2024-09-13T21:48:51.598 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T21:48:51.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T21:48:51.723 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904246 branch: squid description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904246' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3819 sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 sleep_before_teardown: 0 subset: 43/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEP1iJ65NLNzhAN+4rD2U+YUuv7CWwCr1iHCnz0uHhKul+dX056jj3XqEOJE2SSMSO8OzW5FWSLrhgSm06O+2Lg= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMvv1JJzoHa/1MygyaNeUgBLn/UhoEHHXM86Hf5rR0EZBWwhdu4qsY0jbo009DyhfnvB5S4snjG6OKpJiMKDtY= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_21:08:03 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T21:48:51.723 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T21:48:51.724 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T21:48:51.724 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T21:48:51.726 INFO:teuthology.task.internal:Checking packages... 2024-09-13T21:48:51.747 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ecab7be58963a5bd03910cd73eef66405d7fdd50' 2024-09-13T21:48:51.748 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:48:51.748 INFO:teuthology.packaging:ref: None 2024-09-13T21:48:51.748 INFO:teuthology.packaging:tag: None 2024-09-13T21:48:51.748 INFO:teuthology.packaging:branch: squid 2024-09-13T21:48:51.748 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:48:51.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T21:48:51.963 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-324.gecab7be5 2024-09-13T21:48:51.965 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T21:48:51.972 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T21:48:51.972 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T21:48:51.979 INFO:teuthology.task.internal:Saving configuration 2024-09-13T21:48:51.998 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T21:48:52.005 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T21:48:52.039 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904246', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 21:43:47.223898', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEP1iJ65NLNzhAN+4rD2U+YUuv7CWwCr1iHCnz0uHhKul+dX056jj3XqEOJE2SSMSO8OzW5FWSLrhgSm06O+2Lg='} 2024-09-13T21:48:52.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904246', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 21:43:47.225531', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMvv1JJzoHa/1MygyaNeUgBLn/UhoEHHXM86Hf5rR0EZBWwhdu4qsY0jbo009DyhfnvB5S4snjG6OKpJiMKDtY='} 2024-09-13T21:48:52.065 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T21:48:52.071 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T21:48:52.071 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T21:48:52.071 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T21:48:52.141 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6a0082bac0>, signals=[15]) 2024-09-13T21:48:52.141 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T21:48:52.146 INFO:teuthology.task.internal:Opening connections... 2024-09-13T21:48:52.147 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T21:48:52.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:48:52.229 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-09-13T21:48:52.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:48:52.312 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T21:48:52.318 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-13T21:48:52.337 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-13T21:48:52.337 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-09-13T21:48:52.395 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T21:48:52.396 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-09-13T21:48:52.396 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T21:48:52.396 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T21:48:52.396 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T21:48:52.396 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-13T21:48:52.427 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-09-13T21:48:52.445 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-09-13T21:48:52.446 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-09-13T21:48:52.504 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-09-13T21:48:52.504 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-09-13T21:48:52.504 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-09-13T21:48:52.504 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-09-13T21:48:52.504 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-09-13T21:48:52.504 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-09-13T21:48:52.504 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T21:48:52.504 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-09-13T21:48:52.504 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-09-13T21:48:52.505 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T21:48:52.505 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-09-13T21:48:52.505 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T21:48:52.505 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T21:48:52.505 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T21:48:52.505 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-09-13T21:48:52.535 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T21:48:52.545 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T21:48:52.550 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T21:48:52.550 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-13T21:48:52.553 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-09-13T21:48:52.569 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T21:48:52.576 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T21:48:52.576 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-13T21:48:52.609 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-09-13T21:48:52.719 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T21:48:52.789 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T21:48:52.803 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T21:48:52.803 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T21:48:52.804 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T21:48:52.804 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T21:48:52.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:48:52.822 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-13T21:48:52.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:48:52.823 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-09-13T21:48:52.880 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-503.el9.x86_64 2024-09-13T21:48:52.880 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-503.el9.x86_64 2024-09-13T21:48:52.880 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-09-13T21:48:52.881 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-503.el9.x86_64 2024-09-13T21:48:52.882 INFO:teuthology.task.kernel:Running kernel on smithi159: 5.14.0-503.el9.x86_64 2024-09-13T21:48:52.882 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum install -y kernel 2024-09-13T21:48:55.207 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-13T21:48:55.436 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-13T21:48:57.353 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-13T21:48:59.541 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-13T21:49:01.741 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-13T21:49:03.105 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 115 kB/s | 19 kB 00:00 2024-09-13T21:49:04.226 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-13T21:49:04.708 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.5 MB 00:01 2024-09-13T21:49:06.359 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-13T21:49:07.113 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-13T21:49:09.723 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T21:49:11.746 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T21:49:11.747 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T21:49:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:49:11.838 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:49:11.838 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-09-13T21:49:11.838 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout:Install 4 Packages 2024-09-13T21:49:11.839 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:49:11.840 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 79 M 2024-09-13T21:49:11.840 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 126 M 2024-09-13T21:49:11.840 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:49:12.168 INFO:teuthology.orchestra.run.smithi159.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 324 kB/s | 23 kB 00:00 2024-09-13T21:49:12.527 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-13T21:49:12.600 INFO:teuthology.orchestra.run.smithi159.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-13T21:49:13.358 INFO:teuthology.orchestra.run.smithi159.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-13T21:49:13.675 INFO:teuthology.orchestra.run.smithi159.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-13T21:49:13.676 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:49:13.676 INFO:teuthology.orchestra.run.smithi159.stdout:Total 43 MB/s | 79 MB 00:01 2024-09-13T21:49:14.365 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:49:14.525 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T21:49:14.526 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T21:49:14.620 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:49:14.629 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:49:14.630 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-13T21:49:14.631 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:49:14.631 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 79 M 2024-09-13T21:49:14.631 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 126 M 2024-09-13T21:49:14.631 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:49:14.744 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:49:14.744 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:49:14.762 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 262 kB/s | 23 kB 00:00 2024-09-13T21:49:15.674 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:49:15.674 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:49:16.837 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 7.2 MB/s | 16 MB 00:02 2024-09-13T21:49:18.133 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:49:18.420 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 7.8 MB/s | 29 MB 00:03 2024-09-13T21:49:18.863 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:49:18.968 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:49:19.004 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 8.0 MB/s | 35 MB 00:04 2024-09-13T21:49:19.004 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:49:19.004 INFO:teuthology.orchestra.run.smithi089.stdout:Total 18 MB/s | 79 MB 00:04 2024-09-13T21:49:19.681 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:49:20.036 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:49:20.036 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:49:21.018 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:49:21.018 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:49:21.787 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:49:21.914 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:49:23.458 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:49:24.137 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:49:24.230 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:49:26.750 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:49:26.872 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:49:27.063 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:49:27.209 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:49:31.745 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:49:32.052 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:49:32.142 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:49:36.990 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:50:10.240 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:50:10.280 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:50:10.618 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:50:10.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:50:10.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:50:10.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:50:11.468 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:50:11.468 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:50:11.468 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:50:11.468 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T21:50:11.468 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T21:50:11.468 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T21:50:11.468 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T21:50:11.468 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:50:11.468 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:50:11.814 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:50:11.907 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:50:11.907 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:50:11.907 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T21:50:11.908 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T21:50:11.908 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T21:50:11.908 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T21:50:11.908 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T21:50:11.908 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:50:11.967 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:50:11.967 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:50:11.968 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2024-09-13T21:50:12.006 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.06 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 82.el9 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:Group : Unspecified 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 8274670 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T21:50:12.007 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : builder@centos.org 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2024-09-13T21:50:12.008 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:50:12.009 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T21:50:12.009 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T21:50:12.010 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 5.14.0-505.el9.x86_64 2024-09-13T21:50:12.010 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T21:50:12.662 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2024-09-13T21:50:13.975 INFO:teuthology.orchestra.run.smithi159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T21:50:14.013 INFO:teuthology.orchestra.run.smithi159.stderr:done 2024-09-13T21:50:14.014 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-09-13T21:50:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.wJ0TCAZACF 2024-09-13T21:50:14.030 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wJ0TCAZACF 2024-09-13T21:50:14.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.wJ0TCAZACF 2024-09-13T21:50:14.251 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.wJ0TCAZACF is 6KB 2024-09-13T21:50:14.300 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.wJ0TCAZACF 2024-09-13T21:50:14.316 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T21:50:14.378 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T21:50:14.379 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T21:50:14.379 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T21:50:14.379 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T21:50:14.380 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T21:50:14.532 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2024-09-13T21:50:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:50:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:50:15.475 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:50:15.476 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:50:15.476 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:50:15.476 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:50:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:50:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:50:16.314 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:50:16.314 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T21:50:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T21:50:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T21:50:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T21:50:16.315 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:50:16.315 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:50:16.636 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:50:16.771 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:50:16.772 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:50:16.772 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T21:50:16.772 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T21:50:16.772 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T21:50:16.772 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T21:50:16.772 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T21:50:16.772 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:50:16.831 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:50:16.831 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:50:16.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-09-13T21:50:16.863 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-09-13T21:50:16.863 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-09-13T21:50:16.863 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-09-13T21:50:16.863 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 82.el9 2024-09-13T21:50:16.863 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-09-13T21:50:16.863 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8274670 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-09-13T21:50:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-09-13T21:50:16.865 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:50:16.865 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T21:50:16.865 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T21:50:16.865 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T21:50:16.865 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-09-13T21:50:16.865 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:50:16.865 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T21:50:16.866 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T21:50:16.866 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-505.el9.x86_64 2024-09-13T21:50:16.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T21:50:17.535 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-13T21:50:18.819 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T21:50:18.860 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-13T21:50:18.862 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-13T21:50:18.878 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.nRlkEl9JSF 2024-09-13T21:50:18.878 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nRlkEl9JSF 2024-09-13T21:50:18.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.nRlkEl9JSF 2024-09-13T21:50:19.098 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.nRlkEl9JSF is 6KB 2024-09-13T21:50:19.147 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.nRlkEl9JSF 2024-09-13T21:50:19.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T21:50:19.224 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T21:50:19.224 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T21:50:19.224 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T21:50:19.224 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T21:50:19.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T21:50:19.376 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-13T21:50:44.560 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T21:50:44.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-13T21:50:44.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:50:49.385 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T21:50:49.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T21:50:49.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:51:02.973 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-13T21:51:07.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-13T21:51:11.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-13T21:51:11.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:51:15.041 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-13T21:51:16.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T21:51:16.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:51:19.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-13T21:51:27.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-13T21:51:27.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:51:31.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T21:51:31.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:51:45.469 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-13T21:51:50.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-13T21:52:00.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-13T21:52:00.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:52:00.909 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-13T21:52:01.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-13T21:52:01.267 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T21:52:01.267 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-09-13T21:52:01.282 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-505.el9.x86_64 2024-09-13T21:52:01.283 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T21:52:01.283 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T21:52:01.283 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T21:52:02.284 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T21:52:02.285 DEBUG:teuthology.orchestra.run.smithi159:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T21:52:02.348 INFO:teuthology.orchestra.run.smithi159.stdout:ttyS1 2024-09-13T21:52:02.368 DEBUG:teuthology.parallel:result is None 2024-09-13T21:52:05.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T21:52:05.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:52:05.657 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-13T21:52:06.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T21:52:06.090 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T21:52:06.090 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-13T21:52:06.104 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-505.el9.x86_64 2024-09-13T21:52:06.104 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T21:52:06.104 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T21:52:06.104 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T21:52:07.105 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T21:52:07.105 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T21:52:07.250 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-09-13T21:52:07.283 DEBUG:teuthology.parallel:result is None 2024-09-13T21:52:07.284 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T21:52:07.291 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T21:52:07.291 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T21:52:07.296 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T21:52:07.326 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T21:52:07.333 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T21:52:07.340 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T21:52:07.341 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T21:52:07.374 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T21:52:07.419 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T21:52:07.426 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T21:52:07.426 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T21:52:07.462 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T21:52:07.493 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:52:07.505 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:52:07.594 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:52:07.612 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:52:07.615 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T21:52:07.621 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T21:52:07.621 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T21:52:07.628 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T21:52:07.686 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T21:52:07.695 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T21:52:07.695 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T21:52:07.697 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T21:52:07.723 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:52:07.833 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:52:07.914 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:52:07.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:52:08.068 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T21:52:08.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T21:52:08.129 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:52:08.189 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:52:08.235 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:52:08.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:52:08.365 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T21:52:08.365 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T21:52:08.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-13T21:52:08.437 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-09-13T21:52:08.489 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T21:52:08.530 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T21:52:09.032 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T21:52:09.080 INFO:teuthology.task.internal:Starting timer... 2024-09-13T21:52:09.080 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T21:52:09.090 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T21:52:09.098 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-13T21:52:09.098 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-09-13T21:52:09.148 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-09-13T21:52:09.149 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2024-09-13T21:52:09.213 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2024-09-13T21:52:09.215 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T21:52:09.216 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-09-13T21:52:09.235 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-09-13T21:52:09.236 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2024-09-13T21:52:09.289 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2024-09-13T21:52:09.289 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2024-09-13T21:52:09.289 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T21:52:09.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:52:09.315 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T21:52:09.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:52:09.344 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T21:52:09.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-09-13T21:52:09.392 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2024-09-13T21:52:09.428 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T21:52:09.441 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T21:52:09.444 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T21:52:09.585 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T21:52:09.596 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T21:52:09.597 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T21:55:54.065 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2024-09-13T21:55:54.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T21:55:54.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:55:54.179 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-13T21:55:54.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T21:55:54.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-13T21:55:54.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:55:54.339 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-13T21:55:54.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-13T21:55:54.416 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T21:55:54.430 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T21:55:54.430 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T21:55:54.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T21:55:54.433 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T21:55:54.433 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T21:55:54.459 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T21:55:54.474 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T21:55:54.484 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T21:55:54.498 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-09-13T21:55:54.498 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T21:55:54.509 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-09-13T21:55:54.523 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T21:55:54.523 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2024-09-13T21:55:54.534 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2024-09-13T21:55:54.536 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T21:55:54.549 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T21:55:54.562 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T21:55:54.591 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-13T21:55:54.594 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T21:55:54.594 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-13T21:55:54.594 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:54.594 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:54.594 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:54.595 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:54.618 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-13T21:55:54.621 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T21:55:54.621 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-13T21:55:54.621 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:54.621 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:54.621 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:54.621 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:55:54.622 INFO:teuthology.run_tasks:Running task install... 2024-09-13T21:55:54.630 DEBUG:teuthology.task.install:project ceph 2024-09-13T21:55:54.630 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}} 2024-09-13T21:55:54.630 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T21:55:54.631 INFO:teuthology.task.install:Using flavor: default 2024-09-13T21:55:54.637 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T21:55:54.637 INFO:teuthology.task.install:extra packages: [] 2024-09-13T21:55:54.637 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T21:55:54.638 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:55:54.638 INFO:teuthology.packaging:ref: None 2024-09-13T21:55:54.638 INFO:teuthology.packaging:tag: None 2024-09-13T21:55:54.638 INFO:teuthology.packaging:branch: reef 2024-09-13T21:55:54.638 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:55:54.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T21:55:54.640 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T21:55:54.640 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:55:54.640 INFO:teuthology.packaging:ref: None 2024-09-13T21:55:54.641 INFO:teuthology.packaging:tag: None 2024-09-13T21:55:54.641 INFO:teuthology.packaging:branch: reef 2024-09-13T21:55:54.641 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:55:54.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T21:55:54.907 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/ 2024-09-13T21:55:54.907 INFO:teuthology.task.install.rpm:Package version is 18.2.4-845.ge4e227b3 2024-09-13T21:55:54.954 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/ 2024-09-13T21:55:54.954 INFO:teuthology.task.install.rpm:Package version is 18.2.4-845.ge4e227b3 2024-09-13T21:55:55.029 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T21:55:55.029 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T21:55:55.029 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T21:55:55.057 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T21:55:55.057 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:55:55.057 INFO:teuthology.packaging:ref: None 2024-09-13T21:55:55.057 INFO:teuthology.packaging:tag: None 2024-09-13T21:55:55.057 INFO:teuthology.packaging:branch: reef 2024-09-13T21:55:55.057 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:55:55.057 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T21:55:55.073 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T21:55:55.074 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T21:55:55.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T21:55:55.100 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T21:55:55.101 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:55:55.101 INFO:teuthology.packaging:ref: None 2024-09-13T21:55:55.101 INFO:teuthology.packaging:tag: None 2024-09-13T21:55:55.101 INFO:teuthology.packaging:branch: reef 2024-09-13T21:55:55.101 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:55:55.101 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T21:55:55.124 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T21:55:55.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T21:55:55.200 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T21:55:55.243 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T21:55:55.265 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2024-09-13T21:55:55.266 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2024-09-13T21:55:55.308 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-09-13T21:55:55.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-09-13T21:55:55.491 INFO:teuthology.orchestra.run.smithi159.stdout:45 files removed 2024-09-13T21:55:55.519 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw 2024-09-13T21:55:55.545 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-09-13T21:55:55.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw 2024-09-13T21:55:56.076 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 284 kB/s | 77 kB 00:00 2024-09-13T21:55:56.113 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 297 kB/s | 77 kB 00:00 2024-09-13T21:55:56.376 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-13T21:55:56.397 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T21:55:56.652 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-13T21:55:56.673 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-13T21:55:57.118 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-13T21:55:57.498 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-13T21:55:59.029 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-13T21:55:59.475 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-13T21:56:03.717 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-13T21:56:04.879 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-13T21:56:05.335 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-13T21:56:06.388 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 19 kB 00:00 2024-09-13T21:56:06.615 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-13T21:56:07.684 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-13T21:56:12.096 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-13T21:56:13.098 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T21:56:14.446 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:56:14.482 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:56:14.482 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T21:56:14.482 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:56:14.482 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:56:14.482 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 7.7 M 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.3 M 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.0 M 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 5.1 M 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 18 M 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 25 k 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T21:56:14.483 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 712 k 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 478 k 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 4.5 M 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T21:56:14.484 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 45 k 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 129 k 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 162 k 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 321 k 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 300 k 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 99 k 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:56:14.485 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:56:14.486 INFO:teuthology.orchestra.run.smithi089.stdout:Install 28 Packages 2024-09-13T21:56:14.486 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2024-09-13T21:56:14.486 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:14.486 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 53 M 2024-09-13T21:56:14.486 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:56:15.263 INFO:teuthology.orchestra.run.smithi089.stdout:(1/30): ceph-base-18.2.4-845.ge4e227b3.el9.x86_ 10 MB/s | 5.1 MB 00:00 2024-09-13T21:56:15.313 INFO:teuthology.orchestra.run.smithi089.stdout:(2/30): ceph-selinux-18.2.4-845.ge4e227b3.el9.x 503 kB/s | 25 kB 00:00 2024-09-13T21:56:15.405 INFO:teuthology.orchestra.run.smithi089.stdout:(3/30): libcephfs2-18.2.4-845.ge4e227b3.el9.x86 7.6 MB/s | 712 kB 00:00 2024-09-13T21:56:15.458 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:56:15.461 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:56:15.461 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-13T21:56:15.461 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:56:15.461 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:56:15.461 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 7.7 M 2024-09-13T21:56:15.461 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-09-13T21:56:15.461 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.3 M 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.0 M 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 5.1 M 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 18 M 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 25 k 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T21:56:15.462 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 712 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 478 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 4.5 M 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 45 k 2024-09-13T21:56:15.463 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 129 k 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 162 k 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 321 k 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 300 k 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 99 k 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:Install 28 Packages 2024-09-13T21:56:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 2 Packages 2024-09-13T21:56:15.465 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 53 M 2024-09-13T21:56:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:56:15.497 INFO:teuthology.orchestra.run.smithi089.stdout:(4/30): libradosstriper1-18.2.4-845.ge4e227b3.e 5.1 MB/s | 478 kB 00:00 2024-09-13T21:56:15.598 INFO:teuthology.orchestra.run.smithi089.stdout:(5/30): ceph-radosgw-18.2.4-845.ge4e227b3.el9.x 9.4 MB/s | 7.7 MB 00:00 2024-09-13T21:56:15.773 INFO:teuthology.orchestra.run.smithi089.stdout:(6/30): ceph-common-18.2.4-845.ge4e227b3.el9.x8 18 MB/s | 18 MB 00:00 2024-09-13T21:56:15.798 INFO:teuthology.orchestra.run.smithi089.stdout:(7/30): python3-ceph-argparse-18.2.4-845.ge4e22 224 kB/s | 45 kB 00:00 2024-09-13T21:56:15.825 INFO:teuthology.orchestra.run.smithi089.stdout:(8/30): python3-ceph-common-18.2.4-845.ge4e227b 2.5 MB/s | 129 kB 00:00 2024-09-13T21:56:15.849 INFO:teuthology.orchestra.run.smithi089.stdout:(9/30): python3-cephfs-18.2.4-845.ge4e227b3.el9 3.1 MB/s | 162 kB 00:00 2024-09-13T21:56:15.874 INFO:teuthology.orchestra.run.smithi089.stdout:(10/30): python3-rados-18.2.4-845.ge4e227b3.el9 6.2 MB/s | 321 kB 00:00 2024-09-13T21:56:15.900 INFO:teuthology.orchestra.run.smithi089.stdout:(11/30): python3-rbd-18.2.4-845.ge4e227b3.el9.x 5.8 MB/s | 300 kB 00:00 2024-09-13T21:56:15.975 INFO:teuthology.orchestra.run.smithi089.stdout:(12/30): librgw2-18.2.4-845.ge4e227b3.el9.x86_6 9.3 MB/s | 4.5 MB 00:00 2024-09-13T21:56:15.992 INFO:teuthology.orchestra.run.smithi089.stdout:(13/30): python3-rgw-18.2.4-845.ge4e227b3.el9.x 844 kB/s | 99 kB 00:00 2024-09-13T21:56:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:(1/30): ceph-base-18.2.4-845.ge4e227b3.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-13T21:56:16.100 INFO:teuthology.orchestra.run.smithi159.stdout:(2/30): ceph-selinux-18.2.4-845.ge4e227b3.el9.x 604 kB/s | 25 kB 00:00 2024-09-13T21:56:16.109 INFO:teuthology.orchestra.run.smithi089.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 511 kB/s | 107 kB 00:00 2024-09-13T21:56:16.134 INFO:teuthology.orchestra.run.smithi089.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 319 kB/s | 45 kB 00:00 2024-09-13T21:56:16.160 INFO:teuthology.orchestra.run.smithi089.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 870 kB/s | 160 kB 00:00 2024-09-13T21:56:16.175 INFO:teuthology.orchestra.run.smithi159.stdout:(3/30): libcephfs2-18.2.4-845.ge4e227b3.el9.x86 9.3 MB/s | 712 kB 00:00 2024-09-13T21:56:16.210 INFO:teuthology.orchestra.run.smithi089.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 845 kB/s | 42 kB 00:00 2024-09-13T21:56:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-13T21:56:16.277 INFO:teuthology.orchestra.run.smithi089.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-13T21:56:16.311 INFO:teuthology.orchestra.run.smithi089.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-09-13T21:56:16.317 INFO:teuthology.orchestra.run.smithi159.stdout:(4/30): ceph-radosgw-18.2.4-845.ge4e227b3.el9.x 12 MB/s | 7.7 MB 00:00 2024-09-13T21:56:16.345 INFO:teuthology.orchestra.run.smithi089.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T21:56:16.351 INFO:teuthology.orchestra.run.smithi159.stdout:(5/30): libradosstriper1-18.2.4-845.ge4e227b3.e 2.7 MB/s | 478 kB 00:00 2024-09-13T21:56:16.370 INFO:teuthology.orchestra.run.smithi089.stdout:(22/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.4 MB/s | 308 kB 00:00 2024-09-13T21:56:16.395 INFO:teuthology.orchestra.run.smithi089.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-09-13T21:56:16.410 INFO:teuthology.orchestra.run.smithi159.stdout:(6/30): python3-ceph-argparse-18.2.4-845.ge4e22 772 kB/s | 45 kB 00:00 2024-09-13T21:56:16.420 INFO:teuthology.orchestra.run.smithi089.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T21:56:16.446 INFO:teuthology.orchestra.run.smithi089.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-13T21:56:16.476 INFO:teuthology.orchestra.run.smithi159.stdout:(7/30): python3-ceph-common-18.2.4-845.ge4e227b 1.9 MB/s | 129 kB 00:00 2024-09-13T21:56:16.488 INFO:teuthology.orchestra.run.smithi089.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-13T21:56:16.538 INFO:teuthology.orchestra.run.smithi089.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T21:56:16.552 INFO:teuthology.orchestra.run.smithi159.stdout:(8/30): librgw2-18.2.4-845.ge4e227b3.el9.x86_64 19 MB/s | 4.5 MB 00:00 2024-09-13T21:56:16.577 INFO:teuthology.orchestra.run.smithi159.stdout:(9/30): python3-cephfs-18.2.4-845.ge4e227b3.el9 1.6 MB/s | 162 kB 00:00 2024-09-13T21:56:16.627 INFO:teuthology.orchestra.run.smithi159.stdout:(10/30): python3-rados-18.2.4-845.ge4e227b3.el9 4.2 MB/s | 321 kB 00:00 2024-09-13T21:56:16.669 INFO:teuthology.orchestra.run.smithi159.stdout:(11/30): python3-rbd-18.2.4-845.ge4e227b3.el9.x 3.2 MB/s | 300 kB 00:00 2024-09-13T21:56:16.680 INFO:teuthology.orchestra.run.smithi089.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T21:56:16.719 INFO:teuthology.orchestra.run.smithi159.stdout:(12/30): python3-rgw-18.2.4-845.ge4e227b3.el9.x 1.1 MB/s | 99 kB 00:00 2024-09-13T21:56:16.738 INFO:teuthology.orchestra.run.smithi089.stdout:(29/30): librados2-18.2.4-845.ge4e227b3.el9.x86 13 MB/s | 3.3 MB 00:00 2024-09-13T21:56:16.805 INFO:teuthology.orchestra.run.smithi089.stdout:(30/30): librbd1-18.2.4-845.ge4e227b3.el9.x86_6 11 MB/s | 3.0 MB 00:00 2024-09-13T21:56:16.810 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:56:16.810 INFO:teuthology.orchestra.run.smithi089.stdout:Total 23 MB/s | 53 MB 00:02 2024-09-13T21:56:16.879 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:56:16.903 INFO:teuthology.orchestra.run.smithi159.stdout:(13/30): ceph-common-18.2.4-845.ge4e227b3.el9.x 15 MB/s | 18 MB 00:01 2024-09-13T21:56:16.914 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:56:16.914 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:56:16.987 INFO:teuthology.orchestra.run.smithi159.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 337 kB/s | 107 kB 00:00 2024-09-13T21:56:17.004 INFO:teuthology.orchestra.run.smithi159.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-13T21:56:17.037 INFO:teuthology.orchestra.run.smithi159.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 504 kB/s | 160 kB 00:00 2024-09-13T21:56:17.079 INFO:teuthology.orchestra.run.smithi159.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-13T21:56:17.113 INFO:teuthology.orchestra.run.smithi159.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 562 kB/s | 42 kB 00:00 2024-09-13T21:56:17.138 INFO:teuthology.orchestra.run.smithi159.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-13T21:56:17.188 INFO:teuthology.orchestra.run.smithi159.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.0 MB/s | 111 kB 00:00 2024-09-13T21:56:17.214 INFO:teuthology.orchestra.run.smithi159.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-13T21:56:17.239 INFO:teuthology.orchestra.run.smithi159.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T21:56:17.264 INFO:teuthology.orchestra.run.smithi159.stdout:(23/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.0 MB/s | 308 kB 00:00 2024-09-13T21:56:17.289 INFO:teuthology.orchestra.run.smithi159.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T21:56:17.323 INFO:teuthology.orchestra.run.smithi159.stdout:(25/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-13T21:56:17.348 INFO:teuthology.orchestra.run.smithi159.stdout:(26/30): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-13T21:56:17.415 INFO:teuthology.orchestra.run.smithi159.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T21:56:17.491 INFO:teuthology.orchestra.run.smithi159.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-13T21:56:17.530 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:56:17.531 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:56:17.557 INFO:teuthology.orchestra.run.smithi159.stdout:(29/30): librados2-18.2.4-845.ge4e227b3.el9.x86 16 MB/s | 3.3 MB 00:00 2024-09-13T21:56:17.649 INFO:teuthology.orchestra.run.smithi159.stdout:(30/30): librbd1-18.2.4-845.ge4e227b3.el9.x86_6 13 MB/s | 3.0 MB 00:00 2024-09-13T21:56:17.655 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:56:17.655 INFO:teuthology.orchestra.run.smithi159.stdout:Total 24 MB/s | 53 MB 00:02 2024-09-13T21:56:17.729 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:56:17.763 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:56:17.764 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:56:18.383 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:56:18.383 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:56:18.946 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:56:19.037 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T21:56:19.069 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T21:56:19.120 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T21:56:19.490 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T21:56:19.543 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T21:56:19.619 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T21:56:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 6/32 2024-09-13T21:56:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T21:56:19.761 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:56:19.783 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T21:56:19.820 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T21:56:19.851 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T21:56:19.864 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x 9/32 2024-09-13T21:56:19.888 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T21:56:19.932 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 10/32 2024-09-13T21:56:19.938 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T21:56:19.956 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T21:56:20.006 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T21:56:20.113 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T21:56:20.148 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T21:56:20.188 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T21:56:20.245 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T21:56:20.272 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T21:56:20.283 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T21:56:20.309 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T21:56:20.351 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T21:56:20.370 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T21:56:20.462 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T21:56:20.557 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 6/32 2024-09-13T21:56:20.580 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T21:56:20.643 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T21:56:20.651 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T21:56:20.671 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T21:56:20.696 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 20/32 2024-09-13T21:56:20.715 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x 9/32 2024-09-13T21:56:20.788 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 20/32 2024-09-13T21:56:20.790 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 10/32 2024-09-13T21:56:20.816 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T21:56:20.818 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 21/32 2024-09-13T21:56:20.853 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T21:56:20.890 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T21:56:20.996 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T21:56:21.032 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T21:56:21.079 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T21:56:21.113 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T21:56:21.140 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T21:56:21.176 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T21:56:21.210 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T21:56:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T21:56:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 24/32 2024-09-13T21:56:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 24/32 2024-09-13T21:56:21.439 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 25/32 2024-09-13T21:56:21.468 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86 26/32 2024-09-13T21:56:21.507 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T21:56:21.564 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 20/32 2024-09-13T21:56:21.654 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 20/32 2024-09-13T21:56:21.685 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 21/32 2024-09-13T21:56:21.721 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T21:56:22.125 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T21:56:22.150 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 24/32 2024-09-13T21:56:22.221 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 24/32 2024-09-13T21:56:22.289 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 25/32 2024-09-13T21:56:22.327 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86 26/32 2024-09-13T21:56:23.581 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T21:56:23.632 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T21:56:24.183 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T21:56:24.219 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 28/32 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 28/32 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:24.354 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T21:56:24.451 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T21:56:24.490 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T21:56:25.045 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T21:56:25.094 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 28/32 2024-09-13T21:56:25.187 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 28/32 2024-09-13T21:56:25.187 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T21:56:25.187 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T21:56:25.187 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:25.220 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T21:56:34.411 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T21:56:34.411 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-09-13T21:56:34.411 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-09-13T21:56:34.411 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-09-13T21:56:34.411 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-09-13T21:56:34.412 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-09-13T21:56:34.412 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-09-13T21:56:34.412 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-09-13T21:56:34.412 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 30/32 2024-09-13T21:56:35.171 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 30/32 2024-09-13T21:56:35.171 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:35.171 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T21:56:35.171 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:56:35.171 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:56:35.171 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:35.173 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T21:56:35.226 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T21:56:35.227 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2024-09-13T21:56:35.227 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2024-09-13T21:56:35.227 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2024-09-13T21:56:35.227 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2024-09-13T21:56:35.227 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2024-09-13T21:56:35.227 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2024-09-13T21:56:35.227 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2024-09-13T21:56:35.227 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:35.248 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T21:56:35.248 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:56:35.996 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 30/32 2024-09-13T21:56:36.021 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 30/32 2024-09-13T21:56:36.021 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:36.021 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T21:56:36.021 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:56:36.021 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:56:36.021 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:36.023 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T21:56:36.107 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T21:56:36.107 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:56:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:56:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 1/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 3/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 4/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 6/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x 8/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86 9/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 10/32 2024-09-13T21:56:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 12/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 13/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T21:56:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T21:56:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T21:56:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T21:56:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T21:56:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T21:56:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T21:56:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T21:56:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T21:56:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 31/32 2024-09-13T21:56:37.256 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:56:37.256 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 1/32 2024-09-13T21:56:37.256 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2/32 2024-09-13T21:56:37.256 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 3/32 2024-09-13T21:56:37.256 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 4/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 6/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x 8/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86 9/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 10/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 12/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 13/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T21:56:37.257 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T21:56:37.258 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T21:56:37.259 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T21:56:37.259 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T21:56:37.259 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 31/32 2024-09-13T21:56:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:56:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:37.508 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-09-13T21:56:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.508 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.509 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.510 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T21:56:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T21:56:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T21:56:37.511 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:37.511 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:56:37.908 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-test 2024-09-13T21:56:38.309 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.310 INFO:teuthology.orchestra.run.smithi159.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T21:56:38.311 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T21:56:38.311 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T21:56:38.311 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T21:56:38.311 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.311 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T21:56:38.311 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T21:56:38.311 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T21:56:38.311 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.311 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:38.312 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T21:56:38.313 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T21:56:38.313 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:38.313 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:56:38.472 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:26 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:56:38.605 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:56:38.605 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:56:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 40 M 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 166 k 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-13T21:56:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:38.607 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 40 M 2024-09-13T21:56:38.607 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 164 M 2024-09-13T21:56:38.607 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:56:38.645 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-test 2024-09-13T21:56:39.082 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): libcephsqlite-18.2.4-845.ge4e227b3.el9.x 758 kB/s | 166 kB 00:00 2024-09-13T21:56:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:26 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:56:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:56:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:56:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 40 M 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 166 k 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:56:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:Install 4 Packages 2024-09-13T21:56:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 40 M 2024-09-13T21:56:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 164 M 2024-09-13T21:56:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:56:39.408 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 558 kB/s | 304 kB 00:00 2024-09-13T21:56:39.449 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 174 kB/s | 64 kB 00:00 2024-09-13T21:56:39.697 INFO:teuthology.orchestra.run.smithi159.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-13T21:56:39.747 INFO:teuthology.orchestra.run.smithi159.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T21:56:39.848 INFO:teuthology.orchestra.run.smithi159.stdout:(3/4): libcephsqlite-18.2.4-845.ge4e227b3.el9.x 475 kB/s | 166 kB 00:00 2024-09-13T21:56:40.166 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): ceph-test-18.2.4-845.ge4e227b3.el9.x86_6 30 MB/s | 40 MB 00:01 2024-09-13T21:56:40.168 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:56:40.168 INFO:teuthology.orchestra.run.smithi089.stdout:Total 26 MB/s | 40 MB 00:01 2024-09-13T21:56:40.196 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:56:40.215 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:56:40.215 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:56:40.548 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:56:40.548 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:56:40.906 INFO:teuthology.orchestra.run.smithi159.stdout:(4/4): ceph-test-18.2.4-845.ge4e227b3.el9.x86_6 28 MB/s | 40 MB 00:01 2024-09-13T21:56:40.908 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:56:40.909 INFO:teuthology.orchestra.run.smithi159.stdout:Total 26 MB/s | 40 MB 00:01 2024-09-13T21:56:40.936 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:56:40.956 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:56:40.956 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:56:41.039 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:56:41.118 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T21:56:41.157 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T21:56:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 3/4 2024-09-13T21:56:41.278 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:56:41.279 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:56:41.754 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:56:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T21:56:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T21:56:41.908 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 3/4 2024-09-13T21:56:44.897 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 3/4 2024-09-13T21:56:44.983 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 4/4 2024-09-13T21:56:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 3/4 2024-09-13T21:56:45.664 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 4/4 2024-09-13T21:56:46.903 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 4/4 2024-09-13T21:56:46.903 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 1/4 2024-09-13T21:56:46.903 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 2/4 2024-09-13T21:56:46.903 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T21:56:47.197 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T21:56:47.197 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:47.198 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:56:47.198 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:47.198 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:47.198 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T21:56:47.198 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T21:56:47.198 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:47.198 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:56:47.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph 2024-09-13T21:56:47.727 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 4/4 2024-09-13T21:56:47.727 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 1/4 2024-09-13T21:56:47.727 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 2/4 2024-09-13T21:56:47.727 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T21:56:48.037 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T21:56:48.037 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:48.037 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:56:48.037 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:48.037 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:48.037 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T21:56:48.038 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T21:56:48.038 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:48.038 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:56:48.084 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:56:48.224 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:56:48.226 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:56:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T21:56:48.226 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:56:48.226 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:56:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 6.5 k 2024-09-13T21:56:48.226 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T21:56:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 2.1 M 2024-09-13T21:56:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 1.5 M 2024-09-13T21:56:48.226 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 246 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 4.7 M 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 17 M 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T21:56:48.227 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T21:56:48.228 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T21:56:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T21:56:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T21:56:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T21:56:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:48.229 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:56:48.229 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:56:48.229 INFO:teuthology.orchestra.run.smithi089.stdout:Install 33 Packages 2024-09-13T21:56:48.229 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:48.230 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 29 M 2024-09-13T21:56:48.230 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 104 M 2024-09-13T21:56:48.230 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:56:48.348 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph 2024-09-13T21:56:48.527 INFO:teuthology.orchestra.run.smithi089.stdout:(1/33): ceph-18.2.4-845.ge4e227b3.el9.x86_64.rp 52 kB/s | 6.5 kB 00:00 2024-09-13T21:56:48.677 INFO:teuthology.orchestra.run.smithi089.stdout:(2/33): ceph-mgr-18.2.4-845.ge4e227b3.el9.x86_6 5.3 MB/s | 1.5 MB 00:00 2024-09-13T21:56:48.744 INFO:teuthology.orchestra.run.smithi089.stdout:(3/33): ceph-mds-18.2.4-845.ge4e227b3.el9.x86_6 6.1 MB/s | 2.1 MB 00:00 2024-09-13T21:56:48.845 INFO:teuthology.orchestra.run.smithi089.stdout:(4/33): ceph-mon-18.2.4-845.ge4e227b3.el9.x86_6 15 MB/s | 4.7 MB 00:00 2024-09-13T21:56:48.870 INFO:teuthology.orchestra.run.smithi089.stdout:(5/33): ceph-mgr-modules-core-18.2.4-845.ge4e22 1.9 MB/s | 246 kB 00:00 2024-09-13T21:56:48.913 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:35 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:56:49.037 INFO:teuthology.orchestra.run.smithi089.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-13T21:56:49.053 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:56:49.055 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:56:49.056 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-13T21:56:49.056 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:56:49.056 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:56:49.056 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 6.5 k 2024-09-13T21:56:49.056 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-13T21:56:49.056 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 2.1 M 2024-09-13T21:56:49.057 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 1.5 M 2024-09-13T21:56:49.057 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 246 k 2024-09-13T21:56:49.057 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 4.7 M 2024-09-13T21:56:49.057 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 17 M 2024-09-13T21:56:49.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T21:56:49.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T21:56:49.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T21:56:49.058 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T21:56:49.058 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T21:56:49.058 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T21:56:49.058 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T21:56:49.058 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T21:56:49.058 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T21:56:49.058 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T21:56:49.058 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T21:56:49.059 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T21:56:49.059 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T21:56:49.059 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T21:56:49.059 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T21:56:49.059 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T21:56:49.059 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T21:56:49.059 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T21:56:49.060 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T21:56:49.060 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T21:56:49.060 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T21:56:49.060 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T21:56:49.060 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T21:56:49.061 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T21:56:49.061 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T21:56:49.061 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T21:56:49.061 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T21:56:49.061 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:49.062 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:56:49.062 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:56:49.062 INFO:teuthology.orchestra.run.smithi159.stdout:Install 33 Packages 2024-09-13T21:56:49.062 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:49.062 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 29 M 2024-09-13T21:56:49.063 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 104 M 2024-09-13T21:56:49.063 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:56:49.087 INFO:teuthology.orchestra.run.smithi089.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-13T21:56:49.287 INFO:teuthology.orchestra.run.smithi089.stdout:(8/33): ceph-osd-18.2.4-845.ge4e227b3.el9.x86_6 27 MB/s | 17 MB 00:00 2024-09-13T21:56:49.313 INFO:teuthology.orchestra.run.smithi089.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 600 kB/s | 135 kB 00:00 2024-09-13T21:56:49.380 INFO:teuthology.orchestra.run.smithi089.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-09-13T21:56:49.430 INFO:teuthology.orchestra.run.smithi089.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-13T21:56:49.472 INFO:teuthology.orchestra.run.smithi089.stdout:(12/33): python3-requests-2.25.1-8.el9.noarch.r 678 kB/s | 125 kB 00:00 2024-09-13T21:56:49.489 INFO:teuthology.orchestra.run.smithi089.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 591 kB/s | 35 kB 00:00 2024-09-13T21:56:49.523 INFO:teuthology.orchestra.run.smithi089.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-13T21:56:49.540 INFO:teuthology.orchestra.run.smithi089.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-13T21:56:49.557 INFO:teuthology.orchestra.run.smithi089.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 605 kB/s | 51 kB 00:00 2024-09-13T21:56:49.598 INFO:teuthology.orchestra.run.smithi089.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 574 kB/s | 43 kB 00:00 2024-09-13T21:56:49.624 INFO:teuthology.orchestra.run.smithi089.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 464 kB/s | 11 kB 00:00 2024-09-13T21:56:49.675 INFO:teuthology.orchestra.run.smithi089.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-13T21:56:49.675 INFO:teuthology.orchestra.run.smithi089.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 350 kB/s | 18 kB 00:00 2024-09-13T21:56:49.700 INFO:teuthology.orchestra.run.smithi089.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 457 kB/s | 23 kB 00:00 2024-09-13T21:56:49.724 INFO:teuthology.orchestra.run.smithi159.stdout:(1/33): ceph-18.2.4-845.ge4e227b3.el9.x86_64.rp 44 kB/s | 6.5 kB 00:00 2024-09-13T21:56:49.725 INFO:teuthology.orchestra.run.smithi089.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-13T21:56:49.751 INFO:teuthology.orchestra.run.smithi089.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-13T21:56:49.776 INFO:teuthology.orchestra.run.smithi089.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-13T21:56:49.801 INFO:teuthology.orchestra.run.smithi089.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T21:56:49.826 INFO:teuthology.orchestra.run.smithi089.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-13T21:56:49.852 INFO:teuthology.orchestra.run.smithi089.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-13T21:56:49.877 INFO:teuthology.orchestra.run.smithi089.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-13T21:56:49.902 INFO:teuthology.orchestra.run.smithi089.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-09-13T21:56:49.936 INFO:teuthology.orchestra.run.smithi089.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-13T21:56:49.961 INFO:teuthology.orchestra.run.smithi089.stdout:(31/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-13T21:56:49.986 INFO:teuthology.orchestra.run.smithi089.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-09-13T21:56:50.012 INFO:teuthology.orchestra.run.smithi089.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-13T21:56:50.016 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:56:50.017 INFO:teuthology.orchestra.run.smithi089.stdout:Total 16 MB/s | 29 MB 00:01 2024-09-13T21:56:50.058 INFO:teuthology.orchestra.run.smithi159.stdout:(2/33): ceph-mgr-18.2.4-845.ge4e227b3.el9.x86_6 3.0 MB/s | 1.5 MB 00:00 2024-09-13T21:56:50.134 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:56:50.166 INFO:teuthology.orchestra.run.smithi159.stdout:(3/33): ceph-mds-18.2.4-845.ge4e227b3.el9.x86_6 3.6 MB/s | 2.1 MB 00:00 2024-09-13T21:56:50.172 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:56:50.173 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:56:50.233 INFO:teuthology.orchestra.run.smithi159.stdout:(4/33): ceph-mgr-modules-core-18.2.4-845.ge4e22 3.6 MB/s | 246 kB 00:00 2024-09-13T21:56:50.350 INFO:teuthology.orchestra.run.smithi159.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-13T21:56:50.434 INFO:teuthology.orchestra.run.smithi159.stdout:(6/33): python3-cryptography-36.0.1-4.el9.x86_6 15 MB/s | 1.2 MB 00:00 2024-09-13T21:56:50.476 INFO:teuthology.orchestra.run.smithi159.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T21:56:50.534 INFO:teuthology.orchestra.run.smithi159.stdout:(8/33): ceph-mon-18.2.4-845.ge4e227b3.el9.x86_6 5.8 MB/s | 4.7 MB 00:00 2024-09-13T21:56:50.560 INFO:teuthology.orchestra.run.smithi159.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-09-13T21:56:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:56:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:56:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 4.7 MB/s | 215 kB 00:00 2024-09-13T21:56:50.655 INFO:teuthology.orchestra.run.smithi159.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 1.0 MB/s | 125 kB 00:00 2024-09-13T21:56:50.764 INFO:teuthology.orchestra.run.smithi159.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-13T21:56:50.798 INFO:teuthology.orchestra.run.smithi159.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 895 kB/s | 172 kB 00:00 2024-09-13T21:56:50.848 INFO:teuthology.orchestra.run.smithi159.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-09-13T21:56:50.873 INFO:teuthology.orchestra.run.smithi159.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-13T21:56:50.940 INFO:teuthology.orchestra.run.smithi159.stdout:(16/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-13T21:56:50.966 INFO:teuthology.orchestra.run.smithi159.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 370 kB/s | 43 kB 00:00 2024-09-13T21:56:50.991 INFO:teuthology.orchestra.run.smithi159.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 432 kB/s | 11 kB 00:00 2024-09-13T21:56:51.008 INFO:teuthology.orchestra.run.smithi159.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-13T21:56:51.025 INFO:teuthology.orchestra.run.smithi159.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 1.4 MB/s | 23 kB 00:00 2024-09-13T21:56:51.050 INFO:teuthology.orchestra.run.smithi159.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-09-13T21:56:51.067 INFO:teuthology.orchestra.run.smithi159.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 464 kB/s | 19 kB 00:00 2024-09-13T21:56:51.084 INFO:teuthology.orchestra.run.smithi159.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 584 kB/s | 20 kB 00:00 2024-09-13T21:56:51.101 INFO:teuthology.orchestra.run.smithi159.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-09-13T21:56:51.127 INFO:teuthology.orchestra.run.smithi159.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-13T21:56:51.152 INFO:teuthology.orchestra.run.smithi159.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-13T21:56:51.177 INFO:teuthology.orchestra.run.smithi159.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T21:56:51.202 INFO:teuthology.orchestra.run.smithi159.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-13T21:56:51.228 INFO:teuthology.orchestra.run.smithi159.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 709 kB/s | 36 kB 00:00 2024-09-13T21:56:51.253 INFO:teuthology.orchestra.run.smithi159.stdout:(30/33): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-13T21:56:51.278 INFO:teuthology.orchestra.run.smithi159.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-09-13T21:56:51.320 INFO:teuthology.orchestra.run.smithi159.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-09-13T21:56:51.487 INFO:teuthology.orchestra.run.smithi159.stdout:(33/33): ceph-osd-18.2.4-845.ge4e227b3.el9.x86_ 12 MB/s | 17 MB 00:01 2024-09-13T21:56:51.490 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:56:51.490 INFO:teuthology.orchestra.run.smithi159.stdout:Total 12 MB/s | 29 MB 00:02 2024-09-13T21:56:51.603 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:56:51.641 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:56:51.641 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:56:51.804 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:56:51.865 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T21:56:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T21:56:51.930 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T21:56:52.024 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T21:56:52.056 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:56:52.057 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:56:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T21:56:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T21:56:52.205 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T21:56:52.235 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T21:56:52.270 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T21:56:52.303 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T21:56:52.344 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T21:56:52.388 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T21:56:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T21:56:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T21:56:52.543 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T21:56:52.689 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T21:56:52.769 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T21:56:52.830 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T21:56:52.894 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T21:56:52.952 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T21:56:53.006 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T21:56:53.195 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T21:56:53.257 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T21:56:53.267 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:56:53.335 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T21:56:53.340 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T21:56:53.380 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T21:56:53.413 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T21:56:53.433 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T21:56:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T21:56:53.505 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T21:56:53.590 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T21:56:53.591 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T21:56:53.641 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T21:56:53.676 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T21:56:53.707 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T21:56:53.741 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T21:56:53.749 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.n 28/33 2024-09-13T21:56:53.774 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T21:56:53.775 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 29/33 2024-09-13T21:56:53.800 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 29/33 2024-09-13T21:56:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T21:56:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:56:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:56:53.801 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:53.814 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T21:56:53.858 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T21:56:53.892 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T21:56:53.930 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T21:56:54.004 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T21:56:54.170 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T21:56:54.267 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T21:56:54.346 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T21:56:54.390 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T21:56:54.448 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T21:56:54.503 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T21:56:54.693 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T21:56:54.762 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T21:56:54.848 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T21:56:54.954 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T21:56:54.994 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T21:56:55.110 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T21:56:55.262 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.n 28/33 2024-09-13T21:56:55.275 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 30/33 2024-09-13T21:56:55.287 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 29/33 2024-09-13T21:56:55.304 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 30/33 2024-09-13T21:56:55.304 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:55.304 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T21:56:55.304 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:56:55.304 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:56:55.304 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:55.312 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 29/33 2024-09-13T21:56:55.313 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:55.313 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T21:56:55.313 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:56:55.313 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:56:55.313 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:55.752 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 31/33 2024-09-13T21:56:55.776 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 31/33 2024-09-13T21:56:55.776 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:55.776 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T21:56:55.776 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:56:55.777 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:56:55.777 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:55.977 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 32/33 2024-09-13T21:56:56.001 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 32/33 2024-09-13T21:56:56.001 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:56.001 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T21:56:56.001 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:56:56.002 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:56:56.002 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:56.065 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 33/33 2024-09-13T21:56:56.738 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 30/33 2024-09-13T21:56:56.765 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 30/33 2024-09-13T21:56:56.765 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:56.765 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T21:56:56.765 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:56:56.765 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:56:56.765 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:57.206 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 31/33 2024-09-13T21:56:57.229 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 31/33 2024-09-13T21:56:57.229 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:57.229 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T21:56:57.229 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:56:57.230 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:56:57.230 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:57.431 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 32/33 2024-09-13T21:56:57.454 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 32/33 2024-09-13T21:56:57.454 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:56:57.454 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T21:56:57.454 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:56:57.455 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:56:57.455 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:56:57.519 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 33/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 33/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 1/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 2/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 3/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 4/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 5/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.n 6/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T21:56:57.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T21:56:57.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T21:56:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T21:56:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T21:56:57.787 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T21:56:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T21:56:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T21:56:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T21:56:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T21:56:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T21:56:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T21:56:57.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T21:56:58.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T21:56:58.788 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:58.788 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:56:58.788 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:58.788 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:58.788 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:58.788 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:56:58.788 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T21:56:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T21:56:58.790 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T21:56:58.791 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T21:56:58.791 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T21:56:58.791 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T21:56:58.791 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:56:58.791 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:56:59.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-base 2024-09-13T21:56:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 33/33 2024-09-13T21:56:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 1/33 2024-09-13T21:56:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 2/33 2024-09-13T21:56:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 3/33 2024-09-13T21:56:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 4/33 2024-09-13T21:56:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 5/33 2024-09-13T21:56:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.n 6/33 2024-09-13T21:56:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T21:56:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T21:56:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T21:56:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T21:56:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T21:56:59.755 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:56:59.846 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:56:59.887 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:56:59.888 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T21:56:59.888 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:56:59.975 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install cephadm 2024-09-13T21:57:00.335 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T21:57:00.336 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T21:57:00.337 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:00.338 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:00.537 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:00.668 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:00.669 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T21:57:00.669 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:00.669 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 226 k 2024-09-13T21:57:00.669 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:00.669 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:00.669 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:00.670 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T21:57:00.670 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:00.670 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 226 k 2024-09-13T21:57:00.670 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 217 k 2024-09-13T21:57:00.670 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:00.687 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-base 2024-09-13T21:57:00.896 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm-18.2.4-845.ge4e227b3.el9.noarch.rpm 1.0 MB/s | 226 kB 00:00 2024-09-13T21:57:00.897 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:00.897 INFO:teuthology.orchestra.run.smithi089.stdout:Total 993 kB/s | 226 kB 00:00 2024-09-13T21:57:00.897 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:00.902 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:00.902 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:00.905 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:00.905 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:00.974 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:01.260 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:01.350 INFO:teuthology.orchestra.run.smithi159.stdout:Package ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:01.392 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:01.393 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-09-13T21:57:01.393 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:01.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install cephadm 2024-09-13T21:57:01.459 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T21:57:01.550 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T21:57:01.895 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T21:57:02.027 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:02.159 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:02.159 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 226 k 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 226 k 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 217 k 2024-09-13T21:57:02.160 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:02.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T21:57:02.171 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:02.171 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:02.171 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:02.171 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:02.172 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:02.373 INFO:teuthology.orchestra.run.smithi159.stdout:cephadm-18.2.4-845.ge4e227b3.el9.noarch.rpm 1.0 MB/s | 226 kB 00:00 2024-09-13T21:57:02.374 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:02.374 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.0 MB/s | 226 kB 00:00 2024-09-13T21:57:02.374 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:02.380 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:02.380 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:02.382 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:02.383 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:02.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T21:57:02.448 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:02.860 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T21:57:02.936 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T21:57:02.971 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:03.104 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 143 k 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:03.105 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 143 k 2024-09-13T21:57:03.106 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 395 k 2024-09-13T21:57:03.106 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:03.287 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T21:57:03.304 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-immutable-object-cache-18.2.4-845.ge4e227b 721 kB/s | 143 kB 00:00 2024-09-13T21:57:03.304 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:03.305 INFO:teuthology.orchestra.run.smithi089.stdout:Total 715 kB/s | 143 kB 00:00 2024-09-13T21:57:03.305 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:03.312 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:03.312 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:03.369 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:03.369 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:03.521 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:03.536 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T21:57:03.536 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:03.536 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:03.536 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:03.536 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:03.536 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:03.588 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T21:57:03.613 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T21:57:03.613 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:57:03.614 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T21:57:03.614 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:03.753 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T21:57:04.332 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:04.466 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:04.467 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:04.467 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repo Size 2024-09-13T21:57:04.467 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:04.467 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:04.467 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 143 k 2024-09-13T21:57:04.467 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:04.467 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:04.467 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:04.467 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-09-13T21:57:04.468 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:04.468 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 143 k 2024-09-13T21:57:04.468 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 395 k 2024-09-13T21:57:04.468 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:04.500 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T21:57:04.500 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:04.500 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:04.500 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:04.500 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:04.500 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:04.681 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-immutable-object-cache-18.2.4-845.ge4e227b 668 kB/s | 143 kB 00:00 2024-09-13T21:57:04.682 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:04.682 INFO:teuthology.orchestra.run.smithi159.stdout:Total 662 kB/s | 143 kB 00:00 2024-09-13T21:57:04.683 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:04.690 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:04.690 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:04.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr 2024-09-13T21:57:04.748 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:04.748 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:04.991 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T21:57:05.016 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T21:57:05.017 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:57:05.017 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T21:57:05.017 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:05.308 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:05.399 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:05.440 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:05.441 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T21:57:05.442 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:05.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T21:57:05.919 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T21:57:05.919 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:05.920 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:05.920 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:05.920 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:05.920 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:06.089 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:06.135 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr 2024-09-13T21:57:06.221 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:06.222 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:06.222 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T21:57:06.222 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:06.222 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:06.222 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 3.5 M 2024-09-13T21:57:06.222 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T21:57:06.222 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 24 k 2024-09-13T21:57:06.222 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 16 k 2024-09-13T21:57:06.222 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T21:57:06.223 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T21:57:06.223 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:06.223 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:06.223 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:06.223 INFO:teuthology.orchestra.run.smithi089.stdout:Install 5 Packages 2024-09-13T21:57:06.223 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:06.224 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 3.8 M 2024-09-13T21:57:06.224 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 87 M 2024-09-13T21:57:06.224 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:06.409 INFO:teuthology.orchestra.run.smithi089.stdout:(1/5): ceph-prometheus-alerts-18.2.4-845.ge4e22 104 kB/s | 16 kB 00:00 2024-09-13T21:57:06.434 INFO:teuthology.orchestra.run.smithi089.stdout:(2/5): ceph-grafana-dashboards-18.2.4-845.ge4e2 133 kB/s | 24 kB 00:00 2024-09-13T21:57:06.476 INFO:teuthology.orchestra.run.smithi089.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 460 kB/s | 31 kB 00:00 2024-09-13T21:57:06.510 INFO:teuthology.orchestra.run.smithi089.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-09-13T21:57:06.717 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:06.752 INFO:teuthology.orchestra.run.smithi089.stdout:(5/5): ceph-mgr-dashboard-18.2.4-845.ge4e227b3. 7.1 MB/s | 3.5 MB 00:00 2024-09-13T21:57:06.755 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:06.755 INFO:teuthology.orchestra.run.smithi089.stdout:Total 7.1 MB/s | 3.8 MB 00:00 2024-09-13T21:57:06.755 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:06.763 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:06.763 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:06.808 INFO:teuthology.orchestra.run.smithi159.stdout:Package ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:06.842 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:06.843 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:06.851 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:06.852 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-09-13T21:57:06.852 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:06.927 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T21:57:07.089 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:07.183 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-13T21:57:07.216 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-13T21:57:07.269 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.no 3/5 2024-09-13T21:57:07.488 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:07.619 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:07.620 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:07.620 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-13T21:57:07.620 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:07.620 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:07.620 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 3.5 M 2024-09-13T21:57:07.620 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-13T21:57:07.620 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 24 k 2024-09-13T21:57:07.621 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 16 k 2024-09-13T21:57:07.621 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T21:57:07.621 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T21:57:07.621 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:07.621 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:07.621 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:07.621 INFO:teuthology.orchestra.run.smithi159.stdout:Install 5 Packages 2024-09-13T21:57:07.621 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:07.622 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 3.8 M 2024-09-13T21:57:07.622 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 87 M 2024-09-13T21:57:07.622 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:07.927 INFO:teuthology.orchestra.run.smithi159.stdout:(1/5): ceph-grafana-dashboards-18.2.4-845.ge4e2 166 kB/s | 24 kB 00:00 2024-09-13T21:57:07.961 INFO:teuthology.orchestra.run.smithi159.stdout:(2/5): ceph-prometheus-alerts-18.2.4-845.ge4e22 91 kB/s | 16 kB 00:00 2024-09-13T21:57:08.003 INFO:teuthology.orchestra.run.smithi159.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 407 kB/s | 31 kB 00:00 2024-09-13T21:57:08.037 INFO:teuthology.orchestra.run.smithi159.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-09-13T21:57:08.245 INFO:teuthology.orchestra.run.smithi159.stdout:(5/5): ceph-mgr-dashboard-18.2.4-845.ge4e227b3. 7.6 MB/s | 3.5 MB 00:00 2024-09-13T21:57:08.249 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:08.249 INFO:teuthology.orchestra.run.smithi159.stdout:Total 6.0 MB/s | 3.8 MB 00:00 2024-09-13T21:57:08.249 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:08.256 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:08.257 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:08.320 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.n 4/5 2024-09-13T21:57:08.347 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:08.348 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:08.356 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 5/5 2024-09-13T21:57:08.596 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:08.685 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-13T21:57:08.725 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-13T21:57:08.754 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.no 3/5 2024-09-13T21:57:09.393 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 5/5 2024-09-13T21:57:09.393 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.n 1/5 2024-09-13T21:57:09.393 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 2/5 2024-09-13T21:57:09.394 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.no 3/5 2024-09-13T21:57:09.394 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-13T21:57:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-13T21:57:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:09.656 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T21:57:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T21:57:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:09.656 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:09.809 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.n 4/5 2024-09-13T21:57:09.857 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 5/5 2024-09-13T21:57:09.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T21:57:10.446 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:58 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:10.580 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:10.581 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-13T21:57:10.581 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T21:57:10.581 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-13T21:57:10.581 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:10.581 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 7.4 M 2024-09-13T21:57:10.581 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T21:57:10.581 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T21:57:10.581 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-13T21:57:10.582 INFO:teuthology.orchestra.run.smithi089.stdout:Install 12 Packages 2024-09-13T21:57:10.583 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:10.583 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 38 M 2024-09-13T21:57:10.583 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 212 M 2024-09-13T21:57:10.583 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:10.966 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 5/5 2024-09-13T21:57:10.966 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.n 1/5 2024-09-13T21:57:10.966 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 2/5 2024-09-13T21:57:10.966 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.no 3/5 2024-09-13T21:57:10.966 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-13T21:57:11.226 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-13T21:57:11.226 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:11.226 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:11.226 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:11.227 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:11.227 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:11.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T21:57:11.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T21:57:11.227 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:11.227 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:11.293 INFO:teuthology.orchestra.run.smithi089.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.4-84 13 MB/s | 7.4 MB 00:00 2024-09-13T21:57:11.310 INFO:teuthology.orchestra.run.smithi089.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 335 kB/s | 191 kB 00:00 2024-09-13T21:57:11.418 INFO:teuthology.orchestra.run.smithi089.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-13T21:57:11.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T21:57:11.469 INFO:teuthology.orchestra.run.smithi089.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-13T21:57:11.519 INFO:teuthology.orchestra.run.smithi089.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-13T21:57:11.603 INFO:teuthology.orchestra.run.smithi089.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 928 kB/s | 801 kB 00:00 2024-09-13T21:57:11.670 INFO:teuthology.orchestra.run.smithi089.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.3 MB/s | 3.0 MB 00:00 2024-09-13T21:57:11.845 INFO:teuthology.orchestra.run.smithi089.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-09-13T21:57:11.870 INFO:teuthology.orchestra.run.smithi089.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 916 kB/s | 245 kB 00:00 2024-09-13T21:57:11.904 INFO:teuthology.orchestra.run.smithi089.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 4.2 MB/s | 250 kB 00:00 2024-09-13T21:57:11.971 INFO:teuthology.orchestra.run.smithi089.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 11 MB/s | 4.9 MB 00:00 2024-09-13T21:57:12.025 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:12.159 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:12.160 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-13T21:57:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-13T21:57:12.161 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-13T21:57:12.161 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 7.4 M 2024-09-13T21:57:12.161 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-13T21:57:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T21:57:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T21:57:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T21:57:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T21:57:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T21:57:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T21:57:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T21:57:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T21:57:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T21:57:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T21:57:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T21:57:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:12.163 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:12.163 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-13T21:57:12.163 INFO:teuthology.orchestra.run.smithi159.stdout:Install 12 Packages 2024-09-13T21:57:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:12.164 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 38 M 2024-09-13T21:57:12.164 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 212 M 2024-09-13T21:57:12.164 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:12.346 INFO:teuthology.orchestra.run.smithi089.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-13T21:57:12.347 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:12.347 INFO:teuthology.orchestra.run.smithi089.stdout:Total 22 MB/s | 38 MB 00:01 2024-09-13T21:57:12.486 INFO:teuthology.orchestra.run.smithi159.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-13T21:57:12.536 INFO:teuthology.orchestra.run.smithi159.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.0 MB/s | 801 kB 00:00 2024-09-13T21:57:12.553 INFO:teuthology.orchestra.run.smithi159.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-13T21:57:12.586 INFO:teuthology.orchestra.run.smithi159.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 545 kB/s | 18 kB 00:00 2024-09-13T21:57:12.654 INFO:teuthology.orchestra.run.smithi159.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 26 MB/s | 3.0 MB 00:00 2024-09-13T21:57:12.679 INFO:teuthology.orchestra.run.smithi159.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-13T21:57:12.704 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:12.730 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:12.730 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:12.771 INFO:teuthology.orchestra.run.smithi159.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 42 MB/s | 4.9 MB 00:00 2024-09-13T21:57:12.796 INFO:teuthology.orchestra.run.smithi159.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-13T21:57:12.846 INFO:teuthology.orchestra.run.smithi159.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-09-13T21:57:12.913 INFO:teuthology.orchestra.run.smithi159.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-13T21:57:13.047 INFO:teuthology.orchestra.run.smithi159.stdout:(11/12): ceph-mgr-diskprediction-local-18.2.4-8 10 MB/s | 7.4 MB 00:00 2024-09-13T21:57:13.227 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:13.227 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:13.264 INFO:teuthology.orchestra.run.smithi159.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-09-13T21:57:13.265 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:13.265 INFO:teuthology.orchestra.run.smithi159.stdout:Total 35 MB/s | 38 MB 00:01 2024-09-13T21:57:13.625 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:13.649 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:13.650 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:13.983 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:14.061 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T21:57:14.103 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:57:14.154 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:14.154 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:14.205 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:57:14.246 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T21:57:14.433 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T21:57:14.461 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T21:57:14.539 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T21:57:14.908 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:14.972 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T21:57:15.020 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:57:15.128 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:57:15.163 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T21:57:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T21:57:15.327 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T21:57:15.349 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T21:57:15.378 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T21:57:15.455 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T21:57:16.128 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T21:57:16.259 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T21:57:16.612 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:57:17.510 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:57:17.642 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T21:57:17.671 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 12/12 2024-09-13T21:57:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T21:57:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 12/12 2024-09-13T21:57:20.314 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 12/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 1/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:57:20.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T21:57:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T21:57:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:20.766 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T21:57:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T21:57:20.766 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:20.767 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:21.079 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 12/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 1/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:57:21.080 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T21:57:21.115 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-rook 2024-09-13T21:57:21.529 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T21:57:21.529 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:21.529 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:21.529 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:21.529 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T21:57:21.529 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T21:57:21.529 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T21:57:21.529 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T21:57:21.529 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T21:57:21.530 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T21:57:21.530 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T21:57:21.530 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T21:57:21.530 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T21:57:21.530 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T21:57:21.530 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T21:57:21.530 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:21.530 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:21.684 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:09 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:21.819 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 49 k 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T21:57:21.820 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout:Install 13 Packages 2024-09-13T21:57:21.821 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:21.822 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.2 M 2024-09-13T21:57:21.822 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 26 M 2024-09-13T21:57:21.822 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:21.899 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-rook 2024-09-13T21:57:22.074 INFO:teuthology.orchestra.run.smithi089.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 245 kB/s | 19 kB 00:00 2024-09-13T21:57:22.099 INFO:teuthology.orchestra.run.smithi089.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 247 kB/s | 26 kB 00:00 2024-09-13T21:57:22.157 INFO:teuthology.orchestra.run.smithi089.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-09-13T21:57:22.183 INFO:teuthology.orchestra.run.smithi089.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-13T21:57:22.208 INFO:teuthology.orchestra.run.smithi089.stdout:(5/13): ceph-mgr-rook-18.2.4-845.ge4e227b3.el9. 231 kB/s | 49 kB 00:00 2024-09-13T21:57:22.233 INFO:teuthology.orchestra.run.smithi089.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-13T21:57:22.259 INFO:teuthology.orchestra.run.smithi089.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-13T21:57:22.309 INFO:teuthology.orchestra.run.smithi089.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-13T21:57:22.334 INFO:teuthology.orchestra.run.smithi089.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-13T21:57:22.359 INFO:teuthology.orchestra.run.smithi089.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T21:57:22.385 INFO:teuthology.orchestra.run.smithi089.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-13T21:57:22.410 INFO:teuthology.orchestra.run.smithi089.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-13T21:57:22.444 INFO:teuthology.orchestra.run.smithi089.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-13T21:57:22.446 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:22.446 INFO:teuthology.orchestra.run.smithi089.stdout:Total 3.5 MB/s | 2.2 MB 00:00 2024-09-13T21:57:22.473 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:09 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:22.509 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:22.524 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:22.524 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:22.608 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 49 k 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T21:57:22.610 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:22.611 INFO:teuthology.orchestra.run.smithi159.stdout:Install 13 Packages 2024-09-13T21:57:22.612 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:22.612 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:22.613 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:22.613 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 2.2 M 2024-09-13T21:57:22.613 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 26 M 2024-09-13T21:57:22.613 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 239 kB/s | 19 kB 00:00 2024-09-13T21:57:22.879 INFO:teuthology.orchestra.run.smithi159.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 243 kB/s | 26 kB 00:00 2024-09-13T21:57:22.946 INFO:teuthology.orchestra.run.smithi159.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-09-13T21:57:22.972 INFO:teuthology.orchestra.run.smithi159.stdout:(4/13): ceph-mgr-rook-18.2.4-845.ge4e227b3.el9. 249 kB/s | 49 kB 00:00 2024-09-13T21:57:22.997 INFO:teuthology.orchestra.run.smithi159.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-13T21:57:23.031 INFO:teuthology.orchestra.run.smithi159.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.2 MB/s | 279 kB 00:00 2024-09-13T21:57:23.073 INFO:teuthology.orchestra.run.smithi159.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 534 kB/s | 54 kB 00:00 2024-09-13T21:57:23.098 INFO:teuthology.orchestra.run.smithi159.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-13T21:57:23.112 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:23.132 INFO:teuthology.orchestra.run.smithi159.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-13T21:57:23.157 INFO:teuthology.orchestra.run.smithi159.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-13T21:57:23.182 INFO:teuthology.orchestra.run.smithi159.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-13T21:57:23.207 INFO:teuthology.orchestra.run.smithi159.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-13T21:57:23.241 INFO:teuthology.orchestra.run.smithi159.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.5 MB/s | 1.0 MB 00:00 2024-09-13T21:57:23.243 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:23.244 INFO:teuthology.orchestra.run.smithi159.stdout:Total 3.5 MB/s | 2.2 MB 00:00 2024-09-13T21:57:23.281 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T21:57:23.307 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:23.322 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:23.322 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:23.337 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T21:57:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T21:57:23.409 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:23.409 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:23.438 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T21:57:23.479 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T21:57:23.579 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T21:57:23.683 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T21:57:23.739 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T21:57:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:24.095 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T21:57:24.158 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T21:57:24.222 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T21:57:24.260 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T21:57:24.301 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T21:57:24.402 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T21:57:24.447 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T21:57:24.496 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T21:57:24.513 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T21:57:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T21:57:24.569 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T21:57:24.578 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T21:57:24.599 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 13/13 2024-09-13T21:57:25.278 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T21:57:25.334 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T21:57:25.376 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T21:57:25.424 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T21:57:25.446 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 13/13 2024-09-13T21:57:25.450 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 13/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 1/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T21:57:25.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T21:57:25.782 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T21:57:25.782 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:25.782 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:25.782 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:25.782 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:25.783 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:26.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T21:57:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 13/13 2024-09-13T21:57:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 1/13 2024-09-13T21:57:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T21:57:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T21:57:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T21:57:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T21:57:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T21:57:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T21:57:26.291 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T21:57:26.292 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T21:57:26.292 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T21:57:26.292 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T21:57:26.292 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T21:57:26.605 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:26.634 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T21:57:26.635 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T21:57:26.636 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T21:57:26.636 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T21:57:26.636 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T21:57:26.636 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T21:57:26.636 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:26.636 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:26.737 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:26.738 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:26.738 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T21:57:26.738 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 139 k 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2024-09-13T21:57:26.739 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:26.740 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 7.0 M 2024-09-13T21:57:26.740 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 33 M 2024-09-13T21:57:26.740 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:26.889 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T21:57:27.307 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-13T21:57:27.366 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-13T21:57:27.391 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-13T21:57:27.416 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): ceph-mgr-cephadm-18.2.4-845.ge4e227b3.el 563 kB/s | 139 kB 00:00 2024-09-13T21:57:27.433 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.7 MB/s | 74 kB 00:00 2024-09-13T21:57:27.460 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:27.533 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-13T21:57:27.535 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:27.535 INFO:teuthology.orchestra.run.smithi089.stdout:Total 8.8 MB/s | 7.0 MB 00:00 2024-09-13T21:57:27.594 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:27.594 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 139 k 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:27.595 INFO:teuthology.orchestra.run.smithi159.stdout:Install 6 Packages 2024-09-13T21:57:27.596 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:27.596 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 7.0 M 2024-09-13T21:57:27.596 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 33 M 2024-09-13T21:57:27.596 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:27.606 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:27.618 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:27.618 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:27.717 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:27.719 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:27.862 INFO:teuthology.orchestra.run.smithi159.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-13T21:57:27.895 INFO:teuthology.orchestra.run.smithi159.stdout:(2/6): ceph-mgr-cephadm-18.2.4-845.ge4e227b3.el 656 kB/s | 139 kB 00:00 2024-09-13T21:57:27.937 INFO:teuthology.orchestra.run.smithi159.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2024-09-13T21:57:27.962 INFO:teuthology.orchestra.run.smithi159.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-13T21:57:28.024 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:28.046 INFO:teuthology.orchestra.run.smithi159.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-13T21:57:28.071 INFO:teuthology.orchestra.run.smithi159.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.6 MB/s | 548 kB 00:00 2024-09-13T21:57:28.073 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:28.074 INFO:teuthology.orchestra.run.smithi159.stdout:Total 15 MB/s | 7.0 MB 00:00 2024-09-13T21:57:28.144 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:28.156 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:28.156 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:28.189 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T21:57:28.235 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T21:57:28.254 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:28.255 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:28.565 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:28.729 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T21:57:28.759 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T21:57:28.773 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T21:57:28.847 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T21:57:28.910 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T21:57:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 6/6 2024-09-13T21:57:29.305 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T21:57:29.401 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T21:57:29.471 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T21:57:29.502 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 6/6 2024-09-13T21:57:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 6/6 2024-09-13T21:57:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/6 2024-09-13T21:57:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T21:57:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T21:57:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T21:57:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T21:57:30.004 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T21:57:30.004 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:30.004 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:30.004 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:30.004 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T21:57:30.004 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T21:57:30.005 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T21:57:30.005 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T21:57:30.005 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T21:57:30.005 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:30.005 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:30.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-fuse 2024-09-13T21:57:30.299 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 6/6 2024-09-13T21:57:30.299 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/6 2024-09-13T21:57:30.299 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T21:57:30.299 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T21:57:30.299 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T21:57:30.299 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T21:57:30.573 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T21:57:30.793 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:30.794 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:30.794 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T21:57:30.794 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T21:57:30.794 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T21:57:30.794 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T21:57:30.794 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T21:57:30.794 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T21:57:30.794 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:30.795 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:30.810 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-fuse 2024-09-13T21:57:30.850 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:30.983 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:30.985 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:30.985 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T21:57:30.985 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:30.985 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:30.985 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 852 k 2024-09-13T21:57:30.985 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T21:57:30.986 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T21:57:30.986 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:30.986 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:30.986 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:30.986 INFO:teuthology.orchestra.run.smithi089.stdout:Install 2 Packages 2024-09-13T21:57:30.986 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:30.987 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 932 k 2024-09-13T21:57:30.987 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 2.7 M 2024-09-13T21:57:30.987 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:31.153 INFO:teuthology.orchestra.run.smithi089.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 540 kB/s | 80 kB 00:00 2024-09-13T21:57:31.303 INFO:teuthology.orchestra.run.smithi089.stdout:(2/2): ceph-fuse-18.2.4-845.ge4e227b3.el9.x86_6 2.8 MB/s | 852 kB 00:00 2024-09-13T21:57:31.304 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:31.304 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.8 MB/s | 932 kB 00:00 2024-09-13T21:57:31.316 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:31.338 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:31.338 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:31.378 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:31.418 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:31.419 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:31.510 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 852 k 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout:Install 2 Packages 2024-09-13T21:57:31.511 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:31.512 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 932 k 2024-09-13T21:57:31.512 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 2.7 M 2024-09-13T21:57:31.512 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T21:57:31.811 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2/2 2024-09-13T21:57:31.915 INFO:teuthology.orchestra.run.smithi159.stdout:(1/2): ceph-fuse-18.2.4-845.ge4e227b3.el9.x86_6 3.0 MB/s | 852 kB 00:00 2024-09-13T21:57:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-13T21:57:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.2 MB/s | 932 kB 00:00 2024-09-13T21:57:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:32.308 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:32.309 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:32.389 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2/2 2024-09-13T21:57:32.562 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/2 2024-09-13T21:57:32.577 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:32.714 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T21:57:32.797 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2/2 2024-09-13T21:57:32.873 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T21:57:32.873 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:32.874 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:32.874 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T21:57:32.874 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:32.874 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:33.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados-devel 2024-09-13T21:57:33.485 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2/2 2024-09-13T21:57:33.486 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/2 2024-09-13T21:57:33.745 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:21 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:33.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T21:57:33.783 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:33.783 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:33.783 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T21:57:33.784 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:33.784 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:33.882 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:33.882 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 127 k 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 127 k 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 456 k 2024-09-13T21:57:33.883 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:34.042 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install librados-devel 2024-09-13T21:57:34.085 INFO:teuthology.orchestra.run.smithi089.stdout:librados-devel-18.2.4-845.ge4e227b3.el9.x86_64. 628 kB/s | 127 kB 00:00 2024-09-13T21:57:34.086 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:34.086 INFO:teuthology.orchestra.run.smithi089.stdout:Total 624 kB/s | 127 kB 00:00 2024-09-13T21:57:34.086 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:34.094 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:34.094 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:34.154 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:34.154 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:34.299 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:34.399 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:21 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repo Size 2024-09-13T21:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 127 k 2024-09-13T21:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-09-13T21:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 127 k 2024-09-13T21:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 456 k 2024-09-13T21:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:34.789 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout:librados-devel-18.2.4-845.ge4e227b3.el9.x86_64. 590 kB/s | 127 kB 00:00 2024-09-13T21:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout:Total 585 kB/s | 127 kB 00:00 2024-09-13T21:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:35.054 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:35.055 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:35.293 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:35.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs2 2024-09-13T21:57:35.732 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:35.930 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:23 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:35.979 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:35.979 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:35.980 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:35.980 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:35.980 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:35.980 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:36.026 INFO:teuthology.orchestra.run.smithi089.stdout:Package libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:36.070 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:36.071 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T21:57:36.071 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:36.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs-devel 2024-09-13T21:57:36.231 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install libcephfs2 2024-09-13T21:57:36.728 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:36.831 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:23 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:36.858 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:36.859 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:36.859 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-13T21:57:36.859 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:36.859 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:36.860 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 31 k 2024-09-13T21:57:36.860 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:36.860 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:36.860 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:36.860 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T21:57:36.860 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:36.860 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 31 k 2024-09-13T21:57:36.860 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 139 k 2024-09-13T21:57:36.860 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:36.933 INFO:teuthology.orchestra.run.smithi159.stdout:Package libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:36.979 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:36.980 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-09-13T21:57:36.980 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:37.015 INFO:teuthology.orchestra.run.smithi089.stdout:libcephfs-devel-18.2.4-845.ge4e227b3.el9.x86_64 200 kB/s | 31 kB 00:00 2024-09-13T21:57:37.016 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:37.016 INFO:teuthology.orchestra.run.smithi089.stdout:Total 199 kB/s | 31 kB 00:00 2024-09-13T21:57:37.016 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:37.019 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:37.019 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:37.041 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:37.041 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:37.051 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install libcephfs-devel 2024-09-13T21:57:37.122 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:37.220 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:37.549 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:37.619 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:37.750 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repo Size 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 31 k 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-09-13T21:57:37.751 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:37.752 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 31 k 2024-09-13T21:57:37.752 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 139 k 2024-09-13T21:57:37.752 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:37.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:37.785 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:37.785 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:37.785 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:37.785 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:37.785 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:37.908 INFO:teuthology.orchestra.run.smithi159.stdout:libcephfs-devel-18.2.4-845.ge4e227b3.el9.x86_64 199 kB/s | 31 kB 00:00 2024-09-13T21:57:37.909 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:37.909 INFO:teuthology.orchestra.run.smithi159.stdout:Total 197 kB/s | 31 kB 00:00 2024-09-13T21:57:37.909 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:37.912 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:37.913 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:37.933 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:37.933 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:37.971 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados2 2024-09-13T21:57:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:38.129 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:38.479 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:38.535 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:38.625 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:38.667 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:38.668 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T21:57:38.668 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:38.713 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:38.713 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:38.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librbd1 2024-09-13T21:57:38.905 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install librados2 2024-09-13T21:57:39.322 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:39.409 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:39.452 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:39.453 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T21:57:39.456 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:39.469 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:39.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rados 2024-09-13T21:57:39.559 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:39.602 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:39.603 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-09-13T21:57:39.603 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:39.671 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install librbd1 2024-09-13T21:57:40.097 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:40.186 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:40.228 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:40.229 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T21:57:40.229 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:40.240 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:40.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rgw 2024-09-13T21:57:40.332 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:40.376 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:40.377 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-09-13T21:57:40.377 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:40.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-rados 2024-09-13T21:57:40.874 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:40.964 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:41.006 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:41.007 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T21:57:41.007 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:41.022 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:41.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-cephfs 2024-09-13T21:57:41.113 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:41.155 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:41.157 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-09-13T21:57:41.157 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:41.229 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-rgw 2024-09-13T21:57:41.658 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:41.748 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:41.790 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:41.792 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T21:57:41.792 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:41.799 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:41.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rbd 2024-09-13T21:57:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-09-13T21:57:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:42.005 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-cephfs 2024-09-13T21:57:42.438 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:42.525 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:42.567 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:42.568 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T21:57:42.569 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:42.574 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:42.655 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-fuse 2024-09-13T21:57:42.665 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:42.708 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:42.709 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-09-13T21:57:42.709 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:42.780 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-rbd 2024-09-13T21:57:43.224 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:43.348 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:43.361 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:43.361 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-13T21:57:43.361 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:43.361 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:43.361 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 87 k 2024-09-13T21:57:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:43.362 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:43.362 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:43.362 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T21:57:43.362 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:43.362 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 87 k 2024-09-13T21:57:43.362 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 227 k 2024-09-13T21:57:43.362 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:43.439 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T21:57:43.481 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:43.482 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-09-13T21:57:43.482 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:43.551 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install rbd-fuse 2024-09-13T21:57:43.760 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-fuse-18.2.4-845.ge4e227b3.el9.x86_64.rpm 216 kB/s | 87 kB 00:00 2024-09-13T21:57:43.761 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:43.761 INFO:teuthology.orchestra.run.smithi089.stdout:Total 215 kB/s | 87 kB 00:00 2024-09-13T21:57:43.764 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:43.769 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:43.769 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:43.838 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:43.838 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:44.001 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:44.107 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:44.116 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:44.248 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:44.248 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 87 k 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 87 k 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 227 k 2024-09-13T21:57:44.249 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:44.478 INFO:teuthology.orchestra.run.smithi159.stdout:rbd-fuse-18.2.4-845.ge4e227b3.el9.x86_64.rpm 380 kB/s | 87 kB 00:00 2024-09-13T21:57:44.478 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:44.479 INFO:teuthology.orchestra.run.smithi159.stdout:Total 378 kB/s | 87 kB 00:00 2024-09-13T21:57:44.479 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:44.486 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:44.486 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:44.490 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:44.553 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:44.553 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:44.716 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:44.777 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:44.778 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:44.807 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:45.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-mirror 2024-09-13T21:57:45.192 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:45.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:45.464 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:45.464 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:45.465 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:45.465 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:45.465 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:45.615 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:45.690 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install rbd-mirror 2024-09-13T21:57:45.750 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:45.750 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:45.750 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-13T21:57:45.751 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:45.751 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:45.751 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.0 M 2024-09-13T21:57:45.751 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:45.751 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:45.751 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:45.751 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T21:57:45.751 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:45.752 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 3.0 M 2024-09-13T21:57:45.752 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 12 M 2024-09-13T21:57:45.752 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:46.082 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-mirror-18.2.4-845.ge4e227b3.el9.x86_64.rpm 9.1 MB/s | 3.0 MB 00:00 2024-09-13T21:57:46.083 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:46.083 INFO:teuthology.orchestra.run.smithi089.stdout:Total 9.0 MB/s | 3.0 MB 00:00 2024-09-13T21:57:46.083 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:46.092 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:46.092 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:46.171 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:46.171 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:46.271 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:46.407 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repo Size 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.0 M 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-09-13T21:57:46.408 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:46.409 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 3.0 M 2024-09-13T21:57:46.409 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 12 M 2024-09-13T21:57:46.409 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:46.600 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:46.666 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:46.691 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:46.691 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:57:46.691 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T21:57:46.691 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:57:46.692 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:57:46.692 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:46.757 INFO:teuthology.orchestra.run.smithi159.stdout:rbd-mirror-18.2.4-845.ge4e227b3.el9.x86_64.rpm 8.6 MB/s | 3.0 MB 00:00 2024-09-13T21:57:46.758 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:46.758 INFO:teuthology.orchestra.run.smithi159.stdout:Total 8.5 MB/s | 3.0 MB 00:00 2024-09-13T21:57:46.758 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:46.768 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:46.768 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:46.848 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:46.849 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:47.266 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:47.325 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:47.349 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:47.349 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:57:47.349 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T21:57:47.349 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:57:47.349 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:57:47.350 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:47.769 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:47.769 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:47.769 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:47.769 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:47.769 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:47.769 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:48.055 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-nbd 2024-09-13T21:57:48.522 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:48.522 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:48.523 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:48.523 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:48.523 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:48.523 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:48.634 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 09:56:12 PM UTC. 2024-09-13T21:57:48.768 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T21:57:48.769 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:48.769 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-13T21:57:48.769 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:48.769 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T21:57:48.769 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 172 k 2024-09-13T21:57:48.770 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:48.770 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T21:57:48.770 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T21:57:48.770 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T21:57:48.770 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:48.770 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 172 k 2024-09-13T21:57:48.770 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 494 k 2024-09-13T21:57:48.770 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T21:57:48.813 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install rbd-nbd 2024-09-13T21:57:48.979 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-nbd-18.2.4-845.ge4e227b3.el9.x86_64.rpm 824 kB/s | 172 kB 00:00 2024-09-13T21:57:48.979 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:48.980 INFO:teuthology.orchestra.run.smithi089.stdout:Total 818 kB/s | 172 kB 00:00 2024-09-13T21:57:48.980 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T21:57:48.987 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T21:57:48.987 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T21:57:49.056 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T21:57:49.056 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T21:57:49.225 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T21:57:49.326 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:49.396 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 09:56:13 PM UTC. 2024-09-13T21:57:49.531 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-13T21:57:49.532 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:49.532 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-09-13T21:57:49.532 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:49.532 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-13T21:57:49.532 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 172 k 2024-09-13T21:57:49.533 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:49.533 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-13T21:57:49.533 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-13T21:57:49.533 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-09-13T21:57:49.533 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:49.533 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 172 k 2024-09-13T21:57:49.533 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 494 k 2024-09-13T21:57:49.533 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-13T21:57:49.741 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:49.745 INFO:teuthology.orchestra.run.smithi159.stdout:rbd-nbd-18.2.4-845.ge4e227b3.el9.x86_64.rpm 812 kB/s | 172 kB 00:00 2024-09-13T21:57:49.745 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:57:49.746 INFO:teuthology.orchestra.run.smithi159.stdout:Total 806 kB/s | 172 kB 00:00 2024-09-13T21:57:49.746 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-13T21:57:49.754 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-13T21:57:49.754 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-13T21:57:49.822 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-13T21:57:49.822 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-13T21:57:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-13T21:57:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:50.000 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T21:57:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:57:50.000 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T21:57:50.091 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:50.242 DEBUG:teuthology.parallel:result is None 2024-09-13T21:57:50.510 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:50.754 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T21:57:50.754 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:50.754 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-13T21:57:50.755 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T21:57:50.755 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T21:57:50.755 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-13T21:57:50.972 DEBUG:teuthology.parallel:result is None 2024-09-13T21:57:50.972 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:57:50.973 INFO:teuthology.packaging:ref: None 2024-09-13T21:57:50.973 INFO:teuthology.packaging:tag: None 2024-09-13T21:57:50.973 INFO:teuthology.packaging:branch: reef 2024-09-13T21:57:50.973 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:57:50.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T21:57:51.220 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T21:57:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:18.2.4-845.ge4e227b3.el9 2024-09-13T21:57:51.246 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845.ge4e227b3.el9 2024-09-13T21:57:51.246 INFO:teuthology.task.install:The correct ceph version 18.2.4-845.ge4e227b3 is installed. 2024-09-13T21:57:51.248 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:57:51.249 INFO:teuthology.packaging:ref: None 2024-09-13T21:57:51.249 INFO:teuthology.packaging:tag: None 2024-09-13T21:57:51.249 INFO:teuthology.packaging:branch: reef 2024-09-13T21:57:51.249 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:57:51.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T21:57:51.482 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T21:57:51.504 INFO:teuthology.orchestra.run.smithi159.stdout:18.2.4-845.ge4e227b3.el9 2024-09-13T21:57:51.505 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845.ge4e227b3.el9 2024-09-13T21:57:51.505 INFO:teuthology.task.install:The correct ceph version 18.2.4-845.ge4e227b3 is installed. 2024-09-13T21:57:51.507 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T21:57:51.507 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T21:57:51.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T21:57:51.538 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T21:57:51.538 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T21:57:51.571 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T21:57:51.572 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T21:57:51.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T21:57:51.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T21:57:51.676 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T21:57:51.676 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T21:57:51.703 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T21:57:51.769 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T21:57:51.770 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T21:57:51.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T21:57:51.797 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T21:57:51.865 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T21:57:51.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T21:57:51.891 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T21:57:51.956 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T21:57:51.957 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T21:57:51.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T21:57:51.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T21:57:52.051 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T21:57:52.051 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T21:57:52.076 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T21:57:52.141 INFO:teuthology.run_tasks:Running task print... 2024-09-13T21:57:52.150 INFO:teuthology.task.print:**** done install task... 2024-09-13T21:57:52.150 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T21:57:52.250 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T21:57:52.251 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-09-13T21:57:52.251 INFO:tasks.cephadm:Cluster fsid is 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:57:52.251 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T21:57:52.251 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T21:57:52.251 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi089': '172.21.15.89', 'mon.smithi159': '172.21.15.159'} 2024-09-13T21:57:52.252 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T21:57:52.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname $(hostname -s) 2024-09-13T21:57:52.278 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname $(hostname -s) 2024-09-13T21:57:52.304 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-13T21:57:52.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:57:52.456 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56074/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-324-gecab7be5', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-324.gecab7be5'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-13 18:01:03.383540', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-13T21:57:52.690 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref reef, sha1 e4e227b37858f5109138494e01e5ba1ba7b8ffe8 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-13T21:57:52.692 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm 2024-09-13T21:57:52.692 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm 2024-09-13T21:57:52.692 DEBUG:teuthology.orchestra.run.smithi089:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T21:57:53.028 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 21:57 /home/ubuntu/cephtest/cephadm 2024-09-13T21:57:53.028 DEBUG:teuthology.orchestra.run.smithi159:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T21:57:53.365 INFO:teuthology.orchestra.run.smithi159.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 21:57 /home/ubuntu/cephtest/cephadm 2024-09-13T21:57:53.366 DEBUG:teuthology.orchestra.run.smithi089:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T21:57:53.389 DEBUG:teuthology.orchestra.run.smithi159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T21:57:53.419 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-09-13T21:57:53.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-13T21:57:53.431 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-13T21:57:55.000 INFO:teuthology.orchestra.run.smithi159.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T21:57:55.053 INFO:teuthology.orchestra.run.smithi089.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T21:59:11.944 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T21:59:11.945 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)", 2024-09-13T21:59:11.945 INFO:teuthology.orchestra.run.smithi089.stdout: "image_id": "67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1", 2024-09-13T21:59:11.945 INFO:teuthology.orchestra.run.smithi089.stdout: "repo_digests": [ 2024-09-13T21:59:11.945 INFO:teuthology.orchestra.run.smithi089.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322" 2024-09-13T21:59:11.945 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-13T21:59:11.945 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T21:59:14.116 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-13T21:59:14.116 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)", 2024-09-13T21:59:14.117 INFO:teuthology.orchestra.run.smithi159.stdout: "image_id": "67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1", 2024-09-13T21:59:14.117 INFO:teuthology.orchestra.run.smithi159.stdout: "repo_digests": [ 2024-09-13T21:59:14.117 INFO:teuthology.orchestra.run.smithi159.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322" 2024-09-13T21:59:14.117 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-13T21:59:14.117 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-13T21:59:14.134 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph 2024-09-13T21:59:14.169 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph 2024-09-13T21:59:14.199 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /etc/ceph 2024-09-13T21:59:14.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /etc/ceph 2024-09-13T21:59:14.265 INFO:tasks.cephadm:Writing seed config... 2024-09-13T21:59:14.266 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T21:59:14.266 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T21:59:14.266 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T21:59:14.266 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T21:59:14.266 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T21:59:14.266 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T21:59:14.267 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T21:59:14.268 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T21:59:14.269 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T21:59:14.270 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T21:59:14.270 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T21:59:14.295 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 39489060-721b-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T21:59:14.296 DEBUG:teuthology.orchestra.run.smithi089:mon.smithi089> sudo journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089.service 2024-09-13T21:59:14.338 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T21:59:14.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid 39489060-721b-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.89 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:59:14.495 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:59:14.495 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', '39489060-721b-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.89', '--skip-admin-label'] 2024-09-13T21:59:14.521 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stdout 5.2.2 2024-09-13T21:59:14.521 INFO:teuthology.orchestra.run.smithi089.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T21:59:14.521 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying podman|docker is present... 2024-09-13T21:59:14.543 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stdout 5.2.2 2024-09-13T21:59:14.543 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying lvm2 is present... 2024-09-13T21:59:14.543 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying time synchronization is in place... 2024-09-13T21:59:14.551 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T21:59:14.551 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T21:59:14.557 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T21:59:14.557 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T21:59:14.563 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout enabled 2024-09-13T21:59:14.570 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout active 2024-09-13T21:59:14.570 INFO:teuthology.orchestra.run.smithi089.stdout:Unit chronyd.service is enabled and running 2024-09-13T21:59:14.570 INFO:teuthology.orchestra.run.smithi089.stdout:Repeating the final host check... 2024-09-13T21:59:14.592 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stdout 5.2.2 2024-09-13T21:59:14.592 INFO:teuthology.orchestra.run.smithi089.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T21:59:14.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl is present 2024-09-13T21:59:14.592 INFO:teuthology.orchestra.run.smithi089.stdout:lvcreate is present 2024-09-13T21:59:14.599 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T21:59:14.599 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T21:59:14.605 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T21:59:14.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T21:59:14.611 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout enabled 2024-09-13T21:59:14.618 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout active 2024-09-13T21:59:14.618 INFO:teuthology.orchestra.run.smithi089.stdout:Unit chronyd.service is enabled and running 2024-09-13T21:59:14.618 INFO:teuthology.orchestra.run.smithi089.stdout:Host looks OK 2024-09-13T21:59:14.618 INFO:teuthology.orchestra.run.smithi089.stdout:Cluster fsid: 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:59:14.619 INFO:teuthology.orchestra.run.smithi089.stdout:Acquiring lock 140423479960912 on /run/cephadm/39489060-721b-11ef-bceb-c7b262605968.lock 2024-09-13T21:59:14.619 INFO:teuthology.orchestra.run.smithi089.stdout:Lock 140423479960912 acquired on /run/cephadm/39489060-721b-11ef-bceb-c7b262605968.lock 2024-09-13T21:59:14.619 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying IP 172.21.15.89 port 3300 ... 2024-09-13T21:59:14.619 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying IP 172.21.15.89 port 6789 ... 2024-09-13T21:59:14.619 INFO:teuthology.orchestra.run.smithi089.stdout:Base mon IP(s) is [172.21.15.89:3300, 172.21.15.89:6789], mon addrv is [v2:172.21.15.89:3300,v1:172.21.15.89:6789] 2024-09-13T21:59:14.623 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.89 metric 100 2024-09-13T21:59:14.623 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.89 metric 100 2024-09-13T21:59:14.625 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T21:59:14.625 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T21:59:14.625 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T21:59:14.627 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T21:59:14.628 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T21:59:14.628 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T21:59:14.628 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T21:59:14.628 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2024-09-13T21:59:14.628 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T21:59:14.629 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.0/20` 2024-09-13T21:59:14.629 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.0/20` 2024-09-13T21:59:14.629 INFO:teuthology.orchestra.run.smithi089.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T21:59:14.629 INFO:teuthology.orchestra.run.smithi089.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T21:59:14.629 INFO:teuthology.orchestra.run.smithi089.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T21:59:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stdout 67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1 2024-09-13T21:59:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T21:59:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T21:59:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Copying blob sha256:71878612010b3dfa9e3e456d432a49e20ac26634831a8a6522f4d782181c5840 2024-09-13T21:59:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T21:59:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Copying config sha256:67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1 2024-09-13T21:59:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T21:59:15.950 INFO:teuthology.orchestra.run.smithi089.stdout:ceph: stdout ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable) 2024-09-13T21:59:15.950 INFO:teuthology.orchestra.run.smithi089.stdout:Ceph version: ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable) 2024-09-13T21:59:15.950 INFO:teuthology.orchestra.run.smithi089.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T21:59:16.956 INFO:teuthology.orchestra.run.smithi089.stdout:stat: stdout 167 167 2024-09-13T21:59:16.956 INFO:teuthology.orchestra.run.smithi089.stdout:Creating initial keys... 2024-09-13T21:59:17.937 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-authtool: stdout AQC1teRmjLlJERAAcWSPViSLTULcMM8LIZMeEg== 2024-09-13T21:59:18.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-authtool: stdout AQC2teRmDtCODBAAplKph1E1wM/Pjr1mqz8JYA== 2024-09-13T21:59:19.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-authtool: stdout AQC3teRm1SQEBRAAjnNgm5DxdPujyoxlrEhRog== 2024-09-13T21:59:19.666 INFO:teuthology.orchestra.run.smithi089.stdout:Creating initial monmap... 2024-09-13T21:59:20.581 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T21:59:20.581 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T21:59:20.581 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:59:20.581 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T21:59:20.581 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool for smithi089 [v2:172.21.15.89:3300,v1:172.21.15.89:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T21:59:20.582 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = pacific 2024-09-13T21:59:20.582 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: set fsid to 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:59:20.582 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T21:59:20.582 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T21:59:20.582 INFO:teuthology.orchestra.run.smithi089.stdout:Creating mon... 2024-09-13T21:59:21.460 INFO:teuthology.orchestra.run.smithi089.stdout:create mon.smithi089 on 2024-09-13T21:59:21.660 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T21:59:21.804 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T21:59:21.977 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-39489060-721b-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-39489060-721b-11ef-bceb-c7b262605968.target. 2024-09-13T21:59:21.977 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-39489060-721b-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-39489060-721b-11ef-bceb-c7b262605968.target. 2024-09-13T21:59:22.201 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089 2024-09-13T21:59:22.201 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to reset failed state of unit ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089.service: Unit ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089.service not loaded. 2024-09-13T21:59:22.384 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-39489060-721b-11ef-bceb-c7b262605968.target.wants/ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089.service → /etc/systemd/system/ceph-39489060-721b-11ef-bceb-c7b262605968@.service. 2024-09-13T21:59:22.969 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:59:22.969 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout disabled 2024-09-13T21:59:22.976 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:59:22.976 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T21:59:22.976 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld.service is not enabled 2024-09-13T21:59:22.976 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T21:59:22.977 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mon to start... 2024-09-13T21:59:22.977 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mon... 2024-09-13T21:59:23.100 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:22 smithi089 systemd[1]: Started Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T21:59:24.028 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout id: 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout services: 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi089 (age 0.566489s) 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout data: 2024-09-13T21:59:24.029 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.408+0000 7f35d4857640 1 Processor -- start 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.408+0000 7f35d4857640 1 -- start start 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.408+0000 7f35d4857640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.408+0000 7f35d4857640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0079ea0 con 0x7f35d0106050 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.409+0000 7f35ce59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.409+0000 7f35ce59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47570/0 (socket says 172.21.15.89:47570) 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.409+0000 7f35ce59c640 1 -- 172.21.15.89:0/706439385 learned_addr learned my addr 172.21.15.89:0/706439385 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:24.030 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.409+0000 7f35ce59c640 1 -- 172.21.15.89:0/706439385 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0108980 con 0x7f35d0106050 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.411+0000 7f35ce59c640 1 --2- 172.21.15.89:0/706439385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0108440 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009820 tx=0x7f35c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680a4d695898ce50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35cdd9b640 1 -- 172.21.15.89:0/706439385 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35c002ad40 con 0x7f35d0106050 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35cdd9b640 1 -- 172.21.15.89:0/706439385 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0032440 con 0x7f35d0106050 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35cdd9b640 1 -- 172.21.15.89:0/706439385 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35c002aea0 con 0x7f35d0106050 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35d4857640 1 -- 172.21.15.89:0/706439385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 msgr2=0x7f35d0108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35d4857640 1 --2- 172.21.15.89:0/706439385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0108440 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009820 tx=0x7f35c002a270 comp rx=0 tx=0).stop 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35d4857640 1 -- 172.21.15.89:0/706439385 shutdown_connections 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35d4857640 1 --2- 172.21.15.89:0/706439385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0108440 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35d4857640 1 -- 172.21.15.89:0/706439385 >> 172.21.15.89:0/706439385 conn(0x7f35d00ffc50 msgr2=0x7f35d01020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35d4857640 1 -- 172.21.15.89:0/706439385 shutdown_connections 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.412+0000 7f35d4857640 1 -- 172.21.15.89:0/706439385 wait complete. 2024-09-13T21:59:24.031 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.413+0000 7f35d4857640 1 Processor -- start 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.413+0000 7f35d4857640 1 -- start start 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35d4857640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35d4857640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0199040 con 0x7f35d0106050 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35ce59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35ce59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47584/0 (socket says 172.21.15.89:47584) 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35ce59c640 1 -- 172.21.15.89:0/3297915584 learned_addr learned my addr 172.21.15.89:0/3297915584 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35ce59c640 1 -- 172.21.15.89:0/3297915584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00094d0 con 0x7f35d0106050 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35ce59c640 1 --2- 172.21.15.89:0/3297915584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0198b00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f35c00090b0 tx=0x7f35c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35c7fff640 1 -- 172.21.15.89:0/3297915584 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35c00308d0 con 0x7f35d0106050 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35c7fff640 1 -- 172.21.15.89:0/3297915584 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0030a30 con 0x7f35d0106050 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35d4857640 1 -- 172.21.15.89:0/3297915584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d0199240 con 0x7f35d0106050 2024-09-13T21:59:24.032 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35c7fff640 1 -- 172.21.15.89:0/3297915584 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35c0030d30 con 0x7f35d0106050 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.414+0000 7f35d4857640 1 -- 172.21.15.89:0/3297915584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d01996e0 con 0x7f35d0106050 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.415+0000 7f35c7fff640 1 -- 172.21.15.89:0/3297915584 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f35c0039040 con 0x7f35d0106050 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.415+0000 7f35c7fff640 1 -- 172.21.15.89:0/3297915584 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f35c003b880 con 0x7f35d0106050 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.415+0000 7f35d4857640 1 -- 172.21.15.89:0/3297915584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d01928c0 con 0x7f35d0106050 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.418+0000 7f35c7fff640 1 -- 172.21.15.89:0/3297915584 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f35c0037070 con 0x7f35d0106050 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.476+0000 7f35d4857640 1 -- 172.21.15.89:0/3297915584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f35d002c480 con 0x7f35d0106050 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.476+0000 7f35c7fff640 1 -- 172.21.15.89:0/3297915584 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f35c003bb40 con 0x7f35d0106050 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.477+0000 7f35d4857640 1 -- 172.21.15.89:0/3297915584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 msgr2=0x7f35d0198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.477+0000 7f35d4857640 1 --2- 172.21.15.89:0/3297915584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0198b00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f35c00090b0 tx=0x7f35c00046c0 comp rx=0 tx=0).stop 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.477+0000 7f35d4857640 1 -- 172.21.15.89:0/3297915584 shutdown_connections 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.477+0000 7f35d4857640 1 --2- 172.21.15.89:0/3297915584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d0106050 0x7f35d0198b00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:24.033 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.477+0000 7f35d4857640 1 -- 172.21.15.89:0/3297915584 >> 172.21.15.89:0/3297915584 conn(0x7f35d00ffc50 msgr2=0x7f35d0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:24.034 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.477+0000 7f35d4857640 1 -- 172.21.15.89:0/3297915584 shutdown_connections 2024-09-13T21:59:24.034 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:23.477+0000 7f35d4857640 1 -- 172.21.15.89:0/3297915584 wait complete. 2024-09-13T21:59:24.034 INFO:teuthology.orchestra.run.smithi089.stdout:mon is available 2024-09-13T21:59:24.034 INFO:teuthology.orchestra.run.smithi089.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T21:59:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:23 smithi089 ceph-mon[27553]: mon.smithi089 is new leader, mons smithi089 in quorum (ranks 0) 2024-09-13T21:59:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:23 smithi089 ceph-mon[27553]: monmap e1: 1 mons at {smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T21:59:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:23 smithi089 ceph-mon[27553]: fsmap 2024-09-13T21:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:23 smithi089 ceph-mon[27553]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T21:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:23 smithi089 ceph-mon[27553]: mgrmap e1: no daemons active 2024-09-13T21:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:23 smithi089 ceph-mon[27553]: from='client.? 172.21.15.89:0/3297915584' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T21:59:25.076 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:24 smithi089 ceph-mon[27553]: from='client.? 172.21.15.89:0/2445534310' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T21:59:25.077 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:24 smithi089 ceph-mon[27553]: from='client.? 172.21.15.89:0/2445534310' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T21:59:25.086 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:25.086 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T21:59:25.086 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout fsid = 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:59:25.086 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.89:3300,v1:172.21.15.89:6789] 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T21:59:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.438+0000 7f0a48b80640 1 Processor -- start 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.438+0000 7f0a48b80640 1 -- start start 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.438+0000 7f0a48b80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44108420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.438+0000 7f0a48b80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a44079ea0 con 0x7f0a44106030 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.438+0000 7f0a4259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.438+0000 7f0a4259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44108420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47592/0 (socket says 172.21.15.89:47592) 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.438+0000 7f0a4259c640 1 -- 172.21.15.89:0/2025514953 learned_addr learned my addr 172.21.15.89:0/2025514953 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.438+0000 7f0a4259c640 1 -- 172.21.15.89:0/2025514953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44108960 con 0x7f0a44106030 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.439+0000 7f0a4259c640 1 --2- 172.21.15.89:0/2025514953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44108420 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009820 tx=0x7f0a3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da780cf4956d125 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.439+0000 7f0a41d9b640 1 -- 172.21.15.89:0/2025514953 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a3402ad40 con 0x7f0a44106030 2024-09-13T21:59:25.088 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.439+0000 7f0a41d9b640 1 -- 172.21.15.89:0/2025514953 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a34032440 con 0x7f0a44106030 2024-09-13T21:59:25.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.439+0000 7f0a41d9b640 1 -- 172.21.15.89:0/2025514953 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a3402aea0 con 0x7f0a44106030 2024-09-13T21:59:25.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.440+0000 7f0a48b80640 1 -- 172.21.15.89:0/2025514953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 msgr2=0x7f0a44108420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:25.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.440+0000 7f0a48b80640 1 --2- 172.21.15.89:0/2025514953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44108420 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009820 tx=0x7f0a3402a270 comp rx=0 tx=0).stop 2024-09-13T21:59:25.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.440+0000 7f0a48b80640 1 -- 172.21.15.89:0/2025514953 shutdown_connections 2024-09-13T21:59:25.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.440+0000 7f0a48b80640 1 --2- 172.21.15.89:0/2025514953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44108420 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:25.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.440+0000 7f0a48b80640 1 -- 172.21.15.89:0/2025514953 >> 172.21.15.89:0/2025514953 conn(0x7f0a440ffc30 msgr2=0x7f0a44102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:25.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.440+0000 7f0a48b80640 1 -- 172.21.15.89:0/2025514953 shutdown_connections 2024-09-13T21:59:25.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.440+0000 7f0a48b80640 1 -- 172.21.15.89:0/2025514953 wait complete. 2024-09-13T21:59:25.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.441+0000 7f0a48b80640 1 Processor -- start 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.441+0000 7f0a48b80640 1 -- start start 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.441+0000 7f0a48b80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.441+0000 7f0a48b80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a441990b0 con 0x7f0a44106030 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.441+0000 7f0a4259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.441+0000 7f0a4259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47604/0 (socket says 172.21.15.89:47604) 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.441+0000 7f0a4259c640 1 -- 172.21.15.89:0/2445534310 learned_addr learned my addr 172.21.15.89:0/2445534310 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.441+0000 7f0a4259c640 1 -- 172.21.15.89:0/2445534310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a340094d0 con 0x7f0a44106030 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.441+0000 7f0a4259c640 1 --2- 172.21.15.89:0/2445534310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44198b70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0a340090b0 tx=0x7f0a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.442+0000 7f0a3b7fe640 1 -- 172.21.15.89:0/2445534310 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a340308d0 con 0x7f0a44106030 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.442+0000 7f0a3b7fe640 1 -- 172.21.15.89:0/2445534310 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a34030a30 con 0x7f0a44106030 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.442+0000 7f0a48b80640 1 -- 172.21.15.89:0/2445534310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a441992b0 con 0x7f0a44106030 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.442+0000 7f0a3b7fe640 1 -- 172.21.15.89:0/2445534310 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a34030d30 con 0x7f0a44106030 2024-09-13T21:59:25.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.442+0000 7f0a48b80640 1 -- 172.21.15.89:0/2445534310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a44199750 con 0x7f0a44106030 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.442+0000 7f0a3b7fe640 1 -- 172.21.15.89:0/2445534310 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0a34039040 con 0x7f0a44106030 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.442+0000 7f0a3b7fe640 1 -- 172.21.15.89:0/2445534310 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0a3403b880 con 0x7f0a44106030 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.443+0000 7f0a48b80640 1 -- 172.21.15.89:0/2445534310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a441928a0 con 0x7f0a44106030 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.445+0000 7f0a3b7fe640 1 -- 172.21.15.89:0/2445534310 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f0a34037070 con 0x7f0a44106030 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.500+0000 7f0a48b80640 1 -- 172.21.15.89:0/2445534310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f0a44108c10 con 0x7f0a44106030 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.504+0000 7f0a3b7fe640 1 -- 172.21.15.89:0/2445534310 <== mon.0 v2:172.21.15.89:3300/0 7 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f0a34046d50 con 0x7f0a44106030 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.504+0000 7f0a3b7fe640 1 -- 172.21.15.89:0/2445534310 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f0a3403bba0 con 0x7f0a44106030 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.504+0000 7f0a48b80640 1 -- 172.21.15.89:0/2445534310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 msgr2=0x7f0a44198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.504+0000 7f0a48b80640 1 --2- 172.21.15.89:0/2445534310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44198b70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0a340090b0 tx=0x7f0a340046c0 comp rx=0 tx=0).stop 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.505+0000 7f0a48b80640 1 -- 172.21.15.89:0/2445534310 shutdown_connections 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.505+0000 7f0a48b80640 1 --2- 172.21.15.89:0/2445534310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a44106030 0x7f0a44198b70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.505+0000 7f0a48b80640 1 -- 172.21.15.89:0/2445534310 >> 172.21.15.89:0/2445534310 conn(0x7f0a440ffc30 msgr2=0x7f0a44100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:25.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.505+0000 7f0a48b80640 1 -- 172.21.15.89:0/2445534310 shutdown_connections 2024-09-13T21:59:25.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:24.505+0000 7f0a48b80640 1 -- 172.21.15.89:0/2445534310 wait complete. 2024-09-13T21:59:25.092 INFO:teuthology.orchestra.run.smithi089.stdout:Generating new minimal ceph.conf... 2024-09-13T21:59:26.107 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.487+0000 7f0431813640 1 Processor -- start 2024-09-13T21:59:26.107 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.487+0000 7f0431813640 1 -- start start 2024-09-13T21:59:26.107 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.487+0000 7f0431813640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c1048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:26.107 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.487+0000 7f0431813640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c104eb0 con 0x7f042c1044e0 2024-09-13T21:59:26.107 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.488+0000 7f042affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c1048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:26.107 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.488+0000 7f042affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c1048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47610/0 (socket says 172.21.15.89:47610) 2024-09-13T21:59:26.107 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.488+0000 7f042affd640 1 -- 172.21.15.89:0/4014853728 learned_addr learned my addr 172.21.15.89:0/4014853728 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:26.107 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.488+0000 7f042affd640 1 -- 172.21.15.89:0/4014853728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c1056e0 con 0x7f042c1044e0 2024-09-13T21:59:26.107 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.488+0000 7f042affd640 1 --2- 172.21.15.89:0/4014853728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c1048e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f041c009e80 tx=0x7f041c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115728de1d1bbd9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0429ffb640 1 -- 172.21.15.89:0/4014853728 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f041c031400 con 0x7f042c1044e0 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0429ffb640 1 -- 172.21.15.89:0/4014853728 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f041c02d050 con 0x7f042c1044e0 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0429ffb640 1 -- 172.21.15.89:0/4014853728 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f041c007910 con 0x7f042c1044e0 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0431813640 1 -- 172.21.15.89:0/4014853728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 msgr2=0x7f042c1048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0431813640 1 --2- 172.21.15.89:0/4014853728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c1048e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f041c009e80 tx=0x7f041c02a7a0 comp rx=0 tx=0).stop 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0431813640 1 -- 172.21.15.89:0/4014853728 shutdown_connections 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0431813640 1 --2- 172.21.15.89:0/4014853728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c1048e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0431813640 1 -- 172.21.15.89:0/4014853728 >> 172.21.15.89:0/4014853728 conn(0x7f042c0ffc50 msgr2=0x7f042c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0431813640 1 -- 172.21.15.89:0/4014853728 shutdown_connections 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.489+0000 7f0431813640 1 -- 172.21.15.89:0/4014853728 wait complete. 2024-09-13T21:59:26.108 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.490+0000 7f0431813640 1 Processor -- start 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.490+0000 7f0431813640 1 -- start start 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.490+0000 7f0431813640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.490+0000 7f0431813640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c1998b0 con 0x7f042c1044e0 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.490+0000 7f042affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.490+0000 7f042affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47612/0 (socket says 172.21.15.89:47612) 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.490+0000 7f042affd640 1 -- 172.21.15.89:0/285391538 learned_addr learned my addr 172.21.15.89:0/285391538 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.491+0000 7f042affd640 1 -- 172.21.15.89:0/285391538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c009b30 con 0x7f042c1044e0 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.491+0000 7f042affd640 1 --2- 172.21.15.89:0/285391538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c199370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f041c02acc0 tx=0x7f041c0075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.491+0000 7f0430811640 1 -- 172.21.15.89:0/285391538 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f041c031b20 con 0x7f042c1044e0 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.491+0000 7f0430811640 1 -- 172.21.15.89:0/285391538 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f041c031c80 con 0x7f042c1044e0 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.491+0000 7f0431813640 1 -- 172.21.15.89:0/285391538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c199ab0 con 0x7f042c1044e0 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.491+0000 7f0430811640 1 -- 172.21.15.89:0/285391538 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f041c03a6b0 con 0x7f042c1044e0 2024-09-13T21:59:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.491+0000 7f0431813640 1 -- 172.21.15.89:0/285391538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c199fb0 con 0x7f042c1044e0 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.491+0000 7f0430811640 1 -- 172.21.15.89:0/285391538 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f041c038040 con 0x7f042c1044e0 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.491+0000 7f0430811640 1 -- 172.21.15.89:0/285391538 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f041c044bb0 con 0x7f042c1044e0 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.492+0000 7f0431813640 1 -- 172.21.15.89:0/285391538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042c104960 con 0x7f042c1044e0 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.494+0000 7f0430811640 1 -- 172.21.15.89:0/285391538 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f041c040070 con 0x7f042c1044e0 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.551+0000 7f0431813640 1 -- 172.21.15.89:0/285391538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f042c19cb20 con 0x7f042c1044e0 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.551+0000 7f0430811640 1 -- 172.21.15.89:0/285391538 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f041c036070 con 0x7f042c1044e0 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.552+0000 7f0431813640 1 -- 172.21.15.89:0/285391538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 msgr2=0x7f042c199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.552+0000 7f0431813640 1 --2- 172.21.15.89:0/285391538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c199370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f041c02acc0 tx=0x7f041c0075c0 comp rx=0 tx=0).stop 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.552+0000 7f0431813640 1 -- 172.21.15.89:0/285391538 shutdown_connections 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.552+0000 7f0431813640 1 --2- 172.21.15.89:0/285391538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f042c1044e0 0x7f042c199370 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.552+0000 7f0431813640 1 -- 172.21.15.89:0/285391538 >> 172.21.15.89:0/285391538 conn(0x7f042c0ffc50 msgr2=0x7f042c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:26.110 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.552+0000 7f0431813640 1 -- 172.21.15.89:0/285391538 shutdown_connections 2024-09-13T21:59:26.111 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:25.552+0000 7f0431813640 1 -- 172.21.15.89:0/285391538 wait complete. 2024-09-13T21:59:26.111 INFO:teuthology.orchestra.run.smithi089.stdout:Restarting the monitor... 2024-09-13T21:59:26.122 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:25 smithi089 ceph-mon[27553]: from='client.? 172.21.15.89:0/285391538' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:59:26.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:26 smithi089 systemd[1]: Stopping Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T21:59:26.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:26 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089[27549]: 2024-09-13T21:59:26.376+0000 7ffb4dd16640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi089 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:59:26.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:26 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089[27549]: 2024-09-13T21:59:26.376+0000 7ffb4dd16640 -1 mon.smithi089@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T21:59:26.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:26 smithi089 podman[27798]: 2024-09-13 21:59:26.428405379 +0000 UTC m=+0.147838837 container died 767f4e23665ce3dd16f44ecec470f9ec5eb649f22bc4217bfb3caa84a50d9e8e (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-e4e227b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:59:29.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:28 smithi089 podman[27798]: 2024-09-13 21:59:28.775925471 +0000 UTC m=+2.495358931 container cleanup 767f4e23665ce3dd16f44ecec470f9ec5eb649f22bc4217bfb3caa84a50d9e8e (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=reef-e4e227b, maintainer=Guillaume Abrioux ) 2024-09-13T21:59:29.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:28 smithi089 bash[27798]: ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089 2024-09-13T21:59:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:30 smithi089 podman[27810]: 2024-09-13 21:59:30.523407677 +0000 UTC m=+4.085848063 container remove 767f4e23665ce3dd16f44ecec470f9ec5eb649f22bc4217bfb3caa84a50d9e8e (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-13T21:59:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:30 smithi089 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089.service: Deactivated successfully. 2024-09-13T21:59:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:30 smithi089 systemd[1]: Stopped Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T21:59:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:30 smithi089 systemd[1]: Starting Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T21:59:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:30 smithi089 podman[27902]: 2024-09-13 21:59:30.899453306 +0000 UTC m=+0.015716079 image pull 67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1 quay.ceph.io/ceph-ci/ceph:reef 2024-09-13T21:59:32.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:32 smithi089 podman[27902]: 2024-09-13 21:59:32.129417555 +0000 UTC m=+1.245680357 container create d3e6d0d0c916688b536bcbe25e3fdb9bf1d9ccbe26d2273e8c62e3043678cde3 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-e4e227b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-13T21:59:34.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 podman[27902]: 2024-09-13 21:59:33.920050242 +0000 UTC m=+3.036313001 container init d3e6d0d0c916688b536bcbe25e3fdb9bf1d9ccbe26d2273e8c62e3043678cde3 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=reef-e4e227b, GIT_BRANCH=HEAD) 2024-09-13T21:59:34.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 podman[27902]: 2024-09-13 21:59:33.924039352 +0000 UTC m=+3.040302111 container start d3e6d0d0c916688b536bcbe25e3fdb9bf1d9ccbe26d2273e8c62e3043678cde3 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=reef-e4e227b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T21:59:34.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T21:59:34.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable), process ceph-mon, pid 2 2024-09-13T21:59:34.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: pidfile_write: ignore empty --pid-file 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: load: jerasure load: lrc 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: RocksDB version: 7.9.2 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Git sha 0 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Compile date 2024-09-13 16:45:57 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: DB SUMMARY 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: DB Session ID: R34FXAAMQ1GYD9J03087 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: CURRENT file: CURRENT 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi089/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi089/store.db: 000009.log size: 98981 ; 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.error_if_exists: 0 2024-09-13T21:59:34.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.create_if_missing: 0 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.paranoid_checks: 1 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.env: 0x55c3a2d19bc0 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.info_log: 0x55c3a4846dc0 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.statistics: (nil) 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.use_fsync: 0 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_log_file_size: 0 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T21:59:34.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.allow_fallocate: 1 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.use_direct_reads: 0 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.db_log_dir: 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.wal_dir: 2024-09-13T21:59:34.251 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.write_buffer_manager: 0x55c3a4854320 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T21:59:34.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.unordered_write: 0 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.row_cache: None 2024-09-13T21:59:34.253 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.wal_filter: None 2024-09-13T21:59:34.254 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T21:59:34.254 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T21:59:34.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.two_write_queues: 0 2024-09-13T21:59:34.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T21:59:34.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.wal_compression: 0 2024-09-13T21:59:34.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.atomic_flush: 0 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.log_readahead_size: 0 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T21:59:34.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_background_jobs: 2 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_background_compactions: -1 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_subcompactions: 1 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T21:59:34.257 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_open_files: -1 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_background_flushes: -1 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Compression algorithms supported: 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: kZSTD supported: 0 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: kXpressCompression supported: 0 2024-09-13T21:59:34.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: kBZip2Compression supported: 0 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: kLZ4Compression supported: 1 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: kZlibCompression supported: 1 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: kSnappyCompression supported: 1 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000010 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.merge_operator: 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_filter: None 2024-09-13T21:59:34.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c3a4846a20) 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks: 1 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_top_level_index_and_filter: 1 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_type: 0 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_index_type: 0 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_shortening: 1 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T21:59:34.260 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: checksum: 4 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: no_block_cache: 0 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache: 0x55c3a483b350 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_name: BinnedLRUCache 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_options: 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: capacity : 536870912 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_shard_bits : 4 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: strict_capacity_limit : 0 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: high_pri_pool_ratio: 0.000 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_compressed: (nil) 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: persistent_cache: (nil) 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size: 4096 2024-09-13T21:59:34.261 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size_deviation: 10 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_restart_interval: 16 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_block_restart_interval: 1 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: metadata_block_size: 4096 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: partition_filters: 0 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: use_delta_encoding: 1 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: filter_policy: bloomfilter 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: whole_key_filtering: 1 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: verify_compression: 0 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: read_amp_bytes_per_bit: 0 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: format_version: 5 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_index_compression: 1 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_align: 0 2024-09-13T21:59:34.262 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_auto_readahead_size: 262144 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: prepopulate_block_cache: 0 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: initial_auto_readahead_size: 8192 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression: NoCompression 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.num_levels: 7 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T21:59:34.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T21:59:34.264 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T21:59:34.264 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T21:59:34.264 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T21:59:34.264 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T21:59:34.264 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:59:34.264 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T21:59:34.264 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T21:59:34.264 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T21:59:34.265 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T21:59:34.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T21:59:34.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.inplace_update_support: 0 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.bloom_locality: 0 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.max_successive_merges: 0 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T21:59:34.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.ttl: 2592000 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.enable_blob_files: false 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.min_blob_size: 0 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T21:59:34.269 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 01a8d625-f6d3-4c29-b68e-003095d1976f 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264773954788, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264773955939, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94253, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92233, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13701, "raw_average_key_size": 49, "raw_value_size": 84741, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726264773, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "01a8d625-f6d3-4c29-b68e-003095d1976f", "db_session_id": "R34FXAAMQ1GYD9J03087", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264773956055, "job": 1, "event": "recovery_finished"} 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi089/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T21:59:34.270 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c3a4866e00 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: DB pointer 0x55c3a495a000 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** DB Stats ** 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T21:59:34.271 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L0 2/0 93.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Sum 2/0 93.94 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 117.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T21:59:34.272 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative compaction: 0.00 GB write, 25.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval compaction: 0.00 GB write, 25.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache BinnedLRUCache@0x55c3a483b350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-13T21:59:34.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-13T21:59:34.274 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T21:59:34.274 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T21:59:34.274 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: starting mon.smithi089 rank 0 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi089 fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:59:34.274 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: mon.smithi089@-1(???) e1 preinit fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:59:34.274 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: mon.smithi089@-1(???).mds e1 new map 2024-09-13T21:59:34.274 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: mon.smithi089@-1(???).mds e1 print_map 2024-09-13T21:59:34.274 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: e1 2024-09-13T21:59:34.274 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:59:34.274 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: legacy client fscid: -1 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: No filesystems configured 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: mon.smithi089@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: mon.smithi089@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: mon.smithi089@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: mon.smithi089@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:33 smithi089 ceph-mon[27921]: mon.smithi089@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:34 smithi089 ceph-mon[27921]: mon.smithi089 is new leader, mons smithi089 in quorum (ranks 0) 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:34 smithi089 ceph-mon[27921]: monmap e1: 1 mons at {smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T21:59:34.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:34 smithi089 ceph-mon[27921]: fsmap 2024-09-13T21:59:34.276 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:34 smithi089 ceph-mon[27921]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T21:59:34.276 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:34 smithi089 ceph-mon[27921]: mgrmap e1: no daemons active 2024-09-13T21:59:34.806 INFO:teuthology.orchestra.run.smithi089.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T21:59:35.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:34 smithi089 bash[27902]: d3e6d0d0c916688b536bcbe25e3fdb9bf1d9ccbe26d2273e8c62e3043678cde3 2024-09-13T21:59:35.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:34 smithi089 systemd[1]: Started Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T21:59:36.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.218+0000 7f3fafdeb640 1 Processor -- start 2024-09-13T21:59:36.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.219+0000 7f3fafdeb640 1 -- start start 2024-09-13T21:59:36.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.219+0000 7f3fafdeb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa81059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.219+0000 7f3fafdeb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa8105f90 con 0x7f3fa81055c0 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.219+0000 7f3fadb87640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa81059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.219+0000 7f3fadb87640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa81059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45102/0 (socket says 172.21.15.89:45102) 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.219+0000 7f3fadb87640 1 -- 172.21.15.89:0/1812270963 learned_addr learned my addr 172.21.15.89:0/1812270963 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.220+0000 7f3fadb87640 1 -- 172.21.15.89:0/1812270963 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa81067c0 con 0x7f3fa81055c0 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.222+0000 7f3fadb87640 1 --2- 172.21.15.89:0/1812270963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa81059c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009820 tx=0x7f3f9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170586ce7bae1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.222+0000 7f3facb85640 1 -- 172.21.15.89:0/1812270963 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9c02ad40 con 0x7f3fa81055c0 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.222+0000 7f3facb85640 1 -- 172.21.15.89:0/1812270963 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f3f9c0328c0 con 0x7f3fa81055c0 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.222+0000 7f3facb85640 1 -- 172.21.15.89:0/1812270963 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9c0307f0 con 0x7f3fa81055c0 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.222+0000 7f3fafdeb640 1 -- 172.21.15.89:0/1812270963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 msgr2=0x7f3fa81059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.222+0000 7f3fafdeb640 1 --2- 172.21.15.89:0/1812270963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa81059c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009820 tx=0x7f3f9c02a270 comp rx=0 tx=0).stop 2024-09-13T21:59:36.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.223+0000 7f3fafdeb640 1 -- 172.21.15.89:0/1812270963 shutdown_connections 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.223+0000 7f3fafdeb640 1 --2- 172.21.15.89:0/1812270963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa81059c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.223+0000 7f3fafdeb640 1 -- 172.21.15.89:0/1812270963 >> 172.21.15.89:0/1812270963 conn(0x7f3fa8100d30 msgr2=0x7f3fa8103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.223+0000 7f3fafdeb640 1 -- 172.21.15.89:0/1812270963 shutdown_connections 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.223+0000 7f3fafdeb640 1 -- 172.21.15.89:0/1812270963 wait complete. 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.223+0000 7f3fafdeb640 1 Processor -- start 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.223+0000 7f3fafdeb640 1 -- start start 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.223+0000 7f3fafdeb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa807bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.223+0000 7f3fafdeb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa807c0a0 con 0x7f3fa81055c0 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3fadb87640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa807bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3fadb87640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa807bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45104/0 (socket says 172.21.15.89:45104) 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3fadb87640 1 -- 172.21.15.89:0/2842932549 learned_addr learned my addr 172.21.15.89:0/2842932549 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3fadb87640 1 -- 172.21.15.89:0/2842932549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c0094d0 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3fadb87640 1 --2- 172.21.15.89:0/2842932549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa807bb60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c030d30 tx=0x7f3f9c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3f9affd640 1 -- 172.21.15.89:0/2842932549 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9c032c40 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3f9affd640 1 -- 172.21.15.89:0/2842932549 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f3f9c032da0 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3fafdeb640 1 -- 172.21.15.89:0/2842932549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa807a290 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3f9affd640 1 -- 172.21.15.89:0/2842932549 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9c03c570 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3fafdeb640 1 -- 172.21.15.89:0/2842932549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa807a6b0 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.224+0000 7f3f9affd640 1 -- 172.21.15.89:0/2842932549 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3f9c03cae0 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.225+0000 7f3f9affd640 1 -- 172.21.15.89:0/2842932549 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3f9c047e00 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.225+0000 7f3fafdeb640 1 -- 172.21.15.89:0/2842932549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa81059c0 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.228+0000 7f3f9affd640 1 -- 172.21.15.89:0/2842932549 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3f9c037070 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.283+0000 7f3fafdeb640 1 -- 172.21.15.89:0/2842932549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f3fa807a8f0 con 0x7f3fa81055c0 2024-09-13T21:59:36.795 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.286+0000 7f3f9affd640 1 -- 172.21.15.89:0/2842932549 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3f9c03da90 con 0x7f3fa81055c0 2024-09-13T21:59:36.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.287+0000 7f3fafdeb640 1 -- 172.21.15.89:0/2842932549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 msgr2=0x7f3fa807bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:36.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.287+0000 7f3fafdeb640 1 --2- 172.21.15.89:0/2842932549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa807bb60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c030d30 tx=0x7f3f9c030d60 comp rx=0 tx=0).stop 2024-09-13T21:59:36.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.287+0000 7f3fafdeb640 1 -- 172.21.15.89:0/2842932549 shutdown_connections 2024-09-13T21:59:36.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.287+0000 7f3fafdeb640 1 --2- 172.21.15.89:0/2842932549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fa81055c0 0x7f3fa807bb60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:36.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.287+0000 7f3fafdeb640 1 -- 172.21.15.89:0/2842932549 >> 172.21.15.89:0/2842932549 conn(0x7f3fa8100d30 msgr2=0x7f3fa81018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:36.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.287+0000 7f3fafdeb640 1 -- 172.21.15.89:0/2842932549 shutdown_connections 2024-09-13T21:59:36.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:36.287+0000 7f3fafdeb640 1 -- 172.21.15.89:0/2842932549 wait complete. 2024-09-13T21:59:36.796 INFO:teuthology.orchestra.run.smithi089.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T21:59:36.809 INFO:teuthology.orchestra.run.smithi089.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:59:36.809 INFO:teuthology.orchestra.run.smithi089.stdout:Creating mgr... 2024-09-13T21:59:36.809 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T21:59:36.810 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T21:59:36.810 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T21:59:37.061 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-39489060-721b-11ef-bceb-c7b262605968@mgr.smithi089.naneiw 2024-09-13T21:59:37.061 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to reset failed state of unit ceph-39489060-721b-11ef-bceb-c7b262605968@mgr.smithi089.naneiw.service: Unit ceph-39489060-721b-11ef-bceb-c7b262605968@mgr.smithi089.naneiw.service not loaded. 2024-09-13T21:59:37.213 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-39489060-721b-11ef-bceb-c7b262605968.target.wants/ceph-39489060-721b-11ef-bceb-c7b262605968@mgr.smithi089.naneiw.service → /etc/systemd/system/ceph-39489060-721b-11ef-bceb-c7b262605968@.service. 2024-09-13T21:59:37.437 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:37 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2842932549' entity='client.admin' 2024-09-13T21:59:37.737 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:59:37.737 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout disabled 2024-09-13T21:59:37.744 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:59:37.744 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T21:59:37.744 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld.service is not enabled 2024-09-13T21:59:37.744 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T21:59:37.752 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:59:37.753 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout disabled 2024-09-13T21:59:37.760 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:59:37.760 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T21:59:37.760 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld.service is not enabled 2024-09-13T21:59:37.760 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T21:59:37.760 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr to start... 2024-09-13T21:59:37.760 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr... 2024-09-13T21:59:38.656 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:38 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2238841388' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T21:59:38.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:38.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:59:38.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsid": "39489060-721b-11ef-bceb-c7b262605968", 2024-09-13T21:59:38.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T21:59:38.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T21:59:38.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T21:59:38.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T21:59:38.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:38.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 0 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "smithi089" 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T21:59:38.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:59:38.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T21:59:38.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T21:59:38.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T21:59:38.835 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T21:59:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T21:59:38.837 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T21:59:22.912026+0000", 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.153+0000 7fdbfd383640 1 Processor -- start 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.153+0000 7fdbfd383640 1 -- start start 2024-09-13T21:59:38.838 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.153+0000 7fdbfd383640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf8103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.153+0000 7fdbfd383640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8104270 con 0x7fdbf81038a0 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.154+0000 7fdbf6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf8103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.154+0000 7fdbf6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf8103ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45146/0 (socket says 172.21.15.89:45146) 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.154+0000 7fdbf6ffd640 1 -- 172.21.15.89:0/819855294 learned_addr learned my addr 172.21.15.89:0/819855294 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.154+0000 7fdbf6ffd640 1 -- 172.21.15.89:0/819855294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf81043b0 con 0x7fdbf81038a0 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.155+0000 7fdbf6ffd640 1 --2- 172.21.15.89:0/819855294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf8103ca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009820 tx=0x7fdbec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d424f793bd63b6e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.155+0000 7fdbf5ffb640 1 -- 172.21.15.89:0/819855294 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdbec02ad40 con 0x7fdbf81038a0 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.155+0000 7fdbf5ffb640 1 -- 172.21.15.89:0/819855294 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fdbec0328c0 con 0x7fdbf81038a0 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.155+0000 7fdbf5ffb640 1 -- 172.21.15.89:0/819855294 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdbec0307f0 con 0x7fdbf81038a0 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.156+0000 7fdbfd383640 1 -- 172.21.15.89:0/819855294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 msgr2=0x7fdbf8103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.156+0000 7fdbfd383640 1 --2- 172.21.15.89:0/819855294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf8103ca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009820 tx=0x7fdbec02a270 comp rx=0 tx=0).stop 2024-09-13T21:59:38.839 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.156+0000 7fdbfd383640 1 -- 172.21.15.89:0/819855294 shutdown_connections 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.156+0000 7fdbfd383640 1 --2- 172.21.15.89:0/819855294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf8103ca0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.156+0000 7fdbfd383640 1 -- 172.21.15.89:0/819855294 >> 172.21.15.89:0/819855294 conn(0x7fdbf80ff3d0 msgr2=0x7fdbf8101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.156+0000 7fdbfd383640 1 -- 172.21.15.89:0/819855294 shutdown_connections 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.156+0000 7fdbfd383640 1 -- 172.21.15.89:0/819855294 wait complete. 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.156+0000 7fdbfd383640 1 Processor -- start 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.157+0000 7fdbfd383640 1 -- start start 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.157+0000 7fdbfd383640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.157+0000 7fdbfd383640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf819ba40 con 0x7fdbf81038a0 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.157+0000 7fdbf6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.157+0000 7fdbf6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf819b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45152/0 (socket says 172.21.15.89:45152) 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.157+0000 7fdbf6ffd640 1 -- 172.21.15.89:0/2238841388 learned_addr learned my addr 172.21.15.89:0/2238841388 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:38.840 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.157+0000 7fdbf6ffd640 1 -- 172.21.15.89:0/2238841388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec0094d0 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.158+0000 7fdbf6ffd640 1 --2- 172.21.15.89:0/2238841388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf819b500 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009940 tx=0x7fdbec032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.158+0000 7fdbdffff640 1 -- 172.21.15.89:0/2238841388 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdbec041070 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.158+0000 7fdbdffff640 1 -- 172.21.15.89:0/2238841388 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fdbec030cc0 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.158+0000 7fdbfd383640 1 -- 172.21.15.89:0/2238841388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf819bc40 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.158+0000 7fdbdffff640 1 -- 172.21.15.89:0/2238841388 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdbec03c620 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.158+0000 7fdbfd383640 1 -- 172.21.15.89:0/2238841388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf819c060 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.158+0000 7fdbdffff640 1 -- 172.21.15.89:0/2238841388 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fdbec03cb50 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.158+0000 7fdbdffff640 1 -- 172.21.15.89:0/2238841388 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdbec046e00 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.159+0000 7fdbfd383640 1 -- 172.21.15.89:0/2238841388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf8103ca0 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.161+0000 7fdbdffff640 1 -- 172.21.15.89:0/2238841388 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fdbec037070 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.221+0000 7fdbfd383640 1 -- 172.21.15.89:0/2238841388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdbf8105290 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.221+0000 7fdbdffff640 1 -- 172.21.15.89:0/2238841388 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fdbec030e30 con 0x7fdbf81038a0 2024-09-13T21:59:38.841 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.222+0000 7fdbfd383640 1 -- 172.21.15.89:0/2238841388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 msgr2=0x7fdbf819b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:38.842 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.222+0000 7fdbfd383640 1 --2- 172.21.15.89:0/2238841388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf819b500 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009940 tx=0x7fdbec032c60 comp rx=0 tx=0).stop 2024-09-13T21:59:38.842 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.222+0000 7fdbfd383640 1 -- 172.21.15.89:0/2238841388 shutdown_connections 2024-09-13T21:59:38.842 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.222+0000 7fdbfd383640 1 --2- 172.21.15.89:0/2238841388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf81038a0 0x7fdbf819b500 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:38.842 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.222+0000 7fdbfd383640 1 -- 172.21.15.89:0/2238841388 >> 172.21.15.89:0/2238841388 conn(0x7fdbf80ff3d0 msgr2=0x7fdbf8191cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:38.842 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.222+0000 7fdbfd383640 1 -- 172.21.15.89:0/2238841388 shutdown_connections 2024-09-13T21:59:38.842 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:38.222+0000 7fdbfd383640 1 -- 172.21.15.89:0/2238841388 wait complete. 2024-09-13T21:59:38.842 INFO:teuthology.orchestra.run.smithi089.stdout:mgr not available, waiting (1/15)... 2024-09-13T21:59:42.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: Activating manager daemon smithi089.naneiw 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: mgrmap e2: smithi089.naneiw(active, starting, since 0.00296967s) 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: Manager daemon smithi089.naneiw is now available 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/trash_purge_schedule"}]: dispatch 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:42.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:42 smithi089 ceph-mon[27921]: from='mgr.14100 172.21.15.89:0/325477711' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:44.742 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:44 smithi089 ceph-mon[27921]: mgrmap e3: smithi089.naneiw(active, since 1.00757s) 2024-09-13T21:59:45.039 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsid": "39489060-721b-11ef-bceb-c7b262605968", 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 0 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:59:45.040 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "smithi089" 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T21:59:45.041 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T21:59:45.051 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T21:59:45.052 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T21:59:22.912026+0000", 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:59:45.053 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.200+0000 7fa99c088640 1 Processor -- start 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.201+0000 7fa99c088640 1 -- start start 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.201+0000 7fa99c088640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa994108460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.201+0000 7fa99c088640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa994079e60 con 0x7fa994106070 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.201+0000 7fa999e24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa994108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.201+0000 7fa999e24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa994108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56748/0 (socket says 172.21.15.89:56748) 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.201+0000 7fa999e24640 1 -- 172.21.15.89:0/4054042916 learned_addr learned my addr 172.21.15.89:0/4054042916 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.201+0000 7fa999e24640 1 -- 172.21.15.89:0/4054042916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9941089a0 con 0x7fa994106070 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.202+0000 7fa999e24640 1 --2- 172.21.15.89:0/4054042916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa994108460 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa990009820 tx=0x7fa99002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb44235b7fccd83a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.202+0000 7fa998e22640 1 -- 172.21.15.89:0/4054042916 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa99002ad40 con 0x7fa994106070 2024-09-13T21:59:45.054 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.202+0000 7fa998e22640 1 -- 172.21.15.89:0/4054042916 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fa9900328c0 con 0x7fa994106070 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.202+0000 7fa998e22640 1 -- 172.21.15.89:0/4054042916 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9900307f0 con 0x7fa994106070 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.203+0000 7fa99c088640 1 -- 172.21.15.89:0/4054042916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 msgr2=0x7fa994108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.203+0000 7fa99c088640 1 --2- 172.21.15.89:0/4054042916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa994108460 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa990009820 tx=0x7fa99002a270 comp rx=0 tx=0).stop 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.203+0000 7fa99c088640 1 -- 172.21.15.89:0/4054042916 shutdown_connections 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.203+0000 7fa99c088640 1 --2- 172.21.15.89:0/4054042916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa994108460 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.203+0000 7fa99c088640 1 -- 172.21.15.89:0/4054042916 >> 172.21.15.89:0/4054042916 conn(0x7fa9940ffc30 msgr2=0x7fa994102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.203+0000 7fa99c088640 1 -- 172.21.15.89:0/4054042916 shutdown_connections 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.203+0000 7fa99c088640 1 -- 172.21.15.89:0/4054042916 wait complete. 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.204+0000 7fa99c088640 1 Processor -- start 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.204+0000 7fa99c088640 1 -- start start 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.204+0000 7fa99c088640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa9941058f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:45.055 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.204+0000 7fa99c088640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa994105e30 con 0x7fa994106070 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.204+0000 7fa999e24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa9941058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.204+0000 7fa999e24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa9941058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56760/0 (socket says 172.21.15.89:56760) 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.204+0000 7fa999e24640 1 -- 172.21.15.89:0/3060193159 learned_addr learned my addr 172.21.15.89:0/3060193159 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.204+0000 7fa999e24640 1 -- 172.21.15.89:0/3060193159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900094d0 con 0x7fa994106070 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.204+0000 7fa999e24640 1 --2- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa9941058f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa990009940 tx=0x7fa990032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.205+0000 7fa98affd640 1 -- 172.21.15.89:0/3060193159 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa990041070 con 0x7fa994106070 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.205+0000 7fa98affd640 1 -- 172.21.15.89:0/3060193159 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fa990030cc0 con 0x7fa994106070 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.205+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa994104020 con 0x7fa994106070 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.205+0000 7fa98affd640 1 -- 172.21.15.89:0/3060193159 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa99003c620 con 0x7fa994106070 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.205+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa994104440 con 0x7fa994106070 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.206+0000 7fa98affd640 1 -- 172.21.15.89:0/3060193159 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 45439+0+0 (secure 0 0 0) 0x7fa99003c780 con 0x7fa994106070 2024-09-13T21:59:45.056 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.206+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa994106450 con 0x7fa994106070 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.206+0000 7fa98affd640 1 --2- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fa980038530 0x7fa98003a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.206+0000 7fa98affd640 1 -- 172.21.15.89:0/3060193159 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa99006b4e0 con 0x7fa994106070 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.206+0000 7fa999623640 1 --2- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fa980038530 0x7fa98003a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.206+0000 7fa999623640 1 --2- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fa980038530 0x7fa98003a9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9840098c0 tx=0x7fa984006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.211+0000 7fa98affd640 1 -- 172.21.15.89:0/3060193159 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa990031e00 con 0x7fa994106070 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.424+0000 7fa98affd640 1 -- 172.21.15.89:0/3060193159 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fa99003db00 con 0x7fa994106070 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.436+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa9941096f0 con 0x7fa994106070 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.436+0000 7fa98affd640 1 -- 172.21.15.89:0/3060193159 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fa990031e00 con 0x7fa994106070 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fa980038530 msgr2=0x7fa98003a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 --2- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fa980038530 0x7fa98003a9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9840098c0 tx=0x7fa984006db0 comp rx=0 tx=0).stop 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 msgr2=0x7fa9941058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:45.057 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 --2- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa9941058f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa990009940 tx=0x7fa990032c60 comp rx=0 tx=0).stop 2024-09-13T21:59:45.058 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 shutdown_connections 2024-09-13T21:59:45.058 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 --2- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fa980038530 0x7fa98003a9f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:45.058 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 --2- 172.21.15.89:0/3060193159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa994106070 0x7fa9941058f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:45.058 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 >> 172.21.15.89:0/3060193159 conn(0x7fa9940ffc30 msgr2=0x7fa994100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:45.058 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 shutdown_connections 2024-09-13T21:59:45.058 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:44.438+0000 7fa99c088640 1 -- 172.21.15.89:0/3060193159 wait complete. 2024-09-13T21:59:45.058 INFO:teuthology.orchestra.run.smithi089.stdout:mgr is available 2024-09-13T21:59:45.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:45 smithi089 ceph-mon[27921]: mgrmap e4: smithi089.naneiw(active, since 2s) 2024-09-13T21:59:45.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:45 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3060193159' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T21:59:46.176 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:46.176 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T21:59:46.176 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout fsid = 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:59:46.176 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T21:59:46.176 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T21:59:46.176 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T21:59:46.176 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.448+0000 7f69957bf640 1 Processor -- start 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.448+0000 7f69957bf640 1 -- start start 2024-09-13T21:59:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.448+0000 7f69957bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.448+0000 7f69957bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990105fa0 con 0x7f69901055d0 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.448+0000 7f698effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.448+0000 7f698effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56766/0 (socket says 172.21.15.89:56766) 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.448+0000 7f698effd640 1 -- 172.21.15.89:0/214989979 learned_addr learned my addr 172.21.15.89:0/214989979 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.448+0000 7f698effd640 1 -- 172.21.15.89:0/214989979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69901067d0 con 0x7f69901055d0 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.449+0000 7f698effd640 1 --2- 172.21.15.89:0/214989979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901059d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6980009820 tx=0x7f698002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a453ceda63160ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.449+0000 7f698dffb640 1 -- 172.21.15.89:0/214989979 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f698002ad40 con 0x7f69901055d0 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.449+0000 7f698dffb640 1 -- 172.21.15.89:0/214989979 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f69800328c0 con 0x7f69901055d0 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.449+0000 7f698dffb640 1 -- 172.21.15.89:0/214989979 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69800307f0 con 0x7f69901055d0 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.450+0000 7f69957bf640 1 -- 172.21.15.89:0/214989979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 msgr2=0x7f69901059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.450+0000 7f69957bf640 1 --2- 172.21.15.89:0/214989979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901059d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6980009820 tx=0x7f698002a270 comp rx=0 tx=0).stop 2024-09-13T21:59:46.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.450+0000 7f69957bf640 1 -- 172.21.15.89:0/214989979 shutdown_connections 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.450+0000 7f69957bf640 1 --2- 172.21.15.89:0/214989979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901059d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.450+0000 7f69957bf640 1 -- 172.21.15.89:0/214989979 >> 172.21.15.89:0/214989979 conn(0x7f6990100d80 msgr2=0x7f69901031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.450+0000 7f69957bf640 1 -- 172.21.15.89:0/214989979 shutdown_connections 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.450+0000 7f69957bf640 1 -- 172.21.15.89:0/214989979 wait complete. 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.450+0000 7f69957bf640 1 Processor -- start 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f69957bf640 1 -- start start 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f69957bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f69957bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990199820 con 0x7f69901055d0 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f698effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f698effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56778/0 (socket says 172.21.15.89:56778) 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f698effd640 1 -- 172.21.15.89:0/3806466141 learned_addr learned my addr 172.21.15.89:0/3806466141 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:46.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f698effd640 1 -- 172.21.15.89:0/3806466141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800094d0 con 0x7f69901055d0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f698effd640 1 --2- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901992e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f69800303a0 tx=0x7f6980032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f6977fff640 1 -- 172.21.15.89:0/3806466141 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6980030cc0 con 0x7f69901055d0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.451+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6990199a20 con 0x7f69901055d0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.452+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6990199e40 con 0x7f69901055d0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.452+0000 7f6977fff640 1 -- 172.21.15.89:0/3806466141 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6980030e20 con 0x7f69901055d0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.452+0000 7f6977fff640 1 -- 172.21.15.89:0/3806466141 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f698003c620 con 0x7f69901055d0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.452+0000 7f6977fff640 1 -- 172.21.15.89:0/3806466141 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f698003c890 con 0x7f69901055d0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.452+0000 7f6977fff640 1 --2- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f6978038650 0x7f697803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.452+0000 7f6977fff640 1 -- 172.21.15.89:0/3806466141 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f698006b940 con 0x7f69901055d0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.452+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c005280 con 0x7f69901055d0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.453+0000 7f698e7fc640 1 --2- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f6978038650 0x7f697803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:46.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.453+0000 7f698e7fc640 1 --2- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f6978038650 0x7f697803ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f69840098c0 tx=0x7f6984006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.457+0000 7f6977fff640 1 -- 172.21.15.89:0/3806466141 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f69800313a0 con 0x7f69901055d0 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.618+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f697c005ab0 con 0x7f69901055d0 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.619+0000 7f6977fff640 1 -- 172.21.15.89:0/3806466141 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f698003bb30 con 0x7f69901055d0 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f6978038650 msgr2=0x7f697803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 --2- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f6978038650 0x7f697803ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f69840098c0 tx=0x7f6984006db0 comp rx=0 tx=0).stop 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 msgr2=0x7f69901992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 --2- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901992e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f69800303a0 tx=0x7f6980032c60 comp rx=0 tx=0).stop 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 shutdown_connections 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 --2- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f6978038650 0x7f697803ab10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 --2- 172.21.15.89:0/3806466141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69901055d0 0x7f69901992e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 >> 172.21.15.89:0/3806466141 conn(0x7f6990100d80 msgr2=0x7f69901018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 shutdown_connections 2024-09-13T21:59:46.182 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:45.621+0000 7f69957bf640 1 -- 172.21.15.89:0/3806466141 wait complete. 2024-09-13T21:59:46.182 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling cephadm module... 2024-09-13T21:59:46.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:46 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3806466141' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T21:59:47.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:47 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3020712953' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.578+0000 7f1de730c640 1 Processor -- start 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.578+0000 7f1de730c640 1 -- start start 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.579+0000 7f1de730c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.579+0000 7f1de730c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0079e20 con 0x7f1de01060c0 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.579+0000 7f1de50a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.579+0000 7f1de50a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56786/0 (socket says 172.21.15.89:56786) 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.579+0000 7f1de50a8640 1 -- 172.21.15.89:0/2705851585 learned_addr learned my addr 172.21.15.89:0/2705851585 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.579+0000 7f1de50a8640 1 -- 172.21.15.89:0/2705851585 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de01089f0 con 0x7f1de01060c0 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.580+0000 7f1de50a8640 1 --2- 172.21.15.89:0/2705851585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01084b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009820 tx=0x7f1ddc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ad6146d2e7e7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.580+0000 7f1dd7fff640 1 -- 172.21.15.89:0/2705851585 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ddc02ad40 con 0x7f1de01060c0 2024-09-13T21:59:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.580+0000 7f1dd7fff640 1 -- 172.21.15.89:0/2705851585 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f1ddc0328c0 con 0x7f1de01060c0 2024-09-13T21:59:48.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.580+0000 7f1dd7fff640 1 -- 172.21.15.89:0/2705851585 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ddc0307f0 con 0x7f1de01060c0 2024-09-13T21:59:48.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.580+0000 7f1de730c640 1 -- 172.21.15.89:0/2705851585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 msgr2=0x7f1de01084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:48.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.580+0000 7f1de730c640 1 --2- 172.21.15.89:0/2705851585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01084b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009820 tx=0x7f1ddc02a270 comp rx=0 tx=0).stop 2024-09-13T21:59:48.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de730c640 1 -- 172.21.15.89:0/2705851585 shutdown_connections 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de730c640 1 --2- 172.21.15.89:0/2705851585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01084b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de730c640 1 -- 172.21.15.89:0/2705851585 >> 172.21.15.89:0/2705851585 conn(0x7f1de00ffca0 msgr2=0x7f1de01020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de730c640 1 -- 172.21.15.89:0/2705851585 shutdown_connections 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de730c640 1 -- 172.21.15.89:0/2705851585 wait complete. 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de730c640 1 Processor -- start 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de730c640 1 -- start start 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de730c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de730c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de01997f0 con 0x7f1de01060c0 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de50a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de50a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56788/0 (socket says 172.21.15.89:56788) 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.581+0000 7f1de50a8640 1 -- 172.21.15.89:0/3020712953 learned_addr learned my addr 172.21.15.89:0/3020712953 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.582+0000 7f1de50a8640 1 -- 172.21.15.89:0/3020712953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0094d0 con 0x7f1de01060c0 2024-09-13T21:59:48.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.582+0000 7f1de50a8640 1 --2- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01992b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc030d30 tx=0x7f1ddc030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.582+0000 7f1dd67fc640 1 -- 172.21.15.89:0/3020712953 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ddc032c40 con 0x7f1de01060c0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.582+0000 7f1dd67fc640 1 -- 172.21.15.89:0/3020712953 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f1ddc032da0 con 0x7f1de01060c0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.582+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de01999f0 con 0x7f1de01060c0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.582+0000 7f1dd67fc640 1 -- 172.21.15.89:0/3020712953 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ddc03c660 con 0x7f1de01060c0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.582+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de0199e10 con 0x7f1de01060c0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.583+0000 7f1dd67fc640 1 -- 172.21.15.89:0/3020712953 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f1ddc03c7c0 con 0x7f1de01060c0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.583+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de0109710 con 0x7f1de01060c0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.583+0000 7f1dd67fc640 1 --2- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f1dcc038650 0x7f1dcc03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.583+0000 7f1dd67fc640 1 -- 172.21.15.89:0/3020712953 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1ddc06b850 con 0x7f1de01060c0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.583+0000 7f1de48a7640 1 --2- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f1dcc038650 0x7f1dcc03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.584+0000 7f1de48a7640 1 --2- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f1dcc038650 0x7f1dcc03ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00098c0 tx=0x7f1dd0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.588+0000 7f1dd67fc640 1 -- 172.21.15.89:0/3020712953 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1ddc0313a0 con 0x7f1de01060c0 2024-09-13T21:59:48.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:46.792+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f1de019c770 con 0x7f1de01060c0 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.427+0000 7f1dd67fc640 1 -- 172.21.15.89:0/3020712953 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f1ddc03db00 con 0x7f1de01060c0 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.428+0000 7f1dd67fc640 1 -- 172.21.15.89:0/3020712953 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f1ddc045360 con 0x7f1de01060c0 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f1dcc038650 msgr2=0x7f1dcc03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 --2- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f1dcc038650 0x7f1dcc03ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00098c0 tx=0x7f1dd0006db0 comp rx=0 tx=0).stop 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 msgr2=0x7f1de01992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 --2- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01992b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc030d30 tx=0x7f1ddc030d60 comp rx=0 tx=0).stop 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 shutdown_connections 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 --2- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7f1dcc038650 0x7f1dcc03ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 --2- 172.21.15.89:0/3020712953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de01060c0 0x7f1de01992b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 >> 172.21.15.89:0/3020712953 conn(0x7f1de00ffca0 msgr2=0x7f1de0100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 shutdown_connections 2024-09-13T21:59:48.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:47.431+0000 7f1de730c640 1 -- 172.21.15.89:0/3020712953 wait complete. 2024-09-13T21:59:48.688 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:48 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3020712953' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T21:59:48.688 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:48 smithi089 ceph-mon[27921]: mgrmap e5: smithi089.naneiw(active, since 5s) 2024-09-13T21:59:49.389 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:59:49.389 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T21:59:49.389 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T21:59:49.389 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "active_name": "smithi089.naneiw", 2024-09-13T21:59:49.389 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T21:59:49.389 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.509+0000 7ff27bea0640 1 Processor -- start 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.509+0000 7ff27bea0640 1 -- start start 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.509+0000 7ff27bea0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff274108520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.509+0000 7ff27bea0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff274079dc0 con 0x7ff274106130 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.509+0000 7ff279c3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff274108520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.509+0000 7ff279c3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff274108520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56810/0 (socket says 172.21.15.89:56810) 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.509+0000 7ff279c3c640 1 -- 172.21.15.89:0/1574866575 learned_addr learned my addr 172.21.15.89:0/1574866575 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.510+0000 7ff279c3c640 1 -- 172.21.15.89:0/1574866575 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274079f00 con 0x7ff274106130 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.510+0000 7ff279c3c640 1 --2- 172.21.15.89:0/1574866575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff274108520 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff270009820 tx=0x7ff27002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be43a5f61d7ded1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.510+0000 7ff278c3a640 1 -- 172.21.15.89:0/1574866575 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff27002ad40 con 0x7ff274106130 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.510+0000 7ff278c3a640 1 -- 172.21.15.89:0/1574866575 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff2700328c0 con 0x7ff274106130 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.510+0000 7ff278c3a640 1 -- 172.21.15.89:0/1574866575 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2700307f0 con 0x7ff274106130 2024-09-13T21:59:49.390 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.511+0000 7ff27bea0640 1 -- 172.21.15.89:0/1574866575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 msgr2=0x7ff274108520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.511+0000 7ff27bea0640 1 --2- 172.21.15.89:0/1574866575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff274108520 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff270009820 tx=0x7ff27002a270 comp rx=0 tx=0).stop 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.511+0000 7ff27bea0640 1 -- 172.21.15.89:0/1574866575 shutdown_connections 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.511+0000 7ff27bea0640 1 --2- 172.21.15.89:0/1574866575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff274108520 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.511+0000 7ff27bea0640 1 -- 172.21.15.89:0/1574866575 >> 172.21.15.89:0/1574866575 conn(0x7ff2740ffc50 msgr2=0x7ff2741020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.511+0000 7ff27bea0640 1 -- 172.21.15.89:0/1574866575 shutdown_connections 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.511+0000 7ff27bea0640 1 -- 172.21.15.89:0/1574866575 wait complete. 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff27bea0640 1 Processor -- start 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff27bea0640 1 -- start start 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff27bea0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff2741992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff27bea0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff274199800 con 0x7ff274106130 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff279c3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff2741992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:49.391 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff279c3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff2741992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56814/0 (socket says 172.21.15.89:56814) 2024-09-13T21:59:49.392 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff279c3c640 1 -- 172.21.15.89:0/1181647502 learned_addr learned my addr 172.21.15.89:0/1181647502 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:49.392 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff279c3c640 1 -- 172.21.15.89:0/1181647502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700094d0 con 0x7ff274106130 2024-09-13T21:59:49.392 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff279c3c640 1 --2- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff2741992c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff270030d30 tx=0x7ff270030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:49.392 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff26affd640 1 -- 172.21.15.89:0/1181647502 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff270032c40 con 0x7ff274106130 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.512+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff274199a00 con 0x7ff274106130 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.513+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff274199e20 con 0x7ff274106130 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.513+0000 7ff26affd640 1 -- 172.21.15.89:0/1181647502 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff270032da0 con 0x7ff274106130 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.513+0000 7ff26affd640 1 -- 172.21.15.89:0/1181647502 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff27003c660 con 0x7ff274106130 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.513+0000 7ff26affd640 1 -- 172.21.15.89:0/1181647502 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7ff27003c8c0 con 0x7ff274106130 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.514+0000 7ff26affd640 1 --2- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7ff2600386a0 0x7ff26003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.514+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff258005280 con 0x7ff274106130 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.514+0000 7ff27943b640 1 -- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7ff2600386a0 msgr2=0x7ff26003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1940163960 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.514+0000 7ff26affd640 1 -- 172.21.15.89:0/1181647502 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff27006b710 con 0x7ff274106130 2024-09-13T21:59:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.514+0000 7ff27943b640 1 --2- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7ff2600386a0 0x7ff26003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.518+0000 7ff26affd640 1 -- 172.21.15.89:0/1181647502 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff2700313a0 con 0x7ff274106130 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.715+0000 7ff27943b640 1 -- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7ff2600386a0 msgr2=0x7ff26003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1940163960 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.715+0000 7ff27943b640 1 --2- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7ff2600386a0 0x7ff26003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.732+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff258005d40 con 0x7ff274106130 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.732+0000 7ff26affd640 1 -- 172.21.15.89:0/1181647502 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7ff27003bb30 con 0x7ff274106130 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.734+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7ff2600386a0 msgr2=0x7ff26003ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.734+0000 7ff27bea0640 1 --2- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7ff2600386a0 0x7ff26003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.734+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 msgr2=0x7ff2741992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.734+0000 7ff27bea0640 1 --2- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff2741992c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff270030d30 tx=0x7ff270030d60 comp rx=0 tx=0).stop 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.734+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 shutdown_connections 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.734+0000 7ff27bea0640 1 --2- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7ff2600386a0 0x7ff26003ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:49.394 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.734+0000 7ff27bea0640 1 --2- 172.21.15.89:0/1181647502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff274106130 0x7ff2741992c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:49.395 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.734+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 >> 172.21.15.89:0/1181647502 conn(0x7ff2740ffc50 msgr2=0x7ff274100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:49.395 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.734+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 shutdown_connections 2024-09-13T21:59:49.395 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:48.735+0000 7ff27bea0640 1 -- 172.21.15.89:0/1181647502 wait complete. 2024-09-13T21:59:49.395 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for the mgr to restart... 2024-09-13T21:59:49.395 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr epoch 5... 2024-09-13T21:59:49.631 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:49 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1181647502' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: Active manager daemon smithi089.naneiw restarted 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: Activating manager daemon smithi089.naneiw 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: mgrmap e6: smithi089.naneiw(active, starting, since 0.00365697s) 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: Manager daemon smithi089.naneiw is now available 2024-09-13T21:59:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:59:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:59:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:59:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:52 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/trash_purge_schedule"}]: dispatch 2024-09-13T21:59:53.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:53 smithi089 ceph-mon[27921]: Found migration_current of "None". Setting to last migration. 2024-09-13T21:59:53.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:53 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:53.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:53 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:53.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:53 smithi089 ceph-mon[27921]: mgrmap e7: smithi089.naneiw(active, since 1.00549s) 2024-09-13T21:59:53.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:59:53.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T21:59:53.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.824+0000 7fe7ebe7d640 1 Processor -- start 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.825+0000 7fe7ebe7d640 1 -- start start 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.825+0000 7fe7ebe7d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e4108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.825+0000 7fe7ebe7d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4079ea0 con 0x7fe7e4106050 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.825+0000 7fe7e9c19640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e4108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.825+0000 7fe7e9c19640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e4108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56826/0 (socket says 172.21.15.89:56826) 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.825+0000 7fe7e9c19640 1 -- 172.21.15.89:0/1780737089 learned_addr learned my addr 172.21.15.89:0/1780737089 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.825+0000 7fe7e9c19640 1 -- 172.21.15.89:0/1780737089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e4108980 con 0x7fe7e4106050 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.826+0000 7fe7e9c19640 1 --2- 172.21.15.89:0/1780737089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e4108440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009820 tx=0x7fe7e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b38e0831993726 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.826+0000 7fe7e8c17640 1 -- 172.21.15.89:0/1780737089 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7e002ad40 con 0x7fe7e4106050 2024-09-13T21:59:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.826+0000 7fe7e8c17640 1 -- 172.21.15.89:0/1780737089 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe7e00328c0 con 0x7fe7e4106050 2024-09-13T21:59:53.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.826+0000 7fe7e8c17640 1 -- 172.21.15.89:0/1780737089 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7e00307f0 con 0x7fe7e4106050 2024-09-13T21:59:53.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.827+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/1780737089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 msgr2=0x7fe7e4108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:53.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.827+0000 7fe7ebe7d640 1 --2- 172.21.15.89:0/1780737089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e4108440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009820 tx=0x7fe7e002a270 comp rx=0 tx=0).stop 2024-09-13T21:59:53.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.827+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/1780737089 shutdown_connections 2024-09-13T21:59:53.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.827+0000 7fe7ebe7d640 1 --2- 172.21.15.89:0/1780737089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e4108440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:53.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.827+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/1780737089 >> 172.21.15.89:0/1780737089 conn(0x7fe7e40ffc50 msgr2=0x7fe7e41020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:53.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.827+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/1780737089 shutdown_connections 2024-09-13T21:59:53.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.827+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/1780737089 wait complete. 2024-09-13T21:59:53.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.828+0000 7fe7ebe7d640 1 Processor -- start 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.828+0000 7fe7ebe7d640 1 -- start start 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.828+0000 7fe7ebe7d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e41992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.828+0000 7fe7ebe7d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e41997f0 con 0x7fe7e4106050 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.828+0000 7fe7e9c19640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e41992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.828+0000 7fe7e9c19640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e41992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56838/0 (socket says 172.21.15.89:56838) 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.828+0000 7fe7e9c19640 1 -- 172.21.15.89:0/644279559 learned_addr learned my addr 172.21.15.89:0/644279559 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.828+0000 7fe7e9c19640 1 -- 172.21.15.89:0/644279559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e00094d0 con 0x7fe7e4106050 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.828+0000 7fe7e9c19640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e41992b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0030d30 tx=0x7fe7e0030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.829+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7e0032c40 con 0x7fe7e4106050 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.829+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/644279559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e41999f0 con 0x7fe7e4106050 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.829+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe7e0032da0 con 0x7fe7e4106050 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.829+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7e003c660 con 0x7fe7e4106050 2024-09-13T21:59:53.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.829+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/644279559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e4199e10 con 0x7fe7e4106050 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.830+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fe7e003db00 con 0x7fe7e4106050 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.830+0000 7fe7daffd640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 0x7fe7d003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.830+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 --> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7d003b220 con 0x7fe7d0038650 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.830+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe7e006b7d0 con 0x7fe7e4106050 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.830+0000 7fe7e9418640 1 -- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 msgr2=0x7fe7d003ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1940163960 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:49.830+0000 7fe7e9418640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 0x7fe7d003ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:50.031+0000 7fe7e9418640 1 -- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 msgr2=0x7fe7d003ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1940163960 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:50.031+0000 7fe7e9418640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 0x7fe7d003ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:50.432+0000 7fe7e9418640 1 -- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 msgr2=0x7fe7d003ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1940163960 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:50.432+0000 7fe7e9418640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 0x7fe7d003ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:51.233+0000 7fe7e9418640 1 -- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 msgr2=0x7fe7d003ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1940163960 2024-09-13T21:59:53.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:51.233+0000 7fe7e9418640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 0x7fe7d003ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:52.176+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mgrmap(e 6) v1 ==== 45323+0+0 (secure 0 0 0) 0x7fe7e003d800 con 0x7fe7e4106050 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:52.176+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 msgr2=0x7fe7d003ab10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:52.176+0000 7fe7daffd640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 0x7fe7d003ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.177+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7fe7e003d480 con 0x7fe7e4106050 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.177+0000 7fe7daffd640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fe7d003bfd0 0x7fe7d003e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.177+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7d003b220 con 0x7fe7d003bfd0 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.177+0000 7fe7e9418640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fe7d003bfd0 0x7fe7d003e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.179+0000 7fe7e9418640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fe7d003bfd0 0x7fe7d003e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4003980 tx=0x7fe7d4006e10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.180+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fe7d003b220 con 0x7fe7d003bfd0 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.184+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/644279559 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fe7e4109700 con 0x7fe7d003bfd0 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7daffd640 1 -- 172.21.15.89:0/644279559 <== mgr.14116 v2:172.21.15.89:6800/1295505650 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe7e4109700 con 0x7fe7d003bfd0 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fe7d003bfd0 msgr2=0x7fe7d003e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:53.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fe7d003bfd0 0x7fe7d003e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4003980 tx=0x7fe7d4006e10 comp rx=0 tx=0).stop 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 msgr2=0x7fe7e41992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e41992b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0030d30 tx=0x7fe7e0030d60 comp rx=0 tx=0).stop 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/644279559 shutdown_connections 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fe7d003bfd0 0x7fe7d003e3c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:6800/1940163960,v1:172.21.15.89:6801/1940163960] conn(0x7fe7d0038650 0x7fe7d003ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 --2- 172.21.15.89:0/644279559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e4106050 0x7fe7e41992b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/644279559 >> 172.21.15.89:0/644279559 conn(0x7fe7e40ffc50 msgr2=0x7fe7e4100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/644279559 shutdown_connections 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:53.185+0000 7fe7ebe7d640 1 -- 172.21.15.89:0/644279559 wait complete. 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:mgr epoch 5 is available 2024-09-13T21:59:53.802 INFO:teuthology.orchestra.run.smithi089.stdout:Setting orchestrator backend to cephadm... 2024-09-13T21:59:54.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:54 smithi089 ceph-mon[27921]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T21:59:54.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:54 smithi089 ceph-mon[27921]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T21:59:54.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:54 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:59:54.976 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.182+0000 7f2ddd027640 1 Processor -- start 2024-09-13T21:59:54.976 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.182+0000 7f2ddd027640 1 -- start start 2024-09-13T21:59:54.976 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.182+0000 7f2ddd027640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:54.976 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.182+0000 7f2ddd027640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd8079e60 con 0x7f2dd8106090 2024-09-13T21:59:54.976 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.183+0000 7f2dd6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:54.976 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.183+0000 7f2dd6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55786/0 (socket says 172.21.15.89:55786) 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.183+0000 7f2dd6d9d640 1 -- 172.21.15.89:0/2526602439 learned_addr learned my addr 172.21.15.89:0/2526602439 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.183+0000 7f2dd6d9d640 1 -- 172.21.15.89:0/2526602439 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd81089c0 con 0x7f2dd8106090 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.183+0000 7f2dd6d9d640 1 --2- 172.21.15.89:0/2526602439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8108480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009820 tx=0x7f2dc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13476c721f240461 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2dd5d9b640 1 -- 172.21.15.89:0/2526602439 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc802ad40 con 0x7f2dd8106090 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2dd5d9b640 1 -- 172.21.15.89:0/2526602439 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f2dc80328c0 con 0x7f2dd8106090 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2dd5d9b640 1 -- 172.21.15.89:0/2526602439 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc80307f0 con 0x7f2dd8106090 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2ddd027640 1 -- 172.21.15.89:0/2526602439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 msgr2=0x7f2dd8108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2ddd027640 1 --2- 172.21.15.89:0/2526602439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8108480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009820 tx=0x7f2dc802a270 comp rx=0 tx=0).stop 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2ddd027640 1 -- 172.21.15.89:0/2526602439 shutdown_connections 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2ddd027640 1 --2- 172.21.15.89:0/2526602439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8108480 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2ddd027640 1 -- 172.21.15.89:0/2526602439 >> 172.21.15.89:0/2526602439 conn(0x7f2dd80ffc50 msgr2=0x7f2dd81020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:54.977 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2ddd027640 1 -- 172.21.15.89:0/2526602439 shutdown_connections 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.184+0000 7f2ddd027640 1 -- 172.21.15.89:0/2526602439 wait complete. 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.185+0000 7f2ddd027640 1 Processor -- start 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.185+0000 7f2ddd027640 1 -- start start 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.185+0000 7f2ddd027640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8105910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.185+0000 7f2ddd027640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd8105e50 con 0x7f2dd8106090 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.185+0000 7f2dd6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8105910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.185+0000 7f2dd6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8105910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55788/0 (socket says 172.21.15.89:55788) 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.185+0000 7f2dd6d9d640 1 -- 172.21.15.89:0/3677642668 learned_addr learned my addr 172.21.15.89:0/3677642668 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.186+0000 7f2dd6d9d640 1 -- 172.21.15.89:0/3677642668 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80094d0 con 0x7f2dd8106090 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.186+0000 7f2dd6d9d640 1 --2- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8105910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8030d30 tx=0x7f2dc8030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.186+0000 7f2dcffff640 1 -- 172.21.15.89:0/3677642668 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc8032c40 con 0x7f2dd8106090 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.186+0000 7f2dcffff640 1 -- 172.21.15.89:0/3677642668 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f2dc8032da0 con 0x7f2dd8106090 2024-09-13T21:59:54.978 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.186+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd8104040 con 0x7f2dd8106090 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.186+0000 7f2dcffff640 1 -- 172.21.15.89:0/3677642668 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc803c660 con 0x7f2dd8106090 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.186+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd8104460 con 0x7f2dd8106090 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.187+0000 7f2dcffff640 1 -- 172.21.15.89:0/3677642668 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7f2dc803c8d0 con 0x7f2dd8106090 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.187+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd8109710 con 0x7f2dd8106090 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.187+0000 7f2dcffff640 1 --2- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f2dc4038530 0x7f2dc403a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.187+0000 7f2dcffff640 1 -- 172.21.15.89:0/3677642668 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2dc806b5a0 con 0x7f2dd8106090 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.187+0000 7f2dd659c640 1 --2- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f2dc4038530 0x7f2dc403a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.188+0000 7f2dd659c640 1 --2- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f2dc4038530 0x7f2dc403a9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00098c0 tx=0x7f2dc0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.192+0000 7f2dcffff640 1 -- 172.21.15.89:0/3677642668 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2dc803bd10 con 0x7f2dd8106090 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.233+0000 7f2dcffff640 1 -- 172.21.15.89:0/3677642668 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f2dc803db00 con 0x7f2dd8106090 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.369+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dd8104c50 con 0x7f2dc4038530 2024-09-13T21:59:54.979 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.378+0000 7f2dcffff640 1 -- 172.21.15.89:0/3677642668 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2dd8104c50 con 0x7f2dc4038530 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.380+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f2dc4038530 msgr2=0x7f2dc403a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.380+0000 7f2ddd027640 1 --2- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f2dc4038530 0x7f2dc403a9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00098c0 tx=0x7f2dc0006db0 comp rx=0 tx=0).stop 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.381+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 msgr2=0x7f2dd8105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.381+0000 7f2ddd027640 1 --2- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8105910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8030d30 tx=0x7f2dc8030d60 comp rx=0 tx=0).stop 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.381+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 shutdown_connections 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.381+0000 7f2ddd027640 1 --2- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f2dc4038530 0x7f2dc403a9f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.381+0000 7f2ddd027640 1 --2- 172.21.15.89:0/3677642668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd8106090 0x7f2dd8105910 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.381+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 >> 172.21.15.89:0/3677642668 conn(0x7f2dd80ffc50 msgr2=0x7f2dd8100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.381+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 shutdown_connections 2024-09-13T21:59:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:54.381+0000 7f2ddd027640 1 -- 172.21.15.89:0/3677642668 wait complete. 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:55 smithi089 ceph-mon[27921]: [13/Sep/2024:21:59:53] ENGINE Bus STARTING 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:55 smithi089 ceph-mon[27921]: [13/Sep/2024:21:59:53] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:55 smithi089 ceph-mon[27921]: [13/Sep/2024:21:59:53] ENGINE Error in HTTPServer.serve 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:59:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:55 smithi089 ceph-mon[27921]: [13/Sep/2024:21:59:53] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:55 smithi089 ceph-mon[27921]: [13/Sep/2024:21:59:53] ENGINE Bus STARTED 2024-09-13T21:59:55.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:55 smithi089 ceph-mon[27921]: mgrmap e8: smithi089.naneiw(active, since 2s) 2024-09-13T21:59:55.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:55 smithi089 ceph-mon[27921]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:59:55.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:55 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:55.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:55 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:59:56.101 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.349+0000 7f7c8bfcb640 1 Processor -- start 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.350+0000 7f7c8bfcb640 1 -- start start 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.350+0000 7f7c8bfcb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c841059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.350+0000 7f7c8bfcb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c84105f90 con 0x7f7c841055c0 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.350+0000 7f7c89d67640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c841059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.350+0000 7f7c89d67640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c841059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55792/0 (socket says 172.21.15.89:55792) 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.350+0000 7f7c89d67640 1 -- 172.21.15.89:0/4068526502 learned_addr learned my addr 172.21.15.89:0/4068526502 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.350+0000 7f7c89d67640 1 -- 172.21.15.89:0/4068526502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c841067c0 con 0x7f7c841055c0 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.351+0000 7f7c89d67640 1 --2- 172.21.15.89:0/4068526502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c841059c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009820 tx=0x7f7c8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af4a3343a3bca73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.351+0000 7f7c88d65640 1 -- 172.21.15.89:0/4068526502 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c8002ad40 con 0x7f7c841055c0 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.351+0000 7f7c88d65640 1 -- 172.21.15.89:0/4068526502 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f7c800328c0 con 0x7f7c841055c0 2024-09-13T21:59:56.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.351+0000 7f7c88d65640 1 -- 172.21.15.89:0/4068526502 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c800307f0 con 0x7f7c841055c0 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.351+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/4068526502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 msgr2=0x7f7c841059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.351+0000 7f7c8bfcb640 1 --2- 172.21.15.89:0/4068526502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c841059c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009820 tx=0x7f7c8002a270 comp rx=0 tx=0).stop 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/4068526502 shutdown_connections 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c8bfcb640 1 --2- 172.21.15.89:0/4068526502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c841059c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/4068526502 >> 172.21.15.89:0/4068526502 conn(0x7f7c84100d30 msgr2=0x7f7c84103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/4068526502 shutdown_connections 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/4068526502 wait complete. 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c8bfcb640 1 Processor -- start 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c8bfcb640 1 -- start start 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c8bfcb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c8407bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c8bfcb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8407c0a0 con 0x7f7c841055c0 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c89d67640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c8407bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:56.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c89d67640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c8407bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55806/0 (socket says 172.21.15.89:55806) 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.352+0000 7f7c89d67640 1 -- 172.21.15.89:0/147449808 learned_addr learned my addr 172.21.15.89:0/147449808 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.353+0000 7f7c89d67640 1 -- 172.21.15.89:0/147449808 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800094d0 con 0x7f7c841055c0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.353+0000 7f7c89d67640 1 --2- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c8407bb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c80030d30 tx=0x7f7c80030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.353+0000 7f7c7affd640 1 -- 172.21.15.89:0/147449808 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c80032c40 con 0x7f7c841055c0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.353+0000 7f7c7affd640 1 -- 172.21.15.89:0/147449808 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f7c80032da0 con 0x7f7c841055c0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.353+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8407a290 con 0x7f7c841055c0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.353+0000 7f7c7affd640 1 -- 172.21.15.89:0/147449808 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c8003c570 con 0x7f7c841055c0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.353+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8407a6b0 con 0x7f7c841055c0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.354+0000 7f7c7affd640 1 -- 172.21.15.89:0/147449808 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f7c8003c7e0 con 0x7f7c841055c0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.354+0000 7f7c7affd640 1 --2- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f7c700386a0 0x7f7c7003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.354+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c841059c0 con 0x7f7c841055c0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.354+0000 7f7c7affd640 1 -- 172.21.15.89:0/147449808 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7c8006baa0 con 0x7f7c841055c0 2024-09-13T21:59:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.354+0000 7f7c89566640 1 --2- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f7c700386a0 0x7f7c7003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.354+0000 7f7c89566640 1 --2- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f7c700386a0 0x7f7c7003ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098c0 tx=0x7f7c74006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.359+0000 7f7c7affd640 1 -- 172.21.15.89:0/147449808 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c8003b340 con 0x7f7c841055c0 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.523+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c8407aea0 con 0x7f7c700386a0 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.524+0000 7f7c7affd640 1 -- 172.21.15.89:0/147449808 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f7c8407aea0 con 0x7f7c700386a0 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f7c700386a0 msgr2=0x7f7c7003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 --2- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f7c700386a0 0x7f7c7003ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098c0 tx=0x7f7c74006db0 comp rx=0 tx=0).stop 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 msgr2=0x7f7c8407bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 --2- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c8407bb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c80030d30 tx=0x7f7c80030d60 comp rx=0 tx=0).stop 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 shutdown_connections 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 --2- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f7c700386a0 0x7f7c7003ab60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 --2- 172.21.15.89:0/147449808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c841055c0 0x7f7c8407bb60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 >> 172.21.15.89:0/147449808 conn(0x7f7c84100d30 msgr2=0x7f7c84101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:56.106 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 shutdown_connections 2024-09-13T21:59:56.106 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:55.526+0000 7f7c8bfcb640 1 -- 172.21.15.89:0/147449808 wait complete. 2024-09-13T21:59:56.106 INFO:teuthology.orchestra.run.smithi089.stdout:Generating ssh key... 2024-09-13T21:59:56.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:56 smithi089 ceph-mon[27921]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:59:57.533 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.505+0000 7f963800d640 1 Processor -- start 2024-09-13T21:59:57.533 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.505+0000 7f963800d640 1 -- start start 2024-09-13T21:59:57.533 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.505+0000 7f963800d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.505+0000 7f963800d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9630104270 con 0x7f96301038a0 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.505+0000 7f9635da9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.505+0000 7f9635da9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630103ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55816/0 (socket says 172.21.15.89:55816) 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.505+0000 7f9635da9640 1 -- 172.21.15.89:0/1489777005 learned_addr learned my addr 172.21.15.89:0/1489777005 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.505+0000 7f9635da9640 1 -- 172.21.15.89:0/1489777005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96301043b0 con 0x7f96301038a0 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.506+0000 7f9635da9640 1 --2- 172.21.15.89:0/1489777005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630103ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f962c009820 tx=0x7f962c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5624a43926a2026f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.506+0000 7f9634da7640 1 -- 172.21.15.89:0/1489777005 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962c02ad40 con 0x7f96301038a0 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.506+0000 7f9634da7640 1 -- 172.21.15.89:0/1489777005 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f962c0328c0 con 0x7f96301038a0 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.506+0000 7f9634da7640 1 -- 172.21.15.89:0/1489777005 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962c0307f0 con 0x7f96301038a0 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.507+0000 7f963800d640 1 -- 172.21.15.89:0/1489777005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 msgr2=0x7f9630103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.507+0000 7f963800d640 1 --2- 172.21.15.89:0/1489777005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630103ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f962c009820 tx=0x7f962c02a270 comp rx=0 tx=0).stop 2024-09-13T21:59:57.534 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.507+0000 7f963800d640 1 -- 172.21.15.89:0/1489777005 shutdown_connections 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.507+0000 7f963800d640 1 --2- 172.21.15.89:0/1489777005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630103ca0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.507+0000 7f963800d640 1 -- 172.21.15.89:0/1489777005 >> 172.21.15.89:0/1489777005 conn(0x7f96300ff3d0 msgr2=0x7f9630101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.507+0000 7f963800d640 1 -- 172.21.15.89:0/1489777005 shutdown_connections 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.507+0000 7f963800d640 1 -- 172.21.15.89:0/1489777005 wait complete. 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f963800d640 1 Processor -- start 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f963800d640 1 -- start start 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f963800d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f963800d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96301998b0 con 0x7f96301038a0 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f9635da9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f9635da9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55826/0 (socket says 172.21.15.89:55826) 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f9635da9640 1 -- 172.21.15.89:0/656536026 learned_addr learned my addr 172.21.15.89:0/656536026 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f9635da9640 1 -- 172.21.15.89:0/656536026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0094d0 con 0x7f96301038a0 2024-09-13T21:59:57.535 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f9635da9640 1 --2- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630199370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f962c030d30 tx=0x7f962c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.508+0000 7f9626ffd640 1 -- 172.21.15.89:0/656536026 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962c032c40 con 0x7f96301038a0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.509+0000 7f9626ffd640 1 -- 172.21.15.89:0/656536026 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f962c032da0 con 0x7f96301038a0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.509+0000 7f9626ffd640 1 -- 172.21.15.89:0/656536026 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962c03c570 con 0x7f96301038a0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.509+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9630199ab0 con 0x7f96301038a0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.509+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9630199ed0 con 0x7f96301038a0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.509+0000 7f9626ffd640 1 -- 172.21.15.89:0/656536026 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f962c03da90 con 0x7f96301038a0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.510+0000 7f9626ffd640 1 --2- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f961c0386a0 0x7f961c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.510+0000 7f9626ffd640 1 -- 172.21.15.89:0/656536026 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f962c06b9e0 con 0x7f96301038a0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.510+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9630103ca0 con 0x7f96301038a0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.510+0000 7f96355a8640 1 --2- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f961c0386a0 0x7f961c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:57.536 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.510+0000 7f96355a8640 1 --2- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f961c0386a0 0x7f961c03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f96200098c0 tx=0x7f9620006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.514+0000 7f9626ffd640 1 -- 172.21.15.89:0/656536026 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f962c031790 con 0x7f96301038a0 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.677+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f963019c830 con 0x7f961c0386a0 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.958+0000 7f9626ffd640 1 -- 172.21.15.89:0/656536026 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f963019c830 con 0x7f961c0386a0 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f961c0386a0 msgr2=0x7f961c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 --2- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f961c0386a0 0x7f961c03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f96200098c0 tx=0x7f9620006db0 comp rx=0 tx=0).stop 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 msgr2=0x7f9630199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 --2- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630199370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f962c030d30 tx=0x7f962c030d60 comp rx=0 tx=0).stop 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 shutdown_connections 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 --2- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f961c0386a0 0x7f961c03ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 --2- 172.21.15.89:0/656536026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96301038a0 0x7f9630199370 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 >> 172.21.15.89:0/656536026 conn(0x7f96300ff3d0 msgr2=0x7f9630100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 shutdown_connections 2024-09-13T21:59:57.537 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:56.960+0000 7f963800d640 1 -- 172.21.15.89:0/656536026 wait complete. 2024-09-13T21:59:58.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:57 smithi089 ceph-mon[27921]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:59:58.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:57 smithi089 ceph-mon[27921]: Generating ssh key... 2024-09-13T21:59:58.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:57 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:58.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:57 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T21:59:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCthAk5uuZLSJEjH1L+gEUQ5Jwq5Sj3XdvJMkoE9qa1qaRDb1UPnhzs3PbYJDtJ3kMD4C1UZY8+yU0U/Dcn6cjP/chnhN/kZAiIltpE0ZCqDwkJtKW5n3wfudULtBomZq/4WyKXj5MDHEt6n5oR6MHxYn1g7NRgi7+ZLgxp67x3ztZc0fD1Jn8EJG/IBPC2GYQVFVzXKHDzKZmhZKzs2OsXvLJxgFynVQAF8zuhTowiIXGpYDbfSxhp2MnvSQk8qZfutr17kjFb6uG3n7l6Vz+aolEPHIVREYcuzvvJrWev9lHGr23Z0Z4dChUUAZVusd/cs5HbZ/nH6kPJm7SWQomPsa7HL8hjI3194cNXPU36PL8oKO/dQznvVxblFYZMAnVSZeUoLLSuLEIqbSJTnQ5svCWOgGw/d+77kQBD8N06B6I8tzdn5P3f0wnxTDMmZhMC/VbAVDz1rkmLb/t1I7GhNBwuY+43aX5KlgdZyOmDoTloxzUetNaJNjy6yn1csq8= ceph-39489060-721b-11ef-bceb-c7b262605968 2024-09-13T21:59:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.957+0000 7f5335605640 1 Processor -- start 2024-09-13T21:59:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.957+0000 7f5335605640 1 -- start start 2024-09-13T21:59:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.957+0000 7f5335605640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f5330108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.957+0000 7f5335605640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5330079ea0 con 0x7f5330106050 2024-09-13T21:59:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.957+0000 7f532effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f5330108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.958+0000 7f532effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f5330108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55834/0 (socket says 172.21.15.89:55834) 2024-09-13T21:59:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.958+0000 7f532effd640 1 -- 172.21.15.89:0/2293249535 learned_addr learned my addr 172.21.15.89:0/2293249535 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.958+0000 7f532effd640 1 -- 172.21.15.89:0/2293249535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330108980 con 0x7f5330106050 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.958+0000 7f532effd640 1 --2- 172.21.15.89:0/2293249535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f5330108440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5320009820 tx=0x7f532002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff542549dd7c28a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f532e7fc640 1 -- 172.21.15.89:0/2293249535 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f532002ad40 con 0x7f5330106050 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f532e7fc640 1 -- 172.21.15.89:0/2293249535 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f53200328c0 con 0x7f5330106050 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f532e7fc640 1 -- 172.21.15.89:0/2293249535 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53200307f0 con 0x7f5330106050 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f5335605640 1 -- 172.21.15.89:0/2293249535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 msgr2=0x7f5330108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f5335605640 1 --2- 172.21.15.89:0/2293249535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f5330108440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5320009820 tx=0x7f532002a270 comp rx=0 tx=0).stop 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f5335605640 1 -- 172.21.15.89:0/2293249535 shutdown_connections 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f5335605640 1 --2- 172.21.15.89:0/2293249535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f5330108440 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f5335605640 1 -- 172.21.15.89:0/2293249535 >> 172.21.15.89:0/2293249535 conn(0x7f53300ffc50 msgr2=0x7f53301020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f5335605640 1 -- 172.21.15.89:0/2293249535 shutdown_connections 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.959+0000 7f5335605640 1 -- 172.21.15.89:0/2293249535 wait complete. 2024-09-13T21:59:58.691 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.960+0000 7f5335605640 1 Processor -- start 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.960+0000 7f5335605640 1 -- start start 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.960+0000 7f5335605640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f53301992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.960+0000 7f5335605640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53301997f0 con 0x7f5330106050 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.960+0000 7f532effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f53301992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.960+0000 7f532effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f53301992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55838/0 (socket says 172.21.15.89:55838) 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.960+0000 7f532effd640 1 -- 172.21.15.89:0/2649250063 learned_addr learned my addr 172.21.15.89:0/2649250063 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.960+0000 7f532effd640 1 -- 172.21.15.89:0/2649250063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200094d0 con 0x7f5330106050 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.961+0000 7f532effd640 1 --2- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f53301992b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5320009940 tx=0x7f5320032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.961+0000 7f532cff9640 1 -- 172.21.15.89:0/2649250063 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5320041070 con 0x7f5330106050 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.961+0000 7f532cff9640 1 -- 172.21.15.89:0/2649250063 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f5320030cc0 con 0x7f5330106050 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.961+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53301999f0 con 0x7f5330106050 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.961+0000 7f532cff9640 1 -- 172.21.15.89:0/2649250063 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f532003c620 con 0x7f5330106050 2024-09-13T21:59:58.692 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.961+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5330199e10 con 0x7f5330106050 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.962+0000 7f532cff9640 1 -- 172.21.15.89:0/2649250063 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f532003c780 con 0x7f5330106050 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.962+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5330109700 con 0x7f5330106050 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.962+0000 7f532cff9640 1 --2- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f531c0386a0 0x7f531c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.962+0000 7f532cff9640 1 -- 172.21.15.89:0/2649250063 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f532006b600 con 0x7f5330106050 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.962+0000 7f53267fc640 1 --2- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f531c0386a0 0x7f531c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.962+0000 7f53267fc640 1 --2- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f531c0386a0 0x7f531c03ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f53180098c0 tx=0x7f5318006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:57.966+0000 7f532cff9640 1 -- 172.21.15.89:0/2649250063 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5320031bd0 con 0x7f5330106050 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.132+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f5330100f40 con 0x7f531c0386a0 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.133+0000 7f532cff9640 1 -- 172.21.15.89:0/2649250063 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f5330100f40 con 0x7f531c0386a0 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.134+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f531c0386a0 msgr2=0x7f531c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.135+0000 7f5335605640 1 --2- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f531c0386a0 0x7f531c03ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f53180098c0 tx=0x7f5318006db0 comp rx=0 tx=0).stop 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.135+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 msgr2=0x7f53301992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:59:58.693 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.135+0000 7f5335605640 1 --2- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f53301992b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5320009940 tx=0x7f5320032c60 comp rx=0 tx=0).stop 2024-09-13T21:59:58.694 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.135+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 shutdown_connections 2024-09-13T21:59:58.694 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.135+0000 7f5335605640 1 --2- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f531c0386a0 0x7f531c03ab60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:58.694 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.135+0000 7f5335605640 1 --2- 172.21.15.89:0/2649250063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5330106050 0x7f53301992b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:59:58.694 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.135+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 >> 172.21.15.89:0/2649250063 conn(0x7f53300ffc50 msgr2=0x7f5330100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:59:58.694 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.135+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 shutdown_connections 2024-09-13T21:59:58.694 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:58.135+0000 7f5335605640 1 -- 172.21.15.89:0/2649250063 wait complete. 2024-09-13T21:59:58.694 INFO:teuthology.orchestra.run.smithi089.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T21:59:58.694 INFO:teuthology.orchestra.run.smithi089.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T21:59:58.696 INFO:teuthology.orchestra.run.smithi089.stdout:Adding host smithi089... 2024-09-13T21:59:59.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:58 smithi089 ceph-mon[27921]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:00.044 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 21:59:59 smithi089 ceph-mon[27921]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi089", "addr": "172.21.15.89", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:00.979 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:00 smithi089 ceph-mon[27921]: Deploying cephadm binary to smithi089 2024-09-13T22:00:02.401 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Added host 'smithi089' with addr '172.21.15.89' 2024-09-13T22:00:02.401 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.062+0000 7f5397d6a640 1 Processor -- start 2024-09-13T22:00:02.401 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.063+0000 7f5397d6a640 1 -- start start 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.063+0000 7f5397d6a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f53901048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.063+0000 7f5397d6a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390104ea0 con 0x7f53901044d0 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.063+0000 7f5395b06640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f53901048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.063+0000 7f5395b06640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f53901048d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55852/0 (socket says 172.21.15.89:55852) 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.063+0000 7f5395b06640 1 -- 172.21.15.89:0/599111038 learned_addr learned my addr 172.21.15.89:0/599111038 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.063+0000 7f5395b06640 1 -- 172.21.15.89:0/599111038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53901056d0 con 0x7f53901044d0 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.064+0000 7f5395b06640 1 --2- 172.21.15.89:0/599111038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f53901048d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f538c009820 tx=0x7f538c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78302c9764faa5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.064+0000 7f5394b04640 1 -- 172.21.15.89:0/599111038 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f538c02ad40 con 0x7f53901044d0 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.064+0000 7f5394b04640 1 -- 172.21.15.89:0/599111038 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f538c0328c0 con 0x7f53901044d0 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.064+0000 7f5394b04640 1 -- 172.21.15.89:0/599111038 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f538c0307f0 con 0x7f53901044d0 2024-09-13T22:00:02.402 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 -- 172.21.15.89:0/599111038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 msgr2=0x7f53901048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 --2- 172.21.15.89:0/599111038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f53901048d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f538c009820 tx=0x7f538c02a270 comp rx=0 tx=0).stop 2024-09-13T22:00:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 -- 172.21.15.89:0/599111038 shutdown_connections 2024-09-13T22:00:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 --2- 172.21.15.89:0/599111038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f53901048d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 -- 172.21.15.89:0/599111038 >> 172.21.15.89:0/599111038 conn(0x7f53900ffcc0 msgr2=0x7f53901020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 -- 172.21.15.89:0/599111038 shutdown_connections 2024-09-13T22:00:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 -- 172.21.15.89:0/599111038 wait complete. 2024-09-13T22:00:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 Processor -- start 2024-09-13T22:00:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 -- start start 2024-09-13T22:00:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f5390079a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.065+0000 7f5397d6a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390079f80 con 0x7f53901044d0 2024-09-13T22:00:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5395b06640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f5390079a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5395b06640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f5390079a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55860/0 (socket says 172.21.15.89:55860) 2024-09-13T22:00:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5395b06640 1 -- 172.21.15.89:0/307058979 learned_addr learned my addr 172.21.15.89:0/307058979 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5395b06640 1 -- 172.21.15.89:0/307058979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c0094d0 con 0x7f53901044d0 2024-09-13T22:00:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5395b06640 1 --2- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f5390079a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f538c030d30 tx=0x7f538c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5386ffd640 1 -- 172.21.15.89:0/307058979 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f538c032c40 con 0x7f53901044d0 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539019c090 con 0x7f53901044d0 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5386ffd640 1 -- 172.21.15.89:0/307058979 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f538c032da0 con 0x7f53901044d0 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5386ffd640 1 -- 172.21.15.89:0/307058979 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f538c03c420 con 0x7f53901044d0 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.066+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539019c4b0 con 0x7f53901044d0 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.067+0000 7f5386ffd640 1 -- 172.21.15.89:0/307058979 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f538c03c6e0 con 0x7f53901044d0 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.067+0000 7f5386ffd640 1 --2- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f537c038650 0x7f537c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.067+0000 7f5386ffd640 1 -- 172.21.15.89:0/307058979 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f538c06b9d0 con 0x7f53901044d0 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.067+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5390108900 con 0x7f53901044d0 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.067+0000 7f5395305640 1 --2- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f537c038650 0x7f537c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.068+0000 7f5395305640 1 --2- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f537c038650 0x7f537c03ab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f53800098c0 tx=0x7f5380006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.072+0000 7f5386ffd640 1 -- 172.21.15.89:0/307058979 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f538c03b520 con 0x7f53901044d0 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T21:59:59.237+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi089", "addr": "172.21.15.89", "target": ["mon-mgr", ""]}) v1 -- 0x7f539019c7b0 con 0x7f537c038650 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.846+0000 7f5386ffd640 1 -- 172.21.15.89:0/307058979 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f539019c7b0 con 0x7f537c038650 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.848+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f537c038650 msgr2=0x7f537c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.848+0000 7f5397d6a640 1 --2- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f537c038650 0x7f537c03ab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f53800098c0 tx=0x7f5380006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.849+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 msgr2=0x7f5390079a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.849+0000 7f5397d6a640 1 --2- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f5390079a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f538c030d30 tx=0x7f538c030d60 comp rx=0 tx=0).stop 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.849+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 shutdown_connections 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.849+0000 7f5397d6a640 1 --2- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f537c038650 0x7f537c03ab10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.849+0000 7f5397d6a640 1 --2- 172.21.15.89:0/307058979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53901044d0 0x7f5390079a40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.849+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 >> 172.21.15.89:0/307058979 conn(0x7f53900ffcc0 msgr2=0x7f5390100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:02.406 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.849+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 shutdown_connections 2024-09-13T22:00:02.407 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:01.849+0000 7f5397d6a640 1 -- 172.21.15.89:0/307058979 wait complete. 2024-09-13T22:00:02.407 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying mon service with default placement... 2024-09-13T22:00:02.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:02 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:02.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:02 smithi089 ceph-mon[27921]: Added host smithi089 2024-09-13T22:00:02.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:02 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:00:04.654 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.844+0000 7fb8f7464640 1 Processor -- start 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.845+0000 7fb8f7464640 1 -- start start 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.845+0000 7fb8f7464640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.845+0000 7fb8f7464640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0079e00 con 0x7fb8f01060f0 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.845+0000 7fb8f5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.845+0000 7fb8f5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34416/0 (socket says 172.21.15.89:34416) 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.845+0000 7fb8f5200640 1 -- 172.21.15.89:0/2732346105 learned_addr learned my addr 172.21.15.89:0/2732346105 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.845+0000 7fb8f5200640 1 -- 172.21.15.89:0/2732346105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0079f40 con 0x7fb8f01060f0 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.846+0000 7fb8f5200640 1 --2- 172.21.15.89:0/2732346105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01084e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009820 tx=0x7fb8ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2118d4b9460be19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.846+0000 7fb8e7fff640 1 -- 172.21.15.89:0/2732346105 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8ec02ad40 con 0x7fb8f01060f0 2024-09-13T22:00:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.846+0000 7fb8e7fff640 1 -- 172.21.15.89:0/2732346105 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8ec032900 con 0x7fb8f01060f0 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.846+0000 7fb8e7fff640 1 -- 172.21.15.89:0/2732346105 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8ec030860 con 0x7fb8f01060f0 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.847+0000 7fb8f7464640 1 -- 172.21.15.89:0/2732346105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 msgr2=0x7fb8f01084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.847+0000 7fb8f7464640 1 --2- 172.21.15.89:0/2732346105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01084e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009820 tx=0x7fb8ec02a270 comp rx=0 tx=0).stop 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.847+0000 7fb8f7464640 1 -- 172.21.15.89:0/2732346105 shutdown_connections 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.847+0000 7fb8f7464640 1 --2- 172.21.15.89:0/2732346105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01084e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.847+0000 7fb8f7464640 1 -- 172.21.15.89:0/2732346105 >> 172.21.15.89:0/2732346105 conn(0x7fb8f00ffc50 msgr2=0x7fb8f01020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.847+0000 7fb8f7464640 1 -- 172.21.15.89:0/2732346105 shutdown_connections 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.847+0000 7fb8f7464640 1 -- 172.21.15.89:0/2732346105 wait complete. 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.847+0000 7fb8f7464640 1 Processor -- start 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f7464640 1 -- start start 2024-09-13T22:00:04.656 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f7464640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f7464640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0199830 con 0x7fb8f01060f0 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34422/0 (socket says 172.21.15.89:34422) 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f5200640 1 -- 172.21.15.89:0/4283044051 learned_addr learned my addr 172.21.15.89:0/4283044051 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f5200640 1 -- 172.21.15.89:0/4283044051 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec0094d0 con 0x7fb8f01060f0 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f5200640 1 --2- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01992f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec032670 tx=0x7fb8ec0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8e67fc640 1 -- 172.21.15.89:0/4283044051 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8ec032c80 con 0x7fb8f01060f0 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f0199a30 con 0x7fb8f01060f0 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8e67fc640 1 -- 172.21.15.89:0/4283044051 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8ec032de0 con 0x7fb8f01060f0 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8e67fc640 1 -- 172.21.15.89:0/4283044051 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8ec03a720 con 0x7fb8f01060f0 2024-09-13T22:00:04.657 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.848+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f0199ed0 con 0x7fb8f01060f0 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.849+0000 7fb8e67fc640 1 -- 172.21.15.89:0/4283044051 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fb8ec03a9a0 con 0x7fb8f01060f0 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.849+0000 7fb8e67fc640 1 --2- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb8dc038650 0x7fb8dc03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.849+0000 7fb8e67fc640 1 -- 172.21.15.89:0/4283044051 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb8ec06b950 con 0x7fb8f01060f0 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.849+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f0109760 con 0x7fb8f01060f0 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.850+0000 7fb8f49ff640 1 --2- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb8dc038650 0x7fb8dc03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.850+0000 7fb8f49ff640 1 --2- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb8dc038650 0x7fb8dc03ab10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00098c0 tx=0x7fb8e0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:03.854+0000 7fb8e67fc640 1 -- 172.21.15.89:0/4283044051 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb8ec0319f0 con 0x7fb8f01060f0 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.039+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f0100f60 con 0x7fb8dc038650 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.044+0000 7fb8e67fc640 1 -- 172.21.15.89:0/4283044051 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb8f0100f60 con 0x7fb8dc038650 2024-09-13T22:00:04.658 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb8dc038650 msgr2=0x7fb8dc03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 --2- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb8dc038650 0x7fb8dc03ab10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00098c0 tx=0x7fb8e0006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 msgr2=0x7fb8f01992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 --2- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01992f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec032670 tx=0x7fb8ec0326a0 comp rx=0 tx=0).stop 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 shutdown_connections 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 --2- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb8dc038650 0x7fb8dc03ab10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 --2- 172.21.15.89:0/4283044051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8f01060f0 0x7fb8f01992f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 >> 172.21.15.89:0/4283044051 conn(0x7fb8f00ffc50 msgr2=0x7fb8f0100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 shutdown_connections 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:04.046+0000 7fb8f7464640 1 -- 172.21.15.89:0/4283044051 wait complete. 2024-09-13T22:00:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying mgr service with default placement... 2024-09-13T22:00:04.957 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:04 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:04.957 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:04 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:04.957 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:04 smithi089 ceph-mon[27921]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:04.957 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:04 smithi089 ceph-mon[27921]: Saving service mon spec with placement count:5 2024-09-13T22:00:04.957 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:04 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:05.796 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.034+0000 7fcd61111640 1 Processor -- start 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.034+0000 7fcd61111640 1 -- start start 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.034+0000 7fcd61111640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.034+0000 7fcd61111640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c079de0 con 0x7fcd5c106100 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.035+0000 7fcd5ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.035+0000 7fcd5ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1084f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34438/0 (socket says 172.21.15.89:34438) 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.035+0000 7fcd5ad9d640 1 -- 172.21.15.89:0/1875247257 learned_addr learned my addr 172.21.15.89:0/1875247257 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.035+0000 7fcd5ad9d640 1 -- 172.21.15.89:0/1875247257 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c079f20 con 0x7fcd5c106100 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.035+0000 7fcd5ad9d640 1 --2- 172.21.15.89:0/1875247257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1084f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009820 tx=0x7fcd4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a70f6ca72f35fff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd59d9b640 1 -- 172.21.15.89:0/1875247257 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd4c02ad40 con 0x7fcd5c106100 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd59d9b640 1 -- 172.21.15.89:0/1875247257 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd4c032900 con 0x7fcd5c106100 2024-09-13T22:00:05.797 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd59d9b640 1 -- 172.21.15.89:0/1875247257 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd4c030860 con 0x7fcd5c106100 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd61111640 1 -- 172.21.15.89:0/1875247257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 msgr2=0x7fcd5c1084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd61111640 1 --2- 172.21.15.89:0/1875247257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1084f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009820 tx=0x7fcd4c02a270 comp rx=0 tx=0).stop 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd61111640 1 -- 172.21.15.89:0/1875247257 shutdown_connections 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd61111640 1 --2- 172.21.15.89:0/1875247257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1084f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd61111640 1 -- 172.21.15.89:0/1875247257 >> 172.21.15.89:0/1875247257 conn(0x7fcd5c0ffc20 msgr2=0x7fcd5c1020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd61111640 1 -- 172.21.15.89:0/1875247257 shutdown_connections 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.036+0000 7fcd61111640 1 -- 172.21.15.89:0/1875247257 wait complete. 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.037+0000 7fcd61111640 1 Processor -- start 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.037+0000 7fcd61111640 1 -- start start 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.037+0000 7fcd61111640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.037+0000 7fcd61111640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c199820 con 0x7fcd5c106100 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.037+0000 7fcd5ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.037+0000 7fcd5ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34446/0 (socket says 172.21.15.89:34446) 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.037+0000 7fcd5ad9d640 1 -- 172.21.15.89:0/3240936666 learned_addr learned my addr 172.21.15.89:0/3240936666 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.038+0000 7fcd5ad9d640 1 -- 172.21.15.89:0/3240936666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0094d0 con 0x7fcd5c106100 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.038+0000 7fcd5ad9d640 1 --2- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1992e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0097f0 tx=0x7fcd4c030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.038+0000 7fcd53fff640 1 -- 172.21.15.89:0/3240936666 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd4c040070 con 0x7fcd5c106100 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.038+0000 7fcd53fff640 1 -- 172.21.15.89:0/3240936666 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd4c032dd0 con 0x7fcd5c106100 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.038+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c199a20 con 0x7fcd5c106100 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.038+0000 7fcd53fff640 1 -- 172.21.15.89:0/3240936666 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd4c03a790 con 0x7fcd5c106100 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.038+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c199ec0 con 0x7fcd5c106100 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.039+0000 7fcd53fff640 1 -- 172.21.15.89:0/3240936666 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fcd4c03a8f0 con 0x7fcd5c106100 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.039+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c109770 con 0x7fcd5c106100 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.039+0000 7fcd53fff640 1 --2- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fcd480386a0 0x7fcd4803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:05.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.039+0000 7fcd53fff640 1 -- 172.21.15.89:0/3240936666 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcd4c06b8c0 con 0x7fcd5c106100 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.039+0000 7fcd5a59c640 1 --2- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fcd480386a0 0x7fcd4803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.040+0000 7fcd5a59c640 1 --2- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fcd480386a0 0x7fcd4803ab60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd440098c0 tx=0x7fcd44006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.044+0000 7fcd53fff640 1 -- 172.21.15.89:0/3240936666 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd4c039b90 con 0x7fcd5c106100 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.228+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd5c100f10 con 0x7fcd480386a0 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.232+0000 7fcd53fff640 1 -- 172.21.15.89:0/3240936666 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcd5c100f10 con 0x7fcd480386a0 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.234+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fcd480386a0 msgr2=0x7fcd4803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.234+0000 7fcd61111640 1 --2- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fcd480386a0 0x7fcd4803ab60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd440098c0 tx=0x7fcd44006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.234+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 msgr2=0x7fcd5c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.234+0000 7fcd61111640 1 --2- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1992e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0097f0 tx=0x7fcd4c030d50 comp rx=0 tx=0).stop 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.234+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 shutdown_connections 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.234+0000 7fcd61111640 1 --2- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fcd480386a0 0x7fcd4803ab60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.234+0000 7fcd61111640 1 --2- 172.21.15.89:0/3240936666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd5c106100 0x7fcd5c1992e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.234+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 >> 172.21.15.89:0/3240936666 conn(0x7fcd5c0ffc20 msgr2=0x7fcd5c100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.235+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 shutdown_connections 2024-09-13T22:00:05.801 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:05.235+0000 7fcd61111640 1 -- 172.21.15.89:0/3240936666 wait complete. 2024-09-13T22:00:05.801 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying crash service with default placement... 2024-09-13T22:00:06.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:06 smithi089 ceph-mon[27921]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:06.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:06 smithi089 ceph-mon[27921]: Saving service mgr spec with placement count:2 2024-09-13T22:00:06.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:06 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:07.286 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.382+0000 7fc8c0a65640 1 Processor -- start 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.382+0000 7fc8c0a65640 1 -- start start 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.383+0000 7fc8c0a65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.383+0000 7fc8c0a65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc104eb0 con 0x7fc8bc1044e0 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.383+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.383+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34452/0 (socket says 172.21.15.89:34452) 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.383+0000 7fc8ba59c640 1 -- 172.21.15.89:0/3304763357 learned_addr learned my addr 172.21.15.89:0/3304763357 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.383+0000 7fc8ba59c640 1 -- 172.21.15.89:0/3304763357 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc1056e0 con 0x7fc8bc1044e0 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8ba59c640 1 --2- 172.21.15.89:0/3304763357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1048e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009e80 tx=0x7fc8ac02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15fff6d6577a149 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8b959a640 1 -- 172.21.15.89:0/3304763357 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8ac031400 con 0x7fc8bc1044e0 2024-09-13T22:00:07.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8b959a640 1 -- 172.21.15.89:0/3304763357 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8ac02d050 con 0x7fc8bc1044e0 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8b959a640 1 -- 172.21.15.89:0/3304763357 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8ac007930 con 0x7fc8bc1044e0 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3304763357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 msgr2=0x7fc8bc1048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8c0a65640 1 --2- 172.21.15.89:0/3304763357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1048e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009e80 tx=0x7fc8ac02a7a0 comp rx=0 tx=0).stop 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3304763357 shutdown_connections 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8c0a65640 1 --2- 172.21.15.89:0/3304763357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1048e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3304763357 >> 172.21.15.89:0/3304763357 conn(0x7fc8bc0ffc50 msgr2=0x7fc8bc1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3304763357 shutdown_connections 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.384+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3304763357 wait complete. 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.385+0000 7fc8c0a65640 1 Processor -- start 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.385+0000 7fc8c0a65640 1 -- start start 2024-09-13T22:00:07.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.385+0000 7fc8c0a65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:07.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.385+0000 7fc8c0a65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc199900 con 0x7fc8bc1044e0 2024-09-13T22:00:07.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.385+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:07.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.385+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34462/0 (socket says 172.21.15.89:34462) 2024-09-13T22:00:07.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.385+0000 7fc8ba59c640 1 -- 172.21.15.89:0/3935620424 learned_addr learned my addr 172.21.15.89:0/3935620424 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:07.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.386+0000 7fc8ba59c640 1 -- 172.21.15.89:0/3935620424 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009b30 con 0x7fc8bc1044e0 2024-09-13T22:00:07.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.386+0000 7fc8ba59c640 1 --2- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1993c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac02acc0 tx=0x7fc8ac0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.386+0000 7fc8b37fe640 1 -- 172.21.15.89:0/3935620424 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8ac03a550 con 0x7fc8bc1044e0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.386+0000 7fc8b37fe640 1 -- 172.21.15.89:0/3935620424 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8ac03ab70 con 0x7fc8bc1044e0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.386+0000 7fc8b37fe640 1 -- 172.21.15.89:0/3935620424 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8ac039b20 con 0x7fc8bc1044e0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.386+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc199b00 con 0x7fc8bc1044e0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.386+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc199fa0 con 0x7fc8bc1044e0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.387+0000 7fc8b37fe640 1 -- 172.21.15.89:0/3935620424 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fc8ac038040 con 0x7fc8bc1044e0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.387+0000 7fc8b37fe640 1 --2- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fc8a8038650 0x7fc8a803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.387+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc108910 con 0x7fc8bc1044e0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.387+0000 7fc8b37fe640 1 -- 172.21.15.89:0/3935620424 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc8ac06b590 con 0x7fc8bc1044e0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.387+0000 7fc8b9d9b640 1 --2- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fc8a8038650 0x7fc8a803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.388+0000 7fc8b9d9b640 1 --2- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fc8a8038650 0x7fc8a803ab10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40098c0 tx=0x7fc8a4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.392+0000 7fc8b37fe640 1 -- 172.21.15.89:0/3935620424 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc8ac041070 con 0x7fc8bc1044e0 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.570+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8bc100f10 con 0x7fc8a8038650 2024-09-13T22:00:07.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.574+0000 7fc8b37fe640 1 -- 172.21.15.89:0/3935620424 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fc8bc100f10 con 0x7fc8a8038650 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fc8a8038650 msgr2=0x7fc8a803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 --2- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fc8a8038650 0x7fc8a803ab10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40098c0 tx=0x7fc8a4006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 msgr2=0x7fc8bc1993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 --2- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1993c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac02acc0 tx=0x7fc8ac0319a0 comp rx=0 tx=0).stop 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 shutdown_connections 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 --2- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fc8a8038650 0x7fc8a803ab10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 --2- 172.21.15.89:0/3935620424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc1044e0 0x7fc8bc1993c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 >> 172.21.15.89:0/3935620424 conn(0x7fc8bc0ffc50 msgr2=0x7fc8bc100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 shutdown_connections 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:06.576+0000 7fc8c0a65640 1 -- 172.21.15.89:0/3935620424 wait complete. 2024-09-13T22:00:07.292 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying ceph-exporter service with default placement... 2024-09-13T22:00:07.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:07 smithi089 ceph-mon[27921]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:07.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:07 smithi089 ceph-mon[27921]: Saving service crash spec with placement * 2024-09-13T22:00:07.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:07 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:07.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:07 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.685+0000 7f38dfefd640 1 Processor -- start 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.685+0000 7f38dfefd640 1 -- start start 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.686+0000 7f38dfefd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d81048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.686+0000 7f38dfefd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8104eb0 con 0x7f38d81044e0 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.686+0000 7f38ddc99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d81048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.686+0000 7f38ddc99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d81048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34466/0 (socket says 172.21.15.89:34466) 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.686+0000 7f38ddc99640 1 -- 172.21.15.89:0/60872980 learned_addr learned my addr 172.21.15.89:0/60872980 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.686+0000 7f38ddc99640 1 -- 172.21.15.89:0/60872980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d81056e0 con 0x7f38d81044e0 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.687+0000 7f38ddc99640 1 --2- 172.21.15.89:0/60872980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d81048e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009820 tx=0x7f38c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c38f2b90cab958c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.687+0000 7f38dcc97640 1 -- 172.21.15.89:0/60872980 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38c802ad40 con 0x7f38d81044e0 2024-09-13T22:00:08.461 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.687+0000 7f38dcc97640 1 -- 172.21.15.89:0/60872980 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38c8032900 con 0x7f38d81044e0 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.687+0000 7f38dcc97640 1 -- 172.21.15.89:0/60872980 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38c8030860 con 0x7f38d81044e0 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.688+0000 7f38dfefd640 1 -- 172.21.15.89:0/60872980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 msgr2=0x7f38d81048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.688+0000 7f38dfefd640 1 --2- 172.21.15.89:0/60872980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d81048e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009820 tx=0x7f38c802a270 comp rx=0 tx=0).stop 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.688+0000 7f38dfefd640 1 -- 172.21.15.89:0/60872980 shutdown_connections 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.688+0000 7f38dfefd640 1 --2- 172.21.15.89:0/60872980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d81048e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.688+0000 7f38dfefd640 1 -- 172.21.15.89:0/60872980 >> 172.21.15.89:0/60872980 conn(0x7f38d80ffc50 msgr2=0x7f38d81020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.688+0000 7f38dfefd640 1 -- 172.21.15.89:0/60872980 shutdown_connections 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.688+0000 7f38dfefd640 1 -- 172.21.15.89:0/60872980 wait complete. 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.688+0000 7f38dfefd640 1 Processor -- start 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.688+0000 7f38dfefd640 1 -- start start 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38dfefd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d8079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38dfefd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d819c030 con 0x7f38d81044e0 2024-09-13T22:00:08.462 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38ddc99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d8079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38ddc99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d8079a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34472/0 (socket says 172.21.15.89:34472) 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38ddc99640 1 -- 172.21.15.89:0/2383317279 learned_addr learned my addr 172.21.15.89:0/2383317279 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38ddc99640 1 -- 172.21.15.89:0/2383317279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c80094d0 con 0x7f38d81044e0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38ddc99640 1 --2- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d8079a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009940 tx=0x7f38c8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38ceffd640 1 -- 172.21.15.89:0/2383317279 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38c8032c80 con 0x7f38d81044e0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38ceffd640 1 -- 172.21.15.89:0/2383317279 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38c8032de0 con 0x7f38d81044e0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d819c170 con 0x7f38d81044e0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38ceffd640 1 -- 172.21.15.89:0/2383317279 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38c803a720 con 0x7f38d81044e0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.689+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d819c550 con 0x7f38d81044e0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.690+0000 7f38ceffd640 1 -- 172.21.15.89:0/2383317279 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f38c803cc30 con 0x7f38d81044e0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.690+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d8108910 con 0x7f38d81044e0 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.690+0000 7f38ceffd640 1 --2- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f38c4038650 0x7f38c403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:08.463 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.690+0000 7f38ceffd640 1 -- 172.21.15.89:0/2383317279 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f38c806b9c0 con 0x7f38d81044e0 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.690+0000 7f38dd498640 1 --2- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f38c4038650 0x7f38c403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.691+0000 7f38dd498640 1 --2- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f38c4038650 0x7f38c403ab10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38d40098c0 tx=0x7f38d4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.695+0000 7f38ceffd640 1 -- 172.21.15.89:0/2383317279 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f38c8043310 con 0x7f38d81044e0 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.876+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f38d8100ec0 con 0x7f38c4038650 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.883+0000 7f38ceffd640 1 -- 172.21.15.89:0/2383317279 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f38d8100ec0 con 0x7f38c4038650 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f38c4038650 msgr2=0x7f38c403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 --2- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f38c4038650 0x7f38c403ab10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38d40098c0 tx=0x7f38d4006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 msgr2=0x7f38d8079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 --2- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d8079a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009940 tx=0x7f38c8032670 comp rx=0 tx=0).stop 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 shutdown_connections 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 --2- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f38c4038650 0x7f38c403ab10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 --2- 172.21.15.89:0/2383317279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d81044e0 0x7f38d8079a80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:08.464 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 >> 172.21.15.89:0/2383317279 conn(0x7f38d80ffc50 msgr2=0x7f38d81007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:08.465 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 shutdown_connections 2024-09-13T22:00:08.465 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:07.885+0000 7f38dfefd640 1 -- 172.21.15.89:0/2383317279 wait complete. 2024-09-13T22:00:08.465 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying prometheus service with default placement... 2024-09-13T22:00:09.052 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:08 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:09.052 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:08 smithi089 ceph-mon[27921]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:09.052 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:08 smithi089 ceph-mon[27921]: Saving service ceph-exporter spec with placement * 2024-09-13T22:00:09.052 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:08 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:09.619 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T22:00:09.619 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.856+0000 7fba3aafa640 1 Processor -- start 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.856+0000 7fba3aafa640 1 -- start start 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.856+0000 7fba3aafa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba341059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.856+0000 7fba3aafa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba34105f90 con 0x7fba341055c0 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.856+0000 7fba38896640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba341059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.856+0000 7fba38896640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba341059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34476/0 (socket says 172.21.15.89:34476) 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.856+0000 7fba38896640 1 -- 172.21.15.89:0/2010644662 learned_addr learned my addr 172.21.15.89:0/2010644662 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.856+0000 7fba38896640 1 -- 172.21.15.89:0/2010644662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba341067c0 con 0x7fba341055c0 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.857+0000 7fba38896640 1 --2- 172.21.15.89:0/2010644662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba341059c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fba30009820 tx=0x7fba3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc660ec76f13cebb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.857+0000 7fba2b7fe640 1 -- 172.21.15.89:0/2010644662 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba3002ad40 con 0x7fba341055c0 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.857+0000 7fba2b7fe640 1 -- 172.21.15.89:0/2010644662 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba30032900 con 0x7fba341055c0 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.857+0000 7fba2b7fe640 1 -- 172.21.15.89:0/2010644662 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba30030860 con 0x7fba341055c0 2024-09-13T22:00:09.620 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.858+0000 7fba3aafa640 1 -- 172.21.15.89:0/2010644662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 msgr2=0x7fba341059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.858+0000 7fba3aafa640 1 --2- 172.21.15.89:0/2010644662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba341059c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fba30009820 tx=0x7fba3002a270 comp rx=0 tx=0).stop 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.858+0000 7fba3aafa640 1 -- 172.21.15.89:0/2010644662 shutdown_connections 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.858+0000 7fba3aafa640 1 --2- 172.21.15.89:0/2010644662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba341059c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.858+0000 7fba3aafa640 1 -- 172.21.15.89:0/2010644662 >> 172.21.15.89:0/2010644662 conn(0x7fba34100d30 msgr2=0x7fba34103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.858+0000 7fba3aafa640 1 -- 172.21.15.89:0/2010644662 shutdown_connections 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.858+0000 7fba3aafa640 1 -- 172.21.15.89:0/2010644662 wait complete. 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba3aafa640 1 Processor -- start 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba3aafa640 1 -- start start 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba3aafa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba34199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba3aafa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba34199870 con 0x7fba341055c0 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba38896640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba34199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba38896640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba34199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34488/0 (socket says 172.21.15.89:34488) 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba38896640 1 -- 172.21.15.89:0/727084577 learned_addr learned my addr 172.21.15.89:0/727084577 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:09.621 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba38896640 1 -- 172.21.15.89:0/727084577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba300094d0 con 0x7fba341055c0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba38896640 1 --2- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba34199330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fba30009940 tx=0x7fba30032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba29ffb640 1 -- 172.21.15.89:0/727084577 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba30032c80 con 0x7fba341055c0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba29ffb640 1 -- 172.21.15.89:0/727084577 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba30032de0 con 0x7fba341055c0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba34199a70 con 0x7fba341055c0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.859+0000 7fba29ffb640 1 -- 172.21.15.89:0/727084577 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba3003a720 con 0x7fba341055c0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.860+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba34199f10 con 0x7fba341055c0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.860+0000 7fba29ffb640 1 -- 172.21.15.89:0/727084577 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fba3003cc30 con 0x7fba341055c0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.861+0000 7fba29ffb640 1 --2- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fba1c0386a0 0x7fba1c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.861+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba341099f0 con 0x7fba341055c0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.861+0000 7fba29ffb640 1 -- 172.21.15.89:0/727084577 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fba3006b990 con 0x7fba341055c0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.861+0000 7fba2bfff640 1 --2- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fba1c0386a0 0x7fba1c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.861+0000 7fba2bfff640 1 --2- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fba1c0386a0 0x7fba1c03ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba240098c0 tx=0x7fba24006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:09.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:08.865+0000 7fba29ffb640 1 -- 172.21.15.89:0/727084577 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fba30043310 con 0x7fba341055c0 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.050+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fba34101fa0 con 0x7fba1c0386a0 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.058+0000 7fba29ffb640 1 -- 172.21.15.89:0/727084577 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fba34101fa0 con 0x7fba1c0386a0 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fba1c0386a0 msgr2=0x7fba1c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 --2- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fba1c0386a0 0x7fba1c03ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba240098c0 tx=0x7fba24006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 msgr2=0x7fba34199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 --2- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba34199330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fba30009940 tx=0x7fba30032670 comp rx=0 tx=0).stop 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 shutdown_connections 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 --2- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fba1c0386a0 0x7fba1c03ab60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 --2- 172.21.15.89:0/727084577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba341055c0 0x7fba34199330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 >> 172.21.15.89:0/727084577 conn(0x7fba34100d30 msgr2=0x7fba34101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 shutdown_connections 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:09.060+0000 7fba3aafa640 1 -- 172.21.15.89:0/727084577 wait complete. 2024-09-13T22:00:09.623 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying grafana service with default placement... 2024-09-13T22:00:10.483 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:10 smithi089 ceph-mon[27921]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:10.484 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:10 smithi089 ceph-mon[27921]: Saving service prometheus spec with placement count:1 2024-09-13T22:00:10.484 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:10 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:11.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T22:00:11.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.776+0000 7fb9b84b5640 1 Processor -- start 2024-09-13T22:00:11.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.776+0000 7fb9b84b5640 1 -- start start 2024-09-13T22:00:11.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.776+0000 7fb9b84b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b01048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:11.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.776+0000 7fb9b84b5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0104e90 con 0x7fb9b01044c0 2024-09-13T22:00:11.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.776+0000 7fb9b6251640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b01048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.777+0000 7fb9b6251640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b01048c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34490/0 (socket says 172.21.15.89:34490) 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.777+0000 7fb9b6251640 1 -- 172.21.15.89:0/992708084 learned_addr learned my addr 172.21.15.89:0/992708084 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.777+0000 7fb9b6251640 1 -- 172.21.15.89:0/992708084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b01056c0 con 0x7fb9b01044c0 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.777+0000 7fb9b6251640 1 --2- 172.21.15.89:0/992708084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b01048c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009820 tx=0x7fb9ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ff0659bdf89ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b524f640 1 -- 172.21.15.89:0/992708084 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9ac02ad40 con 0x7fb9b01044c0 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b524f640 1 -- 172.21.15.89:0/992708084 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9ac032900 con 0x7fb9b01044c0 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b524f640 1 -- 172.21.15.89:0/992708084 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9ac030860 con 0x7fb9b01044c0 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b84b5640 1 -- 172.21.15.89:0/992708084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 msgr2=0x7fb9b01048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b84b5640 1 --2- 172.21.15.89:0/992708084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b01048c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009820 tx=0x7fb9ac02a270 comp rx=0 tx=0).stop 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b84b5640 1 -- 172.21.15.89:0/992708084 shutdown_connections 2024-09-13T22:00:11.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b84b5640 1 --2- 172.21.15.89:0/992708084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b01048c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:11.491 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b84b5640 1 -- 172.21.15.89:0/992708084 >> 172.21.15.89:0/992708084 conn(0x7fb9b00ffc30 msgr2=0x7fb9b0102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:11.491 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b84b5640 1 -- 172.21.15.89:0/992708084 shutdown_connections 2024-09-13T22:00:11.491 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.778+0000 7fb9b84b5640 1 -- 172.21.15.89:0/992708084 wait complete. 2024-09-13T22:00:11.491 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.779+0000 7fb9b84b5640 1 Processor -- start 2024-09-13T22:00:11.491 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.779+0000 7fb9b84b5640 1 -- start start 2024-09-13T22:00:11.491 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.779+0000 7fb9b84b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:11.491 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.779+0000 7fb9b84b5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0199860 con 0x7fb9b01044c0 2024-09-13T22:00:11.491 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.779+0000 7fb9b6251640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:11.492 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.779+0000 7fb9b6251640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b0199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34502/0 (socket says 172.21.15.89:34502) 2024-09-13T22:00:11.492 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.779+0000 7fb9b6251640 1 -- 172.21.15.89:0/167416976 learned_addr learned my addr 172.21.15.89:0/167416976 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:11.492 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.780+0000 7fb9b6251640 1 -- 172.21.15.89:0/167416976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0094d0 con 0x7fb9b01044c0 2024-09-13T22:00:11.492 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.780+0000 7fb9b6251640 1 --2- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b0199320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009940 tx=0x7fb9ac032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:11.492 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.780+0000 7fb9a77fe640 1 -- 172.21.15.89:0/167416976 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9ac032c80 con 0x7fb9b01044c0 2024-09-13T22:00:11.492 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.780+0000 7fb9a77fe640 1 -- 172.21.15.89:0/167416976 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9ac032de0 con 0x7fb9b01044c0 2024-09-13T22:00:11.492 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.780+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b0199a60 con 0x7fb9b01044c0 2024-09-13T22:00:11.492 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.780+0000 7fb9a77fe640 1 -- 172.21.15.89:0/167416976 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9ac03a720 con 0x7fb9b01044c0 2024-09-13T22:00:11.492 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.780+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b0199f00 con 0x7fb9b01044c0 2024-09-13T22:00:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.781+0000 7fb9a77fe640 1 -- 172.21.15.89:0/167416976 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fb9ac03c400 con 0x7fb9b01044c0 2024-09-13T22:00:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.781+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b0193590 con 0x7fb9b01044c0 2024-09-13T22:00:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.781+0000 7fb9a77fe640 1 --2- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb99c0386a0 0x7fb99c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.781+0000 7fb9a77fe640 1 -- 172.21.15.89:0/167416976 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb9ac06b8c0 con 0x7fb9b01044c0 2024-09-13T22:00:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.781+0000 7fb9b5a50640 1 --2- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb99c0386a0 0x7fb99c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.782+0000 7fb9b5a50640 1 --2- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb99c0386a0 0x7fb99c03ab60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00098c0 tx=0x7fb9a0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.786+0000 7fb9a77fe640 1 -- 172.21.15.89:0/167416976 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb9ac03cc30 con 0x7fb9b01044c0 2024-09-13T22:00:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.959+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b002c610 con 0x7fb99c0386a0 2024-09-13T22:00:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.963+0000 7fb9a77fe640 1 -- 172.21.15.89:0/167416976 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fb9b002c610 con 0x7fb99c0386a0 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb99c0386a0 msgr2=0x7fb99c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 --2- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb99c0386a0 0x7fb99c03ab60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00098c0 tx=0x7fb9a0006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 msgr2=0x7fb9b0199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 --2- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b0199320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009940 tx=0x7fb9ac032670 comp rx=0 tx=0).stop 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 shutdown_connections 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 --2- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fb99c0386a0 0x7fb99c03ab60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 --2- 172.21.15.89:0/167416976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9b01044c0 0x7fb9b0199320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 >> 172.21.15.89:0/167416976 conn(0x7fb9b00ffc30 msgr2=0x7fb9b0100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 shutdown_connections 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:10.965+0000 7fb9b84b5640 1 -- 172.21.15.89:0/167416976 wait complete. 2024-09-13T22:00:11.494 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying node-exporter service with default placement... 2024-09-13T22:00:12.067 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:11 smithi089 ceph-mon[27921]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:12.067 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:11 smithi089 ceph-mon[27921]: Saving service grafana spec with placement count:1 2024-09-13T22:00:12.067 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:11 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:12.698 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T22:00:12.698 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.876+0000 7f3d44543640 1 Processor -- start 2024-09-13T22:00:12.698 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.877+0000 7f3d44543640 1 -- start start 2024-09-13T22:00:12.698 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.877+0000 7f3d44543640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c108520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:12.698 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.877+0000 7f3d44543640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c079dc0 con 0x7f3d3c106130 2024-09-13T22:00:12.698 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.877+0000 7f3d422df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c108520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:12.698 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.877+0000 7f3d422df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c108520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34516/0 (socket says 172.21.15.89:34516) 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.877+0000 7f3d422df640 1 -- 172.21.15.89:0/2459205872 learned_addr learned my addr 172.21.15.89:0/2459205872 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.878+0000 7f3d422df640 1 -- 172.21.15.89:0/2459205872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c079f00 con 0x7f3d3c106130 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.878+0000 7f3d422df640 1 --2- 172.21.15.89:0/2459205872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c108520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009820 tx=0x7f3d3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffc8d14fb34f6b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d412dd640 1 -- 172.21.15.89:0/2459205872 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d3802ad40 con 0x7f3d3c106130 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d412dd640 1 -- 172.21.15.89:0/2459205872 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d38032900 con 0x7f3d3c106130 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d412dd640 1 -- 172.21.15.89:0/2459205872 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d38030860 con 0x7f3d3c106130 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d44543640 1 -- 172.21.15.89:0/2459205872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 msgr2=0x7f3d3c108520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d44543640 1 --2- 172.21.15.89:0/2459205872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c108520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009820 tx=0x7f3d3802a270 comp rx=0 tx=0).stop 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d44543640 1 -- 172.21.15.89:0/2459205872 shutdown_connections 2024-09-13T22:00:12.699 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d44543640 1 --2- 172.21.15.89:0/2459205872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c108520 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d44543640 1 -- 172.21.15.89:0/2459205872 >> 172.21.15.89:0/2459205872 conn(0x7f3d3c0ffc50 msgr2=0x7f3d3c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d44543640 1 -- 172.21.15.89:0/2459205872 shutdown_connections 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.879+0000 7f3d44543640 1 -- 172.21.15.89:0/2459205872 wait complete. 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.880+0000 7f3d44543640 1 Processor -- start 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.880+0000 7f3d44543640 1 -- start start 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.880+0000 7f3d44543640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.880+0000 7f3d44543640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c199830 con 0x7f3d3c106130 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.880+0000 7f3d422df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.880+0000 7f3d422df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34518/0 (socket says 172.21.15.89:34518) 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.880+0000 7f3d422df640 1 -- 172.21.15.89:0/2077132926 learned_addr learned my addr 172.21.15.89:0/2077132926 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.881+0000 7f3d422df640 1 -- 172.21.15.89:0/2077132926 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d380094d0 con 0x7f3d3c106130 2024-09-13T22:00:12.700 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.881+0000 7f3d422df640 1 --2- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c1992f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d380097f0 tx=0x7f3d38030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.881+0000 7f3d337fe640 1 -- 172.21.15.89:0/2077132926 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d38040070 con 0x7f3d3c106130 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.881+0000 7f3d337fe640 1 -- 172.21.15.89:0/2077132926 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d38032dd0 con 0x7f3d3c106130 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.881+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3c199a30 con 0x7f3d3c106130 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.881+0000 7f3d337fe640 1 -- 172.21.15.89:0/2077132926 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d3803a790 con 0x7f3d3c106130 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.881+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3c199ed0 con 0x7f3d3c106130 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.882+0000 7f3d337fe640 1 -- 172.21.15.89:0/2077132926 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f3d3803a8f0 con 0x7f3d3c106130 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.882+0000 7f3d337fe640 1 --2- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f3d280386a0 0x7f3d2803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.882+0000 7f3d337fe640 1 -- 172.21.15.89:0/2077132926 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3d3803cc70 con 0x7f3d3c106130 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.882+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3c1097a0 con 0x7f3d3c106130 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.882+0000 7f3d41ade640 1 --2- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f3d280386a0 0x7f3d2803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.883+0000 7f3d41ade640 1 --2- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f3d280386a0 0x7f3d2803ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0098c0 tx=0x7f3d2c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:11.887+0000 7f3d337fe640 1 -- 172.21.15.89:0/2077132926 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3d38039b40 con 0x7f3d3c106130 2024-09-13T22:00:12.701 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.066+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d3c100f40 con 0x7f3d280386a0 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.071+0000 7f3d337fe640 1 -- 172.21.15.89:0/2077132926 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f3d3c100f40 con 0x7f3d280386a0 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f3d280386a0 msgr2=0x7f3d2803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 --2- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f3d280386a0 0x7f3d2803ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0098c0 tx=0x7f3d2c006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 msgr2=0x7f3d3c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 --2- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c1992f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d380097f0 tx=0x7f3d38030d50 comp rx=0 tx=0).stop 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 shutdown_connections 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 --2- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f3d280386a0 0x7f3d2803ab60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 --2- 172.21.15.89:0/2077132926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d3c106130 0x7f3d3c1992f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 >> 172.21.15.89:0/2077132926 conn(0x7f3d3c0ffc50 msgr2=0x7f3d3c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 shutdown_connections 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:12.073+0000 7f3d44543640 1 -- 172.21.15.89:0/2077132926 wait complete. 2024-09-13T22:00:12.702 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying alertmanager service with default placement... 2024-09-13T22:00:13.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:13 smithi089 ceph-mon[27921]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:13.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:13 smithi089 ceph-mon[27921]: Saving service node-exporter spec with placement * 2024-09-13T22:00:13.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:13 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:13.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:13 smithi089 ceph-mon[27921]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:13.855 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T22:00:13.860 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.075+0000 7f06af7f1640 1 Processor -- start 2024-09-13T22:00:13.860 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.075+0000 7f06af7f1640 1 -- start start 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.075+0000 7f06af7f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a81048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.075+0000 7f06af7f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8104eb0 con 0x7f06a81044e0 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.075+0000 7f06ad58d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a81048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.075+0000 7f06ad58d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a81048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34520/0 (socket says 172.21.15.89:34520) 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.075+0000 7f06ad58d640 1 -- 172.21.15.89:0/4103518145 learned_addr learned my addr 172.21.15.89:0/4103518145 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.076+0000 7f06ad58d640 1 -- 172.21.15.89:0/4103518145 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a81056e0 con 0x7f06a81044e0 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.076+0000 7f06ad58d640 1 --2- 172.21.15.89:0/4103518145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a81048e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009820 tx=0x7f06a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254b0c552f01b91f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.076+0000 7f069ffff640 1 -- 172.21.15.89:0/4103518145 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06a402ad40 con 0x7f06a81044e0 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.077+0000 7f069ffff640 1 -- 172.21.15.89:0/4103518145 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06a4032900 con 0x7f06a81044e0 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.077+0000 7f069ffff640 1 -- 172.21.15.89:0/4103518145 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06a4030860 con 0x7f06a81044e0 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.077+0000 7f06af7f1640 1 -- 172.21.15.89:0/4103518145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 msgr2=0x7f06a81048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.077+0000 7f06af7f1640 1 --2- 172.21.15.89:0/4103518145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a81048e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009820 tx=0x7f06a402a270 comp rx=0 tx=0).stop 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.077+0000 7f06af7f1640 1 -- 172.21.15.89:0/4103518145 shutdown_connections 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.077+0000 7f06af7f1640 1 --2- 172.21.15.89:0/4103518145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a81048e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.077+0000 7f06af7f1640 1 -- 172.21.15.89:0/4103518145 >> 172.21.15.89:0/4103518145 conn(0x7f06a80ffc50 msgr2=0x7f06a81020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.077+0000 7f06af7f1640 1 -- 172.21.15.89:0/4103518145 shutdown_connections 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.077+0000 7f06af7f1640 1 -- 172.21.15.89:0/4103518145 wait complete. 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.078+0000 7f06af7f1640 1 Processor -- start 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.078+0000 7f06af7f1640 1 -- start start 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.078+0000 7f06af7f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a8079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.078+0000 7f06af7f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a819c030 con 0x7f06a81044e0 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.078+0000 7f06ad58d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a8079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.078+0000 7f06ad58d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a8079a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34530/0 (socket says 172.21.15.89:34530) 2024-09-13T22:00:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.078+0000 7f06ad58d640 1 -- 172.21.15.89:0/554229985 learned_addr learned my addr 172.21.15.89:0/554229985 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.078+0000 7f06ad58d640 1 -- 172.21.15.89:0/554229985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a40094d0 con 0x7f06a81044e0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.079+0000 7f06ad58d640 1 --2- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a8079a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009940 tx=0x7f06a4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.079+0000 7f069e7fc640 1 -- 172.21.15.89:0/554229985 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06a4032c80 con 0x7f06a81044e0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.079+0000 7f069e7fc640 1 -- 172.21.15.89:0/554229985 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06a4032de0 con 0x7f06a81044e0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.079+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a819c170 con 0x7f06a81044e0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.079+0000 7f069e7fc640 1 -- 172.21.15.89:0/554229985 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06a403a720 con 0x7f06a81044e0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.079+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a819c550 con 0x7f06a81044e0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.080+0000 7f069e7fc640 1 -- 172.21.15.89:0/554229985 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f06a403cc30 con 0x7f06a81044e0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.080+0000 7f069e7fc640 1 --2- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f0694038650 0x7f069403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.080+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a8108910 con 0x7f06a81044e0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.080+0000 7f069e7fc640 1 -- 172.21.15.89:0/554229985 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f06a406b930 con 0x7f06a81044e0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.080+0000 7f06acd8c640 1 --2- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f0694038650 0x7f069403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.080+0000 7f06acd8c640 1 --2- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f0694038650 0x7f069403ab10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f06980098c0 tx=0x7f0698006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.084+0000 7f069e7fc640 1 -- 172.21.15.89:0/554229985 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f06a4031d70 con 0x7f06a81044e0 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.257+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f06a8100ec0 con 0x7f0694038650 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.262+0000 7f069e7fc640 1 -- 172.21.15.89:0/554229985 <== mgr.14116 v2:172.21.15.89:6800/1295505650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f06a8100ec0 con 0x7f0694038650 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f0694038650 msgr2=0x7f069403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 --2- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f0694038650 0x7f069403ab10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f06980098c0 tx=0x7f0698006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 msgr2=0x7f06a8079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 --2- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a8079a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009940 tx=0x7f06a4032670 comp rx=0 tx=0).stop 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 shutdown_connections 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 --2- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f0694038650 0x7f069403ab10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 --2- 172.21.15.89:0/554229985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06a81044e0 0x7f06a8079a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 >> 172.21.15.89:0/554229985 conn(0x7f06a80ffc50 msgr2=0x7f06a81007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 shutdown_connections 2024-09-13T22:00:13.865 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:13.264+0000 7f06af7f1640 1 -- 172.21.15.89:0/554229985 wait complete. 2024-09-13T22:00:14.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:14 smithi089 ceph-mon[27921]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:14.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:14 smithi089 ceph-mon[27921]: Saving service alertmanager spec with placement count:1 2024-09-13T22:00:14.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:14 smithi089 ceph-mon[27921]: from='mgr.14116 172.21.15.89:0/2091584458' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.244+0000 7fd369843640 1 Processor -- start 2024-09-13T22:00:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.244+0000 7fd369843640 1 -- start start 2024-09-13T22:00:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.244+0000 7fd369843640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd3641059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.244+0000 7fd369843640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364105fa0 con 0x7fd3641055d0 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.244+0000 7fd362ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd3641059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.244+0000 7fd362ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd3641059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36008/0 (socket says 172.21.15.89:36008) 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.244+0000 7fd362ffd640 1 -- 172.21.15.89:0/2848227870 learned_addr learned my addr 172.21.15.89:0/2848227870 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.244+0000 7fd362ffd640 1 -- 172.21.15.89:0/2848227870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3641067d0 con 0x7fd3641055d0 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.245+0000 7fd362ffd640 1 --2- 172.21.15.89:0/2848227870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd3641059d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd354009820 tx=0x7fd35402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f29b3a298fb1a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.245+0000 7fd3627fc640 1 -- 172.21.15.89:0/2848227870 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd35402ad40 con 0x7fd3641055d0 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.245+0000 7fd3627fc640 1 -- 172.21.15.89:0/2848227870 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd354032900 con 0x7fd3641055d0 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.245+0000 7fd3627fc640 1 -- 172.21.15.89:0/2848227870 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd354030860 con 0x7fd3641055d0 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.246+0000 7fd369843640 1 -- 172.21.15.89:0/2848227870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 msgr2=0x7fd3641059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.246+0000 7fd369843640 1 --2- 172.21.15.89:0/2848227870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd3641059d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd354009820 tx=0x7fd35402a270 comp rx=0 tx=0).stop 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.246+0000 7fd369843640 1 -- 172.21.15.89:0/2848227870 shutdown_connections 2024-09-13T22:00:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.246+0000 7fd369843640 1 --2- 172.21.15.89:0/2848227870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd3641059d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.246+0000 7fd369843640 1 -- 172.21.15.89:0/2848227870 >> 172.21.15.89:0/2848227870 conn(0x7fd364100d80 msgr2=0x7fd3641031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.246+0000 7fd369843640 1 -- 172.21.15.89:0/2848227870 shutdown_connections 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.246+0000 7fd369843640 1 -- 172.21.15.89:0/2848227870 wait complete. 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.246+0000 7fd369843640 1 Processor -- start 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.246+0000 7fd369843640 1 -- start start 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd369843640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd364199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd369843640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364199870 con 0x7fd3641055d0 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd362ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd364199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd362ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd364199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36022/0 (socket says 172.21.15.89:36022) 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd362ffd640 1 -- 172.21.15.89:0/229750597 learned_addr learned my addr 172.21.15.89:0/229750597 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd362ffd640 1 -- 172.21.15.89:0/229750597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540094d0 con 0x7fd3641055d0 2024-09-13T22:00:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd362ffd640 1 --2- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd364199330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3540097f0 tx=0x7fd354030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd368841640 1 -- 172.21.15.89:0/229750597 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd354040070 con 0x7fd3641055d0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd368841640 1 -- 172.21.15.89:0/229750597 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd354032dd0 con 0x7fd3641055d0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364199a70 con 0x7fd3641055d0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd368841640 1 -- 172.21.15.89:0/229750597 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd35403a730 con 0x7fd3641055d0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.247+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd364199f10 con 0x7fd3641055d0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.248+0000 7fd368841640 1 -- 172.21.15.89:0/229750597 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fd35403a890 con 0x7fd3641055d0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.248+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd364109a00 con 0x7fd3641055d0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.248+0000 7fd368841640 1 --2- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fd350038650 0x7fd35003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.249+0000 7fd368841640 1 -- 172.21.15.89:0/229750597 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd35406b7d0 con 0x7fd3641055d0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.249+0000 7fd35bfff640 1 --2- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fd350038650 0x7fd35003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.249+0000 7fd35bfff640 1 --2- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fd350038650 0x7fd35003ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0098c0 tx=0x7fd34c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.253+0000 7fd368841640 1 -- 172.21.15.89:0/229750597 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd354039b90 con 0x7fd3641055d0 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.416+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fd364109c40 con 0x7fd3641055d0 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.420+0000 7fd368841640 1 -- 172.21.15.89:0/229750597 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fd354039780 con 0x7fd3641055d0 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fd350038650 msgr2=0x7fd35003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 --2- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fd350038650 0x7fd35003ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0098c0 tx=0x7fd34c006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 msgr2=0x7fd364199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 --2- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd364199330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3540097f0 tx=0x7fd354030d50 comp rx=0 tx=0).stop 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 shutdown_connections 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 --2- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7fd350038650 0x7fd35003ab10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 --2- 172.21.15.89:0/229750597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3641055d0 0x7fd364199330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 >> 172.21.15.89:0/229750597 conn(0x7fd364100d80 msgr2=0x7fd364101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 shutdown_connections 2024-09-13T22:00:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:14.422+0000 7fd369843640 1 -- 172.21.15.89:0/229750597 wait complete. 2024-09-13T22:00:15.590 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:15 smithi089 ceph-mon[27921]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:15.591 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:15 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/229750597' entity='client.admin' 2024-09-13T22:00:16.241 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.414+0000 7f9b55f47640 1 Processor -- start 2024-09-13T22:00:16.241 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.414+0000 7f9b55f47640 1 -- start start 2024-09-13T22:00:16.241 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.414+0000 7f9b55f47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b501059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.414+0000 7f9b55f47640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b50105f90 con 0x7f9b501055c0 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.414+0000 7f9b4f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b501059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.414+0000 7f9b4f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b501059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36032/0 (socket says 172.21.15.89:36032) 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.414+0000 7f9b4f7fe640 1 -- 172.21.15.89:0/717571910 learned_addr learned my addr 172.21.15.89:0/717571910 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.415+0000 7f9b4f7fe640 1 -- 172.21.15.89:0/717571910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b501067c0 con 0x7f9b501055c0 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.415+0000 7f9b4f7fe640 1 --2- 172.21.15.89:0/717571910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b501059c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009820 tx=0x7f9b4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793758525c3383ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.415+0000 7f9b4effd640 1 -- 172.21.15.89:0/717571910 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b4002ad40 con 0x7f9b501055c0 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.415+0000 7f9b4effd640 1 -- 172.21.15.89:0/717571910 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b40032900 con 0x7f9b501055c0 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.416+0000 7f9b4effd640 1 -- 172.21.15.89:0/717571910 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b40030860 con 0x7f9b501055c0 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.416+0000 7f9b55f47640 1 -- 172.21.15.89:0/717571910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 msgr2=0x7f9b501059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.416+0000 7f9b55f47640 1 --2- 172.21.15.89:0/717571910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b501059c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009820 tx=0x7f9b4002a270 comp rx=0 tx=0).stop 2024-09-13T22:00:16.242 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.416+0000 7f9b55f47640 1 -- 172.21.15.89:0/717571910 shutdown_connections 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.416+0000 7f9b55f47640 1 --2- 172.21.15.89:0/717571910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b501059c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.416+0000 7f9b55f47640 1 -- 172.21.15.89:0/717571910 >> 172.21.15.89:0/717571910 conn(0x7f9b50100d30 msgr2=0x7f9b50103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.416+0000 7f9b55f47640 1 -- 172.21.15.89:0/717571910 shutdown_connections 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.416+0000 7f9b55f47640 1 -- 172.21.15.89:0/717571910 wait complete. 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b55f47640 1 Processor -- start 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b55f47640 1 -- start start 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b55f47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b50199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b55f47640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b50199870 con 0x7f9b501055c0 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b4f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b50199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b4f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b50199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36036/0 (socket says 172.21.15.89:36036) 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b4f7fe640 1 -- 172.21.15.89:0/2022922819 learned_addr learned my addr 172.21.15.89:0/2022922819 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:16.243 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b4f7fe640 1 -- 172.21.15.89:0/2022922819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b400094d0 con 0x7f9b501055c0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b4f7fe640 1 --2- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b50199330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b400097f0 tx=0x7f9b40030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.417+0000 7f9b4d7fa640 1 -- 172.21.15.89:0/2022922819 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b40040070 con 0x7f9b501055c0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.418+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b50199a70 con 0x7f9b501055c0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.418+0000 7f9b4d7fa640 1 -- 172.21.15.89:0/2022922819 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b40032dd0 con 0x7f9b501055c0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.418+0000 7f9b4d7fa640 1 -- 172.21.15.89:0/2022922819 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b4003a730 con 0x7f9b501055c0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.418+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b50199f10 con 0x7f9b501055c0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.419+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b501099f0 con 0x7f9b501055c0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.419+0000 7f9b4d7fa640 1 -- 172.21.15.89:0/2022922819 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f9b4003cc30 con 0x7f9b501055c0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.419+0000 7f9b4d7fa640 1 --2- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f9b3c038650 0x7f9b3c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.419+0000 7f9b47fff640 1 --2- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f9b3c038650 0x7f9b3c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.419+0000 7f9b47fff640 1 --2- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f9b3c038650 0x7f9b3c03ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b380098c0 tx=0x7f9b38006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:16.244 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.420+0000 7f9b4d7fa640 1 -- 172.21.15.89:0/2022922819 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9b40043b00 con 0x7f9b501055c0 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.425+0000 7f9b4d7fa640 1 -- 172.21.15.89:0/2022922819 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9b40043920 con 0x7f9b501055c0 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.589+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f9b50109c30 con 0x7f9b501055c0 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.593+0000 7f9b4d7fa640 1 -- 172.21.15.89:0/2022922819 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f9b40043920 con 0x7f9b501055c0 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.595+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f9b3c038650 msgr2=0x7f9b3c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.595+0000 7f9b55f47640 1 --2- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f9b3c038650 0x7f9b3c03ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b380098c0 tx=0x7f9b38006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.595+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 msgr2=0x7f9b50199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.595+0000 7f9b55f47640 1 --2- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b50199330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b400097f0 tx=0x7f9b40030d50 comp rx=0 tx=0).stop 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.596+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 shutdown_connections 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.596+0000 7f9b55f47640 1 --2- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f9b3c038650 0x7f9b3c03ab10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.596+0000 7f9b55f47640 1 --2- 172.21.15.89:0/2022922819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b501055c0 0x7f9b50199330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.596+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 >> 172.21.15.89:0/2022922819 conn(0x7f9b50100d30 msgr2=0x7f9b501018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:16.245 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.596+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 shutdown_connections 2024-09-13T22:00:16.246 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:15.596+0000 7f9b55f47640 1 -- 172.21.15.89:0/2022922819 wait complete. 2024-09-13T22:00:16.246 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling the dashboard module... 2024-09-13T22:00:16.880 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:16 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2022922819' entity='client.admin' 2024-09-13T22:00:16.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:16 smithi089 ceph-mon[27921]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:17.905 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:17 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1146547898' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T22:00:18.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.664+0000 7facc689a640 1 Processor -- start 2024-09-13T22:00:18.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.664+0000 7facc689a640 1 -- start start 2024-09-13T22:00:18.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.664+0000 7facc689a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc01059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:18.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.664+0000 7facc689a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc0105f90 con 0x7facc01055c0 2024-09-13T22:00:18.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.664+0000 7facbffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc01059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:18.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.664+0000 7facbffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc01059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36038/0 (socket says 172.21.15.89:36038) 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.664+0000 7facbffff640 1 -- 172.21.15.89:0/4170823024 learned_addr learned my addr 172.21.15.89:0/4170823024 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.665+0000 7facbffff640 1 -- 172.21.15.89:0/4170823024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc01067c0 con 0x7facc01055c0 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.665+0000 7facbffff640 1 --2- 172.21.15.89:0/4170823024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc01059c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7facb0009820 tx=0x7facb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a5a62fafeda74b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.665+0000 7facbeffd640 1 -- 172.21.15.89:0/4170823024 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facb002ad40 con 0x7facc01055c0 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.666+0000 7facbeffd640 1 -- 172.21.15.89:0/4170823024 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facb0032900 con 0x7facc01055c0 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.666+0000 7facbeffd640 1 -- 172.21.15.89:0/4170823024 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facb0030860 con 0x7facc01055c0 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.666+0000 7facc689a640 1 -- 172.21.15.89:0/4170823024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 msgr2=0x7facc01059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.666+0000 7facc689a640 1 --2- 172.21.15.89:0/4170823024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc01059c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7facb0009820 tx=0x7facb002a270 comp rx=0 tx=0).stop 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.666+0000 7facc689a640 1 -- 172.21.15.89:0/4170823024 shutdown_connections 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.666+0000 7facc689a640 1 --2- 172.21.15.89:0/4170823024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc01059c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.666+0000 7facc689a640 1 -- 172.21.15.89:0/4170823024 >> 172.21.15.89:0/4170823024 conn(0x7facc0100d30 msgr2=0x7facc0103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:18.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.666+0000 7facc689a640 1 -- 172.21.15.89:0/4170823024 shutdown_connections 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.666+0000 7facc689a640 1 -- 172.21.15.89:0/4170823024 wait complete. 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.667+0000 7facc689a640 1 Processor -- start 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.667+0000 7facc689a640 1 -- start start 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.667+0000 7facc689a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc007bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.667+0000 7facc689a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc007c0a0 con 0x7facc01055c0 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.667+0000 7facbffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc007bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.667+0000 7facbffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc007bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36042/0 (socket says 172.21.15.89:36042) 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.667+0000 7facbffff640 1 -- 172.21.15.89:0/1146547898 learned_addr learned my addr 172.21.15.89:0/1146547898 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.667+0000 7facbffff640 1 -- 172.21.15.89:0/1146547898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00094d0 con 0x7facc01055c0 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.667+0000 7facbffff640 1 --2- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc007bb60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facb0009940 tx=0x7facb0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.668+0000 7facbd7fa640 1 -- 172.21.15.89:0/1146547898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facb0032c80 con 0x7facc01055c0 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.668+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc007a290 con 0x7facc01055c0 2024-09-13T22:00:18.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.668+0000 7facbd7fa640 1 -- 172.21.15.89:0/1146547898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facb0032de0 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.668+0000 7facbd7fa640 1 -- 172.21.15.89:0/1146547898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facb003a720 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.668+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc007a730 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.668+0000 7facbd7fa640 1 -- 172.21.15.89:0/1146547898 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7facb003a950 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.669+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc01059c0 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.669+0000 7facbd7fa640 1 --2- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7faca8038650 0x7faca803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.669+0000 7facbd7fa640 1 -- 172.21.15.89:0/1146547898 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7facb006b8f0 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.669+0000 7facbf7fe640 1 --2- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7faca8038650 0x7faca803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.669+0000 7facbf7fe640 1 --2- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7faca8038650 0x7faca803ab10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7facb40098c0 tx=0x7facb4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.673+0000 7facbd7fa640 1 -- 172.21.15.89:0/1146547898 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7facb0039b00 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:16.879+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7facc0109bc0 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.600+0000 7facbd7fa640 1 -- 172.21.15.89:0/1146547898 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7facb003cc30 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.602+0000 7facbd7fa640 1 -- 172.21.15.89:0/1146547898 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7facb0042270 con 0x7facc01055c0 2024-09-13T22:00:18.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7faca8038650 msgr2=0x7faca803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 --2- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7faca8038650 0x7faca803ab10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7facb40098c0 tx=0x7facb4006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 msgr2=0x7facc007bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 --2- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc007bb60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facb0009940 tx=0x7facb0032670 comp rx=0 tx=0).stop 2024-09-13T22:00:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 shutdown_connections 2024-09-13T22:00:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 --2- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7faca8038650 0x7faca803ab10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 --2- 172.21.15.89:0/1146547898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facc01055c0 0x7facc007bb60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 >> 172.21.15.89:0/1146547898 conn(0x7facc0100d30 msgr2=0x7facc01018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 shutdown_connections 2024-09-13T22:00:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:17.605+0000 7facc689a640 1 -- 172.21.15.89:0/1146547898 wait complete. 2024-09-13T22:00:18.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:18 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1146547898' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T22:00:18.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:18 smithi089 ceph-mon[27921]: mgrmap e9: smithi089.naneiw(active, since 25s) 2024-09-13T22:00:19.483 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:00:19.484 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T22:00:19.484 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:00:19.484 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "active_name": "smithi089.naneiw", 2024-09-13T22:00:19.484 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T22:00:19.484 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:00:19.484 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.684+0000 7f51771e4640 1 Processor -- start 2024-09-13T22:00:19.485 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.684+0000 7f51771e4640 1 -- start start 2024-09-13T22:00:19.485 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.684+0000 7f51771e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f51701059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:19.485 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.684+0000 7f51771e4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5170105f90 con 0x7f51701055c0 2024-09-13T22:00:19.485 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.684+0000 7f5174f80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f51701059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:19.485 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.684+0000 7f5174f80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f51701059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36076/0 (socket says 172.21.15.89:36076) 2024-09-13T22:00:19.485 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.684+0000 7f5174f80640 1 -- 172.21.15.89:0/2134697058 learned_addr learned my addr 172.21.15.89:0/2134697058 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:19.485 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.684+0000 7f5174f80640 1 -- 172.21.15.89:0/2134697058 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51701067c0 con 0x7f51701055c0 2024-09-13T22:00:19.485 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.685+0000 7f5174f80640 1 --2- 172.21.15.89:0/2134697058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f51701059c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5164009820 tx=0x7f516402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7415451e73361b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:19.486 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.685+0000 7f516f7fe640 1 -- 172.21.15.89:0/2134697058 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f516402ad40 con 0x7f51701055c0 2024-09-13T22:00:19.486 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.685+0000 7f516f7fe640 1 -- 172.21.15.89:0/2134697058 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5164032900 con 0x7f51701055c0 2024-09-13T22:00:19.486 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.685+0000 7f516f7fe640 1 -- 172.21.15.89:0/2134697058 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5164030860 con 0x7f51701055c0 2024-09-13T22:00:19.486 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.686+0000 7f51771e4640 1 -- 172.21.15.89:0/2134697058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 msgr2=0x7f51701059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:19.486 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.686+0000 7f51771e4640 1 --2- 172.21.15.89:0/2134697058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f51701059c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5164009820 tx=0x7f516402a270 comp rx=0 tx=0).stop 2024-09-13T22:00:19.486 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.686+0000 7f51771e4640 1 -- 172.21.15.89:0/2134697058 shutdown_connections 2024-09-13T22:00:19.486 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.686+0000 7f51771e4640 1 --2- 172.21.15.89:0/2134697058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f51701059c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:19.486 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.686+0000 7f51771e4640 1 -- 172.21.15.89:0/2134697058 >> 172.21.15.89:0/2134697058 conn(0x7f5170100d30 msgr2=0x7f5170103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.686+0000 7f51771e4640 1 -- 172.21.15.89:0/2134697058 shutdown_connections 2024-09-13T22:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.686+0000 7f51771e4640 1 -- 172.21.15.89:0/2134697058 wait complete. 2024-09-13T22:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f51771e4640 1 Processor -- start 2024-09-13T22:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f51771e4640 1 -- start start 2024-09-13T22:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f51771e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f5170199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f51771e4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5170199860 con 0x7f51701055c0 2024-09-13T22:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f5174f80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f5170199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f5174f80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f5170199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36088/0 (socket says 172.21.15.89:36088) 2024-09-13T22:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f5174f80640 1 -- 172.21.15.89:0/1230882882 learned_addr learned my addr 172.21.15.89:0/1230882882 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f5174f80640 1 -- 172.21.15.89:0/1230882882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51640094d0 con 0x7f51701055c0 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f5174f80640 1 --2- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f5170199320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51640097f0 tx=0x7f5164030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f516dffb640 1 -- 172.21.15.89:0/1230882882 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5164040070 con 0x7f51701055c0 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5170199a60 con 0x7f51701055c0 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f516dffb640 1 -- 172.21.15.89:0/1230882882 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5164032dd0 con 0x7f51701055c0 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.687+0000 7f516dffb640 1 -- 172.21.15.89:0/1230882882 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f516403a730 con 0x7f51701055c0 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.688+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5170199f00 con 0x7f51701055c0 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.688+0000 7f516dffb640 1 -- 172.21.15.89:0/1230882882 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f516403a890 con 0x7f51701055c0 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.689+0000 7f516dffb640 1 --2- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f51600386a0 0x7f516003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.689+0000 7f516dffb640 1 -- 172.21.15.89:0/1230882882 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f516406c740 con 0x7f51701055c0 2024-09-13T22:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.689+0000 7f516ffff640 1 -- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f51600386a0 msgr2=0x7f516003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1295505650 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.689+0000 7f516ffff640 1 --2- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f51600386a0 0x7f516003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.689+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51701059c0 con 0x7f51701055c0 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.693+0000 7f516dffb640 1 -- 172.21.15.89:0/1230882882 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5164039b90 con 0x7f51701055c0 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.890+0000 7f516ffff640 1 -- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f51600386a0 msgr2=0x7f516003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1295505650 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.890+0000 7f516ffff640 1 --2- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f51600386a0 0x7f516003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.902+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f51701099f0 con 0x7f51701055c0 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.903+0000 7f516dffb640 1 -- 172.21.15.89:0/1230882882 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f5164039780 con 0x7f51701055c0 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f51600386a0 msgr2=0x7f516003ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 --2- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f51600386a0 0x7f516003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 msgr2=0x7f5170199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 --2- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f5170199320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51640097f0 tx=0x7f5164030d50 comp rx=0 tx=0).stop 2024-09-13T22:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 shutdown_connections 2024-09-13T22:00:19.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 --2- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f51600386a0 0x7f516003ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:19.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 --2- 172.21.15.89:0/1230882882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51701055c0 0x7f5170199320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:19.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 >> 172.21.15.89:0/1230882882 conn(0x7f5170100d30 msgr2=0x7f51701018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:19.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 shutdown_connections 2024-09-13T22:00:19.490 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:18.905+0000 7f51771e4640 1 -- 172.21.15.89:0/1230882882 wait complete. 2024-09-13T22:00:19.490 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for the mgr to restart... 2024-09-13T22:00:19.490 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr epoch 9... 2024-09-13T22:00:19.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:19 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1230882882' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T22:00:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: Active manager daemon smithi089.naneiw restarted 2024-09-13T22:00:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: Activating manager daemon smithi089.naneiw 2024-09-13T22:00:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: mgrmap e10: smithi089.naneiw(active, starting, since 0.00319862s) 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: Manager daemon smithi089.naneiw is now available 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:00:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:22 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/trash_purge_schedule"}]: dispatch 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.875+0000 7f8a42faa640 1 Processor -- start 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.875+0000 7f8a42faa640 1 -- start start 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.875+0000 7f8a42faa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.875+0000 7f8a42faa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c079ea0 con 0x7f8a3c106050 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.875+0000 7f8a40d46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:24.043 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.875+0000 7f8a40d46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36090/0 (socket says 172.21.15.89:36090) 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.875+0000 7f8a40d46640 1 -- 172.21.15.89:0/4239028673 learned_addr learned my addr 172.21.15.89:0/4239028673 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.876+0000 7f8a40d46640 1 -- 172.21.15.89:0/4239028673 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c108980 con 0x7f8a3c106050 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.876+0000 7f8a40d46640 1 --2- 172.21.15.89:0/4239028673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c108440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009820 tx=0x7f8a3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c88a1c04a44b27a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a3b7fe640 1 -- 172.21.15.89:0/4239028673 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a3002ad40 con 0x7f8a3c106050 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a3b7fe640 1 -- 172.21.15.89:0/4239028673 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a30032900 con 0x7f8a3c106050 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a3b7fe640 1 -- 172.21.15.89:0/4239028673 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a30030860 con 0x7f8a3c106050 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a42faa640 1 -- 172.21.15.89:0/4239028673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 msgr2=0x7f8a3c108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a42faa640 1 --2- 172.21.15.89:0/4239028673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c108440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009820 tx=0x7f8a3002a270 comp rx=0 tx=0).stop 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a42faa640 1 -- 172.21.15.89:0/4239028673 shutdown_connections 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a42faa640 1 --2- 172.21.15.89:0/4239028673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c108440 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a42faa640 1 -- 172.21.15.89:0/4239028673 >> 172.21.15.89:0/4239028673 conn(0x7f8a3c0ffc50 msgr2=0x7f8a3c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a42faa640 1 -- 172.21.15.89:0/4239028673 shutdown_connections 2024-09-13T22:00:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.877+0000 7f8a42faa640 1 -- 172.21.15.89:0/4239028673 wait complete. 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.878+0000 7f8a42faa640 1 Processor -- start 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.878+0000 7f8a42faa640 1 -- start start 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.878+0000 7f8a42faa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.878+0000 7f8a42faa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c199830 con 0x7f8a3c106050 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.878+0000 7f8a40d46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.878+0000 7f8a40d46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36102/0 (socket says 172.21.15.89:36102) 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.878+0000 7f8a40d46640 1 -- 172.21.15.89:0/405628055 learned_addr learned my addr 172.21.15.89:0/405628055 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.878+0000 7f8a40d46640 1 -- 172.21.15.89:0/405628055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300094d0 con 0x7f8a3c106050 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.879+0000 7f8a40d46640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c1992f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a30032670 tx=0x7f8a300326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.879+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a30032c80 con 0x7f8a3c106050 2024-09-13T22:00:24.045 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.879+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a30032de0 con 0x7f8a3c106050 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.879+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a3003a720 con 0x7f8a3c106050 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.879+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c199a30 con 0x7f8a3c106050 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.879+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c199ed0 con 0x7f8a3c106050 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.880+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f8a3003cc30 con 0x7f8a3c106050 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.880+0000 7f8a39ffb640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 0x7f8a2c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.880+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 --> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a3c109790 con 0x7f8a2c0386a0 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.880+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8a3006b9e0 con 0x7f8a3c106050 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.880+0000 7f8a3bfff640 1 -- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 msgr2=0x7f8a2c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1295505650 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:19.880+0000 7f8a3bfff640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 0x7f8a2c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:20.081+0000 7f8a3bfff640 1 -- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 msgr2=0x7f8a2c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1295505650 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:20.081+0000 7f8a3bfff640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 0x7f8a2c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:20.482+0000 7f8a3bfff640 1 -- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 msgr2=0x7f8a2c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1295505650 2024-09-13T22:00:24.046 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:20.482+0000 7f8a3bfff640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 0x7f8a2c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:21.283+0000 7f8a3bfff640 1 -- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 msgr2=0x7f8a2c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/1295505650 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:21.283+0000 7f8a3bfff640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 0x7f8a2c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:22.358+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mgrmap(e 10) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f8a3006a810 con 0x7f8a3c106050 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:22.358+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 msgr2=0x7f8a2c03ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:22.358+0000 7f8a39ffb640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 0x7f8a2c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.359+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f8a30046ce0 con 0x7f8a3c106050 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.359+0000 7f8a39ffb640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8a2c03bfb0 0x7f8a2c03e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.359+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 --> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a3c109790 con 0x7f8a2c03bfb0 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.359+0000 7f8a3bfff640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8a2c03bfb0 0x7f8a2c03e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.360+0000 7f8a3bfff640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8a2c03bfb0 0x7f8a2c03e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8a28003980 tx=0x7f8a28006e10 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.360+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 <== mgr.14160 v2:172.21.15.89:6800/2476248652 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f8a3c109790 con 0x7f8a2c03bfb0 2024-09-13T22:00:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 --> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8a3c109900 con 0x7f8a2c03bfb0 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a39ffb640 1 -- 172.21.15.89:0/405628055 <== mgr.14160 v2:172.21.15.89:6800/2476248652 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f8a3c109900 con 0x7f8a2c03bfb0 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8a2c03bfb0 msgr2=0x7f8a2c03e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8a2c03bfb0 0x7f8a2c03e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8a28003980 tx=0x7f8a28006e10 comp rx=0 tx=0).stop 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 msgr2=0x7f8a3c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c1992f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a30032670 tx=0x7f8a300326a0 comp rx=0 tx=0).stop 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 shutdown_connections 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8a2c03bfb0 0x7f8a2c03e3a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:6800/1295505650,v1:172.21.15.89:6801/1295505650] conn(0x7f8a2c0386a0 0x7f8a2c03ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 --2- 172.21.15.89:0/405628055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c106050 0x7f8a3c1992f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.366+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 >> 172.21.15.89:0/405628055 conn(0x7f8a3c0ffc50 msgr2=0x7f8a3c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.367+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 shutdown_connections 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:23.367+0000 7f8a42faa640 1 -- 172.21.15.89:0/405628055 wait complete. 2024-09-13T22:00:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:mgr epoch 9 is available 2024-09-13T22:00:24.049 INFO:teuthology.orchestra.run.smithi089.stdout:Generating a dashboard self-signed certificate... 2024-09-13T22:00:24.655 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:24 smithi089 ceph-mon[27921]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T22:00:24.655 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:24 smithi089 ceph-mon[27921]: mgrmap e11: smithi089.naneiw(active, since 1.00554s) 2024-09-13T22:00:24.655 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:24 smithi089 ceph-mon[27921]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T22:00:24.655 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:24 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:25.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T22:00:25.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.469+0000 7fc934a31640 1 Processor -- start 2024-09-13T22:00:25.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.469+0000 7fc934a31640 1 -- start start 2024-09-13T22:00:25.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.470+0000 7fc934a31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:25.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.470+0000 7fc934a31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc930079e20 con 0x7fc9301060d0 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.470+0000 7fc92e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.470+0000 7fc92e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33530/0 (socket says 172.21.15.89:33530) 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.470+0000 7fc92e59c640 1 -- 172.21.15.89:0/4040727937 learned_addr learned my addr 172.21.15.89:0/4040727937 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.470+0000 7fc92e59c640 1 -- 172.21.15.89:0/4040727937 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc930108a00 con 0x7fc9301060d0 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.471+0000 7fc92e59c640 1 --2- 172.21.15.89:0/4040727937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301084c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc920009820 tx=0x7fc92002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef3ef97e61ebd66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.471+0000 7fc92d59a640 1 -- 172.21.15.89:0/4040727937 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc92002ad40 con 0x7fc9301060d0 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.471+0000 7fc92d59a640 1 -- 172.21.15.89:0/4040727937 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc920032900 con 0x7fc9301060d0 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.471+0000 7fc92d59a640 1 -- 172.21.15.89:0/4040727937 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc920030860 con 0x7fc9301060d0 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.472+0000 7fc934a31640 1 -- 172.21.15.89:0/4040727937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 msgr2=0x7fc9301084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.472+0000 7fc934a31640 1 --2- 172.21.15.89:0/4040727937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301084c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc920009820 tx=0x7fc92002a270 comp rx=0 tx=0).stop 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.472+0000 7fc934a31640 1 -- 172.21.15.89:0/4040727937 shutdown_connections 2024-09-13T22:00:25.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.472+0000 7fc934a31640 1 --2- 172.21.15.89:0/4040727937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301084c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.472+0000 7fc934a31640 1 -- 172.21.15.89:0/4040727937 >> 172.21.15.89:0/4040727937 conn(0x7fc9300ffc50 msgr2=0x7fc9301020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.472+0000 7fc934a31640 1 -- 172.21.15.89:0/4040727937 shutdown_connections 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.472+0000 7fc934a31640 1 -- 172.21.15.89:0/4040727937 wait complete. 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.472+0000 7fc934a31640 1 Processor -- start 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc934a31640 1 -- start start 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc934a31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc934a31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc930199830 con 0x7fc9301060d0 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc92e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc92e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33536/0 (socket says 172.21.15.89:33536) 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc92e59c640 1 -- 172.21.15.89:0/393641703 learned_addr learned my addr 172.21.15.89:0/393641703 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc92e59c640 1 -- 172.21.15.89:0/393641703 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200094d0 con 0x7fc9301060d0 2024-09-13T22:00:25.265 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc92e59c640 1 --2- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301992f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc920032670 tx=0x7fc9200326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc9277fe640 1 -- 172.21.15.89:0/393641703 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc920032c80 con 0x7fc9301060d0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc9277fe640 1 -- 172.21.15.89:0/393641703 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc920032de0 con 0x7fc9301060d0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc930199a30 con 0x7fc9301060d0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc9277fe640 1 -- 172.21.15.89:0/393641703 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc92003a720 con 0x7fc9301060d0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.473+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc930199ed0 con 0x7fc9301060d0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.474+0000 7fc9277fe640 1 -- 172.21.15.89:0/393641703 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7fc92003c400 con 0x7fc9301060d0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.474+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9301097b0 con 0x7fc9301060d0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.474+0000 7fc9277fe640 1 --2- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc91c038580 0x7fc91c03aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.475+0000 7fc9277fe640 1 -- 172.21.15.89:0/393641703 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc92006b8f0 con 0x7fc9301060d0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.475+0000 7fc92dd9b640 1 --2- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc91c038580 0x7fc91c03aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.475+0000 7fc92dd9b640 1 --2- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc91c038580 0x7fc91c03aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc9180098c0 tx=0x7fc918006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.479+0000 7fc9277fe640 1 -- 172.21.15.89:0/393641703 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc920043310 con 0x7fc9301060d0 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.653+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 --> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc930100f40 con 0x7fc91c038580 2024-09-13T22:00:25.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.695+0000 7fc9277fe640 1 -- 172.21.15.89:0/393641703 <== mgr.14160 v2:172.21.15.89:6800/2476248652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc930100f40 con 0x7fc91c038580 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc91c038580 msgr2=0x7fc91c03aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 --2- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc91c038580 0x7fc91c03aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc9180098c0 tx=0x7fc918006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 msgr2=0x7fc9301992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 --2- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301992f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc920032670 tx=0x7fc9200326a0 comp rx=0 tx=0).stop 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 shutdown_connections 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 --2- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc91c038580 0x7fc91c03aa40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 --2- 172.21.15.89:0/393641703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9301060d0 0x7fc9301992f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 >> 172.21.15.89:0/393641703 conn(0x7fc9300ffc50 msgr2=0x7fc930100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 shutdown_connections 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:24.697+0000 7fc934a31640 1 -- 172.21.15.89:0/393641703 wait complete. 2024-09-13T22:00:25.267 INFO:teuthology.orchestra.run.smithi089.stdout:Creating initial admin user... 2024-09-13T22:00:25.495 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: [13/Sep/2024:22:00:23] ENGINE Bus STARTING 2024-09-13T22:00:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: [13/Sep/2024:22:00:24] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T22:00:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: [13/Sep/2024:22:00:24] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T22:00:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: [13/Sep/2024:22:00:24] ENGINE Bus STARTED 2024-09-13T22:00:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: [13/Sep/2024:22:00:24] ENGINE Error in HTTPServer.serve 2024-09-13T22:00:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T22:00:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:00:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:00:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:00:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T22:00:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:00:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:25 smithi089 ceph-mon[27921]: mgrmap e12: smithi089.naneiw(active, since 2s) 2024-09-13T22:00:27.210 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:27 smithi089 ceph-mon[27921]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:27.210 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:27 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:27.218 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Q0PLimucbq3RBxDMsOwo4.DHJmRUli3MnUMgxngEoj8e.ppZ0U.Ju", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726264826, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T22:00:27.218 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.679+0000 7fd7cb6d1640 1 Processor -- start 2024-09-13T22:00:27.218 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.679+0000 7fd7cb6d1640 1 -- start start 2024-09-13T22:00:27.218 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.679+0000 7fd7cb6d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c4108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:27.218 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.679+0000 7fd7cb6d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4079e40 con 0x7fd7c4106090 2024-09-13T22:00:27.218 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.679+0000 7fd7c946d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c4108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.679+0000 7fd7c946d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c4108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33548/0 (socket says 172.21.15.89:33548) 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.679+0000 7fd7c946d640 1 -- 172.21.15.89:0/1259464613 learned_addr learned my addr 172.21.15.89:0/1259464613 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.679+0000 7fd7c946d640 1 -- 172.21.15.89:0/1259464613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c41089c0 con 0x7fd7c4106090 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.680+0000 7fd7c946d640 1 --2- 172.21.15.89:0/1259464613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c4108480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009820 tx=0x7fd7c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0210ad33219cb6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.680+0000 7fd7bbfff640 1 -- 172.21.15.89:0/1259464613 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7c002ad40 con 0x7fd7c4106090 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.680+0000 7fd7bbfff640 1 -- 172.21.15.89:0/1259464613 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7c0032900 con 0x7fd7c4106090 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.680+0000 7fd7bbfff640 1 -- 172.21.15.89:0/1259464613 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7c0030860 con 0x7fd7c4106090 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.681+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/1259464613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 msgr2=0x7fd7c4108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.681+0000 7fd7cb6d1640 1 --2- 172.21.15.89:0/1259464613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c4108480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009820 tx=0x7fd7c002a270 comp rx=0 tx=0).stop 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.681+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/1259464613 shutdown_connections 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.681+0000 7fd7cb6d1640 1 --2- 172.21.15.89:0/1259464613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c4108480 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:27.219 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.681+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/1259464613 >> 172.21.15.89:0/1259464613 conn(0x7fd7c40ffc30 msgr2=0x7fd7c4102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.681+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/1259464613 shutdown_connections 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.681+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/1259464613 wait complete. 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.681+0000 7fd7cb6d1640 1 Processor -- start 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.681+0000 7fd7cb6d1640 1 -- start start 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7cb6d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c41992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7cb6d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4199820 con 0x7fd7c4106090 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7c946d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c41992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7c946d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c41992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33558/0 (socket says 172.21.15.89:33558) 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7c946d640 1 -- 172.21.15.89:0/355356801 learned_addr learned my addr 172.21.15.89:0/355356801 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7c946d640 1 -- 172.21.15.89:0/355356801 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c00094d0 con 0x7fd7c4106090 2024-09-13T22:00:27.220 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7c946d640 1 --2- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c41992e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00097f0 tx=0x7fd7c0030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7ba7fc640 1 -- 172.21.15.89:0/355356801 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7c0040070 con 0x7fd7c4106090 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7ba7fc640 1 -- 172.21.15.89:0/355356801 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7c0032dd0 con 0x7fd7c4106090 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7ba7fc640 1 -- 172.21.15.89:0/355356801 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7c003a790 con 0x7fd7c4106090 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c4199a20 con 0x7fd7c4106090 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.682+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c4199ec0 con 0x7fd7c4106090 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.683+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c4109770 con 0x7fd7c4106090 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.683+0000 7fd7ba7fc640 1 -- 172.21.15.89:0/355356801 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fd7c003a8f0 con 0x7fd7c4106090 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.684+0000 7fd7ba7fc640 1 --2- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd7b00386f0 0x7fd7b003abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.684+0000 7fd7ba7fc640 1 -- 172.21.15.89:0/355356801 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd7c006b930 con 0x7fd7c4106090 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.684+0000 7fd7c8c6c640 1 --2- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd7b00386f0 0x7fd7b003abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:27.221 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.684+0000 7fd7c8c6c640 1 --2- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd7b00386f0 0x7fd7b003abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40098c0 tx=0x7fd7b4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.689+0000 7fd7ba7fc640 1 -- 172.21.15.89:0/355356801 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd7c00396d0 con 0x7fd7c4106090 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:25.867+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 --> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd7c41099b0 con 0x7fd7b00386f0 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.093+0000 7fd7ba7fc640 1 -- 172.21.15.89:0/355356801 <== mgr.14160 v2:172.21.15.89:6800/2476248652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fd7c41099b0 con 0x7fd7b00386f0 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd7b00386f0 msgr2=0x7fd7b003abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 --2- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd7b00386f0 0x7fd7b003abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40098c0 tx=0x7fd7b4006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 msgr2=0x7fd7c41992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 --2- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c41992e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00097f0 tx=0x7fd7c0030d50 comp rx=0 tx=0).stop 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 shutdown_connections 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 --2- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd7b00386f0 0x7fd7b003abb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 --2- 172.21.15.89:0/355356801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c4106090 0x7fd7c41992e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 >> 172.21.15.89:0/355356801 conn(0x7fd7c40ffc30 msgr2=0x7fd7c41007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 shutdown_connections 2024-09-13T22:00:27.222 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:26.095+0000 7fd7cb6d1640 1 -- 172.21.15.89:0/355356801 wait complete. 2024-09-13T22:00:27.223 INFO:teuthology.orchestra.run.smithi089.stdout:Fetching dashboard port number... 2024-09-13T22:00:28.300 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.608+0000 7f285f896640 1 Processor -- start 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.608+0000 7f285f896640 1 -- start start 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.608+0000 7f285f896640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f2858108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.608+0000 7f285f896640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858079ea0 con 0x7f2858106050 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.608+0000 7f285d632640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f2858108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.608+0000 7f285d632640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f2858108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33562/0 (socket says 172.21.15.89:33562) 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.608+0000 7f285d632640 1 -- 172.21.15.89:0/2423972335 learned_addr learned my addr 172.21.15.89:0/2423972335 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.608+0000 7f285d632640 1 -- 172.21.15.89:0/2423972335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858108980 con 0x7f2858106050 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.609+0000 7f285d632640 1 --2- 172.21.15.89:0/2423972335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f2858108440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2854009820 tx=0x7f285402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd4b44dabc38f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.609+0000 7f284ffff640 1 -- 172.21.15.89:0/2423972335 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f285402ad40 con 0x7f2858106050 2024-09-13T22:00:28.301 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.609+0000 7f284ffff640 1 -- 172.21.15.89:0/2423972335 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2854032900 con 0x7f2858106050 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.609+0000 7f284ffff640 1 -- 172.21.15.89:0/2423972335 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2854030860 con 0x7f2858106050 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.610+0000 7f285f896640 1 -- 172.21.15.89:0/2423972335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 msgr2=0x7f2858108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.610+0000 7f285f896640 1 --2- 172.21.15.89:0/2423972335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f2858108440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2854009820 tx=0x7f285402a270 comp rx=0 tx=0).stop 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.610+0000 7f285f896640 1 -- 172.21.15.89:0/2423972335 shutdown_connections 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.610+0000 7f285f896640 1 --2- 172.21.15.89:0/2423972335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f2858108440 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.610+0000 7f285f896640 1 -- 172.21.15.89:0/2423972335 >> 172.21.15.89:0/2423972335 conn(0x7f28580ffc50 msgr2=0x7f28581020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.610+0000 7f285f896640 1 -- 172.21.15.89:0/2423972335 shutdown_connections 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.610+0000 7f285f896640 1 -- 172.21.15.89:0/2423972335 wait complete. 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.610+0000 7f285f896640 1 Processor -- start 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285f896640 1 -- start start 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285f896640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f28581992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285f896640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858199830 con 0x7f2858106050 2024-09-13T22:00:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285d632640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f28581992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285d632640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f28581992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33570/0 (socket says 172.21.15.89:33570) 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285d632640 1 -- 172.21.15.89:0/2196304249 learned_addr learned my addr 172.21.15.89:0/2196304249 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285d632640 1 -- 172.21.15.89:0/2196304249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540094d0 con 0x7f2858106050 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285d632640 1 --2- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f28581992f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f28540097f0 tx=0x7f2854030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f284e7fc640 1 -- 172.21.15.89:0/2196304249 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2854040070 con 0x7f2858106050 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f284e7fc640 1 -- 172.21.15.89:0/2196304249 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2854032dd0 con 0x7f2858106050 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2858199a30 con 0x7f2858106050 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f284e7fc640 1 -- 172.21.15.89:0/2196304249 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f285403a790 con 0x7f2858106050 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.611+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2858199ed0 con 0x7f2858106050 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.612+0000 7f284e7fc640 1 -- 172.21.15.89:0/2196304249 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f285403c400 con 0x7f2858106050 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.612+0000 7f284e7fc640 1 --2- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f28440386a0 0x7f284403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.612+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2858109790 con 0x7f2858106050 2024-09-13T22:00:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.612+0000 7f284e7fc640 1 -- 172.21.15.89:0/2196304249 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f285406b820 con 0x7f2858106050 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.612+0000 7f285ce31640 1 --2- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f28440386a0 0x7f284403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.613+0000 7f285ce31640 1 --2- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f28440386a0 0x7f284403ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28480098c0 tx=0x7f2848006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.617+0000 7f284e7fc640 1 -- 172.21.15.89:0/2196304249 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f285403a8f0 con 0x7f2858106050 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.783+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f28581099d0 con 0x7f2858106050 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.783+0000 7f284e7fc640 1 -- 172.21.15.89:0/2196304249 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f28540690b0 con 0x7f2858106050 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f28440386a0 msgr2=0x7f284403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 --2- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f28440386a0 0x7f284403ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28480098c0 tx=0x7f2848006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 msgr2=0x7f28581992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 --2- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f28581992f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f28540097f0 tx=0x7f2854030d50 comp rx=0 tx=0).stop 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 shutdown_connections 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 --2- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f28440386a0 0x7f284403ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 --2- 172.21.15.89:0/2196304249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858106050 0x7f28581992f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:28.305 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 >> 172.21.15.89:0/2196304249 conn(0x7f28580ffc50 msgr2=0x7f28581007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:28.305 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 shutdown_connections 2024-09-13T22:00:28.305 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:27.785+0000 7f285f896640 1 -- 172.21.15.89:0/2196304249 wait complete. 2024-09-13T22:00:28.306 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T22:00:28.307 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout disabled 2024-09-13T22:00:28.314 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T22:00:28.314 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T22:00:28.314 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld.service is not enabled 2024-09-13T22:00:28.314 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T22:00:28.315 INFO:teuthology.orchestra.run.smithi089.stdout:Ceph Dashboard is now available at: 2024-09-13T22:00:28.315 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:28.315 INFO:teuthology.orchestra.run.smithi089.stdout: URL: https://smithi089.front.sepia.ceph.com:8443/ 2024-09-13T22:00:28.315 INFO:teuthology.orchestra.run.smithi089.stdout: User: admin 2024-09-13T22:00:28.316 INFO:teuthology.orchestra.run.smithi089.stdout: Password: xi8c4odke3 2024-09-13T22:00:28.316 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:28.316 INFO:teuthology.orchestra.run.smithi089.stdout:Saving cluster configuration to /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config directory 2024-09-13T22:00:28.316 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling autotune for osd_memory_target 2024-09-13T22:00:28.436 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:28 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2196304249' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T22:00:29.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.724+0000 7f8b412f4640 1 Processor -- start 2024-09-13T22:00:29.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.724+0000 7f8b412f4640 1 -- start start 2024-09-13T22:00:29.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.724+0000 7f8b412f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c108470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:29.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.724+0000 7f8b412f4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c079e60 con 0x7f8b3c106080 2024-09-13T22:00:29.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.724+0000 7f8b3affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.724+0000 7f8b3affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c108470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33584/0 (socket says 172.21.15.89:33584) 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.724+0000 7f8b3affd640 1 -- 172.21.15.89:0/542124210 learned_addr learned my addr 172.21.15.89:0/542124210 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.724+0000 7f8b3affd640 1 -- 172.21.15.89:0/542124210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c1089b0 con 0x7f8b3c106080 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.725+0000 7f8b3affd640 1 --2- 172.21.15.89:0/542124210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c108470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009820 tx=0x7f8b2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1afc6baefa02c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.725+0000 7f8b3a7fc640 1 -- 172.21.15.89:0/542124210 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b2c02ad40 con 0x7f8b3c106080 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.725+0000 7f8b3a7fc640 1 -- 172.21.15.89:0/542124210 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b2c032900 con 0x7f8b3c106080 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.725+0000 7f8b3a7fc640 1 -- 172.21.15.89:0/542124210 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b2c030860 con 0x7f8b3c106080 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.726+0000 7f8b412f4640 1 -- 172.21.15.89:0/542124210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 msgr2=0x7f8b3c108470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.726+0000 7f8b412f4640 1 --2- 172.21.15.89:0/542124210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c108470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009820 tx=0x7f8b2c02a270 comp rx=0 tx=0).stop 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.726+0000 7f8b412f4640 1 -- 172.21.15.89:0/542124210 shutdown_connections 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.726+0000 7f8b412f4640 1 --2- 172.21.15.89:0/542124210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c108470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:29.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.726+0000 7f8b412f4640 1 -- 172.21.15.89:0/542124210 >> 172.21.15.89:0/542124210 conn(0x7f8b3c0ffcc0 msgr2=0x7f8b3c1020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.726+0000 7f8b412f4640 1 -- 172.21.15.89:0/542124210 shutdown_connections 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.726+0000 7f8b412f4640 1 -- 172.21.15.89:0/542124210 wait complete. 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.726+0000 7f8b412f4640 1 Processor -- start 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.727+0000 7f8b412f4640 1 -- start start 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.727+0000 7f8b412f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.727+0000 7f8b412f4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c199860 con 0x7f8b3c106080 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.727+0000 7f8b3affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.727+0000 7f8b3affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33590/0 (socket says 172.21.15.89:33590) 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.727+0000 7f8b3affd640 1 -- 172.21.15.89:0/1692868552 learned_addr learned my addr 172.21.15.89:0/1692868552 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.727+0000 7f8b3affd640 1 -- 172.21.15.89:0/1692868552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0094d0 con 0x7f8b3c106080 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.727+0000 7f8b3affd640 1 --2- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c032670 tx=0x7f8b2c0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.727+0000 7f8b38ff9640 1 -- 172.21.15.89:0/1692868552 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b2c032c80 con 0x7f8b3c106080 2024-09-13T22:00:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.728+0000 7f8b38ff9640 1 -- 172.21.15.89:0/1692868552 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b2c032de0 con 0x7f8b3c106080 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.728+0000 7f8b38ff9640 1 -- 172.21.15.89:0/1692868552 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b2c03a720 con 0x7f8b3c106080 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.728+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c199a60 con 0x7f8b3c106080 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.728+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c199f00 con 0x7f8b3c106080 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.728+0000 7f8b38ff9640 1 -- 172.21.15.89:0/1692868552 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f8b2c03a950 con 0x7f8b3c106080 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.729+0000 7f8b38ff9640 1 --2- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8b280386f0 0x7f8b2803abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.729+0000 7f8b38ff9640 1 -- 172.21.15.89:0/1692868552 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8b2c06ba40 con 0x7f8b3c106080 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.729+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c109760 con 0x7f8b3c106080 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.729+0000 7f8b327fc640 1 --2- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8b280386f0 0x7f8b2803abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.729+0000 7f8b327fc640 1 --2- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8b280386f0 0x7f8b2803abb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b240098c0 tx=0x7f8b24006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.733+0000 7f8b38ff9640 1 -- 172.21.15.89:0/1692868552 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8b2c039b60 con 0x7f8b3c106080 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.896+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f8b3c19c840 con 0x7f8b3c106080 2024-09-13T22:00:29.451 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.897+0000 7f8b38ff9640 1 -- 172.21.15.89:0/1692868552 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f8b2c039780 con 0x7f8b3c106080 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.898+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8b280386f0 msgr2=0x7f8b2803abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.898+0000 7f8b412f4640 1 --2- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8b280386f0 0x7f8b2803abb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b240098c0 tx=0x7f8b24006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.898+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 msgr2=0x7f8b3c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.898+0000 7f8b412f4640 1 --2- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c032670 tx=0x7f8b2c0326a0 comp rx=0 tx=0).stop 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.898+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 shutdown_connections 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.898+0000 7f8b412f4640 1 --2- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f8b280386f0 0x7f8b2803abb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.898+0000 7f8b412f4640 1 --2- 172.21.15.89:0/1692868552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b3c106080 0x7f8b3c199320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.898+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 >> 172.21.15.89:0/1692868552 conn(0x7f8b3c0ffcc0 msgr2=0x7f8b3c1008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.899+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 shutdown_connections 2024-09-13T22:00:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:28.899+0000 7f8b412f4640 1 -- 172.21.15.89:0/1692868552 wait complete. 2024-09-13T22:00:30.346 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:30 smithi089 ceph-mon[27921]: mgrmap e13: smithi089.naneiw(active, since 6s) 2024-09-13T22:00:30.638 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.834+0000 7f6b8aa0b640 1 Processor -- start 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.834+0000 7f6b8aa0b640 1 -- start start 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.835+0000 7f6b8aa0b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8407a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.835+0000 7f6b8aa0b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8407a900 con 0x7f6b8407bed0 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.835+0000 7f6b83fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8407a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.835+0000 7f6b83fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8407a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33600/0 (socket says 172.21.15.89:33600) 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.835+0000 7f6b83fff640 1 -- 172.21.15.89:0/3359533079 learned_addr learned my addr 172.21.15.89:0/3359533079 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.835+0000 7f6b83fff640 1 -- 172.21.15.89:0/3359533079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8407aa40 con 0x7f6b8407bed0 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b83fff640 1 --2- 172.21.15.89:0/3359533079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8407a330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009820 tx=0x7f6b7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22439103fabd9d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b837fe640 1 -- 172.21.15.89:0/3359533079 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b7402ad40 con 0x7f6b8407bed0 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b837fe640 1 -- 172.21.15.89:0/3359533079 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b74032900 con 0x7f6b8407bed0 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b837fe640 1 -- 172.21.15.89:0/3359533079 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b74030860 con 0x7f6b8407bed0 2024-09-13T22:00:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/3359533079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 msgr2=0x7f6b8407a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b8aa0b640 1 --2- 172.21.15.89:0/3359533079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8407a330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009820 tx=0x7f6b7402a270 comp rx=0 tx=0).stop 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/3359533079 shutdown_connections 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b8aa0b640 1 --2- 172.21.15.89:0/3359533079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8407a330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/3359533079 >> 172.21.15.89:0/3359533079 conn(0x7f6b84100d30 msgr2=0x7f6b84103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/3359533079 shutdown_connections 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.836+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/3359533079 wait complete. 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.837+0000 7f6b8aa0b640 1 Processor -- start 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.837+0000 7f6b8aa0b640 1 -- start start 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.837+0000 7f6b8aa0b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.837+0000 7f6b8aa0b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8419ba60 con 0x7f6b8407bed0 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.837+0000 7f6b83fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:30.640 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.837+0000 7f6b83fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8419b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33614/0 (socket says 172.21.15.89:33614) 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.837+0000 7f6b83fff640 1 -- 172.21.15.89:0/1426919542 learned_addr learned my addr 172.21.15.89:0/1426919542 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.837+0000 7f6b83fff640 1 -- 172.21.15.89:0/1426919542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740094d0 con 0x7f6b8407bed0 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.838+0000 7f6b83fff640 1 --2- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8419b520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009940 tx=0x7f6b74032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.838+0000 7f6b81ffb640 1 -- 172.21.15.89:0/1426919542 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b74032c80 con 0x7f6b8407bed0 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.838+0000 7f6b81ffb640 1 -- 172.21.15.89:0/1426919542 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b74032de0 con 0x7f6b8407bed0 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.838+0000 7f6b81ffb640 1 -- 172.21.15.89:0/1426919542 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b7403a720 con 0x7f6b8407bed0 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.838+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8419bc60 con 0x7f6b8407bed0 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.838+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8419c100 con 0x7f6b8407bed0 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.839+0000 7f6b81ffb640 1 -- 172.21.15.89:0/1426919542 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f6b7403cc30 con 0x7f6b8407bed0 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.839+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8410b9a0 con 0x7f6b8407bed0 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.839+0000 7f6b81ffb640 1 --2- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6b70038740 0x7f6b7003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.839+0000 7f6b81ffb640 1 -- 172.21.15.89:0/1426919542 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6b7406bbf0 con 0x7f6b8407bed0 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.839+0000 7f6b7bfff640 1 --2- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6b70038740 0x7f6b7003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.839+0000 7f6b7bfff640 1 --2- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6b70038740 0x7f6b7003ac00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0098c0 tx=0x7f6b6c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:29.844+0000 7f6b81ffb640 1 -- 172.21.15.89:0/1426919542 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6b74031d30 con 0x7f6b8407bed0 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.091+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f6b8410bbe0 con 0x7f6b8407bed0 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.093+0000 7f6b81ffb640 1 -- 172.21.15.89:0/1426919542 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f6b74031b50 con 0x7f6b8407bed0 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.095+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6b70038740 msgr2=0x7f6b7003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.095+0000 7f6b8aa0b640 1 --2- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6b70038740 0x7f6b7003ac00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0098c0 tx=0x7f6b6c006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.095+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 msgr2=0x7f6b8419b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.095+0000 7f6b8aa0b640 1 --2- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8419b520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009940 tx=0x7f6b74032670 comp rx=0 tx=0).stop 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.095+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 shutdown_connections 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.096+0000 7f6b8aa0b640 1 --2- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6b70038740 0x7f6b7003ac00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:30.642 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.096+0000 7f6b8aa0b640 1 --2- 172.21.15.89:0/1426919542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b8407bed0 0x7f6b8419b520 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:30.643 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.096+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 >> 172.21.15.89:0/1426919542 conn(0x7f6b84100d30 msgr2=0x7f6b84101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:30.643 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.096+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 shutdown_connections 2024-09-13T22:00:30.643 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T22:00:30.096+0000 7f6b8aa0b640 1 -- 172.21.15.89:0/1426919542 wait complete. 2024-09-13T22:00:30.643 INFO:teuthology.orchestra.run.smithi089.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T22:00:30.643 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:30.643 INFO:teuthology.orchestra.run.smithi089.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:00:30.643 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:30.643 INFO:teuthology.orchestra.run.smithi089.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout: ceph telemetry on 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout:For more information see: 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:30.644 INFO:teuthology.orchestra.run.smithi089.stdout:Bootstrap complete. 2024-09-13T22:00:30.670 INFO:tasks.cephadm:Fetching config... 2024-09-13T22:00:30.670 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:00:30.670 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T22:00:30.688 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T22:00:30.688 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:00:30.688 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T22:00:30.744 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T22:00:30.744 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:00:30.744 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/keyring of=/dev/stdout 2024-09-13T22:00:30.810 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T22:00:30.810 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:00:30.810 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T22:00:30.865 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T22:00:30.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCthAk5uuZLSJEjH1L+gEUQ5Jwq5Sj3XdvJMkoE9qa1qaRDb1UPnhzs3PbYJDtJ3kMD4C1UZY8+yU0U/Dcn6cjP/chnhN/kZAiIltpE0ZCqDwkJtKW5n3wfudULtBomZq/4WyKXj5MDHEt6n5oR6MHxYn1g7NRgi7+ZLgxp67x3ztZc0fD1Jn8EJG/IBPC2GYQVFVzXKHDzKZmhZKzs2OsXvLJxgFynVQAF8zuhTowiIXGpYDbfSxhp2MnvSQk8qZfutr17kjFb6uG3n7l6Vz+aolEPHIVREYcuzvvJrWev9lHGr23Z0Z4dChUUAZVusd/cs5HbZ/nH6kPJm7SWQomPsa7HL8hjI3194cNXPU36PL8oKO/dQznvVxblFYZMAnVSZeUoLLSuLEIqbSJTnQ5svCWOgGw/d+77kQBD8N06B6I8tzdn5P3f0wnxTDMmZhMC/VbAVDz1rkmLb/t1I7GhNBwuY+43aX5KlgdZyOmDoTloxzUetNaJNjy6yn1csq8= ceph-39489060-721b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T22:00:30.950 INFO:teuthology.orchestra.run.smithi089.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCthAk5uuZLSJEjH1L+gEUQ5Jwq5Sj3XdvJMkoE9qa1qaRDb1UPnhzs3PbYJDtJ3kMD4C1UZY8+yU0U/Dcn6cjP/chnhN/kZAiIltpE0ZCqDwkJtKW5n3wfudULtBomZq/4WyKXj5MDHEt6n5oR6MHxYn1g7NRgi7+ZLgxp67x3ztZc0fD1Jn8EJG/IBPC2GYQVFVzXKHDzKZmhZKzs2OsXvLJxgFynVQAF8zuhTowiIXGpYDbfSxhp2MnvSQk8qZfutr17kjFb6uG3n7l6Vz+aolEPHIVREYcuzvvJrWev9lHGr23Z0Z4dChUUAZVusd/cs5HbZ/nH6kPJm7SWQomPsa7HL8hjI3194cNXPU36PL8oKO/dQznvVxblFYZMAnVSZeUoLLSuLEIqbSJTnQ5svCWOgGw/d+77kQBD8N06B6I8tzdn5P3f0wnxTDMmZhMC/VbAVDz1rkmLb/t1I7GhNBwuY+43aX5KlgdZyOmDoTloxzUetNaJNjy6yn1csq8= ceph-39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:00:30.961 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCthAk5uuZLSJEjH1L+gEUQ5Jwq5Sj3XdvJMkoE9qa1qaRDb1UPnhzs3PbYJDtJ3kMD4C1UZY8+yU0U/Dcn6cjP/chnhN/kZAiIltpE0ZCqDwkJtKW5n3wfudULtBomZq/4WyKXj5MDHEt6n5oR6MHxYn1g7NRgi7+ZLgxp67x3ztZc0fD1Jn8EJG/IBPC2GYQVFVzXKHDzKZmhZKzs2OsXvLJxgFynVQAF8zuhTowiIXGpYDbfSxhp2MnvSQk8qZfutr17kjFb6uG3n7l6Vz+aolEPHIVREYcuzvvJrWev9lHGr23Z0Z4dChUUAZVusd/cs5HbZ/nH6kPJm7SWQomPsa7HL8hjI3194cNXPU36PL8oKO/dQznvVxblFYZMAnVSZeUoLLSuLEIqbSJTnQ5svCWOgGw/d+77kQBD8N06B6I8tzdn5P3f0wnxTDMmZhMC/VbAVDz1rkmLb/t1I7GhNBwuY+43aX5KlgdZyOmDoTloxzUetNaJNjy6yn1csq8= ceph-39489060-721b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T22:00:31.092 INFO:teuthology.orchestra.run.smithi159.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCthAk5uuZLSJEjH1L+gEUQ5Jwq5Sj3XdvJMkoE9qa1qaRDb1UPnhzs3PbYJDtJ3kMD4C1UZY8+yU0U/Dcn6cjP/chnhN/kZAiIltpE0ZCqDwkJtKW5n3wfudULtBomZq/4WyKXj5MDHEt6n5oR6MHxYn1g7NRgi7+ZLgxp67x3ztZc0fD1Jn8EJG/IBPC2GYQVFVzXKHDzKZmhZKzs2OsXvLJxgFynVQAF8zuhTowiIXGpYDbfSxhp2MnvSQk8qZfutr17kjFb6uG3n7l6Vz+aolEPHIVREYcuzvvJrWev9lHGr23Z0Z4dChUUAZVusd/cs5HbZ/nH6kPJm7SWQomPsa7HL8hjI3194cNXPU36PL8oKO/dQznvVxblFYZMAnVSZeUoLLSuLEIqbSJTnQ5svCWOgGw/d+77kQBD8N06B6I8tzdn5P3f0wnxTDMmZhMC/VbAVDz1rkmLb/t1I7GhNBwuY+43aX5KlgdZyOmDoTloxzUetNaJNjy6yn1csq8= ceph-39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:00:31.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T22:00:31.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:31 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1426919542' entity='client.admin' 2024-09-13T22:00:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:00:33.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.858+0000 7ff0d47c0640 1 -- 172.21.15.89:0/1476020375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 msgr2=0x7ff0cc0fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:33.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.858+0000 7ff0d47c0640 1 --2- 172.21.15.89:0/1476020375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 0x7ff0cc0fead0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009880 tx=0x7ff0c802a5d0 comp rx=0 tx=0).stop 2024-09-13T22:00:33.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.858+0000 7ff0d47c0640 1 -- 172.21.15.89:0/1476020375 shutdown_connections 2024-09-13T22:00:33.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.858+0000 7ff0d47c0640 1 --2- 172.21.15.89:0/1476020375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 0x7ff0cc0fead0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:33.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.858+0000 7ff0d47c0640 1 -- 172.21.15.89:0/1476020375 >> 172.21.15.89:0/1476020375 conn(0x7ff0cc0f9e80 msgr2=0x7ff0cc0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.858+0000 7ff0d47c0640 1 -- 172.21.15.89:0/1476020375 shutdown_connections 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.858+0000 7ff0d47c0640 1 -- 172.21.15.89:0/1476020375 wait complete. 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.858+0000 7ff0d47c0640 1 Processor -- start 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.859+0000 7ff0d47c0640 1 -- start start 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.859+0000 7ff0d47c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 0x7ff0cc068160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.859+0000 7ff0d47c0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc197a30 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.859+0000 7ff0d255c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 0x7ff0cc068160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.859+0000 7ff0d255c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 0x7ff0cc068160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37450/0 (socket says 172.21.15.89:37450) 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.859+0000 7ff0d255c640 1 -- 172.21.15.89:0/3188319228 learned_addr learned my addr 172.21.15.89:0/3188319228 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.859+0000 7ff0d255c640 1 -- 172.21.15.89:0/3188319228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c8009560 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.859+0000 7ff0d255c640 1 --2- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 0x7ff0cc068160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8006010 tx=0x7ff0c80055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.860+0000 7ff0c37fe640 1 -- 172.21.15.89:0/3188319228 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0c8004b60 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.860+0000 7ff0c37fe640 1 -- 172.21.15.89:0/3188319228 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0c8004cc0 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.860+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc197b70 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.860+0000 7ff0c37fe640 1 -- 172.21.15.89:0/3188319228 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0c8031a20 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.860+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc197f50 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.861+0000 7ff0c37fe640 1 -- 172.21.15.89:0/3188319228 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7ff0c8031c90 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.861+0000 7ff0c37fe640 1 --2- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7ff0b8038790 0x7ff0b803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.861+0000 7ff0c37fe640 1 -- 172.21.15.89:0/3188319228 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff0c806c520 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.861+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0cc0fead0 con 0x7ff0cc0fe6d0 2024-09-13T22:00:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.861+0000 7ff0d1d5b640 1 --2- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7ff0b8038790 0x7ff0b803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:33.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.862+0000 7ff0d1d5b640 1 --2- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7ff0b8038790 0x7ff0b803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0098c0 tx=0x7ff0bc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:33.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:33.866+0000 7ff0c37fe640 1 -- 172.21.15.89:0/3188319228 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff0c8035070 con 0x7ff0cc0fe6d0 2024-09-13T22:00:34.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.117+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ff0cc18d500 con 0x7ff0cc0fe6d0 2024-09-13T22:00:34.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.121+0000 7ff0c37fe640 1 -- 172.21.15.89:0/3188319228 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff0c803a360 con 0x7ff0cc0fe6d0 2024-09-13T22:00:34.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7ff0b8038790 msgr2=0x7ff0b803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:34.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 --2- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7ff0b8038790 0x7ff0b803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0098c0 tx=0x7ff0bc006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:34.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 msgr2=0x7ff0cc068160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:34.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 --2- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 0x7ff0cc068160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8006010 tx=0x7ff0c80055f0 comp rx=0 tx=0).stop 2024-09-13T22:00:34.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 shutdown_connections 2024-09-13T22:00:34.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 --2- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7ff0b8038790 0x7ff0b803ac50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:34.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 --2- 172.21.15.89:0/3188319228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc0fe6d0 0x7ff0cc068160 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:34.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 >> 172.21.15.89:0/3188319228 conn(0x7ff0cc0f9e80 msgr2=0x7ff0cc0fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:34.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 shutdown_connections 2024-09-13T22:00:34.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:34.123+0000 7ff0d47c0640 1 -- 172.21.15.89:0/3188319228 wait complete. 2024-09-13T22:00:34.845 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T22:00:34.845 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T22:00:35.372 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:00:35.493 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:35 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3188319228' entity='client.admin' 2024-09-13T22:00:36.601 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:36 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:36.601 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:36 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:36.601 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:36 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:00:36.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:36 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:36.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:36 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:00:36.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:36 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:00:36.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:36 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:00:36.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:36 smithi089 ceph-mon[27921]: Deploying daemon ceph-exporter.smithi089 on smithi089 2024-09-13T22:00:36.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.808+0000 7fd0679c1640 1 -- 172.21.15.89:0/1884046633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 msgr2=0x7fd060072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:36.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.808+0000 7fd0679c1640 1 --2- 172.21.15.89:0/1884046633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 0x7fd060072940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd050009880 tx=0x7fd05002a5d0 comp rx=0 tx=0).stop 2024-09-13T22:00:36.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.808+0000 7fd0679c1640 1 -- 172.21.15.89:0/1884046633 shutdown_connections 2024-09-13T22:00:36.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.808+0000 7fd0679c1640 1 --2- 172.21.15.89:0/1884046633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 0x7fd060072940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:36.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.808+0000 7fd0679c1640 1 -- 172.21.15.89:0/1884046633 >> 172.21.15.89:0/1884046633 conn(0x7fd0600faf90 msgr2=0x7fd0600fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:36.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.809+0000 7fd0679c1640 1 -- 172.21.15.89:0/1884046633 shutdown_connections 2024-09-13T22:00:36.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.809+0000 7fd0679c1640 1 -- 172.21.15.89:0/1884046633 wait complete. 2024-09-13T22:00:36.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.809+0000 7fd0679c1640 1 Processor -- start 2024-09-13T22:00:36.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.809+0000 7fd0679c1640 1 -- start start 2024-09-13T22:00:36.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.809+0000 7fd0679c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 0x7fd06019b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:36.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.809+0000 7fd0679c1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06019b7c0 con 0x7fd0600744e0 2024-09-13T22:00:36.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.810+0000 7fd06575d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 0x7fd06019b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:36.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.810+0000 7fd06575d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 0x7fd06019b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37468/0 (socket says 172.21.15.89:37468) 2024-09-13T22:00:36.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.810+0000 7fd06575d640 1 -- 172.21.15.89:0/3537382049 learned_addr learned my addr 172.21.15.89:0/3537382049 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:36.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.810+0000 7fd06575d640 1 -- 172.21.15.89:0/3537382049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050009560 con 0x7fd0600744e0 2024-09-13T22:00:36.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.810+0000 7fd06575d640 1 --2- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 0x7fd06019b280 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd050005610 tx=0x7fd050005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:36.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.810+0000 7fd05e7fc640 1 -- 172.21.15.89:0/3537382049 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd050004b20 con 0x7fd0600744e0 2024-09-13T22:00:36.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.810+0000 7fd05e7fc640 1 -- 172.21.15.89:0/3537382049 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd050004c80 con 0x7fd0600744e0 2024-09-13T22:00:36.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.810+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06019b9c0 con 0x7fd0600744e0 2024-09-13T22:00:36.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.811+0000 7fd05e7fc640 1 -- 172.21.15.89:0/3537382049 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd050031a90 con 0x7fd0600744e0 2024-09-13T22:00:36.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.811+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06019be60 con 0x7fd0600744e0 2024-09-13T22:00:36.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.811+0000 7fd05e7fc640 1 -- 172.21.15.89:0/3537382049 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fd050031d00 con 0x7fd0600744e0 2024-09-13T22:00:36.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.811+0000 7fd05e7fc640 1 --2- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd048038410 0x7fd04803a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:36.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.811+0000 7fd05e7fc640 1 -- 172.21.15.89:0/3537382049 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd050071660 con 0x7fd0600744e0 2024-09-13T22:00:36.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.812+0000 7fd064f5c640 1 --2- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd048038410 0x7fd04803a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:36.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.812+0000 7fd064f5c640 1 --2- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd048038410 0x7fd04803a8d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd0540098c0 tx=0x7fd054006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:36.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.812+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd060072940 con 0x7fd0600744e0 2024-09-13T22:00:36.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.817+0000 7fd05e7fc640 1 -- 172.21.15.89:0/3537382049 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd050035080 con 0x7fd0600744e0 2024-09-13T22:00:36.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.990+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 --> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0600608f0 con 0x7fd048038410 2024-09-13T22:00:36.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.993+0000 7fd05e7fc640 1 -- 172.21.15.89:0/3537382049 <== mgr.14160 v2:172.21.15.89:6800/2476248652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd0600608f0 con 0x7fd048038410 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd048038410 msgr2=0x7fd04803a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 --2- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd048038410 0x7fd04803a8d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd0540098c0 tx=0x7fd054006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 msgr2=0x7fd06019b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 --2- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 0x7fd06019b280 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd050005610 tx=0x7fd050005640 comp rx=0 tx=0).stop 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 shutdown_connections 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 --2- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd048038410 0x7fd04803a8d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 --2- 172.21.15.89:0/3537382049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0600744e0 0x7fd06019b280 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 >> 172.21.15.89:0/3537382049 conn(0x7fd0600faf90 msgr2=0x7fd0600fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 shutdown_connections 2024-09-13T22:00:36.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:36.995+0000 7fd0679c1640 1 -- 172.21.15.89:0/3537382049 wait complete. 2024-09-13T22:00:37.746 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi159 2024-09-13T22:00:37.746 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:00:37.746 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.conf 2024-09-13T22:00:37.767 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:00:37.767 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:00:37.825 INFO:tasks.cephadm:Adding host smithi159 to orchestrator... 2024-09-13T22:00:37.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch host add smithi159 2024-09-13T22:00:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:00:38.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:37 smithi089 ceph-mon[27921]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:38.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:37 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.822+0000 7f25e78c6640 1 -- 172.21.15.89:0/2463598160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 msgr2=0x7f25e00ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.822+0000 7f25e78c6640 1 --2- 172.21.15.89:0/2463598160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 0x7f25e00ffbc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009880 tx=0x7f25dc02a5d0 comp rx=0 tx=0).stop 2024-09-13T22:00:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.822+0000 7f25e78c6640 1 -- 172.21.15.89:0/2463598160 shutdown_connections 2024-09-13T22:00:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.822+0000 7f25e78c6640 1 --2- 172.21.15.89:0/2463598160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 0x7f25e00ffbc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.822+0000 7f25e78c6640 1 -- 172.21.15.89:0/2463598160 >> 172.21.15.89:0/2463598160 conn(0x7f25e00faf30 msgr2=0x7f25e00fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.822+0000 7f25e78c6640 1 -- 172.21.15.89:0/2463598160 shutdown_connections 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.822+0000 7f25e78c6640 1 -- 172.21.15.89:0/2463598160 wait complete. 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.822+0000 7f25e78c6640 1 Processor -- start 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.823+0000 7f25e78c6640 1 -- start start 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.823+0000 7f25e78c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 0x7f25e0074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.823+0000 7f25e78c6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00746b0 con 0x7f25e00ff7c0 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.823+0000 7f25e5662640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 0x7f25e0074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.823+0000 7f25e5662640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 0x7f25e0074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37480/0 (socket says 172.21.15.89:37480) 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.823+0000 7f25e5662640 1 -- 172.21.15.89:0/2532044411 learned_addr learned my addr 172.21.15.89:0/2532044411 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.823+0000 7f25e5662640 1 -- 172.21.15.89:0/2532044411 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc009560 con 0x7f25e00ff7c0 2024-09-13T22:00:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.823+0000 7f25e5662640 1 --2- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 0x7f25e0074170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f25dc005610 tx=0x7f25dc005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:39.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.824+0000 7f25d67fc640 1 -- 172.21.15.89:0/2532044411 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25dc004b20 con 0x7f25e00ff7c0 2024-09-13T22:00:39.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.824+0000 7f25d67fc640 1 -- 172.21.15.89:0/2532044411 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25dc004c80 con 0x7f25e00ff7c0 2024-09-13T22:00:39.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.824+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e00728a0 con 0x7f25e00ff7c0 2024-09-13T22:00:39.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.824+0000 7f25d67fc640 1 -- 172.21.15.89:0/2532044411 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25dc031a90 con 0x7f25e00ff7c0 2024-09-13T22:00:39.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.824+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e0072d40 con 0x7f25e00ff7c0 2024-09-13T22:00:39.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.824+0000 7f25d67fc640 1 -- 172.21.15.89:0/2532044411 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f25dc031d00 con 0x7f25e00ff7c0 2024-09-13T22:00:39.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.825+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e0105fb0 con 0x7f25e00ff7c0 2024-09-13T22:00:39.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.825+0000 7f25d67fc640 1 --2- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f25cc038790 0x7f25cc03ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:39.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.825+0000 7f25d67fc640 1 -- 172.21.15.89:0/2532044411 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f25dc06c480 con 0x7f25e00ff7c0 2024-09-13T22:00:39.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.825+0000 7f25e4e61640 1 --2- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f25cc038790 0x7f25cc03ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:39.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.825+0000 7f25e4e61640 1 --2- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f25cc038790 0x7f25cc03ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f25d00098c0 tx=0x7f25d0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:39.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:39.829+0000 7f25d67fc640 1 -- 172.21.15.89:0/2532044411 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f25dc04ddb0 con 0x7f25e00ff7c0 2024-09-13T22:00:40.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:40.024+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 --> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}) v1 -- 0x7f25e018e0d0 con 0x7f25cc038790 2024-09-13T22:00:41.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:41 smithi089 ceph-mon[27921]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:41.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:41 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:41.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:41 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:41.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:41 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:41.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:41 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:41.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:41 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:00:41.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:41 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T22:00:41.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:41 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:00:41.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:41 smithi089 ceph-mon[27921]: Deploying daemon crash.smithi089 on smithi089 2024-09-13T22:00:42.735 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:42 smithi089 ceph-mon[27921]: Deploying cephadm binary to smithi159 2024-09-13T22:00:42.735 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:42 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:42.739 INFO:teuthology.orchestra.run.smithi089.stdout:Added host 'smithi159' with addr '172.21.15.159' 2024-09-13T22:00:42.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.737+0000 7f25d67fc640 1 -- 172.21.15.89:0/2532044411 <== mgr.14160 v2:172.21.15.89:6800/2476248652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f25e018e0d0 con 0x7f25cc038790 2024-09-13T22:00:42.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f25cc038790 msgr2=0x7f25cc03ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:42.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 --2- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f25cc038790 0x7f25cc03ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f25d00098c0 tx=0x7f25d0006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:42.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 msgr2=0x7f25e0074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:42.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 --2- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 0x7f25e0074170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f25dc005610 tx=0x7f25dc005640 comp rx=0 tx=0).stop 2024-09-13T22:00:42.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 shutdown_connections 2024-09-13T22:00:42.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 --2- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f25cc038790 0x7f25cc03ac50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:42.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 --2- 172.21.15.89:0/2532044411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e00ff7c0 0x7f25e0074170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:42.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 >> 172.21.15.89:0/2532044411 conn(0x7f25e00faf30 msgr2=0x7f25e00fb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:42.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 shutdown_connections 2024-09-13T22:00:42.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:42.740+0000 7f25e78c6640 1 -- 172.21.15.89:0/2532044411 wait complete. 2024-09-13T22:00:43.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T22:00:43.580 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:00:43.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:43 smithi089 ceph-mon[27921]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:43.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:43 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:43.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:43 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:43.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:43 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:43.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:43 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:43.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:43 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:44.790 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:44 smithi089 ceph-mon[27921]: Added host smithi159 2024-09-13T22:00:44.791 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:44 smithi089 ceph-mon[27921]: Deploying daemon node-exporter.smithi089 on smithi089 2024-09-13T22:00:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.298+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/2551779439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 msgr2=0x7fe3c80fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.298+0000 7fe3cdfb8640 1 --2- 172.21.15.89:0/2551779439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 0x7fe3c80fead0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009c20 tx=0x7fe3c002aa90 comp rx=0 tx=0).stop 2024-09-13T22:00:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.298+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/2551779439 shutdown_connections 2024-09-13T22:00:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.298+0000 7fe3cdfb8640 1 --2- 172.21.15.89:0/2551779439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 0x7fe3c80fead0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.298+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/2551779439 >> 172.21.15.89:0/2551779439 conn(0x7fe3c80f9e80 msgr2=0x7fe3c80fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.298+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/2551779439 shutdown_connections 2024-09-13T22:00:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.298+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/2551779439 wait complete. 2024-09-13T22:00:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.298+0000 7fe3cdfb8640 1 Processor -- start 2024-09-13T22:00:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.299+0000 7fe3cdfb8640 1 -- start start 2024-09-13T22:00:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.299+0000 7fe3cdfb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 0x7fe3c8193ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.299+0000 7fe3cdfb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c8194220 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.299+0000 7fe3c77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 0x7fe3c8193ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:45.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.299+0000 7fe3c77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 0x7fe3c8193ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48948/0 (socket says 172.21.15.89:48948) 2024-09-13T22:00:45.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.299+0000 7fe3c77fe640 1 -- 172.21.15.89:0/1808559855 learned_addr learned my addr 172.21.15.89:0/1808559855 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:45.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.300+0000 7fe3c77fe640 1 -- 172.21.15.89:0/1808559855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c0009900 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.300+0000 7fe3c77fe640 1 --2- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 0x7fe3c8193ce0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009d40 tx=0x7fe3c0030fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:45.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.300+0000 7fe3c4ff9640 1 -- 172.21.15.89:0/1808559855 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3c002fc00 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.300+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c8194420 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.300+0000 7fe3c4ff9640 1 -- 172.21.15.89:0/1808559855 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3c002e880 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.300+0000 7fe3c4ff9640 1 -- 172.21.15.89:0/1808559855 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3c0038450 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.300+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c81948c0 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.301+0000 7fe3c4ff9640 1 -- 172.21.15.89:0/1808559855 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fe3c000a040 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.301+0000 7fe3c4ff9640 1 --2- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fe3b4038740 0x7fe3b403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:45.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.301+0000 7fe3c4ff9640 1 -- 172.21.15.89:0/1808559855 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe3c006eda0 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.301+0000 7fe3c6ffd640 1 --2- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fe3b4038740 0x7fe3b403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:45.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.301+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c80feb50 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.302+0000 7fe3c6ffd640 1 --2- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fe3b4038740 0x7fe3b403ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00098c0 tx=0x7fe3b0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:45.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.306+0000 7fe3c4ff9640 1 -- 172.21.15.89:0/1808559855 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe3c0033080 con 0x7fe3c80fe6d0 2024-09-13T22:00:45.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.476+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 --> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3c818d230 con 0x7fe3b4038740 2024-09-13T22:00:45.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.477+0000 7fe3c4ff9640 1 -- 172.21.15.89:0/1808559855 <== mgr.14160 v2:172.21.15.89:6800/2476248652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fe3c818d230 con 0x7fe3b4038740 2024-09-13T22:00:45.478 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:00:45.479 INFO:teuthology.orchestra.run.smithi089.stdout:[{"addr": "172.21.15.89", "hostname": "smithi089", "labels": [], "status": ""}, {"addr": "172.21.15.159", "hostname": "smithi159", "labels": [], "status": ""}] 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fe3b4038740 msgr2=0x7fe3b403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 --2- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fe3b4038740 0x7fe3b403ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00098c0 tx=0x7fe3b0006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 msgr2=0x7fe3c8193ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 --2- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 0x7fe3c8193ce0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009d40 tx=0x7fe3c0030fd0 comp rx=0 tx=0).stop 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 shutdown_connections 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 --2- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fe3b4038740 0x7fe3b403ac00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 --2- 172.21.15.89:0/1808559855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3c80fe6d0 0x7fe3c8193ce0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 >> 172.21.15.89:0/1808559855 conn(0x7fe3c80f9e80 msgr2=0x7fe3c80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 shutdown_connections 2024-09-13T22:00:45.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:45.479+0000 7fe3cdfb8640 1 -- 172.21.15.89:0/1808559855 wait complete. 2024-09-13T22:00:45.681 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:45 smithi089 ceph-mon[27921]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:46.181 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T22:00:46.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T22:00:46.375 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:00:46.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:46 smithi089 ceph-mon[27921]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:00:47.609 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:47 smithi089 ceph-mon[27921]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:47.609 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:47 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:49.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.255+0000 7f6a60c7d640 1 -- 172.21.15.89:0/2324631279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 msgr2=0x7f6a5c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:49.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.255+0000 7f6a60c7d640 1 --2- 172.21.15.89:0/2324631279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 0x7f6a5c072940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009c20 tx=0x7f6a4c02aa90 comp rx=0 tx=0).stop 2024-09-13T22:00:49.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.255+0000 7f6a60c7d640 1 -- 172.21.15.89:0/2324631279 shutdown_connections 2024-09-13T22:00:49.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.255+0000 7f6a60c7d640 1 --2- 172.21.15.89:0/2324631279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 0x7f6a5c072940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.255+0000 7f6a60c7d640 1 -- 172.21.15.89:0/2324631279 >> 172.21.15.89:0/2324631279 conn(0x7f6a5c0faf30 msgr2=0x7f6a5c0fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.255+0000 7f6a60c7d640 1 -- 172.21.15.89:0/2324631279 shutdown_connections 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.255+0000 7f6a60c7d640 1 -- 172.21.15.89:0/2324631279 wait complete. 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.256+0000 7f6a60c7d640 1 Processor -- start 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.256+0000 7f6a60c7d640 1 -- start start 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.256+0000 7f6a60c7d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 0x7f6a5c196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.256+0000 7f6a60c7d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1974a0 con 0x7f6a5c0744e0 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.256+0000 7f6a5a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 0x7f6a5c196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.256+0000 7f6a5a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 0x7f6a5c196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48972/0 (socket says 172.21.15.89:48972) 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.256+0000 7f6a5a59c640 1 -- 172.21.15.89:0/471087789 learned_addr learned my addr 172.21.15.89:0/471087789 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.256+0000 7f6a5a59c640 1 -- 172.21.15.89:0/471087789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c009900 con 0x7f6a5c0744e0 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.257+0000 7f6a5a59c640 1 --2- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 0x7f6a5c196f60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c005cc0 tx=0x7f6a4c02e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.257+0000 7f6a537fe640 1 -- 172.21.15.89:0/471087789 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a4c03e070 con 0x7f6a5c0744e0 2024-09-13T22:00:49.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.257+0000 7f6a537fe640 1 -- 172.21.15.89:0/471087789 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a4c02e990 con 0x7f6a5c0744e0 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.257+0000 7f6a537fe640 1 -- 172.21.15.89:0/471087789 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a4c038450 con 0x7f6a5c0744e0 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.257+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c1976a0 con 0x7f6a5c0744e0 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.257+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c197b40 con 0x7f6a5c0744e0 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.258+0000 7f6a537fe640 1 -- 172.21.15.89:0/471087789 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f6a4c00a040 con 0x7f6a5c0744e0 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.258+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c0729c0 con 0x7f6a5c0744e0 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.258+0000 7f6a537fe640 1 --2- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6a48038740 0x7f6a4803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.258+0000 7f6a537fe640 1 -- 172.21.15.89:0/471087789 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6a4c06c2c0 con 0x7f6a5c0744e0 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.258+0000 7f6a59d9b640 1 --2- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6a48038740 0x7f6a4803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.259+0000 7f6a59d9b640 1 --2- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6a48038740 0x7f6a4803ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a440098c0 tx=0x7f6a44006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:49.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.263+0000 7f6a537fe640 1 -- 172.21.15.89:0/471087789 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6a4c036770 con 0x7f6a5c0744e0 2024-09-13T22:00:49.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:49.442+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6a5c1907f0 con 0x7f6a5c0744e0 2024-09-13T22:00:49.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:49 smithi089 ceph-mon[27921]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:49.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:49 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:49 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:49 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:49 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:49 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/471087789' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T22:00:50.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.327+0000 7f6a537fe640 1 -- 172.21.15.89:0/471087789 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6a4c033090 con 0x7f6a5c0744e0 2024-09-13T22:00:50.329 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2024-09-13T22:00:50.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.329+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6a48038740 msgr2=0x7f6a4803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:50.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.329+0000 7f6a60c7d640 1 --2- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6a48038740 0x7f6a4803ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a440098c0 tx=0x7f6a44006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:50.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.329+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 msgr2=0x7f6a5c196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:50.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.329+0000 7f6a60c7d640 1 --2- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 0x7f6a5c196f60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c005cc0 tx=0x7f6a4c02e5f0 comp rx=0 tx=0).stop 2024-09-13T22:00:50.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.329+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 shutdown_connections 2024-09-13T22:00:50.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.329+0000 7f6a60c7d640 1 --2- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f6a48038740 0x7f6a4803ac00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:50.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.329+0000 7f6a60c7d640 1 --2- 172.21.15.89:0/471087789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5c0744e0 0x7f6a5c196f60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:50.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.329+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 >> 172.21.15.89:0/471087789 conn(0x7f6a5c0faf30 msgr2=0x7f6a5c0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:50.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.330+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 shutdown_connections 2024-09-13T22:00:50.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:00:50.330+0000 7f6a60c7d640 1 -- 172.21.15.89:0/471087789 wait complete. 2024-09-13T22:00:50.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:50 smithi089 ceph-mon[27921]: Deploying daemon alertmanager.smithi089 on smithi089 2024-09-13T22:00:50.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:50 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/471087789' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T22:00:50.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:50 smithi089 ceph-mon[27921]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:00:51.481 INFO:tasks.cephadm:Adding mon.smithi089 on smithi089 2024-09-13T22:00:51.481 INFO:tasks.cephadm:Adding mon.smithi159 on smithi159 2024-09-13T22:00:51.481 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi089:172.21.15.89=smithi089;smithi159:172.21.15.159=smithi159' 2024-09-13T22:00:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:00:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:00:51.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:51 smithi089 ceph-mon[27921]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:53.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.156+0000 7f3f36c43640 1 -- 172.21.15.159:0/836672341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 msgr2=0x7f3f300fdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:53.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.156+0000 7f3f36c43640 1 --2- 172.21.15.159:0/836672341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 0x7f3f300fdea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009880 tx=0x7f3f2402a5d0 comp rx=0 tx=0).stop 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.156+0000 7f3f36c43640 1 -- 172.21.15.159:0/836672341 shutdown_connections 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.156+0000 7f3f36c43640 1 --2- 172.21.15.159:0/836672341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 0x7f3f300fdea0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.156+0000 7f3f36c43640 1 -- 172.21.15.159:0/836672341 >> 172.21.15.159:0/836672341 conn(0x7f3f300f9610 msgr2=0x7f3f300fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.156+0000 7f3f36c43640 1 -- 172.21.15.159:0/836672341 shutdown_connections 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.156+0000 7f3f36c43640 1 -- 172.21.15.159:0/836672341 wait complete. 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.156+0000 7f3f36c43640 1 Processor -- start 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.156+0000 7f3f36c43640 1 -- start start 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.157+0000 7f3f36c43640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 0x7f3f30194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.157+0000 7f3f36c43640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30195200 con 0x7f3f300fdaa0 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.157+0000 7f3f349df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 0x7f3f30194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.157+0000 7f3f349df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 0x7f3f30194cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:44134/0 (socket says 172.21.15.159:44134) 2024-09-13T22:00:53.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.157+0000 7f3f349df640 1 -- 172.21.15.159:0/3181108698 learned_addr learned my addr 172.21.15.159:0/3181108698 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:00:53.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.157+0000 7f3f349df640 1 -- 172.21.15.159:0/3181108698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24009560 con 0x7f3f300fdaa0 2024-09-13T22:00:53.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.157+0000 7f3f349df640 1 --2- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 0x7f3f30194cc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f24005610 tx=0x7f3f24005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:53.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.158+0000 7f3f2dffb640 1 -- 172.21.15.159:0/3181108698 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f24004b20 con 0x7f3f300fdaa0 2024-09-13T22:00:53.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.158+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f30195400 con 0x7f3f300fdaa0 2024-09-13T22:00:53.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.158+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f301958a0 con 0x7f3f300fdaa0 2024-09-13T22:00:53.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.158+0000 7f3f2dffb640 1 -- 172.21.15.159:0/3181108698 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f24004c80 con 0x7f3f300fdaa0 2024-09-13T22:00:53.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.158+0000 7f3f2dffb640 1 -- 172.21.15.159:0/3181108698 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f24031960 con 0x7f3f300fdaa0 2024-09-13T22:00:53.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.159+0000 7f3f2dffb640 1 -- 172.21.15.159:0/3181108698 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f3f24031ac0 con 0x7f3f300fdaa0 2024-09-13T22:00:53.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.159+0000 7f3f2dffb640 1 --2- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3f20038740 0x7f3f2003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:53.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.159+0000 7f3f2dffb640 1 -- 172.21.15.159:0/3181108698 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3f2406c520 con 0x7f3f300fdaa0 2024-09-13T22:00:53.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.159+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f14005280 con 0x7f3f300fdaa0 2024-09-13T22:00:53.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.159+0000 7f3f2ffff640 1 --2- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3f20038740 0x7f3f2003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:53.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.160+0000 7f3f2ffff640 1 --2- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3f20038740 0x7f3f2003ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0098c0 tx=0x7f3f1c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:53.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.164+0000 7f3f2dffb640 1 -- 172.21.15.159:0/3181108698 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3f24035020 con 0x7f3f300fdaa0 2024-09-13T22:00:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.337+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 --> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi089:172.21.15.89=smithi089;smithi159:172.21.15.159=smithi159", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f14000ca0 con 0x7f3f20038740 2024-09-13T22:00:53.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.343+0000 7f3f2dffb640 1 -- 172.21.15.159:0/3181108698 <== mgr.14160 v2:172.21.15.89:6800/2476248652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3f14000ca0 con 0x7f3f20038740 2024-09-13T22:00:53.344 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mon update... 2024-09-13T22:00:53.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3f20038740 msgr2=0x7f3f2003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 --2- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3f20038740 0x7f3f2003ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0098c0 tx=0x7f3f1c006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 msgr2=0x7f3f30194cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 --2- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 0x7f3f30194cc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f24005610 tx=0x7f3f24005640 comp rx=0 tx=0).stop 2024-09-13T22:00:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 shutdown_connections 2024-09-13T22:00:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 --2- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3f20038740 0x7f3f2003ac00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 --2- 172.21.15.159:0/3181108698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f300fdaa0 0x7f3f30194cc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 >> 172.21.15.159:0/3181108698 conn(0x7f3f300f9610 msgr2=0x7f3f300f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 shutdown_connections 2024-09-13T22:00:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:53.345+0000 7f3f36c43640 1 -- 172.21.15.159:0/3181108698 wait complete. 2024-09-13T22:00:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:53 smithi089 ceph-mon[27921]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:53 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:53 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:54.061 DEBUG:teuthology.orchestra.run.smithi159:mon.smithi159> sudo journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi159.service 2024-09-13T22:00:54.064 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:00:54.064 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:00:54.419 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:00:54.465 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:00:54.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:54 smithi089 ceph-mon[27921]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi089:172.21.15.89=smithi089;smithi159:172.21.15.159=smithi159", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:00:54.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:54 smithi089 ceph-mon[27921]: Saving service mon spec with placement smithi089:172.21.15.89=smithi089;smithi159:172.21.15.159=smithi159;count:2 2024-09-13T22:00:55.480 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:55 smithi089 ceph-mon[27921]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:55.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.780+0000 7fc93a0d0640 1 -- 172.21.15.159:0/3289265439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 msgr2=0x7fc9340ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:55.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.780+0000 7fc93a0d0640 1 --2- 172.21.15.159:0/3289265439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 0x7fc9340ffbe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc924009880 tx=0x7fc92402a5d0 comp rx=0 tx=0).stop 2024-09-13T22:00:55.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.781+0000 7fc93a0d0640 1 -- 172.21.15.159:0/3289265439 shutdown_connections 2024-09-13T22:00:55.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.781+0000 7fc93a0d0640 1 --2- 172.21.15.159:0/3289265439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 0x7fc9340ffbe0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:55.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.781+0000 7fc93a0d0640 1 -- 172.21.15.159:0/3289265439 >> 172.21.15.159:0/3289265439 conn(0x7fc9340faf90 msgr2=0x7fc9340fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:55.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.781+0000 7fc93a0d0640 1 -- 172.21.15.159:0/3289265439 shutdown_connections 2024-09-13T22:00:55.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.781+0000 7fc93a0d0640 1 -- 172.21.15.159:0/3289265439 wait complete. 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.781+0000 7fc93a0d0640 1 Processor -- start 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.781+0000 7fc93a0d0640 1 -- start start 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.781+0000 7fc93a0d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 0x7fc934074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.781+0000 7fc93a0d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340746b0 con 0x7fc9340ff7e0 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc9337fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 0x7fc934074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc9337fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 0x7fc934074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:44156/0 (socket says 172.21.15.159:44156) 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc9337fe640 1 -- 172.21.15.159:0/1092905697 learned_addr learned my addr 172.21.15.159:0/1092905697 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc9337fe640 1 -- 172.21.15.159:0/1092905697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc924009560 con 0x7fc9340ff7e0 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc9337fe640 1 --2- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 0x7fc934074170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc924005610 tx=0x7fc924005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc9317fa640 1 -- 172.21.15.159:0/1092905697 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc924004b20 con 0x7fc9340ff7e0 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc9317fa640 1 -- 172.21.15.159:0/1092905697 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc924004c80 con 0x7fc9340ff7e0 2024-09-13T22:00:55.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9340728a0 con 0x7fc9340ff7e0 2024-09-13T22:00:55.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc9317fa640 1 -- 172.21.15.159:0/1092905697 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc924031a90 con 0x7fc9340ff7e0 2024-09-13T22:00:55.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.782+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc934072d40 con 0x7fc9340ff7e0 2024-09-13T22:00:55.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.783+0000 7fc9317fa640 1 -- 172.21.15.159:0/1092905697 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fc924031d10 con 0x7fc9340ff7e0 2024-09-13T22:00:55.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.783+0000 7fc9317fa640 1 --2- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc920038740 0x7fc92003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:55.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.783+0000 7fc9317fa640 1 -- 172.21.15.159:0/1092905697 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc92406c5a0 con 0x7fc9340ff7e0 2024-09-13T22:00:55.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.783+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc934105fd0 con 0x7fc9340ff7e0 2024-09-13T22:00:55.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.784+0000 7fc92affd640 1 --2- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc920038740 0x7fc92003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:55.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.784+0000 7fc92affd640 1 --2- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc920038740 0x7fc92003ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0098c0 tx=0x7fc91c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:55.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:55.789+0000 7fc9317fa640 1 -- 172.21.15.159:0/1092905697 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc924035020 con 0x7fc9340ff7e0 2024-09-13T22:00:56.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.015+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc93418e080 con 0x7fc9340ff7e0 2024-09-13T22:00:56.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.015+0000 7fc9317fa640 1 -- 172.21.15.159:0/1092905697 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc924035020 con 0x7fc9340ff7e0 2024-09-13T22:00:56.017 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:00:56.017 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:00:56.017 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:00:56.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.017+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc920038740 msgr2=0x7fc92003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:56.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.017+0000 7fc93a0d0640 1 --2- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc920038740 0x7fc92003ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0098c0 tx=0x7fc91c006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:56.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.017+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 msgr2=0x7fc934074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:56.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.017+0000 7fc93a0d0640 1 --2- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 0x7fc934074170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc924005610 tx=0x7fc924005640 comp rx=0 tx=0).stop 2024-09-13T22:00:56.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.018+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 shutdown_connections 2024-09-13T22:00:56.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.018+0000 7fc93a0d0640 1 --2- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc920038740 0x7fc92003ac00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:56.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.018+0000 7fc93a0d0640 1 --2- 172.21.15.159:0/1092905697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340ff7e0 0x7fc934074170 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:56.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.018+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 >> 172.21.15.159:0/1092905697 conn(0x7fc9340faf90 msgr2=0x7fc9340fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:56.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.018+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 shutdown_connections 2024-09-13T22:00:56.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:56.018+0000 7fc93a0d0640 1 -- 172.21.15.159:0/1092905697 wait complete. 2024-09-13T22:00:56.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:56 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/1092905697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:00:57.450 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:57 smithi089 ceph-mon[27921]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:57.605 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:00:57.606 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:00:57.803 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:00:57.848 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:00:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-13T22:00:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:58.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:00:58.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:58 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.178+0000 7f347bbb3640 1 -- 172.21.15.159:0/2764594176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 msgr2=0x7f34740feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.178+0000 7f347bbb3640 1 --2- 172.21.15.159:0/2764594176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 0x7f34740feae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3464009880 tx=0x7f346402a5d0 comp rx=0 tx=0).stop 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.178+0000 7f347bbb3640 1 -- 172.21.15.159:0/2764594176 shutdown_connections 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.178+0000 7f347bbb3640 1 --2- 172.21.15.159:0/2764594176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 0x7f34740feae0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.178+0000 7f347bbb3640 1 -- 172.21.15.159:0/2764594176 >> 172.21.15.159:0/2764594176 conn(0x7f34740f9e90 msgr2=0x7f34740fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.178+0000 7f347bbb3640 1 -- 172.21.15.159:0/2764594176 shutdown_connections 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.178+0000 7f347bbb3640 1 -- 172.21.15.159:0/2764594176 wait complete. 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.179+0000 7f347bbb3640 1 Processor -- start 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.179+0000 7f347bbb3640 1 -- start start 2024-09-13T22:00:59.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.179+0000 7f347bbb3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 0x7f3474194cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.179+0000 7f347bbb3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3474195210 con 0x7f34740fe6e0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.179+0000 7f347994f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 0x7f3474194cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.179+0000 7f347994f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 0x7f3474194cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:44174/0 (socket says 172.21.15.159:44174) 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.179+0000 7f347994f640 1 -- 172.21.15.159:0/3697502513 learned_addr learned my addr 172.21.15.159:0/3697502513 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.179+0000 7f347994f640 1 -- 172.21.15.159:0/3697502513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009560 con 0x7f34740fe6e0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.180+0000 7f347994f640 1 --2- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 0x7f3474194cd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3464005610 tx=0x7f3464005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.180+0000 7f346affd640 1 -- 172.21.15.159:0/3697502513 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3464004b20 con 0x7f34740fe6e0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.180+0000 7f346affd640 1 -- 172.21.15.159:0/3697502513 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3464004c80 con 0x7f34740fe6e0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.180+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3474195410 con 0x7f34740fe6e0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.180+0000 7f346affd640 1 -- 172.21.15.159:0/3697502513 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3464031a90 con 0x7f34740fe6e0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.180+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34741958b0 con 0x7f34740fe6e0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.181+0000 7f346affd640 1 -- 172.21.15.159:0/3697502513 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f3464031d50 con 0x7f34740fe6e0 2024-09-13T22:00:59.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.181+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34740feae0 con 0x7f34740fe6e0 2024-09-13T22:00:59.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.181+0000 7f346affd640 1 --2- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3460038740 0x7f346003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:00:59.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.181+0000 7f346affd640 1 -- 172.21.15.159:0/3697502513 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f346406c580 con 0x7f34740fe6e0 2024-09-13T22:00:59.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.181+0000 7f347914e640 1 --2- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3460038740 0x7f346003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:00:59.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.182+0000 7f347914e640 1 --2- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3460038740 0x7f346003ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f34700098c0 tx=0x7f3470006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:00:59.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.186+0000 7f346affd640 1 -- 172.21.15.159:0/3697502513 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f34640443b0 con 0x7f34740fe6e0 2024-09-13T22:00:59.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.412+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f347418e790 con 0x7f34740fe6e0 2024-09-13T22:00:59.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.413+0000 7f346affd640 1 -- 172.21.15.159:0/3697502513 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f3464035070 con 0x7f34740fe6e0 2024-09-13T22:00:59.414 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:00:59.415 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:00:59.415 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:00:59.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3460038740 msgr2=0x7f346003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:59.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 --2- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3460038740 0x7f346003ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f34700098c0 tx=0x7f3470006db0 comp rx=0 tx=0).stop 2024-09-13T22:00:59.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 msgr2=0x7f3474194cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:00:59.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 --2- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 0x7f3474194cd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3464005610 tx=0x7f3464005640 comp rx=0 tx=0).stop 2024-09-13T22:00:59.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 shutdown_connections 2024-09-13T22:00:59.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 --2- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f3460038740 0x7f346003ac00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:59.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 --2- 172.21.15.159:0/3697502513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34740fe6e0 0x7f3474194cd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:00:59.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 >> 172.21.15.159:0/3697502513 conn(0x7f34740f9e90 msgr2=0x7f3474068320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:00:59.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 shutdown_connections 2024-09-13T22:00:59.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:00:59.415+0000 7f347bbb3640 1 -- 172.21.15.159:0/3697502513 wait complete. 2024-09-13T22:00:59.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:59 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:00:59.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:59 smithi089 ceph-mon[27921]: Deploying daemon grafana.smithi089 on smithi089 2024-09-13T22:00:59.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:59 smithi089 ceph-mon[27921]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:00:59.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:00:59 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/3697502513' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:00.975 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:00.975 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:01.175 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:01.220 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:01.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:01 smithi089 ceph-mon[27921]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:02.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.581+0000 7fc8d1567640 1 -- 172.21.15.159:0/2602499578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 msgr2=0x7fc8cc102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:02.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.581+0000 7fc8d1567640 1 --2- 172.21.15.159:0/2602499578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 0x7fc8cc102650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009880 tx=0x7fc8bc02a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:02.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.581+0000 7fc8d1567640 1 -- 172.21.15.159:0/2602499578 shutdown_connections 2024-09-13T22:01:02.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.581+0000 7fc8d1567640 1 --2- 172.21.15.159:0/2602499578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 0x7fc8cc102650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:02.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.581+0000 7fc8d1567640 1 -- 172.21.15.159:0/2602499578 >> 172.21.15.159:0/2602499578 conn(0x7fc8cc0f9e80 msgr2=0x7fc8cc0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:02.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.581+0000 7fc8d1567640 1 -- 172.21.15.159:0/2602499578 shutdown_connections 2024-09-13T22:01:02.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.581+0000 7fc8d1567640 1 -- 172.21.15.159:0/2602499578 wait complete. 2024-09-13T22:01:02.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.582+0000 7fc8d1567640 1 Processor -- start 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.582+0000 7fc8d1567640 1 -- start start 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.582+0000 7fc8d1567640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 0x7fc8cc196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.582+0000 7fc8d1567640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc197460 con 0x7fc8cc100260 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.582+0000 7fc8caffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 0x7fc8cc196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.582+0000 7fc8caffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 0x7fc8cc196f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:51458/0 (socket says 172.21.15.159:51458) 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.582+0000 7fc8caffd640 1 -- 172.21.15.159:0/168910088 learned_addr learned my addr 172.21.15.159:0/168910088 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.582+0000 7fc8caffd640 1 -- 172.21.15.159:0/168910088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc009560 con 0x7fc8cc100260 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.583+0000 7fc8caffd640 1 --2- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 0x7fc8cc196f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009230 tx=0x7fc8bc0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.583+0000 7fc8c8ff9640 1 -- 172.21.15.159:0/168910088 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8bc004aa0 con 0x7fc8cc100260 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.583+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc197660 con 0x7fc8cc100260 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.583+0000 7fc8c8ff9640 1 -- 172.21.15.159:0/168910088 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8bc004c00 con 0x7fc8cc100260 2024-09-13T22:01:02.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.583+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc197b00 con 0x7fc8cc100260 2024-09-13T22:01:02.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.583+0000 7fc8c8ff9640 1 -- 172.21.15.159:0/168910088 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8bc031af0 con 0x7fc8cc100260 2024-09-13T22:01:02.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.584+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc100640 con 0x7fc8cc100260 2024-09-13T22:01:02.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.584+0000 7fc8c8ff9640 1 -- 172.21.15.159:0/168910088 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fc8bc031c50 con 0x7fc8cc100260 2024-09-13T22:01:02.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.584+0000 7fc8c8ff9640 1 --2- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc8b8038740 0x7fc8b803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:02.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.584+0000 7fc8c8ff9640 1 -- 172.21.15.159:0/168910088 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc8bc06c4c0 con 0x7fc8cc100260 2024-09-13T22:01:02.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.584+0000 7fc8c3fff640 1 --2- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc8b8038740 0x7fc8b803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:02.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.585+0000 7fc8c3fff640 1 --2- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc8b8038740 0x7fc8b803ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40098c0 tx=0x7fc8b4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:02.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.590+0000 7fc8c8ff9640 1 -- 172.21.15.159:0/168910088 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc8bc04d760 con 0x7fc8cc100260 2024-09-13T22:01:02.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.817+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc8cc1909e0 con 0x7fc8cc100260 2024-09-13T22:01:02.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.818+0000 7fc8c8ff9640 1 -- 172.21.15.159:0/168910088 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc8bc035090 con 0x7fc8cc100260 2024-09-13T22:01:02.820 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:02.820 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:02.820 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:02.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc8b8038740 msgr2=0x7fc8b803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:02.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 --2- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc8b8038740 0x7fc8b803ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40098c0 tx=0x7fc8b4006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:02.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 msgr2=0x7fc8cc196f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:02.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 --2- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 0x7fc8cc196f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009230 tx=0x7fc8bc0056e0 comp rx=0 tx=0).stop 2024-09-13T22:01:02.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 shutdown_connections 2024-09-13T22:01:02.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 --2- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fc8b8038740 0x7fc8b803ac00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:02.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 --2- 172.21.15.159:0/168910088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8cc100260 0x7fc8cc196f20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:02.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 >> 172.21.15.159:0/168910088 conn(0x7fc8cc0f9e80 msgr2=0x7fc8cc0fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:02.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 shutdown_connections 2024-09-13T22:01:02.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:02.820+0000 7fc8d1567640 1 -- 172.21.15.159:0/168910088 wait complete. 2024-09-13T22:01:03.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:03 smithi089 ceph-mon[27921]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:03.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:03 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:03.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:03 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/168910088' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:04.397 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:04.398 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:04.609 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:04.653 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:05.657 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:05 smithi089 ceph-mon[27921]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.968+0000 7f053e8d9640 1 -- 172.21.15.159:0/629451474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 msgr2=0x7f05380fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.968+0000 7f053e8d9640 1 --2- 172.21.15.159:0/629451474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 0x7f05380fead0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0528009880 tx=0x7f052802a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.968+0000 7f053e8d9640 1 -- 172.21.15.159:0/629451474 shutdown_connections 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.968+0000 7f053e8d9640 1 --2- 172.21.15.159:0/629451474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 0x7f05380fead0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.968+0000 7f053e8d9640 1 -- 172.21.15.159:0/629451474 >> 172.21.15.159:0/629451474 conn(0x7f05380f9e80 msgr2=0x7f05380fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.968+0000 7f053e8d9640 1 -- 172.21.15.159:0/629451474 shutdown_connections 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.968+0000 7f053e8d9640 1 -- 172.21.15.159:0/629451474 wait complete. 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.968+0000 7f053e8d9640 1 Processor -- start 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.969+0000 7f053e8d9640 1 -- start start 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.969+0000 7f053e8d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 0x7f0538194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.969+0000 7f053e8d9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0538195280 con 0x7f05380fe6d0 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.969+0000 7f0537fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 0x7f0538194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.969+0000 7f0537fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 0x7f0538194d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:51488/0 (socket says 172.21.15.159:51488) 2024-09-13T22:01:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.969+0000 7f0537fff640 1 -- 172.21.15.159:0/2281278881 learned_addr learned my addr 172.21.15.159:0/2281278881 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.969+0000 7f0537fff640 1 -- 172.21.15.159:0/2281278881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009560 con 0x7f05380fe6d0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.969+0000 7f0537fff640 1 --2- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 0x7f0538194d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0528009230 tx=0x7f05280056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.969+0000 7f0535ffb640 1 -- 172.21.15.159:0/2281278881 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0528004aa0 con 0x7f05380fe6d0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.970+0000 7f0535ffb640 1 -- 172.21.15.159:0/2281278881 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0528004c00 con 0x7f05380fe6d0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.970+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0538195480 con 0x7f05380fe6d0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.970+0000 7f0535ffb640 1 -- 172.21.15.159:0/2281278881 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0528031a60 con 0x7f05380fe6d0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.970+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0538195920 con 0x7f05380fe6d0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.970+0000 7f0535ffb640 1 -- 172.21.15.159:0/2281278881 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f0528031bc0 con 0x7f05380fe6d0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.970+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05380fead0 con 0x7f05380fe6d0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.971+0000 7f0535ffb640 1 --2- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f0524038790 0x7f052403ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.971+0000 7f0535ffb640 1 -- 172.21.15.159:0/2281278881 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f052806c460 con 0x7f05380fe6d0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.971+0000 7f052ffff640 1 --2- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f0524038790 0x7f052403ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.971+0000 7f052ffff640 1 --2- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f0524038790 0x7f052403ac50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f05200098c0 tx=0x7f0520006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:05.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:05.975+0000 7f0535ffb640 1 -- 172.21.15.159:0/2281278881 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f052804d7c0 con 0x7f05380fe6d0 2024-09-13T22:01:06.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.199+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f053802c3e0 con 0x7f05380fe6d0 2024-09-13T22:01:06.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.199+0000 7f0535ffb640 1 -- 172.21.15.159:0/2281278881 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f0528035020 con 0x7f05380fe6d0 2024-09-13T22:01:06.201 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:06.201 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:06.202 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:06.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.201+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f0524038790 msgr2=0x7f052403ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:06.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.201+0000 7f053e8d9640 1 --2- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f0524038790 0x7f052403ac50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f05200098c0 tx=0x7f0520006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:06.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.201+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 msgr2=0x7f0538194d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:06.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.201+0000 7f053e8d9640 1 --2- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 0x7f0538194d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0528009230 tx=0x7f05280056e0 comp rx=0 tx=0).stop 2024-09-13T22:01:06.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.201+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 shutdown_connections 2024-09-13T22:01:06.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.201+0000 7f053e8d9640 1 --2- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f0524038790 0x7f052403ac50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:06.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.201+0000 7f053e8d9640 1 --2- 172.21.15.159:0/2281278881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05380fe6d0 0x7f0538194d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:06.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.201+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 >> 172.21.15.159:0/2281278881 conn(0x7f05380f9e80 msgr2=0x7f0538067dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:06.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.202+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 shutdown_connections 2024-09-13T22:01:06.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:06.202+0000 7f053e8d9640 1 -- 172.21.15.159:0/2281278881 wait complete. 2024-09-13T22:01:06.676 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:06 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/2281278881' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:07.665 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:07 smithi089 ceph-mon[27921]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:07.773 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:07.773 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:07.972 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:08.017 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:09.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.397+0000 7fd0affff640 1 -- 172.21.15.159:0/2085476166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0a80317f0 con 0x7fd0b80fe060 2024-09-13T22:01:09.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.397+0000 7fd0bf596640 1 -- 172.21.15.159:0/2085476166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 msgr2=0x7fd0b80fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:09.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.397+0000 7fd0bf596640 1 --2- 172.21.15.159:0/2085476166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 0x7fd0b80fe460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009880 tx=0x7fd0a802a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:09.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.397+0000 7fd0bf596640 1 -- 172.21.15.159:0/2085476166 shutdown_connections 2024-09-13T22:01:09.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.397+0000 7fd0bf596640 1 --2- 172.21.15.159:0/2085476166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 0x7fd0b80fe460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:09.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.397+0000 7fd0bf596640 1 -- 172.21.15.159:0/2085476166 >> 172.21.15.159:0/2085476166 conn(0x7fd0b80f9e90 msgr2=0x7fd0b80fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:09.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.398+0000 7fd0bf596640 1 -- 172.21.15.159:0/2085476166 shutdown_connections 2024-09-13T22:01:09.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.398+0000 7fd0bf596640 1 -- 172.21.15.159:0/2085476166 wait complete. 2024-09-13T22:01:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.398+0000 7fd0bf596640 1 Processor -- start 2024-09-13T22:01:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.398+0000 7fd0bf596640 1 -- start start 2024-09-13T22:01:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.398+0000 7fd0bf596640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 0x7fd0b8196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.398+0000 7fd0bf596640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b81973f0 con 0x7fd0b80fe060 2024-09-13T22:01:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.398+0000 7fd0bd332640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 0x7fd0b8196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.398+0000 7fd0bd332640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 0x7fd0b8196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:51508/0 (socket says 172.21.15.159:51508) 2024-09-13T22:01:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.398+0000 7fd0bd332640 1 -- 172.21.15.159:0/2255804262 learned_addr learned my addr 172.21.15.159:0/2255804262 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.399+0000 7fd0bd332640 1 -- 172.21.15.159:0/2255804262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8009560 con 0x7fd0b80fe060 2024-09-13T22:01:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.399+0000 7fd0bd332640 1 --2- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 0x7fd0b8196eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8006010 tx=0x7fd0a8005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.399+0000 7fd0ae7fc640 1 -- 172.21.15.159:0/2255804262 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0a8004aa0 con 0x7fd0b80fe060 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.399+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b81975f0 con 0x7fd0b80fe060 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.399+0000 7fd0ae7fc640 1 -- 172.21.15.159:0/2255804262 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0a8004c00 con 0x7fd0b80fe060 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.399+0000 7fd0ae7fc640 1 -- 172.21.15.159:0/2255804262 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0a8031a80 con 0x7fd0b80fe060 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.399+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b8197a90 con 0x7fd0b80fe060 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.400+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b80fe460 con 0x7fd0b80fe060 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.400+0000 7fd0ae7fc640 1 -- 172.21.15.159:0/2255804262 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fd0a8031d40 con 0x7fd0b80fe060 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.400+0000 7fd0ae7fc640 1 --2- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd0a4038740 0x7fd0a403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.400+0000 7fd0ae7fc640 1 -- 172.21.15.159:0/2255804262 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd0a806c500 con 0x7fd0b80fe060 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.401+0000 7fd0bcb31640 1 --2- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd0a4038740 0x7fd0a403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.401+0000 7fd0bcb31640 1 --2- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd0a4038740 0x7fd0a403ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40098c0 tx=0x7fd0b4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.405+0000 7fd0ae7fc640 1 -- 172.21.15.159:0/2255804262 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0a804d9a0 con 0x7fd0b80fe060 2024-09-13T22:01:09.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.631+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd0b802c3e0 con 0x7fd0b80fe060 2024-09-13T22:01:09.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.631+0000 7fd0ae7fc640 1 -- 172.21.15.159:0/2255804262 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd0a8035070 con 0x7fd0b80fe060 2024-09-13T22:01:09.633 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:09.633 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:09.633 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:09.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd0a4038740 msgr2=0x7fd0a403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 --2- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd0a4038740 0x7fd0a403ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40098c0 tx=0x7fd0b4006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 msgr2=0x7fd0b8196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 --2- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 0x7fd0b8196eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8006010 tx=0x7fd0a8005630 comp rx=0 tx=0).stop 2024-09-13T22:01:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 shutdown_connections 2024-09-13T22:01:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 --2- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fd0a4038740 0x7fd0a403ac00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 --2- 172.21.15.159:0/2255804262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80fe060 0x7fd0b8196eb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 >> 172.21.15.159:0/2255804262 conn(0x7fd0b80f9e90 msgr2=0x7fd0b80fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 shutdown_connections 2024-09-13T22:01:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:09.633+0000 7fd0bf596640 1 -- 172.21.15.159:0/2255804262 wait complete. 2024-09-13T22:01:09.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:09 smithi089 ceph-mon[27921]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:09.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:09 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:09.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:09 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:09.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:09 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:09.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:09 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:09.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:09 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:09.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:09 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:09.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:09 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:09.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:09 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:10.943 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:10 smithi089 ceph-mon[27921]: Deploying daemon prometheus.smithi089 on smithi089 2024-09-13T22:01:10.944 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:10 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/2255804262' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:11.218 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:11.218 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:11.418 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:11.463 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:11.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:11 smithi089 ceph-mon[27921]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:12.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.924+0000 7f552171e640 1 -- 172.21.15.159:0/1129311480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 msgr2=0x7f551c0feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.924+0000 7f552171e640 1 --2- 172.21.15.159:0/1129311480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 0x7f551c0feae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f550c009880 tx=0x7f550c02a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.924+0000 7f552171e640 1 -- 172.21.15.159:0/1129311480 shutdown_connections 2024-09-13T22:01:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.924+0000 7f552171e640 1 --2- 172.21.15.159:0/1129311480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 0x7f551c0feae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.924+0000 7f552171e640 1 -- 172.21.15.159:0/1129311480 >> 172.21.15.159:0/1129311480 conn(0x7f551c0f9e90 msgr2=0x7f551c0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.924+0000 7f552171e640 1 -- 172.21.15.159:0/1129311480 shutdown_connections 2024-09-13T22:01:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.924+0000 7f552171e640 1 -- 172.21.15.159:0/1129311480 wait complete. 2024-09-13T22:01:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.924+0000 7f552171e640 1 Processor -- start 2024-09-13T22:01:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.924+0000 7f552171e640 1 -- start start 2024-09-13T22:01:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f552171e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 0x7f551c0fbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f552171e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0fc240 con 0x7f551c0fe6e0 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f551affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 0x7f551c0fbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f551affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 0x7f551c0fbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:50654/0 (socket says 172.21.15.159:50654) 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f551affd640 1 -- 172.21.15.159:0/2535844840 learned_addr learned my addr 172.21.15.159:0/2535844840 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f551affd640 1 -- 172.21.15.159:0/2535844840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c009560 con 0x7f551c0fe6e0 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f551affd640 1 --2- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 0x7f551c0fbd00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f550c005610 tx=0x7f550c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f5503fff640 1 -- 172.21.15.159:0/2535844840 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f550c004b20 con 0x7f551c0fe6e0 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c0fa430 con 0x7f551c0fe6e0 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f5503fff640 1 -- 172.21.15.159:0/2535844840 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f550c004c80 con 0x7f551c0fe6e0 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f5503fff640 1 -- 172.21.15.159:0/2535844840 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f550c031a90 con 0x7f551c0fe6e0 2024-09-13T22:01:12.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.925+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c0fa8d0 con 0x7f551c0fe6e0 2024-09-13T22:01:12.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.926+0000 7f5503fff640 1 -- 172.21.15.159:0/2535844840 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f550c031d50 con 0x7f551c0fe6e0 2024-09-13T22:01:12.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.927+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c104ed0 con 0x7f551c0fe6e0 2024-09-13T22:01:12.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.927+0000 7f5503fff640 1 --2- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f5504038740 0x7f550403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:12.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.927+0000 7f5503fff640 1 -- 172.21.15.159:0/2535844840 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f550c06c4c0 con 0x7f551c0fe6e0 2024-09-13T22:01:12.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.927+0000 7f551a7fc640 1 --2- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f5504038740 0x7f550403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:12.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.927+0000 7f551a7fc640 1 --2- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f5504038740 0x7f550403ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f55100098c0 tx=0x7f5510006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:12.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:12.931+0000 7f5503fff640 1 -- 172.21.15.159:0/2535844840 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f550c04dce0 con 0x7f551c0fe6e0 2024-09-13T22:01:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.155+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f551c0feae0 con 0x7f551c0fe6e0 2024-09-13T22:01:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.155+0000 7f5503fff640 1 -- 172.21.15.159:0/2535844840 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f550c035070 con 0x7f551c0fe6e0 2024-09-13T22:01:13.157 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:13.157 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:13.157 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f5504038740 msgr2=0x7f550403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 --2- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f5504038740 0x7f550403ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f55100098c0 tx=0x7f5510006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 msgr2=0x7f551c0fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 --2- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 0x7f551c0fbd00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f550c005610 tx=0x7f550c005640 comp rx=0 tx=0).stop 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 shutdown_connections 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 --2- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f5504038740 0x7f550403ac00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 --2- 172.21.15.159:0/2535844840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551c0fe6e0 0x7f551c0fbd00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 >> 172.21.15.159:0/2535844840 conn(0x7f551c0f9e90 msgr2=0x7f551c0685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 shutdown_connections 2024-09-13T22:01:13.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:13.157+0000 7f552171e640 1 -- 172.21.15.159:0/2535844840 wait complete. 2024-09-13T22:01:13.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:13 smithi089 ceph-mon[27921]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:13.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:13 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:13.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:13 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/2535844840' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:14.680 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:14.680 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:14.880 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:14.923 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:15.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:15 smithi089 ceph-mon[27921]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:16.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.230+0000 7f218447e640 1 -- 172.21.15.159:0/2749741656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 msgr2=0x7f217c0fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:16.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.230+0000 7f218447e640 1 --2- 172.21.15.159:0/2749741656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 0x7f217c0fead0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2174009880 tx=0x7f217402a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:16.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.230+0000 7f218447e640 1 -- 172.21.15.159:0/2749741656 shutdown_connections 2024-09-13T22:01:16.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.230+0000 7f218447e640 1 --2- 172.21.15.159:0/2749741656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 0x7f217c0fead0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:16.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.230+0000 7f218447e640 1 -- 172.21.15.159:0/2749741656 >> 172.21.15.159:0/2749741656 conn(0x7f217c0f9e80 msgr2=0x7f217c0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:16.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.230+0000 7f218447e640 1 -- 172.21.15.159:0/2749741656 shutdown_connections 2024-09-13T22:01:16.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.230+0000 7f218447e640 1 -- 172.21.15.159:0/2749741656 wait complete. 2024-09-13T22:01:16.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.231+0000 7f218447e640 1 Processor -- start 2024-09-13T22:01:16.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.231+0000 7f218447e640 1 -- start start 2024-09-13T22:01:16.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.231+0000 7f218447e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 0x7f217c068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:16.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.231+0000 7f218447e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c068660 con 0x7f217c0fe6d0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.231+0000 7f218221a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 0x7f217c068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.231+0000 7f218221a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 0x7f217c068120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:50670/0 (socket says 172.21.15.159:50670) 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.231+0000 7f218221a640 1 -- 172.21.15.159:0/3582364059 learned_addr learned my addr 172.21.15.159:0/3582364059 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.232+0000 7f218221a640 1 -- 172.21.15.159:0/3582364059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174009560 con 0x7f217c0fe6d0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.232+0000 7f218221a640 1 --2- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 0x7f217c068120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2174009230 tx=0x7f21740056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.232+0000 7f216f7fe640 1 -- 172.21.15.159:0/3582364059 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2174004950 con 0x7f217c0fe6d0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.232+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c197ac0 con 0x7f217c0fe6d0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.232+0000 7f216f7fe640 1 -- 172.21.15.159:0/3582364059 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21740035f0 con 0x7f217c0fe6d0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.232+0000 7f216f7fe640 1 -- 172.21.15.159:0/3582364059 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2174031820 con 0x7f217c0fe6d0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.232+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c197f60 con 0x7f217c0fe6d0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.233+0000 7f216f7fe640 1 -- 172.21.15.159:0/3582364059 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f2174003c40 con 0x7f217c0fe6d0 2024-09-13T22:01:16.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.233+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c0fead0 con 0x7f217c0fe6d0 2024-09-13T22:01:16.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.233+0000 7f216f7fe640 1 --2- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f2168038790 0x7f216803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:16.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.233+0000 7f216f7fe640 1 -- 172.21.15.159:0/3582364059 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f217406c230 con 0x7f217c0fe6d0 2024-09-13T22:01:16.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.234+0000 7f2181a19640 1 --2- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f2168038790 0x7f216803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:16.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.234+0000 7f2181a19640 1 --2- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f2168038790 0x7f216803ac50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f217000ad30 tx=0x7f21700093f0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:16.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.238+0000 7f216f7fe640 1 -- 172.21.15.159:0/3582364059 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f217404d570 con 0x7f217c0fe6d0 2024-09-13T22:01:16.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.468+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f217c18d500 con 0x7f217c0fe6d0 2024-09-13T22:01:16.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.469+0000 7f216f7fe640 1 -- 172.21.15.159:0/3582364059 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2174035020 con 0x7f217c0fe6d0 2024-09-13T22:01:16.470 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:16.471 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:16.471 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:16.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f2168038790 msgr2=0x7f216803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:16.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 --2- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f2168038790 0x7f216803ac50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f217000ad30 tx=0x7f21700093f0 comp rx=0 tx=0).stop 2024-09-13T22:01:16.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 msgr2=0x7f217c068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 --2- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 0x7f217c068120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2174009230 tx=0x7f21740056e0 comp rx=0 tx=0).stop 2024-09-13T22:01:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 shutdown_connections 2024-09-13T22:01:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 --2- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f2168038790 0x7f216803ac50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 --2- 172.21.15.159:0/3582364059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f217c0fe6d0 0x7f217c068120 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 >> 172.21.15.159:0/3582364059 conn(0x7f217c0f9e80 msgr2=0x7f217c0fa900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 shutdown_connections 2024-09-13T22:01:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:16.472+0000 7f218447e640 1 -- 172.21.15.159:0/3582364059 wait complete. 2024-09-13T22:01:17.733 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:17 smithi089 ceph-mon[27921]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:17.734 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:17 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/3582364059' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:17.993 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:17.993 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:18.193 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:18.237 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:19.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.598+0000 7fa9929d5640 1 -- 172.21.15.159:0/3759905356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 msgr2=0x7fa98c0fe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:19.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.598+0000 7fa9929d5640 1 --2- 172.21.15.159:0/3759905356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 0x7fa98c0fe270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009880 tx=0x7fa97c02a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:19.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.598+0000 7fa9929d5640 1 -- 172.21.15.159:0/3759905356 shutdown_connections 2024-09-13T22:01:19.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.598+0000 7fa9929d5640 1 --2- 172.21.15.159:0/3759905356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 0x7fa98c0fe270 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:19.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.598+0000 7fa9929d5640 1 -- 172.21.15.159:0/3759905356 >> 172.21.15.159:0/3759905356 conn(0x7fa98c0f9640 msgr2=0x7fa98c0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:19.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.598+0000 7fa9929d5640 1 -- 172.21.15.159:0/3759905356 shutdown_connections 2024-09-13T22:01:19.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.598+0000 7fa9929d5640 1 -- 172.21.15.159:0/3759905356 wait complete. 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.598+0000 7fa9929d5640 1 Processor -- start 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.598+0000 7fa9929d5640 1 -- start start 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.599+0000 7fa9929d5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 0x7fa98c194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.599+0000 7fa9929d5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c195200 con 0x7fa98c0fde70 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.599+0000 7fa98bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 0x7fa98c194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.599+0000 7fa98bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 0x7fa98c194cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:50694/0 (socket says 172.21.15.159:50694) 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.599+0000 7fa98bfff640 1 -- 172.21.15.159:0/1260356054 learned_addr learned my addr 172.21.15.159:0/1260356054 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.599+0000 7fa98bfff640 1 -- 172.21.15.159:0/1260356054 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c009560 con 0x7fa98c0fde70 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.599+0000 7fa98bfff640 1 --2- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 0x7fa98c194cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa97c006010 tx=0x7fa97c005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.600+0000 7fa9897fa640 1 -- 172.21.15.159:0/1260356054 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa97c004aa0 con 0x7fa98c0fde70 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.600+0000 7fa9897fa640 1 -- 172.21.15.159:0/1260356054 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa97c004c00 con 0x7fa98c0fde70 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.600+0000 7fa9897fa640 1 -- 172.21.15.159:0/1260356054 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa97c031a80 con 0x7fa98c0fde70 2024-09-13T22:01:19.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.600+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c195400 con 0x7fa98c0fde70 2024-09-13T22:01:19.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.600+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c1958a0 con 0x7fa98c0fde70 2024-09-13T22:01:19.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.600+0000 7fa9897fa640 1 -- 172.21.15.159:0/1260356054 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 14) v1 ==== 45626+0+0 (secure 0 0 0) 0x7fa97c031d40 con 0x7fa98c0fde70 2024-09-13T22:01:19.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.600+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c0fe270 con 0x7fa98c0fde70 2024-09-13T22:01:19.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.601+0000 7fa9897fa640 1 --2- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fa974038790 0x7fa97403ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:19.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.601+0000 7fa9897fa640 1 -- 172.21.15.159:0/1260356054 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa97c06c640 con 0x7fa98c0fde70 2024-09-13T22:01:19.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.601+0000 7fa98b7fe640 1 -- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fa974038790 msgr2=0x7fa97403ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/2476248652 2024-09-13T22:01:19.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.601+0000 7fa98b7fe640 1 --2- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fa974038790 0x7fa97403ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:01:19.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.605+0000 7fa9897fa640 1 -- 172.21.15.159:0/1260356054 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa97c04d9a0 con 0x7fa98c0fde70 2024-09-13T22:01:19.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:19 smithi089 ceph-mon[27921]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:19.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:19 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:19.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:19 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:19.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:19 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:19.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:19 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T22:01:19.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.802+0000 7fa98b7fe640 1 -- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fa974038790 msgr2=0x7fa97403ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/2476248652 2024-09-13T22:01:19.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.802+0000 7fa98b7fe640 1 --2- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fa974038790 0x7fa97403ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:01:19.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.836+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa98c18e520 con 0x7fa98c0fde70 2024-09-13T22:01:19.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.837+0000 7fa9897fa640 1 -- 172.21.15.159:0/1260356054 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa97c035070 con 0x7fa98c0fde70 2024-09-13T22:01:19.838 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:19.838 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:19.838 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:19.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fa974038790 msgr2=0x7fa97403ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:01:19.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 --2- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fa974038790 0x7fa97403ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:19.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 msgr2=0x7fa98c194cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:19.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 --2- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 0x7fa98c194cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa97c006010 tx=0x7fa97c005630 comp rx=0 tx=0).stop 2024-09-13T22:01:19.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 shutdown_connections 2024-09-13T22:01:19.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 --2- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7fa974038790 0x7fa97403ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:19.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 --2- 172.21.15.159:0/1260356054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa98c0fde70 0x7fa98c194cc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:19.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 >> 172.21.15.159:0/1260356054 conn(0x7fa98c0f9640 msgr2=0x7fa98c18b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:19.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 shutdown_connections 2024-09-13T22:01:19.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:19.839+0000 7fa9929d5640 1 -- 172.21.15.159:0/1260356054 wait complete. 2024-09-13T22:01:20.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:20 smithi089 ceph-mon[27921]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T22:01:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:20 smithi089 ceph-mon[27921]: mgrmap e14: smithi089.naneiw(active, since 57s) 2024-09-13T22:01:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:20 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/1260356054' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:21.422 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:21.423 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:21.622 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:21.672 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:22.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 -- 172.21.15.159:0/3625609154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 msgr2=0x7f35a00feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:22.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 --2- 172.21.15.159:0/3625609154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 0x7f35a00feae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f359c009880 tx=0x7f359c02a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:22.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 -- 172.21.15.159:0/3625609154 shutdown_connections 2024-09-13T22:01:22.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 --2- 172.21.15.159:0/3625609154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 0x7f35a00feae0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:22.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 -- 172.21.15.159:0/3625609154 >> 172.21.15.159:0/3625609154 conn(0x7f35a00f9e90 msgr2=0x7f35a00fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:22.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 -- 172.21.15.159:0/3625609154 shutdown_connections 2024-09-13T22:01:22.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 -- 172.21.15.159:0/3625609154 wait complete. 2024-09-13T22:01:22.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 Processor -- start 2024-09-13T22:01:22.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 -- start start 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 0x7f35a0194cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.943+0000 7f35a7923640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0195210 con 0x7f35a00fe6e0 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35a56bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 0x7f35a0194cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35a56bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 0x7f35a0194cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:37570/0 (socket says 172.21.15.159:37570) 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35a56bf640 1 -- 172.21.15.159:0/2361305360 learned_addr learned my addr 172.21.15.159:0/2361305360 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35a56bf640 1 -- 172.21.15.159:0/2361305360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c009560 con 0x7f35a00fe6e0 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35a56bf640 1 --2- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 0x7f35a0194cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f359c005610 tx=0x7f359c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35967fc640 1 -- 172.21.15.159:0/2361305360 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f359c004b20 con 0x7f35a00fe6e0 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35967fc640 1 -- 172.21.15.159:0/2361305360 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f359c004c80 con 0x7f35a00fe6e0 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a0195410 con 0x7f35a00fe6e0 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35967fc640 1 -- 172.21.15.159:0/2361305360 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f359c031a90 con 0x7f35a00fe6e0 2024-09-13T22:01:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.944+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a01958b0 con 0x7f35a00fe6e0 2024-09-13T22:01:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.945+0000 7f35967fc640 1 -- 172.21.15.159:0/2361305360 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 14) v1 ==== 45626+0+0 (secure 0 0 0) 0x7f359c031d10 con 0x7f35a00fe6e0 2024-09-13T22:01:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.945+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a00feae0 con 0x7f35a00fe6e0 2024-09-13T22:01:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.945+0000 7f35967fc640 1 --2- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f358c038790 0x7f358c03ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.945+0000 7f35967fc640 1 -- 172.21.15.159:0/2361305360 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f359c06c6e0 con 0x7f35a00fe6e0 2024-09-13T22:01:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.945+0000 7f35a4ebe640 1 -- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f358c038790 msgr2=0x7f358c03ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/2476248652 2024-09-13T22:01:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.945+0000 7f35a4ebe640 1 --2- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f358c038790 0x7f358c03ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:01:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:22.950+0000 7f35967fc640 1 -- 172.21.15.159:0/2361305360 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f359c04d350 con 0x7f35a00fe6e0 2024-09-13T22:01:23.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.146+0000 7f35a4ebe640 1 -- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f358c038790 msgr2=0x7f358c03ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/2476248652 2024-09-13T22:01:23.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.146+0000 7f35a4ebe640 1 --2- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f358c038790 0x7f358c03ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:01:23.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.174+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f35a018e790 con 0x7f35a00fe6e0 2024-09-13T22:01:23.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.175+0000 7f35967fc640 1 -- 172.21.15.159:0/2361305360 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f359c035030 con 0x7f35a00fe6e0 2024-09-13T22:01:23.177 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:23.177 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:23.177 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:23.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.176+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f358c038790 msgr2=0x7f358c03ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:01:23.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.176+0000 7f35a7923640 1 --2- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f358c038790 0x7f358c03ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:23.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.176+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 msgr2=0x7f35a0194cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:23.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.176+0000 7f35a7923640 1 --2- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 0x7f35a0194cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f359c005610 tx=0x7f359c005640 comp rx=0 tx=0).stop 2024-09-13T22:01:23.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.177+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 shutdown_connections 2024-09-13T22:01:23.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.177+0000 7f35a7923640 1 --2- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:6800/2476248652,v1:172.21.15.89:6801/2476248652] conn(0x7f358c038790 0x7f358c03ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:23.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.177+0000 7f35a7923640 1 --2- 172.21.15.159:0/2361305360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35a00fe6e0 0x7f35a0194cd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:23.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.177+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 >> 172.21.15.159:0/2361305360 conn(0x7f35a00f9e90 msgr2=0x7f35a0068320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:23.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.177+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 shutdown_connections 2024-09-13T22:01:23.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:23.177+0000 7f35a7923640 1 -- 172.21.15.159:0/2361305360 wait complete. 2024-09-13T22:01:23.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:23 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/2361305360' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:24.461 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: Active manager daemon smithi089.naneiw restarted 2024-09-13T22:01:24.461 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: Activating manager daemon smithi089.naneiw 2024-09-13T22:01:24.461 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:01:24.461 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: mgrmap e15: smithi089.naneiw(active, starting, since 0.00318196s) 2024-09-13T22:01:24.461 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:01:24.461 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T22:01:24.462 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:01:24.462 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:01:24.462 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:01:24.462 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: Manager daemon smithi089.naneiw is now available 2024-09-13T22:01:24.462 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:01:24.462 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:24.462 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:24.462 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:01:24.462 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/trash_purge_schedule"}]: dispatch 2024-09-13T22:01:24.716 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:24.716 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:24.907 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:24.953 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:26.048 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:25 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:25 smithi089 ceph-mon[27921]: mgrmap e16: smithi089.naneiw(active, since 1.00526s) 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:25 smithi089 ceph-mon[27921]: [13/Sep/2024:22:01:25] ENGINE Bus STARTING 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:25 smithi089 ceph-mon[27921]: [13/Sep/2024:22:01:25] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:25 smithi089 ceph-mon[27921]: [13/Sep/2024:22:01:25] ENGINE Error in HTTPServer.serve 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:01:26.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:01:26.050 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:25 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:26.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.491+0000 7f54296a3640 1 -- 172.21.15.159:0/2635204365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 msgr2=0x7f54240ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:26.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.491+0000 7f54296a3640 1 --2- 172.21.15.159:0/2635204365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 0x7f54240ffbe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5414009880 tx=0x7f541402a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:26.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.491+0000 7f54296a3640 1 -- 172.21.15.159:0/2635204365 shutdown_connections 2024-09-13T22:01:26.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.491+0000 7f54296a3640 1 --2- 172.21.15.159:0/2635204365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 0x7f54240ffbe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:26.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.491+0000 7f54296a3640 1 -- 172.21.15.159:0/2635204365 >> 172.21.15.159:0/2635204365 conn(0x7f54240faf90 msgr2=0x7f54240fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:26.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.491+0000 7f54296a3640 1 -- 172.21.15.159:0/2635204365 shutdown_connections 2024-09-13T22:01:26.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.491+0000 7f54296a3640 1 -- 172.21.15.159:0/2635204365 wait complete. 2024-09-13T22:01:26.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.492+0000 7f54296a3640 1 Processor -- start 2024-09-13T22:01:26.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.492+0000 7f54296a3640 1 -- start start 2024-09-13T22:01:26.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.492+0000 7f54296a3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 0x7f5424194d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:26.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.492+0000 7f54296a3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424195290 con 0x7f54240ff7e0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.492+0000 7f5422ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 0x7f5424194d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.492+0000 7f5422ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 0x7f5424194d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:37592/0 (socket says 172.21.15.159:37592) 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.492+0000 7f5422ffd640 1 -- 172.21.15.159:0/2775610536 learned_addr learned my addr 172.21.15.159:0/2775610536 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.493+0000 7f5422ffd640 1 -- 172.21.15.159:0/2775610536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5414009560 con 0x7f54240ff7e0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.493+0000 7f5422ffd640 1 --2- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 0x7f5424194d50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5414031440 tx=0x7f54140056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.493+0000 7f540bfff640 1 -- 172.21.15.159:0/2775610536 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5414004a20 con 0x7f54240ff7e0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.493+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5424195490 con 0x7f54240ff7e0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.493+0000 7f540bfff640 1 -- 172.21.15.159:0/2775610536 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5414004b80 con 0x7f54240ff7e0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.493+0000 7f540bfff640 1 -- 172.21.15.159:0/2775610536 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5414031a80 con 0x7f54240ff7e0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.493+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5424195930 con 0x7f54240ff7e0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.494+0000 7f540bfff640 1 -- 172.21.15.159:0/2775610536 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 16) v1 ==== 45477+0+0 (secure 0 0 0) 0x7f5414031cc0 con 0x7f54240ff7e0 2024-09-13T22:01:26.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.494+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54240ffbe0 con 0x7f54240ff7e0 2024-09-13T22:01:26.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.494+0000 7f540bfff640 1 --2- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f540c0385d0 0x7f540c03aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:26.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.494+0000 7f540bfff640 1 -- 172.21.15.159:0/2775610536 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f541406c460 con 0x7f54240ff7e0 2024-09-13T22:01:26.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.495+0000 7f54227fc640 1 --2- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f540c0385d0 0x7f540c03aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:26.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.495+0000 7f54227fc640 1 --2- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f540c0385d0 0x7f540c03aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f54180098c0 tx=0x7f5418006db0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:26.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.499+0000 7f540bfff640 1 -- 172.21.15.159:0/2775610536 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f54140035f0 con 0x7f54240ff7e0 2024-09-13T22:01:26.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.743+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f542402c3e0 con 0x7f54240ff7e0 2024-09-13T22:01:26.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.744+0000 7f540bfff640 1 -- 172.21.15.159:0/2775610536 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f5414035020 con 0x7f54240ff7e0 2024-09-13T22:01:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:26.747 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:26.747 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:26.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f540c0385d0 msgr2=0x7f540c03aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:26.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 --2- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f540c0385d0 0x7f540c03aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f54180098c0 tx=0x7f5418006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:26.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 msgr2=0x7f5424194d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:26.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 --2- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 0x7f5424194d50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5414031440 tx=0x7f54140056e0 comp rx=0 tx=0).stop 2024-09-13T22:01:26.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 shutdown_connections 2024-09-13T22:01:26.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 --2- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f540c0385d0 0x7f540c03aa90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:26.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 --2- 172.21.15.159:0/2775610536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54240ff7e0 0x7f5424194d50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:26.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 >> 172.21.15.159:0/2775610536 conn(0x7f54240faf90 msgr2=0x7f54240fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:26.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 shutdown_connections 2024-09-13T22:01:26.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:26.746+0000 7f54296a3640 1 -- 172.21.15.159:0/2775610536 wait complete. 2024-09-13T22:01:27.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:27 smithi089 ceph-mon[27921]: [13/Sep/2024:22:01:25] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T22:01:27.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:27 smithi089 ceph-mon[27921]: [13/Sep/2024:22:01:25] ENGINE Bus STARTED 2024-09-13T22:01:27.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:27 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:27.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:27 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/2775610536' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:27.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:27 smithi089 ceph-mon[27921]: mgrmap e17: smithi089.naneiw(active, since 2s) 2024-09-13T22:01:29.351 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:29.351 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:29.598 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:29.644 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:01:29.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:01:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:01:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:01:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:01:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:30 smithi089 ceph-mon[27921]: Deploying daemon ceph-exporter.smithi159 on smithi159 2024-09-13T22:01:31.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.192+0000 7f7c74b60640 1 -- 172.21.15.159:0/2126405186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 msgr2=0x7f7c70104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:31.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.192+0000 7f7c74b60640 1 --2- 172.21.15.159:0/2126405186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 0x7f7c70104ae0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009880 tx=0x7f7c6002a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:31.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.192+0000 7f7c74b60640 1 -- 172.21.15.159:0/2126405186 shutdown_connections 2024-09-13T22:01:31.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.192+0000 7f7c74b60640 1 --2- 172.21.15.159:0/2126405186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 0x7f7c70104ae0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:31.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.192+0000 7f7c74b60640 1 -- 172.21.15.159:0/2126405186 >> 172.21.15.159:0/2126405186 conn(0x7f7c700fa440 msgr2=0x7f7c700fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:31.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.192+0000 7f7c74b60640 1 -- 172.21.15.159:0/2126405186 shutdown_connections 2024-09-13T22:01:31.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.192+0000 7f7c74b60640 1 -- 172.21.15.159:0/2126405186 wait complete. 2024-09-13T22:01:31.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.192+0000 7f7c74b60640 1 Processor -- start 2024-09-13T22:01:31.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.193+0000 7f7c74b60640 1 -- start start 2024-09-13T22:01:31.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.193+0000 7f7c74b60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 0x7f7c70195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:31.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.193+0000 7f7c74b60640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c70068e40 con 0x7f7c70104700 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.193+0000 7f7c6e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 0x7f7c70195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.193+0000 7f7c6e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 0x7f7c70195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:56340/0 (socket says 172.21.15.159:56340) 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.193+0000 7f7c6e59c640 1 -- 172.21.15.159:0/752993081 learned_addr learned my addr 172.21.15.159:0/752993081 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.193+0000 7f7c6e59c640 1 -- 172.21.15.159:0/752993081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60009560 con 0x7f7c70104700 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.194+0000 7f7c6e59c640 1 --2- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 0x7f7c70195f70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009230 tx=0x7f7c600056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.194+0000 7f7c5f7fe640 1 -- 172.21.15.159:0/752993081 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c60004aa0 con 0x7f7c70104700 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.194+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c70196510 con 0x7f7c70104700 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.194+0000 7f7c5f7fe640 1 -- 172.21.15.159:0/752993081 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c60004c00 con 0x7f7c70104700 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.194+0000 7f7c5f7fe640 1 -- 172.21.15.159:0/752993081 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c60031940 con 0x7f7c70104700 2024-09-13T22:01:31.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.194+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c70196990 con 0x7f7c70104700 2024-09-13T22:01:31.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.195+0000 7f7c5f7fe640 1 -- 172.21.15.159:0/752993081 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f7c60031ba0 con 0x7f7c70104700 2024-09-13T22:01:31.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.195+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c700ffe40 con 0x7f7c70104700 2024-09-13T22:01:31.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.195+0000 7f7c5f7fe640 1 --2- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c58038880 0x7f7c5803ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:31.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.195+0000 7f7c5f7fe640 1 -- 172.21.15.159:0/752993081 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f7c6006c560 con 0x7f7c70104700 2024-09-13T22:01:31.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.195+0000 7f7c6dd9b640 1 --2- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c58038880 0x7f7c5803ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:31.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.196+0000 7f7c6dd9b640 1 --2- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c58038880 0x7f7c5803ad40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7c640098c0 tx=0x7f7c64006db0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:31.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.200+0000 7f7c5f7fe640 1 -- 172.21.15.159:0/752993081 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c6004d350 con 0x7f7c70104700 2024-09-13T22:01:31.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.432+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7c70196c40 con 0x7f7c70104700 2024-09-13T22:01:31.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.433+0000 7f7c5f7fe640 1 -- 172.21.15.159:0/752993081 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f7c60035090 con 0x7f7c70104700 2024-09-13T22:01:31.434 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:31.435 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:31.435 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:31.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c58038880 msgr2=0x7f7c5803ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:31.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 --2- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c58038880 0x7f7c5803ad40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7c640098c0 tx=0x7f7c64006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:31.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 msgr2=0x7f7c70195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:31.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 --2- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 0x7f7c70195f70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009230 tx=0x7f7c600056e0 comp rx=0 tx=0).stop 2024-09-13T22:01:31.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 shutdown_connections 2024-09-13T22:01:31.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 --2- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c58038880 0x7f7c5803ad40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:31.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 --2- 172.21.15.159:0/752993081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c70104700 0x7f7c70195f70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:31.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 >> 172.21.15.159:0/752993081 conn(0x7f7c700fa440 msgr2=0x7f7c700fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:31.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 shutdown_connections 2024-09-13T22:01:31.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:31.435+0000 7f7c74b60640 1 -- 172.21.15.159:0/752993081 wait complete. 2024-09-13T22:01:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:31 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/752993081' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:33.812 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:33.812 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:34.015 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:01:35.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:35.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:35.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:35.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:35.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:01:35.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T22:01:35.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:35.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:34 smithi089 ceph-mon[27921]: Deploying daemon crash.smithi159 on smithi159 2024-09-13T22:01:35.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:35.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.367+0000 7f0ffdaad640 1 -- 172.21.15.159:0/3185413333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 msgr2=0x7f0ff8105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:35.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.367+0000 7f0ffdaad640 1 --2- 172.21.15.159:0/3185413333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 0x7f0ff8105b40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009880 tx=0x7f0fe802a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:35.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.368+0000 7f0ffdaad640 1 -- 172.21.15.159:0/3185413333 shutdown_connections 2024-09-13T22:01:35.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.368+0000 7f0ffdaad640 1 --2- 172.21.15.159:0/3185413333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 0x7f0ff8105b40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:35.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.368+0000 7f0ffdaad640 1 -- 172.21.15.159:0/3185413333 >> 172.21.15.159:0/3185413333 conn(0x7f0ff80fb460 msgr2=0x7f0ff80fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:35.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.368+0000 7f0ffdaad640 1 -- 172.21.15.159:0/3185413333 shutdown_connections 2024-09-13T22:01:35.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.368+0000 7f0ffdaad640 1 -- 172.21.15.159:0/3185413333 wait complete. 2024-09-13T22:01:35.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.368+0000 7f0ffdaad640 1 Processor -- start 2024-09-13T22:01:35.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.368+0000 7f0ffdaad640 1 -- start start 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.369+0000 7f0ffdaad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 0x7f0ff81950a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.369+0000 7f0ffdaad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff81955e0 con 0x7f0ff8105760 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.369+0000 7f0ff77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 0x7f0ff81950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.369+0000 7f0ff77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 0x7f0ff81950a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:56374/0 (socket says 172.21.15.159:56374) 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.369+0000 7f0ff77fe640 1 -- 172.21.15.159:0/1682335223 learned_addr learned my addr 172.21.15.159:0/1682335223 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.369+0000 7f0ff77fe640 1 -- 172.21.15.159:0/1682335223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8009560 con 0x7f0ff8105760 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.369+0000 7f0ff77fe640 1 --2- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 0x7f0ff81950a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009230 tx=0x7f0fe80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.369+0000 7f0ff4ff9640 1 -- 172.21.15.159:0/1682335223 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fe8004aa0 con 0x7f0ff8105760 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.370+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff8195840 con 0x7f0ff8105760 2024-09-13T22:01:35.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.370+0000 7f0ff4ff9640 1 -- 172.21.15.159:0/1682335223 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fe8004c00 con 0x7f0ff8105760 2024-09-13T22:01:35.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.370+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8195cc0 con 0x7f0ff8105760 2024-09-13T22:01:35.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.370+0000 7f0ff4ff9640 1 -- 172.21.15.159:0/1682335223 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fe8031940 con 0x7f0ff8105760 2024-09-13T22:01:35.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.370+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff8100ea0 con 0x7f0ff8105760 2024-09-13T22:01:35.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.371+0000 7f0ff4ff9640 1 -- 172.21.15.159:0/1682335223 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f0fe8031ac0 con 0x7f0ff8105760 2024-09-13T22:01:35.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.371+0000 7f0ff4ff9640 1 --2- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0fe0038830 0x7f0fe003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:35.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.371+0000 7f0ff4ff9640 1 -- 172.21.15.159:0/1682335223 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f0fe806c5c0 con 0x7f0ff8105760 2024-09-13T22:01:35.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.371+0000 7f0ff6ffd640 1 --2- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0fe0038830 0x7f0fe003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:35.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.371+0000 7f0ff6ffd640 1 --2- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0fe0038830 0x7f0fe003acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0098c0 tx=0x7f0fec006db0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:35.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.376+0000 7f0ff4ff9640 1 -- 172.21.15.159:0/1682335223 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0fe803a770 con 0x7f0ff8105760 2024-09-13T22:01:35.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.603+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0ff8105b40 con 0x7f0ff8105760 2024-09-13T22:01:35.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.604+0000 7f0ff4ff9640 1 -- 172.21.15.159:0/1682335223 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f0fe8035300 con 0x7f0ff8105760 2024-09-13T22:01:35.605 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:35.605 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:35.606 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:35.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0fe0038830 msgr2=0x7f0fe003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:35.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 --2- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0fe0038830 0x7f0fe003acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0098c0 tx=0x7f0fec006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:35.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 msgr2=0x7f0ff81950a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:35.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 --2- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 0x7f0ff81950a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009230 tx=0x7f0fe80056e0 comp rx=0 tx=0).stop 2024-09-13T22:01:35.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 shutdown_connections 2024-09-13T22:01:35.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 --2- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0fe0038830 0x7f0fe003acf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:35.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 --2- 172.21.15.159:0/1682335223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ff8105760 0x7f0ff81950a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:35.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 >> 172.21.15.159:0/1682335223 conn(0x7f0ff80fb460 msgr2=0x7f0ff80fb840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:35.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 shutdown_connections 2024-09-13T22:01:35.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:35.606+0000 7f0ffdaad640 1 -- 172.21.15.159:0/1682335223 wait complete. 2024-09-13T22:01:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:35 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/1682335223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:37.158 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:37.158 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:37.395 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.188+0000 7fd504514640 1 -- 172.21.15.159:0/2567887662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 msgr2=0x7fd4fc104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.188+0000 7fd504514640 1 --2- 172.21.15.159:0/2567887662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 0x7fd4fc104a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009880 tx=0x7fd4f802a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.188+0000 7fd504514640 1 -- 172.21.15.159:0/2567887662 shutdown_connections 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.188+0000 7fd504514640 1 --2- 172.21.15.159:0/2567887662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 0x7fd4fc104a30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.188+0000 7fd504514640 1 -- 172.21.15.159:0/2567887662 >> 172.21.15.159:0/2567887662 conn(0x7fd4fc075490 msgr2=0x7fd4fc0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.188+0000 7fd504514640 1 -- 172.21.15.159:0/2567887662 shutdown_connections 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.188+0000 7fd504514640 1 -- 172.21.15.159:0/2567887662 wait complete. 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.189+0000 7fd504514640 1 Processor -- start 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.189+0000 7fd504514640 1 -- start start 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.189+0000 7fd504514640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 0x7fd4fc100220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:39.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.189+0000 7fd504514640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc102130 con 0x7fd4fc104650 2024-09-13T22:01:39.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.189+0000 7fd5022b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 0x7fd4fc100220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:39.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.190+0000 7fd5022b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 0x7fd4fc100220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:56420/0 (socket says 172.21.15.159:56420) 2024-09-13T22:01:39.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.190+0000 7fd5022b0640 1 -- 172.21.15.159:0/1969077859 learned_addr learned my addr 172.21.15.159:0/1969077859 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:39.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.190+0000 7fd5022b0640 1 -- 172.21.15.159:0/1969077859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8009560 con 0x7fd4fc104650 2024-09-13T22:01:39.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.190+0000 7fd5022b0640 1 --2- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 0x7fd4fc100220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009230 tx=0x7fd4f80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:39.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.190+0000 7fd4f37fe640 1 -- 172.21.15.159:0/1969077859 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4f8004aa0 con 0x7fd4fc104650 2024-09-13T22:01:39.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.190+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc100760 con 0x7fd4fc104650 2024-09-13T22:01:39.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.190+0000 7fd4f37fe640 1 -- 172.21.15.159:0/1969077859 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4f8004c00 con 0x7fd4fc104650 2024-09-13T22:01:39.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.190+0000 7fd4f37fe640 1 -- 172.21.15.159:0/1969077859 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4f8031940 con 0x7fd4fc104650 2024-09-13T22:01:39.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.190+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc100be0 con 0x7fd4fc104650 2024-09-13T22:01:39.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.191+0000 7fd4f37fe640 1 -- 172.21.15.159:0/1969077859 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7fd4f80035f0 con 0x7fd4fc104650 2024-09-13T22:01:39.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.191+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc0ffd90 con 0x7fd4fc104650 2024-09-13T22:01:39.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.192+0000 7fd4f37fe640 1 --2- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd4e8038830 0x7fd4e803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:39.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.192+0000 7fd4f37fe640 1 -- 172.21.15.159:0/1969077859 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd4f806c540 con 0x7fd4fc104650 2024-09-13T22:01:39.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.192+0000 7fd501aaf640 1 --2- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd4e8038830 0x7fd4e803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:39.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.192+0000 7fd501aaf640 1 --2- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd4e8038830 0x7fd4e803acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0098c0 tx=0x7fd4ec006db0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:39.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.197+0000 7fd4f37fe640 1 -- 172.21.15.159:0/1969077859 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd4f803a7d0 con 0x7fd4fc104650 2024-09-13T22:01:39.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.438+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd4fc100eb0 con 0x7fd4fc104650 2024-09-13T22:01:39.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.441+0000 7fd4f37fe640 1 -- 172.21.15.159:0/1969077859 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd4f8035090 con 0x7fd4fc104650 2024-09-13T22:01:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:39.444 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:39.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.445+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd4e8038830 msgr2=0x7fd4e803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:39.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.445+0000 7fd504514640 1 --2- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd4e8038830 0x7fd4e803acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0098c0 tx=0x7fd4ec006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:39.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.445+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 msgr2=0x7fd4fc100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:39.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.445+0000 7fd504514640 1 --2- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 0x7fd4fc100220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009230 tx=0x7fd4f80056e0 comp rx=0 tx=0).stop 2024-09-13T22:01:39.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.445+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 shutdown_connections 2024-09-13T22:01:39.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.445+0000 7fd504514640 1 --2- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd4e8038830 0x7fd4e803acf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:39.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.445+0000 7fd504514640 1 --2- 172.21.15.159:0/1969077859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4fc104650 0x7fd4fc100220 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:39.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.445+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 >> 172.21.15.159:0/1969077859 conn(0x7fd4fc075490 msgr2=0x7fd4fc1032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:39.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.446+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 shutdown_connections 2024-09-13T22:01:39.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:39.446+0000 7fd504514640 1 -- 172.21.15.159:0/1969077859 wait complete. 2024-09-13T22:01:40.491 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:40.491 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:40.491 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:40.491 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:40.492 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:40 smithi089 ceph-mon[27921]: Deploying daemon node-exporter.smithi159 on smithi159 2024-09-13T22:01:40.492 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:40.492 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:40.492 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:40 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/1969077859' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:41.173 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:41.173 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:41.383 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:01:44.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.119+0000 7f61ba799640 1 -- 172.21.15.159:0/1213929803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 msgr2=0x7f61b4105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:44.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.119+0000 7f61ba799640 1 --2- 172.21.15.159:0/1213929803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 0x7f61b4105bc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009880 tx=0x7f61a402a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:44.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.119+0000 7f61ba799640 1 -- 172.21.15.159:0/1213929803 shutdown_connections 2024-09-13T22:01:44.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.119+0000 7f61ba799640 1 --2- 172.21.15.159:0/1213929803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 0x7f61b4105bc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:44.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.119+0000 7f61ba799640 1 -- 172.21.15.159:0/1213929803 >> 172.21.15.159:0/1213929803 conn(0x7f61b40f9ae0 msgr2=0x7f61b40fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:44.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.119+0000 7f61ba799640 1 -- 172.21.15.159:0/1213929803 shutdown_connections 2024-09-13T22:01:44.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.119+0000 7f61ba799640 1 -- 172.21.15.159:0/1213929803 wait complete. 2024-09-13T22:01:44.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.120+0000 7f61ba799640 1 Processor -- start 2024-09-13T22:01:44.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.120+0000 7f61ba799640 1 -- start start 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.120+0000 7f61ba799640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 0x7f61b4195170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.120+0000 7f61ba799640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b41956b0 con 0x7f61b41057e0 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.121+0000 7f61b3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 0x7f61b4195170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.121+0000 7f61b3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 0x7f61b4195170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:48656/0 (socket says 172.21.15.159:48656) 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.121+0000 7f61b3fff640 1 -- 172.21.15.159:0/2876540836 learned_addr learned my addr 172.21.15.159:0/2876540836 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.123+0000 7f61b3fff640 1 -- 172.21.15.159:0/2876540836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009560 con 0x7f61b41057e0 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.124+0000 7f61b3fff640 1 --2- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 0x7f61b4195170 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009230 tx=0x7f61a40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.125+0000 7f61b17fa640 1 -- 172.21.15.159:0/2876540836 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61a4004be0 con 0x7f61b41057e0 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.125+0000 7f61b17fa640 1 -- 172.21.15.159:0/2876540836 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61a4004d40 con 0x7f61b41057e0 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.125+0000 7f61b17fa640 1 -- 172.21.15.159:0/2876540836 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61a4031a90 con 0x7f61b41057e0 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.125+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b4195910 con 0x7f61b41057e0 2024-09-13T22:01:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.125+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b4195d90 con 0x7f61b41057e0 2024-09-13T22:01:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.126+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b4100ff0 con 0x7f61b41057e0 2024-09-13T22:01:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.127+0000 7f61b17fa640 1 -- 172.21.15.159:0/2876540836 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f61a4031bf0 con 0x7f61b41057e0 2024-09-13T22:01:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.127+0000 7f61b17fa640 1 --2- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f619c0388d0 0x7f619c03ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.127+0000 7f61b17fa640 1 -- 172.21.15.159:0/2876540836 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f61a406c940 con 0x7f61b41057e0 2024-09-13T22:01:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.128+0000 7f61b37fe640 1 --2- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f619c0388d0 0x7f619c03ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.128+0000 7f61b37fe640 1 --2- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f619c0388d0 0x7f619c03ad90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61a80098c0 tx=0x7f61a8006db0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.132+0000 7f61b17fa640 1 -- 172.21.15.159:0/2876540836 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f61a404ebd0 con 0x7f61b41057e0 2024-09-13T22:01:44.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.364+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f61b4109c40 con 0x7f61b41057e0 2024-09-13T22:01:44.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.365+0000 7f61b17fa640 1 -- 172.21.15.159:0/2876540836 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f61a4040070 con 0x7f61b41057e0 2024-09-13T22:01:44.366 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:44.366 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:44.367 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:44.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f619c0388d0 msgr2=0x7f619c03ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:44.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 --2- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f619c0388d0 0x7f619c03ad90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61a80098c0 tx=0x7f61a8006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:44.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 msgr2=0x7f61b4195170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:44.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 --2- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 0x7f61b4195170 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009230 tx=0x7f61a40056e0 comp rx=0 tx=0).stop 2024-09-13T22:01:44.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 shutdown_connections 2024-09-13T22:01:44.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 --2- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f619c0388d0 0x7f619c03ad90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:44.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 --2- 172.21.15.159:0/2876540836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61b41057e0 0x7f61b4195170 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:44.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 >> 172.21.15.159:0/2876540836 conn(0x7f61b40f9ae0 msgr2=0x7f61b40fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:44.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 shutdown_connections 2024-09-13T22:01:44.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:44.367+0000 7f61ba799640 1 -- 172.21.15.159:0/2876540836 wait complete. 2024-09-13T22:01:44.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:44.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:44.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:44.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:44.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:01:44.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T22:01:44.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:01:44.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:44.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: Deploying daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:01:44.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:44.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:44.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:44 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/2876540836' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:45.974 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:45.975 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:46.363 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:01:47.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:47 smithi089 ceph-mon[27921]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:47.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.815+0000 7f85653d8640 1 -- 172.21.15.159:0/3882772053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 msgr2=0x7f8560105c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:47.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.815+0000 7f85653d8640 1 --2- 172.21.15.159:0/3882772053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 0x7f8560105c10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8550009880 tx=0x7f855002a5d0 comp rx=0 tx=0).stop 2024-09-13T22:01:47.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.815+0000 7f85653d8640 1 -- 172.21.15.159:0/3882772053 shutdown_connections 2024-09-13T22:01:47.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.815+0000 7f85653d8640 1 --2- 172.21.15.159:0/3882772053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 0x7f8560105c10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:47.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.815+0000 7f85653d8640 1 -- 172.21.15.159:0/3882772053 >> 172.21.15.159:0/3882772053 conn(0x7f8560076500 msgr2=0x7f8560076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:47.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.815+0000 7f85653d8640 1 -- 172.21.15.159:0/3882772053 shutdown_connections 2024-09-13T22:01:47.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.815+0000 7f85653d8640 1 -- 172.21.15.159:0/3882772053 wait complete. 2024-09-13T22:01:47.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.816+0000 7f85653d8640 1 Processor -- start 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.816+0000 7f85653d8640 1 -- start start 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.816+0000 7f85653d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 0x7f85601950b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.816+0000 7f85653d8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85601955f0 con 0x7f8560105830 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.817+0000 7f855effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 0x7f85601950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.817+0000 7f855effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 0x7f85601950b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:48676/0 (socket says 172.21.15.159:48676) 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.817+0000 7f855effd640 1 -- 172.21.15.159:0/1966770306 learned_addr learned my addr 172.21.15.159:0/1966770306 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.817+0000 7f855effd640 1 -- 172.21.15.159:0/1966770306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550009560 con 0x7f8560105830 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.817+0000 7f855effd640 1 --2- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 0x7f85601950b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8550009230 tx=0x7f85500056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.818+0000 7f8547fff640 1 -- 172.21.15.159:0/1966770306 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8550004aa0 con 0x7f8560105830 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.818+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8560195850 con 0x7f8560105830 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.818+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8560195cd0 con 0x7f8560105830 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.818+0000 7f8547fff640 1 -- 172.21.15.159:0/1966770306 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8550004c00 con 0x7f8560105830 2024-09-13T22:01:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.818+0000 7f8547fff640 1 -- 172.21.15.159:0/1966770306 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f85500317f0 con 0x7f8560105830 2024-09-13T22:01:47.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.819+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8560100ed0 con 0x7f8560105830 2024-09-13T22:01:47.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.819+0000 7f8547fff640 1 -- 172.21.15.159:0/1966770306 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f85500035f0 con 0x7f8560105830 2024-09-13T22:01:47.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.819+0000 7f8547fff640 1 --2- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8548038830 0x7f854803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:47.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.819+0000 7f8547fff640 1 -- 172.21.15.159:0/1966770306 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f855006c360 con 0x7f8560105830 2024-09-13T22:01:47.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.819+0000 7f855e7fc640 1 --2- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8548038830 0x7f854803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:47.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.820+0000 7f855e7fc640 1 --2- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8548038830 0x7f854803acf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f855400ad30 tx=0x7f85540093f0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:47.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:47.824+0000 7f8547fff640 1 -- 172.21.15.159:0/1966770306 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f85500439b0 con 0x7f8560105830 2024-09-13T22:01:48.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.064+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8560109cc0 con 0x7f8560105830 2024-09-13T22:01:48.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.064+0000 7f8547fff640 1 -- 172.21.15.159:0/1966770306 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8550035030 con 0x7f8560105830 2024-09-13T22:01:48.066 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:48.066 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:48.067 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:48.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8548038830 msgr2=0x7f854803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:48.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 --2- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8548038830 0x7f854803acf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f855400ad30 tx=0x7f85540093f0 comp rx=0 tx=0).stop 2024-09-13T22:01:48.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 msgr2=0x7f85601950b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:48.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 --2- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 0x7f85601950b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8550009230 tx=0x7f85500056e0 comp rx=0 tx=0).stop 2024-09-13T22:01:48.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 shutdown_connections 2024-09-13T22:01:48.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 --2- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8548038830 0x7f854803acf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:48.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 --2- 172.21.15.159:0/1966770306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8560105830 0x7f85601950b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:48.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 >> 172.21.15.159:0/1966770306 conn(0x7f8560076500 msgr2=0x7f85600fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:48.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 shutdown_connections 2024-09-13T22:01:48.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:48.067+0000 7f85653d8640 1 -- 172.21.15.159:0/1966770306 wait complete. 2024-09-13T22:01:48.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:48 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/1966770306' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:49.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:49 smithi089 ceph-mon[27921]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:01:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:49 smithi089 ceph-mon[27921]: Deploying daemon mon.smithi159 on smithi159 2024-09-13T22:01:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:49.941 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:49.941 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:50.685 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:01:51.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:51 smithi089 ceph-mon[27921]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:52.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.750+0000 7fd029f76640 1 -- 172.21.15.159:0/688656870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 msgr2=0x7fd024104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.750+0000 7fd029f76640 1 --2- 172.21.15.159:0/688656870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 0x7fd024104a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd014009c20 tx=0x7fd01402aa90 comp rx=0 tx=0).stop 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.750+0000 7fd029f76640 1 -- 172.21.15.159:0/688656870 shutdown_connections 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.750+0000 7fd029f76640 1 --2- 172.21.15.159:0/688656870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 0x7fd024104a30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.750+0000 7fd029f76640 1 -- 172.21.15.159:0/688656870 >> 172.21.15.159:0/688656870 conn(0x7fd024075490 msgr2=0x7fd0240fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.750+0000 7fd029f76640 1 -- 172.21.15.159:0/688656870 shutdown_connections 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.750+0000 7fd029f76640 1 -- 172.21.15.159:0/688656870 wait complete. 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.750+0000 7fd029f76640 1 Processor -- start 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.751+0000 7fd029f76640 1 -- start start 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.751+0000 7fd029f76640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 0x7fd024195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.751+0000 7fd029f76640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024068670 con 0x7fd024104650 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.751+0000 7fd0237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 0x7fd024195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:52.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.751+0000 7fd0237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 0x7fd024195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.159:41234/0 (socket says 172.21.15.159:41234) 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.751+0000 7fd0237fe640 1 -- 172.21.15.159:0/1871225222 learned_addr learned my addr 172.21.15.159:0/1871225222 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.751+0000 7fd0237fe640 1 -- 172.21.15.159:0/1871225222 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014009900 con 0x7fd024104650 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.752+0000 7fd0237fe640 1 --2- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 0x7fd024195f90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd014009d40 tx=0x7fd01402f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.752+0000 7fd020ff9640 1 -- 172.21.15.159:0/1871225222 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd01403e070 con 0x7fd024104650 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.752+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd024196530 con 0x7fd024104650 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.752+0000 7fd020ff9640 1 -- 172.21.15.159:0/1871225222 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd014003e20 con 0x7fd024104650 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.752+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0241969b0 con 0x7fd024104650 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.752+0000 7fd020ff9640 1 -- 172.21.15.159:0/1871225222 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd014004640 con 0x7fd024104650 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.753+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd024103470 con 0x7fd024104650 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.753+0000 7fd020ff9640 1 -- 172.21.15.159:0/1871225222 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7fd01400a040 con 0x7fd024104650 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.753+0000 7fd020ff9640 1 --2- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd010038830 0x7fd01003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.753+0000 7fd020ff9640 1 -- 172.21.15.159:0/1871225222 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd01406c8b0 con 0x7fd024104650 2024-09-13T22:01:52.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.754+0000 7fd022ffd640 1 --2- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd010038830 0x7fd01003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:52.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.754+0000 7fd022ffd640 1 --2- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd010038830 0x7fd01003acf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0098c0 tx=0x7fd00c006db0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:52.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:52.758+0000 7fd020ff9640 1 -- 172.21.15.159:0/1871225222 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd01404bb50 con 0x7fd024104650 2024-09-13T22:01:53.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.001+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd0240ffd90 con 0x7fd024104650 2024-09-13T22:01:53.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.002+0000 7fd020ff9640 1 -- 172.21.15.159:0/1871225222 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd014033020 con 0x7fd024104650 2024-09-13T22:01:53.003 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:53.003 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T21:59:19.977648Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:01:53.004 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-13T22:01:53.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd010038830 msgr2=0x7fd01003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:53.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 --2- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd010038830 0x7fd01003acf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0098c0 tx=0x7fd00c006db0 comp rx=0 tx=0).stop 2024-09-13T22:01:53.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 msgr2=0x7fd024195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:53.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 --2- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 0x7fd024195f90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd014009d40 tx=0x7fd01402f8a0 comp rx=0 tx=0).stop 2024-09-13T22:01:53.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 shutdown_connections 2024-09-13T22:01:53.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 --2- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd010038830 0x7fd01003acf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:53.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 --2- 172.21.15.159:0/1871225222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024104650 0x7fd024195f90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:53.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 >> 172.21.15.159:0/1871225222 conn(0x7fd024075490 msgr2=0x7fd0240fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:53.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 shutdown_connections 2024-09-13T22:01:53.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:53.004+0000 7fd029f76640 1 -- 172.21.15.159:0/1871225222 wait complete. 2024-09-13T22:01:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:53 smithi089 ceph-mon[27921]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:53 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/1871225222' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:53 smithi089 ceph-mon[27921]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:01:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:53 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/1715906678' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:01:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:53 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/1715906678' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:01:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:53 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/1715906678' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:01:53.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:53 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/1715906678' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:01:53.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 podman[35288]: 2024-09-13 22:01:53.75549484 +0000 UTC m=+0.978157442 container init 9cc9ae5673971832da6dd7e671c8499164c9fbb13adf40a030f731507e5db75b (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, CEPH_POINT_RELEASE=, RELEASE=reef-e4e227b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-13T22:01:53.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 podman[35288]: 2024-09-13 22:01:53.760543188 +0000 UTC m=+0.983205782 container start 9cc9ae5673971832da6dd7e671c8499164c9fbb13adf40a030f731507e5db75b (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=reef-e4e227b, org.label-schema.schema-version=1.0) 2024-09-13T22:01:54.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable), process ceph-mon, pid 2 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pidfile_write: ignore empty --pid-file 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: load: jerasure load: lrc 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: RocksDB version: 7.9.2 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Git sha 0 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Compile date 2024-09-13 16:45:57 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: DB SUMMARY 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: DB Session ID: NMMYNVJ8RF4WK1BN20W1 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: CURRENT file: CURRENT 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi159/store.db dir, Total Num: 0, files: 2024-09-13T22:01:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi159/store.db: 000004.log size: 511 ; 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.error_if_exists: 0 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.create_if_missing: 0 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.paranoid_checks: 1 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.env: 0x561be03d2bc0 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.info_log: 0x561be1f74dc0 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.statistics: (nil) 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.use_fsync: 0 2024-09-13T22:01:54.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_log_file_size: 0 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.allow_fallocate: 1 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.use_direct_reads: 0 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.db_log_dir: 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.wal_dir: 2024-09-13T22:01:54.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.write_buffer_manager: 0x561be1f82320 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:01:54.265 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.unordered_write: 0 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.row_cache: None 2024-09-13T22:01:54.266 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.wal_filter: None 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.two_write_queues: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.wal_compression: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.atomic_flush: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.log_readahead_size: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:01:54.267 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_background_jobs: 2 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_background_compactions: -1 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_subcompactions: 1 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:01:54.268 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_open_files: -1 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_background_flushes: -1 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Compression algorithms supported: 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: kZSTD supported: 0 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: kXpressCompression supported: 0 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: kBZip2Compression supported: 0 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:01:54.269 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: kLZ4Compression supported: 1 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: kZlibCompression supported: 1 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: kSnappyCompression supported: 1 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000005 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.merge_operator: 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_filter: None 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:01:54.270 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561be1f74a20) 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks: 1 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_top_level_index_and_filter: 1 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_type: 0 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_index_type: 0 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_shortening: 1 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: checksum: 4 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: no_block_cache: 0 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache: 0x561be1f69350 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_name: BinnedLRUCache 2024-09-13T22:01:54.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_options: 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: capacity : 536870912 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: num_shard_bits : 4 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: strict_capacity_limit : 0 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: high_pri_pool_ratio: 0.000 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_compressed: (nil) 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: persistent_cache: (nil) 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size: 4096 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size_deviation: 10 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_restart_interval: 16 2024-09-13T22:01:54.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_block_restart_interval: 1 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: metadata_block_size: 4096 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: partition_filters: 0 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: use_delta_encoding: 1 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: filter_policy: bloomfilter 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: whole_key_filtering: 1 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: verify_compression: 0 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: read_amp_bytes_per_bit: 0 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: format_version: 5 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_index_compression: 1 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_align: 0 2024-09-13T22:01:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_auto_readahead_size: 262144 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: prepopulate_block_cache: 0 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: initial_auto_readahead_size: 8192 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression: NoCompression 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.num_levels: 7 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:01:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:01:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:01:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:01:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:01:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:01:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:01:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:01:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:01:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:01:54.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:01:54.276 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:01:54.277 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:01:54.278 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.inplace_update_support: 0 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.bloom_locality: 0 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.max_successive_merges: 0 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:01:54.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.ttl: 2592000 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.enable_blob_files: false 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.min_blob_size: 0 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:01:54.280 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 350db71d-1e13-49cb-896c-946c77fcecb8 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264913788316, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264913788891, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726264913, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "350db71d-1e13-49cb-896c-946c77fcecb8", "db_session_id": "NMMYNVJ8RF4WK1BN20W1", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264913789023, "job": 1, "event": "recovery_finished"} 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi159/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561be1f94e00 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: DB pointer 0x561be2088000 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:01:54.281 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** DB Stats ** 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:01:54.282 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T22:01:54.283 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Block cache BinnedLRUCache@0x561be1f69350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159 does not exist in monmap, will attempt to join an existing cluster 2024-09-13T22:01:54.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: using public_addr v2:172.21.15.159:0/0 -> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: starting mon.smithi159 rank -1 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi159 fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(???) e0 preinit fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).mds e1 new map 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).mds e1 print_map 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: e1 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: legacy client fscid: -1 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: No filesystems configured 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T22:01:54.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Added host smithi159 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Deploying daemon node-exporter.smithi089 on smithi089 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/471087789' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Deploying daemon alertmanager.smithi089 on smithi089 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/471087789' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi089:172.21.15.89=smithi089;smithi159:172.21.15.159=smithi159", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:01:54.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Saving service mon spec with placement smithi089:172.21.15.89=smithi089;smithi159:172.21.15.159=smithi159;count:2 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/1092905697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.288 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Deploying daemon grafana.smithi089 on smithi089 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/3697502513' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/168910088' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/2281278881' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.289 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Deploying daemon prometheus.smithi089 on smithi089 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/2255804262' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.290 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/2535844840' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/3582364059' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14160 172.21.15.89:0/1806486181' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mgrmap e14: smithi089.naneiw(active, since 57s) 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/1260356054' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/2361305360' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.291 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Active manager daemon smithi089.naneiw restarted 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Activating manager daemon smithi089.naneiw 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mgrmap e15: smithi089.naneiw(active, starting, since 0.00318196s) 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Manager daemon smithi089.naneiw is now available 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:01:54.292 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/trash_purge_schedule"}]: dispatch 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mgrmap e16: smithi089.naneiw(active, since 1.00526s) 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: [13/Sep/2024:22:01:25] ENGINE Bus STARTING 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: [13/Sep/2024:22:01:25] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: [13/Sep/2024:22:01:25] ENGINE Error in HTTPServer.serve 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Traceback (most recent call last): 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._run(expiration_interval) 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:01:54.293 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: s = self.context.wrap_socket( 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: return self.sslsocket_class._create( 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self.do_handshake() 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._sslobj.do_handshake() 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.294 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: [13/Sep/2024:22:01:25] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: [13/Sep/2024:22:01:25] ENGINE Bus STARTED 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/2775610536' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mgrmap e17: smithi089.naneiw(active, since 2s) 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Deploying daemon ceph-exporter.smithi159 on smithi159 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/752993081' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:01:54.297 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Deploying daemon crash.smithi159 on smithi159 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/1682335223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Deploying daemon node-exporter.smithi159 on smithi159 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/1969077859' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.298 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Deploying daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/2876540836' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/1966770306' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.299 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Deploying daemon mon.smithi159 on smithi159 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/1871225222' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/1715906678' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/1715906678' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:01:54.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/1715906678' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:01:54.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/1715906678' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:01:54.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 ceph-mon[35348]: mon.smithi159@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-13T22:01:54.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 bash[35288]: 9cc9ae5673971832da6dd7e671c8499164c9fbb13adf40a030f731507e5db75b 2024-09-13T22:01:54.301 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:53 smithi159 systemd[1]: Started Ceph mon.smithi159 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:01:54.644 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:01:54.645 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:01:54.845 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi159/config 2024-09-13T22:01:59.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: mon.smithi089 calling monitor election 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: mon.smithi159 calling monitor election 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:59.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: mon.smithi089 is new leader, mons smithi089,smithi159 in quorum (ranks 0,1) 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: monmap e2: 2 mons at {smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0],smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: fsmap 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: mgrmap e18: smithi089.naneiw(active, since 34s), standbys: smithi159.ghpomd 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: overall HEALTH_OK 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:01:59.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: mon.smithi089 calling monitor election 2024-09-13T22:01:59.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:59.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:59.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: mon.smithi159 calling monitor election 2024-09-13T22:01:59.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: mon.smithi089 is new leader, mons smithi089,smithi159 in quorum (ranks 0,1) 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: monmap e2: 2 mons at {smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0],smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: fsmap 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: mgrmap e18: smithi089.naneiw(active, since 34s), standbys: smithi159.ghpomd 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: overall HEALTH_OK 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:01:59.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.456+0000 7f30bfbe7640 1 -- 172.21.15.159:0/2883301173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30a0003530 msgr2=0x7f30a00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:59.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.456+0000 7f30bfbe7640 1 --2- 172.21.15.159:0/2883301173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30a0003530 0x7f30a00059c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f30b80ffc10 tx=0x7f30a802bce0 comp rx=0 tx=0).stop 2024-09-13T22:01:59.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.456+0000 7f30bfbe7640 1 -- 172.21.15.159:0/2883301173 shutdown_connections 2024-09-13T22:01:59.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.456+0000 7f30bfbe7640 1 --2- 172.21.15.159:0/2883301173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30a0003530 0x7f30a00059c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:59.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.456+0000 7f30bfbe7640 1 -- 172.21.15.159:0/2883301173 >> 172.21.15.159:0/2883301173 conn(0x7f30b80fa440 msgr2=0x7f30b80fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:59.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.456+0000 7f30bfbe7640 1 -- 172.21.15.159:0/2883301173 shutdown_connections 2024-09-13T22:01:59.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.456+0000 7f30bfbe7640 1 -- 172.21.15.159:0/2883301173 wait complete. 2024-09-13T22:01:59.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bfbe7640 1 Processor -- start 2024-09-13T22:01:59.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bfbe7640 1 -- start start 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bfbe7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30a0003530 0x7f30b8196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bfbe7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 0x7f30b81969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bfbe7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b819f0c0 con 0x7f30a0003530 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bfbe7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b819f200 con 0x7f30b8196590 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bd182640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 0x7f30b81969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bd182640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 0x7f30b81969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38648/0 (socket says 172.21.15.159:38648) 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bd182640 1 -- 172.21.15.159:0/625191475 learned_addr learned my addr 172.21.15.159:0/625191475 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bd182640 1 -- 172.21.15.159:0/625191475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 msgr2=0x7f30b81969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bd182640 1 -- 172.21.15.159:0/625191475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 msgr2=0x7f30b81969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.457+0000 7f30bd182640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 0x7f30b81969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T22:01:59.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30bd182640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 0x7f30b81969f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30bd983640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30a0003530 0x7f30b8196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30bd983640 1 -- 172.21.15.159:0/625191475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 msgr2=0x7f30b81969f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30bd983640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 0x7f30b81969f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30bd983640 1 -- 172.21.15.159:0/625191475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a8011870 con 0x7f30a0003530 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30bd983640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30a0003530 0x7f30b8196050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30a8011c00 tx=0x7f30a802d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30b6ffd640 1 -- 172.21.15.159:0/625191475 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30a80035f0 con 0x7f30a0003530 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30b6ffd640 1 -- 172.21.15.159:0/625191475 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30a8003c10 con 0x7f30a0003530 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b819f400 con 0x7f30a0003530 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30b6ffd640 1 -- 172.21.15.159:0/625191475 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30a8037c10 con 0x7f30a0003530 2024-09-13T22:01:59.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.458+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b819f950 con 0x7f30a0003530 2024-09-13T22:01:59.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.459+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b80ffec0 con 0x7f30a0003530 2024-09-13T22:01:59.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.460+0000 7f30b6ffd640 1 -- 172.21.15.159:0/625191475 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f30a8037480 con 0x7f30a0003530 2024-09-13T22:01:59.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.460+0000 7f30b6ffd640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f30a406cd20 0x7f30a406f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:01:59.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.460+0000 7f30b6ffd640 1 -- 172.21.15.159:0/625191475 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f30a8000e40 con 0x7f30a0003530 2024-09-13T22:01:59.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.461+0000 7f30bd182640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f30a406cd20 0x7f30a406f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:01:59.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.463+0000 7f30bd182640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f30a406cd20 0x7f30a406f1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009100 tx=0x7f30ac008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:01:59.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.465+0000 7f30b6ffd640 1 -- 172.21.15.159:0/625191475 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30a8077c50 con 0x7f30a0003530 2024-09-13T22:01:59.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.701+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f30b818e040 con 0x7f30a0003530 2024-09-13T22:01:59.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.701+0000 7f30b6ffd640 1 -- 172.21.15.159:0/625191475 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7f30b818e040 con 0x7f30a0003530 2024-09-13T22:01:59.703 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:01:59.703 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":2,"fsid":"39489060-721b-11ef-bceb-c7b262605968","modified":"2024-09-13T22:01:53.825962Z","created":"2024-09-13T21:59:19.977648Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T22:01:59.703 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 2 2024-09-13T22:01:59.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.703+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f30a406cd20 msgr2=0x7f30a406f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:59.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.703+0000 7f30bfbe7640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f30a406cd20 0x7f30a406f1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009100 tx=0x7f30ac008040 comp rx=0 tx=0).stop 2024-09-13T22:01:59.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.703+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30a0003530 msgr2=0x7f30b8196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:01:59.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.703+0000 7f30bfbe7640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30a0003530 0x7f30b8196050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30a8011c00 tx=0x7f30a802d8e0 comp rx=0 tx=0).stop 2024-09-13T22:01:59.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.704+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 shutdown_connections 2024-09-13T22:01:59.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.704+0000 7f30bfbe7640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f30a406cd20 0x7f30a406f1e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:59.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.704+0000 7f30bfbe7640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b8196590 0x7f30b81969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:59.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.704+0000 7f30bfbe7640 1 --2- 172.21.15.159:0/625191475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30a0003530 0x7f30b8196050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:01:59.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.704+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 >> 172.21.15.159:0/625191475 conn(0x7f30b80fa440 msgr2=0x7f30b80fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:01:59.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.704+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 shutdown_connections 2024-09-13T22:01:59.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:01:59.704+0000 7f30bfbe7640 1 -- 172.21.15.159:0/625191475 wait complete. 2024-09-13T22:02:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:59 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:02:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:59 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:59 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/625191475' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:02:00.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:01:59 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:02:00.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:59 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:02:00.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:59 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:00.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:59 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/625191475' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:02:00.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:01:59 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:02:00.618 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T22:02:00.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T22:02:00.828 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:02:01.190 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:00 smithi089 ceph-mon[27921]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:01.198 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:00 smithi159 ceph-mon[35348]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:02.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.434+0000 7f4e2c0a4640 1 -- 172.21.15.89:0/364746359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24104670 msgr2=0x7f4e24104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:02.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.434+0000 7f4e2c0a4640 1 --2- 172.21.15.89:0/364746359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24104670 0x7f4e24104a50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009880 tx=0x7f4e2002a5d0 comp rx=0 tx=0).stop 2024-09-13T22:02:02.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.434+0000 7f4e2c0a4640 1 -- 172.21.15.89:0/364746359 shutdown_connections 2024-09-13T22:02:02.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.434+0000 7f4e2c0a4640 1 --2- 172.21.15.89:0/364746359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24104670 0x7f4e24104a50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.434+0000 7f4e2c0a4640 1 -- 172.21.15.89:0/364746359 >> 172.21.15.89:0/364746359 conn(0x7f4e240fa3b0 msgr2=0x7f4e240fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.434+0000 7f4e2c0a4640 1 -- 172.21.15.89:0/364746359 shutdown_connections 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.434+0000 7f4e2c0a4640 1 -- 172.21.15.89:0/364746359 wait complete. 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2c0a4640 1 Processor -- start 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2c0a4640 1 -- start start 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2c0a4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e24104670 0x7f4e24193e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2c0a4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24194370 0x7f4e241947f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2c0a4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24068de0 con 0x7f4e24194370 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2c0a4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e241a14a0 con 0x7f4e24104670 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2963f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24194370 0x7f4e241947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2963f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24194370 0x7f4e241947f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45644/0 (socket says 172.21.15.89:45644) 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2963f640 1 -- 172.21.15.89:0/2863956451 learned_addr learned my addr 172.21.15.89:0/2863956451 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:02:02.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e29e40640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e24104670 0x7f4e24193e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2963f640 1 -- 172.21.15.89:0/2863956451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e24104670 msgr2=0x7f4e24193e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2963f640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e24104670 0x7f4e24193e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e2963f640 1 -- 172.21.15.89:0/2863956451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20009560 con 0x7f4e24194370 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.435+0000 7f4e29e40640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e24104670 0x7f4e24193e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.436+0000 7f4e2963f640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24194370 0x7f4e241947f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400b4a0 tx=0x7f4e1400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.436+0000 7f4e1affd640 1 -- 172.21.15.89:0/2863956451 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e140107e0 con 0x7f4e24194370 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.436+0000 7f4e1affd640 1 -- 172.21.15.89:0/2863956451 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e14010e00 con 0x7f4e24194370 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.436+0000 7f4e2c0a4640 1 -- 172.21.15.89:0/2863956451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e241a15e0 con 0x7f4e24194370 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.436+0000 7f4e1affd640 1 -- 172.21.15.89:0/2863956451 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e1400f360 con 0x7f4e24194370 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.436+0000 7f4e2c0a4640 1 -- 172.21.15.89:0/2863956451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e241a1ae0 con 0x7f4e24194370 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.437+0000 7f4e18ff9640 1 -- 172.21.15.89:0/2863956451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e240ffdb0 con 0x7f4e24194370 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.437+0000 7f4e1affd640 1 -- 172.21.15.89:0/2863956451 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f4e14017360 con 0x7f4e24194370 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.437+0000 7f4e1affd640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f4e1006cd20 0x7f4e1006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:02:02.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.438+0000 7f4e1affd640 1 -- 172.21.15.89:0/2863956451 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4e1408ab50 con 0x7f4e24194370 2024-09-13T22:02:02.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.438+0000 7f4e29e40640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f4e1006cd20 0x7f4e1006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:02:02.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.438+0000 7f4e29e40640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f4e1006cd20 0x7f4e1006f1e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e20006010 tx=0x7f4e20005a40 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:02:02.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.442+0000 7f4e1affd640 1 -- 172.21.15.89:0/2863956451 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4e14056000 con 0x7f4e24194370 2024-09-13T22:02:02.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.609+0000 7f4e18ff9640 1 -- 172.21.15.89:0/2863956451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4e240684b0 con 0x7f4e24194370 2024-09-13T22:02:02.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.610+0000 7f4e1affd640 1 -- 172.21.15.89:0/2863956451 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f4e1408a310 con 0x7f4e24194370 2024-09-13T22:02:02.611 INFO:teuthology.orchestra.run.smithi089.stdout:# minimal ceph.conf for 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:02:02.612 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-09-13T22:02:02.612 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:02:02.612 INFO:teuthology.orchestra.run.smithi089.stdout: mon_host = [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-09-13T22:02:02.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 -- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f4e1006cd20 msgr2=0x7f4e1006f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:02.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f4e1006cd20 0x7f4e1006f1e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e20006010 tx=0x7f4e20005a40 comp rx=0 tx=0).stop 2024-09-13T22:02:02.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 -- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24194370 msgr2=0x7f4e241947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:02.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24194370 0x7f4e241947f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400b4a0 tx=0x7f4e1400b960 comp rx=0 tx=0).stop 2024-09-13T22:02:02.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 -- 172.21.15.89:0/2863956451 shutdown_connections 2024-09-13T22:02:02.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f4e1006cd20 0x7f4e1006f1e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:02.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e24194370 0x7f4e241947f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:02.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 --2- 172.21.15.89:0/2863956451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e24104670 0x7f4e24193e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:02.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 -- 172.21.15.89:0/2863956451 >> 172.21.15.89:0/2863956451 conn(0x7f4e240fa3b0 msgr2=0x7f4e240fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:02:02.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 -- 172.21.15.89:0/2863956451 shutdown_connections 2024-09-13T22:02:02.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:02.612+0000 7f4e18ff9640 1 -- 172.21.15.89:0/2863956451 wait complete. 2024-09-13T22:02:02.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:02:02.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:02:02.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:02.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:02.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:02:02.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:02:02.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:02:02.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:02.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:02:02.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:02:02.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:03.227 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T22:02:03.227 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:02:03.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T22:02:03.255 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:02:03.255 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:02:03.320 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:02:03.320 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T22:02:03.353 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:02:03.353 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:02:03.422 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T22:02:03.422 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:02:03.422 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T22:02:03.437 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T22:02:03.438 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-13T22:02:03.495 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T22:02:03.495 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:02:03.495 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T22:02:03.495 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:02:03.495 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:02:03.496 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-13 22:01:17.849879828 +0000 2024-09-13T22:02:03.496 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 21:55:33.874545679 +0000 2024-09-13T22:02:03.496 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 21:55:33.874545679 +0000 2024-09-13T22:02:03.496 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 21:55:33.874545679 +0000 2024-09-13T22:02:03.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T22:02:03.559 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-13T22:02:03.559 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-13T22:02:03.560 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000211173 s, 2.4 MB/s 2024-09-13T22:02:03.561 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T22:02:03.617 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-13T22:02:03.674 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T22:02:03.674 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:02:03.674 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T22:02:03.674 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:02:03.674 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:02:03.674 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-13 22:01:17.849879828 +0000 2024-09-13T22:02:03.674 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 21:55:34.205537843 +0000 2024-09-13T22:02:03.674 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 21:55:34.205537843 +0000 2024-09-13T22:02:03.674 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 21:55:34.205537843 +0000 2024-09-13T22:02:03.674 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T22:02:03.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:03 smithi159 ceph-mon[35348]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:02:03.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:03 smithi159 ceph-mon[35348]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:02:03.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:03 smithi159 ceph-mon[35348]: Reconfiguring mon.smithi089 (unknown last config time)... 2024-09-13T22:02:03.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:03 smithi159 ceph-mon[35348]: Reconfiguring daemon mon.smithi089 on smithi089 2024-09-13T22:02:03.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:03 smithi159 ceph-mon[35348]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:03.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:03 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2863956451' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:03.735 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:03 smithi089 ceph-mon[27921]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:02:03.736 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:03 smithi089 ceph-mon[27921]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:02:03.736 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:03 smithi089 ceph-mon[27921]: Reconfiguring mon.smithi089 (unknown last config time)... 2024-09-13T22:02:03.736 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:03 smithi089 ceph-mon[27921]: Reconfiguring daemon mon.smithi089 on smithi089 2024-09-13T22:02:03.736 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:03 smithi089 ceph-mon[27921]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:03.736 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:03 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2863956451' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:03.738 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-13T22:02:03.738 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-13T22:02:03.738 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000227607 s, 2.2 MB/s 2024-09-13T22:02:03.740 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T22:02:03.797 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-13T22:02:03.852 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T22:02:03.852 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:02:03.852 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T22:02:03.852 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:02:03.852 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:02:03.852 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-13 22:01:17.849879828 +0000 2024-09-13T22:02:03.852 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 21:55:34.537529983 +0000 2024-09-13T22:02:03.853 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 21:55:34.537529983 +0000 2024-09-13T22:02:03.853 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 21:55:34.537529983 +0000 2024-09-13T22:02:03.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T22:02:03.916 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-13T22:02:03.916 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-13T22:02:03.916 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000195465 s, 2.6 MB/s 2024-09-13T22:02:03.918 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T22:02:03.974 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-13T22:02:04.030 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T22:02:04.030 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:02:04.030 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T22:02:04.031 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:02:04.031 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:02:04.031 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-13 22:01:17.850879805 +0000 2024-09-13T22:02:04.031 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 21:55:34.860522336 +0000 2024-09-13T22:02:04.031 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 21:55:34.860522336 +0000 2024-09-13T22:02:04.031 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 21:55:34.860522336 +0000 2024-09-13T22:02:04.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T22:02:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-13T22:02:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-13T22:02:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00019959 s, 2.6 MB/s 2024-09-13T22:02:04.094 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T22:02:04.151 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:02:04.152 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T22:02:04.172 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T22:02:04.172 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-09-13T22:02:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T22:02:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:02:04.231 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-13T22:02:04.231 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:02:04.231 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:02:04.231 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-13 22:01:51.400410814 +0000 2024-09-13T22:02:04.231 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-13 21:55:33.850909598 +0000 2024-09-13T22:02:04.231 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-13 21:55:33.850909598 +0000 2024-09-13T22:02:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-13 21:55:33.850909598 +0000 2024-09-13T22:02:04.232 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T22:02:04.298 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-13T22:02:04.298 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-13T22:02:04.298 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000298346 s, 1.7 MB/s 2024-09-13T22:02:04.300 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T22:02:04.358 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-09-13T22:02:04.414 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T22:02:04.415 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:02:04.415 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-13T22:02:04.415 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:02:04.415 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:02:04.415 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-13 22:01:51.400410814 +0000 2024-09-13T22:02:04.415 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-13 21:55:34.182903389 +0000 2024-09-13T22:02:04.415 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-13 21:55:34.182903389 +0000 2024-09-13T22:02:04.415 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-13 21:55:34.182903389 +0000 2024-09-13T22:02:04.415 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T22:02:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-13T22:02:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-13T22:02:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000201626 s, 2.5 MB/s 2024-09-13T22:02:04.481 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T22:02:04.539 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-09-13T22:02:04.596 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T22:02:04.596 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:02:04.596 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T22:02:04.596 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:02:04.596 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:02:04.596 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-13 22:01:51.400410814 +0000 2024-09-13T22:02:04.597 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-13 21:55:34.516897142 +0000 2024-09-13T22:02:04.597 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-13 21:55:34.516897142 +0000 2024-09-13T22:02:04.597 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-13 21:55:34.516897142 +0000 2024-09-13T22:02:04.597 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T22:02:04.660 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-13T22:02:04.660 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-13T22:02:04.660 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000214015 s, 2.4 MB/s 2024-09-13T22:02:04.662 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T22:02:04.719 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-09-13T22:02:04.775 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T22:02:04.775 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:02:04.775 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-13T22:02:04.775 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:02:04.775 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:02:04.775 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-13 22:01:51.401410796 +0000 2024-09-13T22:02:04.776 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-13 21:55:34.829891288 +0000 2024-09-13T22:02:04.776 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-13 21:55:34.829891288 +0000 2024-09-13T22:02:04.776 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-13 21:55:34.829891288 +0000 2024-09-13T22:02:04.776 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T22:02:04.839 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-13T22:02:04.839 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-13T22:02:04.839 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.0002075 s, 2.5 MB/s 2024-09-13T22:02:04.840 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T22:02:04.896 INFO:tasks.cephadm:Deploying osd.0 on smithi089 with /dev/vg_nvme/lv_4... 2024-09-13T22:02:04.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T22:02:05.097 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:02:05.476 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:05 smithi089 ceph-mon[27921]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:05.476 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:05 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:05.476 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:05 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:05.476 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:05 smithi089 ceph-mon[27921]: Reconfiguring mgr.smithi089.naneiw (unknown last config time)... 2024-09-13T22:02:05.476 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:05 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.naneiw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:02:05.476 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:05 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:02:05.476 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:05 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:05.477 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:05 smithi089 ceph-mon[27921]: Reconfiguring daemon mgr.smithi089.naneiw on smithi089 2024-09-13T22:02:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:05 smithi159 ceph-mon[35348]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:05 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:05 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:05.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:05 smithi159 ceph-mon[35348]: Reconfiguring mgr.smithi089.naneiw (unknown last config time)... 2024-09-13T22:02:05.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:05 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.naneiw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:02:05.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:05 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:02:05.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:05 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:05.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:05 smithi159 ceph-mon[35348]: Reconfiguring daemon mgr.smithi089.naneiw on smithi089 2024-09-13T22:02:06.801 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:06 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:06.802 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:06 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:06.802 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:06 smithi089 ceph-mon[27921]: Reconfiguring ceph-exporter.smithi089 (monmap changed)... 2024-09-13T22:02:06.802 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:06 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:02:06.802 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:06 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:06.802 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:06 smithi089 ceph-mon[27921]: Reconfiguring daemon ceph-exporter.smithi089 on smithi089 2024-09-13T22:02:06.802 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:06 smithi089 ceph-mon[27921]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:07.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:06 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:07.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:06 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:07.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:06 smithi159 ceph-mon[35348]: Reconfiguring ceph-exporter.smithi089 (monmap changed)... 2024-09-13T22:02:07.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:06 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:02:07.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:06 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:07.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:06 smithi159 ceph-mon[35348]: Reconfiguring daemon ceph-exporter.smithi089 on smithi089 2024-09-13T22:02:07.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:06 smithi159 ceph-mon[35348]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:08 smithi089 ceph-mon[27921]: Reconfiguring crash.smithi089 (monmap changed)... 2024-09-13T22:02:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:02:08.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:08.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:08 smithi089 ceph-mon[27921]: Reconfiguring daemon crash.smithi089 on smithi089 2024-09-13T22:02:08.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:08 smithi089 ceph-mon[27921]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:08 smithi159 ceph-mon[35348]: Reconfiguring crash.smithi089 (monmap changed)... 2024-09-13T22:02:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:02:09.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:09.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:08 smithi159 ceph-mon[35348]: Reconfiguring daemon crash.smithi089 on smithi089 2024-09-13T22:02:09.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:08 smithi159 ceph-mon[35348]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:09.049 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:02:09.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_4 2024-09-13T22:02:09.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:02:10.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:02:10.190 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:02:11.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:11 smithi089 ceph-mon[27921]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:11.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:11.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:11.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:11 smithi089 ceph-mon[27921]: Reconfiguring alertmanager.smithi089 (dependencies changed)... 2024-09-13T22:02:11.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:11 smithi089 ceph-mon[27921]: Reconfiguring daemon alertmanager.smithi089 on smithi089 2024-09-13T22:02:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:11 smithi159 ceph-mon[35348]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:11.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:11 smithi159 ceph-mon[35348]: Reconfiguring alertmanager.smithi089 (dependencies changed)... 2024-09-13T22:02:11.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:11 smithi159 ceph-mon[35348]: Reconfiguring daemon alertmanager.smithi089 on smithi089 2024-09-13T22:02:13.340 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:13 smithi089 ceph-mon[27921]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:13.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:13 smithi159 ceph-mon[35348]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:13.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.855+0000 7fd844df2640 1 -- 172.21.15.89:0/674022064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 msgr2=0x7fd8400ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:13.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.855+0000 7fd844df2640 1 --2- 172.21.15.89:0/674022064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 0x7fd8400ff290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd834009880 tx=0x7fd83402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:02:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.855+0000 7fd844df2640 1 -- 172.21.15.89:0/674022064 shutdown_connections 2024-09-13T22:02:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.855+0000 7fd844df2640 1 --2- 172.21.15.89:0/674022064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 0x7fd8400ff290 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.855+0000 7fd844df2640 1 --2- 172.21.15.89:0/674022064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8400fe4f0 0x7fd8400fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.855+0000 7fd844df2640 1 -- 172.21.15.89:0/674022064 >> 172.21.15.89:0/674022064 conn(0x7fd8400fa280 msgr2=0x7fd8400fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:02:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.855+0000 7fd844df2640 1 -- 172.21.15.89:0/674022064 shutdown_connections 2024-09-13T22:02:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.855+0000 7fd844df2640 1 -- 172.21.15.89:0/674022064 wait complete. 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd844df2640 1 Processor -- start 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd844df2640 1 -- start start 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd844df2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8400fe4f0 0x7fd840197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd844df2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 0x7fd840197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd844df2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8401983a0 con 0x7fd8400fee30 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd844df2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd840198510 con 0x7fd8400fe4f0 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd83dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 0x7fd840197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd83dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 0x7fd840197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34650/0 (socket says 172.21.15.89:34650) 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd83dd9b640 1 -- 172.21.15.89:0/599637754 learned_addr learned my addr 172.21.15.89:0/599637754 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd83e59c640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8400fe4f0 0x7fd840197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:02:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd83dd9b640 1 -- 172.21.15.89:0/599637754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8400fe4f0 msgr2=0x7fd840197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd83dd9b640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8400fe4f0 0x7fd840197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.856+0000 7fd83dd9b640 1 -- 172.21.15.89:0/599637754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834009560 con 0x7fd8400fee30 2024-09-13T22:02:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.857+0000 7fd83dd9b640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 0x7fd840197dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd8340055f0 tx=0x7fd834005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:02:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.857+0000 7fd82f7fe640 1 -- 172.21.15.89:0/599637754 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd834004b20 con 0x7fd8400fee30 2024-09-13T22:02:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.857+0000 7fd82f7fe640 1 -- 172.21.15.89:0/599637754 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd834004c80 con 0x7fd8400fee30 2024-09-13T22:02:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.857+0000 7fd82f7fe640 1 -- 172.21.15.89:0/599637754 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd834003bc0 con 0x7fd8400fee30 2024-09-13T22:02:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.857+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84019cf50 con 0x7fd8400fee30 2024-09-13T22:02:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.857+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84019d410 con 0x7fd8400fee30 2024-09-13T22:02:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.858+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd840191980 con 0x7fd8400fee30 2024-09-13T22:02:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.859+0000 7fd82f7fe640 1 -- 172.21.15.89:0/599637754 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fd834031640 con 0x7fd8400fee30 2024-09-13T22:02:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.859+0000 7fd82f7fe640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd82806cbc0 0x7fd82806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:02:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.859+0000 7fd82f7fe640 1 -- 172.21.15.89:0/599637754 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd8340ac370 con 0x7fd8400fee30 2024-09-13T22:02:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.859+0000 7fd83e59c640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd82806cbc0 0x7fd82806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:02:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.860+0000 7fd83e59c640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd82806cbc0 0x7fd82806f080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd830005fd0 tx=0x7fd830005e20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:02:13.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:13.866+0000 7fd82f7fe640 1 -- 172.21.15.89:0/599637754 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd8340778a0 con 0x7fd8400fee30 2024-09-13T22:02:14.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:14.042+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd84002c4f0 con 0x7fd82806cbc0 2024-09-13T22:02:14.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:14 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:02:14.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:14 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:02:14.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:14 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:14.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:14 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:02:14.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:14 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:02:14.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:14 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:15.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:15 smithi089 ceph-mon[27921]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:02:15.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:15 smithi089 ceph-mon[27921]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:15.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:15 smithi159 ceph-mon[35348]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:02:15.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:15 smithi159 ceph-mon[35348]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:17.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:17 smithi089 ceph-mon[27921]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:17.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:17 smithi159 ceph-mon[35348]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:18.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:18.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:18.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:18 smithi089 ceph-mon[27921]: Reconfiguring grafana.smithi089 (dependencies changed)... 2024-09-13T22:02:18.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:18 smithi089 ceph-mon[27921]: Reconfiguring daemon grafana.smithi089 on smithi089 2024-09-13T22:02:18.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:18 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2665851788' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b302bbb3-37e7-4684-8f1b-71b4eb70a687"}]: dispatch 2024-09-13T22:02:18.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:18 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2665851788' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b302bbb3-37e7-4684-8f1b-71b4eb70a687"}]': finished 2024-09-13T22:02:18.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:18 smithi089 ceph-mon[27921]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T22:02:18.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:18.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:18.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:18.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:18 smithi159 ceph-mon[35348]: Reconfiguring grafana.smithi089 (dependencies changed)... 2024-09-13T22:02:18.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:18 smithi159 ceph-mon[35348]: Reconfiguring daemon grafana.smithi089 on smithi089 2024-09-13T22:02:18.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:18 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2665851788' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b302bbb3-37e7-4684-8f1b-71b4eb70a687"}]: dispatch 2024-09-13T22:02:18.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:18 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2665851788' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b302bbb3-37e7-4684-8f1b-71b4eb70a687"}]': finished 2024-09-13T22:02:18.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:18 smithi159 ceph-mon[35348]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T22:02:18.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:19.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:19 smithi089 ceph-mon[27921]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:19.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:19 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1215859866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:02:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:19 smithi159 ceph-mon[35348]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:19 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/1215859866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:02:21.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:21 smithi159 ceph-mon[35348]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:21 smithi089 ceph-mon[27921]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:23.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:23 smithi159 ceph-mon[35348]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:23.742 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:23 smithi089 ceph-mon[27921]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:24.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:02:24.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:02:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:25 smithi089 ceph-mon[27921]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:25.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:25 smithi159 ceph-mon[35348]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:27.528 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:27 smithi089 ceph-mon[27921]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:27.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:27 smithi159 ceph-mon[35348]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:28.745 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:28.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:28.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:28 smithi089 ceph-mon[27921]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T22:02:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:28 smithi159 ceph-mon[35348]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T22:02:29.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:29 smithi089 ceph-mon[27921]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T22:02:29.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:29 smithi089 ceph-mon[27921]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:29.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:02:29.670 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:29 smithi159 ceph-mon[35348]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T22:02:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:29 smithi159 ceph-mon[35348]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:29 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:02:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:29 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:30.524 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:30 smithi089 ceph-mon[27921]: Deploying daemon osd.0 on smithi089 2024-09-13T22:02:30.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:30 smithi159 ceph-mon[35348]: Deploying daemon osd.0 on smithi089 2024-09-13T22:02:31.660 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:31 smithi159 ceph-mon[35348]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:31.682 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:31 smithi089 ceph-mon[27921]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:33.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:33 smithi089 ceph-mon[27921]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:33.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:33 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:33.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:33 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:33.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:33 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:02:33.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:33 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:33.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:33 smithi159 ceph-mon[35348]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:33.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:33 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:33.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:33 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:33.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:33 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:02:33.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:33 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:34.696 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:34 smithi089 ceph-mon[27921]: Reconfiguring ceph-exporter.smithi159 (monmap changed)... 2024-09-13T22:02:34.697 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:34 smithi089 ceph-mon[27921]: Reconfiguring daemon ceph-exporter.smithi159 on smithi159 2024-09-13T22:02:34.697 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:34.697 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:34.697 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:02:34.697 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:34.705 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:34 smithi159 ceph-mon[35348]: Reconfiguring ceph-exporter.smithi159 (monmap changed)... 2024-09-13T22:02:34.705 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:34 smithi159 ceph-mon[35348]: Reconfiguring daemon ceph-exporter.smithi159 on smithi159 2024-09-13T22:02:34.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:34 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:34.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:34 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:34.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:34 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:02:34.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:34 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:35.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:35 smithi089 ceph-mon[27921]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:35.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:35 smithi089 ceph-mon[27921]: Reconfiguring crash.smithi159 (monmap changed)... 2024-09-13T22:02:35.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:35 smithi089 ceph-mon[27921]: Reconfiguring daemon crash.smithi159 on smithi159 2024-09-13T22:02:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:35 smithi159 ceph-mon[35348]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:35 smithi159 ceph-mon[35348]: Reconfiguring crash.smithi159 (monmap changed)... 2024-09-13T22:02:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:35 smithi159 ceph-mon[35348]: Reconfiguring daemon crash.smithi159 on smithi159 2024-09-13T22:02:36.797 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:36 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:36.797 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:36 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:36.797 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:36 smithi089 ceph-mon[27921]: Reconfiguring mgr.smithi159.ghpomd (monmap changed)... 2024-09-13T22:02:36.797 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:36 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:02:36.797 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:36 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:02:36.797 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:36 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:36.797 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:36 smithi089 ceph-mon[27921]: Reconfiguring daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:02:36.798 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:36 smithi089 ceph-mon[27921]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:36 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:36 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:36 smithi159 ceph-mon[35348]: Reconfiguring mgr.smithi159.ghpomd (monmap changed)... 2024-09-13T22:02:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:36 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:02:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:36 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:02:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:36 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:36 smithi159 ceph-mon[35348]: Reconfiguring daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:02:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:36 smithi159 ceph-mon[35348]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:37 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:37 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:37 smithi159 ceph-mon[35348]: Reconfiguring mon.smithi159 (monmap changed)... 2024-09-13T22:02:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:37 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:02:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:37 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:02:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:37 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:38.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:37 smithi159 ceph-mon[35348]: Reconfiguring daemon mon.smithi159 on smithi159 2024-09-13T22:02:38.108 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:37 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:38.108 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:37 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:38.108 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:37 smithi089 ceph-mon[27921]: Reconfiguring mon.smithi159 (monmap changed)... 2024-09-13T22:02:38.108 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:37 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:02:38.109 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:37 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:02:38.109 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:37 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:38.109 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:37 smithi089 ceph-mon[27921]: Reconfiguring daemon mon.smithi159 on smithi159 2024-09-13T22:02:39.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:02:39.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:02:39.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T22:02:39.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T22:02:39.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:02:39.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:02:39.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T22:02:39.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T22:02:39.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:02:39.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:02:39.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T22:02:39.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T22:02:39.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:39.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:38 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:02:39.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:02:39.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:02:39.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T22:02:39.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T22:02:39.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:02:39.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:02:39.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T22:02:39.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T22:02:39.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:02:39.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:02:39.262 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T22:02:39.263 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T22:02:39.263 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:39.263 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:39.263 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:38 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:02:40.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:02:40.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:40.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:40.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:02:40.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:40.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:40.907 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 0 on host 'smithi089' 2024-09-13T22:02:40.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.904+0000 7fd82f7fe640 1 -- 172.21.15.89:0/599637754 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd84002c4f0 con 0x7fd82806cbc0 2024-09-13T22:02:40.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd82806cbc0 msgr2=0x7fd82806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:40.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd82806cbc0 0x7fd82806f080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd830005fd0 tx=0x7fd830005e20 comp rx=0 tx=0).stop 2024-09-13T22:02:40.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 msgr2=0x7fd840197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:40.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 0x7fd840197dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd8340055f0 tx=0x7fd834005620 comp rx=0 tx=0).stop 2024-09-13T22:02:40.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 shutdown_connections 2024-09-13T22:02:40.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd82806cbc0 0x7fd82806f080 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:40.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8400fee30 0x7fd840197dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:40.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 --2- 172.21.15.89:0/599637754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8400fe4f0 0x7fd840197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:40.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 >> 172.21.15.89:0/599637754 conn(0x7fd8400fa280 msgr2=0x7fd840106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:02:40.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 shutdown_connections 2024-09-13T22:02:40.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:40.906+0000 7fd844df2640 1 -- 172.21.15.89:0/599637754 wait complete. 2024-09-13T22:02:41.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:41 smithi089 ceph-mon[27921]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:41.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:41 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:41.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:41 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:41.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:41 smithi159 ceph-mon[35348]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:41.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:41 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:41.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:41 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:41.839 DEBUG:teuthology.orchestra.run.smithi089:osd.0> sudo journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T22:02:41.841 INFO:tasks.cephadm:Deploying osd.1 on smithi089 with /dev/vg_nvme/lv_3... 2024-09-13T22:02:41.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T22:02:42.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:42 smithi089 ceph-mon[27921]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:02:42.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:42 smithi159 ceph-mon[35348]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:02:43.345 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:02:43.466 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:43 smithi089 ceph-mon[27921]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T22:02:43.466 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:43 smithi089 ceph-mon[27921]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T22:02:43.466 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:43 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:43.466 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:43 smithi089 ceph-mon[27921]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:02:43.466 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:43 smithi089 ceph-mon[27921]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:43 smithi159 ceph-mon[35348]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T22:02:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:43 smithi159 ceph-mon[35348]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T22:02:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:43 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:43 smithi159 ceph-mon[35348]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:02:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:43 smithi159 ceph-mon[35348]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:44.149 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:02:43 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[46186]: 2024-09-13T22:02:43.981+0000 7f7772149640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T22:02:44.149 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:02:43 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[46186]: 2024-09-13T22:02:43.990+0000 7f776a77c640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:02:44.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:44 smithi089 ceph-mon[27921]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T22:02:44.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:44 smithi089 ceph-mon[27921]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T22:02:44.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:44.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:44.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:44 smithi089 ceph-mon[27921]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' 2024-09-13T22:02:44.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:44 smithi159 ceph-mon[35348]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T22:02:44.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:44 smithi159 ceph-mon[35348]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T22:02:44.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:44.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:44.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:44 smithi159 ceph-mon[35348]: from='osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419]' entity='osd.0' 2024-09-13T22:02:45.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:45 smithi089 ceph-mon[27921]: purged_snaps scrub starts 2024-09-13T22:02:45.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:45 smithi089 ceph-mon[27921]: purged_snaps scrub ok 2024-09-13T22:02:45.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:45 smithi089 ceph-mon[27921]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:45.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:45 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:45.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:45 smithi089 ceph-mon[27921]: osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] boot 2024-09-13T22:02:45.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:45 smithi089 ceph-mon[27921]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T22:02:45.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:45 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:45.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:45 smithi159 ceph-mon[35348]: purged_snaps scrub starts 2024-09-13T22:02:45.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:45 smithi159 ceph-mon[35348]: purged_snaps scrub ok 2024-09-13T22:02:45.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:45 smithi159 ceph-mon[35348]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:02:45.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:45 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:45.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:45 smithi159 ceph-mon[35348]: osd.0 [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] boot 2024-09-13T22:02:45.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:45 smithi159 ceph-mon[35348]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T22:02:45.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:45 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:02:47.115 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:47 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:47.116 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:47 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:47.116 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:47 smithi089 ceph-mon[27921]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:47.116 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:47 smithi089 ceph-mon[27921]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T22:02:47.118 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:02:47.137 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_3 2024-09-13T22:02:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:47 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:47 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:47 smithi159 ceph-mon[35348]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:47 smithi159 ceph-mon[35348]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T22:02:47.928 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:02:49.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:49 smithi089 ceph-mon[27921]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:49.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:49 smithi159 ceph-mon[35348]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:49.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.931+0000 7f809421d640 1 -- 172.21.15.89:0/2336476267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 msgr2=0x7f808c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.931+0000 7f809421d640 1 --2- 172.21.15.89:0/2336476267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 0x7f808c0fff90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f807c009880 tx=0x7f807c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.931+0000 7f809421d640 1 -- 172.21.15.89:0/2336476267 shutdown_connections 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.931+0000 7f809421d640 1 --2- 172.21.15.89:0/2336476267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c100d90 0x7f808c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.931+0000 7f809421d640 1 --2- 172.21.15.89:0/2336476267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 0x7f808c0fff90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.931+0000 7f809421d640 1 -- 172.21.15.89:0/2336476267 >> 172.21.15.89:0/2336476267 conn(0x7f808c0fb320 msgr2=0x7f808c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.931+0000 7f809421d640 1 -- 172.21.15.89:0/2336476267 shutdown_connections 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.931+0000 7f809421d640 1 -- 172.21.15.89:0/2336476267 wait complete. 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f809421d640 1 Processor -- start 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f809421d640 1 -- start start 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f809421d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 0x7f808c1956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f809421d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c100d90 0x7f808c195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:02:49.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f809421d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c196200 con 0x7f808c0ffb90 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f809421d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c196370 con 0x7f808c100d90 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f8091fb9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 0x7f808c1956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f8091fb9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 0x7f808c1956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50428/0 (socket says 172.21.15.89:50428) 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f8091fb9640 1 -- 172.21.15.89:0/2086345349 learned_addr learned my addr 172.21.15.89:0/2086345349 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f80917b8640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c100d90 0x7f808c195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f8091fb9640 1 -- 172.21.15.89:0/2086345349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c100d90 msgr2=0x7f808c195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f8091fb9640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c100d90 0x7f808c195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f8091fb9640 1 -- 172.21.15.89:0/2086345349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c009560 con 0x7f808c0ffb90 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.932+0000 7f80917b8640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c100d90 0x7f808c195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:02:49.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.933+0000 7f8091fb9640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 0x7f808c1956f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f807c005610 tx=0x7f807c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:02:49.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.933+0000 7f8082ffd640 1 -- 172.21.15.89:0/2086345349 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f807c004ba0 con 0x7f808c0ffb90 2024-09-13T22:02:49.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.933+0000 7f8082ffd640 1 -- 172.21.15.89:0/2086345349 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f807c004d00 con 0x7f808c0ffb90 2024-09-13T22:02:49.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.933+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c19adb0 con 0x7f808c0ffb90 2024-09-13T22:02:49.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.933+0000 7f8082ffd640 1 -- 172.21.15.89:0/2086345349 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f807c003bd0 con 0x7f808c0ffb90 2024-09-13T22:02:49.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.933+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c19b2c0 con 0x7f808c0ffb90 2024-09-13T22:02:49.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.934+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c108800 con 0x7f808c0ffb90 2024-09-13T22:02:49.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.934+0000 7f8082ffd640 1 -- 172.21.15.89:0/2086345349 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f807c031640 con 0x7f808c0ffb90 2024-09-13T22:02:49.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.935+0000 7f8082ffd640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f807806cbd0 0x7f807806f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:02:49.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.935+0000 7f8082ffd640 1 -- 172.21.15.89:0/2086345349 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f807c0ac6f0 con 0x7f808c0ffb90 2024-09-13T22:02:49.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.935+0000 7f80917b8640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f807806cbd0 0x7f807806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:02:49.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.935+0000 7f80917b8640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f807806cbd0 0x7f807806f090 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8088006fd0 tx=0x7f8088008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:02:49.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:49.939+0000 7f8082ffd640 1 -- 172.21.15.89:0/2086345349 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f807c077940 con 0x7f808c0ffb90 2024-09-13T22:02:50.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:02:50.111+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f808c19b4e0 con 0x7f807806cbd0 2024-09-13T22:02:50.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:50 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:02:50.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:50 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:02:50.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:50 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:50.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:50 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:02:50.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:50 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:02:50.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:50 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:51.471 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:51 smithi089 ceph-mon[27921]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:02:51.471 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:51 smithi089 ceph-mon[27921]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:51.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:51 smithi159 ceph-mon[35348]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:02:51.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:51 smithi159 ceph-mon[35348]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:52.990 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: Detected new or changed devices on smithi089 2024-09-13T22:02:52.990 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:52.990 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:52.990 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:02:52.990 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: Adjusting osd_memory_target on smithi089 to 11839M 2024-09-13T22:02:52.991 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:52.991 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:52.991 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:02:52.991 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:52.991 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:02:52.991 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:52 smithi089 ceph-mon[27921]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: Detected new or changed devices on smithi089 2024-09-13T22:02:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:02:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: Adjusting osd_memory_target on smithi089 to 11839M 2024-09-13T22:02:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:02:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:02:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:52 smithi159 ceph-mon[35348]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:53.864 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:53 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1432123534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9bde342-70cc-40ec-b320-82a9fec55c04"}]: dispatch 2024-09-13T22:02:53.864 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:53 smithi089 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9bde342-70cc-40ec-b320-82a9fec55c04"}]: dispatch 2024-09-13T22:02:53.864 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:53 smithi089 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9bde342-70cc-40ec-b320-82a9fec55c04"}]': finished 2024-09-13T22:02:53.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:53 smithi089 ceph-mon[27921]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T22:02:53.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:53 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:02:53.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:53 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:53.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:53 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:53 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/1432123534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9bde342-70cc-40ec-b320-82a9fec55c04"}]: dispatch 2024-09-13T22:02:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:53 smithi159 ceph-mon[35348]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9bde342-70cc-40ec-b320-82a9fec55c04"}]: dispatch 2024-09-13T22:02:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:53 smithi159 ceph-mon[35348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9bde342-70cc-40ec-b320-82a9fec55c04"}]': finished 2024-09-13T22:02:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:53 smithi159 ceph-mon[35348]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T22:02:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:02:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:54 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2764248366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:02:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:54 smithi089 ceph-mon[27921]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:02:55.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:54 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2764248366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:02:55.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:54 smithi159 ceph-mon[35348]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:55.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:02:57.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:57 smithi089 ceph-mon[27921]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:57.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:57.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:57.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:57.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:02:57.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:57 smithi159 ceph-mon[35348]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:02:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:02:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:02:59.741 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:02:59 smithi089 ceph-mon[27921]: pgmap v46: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:02:59.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:02:59 smithi159 ceph-mon[35348]: pgmap v46: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:00.741 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:00 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:03:00.741 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:00 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:00.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:00 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:03:00.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:00 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:01.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:01 smithi159 ceph-mon[35348]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:01.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:01 smithi159 ceph-mon[35348]: Deploying daemon osd.1 on smithi089 2024-09-13T22:03:01.818 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:01 smithi089 ceph-mon[27921]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:01.818 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:01 smithi089 ceph-mon[27921]: Deploying daemon osd.1 on smithi089 2024-09-13T22:03:03.624 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:03 smithi089 ceph-mon[27921]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:03.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:03 smithi159 ceph-mon[35348]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:05.682 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:05 smithi089 ceph-mon[27921]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:05.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:05 smithi159 ceph-mon[35348]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:06.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:06 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:06.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:06 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:06.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:06 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:06.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:06 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:06.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:06 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:06.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:06 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:07.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:07 smithi089 ceph-mon[27921]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:07.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:07 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:07.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:07 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:07 smithi159 ceph-mon[35348]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:07 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:07 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:09.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:09 smithi089 ceph-mon[27921]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:09.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:03:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.709+0000 7f8082ffd640 1 -- 172.21.15.89:0/2086345349 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f808c19b4e0 con 0x7f807806cbd0 2024-09-13T22:03:09.711 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 1 on host 'smithi089' 2024-09-13T22:03:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f807806cbd0 msgr2=0x7f807806f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:03:09.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f807806cbd0 0x7f807806f090 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8088006fd0 tx=0x7f8088008040 comp rx=0 tx=0).stop 2024-09-13T22:03:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 msgr2=0x7f808c1956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:03:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 0x7f808c1956f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f807c005610 tx=0x7f807c005640 comp rx=0 tx=0).stop 2024-09-13T22:03:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 shutdown_connections 2024-09-13T22:03:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f807806cbd0 0x7f807806f090 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c100d90 0x7f808c195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 --2- 172.21.15.89:0/2086345349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f808c0ffb90 0x7f808c1956f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 >> 172.21.15.89:0/2086345349 conn(0x7f808c0fb320 msgr2=0x7f808c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:03:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 shutdown_connections 2024-09-13T22:03:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:09.711+0000 7f809421d640 1 -- 172.21.15.89:0/2086345349 wait complete. 2024-09-13T22:03:10.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:09 smithi159 ceph-mon[35348]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:10.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:03:10.342 DEBUG:teuthology.orchestra.run.smithi089:osd.1> sudo journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T22:03:10.345 INFO:tasks.cephadm:Deploying osd.2 on smithi089 with /dev/vg_nvme/lv_2... 2024-09-13T22:03:10.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T22:03:10.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:10 smithi089 ceph-mon[27921]: from='osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:03:10.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:10 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:10.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:10 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:11.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:10 smithi159 ceph-mon[35348]: from='osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:03:11.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:10 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:11.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:10 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:11.051 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:03:11.929 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:11 smithi089 ceph-mon[27921]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:11.930 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:11 smithi089 ceph-mon[27921]: from='osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T22:03:11.930 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:11 smithi089 ceph-mon[27921]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T22:03:11.930 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:11.930 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:11 smithi089 ceph-mon[27921]: from='osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:03:11.930 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:11 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[53606]: 2024-09-13T22:03:11.526+0000 7f9649db2640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T22:03:11.930 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:11 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[53606]: 2024-09-13T22:03:11.532+0000 7f96463ed640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:03:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:11 smithi159 ceph-mon[35348]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:11 smithi159 ceph-mon[35348]: from='osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T22:03:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:11 smithi159 ceph-mon[35348]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T22:03:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:11 smithi159 ceph-mon[35348]: from='osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:03:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:12 smithi159 ceph-mon[35348]: from='osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T22:03:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:12 smithi159 ceph-mon[35348]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T22:03:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:12 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:12 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:12.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:12 smithi089 ceph-mon[27921]: from='osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T22:03:12.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:12 smithi089 ceph-mon[27921]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T22:03:12.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:12 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:12.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:12 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:13.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:13 smithi089 ceph-mon[27921]: purged_snaps scrub starts 2024-09-13T22:03:13.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:13 smithi089 ceph-mon[27921]: purged_snaps scrub ok 2024-09-13T22:03:13.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:13 smithi089 ceph-mon[27921]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:13.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:13 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:13.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:13 smithi089 ceph-mon[27921]: osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] boot 2024-09-13T22:03:13.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:13 smithi089 ceph-mon[27921]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T22:03:13.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:13 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:13.869 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:13 smithi159 ceph-mon[35348]: purged_snaps scrub starts 2024-09-13T22:03:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:13 smithi159 ceph-mon[35348]: purged_snaps scrub ok 2024-09-13T22:03:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:13 smithi159 ceph-mon[35348]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:03:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:13 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:13 smithi159 ceph-mon[35348]: osd.1 [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] boot 2024-09-13T22:03:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:13 smithi159 ceph-mon[35348]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T22:03:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:13 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:03:14.722 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:14 smithi089 ceph-mon[27921]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T22:03:14.722 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:14 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:14.722 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:14 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:14.722 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:14 smithi089 ceph-mon[27921]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:14 smithi159 ceph-mon[35348]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T22:03:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:14 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:14 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:14 smithi159 ceph-mon[35348]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:15.423 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:03:15.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_2 2024-09-13T22:03:16.470 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:03:17.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:17 smithi089 ceph-mon[27921]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:17.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:17 smithi159 ceph-mon[35348]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:18.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.730+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1642147249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80fea80 msgr2=0x7fb9e80fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:03:18.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.730+0000 7fb9ef6ef640 1 --2- 172.21.15.89:0/1642147249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80fea80 0x7fb9e80fee80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009880 tx=0x7fb9d802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.730+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1642147249 shutdown_connections 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.730+0000 7fb9ef6ef640 1 --2- 172.21.15.89:0/1642147249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e80ffc80 0x7fb9e8100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.730+0000 7fb9ef6ef640 1 --2- 172.21.15.89:0/1642147249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80fea80 0x7fb9e80fee80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.730+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1642147249 >> 172.21.15.89:0/1642147249 conn(0x7fb9e80fa230 msgr2=0x7fb9e80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.730+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1642147249 shutdown_connections 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.730+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1642147249 wait complete. 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ef6ef640 1 Processor -- start 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ef6ef640 1 -- start start 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ef6ef640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e80fea80 0x7fb9e8106a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ef6ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80ffc80 0x7fb9e8105080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:03:18.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ef6ef640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e81055c0 con 0x7fb9e80ffc80 2024-09-13T22:03:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ef6ef640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8105730 con 0x7fb9e80fea80 2024-09-13T22:03:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ecc8a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80ffc80 0x7fb9e8105080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:03:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ecc8a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80ffc80 0x7fb9e8105080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49012/0 (socket says 172.21.15.89:49012) 2024-09-13T22:03:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ecc8a640 1 -- 172.21.15.89:0/1944581863 learned_addr learned my addr 172.21.15.89:0/1944581863 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:03:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ed48b640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e80fea80 0x7fb9e8106a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:03:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ecc8a640 1 -- 172.21.15.89:0/1944581863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e80fea80 msgr2=0x7fb9e8106a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:03:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ecc8a640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e80fea80 0x7fb9e8106a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ecc8a640 1 -- 172.21.15.89:0/1944581863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8009560 con 0x7fb9e80ffc80 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9ecc8a640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80ffc80 0x7fb9e8105080 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400b420 tx=0x7fb9e400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.731+0000 7fb9de7fc640 1 -- 172.21.15.89:0/1944581863 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9e4011800 con 0x7fb9e80ffc80 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.732+0000 7fb9de7fc640 1 -- 172.21.15.89:0/1944581863 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9e4011e20 con 0x7fb9e80ffc80 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.732+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e8105a10 con 0x7fb9e80ffc80 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.732+0000 7fb9de7fc640 1 -- 172.21.15.89:0/1944581863 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9e400f2e0 con 0x7fb9e80ffc80 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.732+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e819d790 con 0x7fb9e80ffc80 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.733+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e80fef00 con 0x7fb9e80ffc80 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.733+0000 7fb9de7fc640 1 -- 172.21.15.89:0/1944581863 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fb9e4010380 con 0x7fb9e80ffc80 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.734+0000 7fb9de7fc640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb9d406cbc0 0x7fb9d406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.734+0000 7fb9ed48b640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb9d406cbc0 0x7fb9d406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:03:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.734+0000 7fb9de7fc640 1 -- 172.21.15.89:0/1944581863 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7fb9e408aeb0 con 0x7fb9e80ffc80 2024-09-13T22:03:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.734+0000 7fb9ed48b640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb9d406cbc0 0x7fb9d406f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802a9c0 tx=0x7fb9d8000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:03:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.738+0000 7fb9de7fc640 1 -- 172.21.15.89:0/1944581863 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb9e4055f50 con 0x7fb9e80ffc80 2024-09-13T22:03:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:18.919+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9e81045d0 con 0x7fb9d406cbc0 2024-09-13T22:03:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: Detected new or changed devices on smithi089 2024-09-13T22:03:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: Adjusting osd_memory_target on smithi089 to 5919M 2024-09-13T22:03:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:03:18.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:18.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:18.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:18 smithi089 ceph-mon[27921]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:19.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: Detected new or changed devices on smithi089 2024-09-13T22:03:19.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:19.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:19.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:19.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:19.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: Adjusting osd_memory_target on smithi089 to 5919M 2024-09-13T22:03:19.143 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:19.144 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:19.144 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:03:19.144 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:19.144 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:19.144 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:18 smithi159 ceph-mon[35348]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:19.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:19 smithi089 ceph-mon[27921]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:03:19.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:19 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:03:19.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:19 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:03:19.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:19 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:19.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:19 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:19.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:19 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:20.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:19 smithi159 ceph-mon[35348]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:03:20.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:19 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:03:20.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:19 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:03:20.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:19 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:20.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:19 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:20.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:19 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:21.216 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:20 smithi089 ceph-mon[27921]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:21.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:20 smithi159 ceph-mon[35348]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:23.445 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:23 smithi089 ceph-mon[27921]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:23.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:23 smithi159 ceph-mon[35348]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:24.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3238736292' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d8ac3d0-8a46-49d2-89fd-322227c2d9e6"}]: dispatch 2024-09-13T22:03:24.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3238736292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d8ac3d0-8a46-49d2-89fd-322227c2d9e6"}]': finished 2024-09-13T22:03:24.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T22:03:24.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:24.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:24.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:24.443 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:24.443 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:03:24.443 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:24.443 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:03:24.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3238736292' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d8ac3d0-8a46-49d2-89fd-322227c2d9e6"}]: dispatch 2024-09-13T22:03:24.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3238736292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d8ac3d0-8a46-49d2-89fd-322227c2d9e6"}]': finished 2024-09-13T22:03:24.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T22:03:24.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:24.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:24.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:24.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:24.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:03:24.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:24.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:03:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:25 smithi089 ceph-mon[27921]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:25 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3879290376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:03:25.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:25 smithi159 ceph-mon[35348]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:25.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:25 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3879290376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:03:27.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:27 smithi089 ceph-mon[27921]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:27.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:27 smithi159 ceph-mon[35348]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:29.393 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:29 smithi089 ceph-mon[27921]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:29.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:29 smithi159 ceph-mon[35348]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:31.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:31 smithi089 ceph-mon[27921]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:31.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:03:31.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:31.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:31 smithi159 ceph-mon[35348]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:31.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:03:31.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:32.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:32 smithi089 ceph-mon[27921]: Deploying daemon osd.2 on smithi089 2024-09-13T22:03:32.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:32 smithi159 ceph-mon[35348]: Deploying daemon osd.2 on smithi089 2024-09-13T22:03:33.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:33 smithi089 ceph-mon[27921]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:33 smithi159 ceph-mon[35348]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:35.444 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:35 smithi089 ceph-mon[27921]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:35.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:35 smithi159 ceph-mon[35348]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:36.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:36 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:36.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:36 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:36.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:36 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:36 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:36 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:36 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:37.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:37 smithi089 ceph-mon[27921]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:37.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:37 smithi159 ceph-mon[35348]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:38.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.935+0000 7fb9de7fc640 1 -- 172.21.15.89:0/1944581863 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb9e81045d0 con 0x7fb9d406cbc0 2024-09-13T22:03:38.936 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 2 on host 'smithi089' 2024-09-13T22:03:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb9d406cbc0 msgr2=0x7fb9d406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:03:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb9d406cbc0 0x7fb9d406f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802a9c0 tx=0x7fb9d8000bc0 comp rx=0 tx=0).stop 2024-09-13T22:03:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80ffc80 msgr2=0x7fb9e8105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:03:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80ffc80 0x7fb9e8105080 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400b420 tx=0x7fb9e400b8e0 comp rx=0 tx=0).stop 2024-09-13T22:03:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 shutdown_connections 2024-09-13T22:03:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb9d406cbc0 0x7fb9d406f080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e80ffc80 0x7fb9e8105080 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 --2- 172.21.15.89:0/1944581863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9e80fea80 0x7fb9e8106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 >> 172.21.15.89:0/1944581863 conn(0x7fb9e80fa230 msgr2=0x7fb9e8102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:03:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 shutdown_connections 2024-09-13T22:03:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:03:38.937+0000 7fb9ef6ef640 1 -- 172.21.15.89:0/1944581863 wait complete. 2024-09-13T22:03:39.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:39 smithi089 ceph-mon[27921]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:39.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:39 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:39.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:39 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:39.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:39 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:03:39.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:39 smithi159 ceph-mon[35348]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:39.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:39 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:39.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:39 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:39.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:39 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:03:39.912 DEBUG:teuthology.orchestra.run.smithi089:osd.2> sudo journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T22:03:39.915 INFO:tasks.cephadm:Deploying osd.3 on smithi159 with /dev/vg_nvme/lv_4... 2024-09-13T22:03:39.915 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T22:03:40.124 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi159/config 2024-09-13T22:03:40.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:40 smithi089 ceph-mon[27921]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:03:40.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:40 smithi159 ceph-mon[35348]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:03:41.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:41 smithi089 ceph-mon[27921]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:41.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:41 smithi089 ceph-mon[27921]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T22:03:41.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:41 smithi089 ceph-mon[27921]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T22:03:41.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:41 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:41.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:41 smithi089 ceph-mon[27921]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:03:41.376 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:41 smithi159 ceph-mon[35348]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:41.376 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:41 smithi159 ceph-mon[35348]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T22:03:41.376 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:41 smithi159 ceph-mon[35348]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T22:03:41.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:41 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:41.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:41 smithi159 ceph-mon[35348]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:03:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:03:42.481 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_4 2024-09-13T22:03:42.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:42 smithi089 ceph-mon[27921]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T22:03:42.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:42 smithi089 ceph-mon[27921]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T22:03:42.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:42 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:42.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:42 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:42.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:42 smithi089 ceph-mon[27921]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' 2024-09-13T22:03:42.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:42 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[61195]: 2024-09-13T22:03:42.063+0000 7fc97c07e640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T22:03:42.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:42 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[61195]: 2024-09-13T22:03:42.072+0000 7fc9746b1640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:03:42.500 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:42 smithi159 ceph-mon[35348]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T22:03:42.500 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:42 smithi159 ceph-mon[35348]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T22:03:42.500 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:42 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:42.500 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:42 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:42.500 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:42 smithi159 ceph-mon[35348]: from='osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294]' entity='osd.2' 2024-09-13T22:03:42.680 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi159/config 2024-09-13T22:03:43.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:43 smithi159 ceph-mon[35348]: purged_snaps scrub starts 2024-09-13T22:03:43.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:43 smithi159 ceph-mon[35348]: purged_snaps scrub ok 2024-09-13T22:03:43.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:43 smithi159 ceph-mon[35348]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:43.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:43 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:43.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:43 smithi159 ceph-mon[35348]: osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] boot 2024-09-13T22:03:43.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:43 smithi159 ceph-mon[35348]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T22:03:43.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:43 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:43.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:43 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:43.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:43 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:43.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:43 smithi089 ceph-mon[27921]: purged_snaps scrub starts 2024-09-13T22:03:43.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:43 smithi089 ceph-mon[27921]: purged_snaps scrub ok 2024-09-13T22:03:43.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:43 smithi089 ceph-mon[27921]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:03:43.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:43 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:43.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:43 smithi089 ceph-mon[27921]: osd.2 [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] boot 2024-09-13T22:03:43.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:43 smithi089 ceph-mon[27921]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T22:03:43.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:43 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:03:43.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:43 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:43.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:43 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.171+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/1497636642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 msgr2=0x7f2e040fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:03:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.171+0000 7f2e0ba7a640 1 --2- 172.21.15.159:0/1497636642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 0x7f2e040fe250 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009880 tx=0x7f2e0002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:03:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.171+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/1497636642 shutdown_connections 2024-09-13T22:03:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.171+0000 7f2e0ba7a640 1 --2- 172.21.15.159:0/1497636642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e04100e30 0x7f2e041012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.171+0000 7f2e0ba7a640 1 --2- 172.21.15.159:0/1497636642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 0x7f2e040fe250 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.171+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/1497636642 >> 172.21.15.159:0/1497636642 conn(0x7f2e040f99c0 msgr2=0x7f2e040fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.171+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/1497636642 shutdown_connections 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.171+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/1497636642 wait complete. 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e0ba7a640 1 Processor -- start 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e0ba7a640 1 -- start start 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e0ba7a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 0x7f2e04100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e0ba7a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e04100e30 0x7f2e040fede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e0ba7a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040ff320 con 0x7f2e04100e30 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e0ba7a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040ff490 con 0x7f2e040fde50 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e09816640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 0x7f2e04100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:03:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e09816640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 0x7f2e04100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39090/0 (socket says 172.21.15.159:39090) 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e09816640 1 -- 172.21.15.159:0/730237660 learned_addr learned my addr 172.21.15.159:0/730237660 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e09015640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e04100e30 0x7f2e040fede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e09816640 1 -- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e04100e30 msgr2=0x7f2e040fede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e09816640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e04100e30 0x7f2e040fede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e09816640 1 -- 172.21.15.159:0/730237660 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00009560 con 0x7f2e040fde50 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.172+0000 7f2e09015640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e04100e30 0x7f2e040fede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.173+0000 7f2e09816640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 0x7f2e04100790 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2e0002a9c0 tx=0x7f2e000054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.173+0000 7f2dfaffd640 1 -- 172.21.15.159:0/730237660 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e00004aa0 con 0x7f2e040fde50 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.173+0000 7f2dfaffd640 1 -- 172.21.15.159:0/730237660 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e00004c00 con 0x7f2e040fde50 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.173+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e040ff710 con 0x7f2e040fde50 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.173+0000 7f2dfaffd640 1 -- 172.21.15.159:0/730237660 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e00003a80 con 0x7f2e040fde50 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.173+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0419d670 con 0x7f2e040fde50 2024-09-13T22:03:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.174+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e040fe250 con 0x7f2e040fde50 2024-09-13T22:03:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.174+0000 7f2dfaffd640 1 -- 172.21.15.159:0/730237660 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f2e00003d40 con 0x7f2e040fde50 2024-09-13T22:03:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.175+0000 7f2dfaffd640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2df006cbd0 0x7f2df006f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:03:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.175+0000 7f2dfaffd640 1 -- 172.21.15.159:0/730237660 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2846+0+0 (secure 0 0 0) 0x7f2e000ac8e0 con 0x7f2e040fde50 2024-09-13T22:03:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.175+0000 7f2e09015640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2df006cbd0 0x7f2df006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:03:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.175+0000 7f2e09015640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2df006cbd0 0x7f2df006f090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2df40058c0 tx=0x7f2df4005850 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:03:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.179+0000 7f2dfaffd640 1 -- 172.21.15.159:0/730237660 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e000777d0 con 0x7f2e040fde50 2024-09-13T22:03:44.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:44.350+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e04105780 con 0x7f2df006cbd0 2024-09-13T22:03:44.601 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:03:44.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:03:44.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:03:44.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T22:03:44.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:44 smithi089 ceph-mon[27921]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T22:03:44.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:44.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:03:44.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:03:44.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:03:44.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:03:44.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T22:03:44.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:44 smithi159 ceph-mon[35348]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T22:03:44.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:44.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:03:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:45 smithi159 ceph-mon[35348]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:45 smithi159 ceph-mon[35348]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:03:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:45 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T22:03:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:45 smithi159 ceph-mon[35348]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T22:03:45.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:45 smithi089 ceph-mon[27921]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:45.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:45 smithi089 ceph-mon[27921]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:03:45.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:45 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T22:03:45.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:45 smithi089 ceph-mon[27921]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T22:03:46.150 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65769]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:03:46.150 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65769]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:46.150 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:46.150 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65769]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:46.496 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65893]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:03:46.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65893]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:46.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:46.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65893]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:46.882 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65928]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:03:46.882 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65928]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:46.882 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:46.882 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65928]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:46.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:03:46.933+0000 7f2dfaffd640 1 -- 172.21.15.159:0/730237660 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2e00031c70 con 0x7f2e040fde50 2024-09-13T22:03:47.145 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65942]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:03:47.145 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65942]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:47.145 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:47.145 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:03:46 smithi089 sudo[65942]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: Detected new or changed devices on smithi089 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: Adjusting osd_memory_target on smithi089 to 3946M 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:03:47.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:47.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:47.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T22:03:47.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/115722653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b46e232-93af-4dc8-b581-5c913182e388"}]: dispatch 2024-09-13T22:03:47.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b46e232-93af-4dc8-b581-5c913182e388"}]: dispatch 2024-09-13T22:03:47.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b46e232-93af-4dc8-b581-5c913182e388"}]': finished 2024-09-13T22:03:47.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T22:03:47.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:46 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: Detected new or changed devices on smithi089 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: Adjusting osd_memory_target on smithi089 to 3946M 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:47.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/115722653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b46e232-93af-4dc8-b581-5c913182e388"}]: dispatch 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b46e232-93af-4dc8-b581-5c913182e388"}]: dispatch 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b46e232-93af-4dc8-b581-5c913182e388"}]': finished 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T22:03:47.250 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:46 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:03:47.407 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[65999]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:03:47.408 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[65999]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:47.408 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[65999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:47.408 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[65999]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:47.660 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66049]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:03:47.660 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66049]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:47.660 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:47.660 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66049]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:47.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66072]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:03:47.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66072]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:47.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:47.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66072]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:48.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66106]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:03:48.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66106]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:48.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:48.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:47 smithi089 sudo[66106]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:48.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 sudo[39485]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:03:48.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 sudo[39485]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:48.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 sudo[39485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:48.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 sudo[39485]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:48.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:48 smithi089 ceph-mon[27921]: mgrmap e19: smithi089.naneiw(active, since 2m), standbys: smithi159.ghpomd 2024-09-13T22:03:48.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:48 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/2961708935' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:03:48.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:48 smithi089 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:03:48.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:48 smithi089 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:03:48.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:48 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:03:48.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:48 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:03:48.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:48 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:03:48.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:48 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:03:48.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 sudo[39672]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:03:48.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 sudo[39672]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:03:48.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 sudo[39672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T22:03:48.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 sudo[39672]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:03:48.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 ceph-mon[35348]: mgrmap e19: smithi089.naneiw(active, since 2m), standbys: smithi159.ghpomd 2024-09-13T22:03:48.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/2961708935' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:03:48.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 ceph-mon[35348]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:03:48.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 ceph-mon[35348]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:03:48.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:03:48.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:03:48.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:03:48.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:48 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:03:49.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:49 smithi089 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:03:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:49 smithi089 ceph-mon[27921]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:49 smithi089 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:03:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:49 smithi159 ceph-mon[35348]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:03:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:49 smithi159 ceph-mon[35348]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:49 smithi159 ceph-mon[35348]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:03:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:49 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:51.171 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:50 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:51.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:50 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:51.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:50 smithi159 ceph-mon[35348]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:51.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:50 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:51.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:50 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:03:51.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:50 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:51.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:50 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:51.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:50 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:51.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:50 smithi089 ceph-mon[27921]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:51.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:50 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:51.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:50 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:03:51.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:50 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:53.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:53 smithi159 ceph-mon[35348]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:53.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:53 smithi089 ceph-mon[27921]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:54.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T22:03:54.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:54.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:03:54.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T22:03:54.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:03:54.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:03:55.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:55 smithi159 ceph-mon[35348]: Deploying daemon osd.3 on smithi159 2024-09-13T22:03:55.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:55 smithi159 ceph-mon[35348]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:55.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:55 smithi089 ceph-mon[27921]: Deploying daemon osd.3 on smithi159 2024-09-13T22:03:55.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:55 smithi089 ceph-mon[27921]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:57.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:57 smithi089 ceph-mon[27921]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:57.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:57 smithi159 ceph-mon[35348]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:59.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:59 smithi089 ceph-mon[27921]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:59.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:59 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:59.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:59 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:59.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:03:59 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:59 smithi159 ceph-mon[35348]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:03:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:59 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:03:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:59 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:03:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:03:59 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:01.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:01 smithi159 ceph-mon[35348]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:04:01.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.381+0000 7f2dfaffd640 1 -- 172.21.15.159:0/730237660 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2e04105780 con 0x7f2df006cbd0 2024-09-13T22:04:01.383 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 3 on host 'smithi159' 2024-09-13T22:04:01.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2df006cbd0 msgr2=0x7f2df006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:01.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2df006cbd0 0x7f2df006f090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2df40058c0 tx=0x7f2df4005850 comp rx=0 tx=0).stop 2024-09-13T22:04:01.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 msgr2=0x7f2e04100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:01.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 0x7f2e04100790 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2e0002a9c0 tx=0x7f2e000054f0 comp rx=0 tx=0).stop 2024-09-13T22:04:01.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 shutdown_connections 2024-09-13T22:04:01.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2df006cbd0 0x7f2df006f090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:01.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e04100e30 0x7f2e040fede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:01.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 --2- 172.21.15.159:0/730237660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e040fde50 0x7f2e04100790 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:01.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 >> 172.21.15.159:0/730237660 conn(0x7f2e040f99c0 msgr2=0x7f2e04104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:04:01.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 shutdown_connections 2024-09-13T22:04:01.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:01.383+0000 7f2e0ba7a640 1 -- 172.21.15.159:0/730237660 wait complete. 2024-09-13T22:04:01.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:01 smithi089 ceph-mon[27921]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:04:02.014 DEBUG:teuthology.orchestra.run.smithi159:osd.3> sudo journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T22:04:02.057 INFO:tasks.cephadm:Deploying osd.4 on smithi159 with /dev/vg_nvme/lv_3... 2024-09-13T22:04:02.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T22:04:02.383 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi159/config 2024-09-13T22:04:02.574 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:02.574 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:02 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:02.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:02.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:02 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:03.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:04:02 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[41282]: 2024-09-13T22:04:02.570+0000 7f83cca1b640 -1 osd.3 0 log_to_monitors true 2024-09-13T22:04:03.672 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:03 smithi159 ceph-mon[35348]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:04:03.672 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:03 smithi159 ceph-mon[35348]: from='osd.3 [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:04:03.672 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:03 smithi159 ceph-mon[35348]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:04:03.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:03 smithi089 ceph-mon[27921]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:04:03.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:03 smithi089 ceph-mon[27921]: from='osd.3 [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:04:03.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:03 smithi089 ceph-mon[27921]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:04:04.677 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:04 smithi159 ceph-mon[35348]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T22:04:04.678 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:04 smithi159 ceph-mon[35348]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T22:04:04.678 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:04 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:04.678 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:04 smithi159 ceph-mon[35348]: from='osd.3 [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:04.678 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:04 smithi159 ceph-mon[35348]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:04.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:04 smithi089 ceph-mon[27921]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T22:04:04.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:04 smithi089 ceph-mon[27921]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T22:04:04.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:04 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:04.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:04 smithi089 ceph-mon[27921]: from='osd.3 [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:04.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:04 smithi089 ceph-mon[27921]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:05.340 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:04:05.358 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[41282]: 2024-09-13T22:04:05.215+0000 7f83c8179640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T22:04:05.358 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[41282]: 2024-09-13T22:04:05.223+0000 7f83c07ac640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:04:05.360 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_3 2024-09-13T22:04:05.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-mon[35348]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:04:05.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-mon[35348]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-13T22:04:05.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-mon[35348]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T22:04:05.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:05.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:05.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:05.683 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:05.683 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:05 smithi159 ceph-mon[35348]: from='osd.3 ' entity='osd.3' 2024-09-13T22:04:05.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:05 smithi089 ceph-mon[27921]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:04:05.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:05 smithi089 ceph-mon[27921]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-13T22:04:05.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:05 smithi089 ceph-mon[27921]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T22:04:05.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:05 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:05.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:05 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:05.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:05 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:05.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:05 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:05.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:05 smithi089 ceph-mon[27921]: from='osd.3 ' entity='osd.3' 2024-09-13T22:04:06.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:06 smithi159 ceph-mon[35348]: purged_snaps scrub starts 2024-09-13T22:04:06.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:06 smithi159 ceph-mon[35348]: purged_snaps scrub ok 2024-09-13T22:04:06.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:06 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:06.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:06 smithi159 ceph-mon[35348]: osd.3 [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] boot 2024-09-13T22:04:06.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:06 smithi159 ceph-mon[35348]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T22:04:06.676 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:06 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:06.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:06 smithi089 ceph-mon[27921]: purged_snaps scrub starts 2024-09-13T22:04:06.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:06 smithi089 ceph-mon[27921]: purged_snaps scrub ok 2024-09-13T22:04:06.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:06 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:06.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:06 smithi089 ceph-mon[27921]: osd.3 [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] boot 2024-09-13T22:04:06.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:06 smithi089 ceph-mon[27921]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T22:04:06.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:06 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:04:06.876 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi159/config 2024-09-13T22:04:07.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:07 smithi159 ceph-mon[35348]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:04:07.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:07 smithi159 ceph-mon[35348]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T22:04:07.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:07 smithi089 ceph-mon[27921]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:04:07.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:07 smithi089 ceph-mon[27921]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T22:04:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T22:04:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:08.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:08.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:08.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:08.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:08 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:08.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T22:04:08.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:08.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:08.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:08.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:08.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:08.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:08.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:08.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:08.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:08.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:08.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:08 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:09.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 -- 172.21.15.159:0/1852959125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c0ffb90 msgr2=0x7f450c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 --2- 172.21.15.159:0/1852959125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c0ffb90 0x7f450c0fff90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4508009880 tx=0x7f450802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 -- 172.21.15.159:0/1852959125 shutdown_connections 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 --2- 172.21.15.159:0/1852959125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450c100d90 0x7f450c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 --2- 172.21.15.159:0/1852959125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c0ffb90 0x7f450c0fff90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 -- 172.21.15.159:0/1852959125 >> 172.21.15.159:0/1852959125 conn(0x7f450c0fb320 msgr2=0x7f450c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 -- 172.21.15.159:0/1852959125 shutdown_connections 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 -- 172.21.15.159:0/1852959125 wait complete. 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 Processor -- start 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 -- start start 2024-09-13T22:04:09.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450c0ffb90 0x7f450c195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c100d90 0x7f450c195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c196150 con 0x7f450c0ffb90 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.098+0000 7f4513419640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c1962c0 con 0x7f450c100d90 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45109b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c100d90 0x7f450c195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45109b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c100d90 0x7f450c195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50468/0 (socket says 172.21.15.159:50468) 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45109b4640 1 -- 172.21.15.159:0/699590086 learned_addr learned my addr 172.21.15.159:0/699590086 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45111b5640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450c0ffb90 0x7f450c195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45109b4640 1 -- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450c0ffb90 msgr2=0x7f450c195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45109b4640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450c0ffb90 0x7f450c195640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:09.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45109b4640 1 -- 172.21.15.159:0/699590086 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508009560 con 0x7f450c100d90 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45109b4640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c100d90 0x7f450c195b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00d6f0 tx=0x7f44fc00dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45027fc640 1 -- 172.21.15.159:0/699590086 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44fc009a30 con 0x7f450c100d90 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c19ad60 con 0x7f450c100d90 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45027fc640 1 -- 172.21.15.159:0/699590086 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44fc0054e0 con 0x7f450c100d90 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f45027fc640 1 -- 172.21.15.159:0/699590086 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44fc010460 con 0x7f450c100d90 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.099+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c19b330 con 0x7f450c100d90 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.100+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c18f730 con 0x7f450c100d90 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.101+0000 7f45027fc640 1 -- 172.21.15.159:0/699590086 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f44fc009b90 con 0x7f450c100d90 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.101+0000 7f45027fc640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f44f806cc50 0x7f44f806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.101+0000 7f45027fc640 1 -- 172.21.15.159:0/699590086 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f44fc08b650 con 0x7f450c100d90 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.102+0000 7f45111b5640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f44f806cc50 0x7f44f806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:09.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.102+0000 7f45111b5640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f44f806cc50 0x7f44f806f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4508009230 tx=0x7f45080314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:04:09.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.106+0000 7f45027fc640 1 -- 172.21.15.159:0/699590086 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f44fc056170 con 0x7f450c100d90 2024-09-13T22:04:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:09.279+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f450c02c4f0 con 0x7f44f806cc50 2024-09-13T22:04:09.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:09 smithi159 ceph-mon[35348]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:09.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:09 smithi159 ceph-mon[35348]: Detected new or changed devices on smithi159 2024-09-13T22:04:09.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:09 smithi159 ceph-mon[35348]: Adjusting osd_memory_target on smithi159 to 14912M 2024-09-13T22:04:09.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:09 smithi159 ceph-mon[35348]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T22:04:09.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:04:09.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:04:09.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:04:09.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:09.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:09 smithi089 ceph-mon[27921]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:09.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:09 smithi089 ceph-mon[27921]: Detected new or changed devices on smithi159 2024-09-13T22:04:09.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:09 smithi089 ceph-mon[27921]: Adjusting osd_memory_target on smithi159 to 14912M 2024-09-13T22:04:09.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:09 smithi089 ceph-mon[27921]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T22:04:09.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:04:09.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:04:09.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:04:09.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:10.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:10 smithi159 ceph-mon[35348]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:04:10.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:10 smithi159 ceph-mon[35348]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T22:04:10.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:10 smithi089 ceph-mon[27921]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:04:10.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:10 smithi089 ceph-mon[27921]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T22:04:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:11 smithi159 ceph-mon[35348]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T22:04:11.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:11 smithi089 ceph-mon[27921]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T22:04:12.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:12 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/3374192194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc8f7bef-0f17-4b78-b650-9158f23c9b48"}]: dispatch 2024-09-13T22:04:12.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:12 smithi089 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc8f7bef-0f17-4b78-b650-9158f23c9b48"}]: dispatch 2024-09-13T22:04:12.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:12 smithi089 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc8f7bef-0f17-4b78-b650-9158f23c9b48"}]': finished 2024-09-13T22:04:12.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:12 smithi089 ceph-mon[27921]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T22:04:12.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:12 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:12.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:12 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/2186542623' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:04:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:12 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/3374192194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc8f7bef-0f17-4b78-b650-9158f23c9b48"}]: dispatch 2024-09-13T22:04:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:12 smithi159 ceph-mon[35348]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc8f7bef-0f17-4b78-b650-9158f23c9b48"}]: dispatch 2024-09-13T22:04:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:12 smithi159 ceph-mon[35348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc8f7bef-0f17-4b78-b650-9158f23c9b48"}]': finished 2024-09-13T22:04:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:12 smithi159 ceph-mon[35348]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T22:04:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:12 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:12 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/2186542623' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:04:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:13 smithi159 ceph-mon[35348]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-13T22:04:13.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:13 smithi089 ceph-mon[27921]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-13T22:04:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:15 smithi089 ceph-mon[27921]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T22:04:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:15 smithi159 ceph-mon[35348]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T22:04:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:17 smithi159 ceph-mon[35348]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-13T22:04:17.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:17 smithi089 ceph-mon[27921]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-13T22:04:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:19 smithi159 ceph-mon[35348]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:19.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:19 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T22:04:19.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:19 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:19.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:19 smithi159 ceph-mon[35348]: Deploying daemon osd.4 on smithi159 2024-09-13T22:04:19.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:19 smithi089 ceph-mon[27921]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:19.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:19 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T22:04:19.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:19 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:19.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:19 smithi089 ceph-mon[27921]: Deploying daemon osd.4 on smithi159 2024-09-13T22:04:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:21 smithi089 ceph-mon[27921]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:21.794 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:21 smithi159 ceph-mon[35348]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:23.839 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:23 smithi159 ceph-mon[35348]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:23.839 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:23 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:23.839 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:23 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:23.839 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:23 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:23.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:23 smithi089 ceph-mon[27921]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:23.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:23 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:23.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:23 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:23.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:23 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:24.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:04:24.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:04:25.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:25 smithi159 ceph-mon[35348]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:25.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:25 smithi089 ceph-mon[27921]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:27.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.271+0000 7f45027fc640 1 -- 172.21.15.159:0/699590086 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f450c02c4f0 con 0x7f44f806cc50 2024-09-13T22:04:27.273 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 4 on host 'smithi159' 2024-09-13T22:04:27.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f44f806cc50 msgr2=0x7f44f806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:27.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f44f806cc50 0x7f44f806f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4508009230 tx=0x7f45080314e0 comp rx=0 tx=0).stop 2024-09-13T22:04:27.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c100d90 msgr2=0x7f450c195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:27.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c100d90 0x7f450c195b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00d6f0 tx=0x7f44fc00dbb0 comp rx=0 tx=0).stop 2024-09-13T22:04:27.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 shutdown_connections 2024-09-13T22:04:27.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f44f806cc50 0x7f44f806f110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:27.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f450c100d90 0x7f450c195b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:27.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 --2- 172.21.15.159:0/699590086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450c0ffb90 0x7f450c195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:27.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 >> 172.21.15.159:0/699590086 conn(0x7f450c0fb320 msgr2=0x7f450c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:04:27.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 shutdown_connections 2024-09-13T22:04:27.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:27.274+0000 7f4513419640 1 -- 172.21.15.159:0/699590086 wait complete. 2024-09-13T22:04:27.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:27.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:27.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:27.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:27.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:27.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:27.867 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='osd.4 [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:04:27.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:04:27.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:27.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:27.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:27 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:27.890 DEBUG:teuthology.orchestra.run.smithi159:osd.4> sudo journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T22:04:27.893 INFO:tasks.cephadm:Deploying osd.5 on smithi159 with /dev/vg_nvme/lv_2... 2024-09-13T22:04:27.893 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T22:04:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='osd.4 [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:04:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:04:27.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:27.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:27.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:27 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:29.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:28 smithi159 ceph-mon[35348]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T22:04:29.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:28 smithi159 ceph-mon[35348]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T22:04:29.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:29.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:28 smithi159 ceph-mon[35348]: from='osd.4 [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:29.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:28 smithi159 ceph-mon[35348]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:29.141 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:28 smithi159 ceph-mon[35348]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:29.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:28 smithi089 ceph-mon[27921]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T22:04:29.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:28 smithi089 ceph-mon[27921]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T22:04:29.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:29.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:28 smithi089 ceph-mon[27921]: from='osd.4 [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:29.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:28 smithi089 ceph-mon[27921]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:29.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:28 smithi089 ceph-mon[27921]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:29.551 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi159/config 2024-09-13T22:04:29.938 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:29 smithi159 ceph-mon[35348]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-13T22:04:29.938 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:29 smithi159 ceph-mon[35348]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T22:04:29.938 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:29 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:29.939 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:29 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:29.939 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:29 smithi159 ceph-mon[35348]: from='osd.4 ' entity='osd.4' 2024-09-13T22:04:29.939 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:04:29 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[48145]: 2024-09-13T22:04:29.692+0000 7fe04d81a640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T22:04:29.939 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:04:29 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[48145]: 2024-09-13T22:04:29.703+0000 7fe044612640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:04:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:29 smithi089 ceph-mon[27921]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-13T22:04:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:29 smithi089 ceph-mon[27921]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T22:04:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:29 smithi089 ceph-mon[27921]: from='osd.4 ' entity='osd.4' 2024-09-13T22:04:31.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:30 smithi159 ceph-mon[35348]: purged_snaps scrub starts 2024-09-13T22:04:31.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:30 smithi159 ceph-mon[35348]: purged_snaps scrub ok 2024-09-13T22:04:31.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:30 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:31.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:30 smithi159 ceph-mon[35348]: osd.4 [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] boot 2024-09-13T22:04:31.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:30 smithi159 ceph-mon[35348]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T22:04:31.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:30 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:31.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:30 smithi159 ceph-mon[35348]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:31.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:30 smithi089 ceph-mon[27921]: purged_snaps scrub starts 2024-09-13T22:04:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:30 smithi089 ceph-mon[27921]: purged_snaps scrub ok 2024-09-13T22:04:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:30 smithi089 ceph-mon[27921]: osd.4 [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] boot 2024-09-13T22:04:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:30 smithi089 ceph-mon[27921]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T22:04:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:30 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:04:31.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:30 smithi089 ceph-mon[27921]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: Detected new or changed devices on smithi159 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: Adjusting osd_memory_target on smithi159 to 7456M 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:31.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:31.976 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: Detected new or changed devices on smithi159 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: Adjusting osd_memory_target on smithi159 to 7456M 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:32.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:32.589 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-13T22:04:32.609 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_2 2024-09-13T22:04:32.810 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi159/config 2024-09-13T22:04:33.196 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:32 smithi159 ceph-mon[35348]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:33.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:32 smithi089 ceph-mon[27921]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:34.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.434+0000 7f0d8ce50640 1 -- 172.21.15.159:0/4206119289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 msgr2=0x7f0d88100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:34.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.434+0000 7f0d8ce50640 1 --2- 172.21.15.159:0/4206119289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 0x7f0d88100170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009880 tx=0x7f0d7c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:04:34.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.434+0000 7f0d8ce50640 1 -- 172.21.15.159:0/4206119289 shutdown_connections 2024-09-13T22:04:34.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.434+0000 7f0d8ce50640 1 --2- 172.21.15.159:0/4206119289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 0x7f0d88100170 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:34.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.434+0000 7f0d8ce50640 1 --2- 172.21.15.159:0/4206119289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d880feaf0 0x7f0d880feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:34.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.434+0000 7f0d8ce50640 1 -- 172.21.15.159:0/4206119289 >> 172.21.15.159:0/4206119289 conn(0x7f0d880fa280 msgr2=0x7f0d880fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:04:34.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.434+0000 7f0d8ce50640 1 -- 172.21.15.159:0/4206119289 shutdown_connections 2024-09-13T22:04:34.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.434+0000 7f0d8ce50640 1 -- 172.21.15.159:0/4206119289 wait complete. 2024-09-13T22:04:34.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d8ce50640 1 Processor -- start 2024-09-13T22:04:34.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d8ce50640 1 -- start start 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d8ce50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d880feaf0 0x7f0d88068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d8ce50640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 0x7f0d8819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d8ce50640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8819aa00 con 0x7f0d880feaf0 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d8ce50640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8819ab40 con 0x7f0d880ffcf0 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d85d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 0x7f0d8819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d85d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 0x7f0d8819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35190/0 (socket says 172.21.15.159:35190) 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d85d9b640 1 -- 172.21.15.159:0/475687485 learned_addr learned my addr 172.21.15.159:0/475687485 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d8659c640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d880feaf0 0x7f0d88068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d85d9b640 1 -- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d880feaf0 msgr2=0x7f0d88068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d85d9b640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d880feaf0 0x7f0d88068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.435+0000 7f0d85d9b640 1 -- 172.21.15.159:0/475687485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c009560 con 0x7f0d880ffcf0 2024-09-13T22:04:34.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.436+0000 7f0d85d9b640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 0x7f0d8819a430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c006010 tx=0x7f0d7c0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:04:34.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.436+0000 7f0d777fe640 1 -- 172.21.15.159:0/475687485 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7c004aa0 con 0x7f0d880ffcf0 2024-09-13T22:04:34.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.436+0000 7f0d777fe640 1 -- 172.21.15.159:0/475687485 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d7c004c00 con 0x7f0d880ffcf0 2024-09-13T22:04:34.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.436+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8819ad90 con 0x7f0d880ffcf0 2024-09-13T22:04:34.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.436+0000 7f0d777fe640 1 -- 172.21.15.159:0/475687485 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7c0039b0 con 0x7f0d880ffcf0 2024-09-13T22:04:34.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.436+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8819b280 con 0x7f0d880ffcf0 2024-09-13T22:04:34.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.437+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8818e670 con 0x7f0d880ffcf0 2024-09-13T22:04:34.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.437+0000 7f0d777fe640 1 -- 172.21.15.159:0/475687485 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0d7c031c00 con 0x7f0d880ffcf0 2024-09-13T22:04:34.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.438+0000 7f0d777fe640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0d7006cc50 0x7f0d7006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:34.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.438+0000 7f0d777fe640 1 -- 172.21.15.159:0/475687485 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f0d7c0acee0 con 0x7f0d880ffcf0 2024-09-13T22:04:34.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.438+0000 7f0d8659c640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0d7006cc50 0x7f0d7006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:34.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.438+0000 7f0d8659c640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0d7006cc50 0x7f0d7006f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d78005fd0 tx=0x7f0d78005850 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:04:34.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.442+0000 7f0d777fe640 1 -- 172.21.15.159:0/475687485 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0d7c0777a0 con 0x7f0d880ffcf0 2024-09-13T22:04:34.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:34.611+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d8802c4f0 con 0x7f0d7006cc50 2024-09-13T22:04:35.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:35 smithi089 ceph-mon[27921]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:35.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:35 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:04:35.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:35 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:04:35.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:35 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:35.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:35 smithi159 ceph-mon[35348]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:35.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:35 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:04:35.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:35 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:04:35.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:35 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:36.485 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:36 smithi159 ceph-mon[35348]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:04:36.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:36 smithi089 ceph-mon[27921]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:04:37.382 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:37 smithi159 ceph-mon[35348]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:37.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:37 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/2657333256' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5dfaa561-43d5-428e-b6d3-a7e8dc317d34"}]: dispatch 2024-09-13T22:04:37.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:37 smithi159 ceph-mon[35348]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5dfaa561-43d5-428e-b6d3-a7e8dc317d34"}]: dispatch 2024-09-13T22:04:37.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:37 smithi159 ceph-mon[35348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5dfaa561-43d5-428e-b6d3-a7e8dc317d34"}]': finished 2024-09-13T22:04:37.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:37 smithi159 ceph-mon[35348]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T22:04:37.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:37 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:37 smithi089 ceph-mon[27921]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:37 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/2657333256' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5dfaa561-43d5-428e-b6d3-a7e8dc317d34"}]: dispatch 2024-09-13T22:04:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:37 smithi089 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5dfaa561-43d5-428e-b6d3-a7e8dc317d34"}]: dispatch 2024-09-13T22:04:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:37 smithi089 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5dfaa561-43d5-428e-b6d3-a7e8dc317d34"}]': finished 2024-09-13T22:04:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:37 smithi089 ceph-mon[27921]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T22:04:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:37 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:38.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:38 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/3792316733' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:04:38.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:38 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/3792316733' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:04:39.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:39 smithi089 ceph-mon[27921]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:39.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:39 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:04:39.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:39 smithi159 ceph-mon[35348]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:39.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:39 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:04:41.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:41 smithi089 ceph-mon[27921]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:41.508 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:41 smithi159 ceph-mon[35348]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:43 smithi159 ceph-mon[35348]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:43.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:43 smithi089 ceph-mon[27921]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:44.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T22:04:44.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:44 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:44.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T22:04:44.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:44 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:45.359 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:45 smithi159 ceph-mon[35348]: Deploying daemon osd.5 on smithi159 2024-09-13T22:04:45.359 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:45 smithi159 ceph-mon[35348]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:45.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:45 smithi089 ceph-mon[27921]: Deploying daemon osd.5 on smithi159 2024-09-13T22:04:45.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:45 smithi089 ceph-mon[27921]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:47.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:47 smithi159 ceph-mon[35348]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:47.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:47 smithi089 ceph-mon[27921]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:49.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:49 smithi159 ceph-mon[35348]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:49.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:49 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:49.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:49 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:49.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:49 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:49.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:49 smithi089 ceph-mon[27921]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:49 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:51.551 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:51 smithi159 ceph-mon[35348]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:51.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:51 smithi089 ceph-mon[27921]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:52.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.522+0000 7f0d777fe640 1 -- 172.21.15.159:0/475687485 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0d8802c4f0 con 0x7f0d7006cc50 2024-09-13T22:04:52.523 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 5 on host 'smithi159' 2024-09-13T22:04:52.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0d7006cc50 msgr2=0x7f0d7006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:52.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0d7006cc50 0x7f0d7006f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d78005fd0 tx=0x7f0d78005850 comp rx=0 tx=0).stop 2024-09-13T22:04:52.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 msgr2=0x7f0d8819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:52.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 0x7f0d8819a430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c006010 tx=0x7f0d7c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:04:52.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 shutdown_connections 2024-09-13T22:04:52.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f0d7006cc50 0x7f0d7006f110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:52.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d880ffcf0 0x7f0d8819a430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:52.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 --2- 172.21.15.159:0/475687485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d880feaf0 0x7f0d88068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:52.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 >> 172.21.15.159:0/475687485 conn(0x7f0d880fa280 msgr2=0x7f0d881033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:04:52.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 shutdown_connections 2024-09-13T22:04:52.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:04:52.524+0000 7f0d8ce50640 1 -- 172.21.15.159:0/475687485 wait complete. 2024-09-13T22:04:53.510 DEBUG:teuthology.orchestra.run.smithi159:osd.5> sudo journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T22:04:53.512 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T22:04:53.512 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T22:04:53.728 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:04:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:53 smithi159 ceph-mon[35348]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:53 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:53 smithi159 ceph-mon[35348]: from='osd.5 [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:04:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:53 smithi159 ceph-mon[35348]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:04:53.850 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:53 smithi089 ceph-mon[27921]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:53.850 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:53 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:53.850 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:53 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:53.850 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:53 smithi089 ceph-mon[27921]: from='osd.5 [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:04:53.850 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:53 smithi089 ceph-mon[27921]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:04:54.666 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:54 smithi159 ceph-mon[35348]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T22:04:54.666 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:54 smithi159 ceph-mon[35348]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T22:04:54.666 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:54.666 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:54 smithi159 ceph-mon[35348]: from='osd.5 [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:54.666 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:54 smithi159 ceph-mon[35348]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:54.666 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:54.666 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:54.667 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:04:54.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:54 smithi089 ceph-mon[27921]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T22:04:54.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:54 smithi089 ceph-mon[27921]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T22:04:54.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:54.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:54 smithi089 ceph-mon[27921]: from='osd.5 [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:54.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:54 smithi089 ceph-mon[27921]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:04:54.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:54.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:54.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:04:55.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.486+0000 7fcab9291640 1 -- 172.21.15.89:0/2422579204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40ffca0 msgr2=0x7fcab4100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:55.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.486+0000 7fcab9291640 1 --2- 172.21.15.89:0/2422579204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40ffca0 0x7fcab4100120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009c20 tx=0x7fcaa802a970 comp rx=0 tx=0).stop 2024-09-13T22:04:55.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.486+0000 7fcab9291640 1 -- 172.21.15.89:0/2422579204 shutdown_connections 2024-09-13T22:04:55.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.486+0000 7fcab9291640 1 --2- 172.21.15.89:0/2422579204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40ffca0 0x7fcab4100120 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:55.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.486+0000 7fcab9291640 1 --2- 172.21.15.89:0/2422579204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcab40feaa0 0x7fcab40feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:55.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.486+0000 7fcab9291640 1 -- 172.21.15.89:0/2422579204 >> 172.21.15.89:0/2422579204 conn(0x7fcab40fa250 msgr2=0x7fcab40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:04:55.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.486+0000 7fcab9291640 1 -- 172.21.15.89:0/2422579204 shutdown_connections 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.486+0000 7fcab9291640 1 -- 172.21.15.89:0/2422579204 wait complete. 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.486+0000 7fcab9291640 1 Processor -- start 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab9291640 1 -- start start 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab9291640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40feaa0 0x7fcab4195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab9291640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcab40ffca0 0x7fcab4195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab9291640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4196240 con 0x7fcab40feaa0 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab9291640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab41963b0 con 0x7fcab40ffca0 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40feaa0 0x7fcab4195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40feaa0 0x7fcab4195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42030/0 (socket says 172.21.15.89:42030) 2024-09-13T22:04:55.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab2ffd640 1 -- 172.21.15.89:0/3633907138 learned_addr learned my addr 172.21.15.89:0/3633907138 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab27fc640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcab40ffca0 0x7fcab4195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab2ffd640 1 -- 172.21.15.89:0/3633907138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcab40ffca0 msgr2=0x7fcab4195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab2ffd640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcab40ffca0 0x7fcab4195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab2ffd640 1 -- 172.21.15.89:0/3633907138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8009900 con 0x7fcab40feaa0 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.487+0000 7fcab2ffd640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40feaa0 0x7fcab4195730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00b400 tx=0x7fcaac00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.488+0000 7fca9bfff640 1 -- 172.21.15.89:0/3633907138 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaac011800 con 0x7fcab40feaa0 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.488+0000 7fca9bfff640 1 -- 172.21.15.89:0/3633907138 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcaac011e20 con 0x7fcab40feaa0 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.488+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab419ae50 con 0x7fcab40feaa0 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.488+0000 7fca9bfff640 1 -- 172.21.15.89:0/3633907138 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaac00f2e0 con 0x7fcab40feaa0 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.488+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab419b390 con 0x7fcab40feaa0 2024-09-13T22:04:55.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.489+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab40fef20 con 0x7fcab40feaa0 2024-09-13T22:04:55.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.489+0000 7fca9bfff640 1 -- 172.21.15.89:0/3633907138 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcaac010380 con 0x7fcab40feaa0 2024-09-13T22:04:55.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.490+0000 7fca9bfff640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fca9c06cc50 0x7fca9c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:55.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.490+0000 7fca9bfff640 1 -- 172.21.15.89:0/3633907138 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4358+0+0 (secure 0 0 0) 0x7fcaac08bad0 con 0x7fcab40feaa0 2024-09-13T22:04:55.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.490+0000 7fcab27fc640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fca9c06cc50 0x7fca9c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:55.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.490+0000 7fcab27fc640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fca9c06cc50 0x7fca9c06f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcab4196c50 tx=0x7fcaa8003970 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:04:55.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.494+0000 7fca9bfff640 1 -- 172.21.15.89:0/3633907138 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcaac0562f0 con 0x7fcab40feaa0 2024-09-13T22:04:55.531 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:04:55 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[54928]: 2024-09-13T22:04:55.373+0000 7f1087da0640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T22:04:55.531 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:04:55 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[54928]: 2024-09-13T22:04:55.383+0000 7f10803d3640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:04:55.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.662+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fcab4107730 con 0x7fcab40feaa0 2024-09-13T22:04:55.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:55 smithi089 ceph-mon[27921]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:55.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:55 smithi089 ceph-mon[27921]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-13T22:04:55.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:55 smithi089 ceph-mon[27921]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T22:04:55.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:55 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:55.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:55 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:55.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:55 smithi089 ceph-mon[27921]: from='osd.5 ' entity='osd.5' 2024-09-13T22:04:55.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.662+0000 7fca9bfff640 1 -- 172.21.15.89:0/3633907138 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7fcaac059910 con 0x7fcab40feaa0 2024-09-13T22:04:55.665 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:04:55.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fca9c06cc50 msgr2=0x7fca9c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:55.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fca9c06cc50 0x7fca9c06f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcab4196c50 tx=0x7fcaa8003970 comp rx=0 tx=0).stop 2024-09-13T22:04:55.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40feaa0 msgr2=0x7fcab4195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:55.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40feaa0 0x7fcab4195730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00b400 tx=0x7fcaac00b8c0 comp rx=0 tx=0).stop 2024-09-13T22:04:55.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 shutdown_connections 2024-09-13T22:04:55.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fca9c06cc50 0x7fca9c06f110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:55.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcab40ffca0 0x7fcab4195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:55.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 --2- 172.21.15.89:0/3633907138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcab40feaa0 0x7fcab4195730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:55.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 >> 172.21.15.89:0/3633907138 conn(0x7fcab40fa250 msgr2=0x7fcab40fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:04:55.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 shutdown_connections 2024-09-13T22:04:55.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:55.665+0000 7fcab9291640 1 -- 172.21.15.89:0/3633907138 wait complete. 2024-09-13T22:04:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:55 smithi159 ceph-mon[35348]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:56.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:55 smithi159 ceph-mon[35348]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-13T22:04:56.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:55 smithi159 ceph-mon[35348]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T22:04:56.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:55 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:56.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:55 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:56.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:55 smithi159 ceph-mon[35348]: from='osd.5 ' entity='osd.5' 2024-09-13T22:04:56.353 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1726265069,"num_in_osds":6,"osd_in_since":1726265076,"num_remapped_pgs":0} 2024-09-13T22:04:56.610 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:56 smithi089 ceph-mon[27921]: purged_snaps scrub starts 2024-09-13T22:04:56.610 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:56 smithi089 ceph-mon[27921]: purged_snaps scrub ok 2024-09-13T22:04:56.610 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:56 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:56.611 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:56 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3633907138' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T22:04:56.611 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:56 smithi089 ceph-mon[27921]: osd.5 [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] boot 2024-09-13T22:04:56.611 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:56 smithi089 ceph-mon[27921]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T22:04:56.611 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:56 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:56.885 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:56 smithi159 ceph-mon[35348]: purged_snaps scrub starts 2024-09-13T22:04:56.885 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:56 smithi159 ceph-mon[35348]: purged_snaps scrub ok 2024-09-13T22:04:56.885 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:56 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:56.885 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:56 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3633907138' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T22:04:56.886 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:56 smithi159 ceph-mon[35348]: osd.5 [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] boot 2024-09-13T22:04:56.886 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:56 smithi159 ceph-mon[35348]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T22:04:56.886 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:56 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:04:57.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T22:04:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:04:57.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:57.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:57.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:57.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:57.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:57.861 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:57.861 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:57.861 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:57.861 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:57.861 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:57.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:57.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:57.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:57.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:58.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:04:58.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:04:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:04:58.924 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:58 smithi089 ceph-mon[27921]: Detected new or changed devices on smithi159 2024-09-13T22:04:58.924 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:58 smithi089 ceph-mon[27921]: Adjusting osd_memory_target on smithi159 to 4970M 2024-09-13T22:04:58.924 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:58 smithi089 ceph-mon[27921]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T22:04:59.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:58 smithi159 ceph-mon[35348]: Detected new or changed devices on smithi159 2024-09-13T22:04:59.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:58 smithi159 ceph-mon[35348]: Adjusting osd_memory_target on smithi159 to 4970M 2024-09-13T22:04:59.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:58 smithi159 ceph-mon[35348]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T22:04:59.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.263+0000 7f93c6e14640 1 -- 172.21.15.89:0/1234121372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 msgr2=0x7f93c00fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:59.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.263+0000 7f93c6e14640 1 --2- 172.21.15.89:0/1234121372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 0x7f93c00fee80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009880 tx=0x7f93b402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:04:59.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.263+0000 7f93c6e14640 1 -- 172.21.15.89:0/1234121372 shutdown_connections 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.263+0000 7f93c6e14640 1 --2- 172.21.15.89:0/1234121372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c00ffc80 0x7f93c0100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.263+0000 7f93c6e14640 1 --2- 172.21.15.89:0/1234121372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 0x7f93c00fee80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.263+0000 7f93c6e14640 1 -- 172.21.15.89:0/1234121372 >> 172.21.15.89:0/1234121372 conn(0x7f93c00fa230 msgr2=0x7f93c00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.263+0000 7f93c6e14640 1 -- 172.21.15.89:0/1234121372 shutdown_connections 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.263+0000 7f93c6e14640 1 -- 172.21.15.89:0/1234121372 wait complete. 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c6e14640 1 Processor -- start 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c6e14640 1 -- start start 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c6e14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 0x7f93c01956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c6e14640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c00ffc80 0x7f93c0195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c6e14640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c01961f0 con 0x7f93c00fea80 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c6e14640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0196360 con 0x7f93c00ffc80 2024-09-13T22:04:59.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c4bb0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 0x7f93c01956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c4bb0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 0x7f93c01956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42044/0 (socket says 172.21.15.89:42044) 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c4bb0640 1 -- 172.21.15.89:0/3497390167 learned_addr learned my addr 172.21.15.89:0/3497390167 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93bffff640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c00ffc80 0x7f93c0195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c4bb0640 1 -- 172.21.15.89:0/3497390167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c00ffc80 msgr2=0x7f93c0195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c4bb0640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c00ffc80 0x7f93c0195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c4bb0640 1 -- 172.21.15.89:0/3497390167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4009560 con 0x7f93c00fea80 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93bffff640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c00ffc80 0x7f93c0195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c4bb0640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 0x7f93c01956e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005610 tx=0x7f93b4005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93bdffb640 1 -- 172.21.15.89:0/3497390167 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b4004ba0 con 0x7f93c00fea80 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.264+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c019ada0 con 0x7f93c00fea80 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.265+0000 7f93bdffb640 1 -- 172.21.15.89:0/3497390167 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93b4004d00 con 0x7f93c00fea80 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.265+0000 7f93bdffb640 1 -- 172.21.15.89:0/3497390167 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b4003bd0 con 0x7f93c00fea80 2024-09-13T22:04:59.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.265+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c019b2b0 con 0x7f93c00fea80 2024-09-13T22:04:59.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.266+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c0068e00 con 0x7f93c00fea80 2024-09-13T22:04:59.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.266+0000 7f93bdffb640 1 -- 172.21.15.89:0/3497390167 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f93b4031640 con 0x7f93c00fea80 2024-09-13T22:04:59.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.267+0000 7f93bdffb640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f93b006cc50 0x7f93b006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:04:59.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.267+0000 7f93bdffb640 1 -- 172.21.15.89:0/3497390167 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f93b40ad240 con 0x7f93c00fea80 2024-09-13T22:04:59.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.267+0000 7f93bffff640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f93b006cc50 0x7f93b006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:04:59.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.267+0000 7f93bffff640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f93b006cc50 0x7f93b006f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93ac006fd0 tx=0x7f93ac008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:04:59.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.271+0000 7f93bdffb640 1 -- 172.21.15.89:0/3497390167 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f93b4077950 con 0x7f93c00fea80 2024-09-13T22:04:59.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.434+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f93c019b7b0 con 0x7f93c00fea80 2024-09-13T22:04:59.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.434+0000 7f93bdffb640 1 -- 172.21.15.89:0/3497390167 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f93b407af70 con 0x7f93c00fea80 2024-09-13T22:04:59.436 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f93b006cc50 msgr2=0x7f93b006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f93b006cc50 0x7f93b006f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93ac006fd0 tx=0x7f93ac008040 comp rx=0 tx=0).stop 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 msgr2=0x7f93c01956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 0x7f93c01956e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005610 tx=0x7f93b4005640 comp rx=0 tx=0).stop 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 shutdown_connections 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f93b006cc50 0x7f93b006f110 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93c00ffc80 0x7f93c0195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 --2- 172.21.15.89:0/3497390167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c00fea80 0x7f93c01956e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 >> 172.21.15.89:0/3497390167 conn(0x7f93c00fa230 msgr2=0x7f93c0102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 shutdown_connections 2024-09-13T22:04:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:04:59.436+0000 7f93c6e14640 1 -- 172.21.15.89:0/3497390167 wait complete. 2024-09-13T22:04:59.702 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:59 smithi089 ceph-mon[27921]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:04:59.703 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:04:59 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3497390167' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T22:04:59.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:59 smithi159 ceph-mon[35348]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:04:59.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:04:59 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3497390167' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T22:05:00.128 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726265096,"num_in_osds":6,"osd_in_since":1726265076,"num_remapped_pgs":0} 2024-09-13T22:05:00.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T22:05:00.327 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:00.736 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:00 smithi089 ceph-mon[27921]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:01.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:00 smithi159 ceph-mon[35348]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.938+0000 7fd7b4826640 1 -- 172.21.15.89:0/3517894799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 msgr2=0x7fd7b0104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.938+0000 7fd7b4826640 1 --2- 172.21.15.89:0/3517894799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 0x7fd7b0104e00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009880 tx=0x7fd7a802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.938+0000 7fd7b4826640 1 -- 172.21.15.89:0/3517894799 shutdown_connections 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.938+0000 7fd7b4826640 1 --2- 172.21.15.89:0/3517894799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b00fea20 0x7fd7b00fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.938+0000 7fd7b4826640 1 --2- 172.21.15.89:0/3517894799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 0x7fd7b0104e00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.938+0000 7fd7b4826640 1 -- 172.21.15.89:0/3517894799 >> 172.21.15.89:0/3517894799 conn(0x7fd7b00fa700 msgr2=0x7fd7b00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.938+0000 7fd7b4826640 1 -- 172.21.15.89:0/3517894799 shutdown_connections 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.938+0000 7fd7b4826640 1 -- 172.21.15.89:0/3517894799 wait complete. 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7b4826640 1 Processor -- start 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7b4826640 1 -- start start 2024-09-13T22:05:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7b4826640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b00fea20 0x7fd7b019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7b4826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 0x7fd7b019be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7b4826640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b0195950 con 0x7fd7b0104a20 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7b4826640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b0195a90 con 0x7fd7b00fea20 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7add9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 0x7fd7b019be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7add9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 0x7fd7b019be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42064/0 (socket says 172.21.15.89:42064) 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7add9b640 1 -- 172.21.15.89:0/3677666299 learned_addr learned my addr 172.21.15.89:0/3677666299 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.939+0000 7fd7ae59c640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b00fea20 0x7fd7b019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.940+0000 7fd7add9b640 1 -- 172.21.15.89:0/3677666299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b00fea20 msgr2=0x7fd7b019b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.940+0000 7fd7add9b640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b00fea20 0x7fd7b019b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.940+0000 7fd7add9b640 1 -- 172.21.15.89:0/3677666299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8009560 con 0x7fd7b0104a20 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.940+0000 7fd7add9b640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 0x7fd7b019be30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400db80 tx=0x7fd7a400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.940+0000 7fd79f7fe640 1 -- 172.21.15.89:0/3677666299 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a400de40 con 0x7fd7b0104a20 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.940+0000 7fd79f7fe640 1 -- 172.21.15.89:0/3677666299 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7a4003e30 con 0x7fd7b0104a20 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.940+0000 7fd79f7fe640 1 -- 172.21.15.89:0/3677666299 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a4010830 con 0x7fd7b0104a20 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.940+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b0195d70 con 0x7fd7b0104a20 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.940+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b01962c0 con 0x7fd7b0104a20 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.941+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b0100160 con 0x7fd7b0104a20 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.941+0000 7fd79f7fe640 1 -- 172.21.15.89:0/3677666299 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd7a4004020 con 0x7fd7b0104a20 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.942+0000 7fd79f7fe640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd79806cc50 0x7fd79806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.942+0000 7fd79f7fe640 1 -- 172.21.15.89:0/3677666299 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd7a408c100 con 0x7fd7b0104a20 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.942+0000 7fd7ae59c640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd79806cc50 0x7fd79806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.942+0000 7fd7ae59c640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd79806cc50 0x7fd79806f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009230 tx=0x7fd7a80058d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:01.946+0000 7fd79f7fe640 1 -- 172.21.15.89:0/3677666299 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd7a4056890 con 0x7fd7b0104a20 2024-09-13T22:05:02.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.111+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7b010bc90 con 0x7fd7b0104a20 2024-09-13T22:05:02.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.112+0000 7fd79f7fe640 1 -- 172.21.15.89:0/3677666299 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11335 (secure 0 0 0) 0x7fd7a40042d0 con 0x7fd7b0104a20 2024-09-13T22:05:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:05:02.113 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"fsid":"39489060-721b-11ef-bceb-c7b262605968","created":"2024-09-13T21:59:22.911578+0000","modified":"2024-09-13T22:04:57.539418+0000","last_up_change":"2024-09-13T22:04:56.377228+0000","last_in_change":"2024-09-13T22:04:36.794558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T22:03:44.451868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b302bbb3-37e7-4684-8f1b-71b4eb70a687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6803","nonce":3447581419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6805","nonce":3447581419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6809","nonce":3447581419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6807","nonce":3447581419}]},"public_addr":"172.21.15.89:6803/3447581419","cluster_addr":"172.21.15.89:6805/3447581419","heartbeat_back_addr":"172.21.15.89:6809/3447581419","heartbeat_front_addr":"172.21.15.89:6807/3447581419","state":["exists","up"]},{"osd":1,"uuid":"f9bde342-70cc-40ec-b320-82a9fec55c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6811","nonce":2396439127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6813","nonce":2396439127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6817","nonce":2396439127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6815","nonce":2396439127}]},"public_addr":"172.21.15.89:6811/2396439127","cluster_addr":"172.21.15.89:6813/2396439127","heartbeat_back_addr":"172.21.15.89:6817/2396439127","heartbeat_front_addr":"172.21.15.89:6815/2396439127","state":["exists","up"]},{"osd":2,"uuid":"6d8ac3d0-8a46-49d2-89fd-322227c2d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6819","nonce":2807079294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6821","nonce":2807079294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6825","nonce":2807079294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6823","nonce":2807079294}]},"public_addr":"172.21.15.89:6819/2807079294","cluster_addr":"172.21.15.89:6821/2807079294","heartbeat_back_addr":"172.21.15.89:6825/2807079294","heartbeat_front_addr":"172.21.15.89:6823/2807079294","state":["exists","up"]},{"osd":3,"uuid":"7b46e232-93af-4dc8-b581-5c913182e388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6801","nonce":3856170909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6803","nonce":3856170909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6807","nonce":3856170909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6805","nonce":3856170909}]},"public_addr":"172.21.15.159:6801/3856170909","cluster_addr":"172.21.15.159:6803/3856170909","heartbeat_back_addr":"172.21.15.159:6807/3856170909","heartbeat_front_addr":"172.21.15.159:6805/3856170909","state":["exists","up"]},{"osd":4,"uuid":"bc8f7bef-0f17-4b78-b650-9158f23c9b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6809","nonce":664583294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6811","nonce":664583294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6815","nonce":664583294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6813","nonce":664583294}]},"public_addr":"172.21.15.159:6809/664583294","cluster_addr":"172.21.15.159:6811/664583294","heartbeat_back_addr":"172.21.15.159:6815/664583294","heartbeat_front_addr":"172.21.15.159:6813/664583294","state":["exists","up"]},{"osd":5,"uuid":"5dfaa561-43d5-428e-b6d3-a7e8dc317d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6817","nonce":2377310384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6819","nonce":2377310384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6823","nonce":2377310384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6821","nonce":2377310384}]},"public_addr":"172.21.15.159:6817/2377310384","cluster_addr":"172.21.15.159:6819/2377310384","heartbeat_back_addr":"172.21.15.159:6823/2377310384","heartbeat_front_addr":"172.21.15.159:6821/2377310384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:02:42.786910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:03:10.681138+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:03:40.885319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:04:03.592998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:04:28.246876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:04:53.735904+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/1244250966":"2024-09-14T22:01:24.135771+0000","172.21.15.89:0/958685779":"2024-09-14T22:01:24.135771+0000","172.21.15.89:0/268036096":"2024-09-14T21:59:52.175828+0000","172.21.15.89:0/748057153":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6800/1940163960":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6801/1940163960":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6800/2476248652":"2024-09-14T22:01:24.135771+0000","172.21.15.89:0/2892493712":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6800/1295505650":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/3358437000":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/1019473844":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/801083302":"2024-09-14T22:00:22.356658+0000","172.21.15.89:6801/1295505650":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/1753927941":"2024-09-14T22:01:24.135771+0000","172.21.15.89:6801/2476248652":"2024-09-14T22:01:24.135771+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T22:05:02.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.113+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd79806cc50 msgr2=0x7fd79806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:02.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.113+0000 7fd7b4826640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd79806cc50 0x7fd79806f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009230 tx=0x7fd7a80058d0 comp rx=0 tx=0).stop 2024-09-13T22:05:02.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.113+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 msgr2=0x7fd7b019be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:02.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.113+0000 7fd7b4826640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 0x7fd7b019be30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400db80 tx=0x7fd7a400b630 comp rx=0 tx=0).stop 2024-09-13T22:05:02.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.114+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 shutdown_connections 2024-09-13T22:05:02.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.114+0000 7fd7b4826640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd79806cc50 0x7fd79806f110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:02.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.114+0000 7fd7b4826640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b0104a20 0x7fd7b019be30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:02.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.114+0000 7fd7b4826640 1 --2- 172.21.15.89:0/3677666299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b00fea20 0x7fd7b019b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:02.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.114+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 >> 172.21.15.89:0/3677666299 conn(0x7fd7b00fa700 msgr2=0x7fd7b00fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:02.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.114+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 shutdown_connections 2024-09-13T22:05:02.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:02.114+0000 7fd7b4826640 1 -- 172.21.15.89:0/3677666299 wait complete. 2024-09-13T22:05:02.433 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:02 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3677666299' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:05:02.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:02 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3677666299' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:05:02.754 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T22:03:44.451868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T22:05:02.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T22:05:02.953 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:03 smithi089 ceph-mon[27921]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:03.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:03 smithi159 ceph-mon[35348]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.675+0000 7ff25071f640 1 -- 172.21.15.89:0/2266937487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 msgr2=0x7ff248104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.675+0000 7ff25071f640 1 --2- 172.21.15.89:0/2266937487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 0x7ff248104f30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff244009880 tx=0x7ff24402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.675+0000 7ff25071f640 1 -- 172.21.15.89:0/2266937487 shutdown_connections 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.675+0000 7ff25071f640 1 --2- 172.21.15.89:0/2266937487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2480fdf70 0x7ff2480fe3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.675+0000 7ff25071f640 1 --2- 172.21.15.89:0/2266937487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 0x7ff248104f30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.675+0000 7ff25071f640 1 -- 172.21.15.89:0/2266937487 >> 172.21.15.89:0/2266937487 conn(0x7ff2480f9ec0 msgr2=0x7ff2480fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.675+0000 7ff25071f640 1 -- 172.21.15.89:0/2266937487 shutdown_connections 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.675+0000 7ff25071f640 1 -- 172.21.15.89:0/2266937487 wait complete. 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff25071f640 1 Processor -- start 2024-09-13T22:05:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff25071f640 1 -- start start 2024-09-13T22:05:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff25071f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2480fdf70 0x7ff2480ff150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff25071f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 0x7ff2480ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff25071f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480ffbd0 con 0x7ff248104b50 2024-09-13T22:05:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff25071f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480ffd40 con 0x7ff2480fdf70 2024-09-13T22:05:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff24dcba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 0x7ff2480ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff24dcba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 0x7ff2480ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58366/0 (socket says 172.21.15.89:58366) 2024-09-13T22:05:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff24dcba640 1 -- 172.21.15.89:0/4233542167 learned_addr learned my addr 172.21.15.89:0/4233542167 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.676+0000 7ff24e4bb640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2480fdf70 0x7ff2480ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff24dcba640 1 -- 172.21.15.89:0/4233542167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2480fdf70 msgr2=0x7ff2480ff150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff24dcba640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2480fdf70 0x7ff2480ff150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff24dcba640 1 -- 172.21.15.89:0/4233542167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244009560 con 0x7ff248104b50 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff24e4bb640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2480fdf70 0x7ff2480ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff24dcba640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 0x7ff2480ff690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff23800e970 tx=0x7ff23800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff23f7fe640 1 -- 172.21.15.89:0/4233542167 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff23800cc90 con 0x7ff248104b50 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2481a1dd0 con 0x7ff248104b50 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff23f7fe640 1 -- 172.21.15.89:0/4233542167 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff23800cdf0 con 0x7ff248104b50 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff23f7fe640 1 -- 172.21.15.89:0/4233542167 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff238010430 con 0x7ff248104b50 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.677+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2481a2130 con 0x7ff248104b50 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.678+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff248101290 con 0x7ff248104b50 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.678+0000 7ff23f7fe640 1 -- 172.21.15.89:0/4233542167 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff2380046c0 con 0x7ff248104b50 2024-09-13T22:05:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.679+0000 7ff23f7fe640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff23406cc50 0x7ff23406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:04.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.679+0000 7ff23f7fe640 1 -- 172.21.15.89:0/4233542167 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff238014070 con 0x7ff248104b50 2024-09-13T22:05:04.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.679+0000 7ff24e4bb640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff23406cc50 0x7ff23406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:04.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.679+0000 7ff24e4bb640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff23406cc50 0x7ff23406f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff244006010 tx=0x7ff244005e60 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:04.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.683+0000 7ff23f7fe640 1 -- 172.21.15.89:0/4233542167 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff238056c50 con 0x7ff248104b50 2024-09-13T22:05:04.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.847+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2480fe3d0 con 0x7ff248104b50 2024-09-13T22:05:04.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.848+0000 7ff23f7fe640 1 -- 172.21.15.89:0/4233542167 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2480fe3d0 con 0x7ff248104b50 2024-09-13T22:05:04.849 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-09-13T22:05:04.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff23406cc50 msgr2=0x7ff23406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:04.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff23406cc50 0x7ff23406f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff244006010 tx=0x7ff244005e60 comp rx=0 tx=0).stop 2024-09-13T22:05:04.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 msgr2=0x7ff2480ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:04.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 0x7ff2480ff690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff23800e970 tx=0x7ff23800ed70 comp rx=0 tx=0).stop 2024-09-13T22:05:04.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 shutdown_connections 2024-09-13T22:05:04.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff23406cc50 0x7ff23406f110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:04.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff248104b50 0x7ff2480ff690 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:04.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 --2- 172.21.15.89:0/4233542167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2480fdf70 0x7ff2480ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:04.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 >> 172.21.15.89:0/4233542167 conn(0x7ff2480f9ec0 msgr2=0x7ff2480fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:04.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 shutdown_connections 2024-09-13T22:05:04.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:04.850+0000 7ff25071f640 1 -- 172.21.15.89:0/4233542167 wait complete. 2024-09-13T22:05:05.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:05 smithi089 ceph-mon[27921]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:05.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:05 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/4233542167' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T22:05:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:05 smithi159 ceph-mon[35348]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:05 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/4233542167' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T22:05:05.733 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T22:05:05.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T22:05:05.929 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:07.457 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:07 smithi089 ceph-mon[27921]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:07.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:07 smithi159 ceph-mon[35348]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:07.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.673+0000 7ff3b9485640 1 -- 172.21.15.89:0/72962109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 msgr2=0x7ff3b4101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:07.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.673+0000 7ff3b9485640 1 --2- 172.21.15.89:0/72962109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 0x7ff3b4101290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff39c009880 tx=0x7ff39c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:07.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.673+0000 7ff3b9485640 1 -- 172.21.15.89:0/72962109 shutdown_connections 2024-09-13T22:05:07.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.673+0000 7ff3b9485640 1 --2- 172.21.15.89:0/72962109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 0x7ff3b4101290 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:07.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.673+0000 7ff3b9485640 1 --2- 172.21.15.89:0/72962109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3b40fde30 0x7ff3b40fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:07.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.673+0000 7ff3b9485640 1 -- 172.21.15.89:0/72962109 >> 172.21.15.89:0/72962109 conn(0x7ff3b40f9980 msgr2=0x7ff3b40fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:07.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.673+0000 7ff3b9485640 1 -- 172.21.15.89:0/72962109 shutdown_connections 2024-09-13T22:05:07.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.673+0000 7ff3b9485640 1 -- 172.21.15.89:0/72962109 wait complete. 2024-09-13T22:05:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.674+0000 7ff3b9485640 1 Processor -- start 2024-09-13T22:05:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.674+0000 7ff3b9485640 1 -- start start 2024-09-13T22:05:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.674+0000 7ff3b9485640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3b40fde30 0x7ff3b41955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.674+0000 7ff3b9485640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 0x7ff3b4195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b9485640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b41960e0 con 0x7ff3b4100e10 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b9485640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b4196250 con 0x7ff3b40fde30 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 0x7ff3b4195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 0x7ff3b4195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58384/0 (socket says 172.21.15.89:58384) 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b27fc640 1 -- 172.21.15.89:0/645318032 learned_addr learned my addr 172.21.15.89:0/645318032 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b2ffd640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3b40fde30 0x7ff3b41955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b27fc640 1 -- 172.21.15.89:0/645318032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3b40fde30 msgr2=0x7ff3b41955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b27fc640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3b40fde30 0x7ff3b41955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b27fc640 1 -- 172.21.15.89:0/645318032 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c009560 con 0x7ff3b4100e10 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b27fc640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 0x7ff3b4195b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff39c005640 tx=0x7ff39c005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3abfff640 1 -- 172.21.15.89:0/645318032 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff39c004ba0 con 0x7ff3b4100e10 2024-09-13T22:05:07.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b419ac90 con 0x7ff3b4100e10 2024-09-13T22:05:07.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3abfff640 1 -- 172.21.15.89:0/645318032 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff39c004d00 con 0x7ff3b4100e10 2024-09-13T22:05:07.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3abfff640 1 -- 172.21.15.89:0/645318032 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff39c003c30 con 0x7ff3b4100e10 2024-09-13T22:05:07.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.675+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b419b200 con 0x7ff3b4100e10 2024-09-13T22:05:07.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.677+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b4108750 con 0x7ff3b4100e10 2024-09-13T22:05:07.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.677+0000 7ff3abfff640 1 -- 172.21.15.89:0/645318032 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff39c031640 con 0x7ff3b4100e10 2024-09-13T22:05:07.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.677+0000 7ff3abfff640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff3a006cc50 0x7ff3a006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:07.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.678+0000 7ff3abfff640 1 -- 172.21.15.89:0/645318032 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff39c0ad130 con 0x7ff3b4100e10 2024-09-13T22:05:07.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.678+0000 7ff3b2ffd640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff3a006cc50 0x7ff3a006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:07.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.678+0000 7ff3b2ffd640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff3a006cc50 0x7ff3a006f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4067a30 tx=0x7ff3ac00a590 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:07.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.682+0000 7ff3abfff640 1 -- 172.21.15.89:0/645318032 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff39c0778f0 con 0x7ff3b4100e10 2024-09-13T22:05:07.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.928+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff3b4108910 con 0x7ff3b4100e10 2024-09-13T22:05:07.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.932+0000 7ff3abfff640 1 -- 172.21.15.89:0/645318032 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff39c07af10 con 0x7ff3b4100e10 2024-09-13T22:05:07.933 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-09-13T22:05:07.933 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQATt+Rm8IxoNxAAoroM75GZrkMc+cQS9V2qbg== 2024-09-13T22:05:07.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.934+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff3a006cc50 msgr2=0x7ff3a006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:07.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.934+0000 7ff3b9485640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff3a006cc50 0x7ff3a006f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4067a30 tx=0x7ff3ac00a590 comp rx=0 tx=0).stop 2024-09-13T22:05:07.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.934+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 msgr2=0x7ff3b4195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:07.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.934+0000 7ff3b9485640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 0x7ff3b4195b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff39c005640 tx=0x7ff39c005670 comp rx=0 tx=0).stop 2024-09-13T22:05:07.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.934+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 shutdown_connections 2024-09-13T22:05:07.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.934+0000 7ff3b9485640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff3a006cc50 0x7ff3a006f110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:07.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.934+0000 7ff3b9485640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b4100e10 0x7ff3b4195b10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:07.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.934+0000 7ff3b9485640 1 --2- 172.21.15.89:0/645318032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3b40fde30 0x7ff3b41955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:07.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.934+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 >> 172.21.15.89:0/645318032 conn(0x7ff3b40f9980 msgr2=0x7ff3b4104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:07.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.935+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 shutdown_connections 2024-09-13T22:05:07.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:07.935+0000 7ff3b9485640 1 -- 172.21.15.89:0/645318032 wait complete. 2024-09-13T22:05:08.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:08 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/645318032' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:05:08.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:08 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/645318032' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T22:05:08.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:08 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/645318032' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:05:08.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:08 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/645318032' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T22:05:08.719 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:05:08.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T22:05:08.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T22:05:08.756 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T22:05:08.971 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi159/config 2024-09-13T22:05:09.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:09 smithi159 ceph-mon[35348]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:09.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:05:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:09 smithi089 ceph-mon[27921]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:05:10.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.539+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4088055431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa4100d80 msgr2=0x7f6aa4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:10.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.539+0000 7f6aabd8b640 1 --2- 172.21.15.159:0/4088055431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa4100d80 0x7f6aa4101200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009880 tx=0x7f6a9402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:10.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.539+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4088055431 shutdown_connections 2024-09-13T22:05:10.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.539+0000 7f6aabd8b640 1 --2- 172.21.15.159:0/4088055431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa4100d80 0x7f6aa4101200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:10.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.539+0000 7f6aabd8b640 1 --2- 172.21.15.159:0/4088055431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa40ffb80 0x7f6aa40fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.539+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4088055431 >> 172.21.15.159:0/4088055431 conn(0x7f6aa40fb2f0 msgr2=0x7f6aa40fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.539+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4088055431 shutdown_connections 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4088055431 wait complete. 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aabd8b640 1 Processor -- start 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aabd8b640 1 -- start start 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aabd8b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa40ffb80 0x7f6aa4195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aabd8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa4100d80 0x7f6aa4195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aabd8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4196260 con 0x7f6aa4100d80 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aabd8b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41963d0 con 0x7f6aa40ffb80 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aa9b27640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa40ffb80 0x7f6aa4195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aa9b27640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa40ffb80 0x7f6aa4195750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49166/0 (socket says 172.21.15.159:49166) 2024-09-13T22:05:10.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.540+0000 7f6aa9b27640 1 -- 172.21.15.159:0/4778738 learned_addr learned my addr 172.21.15.159:0/4778738 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6aa9326640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa4100d80 0x7f6aa4195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6aa9b27640 1 -- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa4100d80 msgr2=0x7f6aa4195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6aa9b27640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa4100d80 0x7f6aa4195c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6aa9b27640 1 -- 172.21.15.159:0/4778738 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a94009560 con 0x7f6aa40ffb80 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6aa9b27640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa40ffb80 0x7f6aa4195750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000b3d0 tx=0x7f6aa000b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6a9affd640 1 -- 172.21.15.159:0/4778738 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aa0011800 con 0x7f6aa40ffb80 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6a9affd640 1 -- 172.21.15.159:0/4778738 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6aa0011e20 con 0x7f6aa40ffb80 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa419ae70 con 0x7f6aa40ffb80 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6a9affd640 1 -- 172.21.15.159:0/4778738 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aa000f510 con 0x7f6aa40ffb80 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.541+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa419b3b0 con 0x7f6aa40ffb80 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.542+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa4100000 con 0x7f6aa40ffb80 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.543+0000 7f6a9affd640 1 -- 172.21.15.159:0/4778738 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6aa0010380 con 0x7f6aa40ffb80 2024-09-13T22:05:10.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.543+0000 7f6a9affd640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f6a9006cc50 0x7f6a9006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:10.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.543+0000 7f6a9affd640 1 -- 172.21.15.159:0/4778738 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6aa008bc20 con 0x7f6aa40ffb80 2024-09-13T22:05:10.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.543+0000 7f6aa9326640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f6a9006cc50 0x7f6a9006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:10.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.544+0000 7f6aa9326640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f6a9006cc50 0x7f6a9006f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a94000c00 tx=0x7f6a940314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:10.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.547+0000 7f6a9affd640 1 -- 172.21.15.159:0/4778738 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6aa0056330 con 0x7f6aa40ffb80 2024-09-13T22:05:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.770+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f6aa419b600 con 0x7f6aa40ffb80 2024-09-13T22:05:10.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.776+0000 7f6a9affd640 1 -- 172.21.15.159:0/4778738 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f6aa0059950 con 0x7f6aa40ffb80 2024-09-13T22:05:10.777 INFO:teuthology.orchestra.run.smithi159.stdout:[client.1] 2024-09-13T22:05:10.777 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQAWt+RmdY4MLhAAZYnp1nP8byfOzSSACmzowg== 2024-09-13T22:05:10.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f6a9006cc50 msgr2=0x7f6a9006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f6a9006cc50 0x7f6a9006f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a94000c00 tx=0x7f6a940314e0 comp rx=0 tx=0).stop 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa40ffb80 msgr2=0x7f6aa4195750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa40ffb80 0x7f6aa4195750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000b3d0 tx=0x7f6aa000b890 comp rx=0 tx=0).stop 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 shutdown_connections 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f6a9006cc50 0x7f6a9006f110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aa4100d80 0x7f6aa4195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 --2- 172.21.15.159:0/4778738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6aa40ffb80 0x7f6aa4195750 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 >> 172.21.15.159:0/4778738 conn(0x7f6aa40fb2f0 msgr2=0x7f6aa4103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 shutdown_connections 2024-09-13T22:05:10.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:05:10.778+0000 7f6aabd8b640 1 -- 172.21.15.159:0/4778738 wait complete. 2024-09-13T22:05:11.386 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:05:11.386 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T22:05:11.386 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T22:05:11.425 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T22:05:11.425 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T22:05:11.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T22:05:11.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:11 smithi089 ceph-mon[27921]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:11.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:11 smithi089 ceph-mon[27921]: from='client.? 172.21.15.159:0/4778738' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:05:11.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:11 smithi089 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:05:11.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:11 smithi089 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T22:05:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:11 smithi159 ceph-mon[35348]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:11 smithi159 ceph-mon[35348]: from='client.? 172.21.15.159:0/4778738' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:05:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:11 smithi159 ceph-mon[35348]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:05:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:11 smithi159 ceph-mon[35348]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T22:05:11.642 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:13.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.345+0000 7fa369a88640 1 -- 172.21.15.89:0/1248410767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa364100d80 msgr2=0x7fa364101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.345+0000 7fa369a88640 1 --2- 172.21.15.89:0/1248410767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa364100d80 0x7fa364101160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3540098b0 tx=0x7fa35402a4d0 comp rx=0 tx=0).stop 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.345+0000 7fa369a88640 1 -- 172.21.15.89:0/1248410767 shutdown_connections 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.345+0000 7fa369a88640 1 --2- 172.21.15.89:0/1248410767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3641016a0 0x7fa364109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.345+0000 7fa369a88640 1 --2- 172.21.15.89:0/1248410767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa364100d80 0x7fa364101160 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.345+0000 7fa369a88640 1 -- 172.21.15.89:0/1248410767 >> 172.21.15.89:0/1248410767 conn(0x7fa3640fa700 msgr2=0x7fa3640fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.345+0000 7fa369a88640 1 -- 172.21.15.89:0/1248410767 shutdown_connections 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.345+0000 7fa369a88640 1 -- 172.21.15.89:0/1248410767 wait complete. 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa369a88640 1 Processor -- start 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa369a88640 1 -- start start 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa369a88640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa364100d80 0x7fa364195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa369a88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3641016a0 0x7fa364196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa369a88640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3641968f0 con 0x7fa3641016a0 2024-09-13T22:05:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa369a88640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364199560 con 0x7fa364100d80 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa35bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3641016a0 0x7fa364196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa35bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3641016a0 0x7fa364196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58402/0 (socket says 172.21.15.89:58402) 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa35bfff640 1 -- 172.21.15.89:0/3262296121 learned_addr learned my addr 172.21.15.89:0/3262296121 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa3637fe640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa364100d80 0x7fa364195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa35bfff640 1 -- 172.21.15.89:0/3262296121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa364100d80 msgr2=0x7fa364195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa35bfff640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa364100d80 0x7fa364195cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa35bfff640 1 -- 172.21.15.89:0/3262296121 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa354009560 con 0x7fa3641016a0 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.346+0000 7fa3637fe640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa364100d80 0x7fa364195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.347+0000 7fa35bfff640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3641016a0 0x7fa364196210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00b420 tx=0x7fa34c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.347+0000 7fa3617fa640 1 -- 172.21.15.89:0/3262296121 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa34c011800 con 0x7fa3641016a0 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.347+0000 7fa3617fa640 1 -- 172.21.15.89:0/3262296121 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa34c011e20 con 0x7fa3641016a0 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.347+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa364199840 con 0x7fa3641016a0 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.347+0000 7fa3617fa640 1 -- 172.21.15.89:0/3262296121 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa34c00f2e0 con 0x7fa3641016a0 2024-09-13T22:05:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.347+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa364199d90 con 0x7fa3641016a0 2024-09-13T22:05:13.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.348+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa364068c90 con 0x7fa3641016a0 2024-09-13T22:05:13.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.348+0000 7fa3617fa640 1 -- 172.21.15.89:0/3262296121 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa34c010380 con 0x7fa3641016a0 2024-09-13T22:05:13.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.349+0000 7fa3617fa640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa35006cc50 0x7fa35006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:13.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.349+0000 7fa3617fa640 1 -- 172.21.15.89:0/3262296121 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa34c08b7d0 con 0x7fa3641016a0 2024-09-13T22:05:13.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.349+0000 7fa3637fe640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa35006cc50 0x7fa35006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:13.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.349+0000 7fa3637fe640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa35006cc50 0x7fa35006f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa354006010 tx=0x7fa354005e60 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.353+0000 7fa3617fa640 1 -- 172.21.15.89:0/3262296121 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa34c055f60 con 0x7fa3641016a0 2024-09-13T22:05:13.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:13 smithi089 ceph-mon[27921]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:13.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:13 smithi159 ceph-mon[35348]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:13.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.563+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa3641011e0 con 0x7fa3641016a0 2024-09-13T22:05:13.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.566+0000 7fa3617fa640 1 -- 172.21.15.89:0/3262296121 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174012 (secure 0 0 0) 0x7fa34c059580 con 0x7fa3641016a0 2024-09-13T22:05:13.570 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa35006cc50 msgr2=0x7fa35006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa35006cc50 0x7fa35006f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa354006010 tx=0x7fa354005e60 comp rx=0 tx=0).stop 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3641016a0 msgr2=0x7fa364196210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3641016a0 0x7fa364196210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00b420 tx=0x7fa34c00b8e0 comp rx=0 tx=0).stop 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 shutdown_connections 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa35006cc50 0x7fa35006f110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3641016a0 0x7fa364196210 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 --2- 172.21.15.89:0/3262296121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa364100d80 0x7fa364195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 >> 172.21.15.89:0/3262296121 conn(0x7fa3640fa700 msgr2=0x7fa364102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 shutdown_connections 2024-09-13T22:05:13.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:13.568+0000 7fa369a88640 1 -- 172.21.15.89:0/3262296121 wait complete. 2024-09-13T22:05:14.385 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"flags":0,"active_gid":14209,"active_name":"smithi089.naneiw","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":3305276684},{"type":"v1","addr":"172.21.15.89:6801","nonce":3305276684}]},"active_addr":"172.21.15.89:6801/3305276684","active_change":"2024-09-13T22:01:24.135923+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14234,"name":"smithi159.ghpomd","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.89:8443/","prometheus":"http://172.21.15.89:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3559780592}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2422912912}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":523992665}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3806822510}]}]} 2024-09-13T22:05:14.390 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T22:05:14.390 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T22:05:14.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T22:05:14.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:14 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3262296121' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T22:05:14.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:14 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3262296121' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T22:05:14.591 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:15.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:15 smithi089 ceph-mon[27921]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:15.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:15 smithi159 ceph-mon[35348]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.201+0000 7fe9d6990640 1 -- 172.21.15.89:0/1165943372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 msgr2=0x7fe9d0109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.201+0000 7fe9d6990640 1 --2- 172.21.15.89:0/1165943372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 0x7fe9d0109b20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40098b0 tx=0x7fe9c402a560 comp rx=0 tx=0).stop 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.201+0000 7fe9d6990640 1 -- 172.21.15.89:0/1165943372 shutdown_connections 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.201+0000 7fe9d6990640 1 --2- 172.21.15.89:0/1165943372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 0x7fe9d0109b20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.201+0000 7fe9d6990640 1 --2- 172.21.15.89:0/1165943372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9d0100d10 0x7fe9d01010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.201+0000 7fe9d6990640 1 -- 172.21.15.89:0/1165943372 >> 172.21.15.89:0/1165943372 conn(0x7fe9d00758a0 msgr2=0x7fe9d00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.201+0000 7fe9d6990640 1 -- 172.21.15.89:0/1165943372 shutdown_connections 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.201+0000 7fe9d6990640 1 -- 172.21.15.89:0/1165943372 wait complete. 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9d6990640 1 Processor -- start 2024-09-13T22:05:16.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9d6990640 1 -- start start 2024-09-13T22:05:16.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9d6990640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9d0100d10 0x7fe9d00fe970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:16.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9d6990640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 0x7fe9d00feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:16.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9d6990640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00ff3f0 con 0x7fe9d0101630 2024-09-13T22:05:16.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9d6990640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00ff560 con 0x7fe9d0100d10 2024-09-13T22:05:16.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9cf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 0x7fe9d00feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:16.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9cf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 0x7fe9d00feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47960/0 (socket says 172.21.15.89:47960) 2024-09-13T22:05:16.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9cf7fe640 1 -- 172.21.15.89:0/941358684 learned_addr learned my addr 172.21.15.89:0/941358684 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:16.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9cffff640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9d0100d10 0x7fe9d00fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9cf7fe640 1 -- 172.21.15.89:0/941358684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9d0100d10 msgr2=0x7fe9d00fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9cf7fe640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9d0100d10 0x7fe9d00fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.202+0000 7fe9cf7fe640 1 -- 172.21.15.89:0/941358684 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009560 con 0x7fe9d0101630 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.203+0000 7fe9cf7fe640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 0x7fe9d00feeb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4006010 tx=0x7fe9c40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.203+0000 7fe9cd7fa640 1 -- 172.21.15.89:0/941358684 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c4004aa0 con 0x7fe9d0101630 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.203+0000 7fe9cd7fa640 1 -- 172.21.15.89:0/941358684 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9c4004c00 con 0x7fe9d0101630 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.203+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d00ff7e0 con 0x7fe9d0101630 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.203+0000 7fe9cd7fa640 1 -- 172.21.15.89:0/941358684 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c4003a20 con 0x7fe9d0101630 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.203+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d01a20e0 con 0x7fe9d0101630 2024-09-13T22:05:16.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.204+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d00684b0 con 0x7fe9d0101630 2024-09-13T22:05:16.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.204+0000 7fe9cd7fa640 1 -- 172.21.15.89:0/941358684 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe9c4003bc0 con 0x7fe9d0101630 2024-09-13T22:05:16.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.205+0000 7fe9cd7fa640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fe9b806cc50 0x7fe9b806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:16.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.205+0000 7fe9cd7fa640 1 -- 172.21.15.89:0/941358684 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe9c40ace50 con 0x7fe9d0101630 2024-09-13T22:05:16.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.205+0000 7fe9cffff640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fe9b806cc50 0x7fe9b806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:16.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.205+0000 7fe9cffff640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fe9b806cc50 0x7fe9b806f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009890 tx=0x7fe9c0008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:16.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.209+0000 7fe9cd7fa640 1 -- 172.21.15.89:0/941358684 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe9c40775e0 con 0x7fe9d0101630 2024-09-13T22:05:16.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.374+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9d00ff750 con 0x7fe9d0101630 2024-09-13T22:05:16.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.375+0000 7fe9cd7fa640 1 -- 172.21.15.89:0/941358684 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11335 (secure 0 0 0) 0x7fe9c407ac00 con 0x7fe9d0101630 2024-09-13T22:05:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:05:16.377 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"fsid":"39489060-721b-11ef-bceb-c7b262605968","created":"2024-09-13T21:59:22.911578+0000","modified":"2024-09-13T22:04:57.539418+0000","last_up_change":"2024-09-13T22:04:56.377228+0000","last_in_change":"2024-09-13T22:04:36.794558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T22:03:44.451868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b302bbb3-37e7-4684-8f1b-71b4eb70a687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6803","nonce":3447581419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6805","nonce":3447581419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6809","nonce":3447581419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6807","nonce":3447581419}]},"public_addr":"172.21.15.89:6803/3447581419","cluster_addr":"172.21.15.89:6805/3447581419","heartbeat_back_addr":"172.21.15.89:6809/3447581419","heartbeat_front_addr":"172.21.15.89:6807/3447581419","state":["exists","up"]},{"osd":1,"uuid":"f9bde342-70cc-40ec-b320-82a9fec55c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6811","nonce":2396439127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6813","nonce":2396439127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6817","nonce":2396439127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6815","nonce":2396439127}]},"public_addr":"172.21.15.89:6811/2396439127","cluster_addr":"172.21.15.89:6813/2396439127","heartbeat_back_addr":"172.21.15.89:6817/2396439127","heartbeat_front_addr":"172.21.15.89:6815/2396439127","state":["exists","up"]},{"osd":2,"uuid":"6d8ac3d0-8a46-49d2-89fd-322227c2d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6819","nonce":2807079294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6821","nonce":2807079294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6825","nonce":2807079294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6823","nonce":2807079294}]},"public_addr":"172.21.15.89:6819/2807079294","cluster_addr":"172.21.15.89:6821/2807079294","heartbeat_back_addr":"172.21.15.89:6825/2807079294","heartbeat_front_addr":"172.21.15.89:6823/2807079294","state":["exists","up"]},{"osd":3,"uuid":"7b46e232-93af-4dc8-b581-5c913182e388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6801","nonce":3856170909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6803","nonce":3856170909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6807","nonce":3856170909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6805","nonce":3856170909}]},"public_addr":"172.21.15.159:6801/3856170909","cluster_addr":"172.21.15.159:6803/3856170909","heartbeat_back_addr":"172.21.15.159:6807/3856170909","heartbeat_front_addr":"172.21.15.159:6805/3856170909","state":["exists","up"]},{"osd":4,"uuid":"bc8f7bef-0f17-4b78-b650-9158f23c9b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6809","nonce":664583294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6811","nonce":664583294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6815","nonce":664583294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6813","nonce":664583294}]},"public_addr":"172.21.15.159:6809/664583294","cluster_addr":"172.21.15.159:6811/664583294","heartbeat_back_addr":"172.21.15.159:6815/664583294","heartbeat_front_addr":"172.21.15.159:6813/664583294","state":["exists","up"]},{"osd":5,"uuid":"5dfaa561-43d5-428e-b6d3-a7e8dc317d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6817","nonce":2377310384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6819","nonce":2377310384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6823","nonce":2377310384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6821","nonce":2377310384}]},"public_addr":"172.21.15.159:6817/2377310384","cluster_addr":"172.21.15.159:6819/2377310384","heartbeat_back_addr":"172.21.15.159:6823/2377310384","heartbeat_front_addr":"172.21.15.159:6821/2377310384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:02:42.786910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:03:10.681138+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:03:40.885319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:04:03.592998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:04:28.246876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:04:53.735904+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/1244250966":"2024-09-14T22:01:24.135771+0000","172.21.15.89:0/958685779":"2024-09-14T22:01:24.135771+0000","172.21.15.89:0/268036096":"2024-09-14T21:59:52.175828+0000","172.21.15.89:0/748057153":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6800/1940163960":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6801/1940163960":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6800/2476248652":"2024-09-14T22:01:24.135771+0000","172.21.15.89:0/2892493712":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6800/1295505650":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/3358437000":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/1019473844":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/801083302":"2024-09-14T22:00:22.356658+0000","172.21.15.89:6801/1295505650":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/1753927941":"2024-09-14T22:01:24.135771+0000","172.21.15.89:6801/2476248652":"2024-09-14T22:01:24.135771+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T22:05:16.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fe9b806cc50 msgr2=0x7fe9b806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:16.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fe9b806cc50 0x7fe9b806f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009890 tx=0x7fe9c0008040 comp rx=0 tx=0).stop 2024-09-13T22:05:16.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 msgr2=0x7fe9d00feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:16.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 0x7fe9d00feeb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4006010 tx=0x7fe9c40055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:16.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 shutdown_connections 2024-09-13T22:05:16.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fe9b806cc50 0x7fe9b806f110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:16.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d0101630 0x7fe9d00feeb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:16.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 --2- 172.21.15.89:0/941358684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9d0100d10 0x7fe9d00fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:16.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 >> 172.21.15.89:0/941358684 conn(0x7fe9d00758a0 msgr2=0x7fe9d0101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:16.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 shutdown_connections 2024-09-13T22:05:16.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:16.377+0000 7fe9d6990640 1 -- 172.21.15.89:0/941358684 wait complete. 2024-09-13T22:05:17.007 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T22:05:17.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T22:05:17.207 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:17.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:17 smithi159 ceph-mon[35348]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:17.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:17 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/941358684' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:05:17.580 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:17 smithi089 ceph-mon[27921]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:17.580 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:17 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/941358684' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:05:18.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.873+0000 7f42092b3640 1 -- 172.21.15.89:0/3617743360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4204104a10 msgr2=0x7f4204104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:18.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.873+0000 7f42092b3640 1 --2- 172.21.15.89:0/3617743360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4204104a10 0x7f4204104df0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009880 tx=0x7f41f402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:18.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.873+0000 7f42092b3640 1 -- 172.21.15.89:0/3617743360 shutdown_connections 2024-09-13T22:05:18.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.873+0000 7f42092b3640 1 --2- 172.21.15.89:0/3617743360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42040fea10 0x7f42040fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:18.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.873+0000 7f42092b3640 1 --2- 172.21.15.89:0/3617743360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4204104a10 0x7f4204104df0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:18.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.873+0000 7f42092b3640 1 -- 172.21.15.89:0/3617743360 >> 172.21.15.89:0/3617743360 conn(0x7f42040fa730 msgr2=0x7f42040fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.873+0000 7f42092b3640 1 -- 172.21.15.89:0/3617743360 shutdown_connections 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.873+0000 7f42092b3640 1 -- 172.21.15.89:0/3617743360 wait complete. 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.874+0000 7f42092b3640 1 Processor -- start 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.874+0000 7f42092b3640 1 -- start start 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.874+0000 7f42092b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42040fea10 0x7f4204196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.874+0000 7f42092b3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4204104a10 0x7f4204196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.874+0000 7f42092b3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42041975b0 con 0x7f42040fea10 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.874+0000 7f42092b3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4204197720 con 0x7f4204104a10 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f4202ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42040fea10 0x7f4204196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:18.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f4202ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42040fea10 0x7f4204196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47974/0 (socket says 172.21.15.89:47974) 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f4202ffd640 1 -- 172.21.15.89:0/3903399961 learned_addr learned my addr 172.21.15.89:0/3903399961 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f42027fc640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4204104a10 0x7f4204196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f4202ffd640 1 -- 172.21.15.89:0/3903399961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4204104a10 msgr2=0x7f4204196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f4202ffd640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4204104a10 0x7f4204196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f4202ffd640 1 -- 172.21.15.89:0/3903399961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4009560 con 0x7f42040fea10 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f4202ffd640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42040fea10 0x7f4204196aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41f402a9c0 tx=0x7f41f40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f41ebfff640 1 -- 172.21.15.89:0/3903399961 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f4004aa0 con 0x7f42040fea10 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f41ebfff640 1 -- 172.21.15.89:0/3903399961 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41f4004c00 con 0x7f42040fea10 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420419fb10 con 0x7f42040fea10 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f41ebfff640 1 -- 172.21.15.89:0/3903399961 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f4003ab0 con 0x7f42040fea10 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.875+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420419fe70 con 0x7f42040fea10 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.876+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4204100150 con 0x7f42040fea10 2024-09-13T22:05:18.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.877+0000 7f41ebfff640 1 -- 172.21.15.89:0/3903399961 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f41f4031d20 con 0x7f42040fea10 2024-09-13T22:05:18.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.877+0000 7f41ebfff640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f41ec06cc50 0x7f41ec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:18.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.877+0000 7f42027fc640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f41ec06cc50 0x7f41ec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:18.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.877+0000 7f41ebfff640 1 -- 172.21.15.89:0/3903399961 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f41f40acf20 con 0x7f42040fea10 2024-09-13T22:05:18.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.878+0000 7f42027fc640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f41ec06cc50 0x7f41ec06f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4204068c90 tx=0x7f41f8008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:18.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:18.881+0000 7f41ebfff640 1 -- 172.21.15.89:0/3903399961 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f41f40e0e20 con 0x7f42040fea10 2024-09-13T22:05:19.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.045+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4204068a40 con 0x7f42040fea10 2024-09-13T22:05:19.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.046+0000 7f41ebfff640 1 -- 172.21.15.89:0/3903399961 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11335 (secure 0 0 0) 0x7f41f407b140 con 0x7f42040fea10 2024-09-13T22:05:19.047 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:05:19.047 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"fsid":"39489060-721b-11ef-bceb-c7b262605968","created":"2024-09-13T21:59:22.911578+0000","modified":"2024-09-13T22:04:57.539418+0000","last_up_change":"2024-09-13T22:04:56.377228+0000","last_in_change":"2024-09-13T22:04:36.794558+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T22:03:44.451868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b302bbb3-37e7-4684-8f1b-71b4eb70a687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6803","nonce":3447581419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6805","nonce":3447581419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6809","nonce":3447581419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":3447581419},{"type":"v1","addr":"172.21.15.89:6807","nonce":3447581419}]},"public_addr":"172.21.15.89:6803/3447581419","cluster_addr":"172.21.15.89:6805/3447581419","heartbeat_back_addr":"172.21.15.89:6809/3447581419","heartbeat_front_addr":"172.21.15.89:6807/3447581419","state":["exists","up"]},{"osd":1,"uuid":"f9bde342-70cc-40ec-b320-82a9fec55c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6811","nonce":2396439127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6813","nonce":2396439127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6817","nonce":2396439127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2396439127},{"type":"v1","addr":"172.21.15.89:6815","nonce":2396439127}]},"public_addr":"172.21.15.89:6811/2396439127","cluster_addr":"172.21.15.89:6813/2396439127","heartbeat_back_addr":"172.21.15.89:6817/2396439127","heartbeat_front_addr":"172.21.15.89:6815/2396439127","state":["exists","up"]},{"osd":2,"uuid":"6d8ac3d0-8a46-49d2-89fd-322227c2d9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6819","nonce":2807079294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6821","nonce":2807079294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6825","nonce":2807079294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":2807079294},{"type":"v1","addr":"172.21.15.89:6823","nonce":2807079294}]},"public_addr":"172.21.15.89:6819/2807079294","cluster_addr":"172.21.15.89:6821/2807079294","heartbeat_back_addr":"172.21.15.89:6825/2807079294","heartbeat_front_addr":"172.21.15.89:6823/2807079294","state":["exists","up"]},{"osd":3,"uuid":"7b46e232-93af-4dc8-b581-5c913182e388","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6801","nonce":3856170909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6803","nonce":3856170909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6807","nonce":3856170909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3856170909},{"type":"v1","addr":"172.21.15.159:6805","nonce":3856170909}]},"public_addr":"172.21.15.159:6801/3856170909","cluster_addr":"172.21.15.159:6803/3856170909","heartbeat_back_addr":"172.21.15.159:6807/3856170909","heartbeat_front_addr":"172.21.15.159:6805/3856170909","state":["exists","up"]},{"osd":4,"uuid":"bc8f7bef-0f17-4b78-b650-9158f23c9b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6809","nonce":664583294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6811","nonce":664583294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6815","nonce":664583294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":664583294},{"type":"v1","addr":"172.21.15.159:6813","nonce":664583294}]},"public_addr":"172.21.15.159:6809/664583294","cluster_addr":"172.21.15.159:6811/664583294","heartbeat_back_addr":"172.21.15.159:6815/664583294","heartbeat_front_addr":"172.21.15.159:6813/664583294","state":["exists","up"]},{"osd":5,"uuid":"5dfaa561-43d5-428e-b6d3-a7e8dc317d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6817","nonce":2377310384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6819","nonce":2377310384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6823","nonce":2377310384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2377310384},{"type":"v1","addr":"172.21.15.159:6821","nonce":2377310384}]},"public_addr":"172.21.15.159:6817/2377310384","cluster_addr":"172.21.15.159:6819/2377310384","heartbeat_back_addr":"172.21.15.159:6823/2377310384","heartbeat_front_addr":"172.21.15.159:6821/2377310384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:02:42.786910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:03:10.681138+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:03:40.885319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:04:03.592998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:04:28.246876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:04:53.735904+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/1244250966":"2024-09-14T22:01:24.135771+0000","172.21.15.89:0/958685779":"2024-09-14T22:01:24.135771+0000","172.21.15.89:0/268036096":"2024-09-14T21:59:52.175828+0000","172.21.15.89:0/748057153":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6800/1940163960":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6801/1940163960":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6800/2476248652":"2024-09-14T22:01:24.135771+0000","172.21.15.89:0/2892493712":"2024-09-14T21:59:52.175828+0000","172.21.15.89:6800/1295505650":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/3358437000":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/1019473844":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/801083302":"2024-09-14T22:00:22.356658+0000","172.21.15.89:6801/1295505650":"2024-09-14T22:00:22.356658+0000","172.21.15.89:0/1753927941":"2024-09-14T22:01:24.135771+0000","172.21.15.89:6801/2476248652":"2024-09-14T22:01:24.135771+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T22:05:19.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f41ec06cc50 msgr2=0x7f41ec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:19.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f41ec06cc50 0x7f41ec06f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4204068c90 tx=0x7f41f8008040 comp rx=0 tx=0).stop 2024-09-13T22:05:19.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42040fea10 msgr2=0x7f4204196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:19.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42040fea10 0x7f4204196aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41f402a9c0 tx=0x7f41f40055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:19.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 shutdown_connections 2024-09-13T22:05:19.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f41ec06cc50 0x7f41ec06f110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:19.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4204104a10 0x7f4204196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:19.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 --2- 172.21.15.89:0/3903399961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42040fea10 0x7f4204196aa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:19.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 >> 172.21.15.89:0/3903399961 conn(0x7f42040fa730 msgr2=0x7f42040fb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:19.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 shutdown_connections 2024-09-13T22:05:19.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:19.048+0000 7f42092b3640 1 -- 172.21.15.89:0/3903399961 wait complete. 2024-09-13T22:05:19.467 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:19 smithi089 ceph-mon[27921]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:19.467 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:19 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3903399961' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:05:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:19 smithi159 ceph-mon[35348]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:19 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3903399961' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:05:19.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T22:05:19.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T22:05:19.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T22:05:19.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T22:05:19.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T22:05:19.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T22:05:20.046 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:20.051 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:20.337 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:20.735 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:20.736 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:20.737 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:21.486 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:21 smithi089 ceph-mon[27921]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:21.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:21 smithi159 ceph-mon[35348]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:23.409 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:23 smithi089 ceph-mon[27921]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:23.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:23 smithi159 ceph-mon[35348]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:24.355 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:05:24.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:05:25.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.167+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/1144680709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc0fe9f0 msgr2=0x7f2fdc0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.167+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/1144680709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc0fe9f0 0x7f2fdc0fee50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009880 tx=0x7f2fc402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.167+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/1144680709 shutdown_connections 2024-09-13T22:05:25.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.167+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/1144680709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc0fe9f0 0x7f2fdc0fee50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.167+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/1144680709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fdc1049f0 0x7f2fdc104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.167+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/1144680709 >> 172.21.15.89:0/1144680709 conn(0x7f2fdc0758a0 msgr2=0x7f2fdc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:25.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.167+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/1144680709 shutdown_connections 2024-09-13T22:05:25.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.167+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/1144680709 wait complete. 2024-09-13T22:05:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.168+0000 7f2fe0a1f640 1 Processor -- start 2024-09-13T22:05:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.168+0000 7f2fe0a1f640 1 -- start start 2024-09-13T22:05:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.168+0000 7f2fe0a1f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fdc0fe9f0 0x7f2fdc19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.168+0000 7f2fe0a1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc1049f0 0x7f2fdc19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.168+0000 7f2fe0a1f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc19c4a0 con 0x7f2fdc1049f0 2024-09-13T22:05:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.168+0000 7f2fe0a1f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc195970 con 0x7f2fdc0fe9f0 2024-09-13T22:05:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.169+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc1049f0 0x7f2fdc19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.169+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc1049f0 0x7f2fdc19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50112/0 (socket says 172.21.15.89:50112) 2024-09-13T22:05:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.169+0000 7f2fd3fff640 1 -- 172.21.15.89:0/3532925895 learned_addr learned my addr 172.21.15.89:0/3532925895 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.169+0000 7f2fda59c640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fdc0fe9f0 0x7f2fdc19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.169+0000 7f2fd3fff640 1 -- 172.21.15.89:0/3532925895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fdc0fe9f0 msgr2=0x7f2fdc19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.169+0000 7f2fd3fff640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fdc0fe9f0 0x7f2fdc19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.169+0000 7f2fd3fff640 1 -- 172.21.15.89:0/3532925895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4009560 con 0x7f2fdc1049f0 2024-09-13T22:05:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.169+0000 7f2fd3fff640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc1049f0 0x7f2fdc19be50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2fc402a9c0 tx=0x7f2fc40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.169+0000 7f2fd37fe640 1 -- 172.21.15.89:0/3532925895 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fc4004aa0 con 0x7f2fdc1049f0 2024-09-13T22:05:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.170+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc195bf0 con 0x7f2fdc1049f0 2024-09-13T22:05:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.170+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc1960e0 con 0x7f2fdc1049f0 2024-09-13T22:05:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.170+0000 7f2fd37fe640 1 -- 172.21.15.89:0/3532925895 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fc4004c00 con 0x7f2fdc1049f0 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.170+0000 7f2fd37fe640 1 -- 172.21.15.89:0/3532925895 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fc4003a20 con 0x7f2fdc1049f0 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.171+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fbc000fc0 con 0x7f2fdc1049f0 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.171+0000 7f2fd37fe640 1 -- 172.21.15.89:0/3532925895 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2fc4003c20 con 0x7f2fdc1049f0 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.172+0000 7f2fd37fe640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2fc806cc50 0x7f2fc806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.172+0000 7f2fd37fe640 1 -- 172.21.15.89:0/3532925895 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2fc40ace20 con 0x7f2fdc1049f0 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.172+0000 7f2fd37fe640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] conn(0x7f2fc80729e0 0x7f2fc8074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.172+0000 7f2fda59c640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2fc806cc50 0x7f2fc806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.172+0000 7f2fd37fe640 1 -- 172.21.15.89:0/3532925895 --> [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fc80754b0 con 0x7f2fc80729e0 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.172+0000 7f2fd37fe640 1 -- 172.21.15.89:0/3532925895 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fc40b2500 con 0x7f2fdc1049f0 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.172+0000 7f2fdad9d640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] conn(0x7f2fc80729e0 0x7f2fc8074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.173+0000 7f2fda59c640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2fc806cc50 0x7f2fc806f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00abe0 tx=0x7f2fcc00a2d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:25.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.173+0000 7f2fdad9d640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] conn(0x7f2fc80729e0 0x7f2fc8074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:25.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.174+0000 7f2fd37fe640 1 -- 172.21.15.89:0/3532925895 <== osd.1 v2:172.21.15.89:6810/2396439127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2fc80754b0 con 0x7f2fc80729e0 2024-09-13T22:05:25.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.188+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 --> [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fbc002c20 con 0x7f2fc80729e0 2024-09-13T22:05:25.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fd37fe640 1 -- 172.21.15.89:0/3532925895 <== osd.1 v2:172.21.15.89:6810/2396439127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fbc002c20 con 0x7f2fc80729e0 2024-09-13T22:05:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] conn(0x7f2fc80729e0 msgr2=0x7f2fc8074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] conn(0x7f2fc80729e0 0x7f2fc8074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2fc806cc50 msgr2=0x7f2fc806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2fc806cc50 0x7f2fc806f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00abe0 tx=0x7f2fcc00a2d0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc1049f0 msgr2=0x7f2fdc19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc1049f0 0x7f2fdc19be50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2fc402a9c0 tx=0x7f2fc40055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 shutdown_connections 2024-09-13T22:05:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6810/2396439127,v1:172.21.15.89:6811/2396439127] conn(0x7f2fc80729e0 0x7f2fc8074e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2fc806cc50 0x7f2fc806f110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fdc1049f0 0x7f2fdc19be50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 --2- 172.21.15.89:0/3532925895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fdc0fe9f0 0x7f2fdc19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 >> 172.21.15.89:0/3532925895 conn(0x7f2fdc0758a0 msgr2=0x7f2fdc0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:25.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 shutdown_connections 2024-09-13T22:05:25.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.189+0000 7f2fe0a1f640 1 -- 172.21.15.89:0/3532925895 wait complete. 2024-09-13T22:05:25.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:25 smithi089 ceph-mon[27921]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:25.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:25 smithi159 ceph-mon[35348]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:25.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.927+0000 7f55401d0640 1 -- 172.21.15.89:0/3322389005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5538100750 msgr2=0x7f55381047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.927+0000 7f55401d0640 1 --2- 172.21.15.89:0/3322389005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5538100750 0x7f55381047a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5528009880 tx=0x7f552802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 -- 172.21.15.89:0/3322389005 shutdown_connections 2024-09-13T22:05:25.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 --2- 172.21.15.89:0/3322389005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5538100750 0x7f55381047a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 --2- 172.21.15.89:0/3322389005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55380ffda0 0x7f5538100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 -- 172.21.15.89:0/3322389005 >> 172.21.15.89:0/3322389005 conn(0x7f55380fb840 msgr2=0x7f55380fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 -- 172.21.15.89:0/3322389005 shutdown_connections 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 -- 172.21.15.89:0/3322389005 wait complete. 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 Processor -- start 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 -- start start 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55380ffda0 0x7f553819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538100750 0x7f553819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5538195930 con 0x7f55380ffda0 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.928+0000 7f55401d0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5538195a70 con 0x7f5538100750 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f553df6c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55380ffda0 0x7f553819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f553df6c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55380ffda0 0x7f553819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50126/0 (socket says 172.21.15.89:50126) 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f553df6c640 1 -- 172.21.15.89:0/2724302730 learned_addr learned my addr 172.21.15.89:0/2724302730 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f553d76b640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538100750 0x7f553819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:25.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f553df6c640 1 -- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538100750 msgr2=0x7f553819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f553df6c640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538100750 0x7f553819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f553df6c640 1 -- 172.21.15.89:0/2724302730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528009560 con 0x7f55380ffda0 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f553df6c640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55380ffda0 0x7f553819b8d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f553400d6f0 tx=0x7f553400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f552effd640 1 -- 172.21.15.89:0/2724302730 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5534009a30 con 0x7f55380ffda0 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f552effd640 1 -- 172.21.15.89:0/2724302730 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55340054e0 con 0x7f55380ffda0 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5538195d50 con 0x7f55380ffda0 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f552effd640 1 -- 172.21.15.89:0/2724302730 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5534010460 con 0x7f55380ffda0 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.929+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5538196270 con 0x7f55380ffda0 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.930+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f553810d0d0 con 0x7f55380ffda0 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.931+0000 7f552effd640 1 -- 172.21.15.89:0/2724302730 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5534009b90 con 0x7f55380ffda0 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.931+0000 7f552effd640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f552406cc50 0x7f552406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:25.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.931+0000 7f552effd640 1 -- 172.21.15.89:0/2724302730 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f553408bac0 con 0x7f55380ffda0 2024-09-13T22:05:25.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.931+0000 7f553d76b640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f552406cc50 0x7f552406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:25.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.931+0000 7f552effd640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] conn(0x7f55240729e0 0x7f5524074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:25.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.931+0000 7f552effd640 1 -- 172.21.15.89:0/2724302730 --> [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55240754b0 con 0x7f55240729e0 2024-09-13T22:05:25.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.931+0000 7f552effd640 1 -- 172.21.15.89:0/2724302730 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55340902a0 con 0x7f55380ffda0 2024-09-13T22:05:25.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.932+0000 7f553d76b640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f552406cc50 0x7f552406f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5528000c00 tx=0x7f5528005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:25.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.932+0000 7f553e76d640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] conn(0x7f55240729e0 0x7f5524074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:25.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.932+0000 7f553e76d640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] conn(0x7f55240729e0 0x7f5524074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:25.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.933+0000 7f552effd640 1 -- 172.21.15.89:0/2724302730 <== osd.4 v2:172.21.15.159:6808/664583294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f55240754b0 con 0x7f55240729e0 2024-09-13T22:05:25.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.946+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 --> [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5538196750 con 0x7f55240729e0 2024-09-13T22:05:25.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.946+0000 7f552effd640 1 -- 172.21.15.89:0/2724302730 <== osd.4 v2:172.21.15.159:6808/664583294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5538196750 con 0x7f55240729e0 2024-09-13T22:05:25.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] conn(0x7f55240729e0 msgr2=0x7f5524074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] conn(0x7f55240729e0 0x7f5524074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f552406cc50 msgr2=0x7f552406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f552406cc50 0x7f552406f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5528000c00 tx=0x7f5528005a20 comp rx=0 tx=0).stop 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55380ffda0 msgr2=0x7f553819b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55380ffda0 0x7f553819b8d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f553400d6f0 tx=0x7f553400dbb0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 shutdown_connections 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:6808/664583294,v1:172.21.15.159:6809/664583294] conn(0x7f55240729e0 0x7f5524074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f552406cc50 0x7f552406f110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538100750 0x7f553819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 --2- 172.21.15.89:0/2724302730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55380ffda0 0x7f553819b8d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 >> 172.21.15.89:0/2724302730 conn(0x7f55380fb840 msgr2=0x7f55380fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 shutdown_connections 2024-09-13T22:05:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:25.947+0000 7f55401d0640 1 -- 172.21.15.89:0/2724302730 wait complete. 2024-09-13T22:05:27.571 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:27 smithi089 ceph-mon[27921]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:27.724 INFO:teuthology.orchestra.run.smithi089.stdout:60129542174 2024-09-13T22:05:27.724 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T22:05:27.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:27 smithi159 ceph-mon[35348]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:28.774 INFO:teuthology.orchestra.run.smithi089.stdout:146028888079 2024-09-13T22:05:28.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T22:05:29.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.396+0000 7f3f3fffe640 1 -- 172.21.15.89:0/318380085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 msgr2=0x7f3f38101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.396+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/318380085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 0x7f3f38101040 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3f280098b0 tx=0x7f3f2802a4d0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.396+0000 7f3f3fffe640 1 -- 172.21.15.89:0/318380085 shutdown_connections 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.396+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/318380085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f38101610 0x7f3f38109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.396+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/318380085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 0x7f3f38101040 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.396+0000 7f3f3fffe640 1 -- 172.21.15.89:0/318380085 >> 172.21.15.89:0/318380085 conn(0x7f3f380fa730 msgr2=0x7f3f380fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.396+0000 7f3f3fffe640 1 -- 172.21.15.89:0/318380085 shutdown_connections 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.396+0000 7f3f3fffe640 1 -- 172.21.15.89:0/318380085 wait complete. 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.397+0000 7f3f3fffe640 1 Processor -- start 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.397+0000 7f3f3fffe640 1 -- start start 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.397+0000 7f3f3fffe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 0x7f3f380fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.397+0000 7f3f3fffe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f38101610 0x7f3f380fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.397+0000 7f3f3fffe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380ff3d0 con 0x7f3f38100c60 2024-09-13T22:05:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.397+0000 7f3f3fffe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380ff540 con 0x7f3f38101610 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.397+0000 7f3f3dd9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 0x7f3f380fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.397+0000 7f3f3dd9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 0x7f3f380fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50142/0 (socket says 172.21.15.89:50142) 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.397+0000 7f3f3dd9a640 1 -- 172.21.15.89:0/1576682293 learned_addr learned my addr 172.21.15.89:0/1576682293 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f3d599640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f38101610 0x7f3f380fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f3dd9a640 1 -- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f38101610 msgr2=0x7f3f380fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f3dd9a640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f38101610 0x7f3f380fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f3dd9a640 1 -- 172.21.15.89:0/1576682293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28009560 con 0x7f3f38100c60 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f3dd9a640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 0x7f3f380fe950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009230 tx=0x7f3f280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f2effd640 1 -- 172.21.15.89:0/1576682293 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f28004aa0 con 0x7f3f38100c60 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f2effd640 1 -- 172.21.15.89:0/1576682293 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f28004c00 con 0x7f3f38100c60 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f380ff7c0 con 0x7f3f38100c60 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f2effd640 1 -- 172.21.15.89:0/1576682293 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f280039f0 con 0x7f3f38100c60 2024-09-13T22:05:29.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.398+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f381a2030 con 0x7f3f38100c60 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.399+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f3810d130 con 0x7f3f38100c60 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.399+0000 7f3f2effd640 1 -- 172.21.15.89:0/1576682293 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3f28031c00 con 0x7f3f38100c60 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.400+0000 7f3f2effd640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3f2406cc60 0x7f3f2406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.400+0000 7f3f2effd640 1 -- 172.21.15.89:0/1576682293 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3f280acf20 con 0x7f3f38100c60 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.400+0000 7f3f3d599640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3f2406cc60 0x7f3f2406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.400+0000 7f3f2effd640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] conn(0x7f3f240729f0 0x7f3f24074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.400+0000 7f3f2effd640 1 -- 172.21.15.89:0/1576682293 --> [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f240754c0 con 0x7f3f240729f0 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.400+0000 7f3f2effd640 1 -- 172.21.15.89:0/1576682293 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f280af5f0 con 0x7f3f38100c60 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.400+0000 7f3f3e59b640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] conn(0x7f3f240729f0 0x7f3f24074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.400+0000 7f3f3d599640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3f2406cc60 0x7f3f2406f120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f381000d0 tx=0x7f3f34008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.401+0000 7f3f3e59b640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] conn(0x7f3f240729f0 0x7f3f24074e10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.401+0000 7f3f2effd640 1 -- 172.21.15.89:0/1576682293 <== osd.3 v2:172.21.15.159:6800/3856170909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3f240754c0 con 0x7f3f240729f0 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.414+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 --> [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3f380ff7c0 con 0x7f3f240729f0 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f2effd640 1 -- 172.21.15.89:0/1576682293 <== osd.3 v2:172.21.15.159:6800/3856170909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3f380ff7c0 con 0x7f3f240729f0 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] conn(0x7f3f240729f0 msgr2=0x7f3f24074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] conn(0x7f3f240729f0 0x7f3f24074e10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3f2406cc60 msgr2=0x7f3f2406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3f2406cc60 0x7f3f2406f120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f381000d0 tx=0x7f3f34008040 comp rx=0 tx=0).stop 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 msgr2=0x7f3f380fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 0x7f3f380fe950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009230 tx=0x7f3f280055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 shutdown_connections 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:6800/3856170909,v1:172.21.15.159:6801/3856170909] conn(0x7f3f240729f0 0x7f3f24074e10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3f2406cc60 0x7f3f2406f120 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f38101610 0x7f3f380fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 --2- 172.21.15.89:0/1576682293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f38100c60 0x7f3f380fe950 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 >> 172.21.15.89:0/1576682293 conn(0x7f3f380fa730 msgr2=0x7f3f38101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:29.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 shutdown_connections 2024-09-13T22:05:29.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.415+0000 7f3f3fffe640 1 -- 172.21.15.89:0/1576682293 wait complete. 2024-09-13T22:05:29.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:29 smithi089 ceph-mon[27921]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:29 smithi159 ceph-mon[35348]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:29.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.845+0000 7fcc28370640 1 -- 172.21.15.89:0/4009137600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 msgr2=0x7fcc20104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.845+0000 7fcc28370640 1 --2- 172.21.15.89:0/4009137600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 0x7fcc20104e00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0097e0 tx=0x7fcc1c02a3f0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.845+0000 7fcc28370640 1 -- 172.21.15.89:0/4009137600 shutdown_connections 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.845+0000 7fcc28370640 1 --2- 172.21.15.89:0/4009137600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc200fea20 0x7fcc200fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.845+0000 7fcc28370640 1 --2- 172.21.15.89:0/4009137600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 0x7fcc20104e00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.845+0000 7fcc28370640 1 -- 172.21.15.89:0/4009137600 >> 172.21.15.89:0/4009137600 conn(0x7fcc200fa700 msgr2=0x7fcc200fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.845+0000 7fcc28370640 1 -- 172.21.15.89:0/4009137600 shutdown_connections 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.845+0000 7fcc28370640 1 -- 172.21.15.89:0/4009137600 wait complete. 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc28370640 1 Processor -- start 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc28370640 1 -- start start 2024-09-13T22:05:29.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc28370640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc200fea20 0x7fcc20196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc28370640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 0x7fcc20196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc28370640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20197480 con 0x7fcc20104a20 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc28370640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc201975f0 con 0x7fcc200fea20 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc2590b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 0x7fcc20196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc2590b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 0x7fcc20196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50158/0 (socket says 172.21.15.89:50158) 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc2590b640 1 -- 172.21.15.89:0/1370400403 learned_addr learned my addr 172.21.15.89:0/1370400403 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc2610c640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc200fea20 0x7fcc20196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc2590b640 1 -- 172.21.15.89:0/1370400403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc200fea20 msgr2=0x7fcc20196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc2590b640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc200fea20 0x7fcc20196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.846+0000 7fcc2590b640 1 -- 172.21.15.89:0/1370400403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c009490 con 0x7fcc20104a20 2024-09-13T22:05:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.847+0000 7fcc2590b640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 0x7fcc20196eb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000e970 tx=0x7fcc1000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.847+0000 7fcc177fe640 1 -- 172.21.15.89:0/1370400403 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc1000cc90 con 0x7fcc20104a20 2024-09-13T22:05:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.847+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2019f9e0 con 0x7fcc20104a20 2024-09-13T22:05:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.847+0000 7fcc177fe640 1 -- 172.21.15.89:0/1370400403 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc1000cdf0 con 0x7fcc20104a20 2024-09-13T22:05:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.847+0000 7fcc177fe640 1 -- 172.21.15.89:0/1370400403 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc10010430 con 0x7fcc20104a20 2024-09-13T22:05:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.847+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2019fe50 con 0x7fcc20104a20 2024-09-13T22:05:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.848+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc2010bfb0 con 0x7fcc20104a20 2024-09-13T22:05:29.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.848+0000 7fcc177fe640 1 -- 172.21.15.89:0/1370400403 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcc100046c0 con 0x7fcc20104a20 2024-09-13T22:05:29.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.849+0000 7fcc177fe640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcc0c06cc50 0x7fcc0c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:29.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.849+0000 7fcc2610c640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcc0c06cc50 0x7fcc0c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:29.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.849+0000 7fcc177fe640 1 -- 172.21.15.89:0/1370400403 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcc10014070 con 0x7fcc20104a20 2024-09-13T22:05:29.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.849+0000 7fcc177fe640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] conn(0x7fcc0c0729e0 0x7fcc0c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:29.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.849+0000 7fcc177fe640 1 -- 172.21.15.89:0/1370400403 --> [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc0c0754b0 con 0x7fcc0c0729e0 2024-09-13T22:05:29.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.849+0000 7fcc177fe640 1 -- 172.21.15.89:0/1370400403 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc1008cae0 con 0x7fcc20104a20 2024-09-13T22:05:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.849+0000 7fcc2690d640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] conn(0x7fcc0c0729e0 0x7fcc0c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.849+0000 7fcc2610c640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcc0c06cc50 0x7fcc0c06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0097b0 tx=0x7fcc1c0058b0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.849+0000 7fcc2690d640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] conn(0x7fcc0c0729e0 0x7fcc0c074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.850+0000 7fcc177fe640 1 -- 172.21.15.89:0/1370400403 <== osd.0 v2:172.21.15.89:6802/3447581419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fcc0c0754b0 con 0x7fcc0c0729e0 2024-09-13T22:05:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.863+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 --> [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcc20060bb0 con 0x7fcc0c0729e0 2024-09-13T22:05:29.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.863+0000 7fcc177fe640 1 -- 172.21.15.89:0/1370400403 <== osd.0 v2:172.21.15.89:6802/3447581419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcc20060bb0 con 0x7fcc0c0729e0 2024-09-13T22:05:29.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.863+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] conn(0x7fcc0c0729e0 msgr2=0x7fcc0c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.863+0000 7fcc28370640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] conn(0x7fcc0c0729e0 0x7fcc0c074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcc0c06cc50 msgr2=0x7fcc0c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcc0c06cc50 0x7fcc0c06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0097b0 tx=0x7fcc1c0058b0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 msgr2=0x7fcc20196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:29.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 0x7fcc20196eb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000e970 tx=0x7fcc1000ee30 comp rx=0 tx=0).stop 2024-09-13T22:05:29.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 shutdown_connections 2024-09-13T22:05:29.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6802/3447581419,v1:172.21.15.89:6803/3447581419] conn(0x7fcc0c0729e0 0x7fcc0c074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcc0c06cc50 0x7fcc0c06f110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc20104a20 0x7fcc20196eb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 --2- 172.21.15.89:0/1370400403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc200fea20 0x7fcc20196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:29.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 >> 172.21.15.89:0/1370400403 conn(0x7fcc200fa700 msgr2=0x7fcc200fb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:29.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 shutdown_connections 2024-09-13T22:05:29.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:29.864+0000 7fcc28370640 1 -- 172.21.15.89:0/1370400403 wait complete. 2024-09-13T22:05:30.602 INFO:teuthology.orchestra.run.smithi089.stdout:38654705700 2024-09-13T22:05:30.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T22:05:30.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.878+0000 7feae5224640 1 -- 172.21.15.89:0/2735862049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae0100cb0 msgr2=0x7feae0101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.878+0000 7feae5224640 1 --2- 172.21.15.89:0/2735862049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae0100cb0 0x7feae0101090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fead0009880 tx=0x7fead002a530 comp rx=0 tx=0).stop 2024-09-13T22:05:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.878+0000 7feae5224640 1 -- 172.21.15.89:0/2735862049 shutdown_connections 2024-09-13T22:05:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.878+0000 7feae5224640 1 --2- 172.21.15.89:0/2735862049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae01015d0 0x7feae0109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.878+0000 7feae5224640 1 --2- 172.21.15.89:0/2735862049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae0100cb0 0x7feae0101090 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.878+0000 7feae5224640 1 -- 172.21.15.89:0/2735862049 >> 172.21.15.89:0/2735862049 conn(0x7feae00758a0 msgr2=0x7feae00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.878+0000 7feae5224640 1 -- 172.21.15.89:0/2735862049 shutdown_connections 2024-09-13T22:05:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.878+0000 7feae5224640 1 -- 172.21.15.89:0/2735862049 wait complete. 2024-09-13T22:05:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.879+0000 7feae5224640 1 Processor -- start 2024-09-13T22:05:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.879+0000 7feae5224640 1 -- start start 2024-09-13T22:05:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.879+0000 7feae5224640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae0100cb0 0x7feae019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.879+0000 7feae5224640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae01015d0 0x7feae019bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.879+0000 7feae5224640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0195a20 con 0x7feae01015d0 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.879+0000 7feae5224640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0195b60 con 0x7feae0100cb0 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7fead659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae01015d0 0x7feae019bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7fead659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae01015d0 0x7feae019bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50170/0 (socket says 172.21.15.89:50170) 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7fead659c640 1 -- 172.21.15.89:0/3231099913 learned_addr learned my addr 172.21.15.89:0/3231099913 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7feaded9d640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae0100cb0 0x7feae019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7fead659c640 1 -- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae0100cb0 msgr2=0x7feae019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7fead659c640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae0100cb0 0x7feae019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7fead659c640 1 -- 172.21.15.89:0/3231099913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0009560 con 0x7feae01015d0 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7fead659c640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae01015d0 0x7feae019bf00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feac800b370 tx=0x7feac800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7feadcd99640 1 -- 172.21.15.89:0/3231099913 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac8011800 con 0x7feae01015d0 2024-09-13T22:05:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7feadcd99640 1 -- 172.21.15.89:0/3231099913 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feac8011e20 con 0x7feae01015d0 2024-09-13T22:05:30.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae0195e40 con 0x7feae01015d0 2024-09-13T22:05:30.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7feadcd99640 1 -- 172.21.15.89:0/3231099913 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac800f2e0 con 0x7feae01015d0 2024-09-13T22:05:30.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.880+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae0196390 con 0x7feae01015d0 2024-09-13T22:05:30.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.881+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feae0068510 con 0x7feae01015d0 2024-09-13T22:05:30.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.882+0000 7feadcd99640 1 -- 172.21.15.89:0/3231099913 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7feac800f570 con 0x7feae01015d0 2024-09-13T22:05:30.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.882+0000 7feadcd99640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7feacc06cc50 0x7feacc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:30.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.882+0000 7feadcd99640 1 -- 172.21.15.89:0/3231099913 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7feac808bac0 con 0x7feae01015d0 2024-09-13T22:05:30.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.882+0000 7feaded9d640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7feacc06cc50 0x7feacc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:30.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.883+0000 7feadcd99640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] conn(0x7feacc0729e0 0x7feacc074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:30.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.883+0000 7feadcd99640 1 -- 172.21.15.89:0/3231099913 --> [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feacc0754b0 con 0x7feacc0729e0 2024-09-13T22:05:30.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.883+0000 7feadcd99640 1 -- 172.21.15.89:0/3231099913 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7feac80902a0 con 0x7feae01015d0 2024-09-13T22:05:30.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.883+0000 7feadf59e640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] conn(0x7feacc0729e0 0x7feacc074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:30.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.883+0000 7feaded9d640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7feacc06cc50 0x7feacc06f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fead0000c00 tx=0x7fead0005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:30.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.884+0000 7feadf59e640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] conn(0x7feacc0729e0 0x7feacc074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:30.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.884+0000 7feadcd99640 1 -- 172.21.15.89:0/3231099913 <== osd.5 v2:172.21.15.159:6816/2377310384 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7feacc0754b0 con 0x7feacc0729e0 2024-09-13T22:05:30.890 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:30.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.898+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 --> [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feae010d040 con 0x7feacc0729e0 2024-09-13T22:05:30.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feadcd99640 1 -- 172.21.15.89:0/3231099913 <== osd.5 v2:172.21.15.159:6816/2377310384 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7feae010d040 con 0x7feacc0729e0 2024-09-13T22:05:30.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] conn(0x7feacc0729e0 msgr2=0x7feacc074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:30.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] conn(0x7feacc0729e0 0x7feacc074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:30.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7feacc06cc50 msgr2=0x7feacc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:30.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7feacc06cc50 0x7feacc06f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fead0000c00 tx=0x7fead0005a20 comp rx=0 tx=0).stop 2024-09-13T22:05:30.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae01015d0 msgr2=0x7feae019bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:30.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae01015d0 0x7feae019bf00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feac800b370 tx=0x7feac800b830 comp rx=0 tx=0).stop 2024-09-13T22:05:30.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 shutdown_connections 2024-09-13T22:05:30.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7feacc06cc50 0x7feacc06f110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:30.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:6816/2377310384,v1:172.21.15.159:6817/2377310384] conn(0x7feacc0729e0 0x7feacc074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:30.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feae01015d0 0x7feae019bf00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:30.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 --2- 172.21.15.89:0/3231099913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feae0100cb0 0x7feae019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:30.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 >> 172.21.15.89:0/3231099913 conn(0x7feae00758a0 msgr2=0x7feae0102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:30.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 shutdown_connections 2024-09-13T22:05:30.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:30.899+0000 7feae5224640 1 -- 172.21.15.89:0/3231099913 wait complete. 2024-09-13T22:05:31.415 INFO:teuthology.orchestra.run.smithi089.stdout:111669149716 2024-09-13T22:05:31.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T22:05:31.654 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:31.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:31 smithi089 ceph-mon[27921]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:31 smithi159 ceph-mon[35348]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:32.271 INFO:teuthology.orchestra.run.smithi089.stdout:167503724554 2024-09-13T22:05:32.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T22:05:33.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:33 smithi089 ceph-mon[27921]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:33.499 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:33 smithi159 ceph-mon[35348]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 -- 172.21.15.89:0/1295762480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84101f70 msgr2=0x7f8d84102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1295762480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84101f70 0x7f8d84102350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009880 tx=0x7f8d8002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 -- 172.21.15.89:0/1295762480 shutdown_connections 2024-09-13T22:05:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1295762480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d84102920 0x7f8d84106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1295762480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84101f70 0x7f8d84102350 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 -- 172.21.15.89:0/1295762480 >> 172.21.15.89:0/1295762480 conn(0x7f8d840fd9f0 msgr2=0x7f8d840ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 -- 172.21.15.89:0/1295762480 shutdown_connections 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 -- 172.21.15.89:0/1295762480 wait complete. 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 Processor -- start 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 -- start start 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.042+0000 7f8d8b350640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d84101f70 0x7f8d8419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d8b350640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84102920 0x7f8d8419de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d8b350640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8419e4e0 con 0x7f8d84102920 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d8b350640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84197ad0 con 0x7f8d84101f70 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d888eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84102920 0x7f8d8419de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d888eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84102920 0x7f8d8419de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34858/0 (socket says 172.21.15.89:34858) 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d888eb640 1 -- 172.21.15.89:0/1761865620 learned_addr learned my addr 172.21.15.89:0/1761865620 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d890ec640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d84101f70 0x7f8d8419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d888eb640 1 -- 172.21.15.89:0/1761865620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d84101f70 msgr2=0x7f8d8419d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d888eb640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d84101f70 0x7f8d8419d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d888eb640 1 -- 172.21.15.89:0/1761865620 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80009560 con 0x7f8d84102920 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d888eb640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84102920 0x7f8d8419de50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d6f0 tx=0x7f8d7400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d7a7fc640 1 -- 172.21.15.89:0/1761865620 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d74009a30 con 0x7f8d84102920 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d84197db0 con 0x7f8d84102920 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d7a7fc640 1 -- 172.21.15.89:0/1761865620 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d740054e0 con 0x7f8d84102920 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d7a7fc640 1 -- 172.21.15.89:0/1761865620 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d74010460 con 0x7f8d84102920 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.043+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d84198300 con 0x7f8d84102920 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.044+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d8410f270 con 0x7f8d84102920 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.045+0000 7f8d7a7fc640 1 -- 172.21.15.89:0/1761865620 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8d74009b90 con 0x7f8d84102920 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.045+0000 7f8d7a7fc640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8d7006cc60 0x7f8d7006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:34.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.045+0000 7f8d7a7fc640 1 -- 172.21.15.89:0/1761865620 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8d7408ba10 con 0x7f8d84102920 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.045+0000 7f8d890ec640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8d7006cc60 0x7f8d7006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.045+0000 7f8d7a7fc640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] conn(0x7f8d700729f0 0x7f8d70074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.045+0000 7f8d7a7fc640 1 -- 172.21.15.89:0/1761865620 --> [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d700754c0 con 0x7f8d700729f0 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.045+0000 7f8d7a7fc640 1 -- 172.21.15.89:0/1761865620 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d740902a0 con 0x7f8d84102920 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.046+0000 7f8d898ed640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] conn(0x7f8d700729f0 0x7f8d70074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.046+0000 7f8d890ec640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8d7006cc60 0x7f8d7006f120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009230 tx=0x7f8d80005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.046+0000 7f8d898ed640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] conn(0x7f8d700729f0 0x7f8d70074e10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.046+0000 7f8d7a7fc640 1 -- 172.21.15.89:0/1761865620 <== osd.2 v2:172.21.15.89:6818/2807079294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8d700754c0 con 0x7f8d700729f0 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.059+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 --> [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d84198760 con 0x7f8d700729f0 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d7a7fc640 1 -- 172.21.15.89:0/1761865620 <== osd.2 v2:172.21.15.89:6818/2807079294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d84198760 con 0x7f8d700729f0 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] conn(0x7f8d700729f0 msgr2=0x7f8d70074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] conn(0x7f8d700729f0 0x7f8d70074e10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8d7006cc60 msgr2=0x7f8d7006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8d7006cc60 0x7f8d7006f120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009230 tx=0x7f8d80005a20 comp rx=0 tx=0).stop 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84102920 msgr2=0x7f8d8419de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84102920 0x7f8d8419de50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d6f0 tx=0x7f8d7400dbb0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 shutdown_connections 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6818/2807079294,v1:172.21.15.89:6819/2807079294] conn(0x7f8d700729f0 0x7f8d70074e10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8d7006cc60 0x7f8d7006f120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d84102920 0x7f8d8419de50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 --2- 172.21.15.89:0/1761865620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d84101f70 0x7f8d8419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 >> 172.21.15.89:0/1761865620 conn(0x7f8d840fd9f0 msgr2=0x7f8d840fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 shutdown_connections 2024-09-13T22:05:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:34.060+0000 7f8d8b350640 1 -- 172.21.15.89:0/1761865620 wait complete. 2024-09-13T22:05:35.128 INFO:teuthology.orchestra.run.smithi089.stdout:81604378650 2024-09-13T22:05:35.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T22:05:35.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:35 smithi089 ceph-mon[27921]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:35 smithi159 ceph-mon[35348]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:36.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.667+0000 7fa01fa24640 1 -- 172.21.15.89:0/1537202933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa018104a30 msgr2=0x7fa018104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:36.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.667+0000 7fa01fa24640 1 --2- 172.21.15.89:0/1537202933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa018104a30 0x7fa018104e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa014009880 tx=0x7fa01402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:36.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.667+0000 7fa01fa24640 1 -- 172.21.15.89:0/1537202933 shutdown_connections 2024-09-13T22:05:36.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.667+0000 7fa01fa24640 1 --2- 172.21.15.89:0/1537202933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180fea30 0x7fa0180fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:36.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.667+0000 7fa01fa24640 1 --2- 172.21.15.89:0/1537202933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa018104a30 0x7fa018104e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:36.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.667+0000 7fa01fa24640 1 -- 172.21.15.89:0/1537202933 >> 172.21.15.89:0/1537202933 conn(0x7fa0180fa730 msgr2=0x7fa0180fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:36.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.668+0000 7fa01fa24640 1 -- 172.21.15.89:0/1537202933 shutdown_connections 2024-09-13T22:05:36.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.668+0000 7fa01fa24640 1 -- 172.21.15.89:0/1537202933 wait complete. 2024-09-13T22:05:36.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.668+0000 7fa01fa24640 1 Processor -- start 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.668+0000 7fa01fa24640 1 -- start start 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01fa24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0180fea30 0x7fa01819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01fa24640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018104a30 0x7fa01819ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01fa24640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01819b390 con 0x7fa0180fea30 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01fa24640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018194920 con 0x7fa018104a30 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01d7c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0180fea30 0x7fa01819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01d7c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0180fea30 0x7fa01819a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34878/0 (socket says 172.21.15.89:34878) 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01d7c0640 1 -- 172.21.15.89:0/2436395895 learned_addr learned my addr 172.21.15.89:0/2436395895 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01cfbf640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018104a30 0x7fa01819ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01d7c0640 1 -- 172.21.15.89:0/2436395895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018104a30 msgr2=0x7fa01819ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01d7c0640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018104a30 0x7fa01819ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:36.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01d7c0640 1 -- 172.21.15.89:0/2436395895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014009560 con 0x7fa0180fea30 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01d7c0640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0180fea30 0x7fa01819a830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa01402a9c0 tx=0x7fa0140055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa00e7fc640 1 -- 172.21.15.89:0/2436395895 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa014004aa0 con 0x7fa0180fea30 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa018194ba0 con 0x7fa0180fea30 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa00e7fc640 1 -- 172.21.15.89:0/2436395895 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa014004c00 con 0x7fa0180fea30 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa00e7fc640 1 -- 172.21.15.89:0/2436395895 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa014003ab0 con 0x7fa0180fea30 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.669+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa018195090 con 0x7fa0180fea30 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.670+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa018100170 con 0x7fa0180fea30 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.671+0000 7fa00e7fc640 1 -- 172.21.15.89:0/2436395895 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa014031d20 con 0x7fa0180fea30 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.671+0000 7fa00e7fc640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa00406cc50 0x7fa00406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.671+0000 7fa00e7fc640 1 -- 172.21.15.89:0/2436395895 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa0140ad020 con 0x7fa0180fea30 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.671+0000 7fa01cfbf640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa00406cc50 0x7fa00406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.672+0000 7fa01cfbf640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa00406cc50 0x7fa00406f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa018195d90 tx=0x7fa008008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:36.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.676+0000 7fa00e7fc640 1 -- 172.21.15.89:0/2436395895 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa014077730 con 0x7fa0180fea30 2024-09-13T22:05:36.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.845+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa018106fa0 con 0x7fa0180fea30 2024-09-13T22:05:36.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.845+0000 7fa00e7fc640 1 -- 172.21.15.89:0/2436395895 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa01407ad50 con 0x7fa0180fea30 2024-09-13T22:05:36.848 INFO:teuthology.orchestra.run.smithi089.stdout:146028888081 2024-09-13T22:05:36.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.847+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa00406cc50 msgr2=0x7fa00406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:36.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa00406cc50 0x7fa00406f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa018195d90 tx=0x7fa008008040 comp rx=0 tx=0).stop 2024-09-13T22:05:36.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0180fea30 msgr2=0x7fa01819a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:36.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0180fea30 0x7fa01819a830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa01402a9c0 tx=0x7fa0140055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:36.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 shutdown_connections 2024-09-13T22:05:36.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fa00406cc50 0x7fa00406f110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:36.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018104a30 0x7fa01819ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:36.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 --2- 172.21.15.89:0/2436395895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0180fea30 0x7fa01819a830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:36.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 >> 172.21.15.89:0/2436395895 conn(0x7fa0180fa730 msgr2=0x7fa0180fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:36.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 shutdown_connections 2024-09-13T22:05:36.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:36.848+0000 7fa01fa24640 1 -- 172.21.15.89:0/2436395895 wait complete. 2024-09-13T22:05:37.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.261+0000 7f5838ede640 1 -- 172.21.15.89:0/2755120669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 msgr2=0x7f5834109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:37.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.261+0000 7f5838ede640 1 --2- 172.21.15.89:0/2755120669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 0x7f5834109ac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5828009880 tx=0x7f582802a530 comp rx=0 tx=0).stop 2024-09-13T22:05:37.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.262+0000 7f5838ede640 1 -- 172.21.15.89:0/2755120669 shutdown_connections 2024-09-13T22:05:37.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.262+0000 7f5838ede640 1 --2- 172.21.15.89:0/2755120669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 0x7f5834109ac0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:37.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.262+0000 7f5838ede640 1 --2- 172.21.15.89:0/2755120669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5834100cb0 0x7f5834101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:37.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.262+0000 7f5838ede640 1 -- 172.21.15.89:0/2755120669 >> 172.21.15.89:0/2755120669 conn(0x7f58340758a0 msgr2=0x7f58340fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:37.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.262+0000 7f5838ede640 1 -- 172.21.15.89:0/2755120669 shutdown_connections 2024-09-13T22:05:37.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.262+0000 7f5838ede640 1 -- 172.21.15.89:0/2755120669 wait complete. 2024-09-13T22:05:37.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.262+0000 7f5838ede640 1 Processor -- start 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5838ede640 1 -- start start 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5838ede640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5834100cb0 0x7f583419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5838ede640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 0x7f583419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5838ede640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583419c3b0 con 0x7f58341015d0 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5838ede640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5834195940 con 0x7f5834100cb0 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5831d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 0x7f583419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5831d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 0x7f583419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34906/0 (socket says 172.21.15.89:34906) 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5831d9b640 1 -- 172.21.15.89:0/1018512737 learned_addr learned my addr 172.21.15.89:0/1018512737 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5831d9b640 1 -- 172.21.15.89:0/1018512737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5834100cb0 msgr2=0x7f583419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f583259c640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5834100cb0 0x7f583419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5831d9b640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5834100cb0 0x7f583419b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5831d9b640 1 -- 172.21.15.89:0/1018512737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828009560 con 0x7f58341015d0 2024-09-13T22:05:37.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.263+0000 7f5831d9b640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 0x7f583419bd90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f582802aa50 tx=0x7f58280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.264+0000 7f58237fe640 1 -- 172.21.15.89:0/1018512737 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5828004aa0 con 0x7f58341015d0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.264+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5834195bc0 con 0x7f58341015d0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.264+0000 7f58237fe640 1 -- 172.21.15.89:0/1018512737 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5828004c00 con 0x7f58341015d0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.264+0000 7f58237fe640 1 -- 172.21.15.89:0/1018512737 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58280039b0 con 0x7f58341015d0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.264+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58341960b0 con 0x7f58341015d0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.265+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5834068510 con 0x7f58341015d0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.265+0000 7f58237fe640 1 -- 172.21.15.89:0/1018512737 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f582802ad50 con 0x7f58341015d0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.266+0000 7f58237fe640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f581c06cc50 0x7f581c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.266+0000 7f58237fe640 1 -- 172.21.15.89:0/1018512737 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f58280acd90 con 0x7f58341015d0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.266+0000 7f583259c640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f581c06cc50 0x7f581c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.266+0000 7f583259c640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f581c06cc50 0x7f581c06f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5824005c40 tx=0x7f5824008230 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:37.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.270+0000 7f58237fe640 1 -- 172.21.15.89:0/1018512737 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f58280774a0 con 0x7f58341015d0 2024-09-13T22:05:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.440+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5834101090 con 0x7f58341015d0 2024-09-13T22:05:37.443 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:37 smithi089 ceph-mon[27921]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:37.443 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:37 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2436395895' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T22:05:37.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.441+0000 7f58237fe640 1 -- 172.21.15.89:0/1018512737 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f582807aac0 con 0x7f58341015d0 2024-09-13T22:05:37.444 INFO:teuthology.orchestra.run.smithi089.stdout:60129542176 2024-09-13T22:05:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f581c06cc50 msgr2=0x7f581c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f581c06cc50 0x7f581c06f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5824005c40 tx=0x7f5824008230 comp rx=0 tx=0).stop 2024-09-13T22:05:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 msgr2=0x7f583419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 0x7f583419bd90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f582802aa50 tx=0x7f58280055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 shutdown_connections 2024-09-13T22:05:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f581c06cc50 0x7f581c06f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58341015d0 0x7f583419bd90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:37.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 --2- 172.21.15.89:0/1018512737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5834100cb0 0x7f583419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:37.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 >> 172.21.15.89:0/1018512737 conn(0x7f58340758a0 msgr2=0x7f5834101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:37.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 shutdown_connections 2024-09-13T22:05:37.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:37.443+0000 7f5838ede640 1 -- 172.21.15.89:0/1018512737 wait complete. 2024-09-13T22:05:37.729 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:37 smithi159 ceph-mon[35348]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:37 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2436395895' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T22:05:38.138 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:38.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:38 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1018512737' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T22:05:38.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:38 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/1018512737' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T22:05:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.739+0000 7f880bde6640 1 -- 172.21.15.89:0/775342709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 msgr2=0x7f8804104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.739+0000 7f880bde6640 1 --2- 172.21.15.89:0/775342709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 0x7f8804104dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8800009880 tx=0x7f880002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.739+0000 7f880bde6640 1 -- 172.21.15.89:0/775342709 shutdown_connections 2024-09-13T22:05:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.739+0000 7f880bde6640 1 --2- 172.21.15.89:0/775342709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88040fe9f0 0x7f88040fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.739+0000 7f880bde6640 1 --2- 172.21.15.89:0/775342709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 0x7f8804104dd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.739+0000 7f880bde6640 1 -- 172.21.15.89:0/775342709 >> 172.21.15.89:0/775342709 conn(0x7f88040758a0 msgr2=0x7f88040fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.739+0000 7f880bde6640 1 -- 172.21.15.89:0/775342709 shutdown_connections 2024-09-13T22:05:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.739+0000 7f880bde6640 1 -- 172.21.15.89:0/775342709 wait complete. 2024-09-13T22:05:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f880bde6640 1 Processor -- start 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f880bde6640 1 -- start start 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f880bde6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88040fe9f0 0x7f8804196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f880bde6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 0x7f8804196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f880bde6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804197510 con 0x7f88041049f0 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f880bde6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804197680 con 0x7f88040fe9f0 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f8809381640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 0x7f8804196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f8809381640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 0x7f8804196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34930/0 (socket says 172.21.15.89:34930) 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f8809381640 1 -- 172.21.15.89:0/4009438688 learned_addr learned my addr 172.21.15.89:0/4009438688 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.740+0000 7f8809b82640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88040fe9f0 0x7f8804196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.741+0000 7f8809381640 1 -- 172.21.15.89:0/4009438688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88040fe9f0 msgr2=0x7f8804196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.741+0000 7f8809381640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88040fe9f0 0x7f8804196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.741+0000 7f8809381640 1 -- 172.21.15.89:0/4009438688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800009560 con 0x7f88041049f0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.741+0000 7f8809381640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 0x7f8804196f40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f87f400b420 tx=0x7f87f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.741+0000 7f87faffd640 1 -- 172.21.15.89:0/4009438688 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f4011800 con 0x7f88041049f0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.741+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880419fa70 con 0x7f88041049f0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.741+0000 7f87faffd640 1 -- 172.21.15.89:0/4009438688 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87f4011e20 con 0x7f88041049f0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.741+0000 7f87faffd640 1 -- 172.21.15.89:0/4009438688 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f400f2e0 con 0x7f88041049f0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.741+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880419fee0 con 0x7f88041049f0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.742+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8804100130 con 0x7f88041049f0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.742+0000 7f87faffd640 1 -- 172.21.15.89:0/4009438688 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f87f4010380 con 0x7f88041049f0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.743+0000 7f87faffd640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f87f006cc50 0x7f87f006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.743+0000 7f87faffd640 1 -- 172.21.15.89:0/4009438688 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f87f408b880 con 0x7f88041049f0 2024-09-13T22:05:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.743+0000 7f8809b82640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f87f006cc50 0x7f87f006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:38.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.743+0000 7f8809b82640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f87f006cc50 0x7f87f006f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8800000c00 tx=0x7f8800005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:38.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.747+0000 7f87faffd640 1 -- 172.21.15.89:0/4009438688 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f87f4055f90 con 0x7f88041049f0 2024-09-13T22:05:38.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888079 got 146028888081 for osd.4 2024-09-13T22:05:38.885 DEBUG:teuthology.parallel:result is None 2024-09-13T22:05:38.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.918+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88040feed0 con 0x7f88041049f0 2024-09-13T22:05:38.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.918+0000 7f87faffd640 1 -- 172.21.15.89:0/4009438688 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87f40595b0 con 0x7f88041049f0 2024-09-13T22:05:38.920 INFO:teuthology.orchestra.run.smithi089.stdout:111669149718 2024-09-13T22:05:38.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f87f006cc50 msgr2=0x7f87f006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:38.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f87f006cc50 0x7f87f006f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8800000c00 tx=0x7f8800005a20 comp rx=0 tx=0).stop 2024-09-13T22:05:38.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 msgr2=0x7f8804196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:38.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 0x7f8804196f40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f87f400b420 tx=0x7f87f400b8e0 comp rx=0 tx=0).stop 2024-09-13T22:05:38.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 shutdown_connections 2024-09-13T22:05:38.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f87f006cc50 0x7f87f006f110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:38.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88041049f0 0x7f8804196f40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:38.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 --2- 172.21.15.89:0/4009438688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88040fe9f0 0x7f8804196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:38.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 >> 172.21.15.89:0/4009438688 conn(0x7f88040758a0 msgr2=0x7f88040fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:38.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 shutdown_connections 2024-09-13T22:05:38.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:38.921+0000 7f880bde6640 1 -- 172.21.15.89:0/4009438688 wait complete. 2024-09-13T22:05:39.106 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:39.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:39 smithi089 ceph-mon[27921]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:39.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:39 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/4009438688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T22:05:39.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:39 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:05:39.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:39 smithi159 ceph-mon[35348]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:39.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:39 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/4009438688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T22:05:39.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:39 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:05:40.137 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149716 got 111669149718 for osd.3 2024-09-13T22:05:40.137 DEBUG:teuthology.parallel:result is None 2024-09-13T22:05:41.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:41 smithi089 ceph-mon[27921]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:41.501 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-09-13T22:05:41.501 DEBUG:teuthology.parallel:result is None 2024-09-13T22:05:41.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:41 smithi159 ceph-mon[35348]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:43.488 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:43 smithi089 ceph-mon[27921]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.710+0000 7fda3d02d640 1 -- 172.21.15.89:0/412634309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 msgr2=0x7fda38101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.710+0000 7fda3d02d640 1 --2- 172.21.15.89:0/412634309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 0x7fda38101090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda28009880 tx=0x7fda2802a530 comp rx=0 tx=0).stop 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.710+0000 7fda3d02d640 1 -- 172.21.15.89:0/412634309 shutdown_connections 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.710+0000 7fda3d02d640 1 --2- 172.21.15.89:0/412634309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda381015d0 0x7fda38109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.710+0000 7fda3d02d640 1 --2- 172.21.15.89:0/412634309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 0x7fda38101090 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.710+0000 7fda3d02d640 1 -- 172.21.15.89:0/412634309 >> 172.21.15.89:0/412634309 conn(0x7fda380758a0 msgr2=0x7fda380fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.710+0000 7fda3d02d640 1 -- 172.21.15.89:0/412634309 shutdown_connections 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.710+0000 7fda3d02d640 1 -- 172.21.15.89:0/412634309 wait complete. 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.711+0000 7fda3d02d640 1 Processor -- start 2024-09-13T22:05:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.711+0000 7fda3d02d640 1 -- start start 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.711+0000 7fda3d02d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 0x7fda3819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.711+0000 7fda3d02d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda381015d0 0x7fda3819bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.711+0000 7fda3d02d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38195a20 con 0x7fda38100cb0 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.711+0000 7fda3d02d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38195b60 con 0x7fda381015d0 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.711+0000 7fda36d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 0x7fda3819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.711+0000 7fda36d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 0x7fda3819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41758/0 (socket says 172.21.15.89:41758) 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.711+0000 7fda36d9d640 1 -- 172.21.15.89:0/3102290702 learned_addr learned my addr 172.21.15.89:0/3102290702 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda3659c640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda381015d0 0x7fda3819bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda36d9d640 1 -- 172.21.15.89:0/3102290702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda381015d0 msgr2=0x7fda3819bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda36d9d640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda381015d0 0x7fda3819bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda36d9d640 1 -- 172.21.15.89:0/3102290702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28009560 con 0x7fda38100cb0 2024-09-13T22:05:43.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda36d9d640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 0x7fda3819b9c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fda2802aa50 tx=0x7fda280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:43.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda1ffff640 1 -- 172.21.15.89:0/3102290702 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda28004aa0 con 0x7fda38100cb0 2024-09-13T22:05:43.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda38195de0 con 0x7fda38100cb0 2024-09-13T22:05:43.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda1ffff640 1 -- 172.21.15.89:0/3102290702 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda28004c00 con 0x7fda38100cb0 2024-09-13T22:05:43.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda1ffff640 1 -- 172.21.15.89:0/3102290702 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda28003ab0 con 0x7fda38100cb0 2024-09-13T22:05:43.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.712+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda381962d0 con 0x7fda38100cb0 2024-09-13T22:05:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.713+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda38068510 con 0x7fda38100cb0 2024-09-13T22:05:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.714+0000 7fda1ffff640 1 -- 172.21.15.89:0/3102290702 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fda2802ad50 con 0x7fda38100cb0 2024-09-13T22:05:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.714+0000 7fda1ffff640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fda2006cc50 0x7fda2006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.714+0000 7fda1ffff640 1 -- 172.21.15.89:0/3102290702 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fda280acd70 con 0x7fda38100cb0 2024-09-13T22:05:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.714+0000 7fda3659c640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fda2006cc50 0x7fda2006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.715+0000 7fda3659c640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fda2006cc50 0x7fda2006f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda38197270 tx=0x7fda2c008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:43.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.718+0000 7fda1ffff640 1 -- 172.21.15.89:0/3102290702 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fda28077480 con 0x7fda38100cb0 2024-09-13T22:05:43.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:43 smithi159 ceph-mon[35348]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:43.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.886+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fda38101110 con 0x7fda38100cb0 2024-09-13T22:05:43.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.886+0000 7fda1ffff640 1 -- 172.21.15.89:0/3102290702 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda2807aaa0 con 0x7fda38100cb0 2024-09-13T22:05:43.887 INFO:teuthology.orchestra.run.smithi089.stdout:167503724557 2024-09-13T22:05:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fda2006cc50 msgr2=0x7fda2006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fda2006cc50 0x7fda2006f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda38197270 tx=0x7fda2c008040 comp rx=0 tx=0).stop 2024-09-13T22:05:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 msgr2=0x7fda3819b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 0x7fda3819b9c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fda2802aa50 tx=0x7fda280055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 shutdown_connections 2024-09-13T22:05:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fda2006cc50 0x7fda2006f110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda381015d0 0x7fda3819bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 --2- 172.21.15.89:0/3102290702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda38100cb0 0x7fda3819b9c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 >> 172.21.15.89:0/3102290702 conn(0x7fda380758a0 msgr2=0x7fda38102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 shutdown_connections 2024-09-13T22:05:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:43.888+0000 7fda3d02d640 1 -- 172.21.15.89:0/3102290702 wait complete. 2024-09-13T22:05:44.597 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:44 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3102290702' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T22:05:44.619 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724554 got 167503724557 for osd.5 2024-09-13T22:05:44.619 DEBUG:teuthology.parallel:result is None 2024-09-13T22:05:44.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:44 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3102290702' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T22:05:44.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.811+0000 7f15ba75e640 1 -- 172.21.15.89:0/1919541490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 msgr2=0x7f15b4104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:44.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.811+0000 7f15ba75e640 1 --2- 172.21.15.89:0/1919541490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 0x7f15b4104780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f159c009880 tx=0x7f159c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:44.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.811+0000 7f15ba75e640 1 -- 172.21.15.89:0/1919541490 shutdown_connections 2024-09-13T22:05:44.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.811+0000 7f15ba75e640 1 --2- 172.21.15.89:0/1919541490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 0x7f15b4104780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:44.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.811+0000 7f15ba75e640 1 --2- 172.21.15.89:0/1919541490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15b40fe290 0x7f15b40fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:44.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.811+0000 7f15ba75e640 1 -- 172.21.15.89:0/1919541490 >> 172.21.15.89:0/1919541490 conn(0x7f15b40f9ec0 msgr2=0x7f15b40fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:44.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.811+0000 7f15ba75e640 1 -- 172.21.15.89:0/1919541490 shutdown_connections 2024-09-13T22:05:44.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.811+0000 7f15ba75e640 1 -- 172.21.15.89:0/1919541490 wait complete. 2024-09-13T22:05:44.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.812+0000 7f15ba75e640 1 Processor -- start 2024-09-13T22:05:44.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.812+0000 7f15ba75e640 1 -- start start 2024-09-13T22:05:44.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.812+0000 7f15ba75e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15b40fe290 0x7f15b419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:44.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.812+0000 7f15ba75e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 0x7f15b419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:44.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15ba75e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4195950 con 0x7f15b40fec40 2024-09-13T22:05:44.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15ba75e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4195a90 con 0x7f15b40fe290 2024-09-13T22:05:44.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 0x7f15b419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:44.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 0x7f15b419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41772/0 (socket says 172.21.15.89:41772) 2024-09-13T22:05:44.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b37fe640 1 -- 172.21.15.89:0/2616260374 learned_addr learned my addr 172.21.15.89:0/2616260374 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:44.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b3fff640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15b40fe290 0x7f15b419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:44.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b37fe640 1 -- 172.21.15.89:0/2616260374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15b40fe290 msgr2=0x7f15b419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:44.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b37fe640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15b40fe290 0x7f15b419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:44.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b37fe640 1 -- 172.21.15.89:0/2616260374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c009560 con 0x7f15b40fec40 2024-09-13T22:05:44.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b3fff640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15b40fe290 0x7f15b419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:05:44.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b37fe640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 0x7f15b419bde0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f159c02a9c0 tx=0x7f159c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b17fa640 1 -- 172.21.15.89:0/2616260374 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f159c004aa0 con 0x7f15b40fec40 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b17fa640 1 -- 172.21.15.89:0/2616260374 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f159c004c00 con 0x7f15b40fec40 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15b17fa640 1 -- 172.21.15.89:0/2616260374 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f159c003ab0 con 0x7f15b40fec40 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b4195d10 con 0x7f15b40fec40 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.813+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b4196200 con 0x7f15b40fec40 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.814+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b4101350 con 0x7f15b40fec40 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.815+0000 7f15b17fa640 1 -- 172.21.15.89:0/2616260374 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f159c031d20 con 0x7f15b40fec40 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.815+0000 7f15b17fa640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f15a006cc50 0x7f15a006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.815+0000 7f15b3fff640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f15a006cc50 0x7f15a006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.815+0000 7f15b17fa640 1 -- 172.21.15.89:0/2616260374 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f159c0ad020 con 0x7f15b40fec40 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.816+0000 7f15b3fff640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f15a006cc50 0x7f15a006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15a4005fd0 tx=0x7f15a4005ea0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:44.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.820+0000 7f15b17fa640 1 -- 172.21.15.89:0/2616260374 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f159c077730 con 0x7f15b40fec40 2024-09-13T22:05:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.987+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f15b4108090 con 0x7f15b40fec40 2024-09-13T22:05:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.987+0000 7f15b17fa640 1 -- 172.21.15.89:0/2616260374 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f159c07ad50 con 0x7f15b40fec40 2024-09-13T22:05:44.989 INFO:teuthology.orchestra.run.smithi089.stdout:81604378652 2024-09-13T22:05:44.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f15a006cc50 msgr2=0x7f15a006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:44.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f15a006cc50 0x7f15a006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15a4005fd0 tx=0x7f15a4005ea0 comp rx=0 tx=0).stop 2024-09-13T22:05:44.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 msgr2=0x7f15b419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:44.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 0x7f15b419bde0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f159c02a9c0 tx=0x7f159c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:44.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 shutdown_connections 2024-09-13T22:05:44.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f15a006cc50 0x7f15a006f110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:44.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15b40fec40 0x7f15b419bde0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 --2- 172.21.15.89:0/2616260374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15b40fe290 0x7f15b419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 >> 172.21.15.89:0/2616260374 conn(0x7f15b40f9ec0 msgr2=0x7f15b40fb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 shutdown_connections 2024-09-13T22:05:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:44.990+0000 7f15ba75e640 1 -- 172.21.15.89:0/2616260374 wait complete. 2024-09-13T22:05:45.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:45 smithi089 ceph-mon[27921]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:45.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:45 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2616260374' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T22:05:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:45 smithi159 ceph-mon[35348]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:45 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2616260374' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T22:05:45.804 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378650 got 81604378652 for osd.2 2024-09-13T22:05:45.805 DEBUG:teuthology.parallel:result is None 2024-09-13T22:05:46.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.054+0000 7ff8b0f22640 1 -- 172.21.15.89:0/2880454195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac0fe9f0 msgr2=0x7ff8ac0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:46.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.055+0000 7ff8b0f22640 1 --2- 172.21.15.89:0/2880454195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac0fe9f0 0x7ff8ac0fee50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009880 tx=0x7ff8a002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:46.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.055+0000 7ff8b0f22640 1 -- 172.21.15.89:0/2880454195 shutdown_connections 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.055+0000 7ff8b0f22640 1 --2- 172.21.15.89:0/2880454195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac0fe9f0 0x7ff8ac0fee50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.055+0000 7ff8b0f22640 1 --2- 172.21.15.89:0/2880454195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ac1049f0 0x7ff8ac104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.055+0000 7ff8b0f22640 1 -- 172.21.15.89:0/2880454195 >> 172.21.15.89:0/2880454195 conn(0x7ff8ac0758a0 msgr2=0x7ff8ac0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.055+0000 7ff8b0f22640 1 -- 172.21.15.89:0/2880454195 shutdown_connections 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.055+0000 7ff8b0f22640 1 -- 172.21.15.89:0/2880454195 wait complete. 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.055+0000 7ff8b0f22640 1 Processor -- start 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.055+0000 7ff8b0f22640 1 -- start start 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8b0f22640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ac0fe9f0 0x7ff8ac19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8b0f22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1049f0 0x7ff8ac19bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8b0f22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac1959f0 con 0x7ff8ac1049f0 2024-09-13T22:05:46.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8b0f22640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac195b30 con 0x7ff8ac0fe9f0 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8a9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1049f0 0x7ff8ac19bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8a9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1049f0 0x7ff8ac19bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41784/0 (socket says 172.21.15.89:41784) 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8a9d9b640 1 -- 172.21.15.89:0/500520701 learned_addr learned my addr 172.21.15.89:0/500520701 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8aa59c640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ac0fe9f0 0x7ff8ac19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8a9d9b640 1 -- 172.21.15.89:0/500520701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ac0fe9f0 msgr2=0x7ff8ac19b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8a9d9b640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ac0fe9f0 0x7ff8ac19b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8a9d9b640 1 -- 172.21.15.89:0/500520701 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0009560 con 0x7ff8ac1049f0 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8aa59c640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ac0fe9f0 0x7ff8ac19b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8a9d9b640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1049f0 0x7ff8ac19bed0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8a002a9c0 tx=0x7ff8a00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff89b7fe640 1 -- 172.21.15.89:0/500520701 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8a0004aa0 con 0x7ff8ac1049f0 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac195db0 con 0x7ff8ac1049f0 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff89b7fe640 1 -- 172.21.15.89:0/500520701 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8a0004c00 con 0x7ff8ac1049f0 2024-09-13T22:05:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.056+0000 7ff89b7fe640 1 -- 172.21.15.89:0/500520701 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8a0003ab0 con 0x7ff8ac1049f0 2024-09-13T22:05:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.057+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac1962a0 con 0x7ff8ac1049f0 2024-09-13T22:05:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.058+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac100130 con 0x7ff8ac1049f0 2024-09-13T22:05:46.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.058+0000 7ff89b7fe640 1 -- 172.21.15.89:0/500520701 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff8a0031d20 con 0x7ff8ac1049f0 2024-09-13T22:05:46.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.058+0000 7ff89b7fe640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff89406cc50 0x7ff89406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:46.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.059+0000 7ff89b7fe640 1 -- 172.21.15.89:0/500520701 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff8a00ad020 con 0x7ff8ac1049f0 2024-09-13T22:05:46.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.059+0000 7ff8aa59c640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff89406cc50 0x7ff89406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:46.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.059+0000 7ff8aa59c640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff89406cc50 0x7ff89406f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff89c006fd0 tx=0x7ff89c008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:46.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.063+0000 7ff89b7fe640 1 -- 172.21.15.89:0/500520701 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff8a0077730 con 0x7ff8ac1049f0 2024-09-13T22:05:46.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.227+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8ac10bce0 con 0x7ff8ac1049f0 2024-09-13T22:05:46.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.227+0000 7ff89b7fe640 1 -- 172.21.15.89:0/500520701 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8a007ad50 con 0x7ff8ac1049f0 2024-09-13T22:05:46.229 INFO:teuthology.orchestra.run.smithi089.stdout:38654705703 2024-09-13T22:05:46.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff89406cc50 msgr2=0x7ff89406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff89406cc50 0x7ff89406f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff89c006fd0 tx=0x7ff89c008040 comp rx=0 tx=0).stop 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1049f0 msgr2=0x7ff8ac19bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1049f0 0x7ff8ac19bed0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8a002a9c0 tx=0x7ff8a00055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 shutdown_connections 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff89406cc50 0x7ff89406f110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1049f0 0x7ff8ac19bed0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 --2- 172.21.15.89:0/500520701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8ac0fe9f0 0x7ff8ac19b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 >> 172.21.15.89:0/500520701 conn(0x7ff8ac0758a0 msgr2=0x7ff8ac0fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 shutdown_connections 2024-09-13T22:05:46.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:46.229+0000 7ff8b0f22640 1 -- 172.21.15.89:0/500520701 wait complete. 2024-09-13T22:05:46.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:46 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/500520701' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T22:05:46.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:46 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/500520701' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T22:05:46.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705703 for osd.0 2024-09-13T22:05:46.799 DEBUG:teuthology.parallel:result is None 2024-09-13T22:05:46.799 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T22:05:46.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T22:05:46.999 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:47.416 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:47 smithi089 ceph-mon[27921]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:47.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:47 smithi159 ceph-mon[35348]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:48.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.768+0000 7f54d1a55640 1 -- 172.21.15.89:0/4121828796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc105bf0 msgr2=0x7f54cc105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:48.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.768+0000 7f54d1a55640 1 --2- 172.21.15.89:0/4121828796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc105bf0 0x7f54cc105fd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009880 tx=0x7f54c002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:48.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.768+0000 7f54d1a55640 1 -- 172.21.15.89:0/4121828796 shutdown_connections 2024-09-13T22:05:48.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.768+0000 7f54d1a55640 1 --2- 172.21.15.89:0/4121828796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54cc0ffb40 0x7f54cc0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:48.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.768+0000 7f54d1a55640 1 --2- 172.21.15.89:0/4121828796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc105bf0 0x7f54cc105fd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:48.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.768+0000 7f54d1a55640 1 -- 172.21.15.89:0/4121828796 >> 172.21.15.89:0/4121828796 conn(0x7f54cc0fb860 msgr2=0x7f54cc0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:48.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.768+0000 7f54d1a55640 1 -- 172.21.15.89:0/4121828796 shutdown_connections 2024-09-13T22:05:48.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.768+0000 7f54d1a55640 1 -- 172.21.15.89:0/4121828796 wait complete. 2024-09-13T22:05:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54d1a55640 1 Processor -- start 2024-09-13T22:05:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54d1a55640 1 -- start start 2024-09-13T22:05:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54d1a55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0ffb40 0x7f54cc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54d1a55640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54cc105bf0 0x7f54cc072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54d1a55640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc073230 con 0x7f54cc0ffb40 2024-09-13T22:05:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54d1a55640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0733a0 con 0x7f54cc105bf0 2024-09-13T22:05:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54caffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0ffb40 0x7f54cc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:48.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54caffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0ffb40 0x7f54cc0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41808/0 (socket says 172.21.15.89:41808) 2024-09-13T22:05:48.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54caffd640 1 -- 172.21.15.89:0/740153280 learned_addr learned my addr 172.21.15.89:0/740153280 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:48.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54caffd640 1 -- 172.21.15.89:0/740153280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54cc105bf0 msgr2=0x7f54cc072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:48.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54caffd640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54cc105bf0 0x7f54cc072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:48.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.769+0000 7f54caffd640 1 -- 172.21.15.89:0/740153280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009560 con 0x7f54cc0ffb40 2024-09-13T22:05:48.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.770+0000 7f54caffd640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0ffb40 0x7f54cc0727b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54c002a9c0 tx=0x7f54c00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:48.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.770+0000 7f54d0a53640 1 -- 172.21.15.89:0/740153280 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c0004aa0 con 0x7f54cc0ffb40 2024-09-13T22:05:48.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.770+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc073620 con 0x7f54cc0ffb40 2024-09-13T22:05:48.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.770+0000 7f54d0a53640 1 -- 172.21.15.89:0/740153280 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54c0004c00 con 0x7f54cc0ffb40 2024-09-13T22:05:48.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.770+0000 7f54d0a53640 1 -- 172.21.15.89:0/740153280 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c0003ab0 con 0x7f54cc0ffb40 2024-09-13T22:05:48.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.770+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc1a2080 con 0x7f54cc0ffb40 2024-09-13T22:05:48.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.771+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc1011f0 con 0x7f54cc0ffb40 2024-09-13T22:05:48.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.771+0000 7f54d0a53640 1 -- 172.21.15.89:0/740153280 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f54c0003ce0 con 0x7f54cc0ffb40 2024-09-13T22:05:48.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.772+0000 7f54d0a53640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f54b406cc50 0x7f54b406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:48.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.772+0000 7f54ca7fc640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f54b406cc50 0x7f54b406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:48.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.772+0000 7f54d0a53640 1 -- 172.21.15.89:0/740153280 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f54c00ace60 con 0x7f54cc0ffb40 2024-09-13T22:05:48.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.772+0000 7f54ca7fc640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f54b406cc50 0x7f54b406f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54cc073ee0 tx=0x7f54bc006c90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:48.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.776+0000 7f54d0a53640 1 -- 172.21.15.89:0/740153280 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f54c0077570 con 0x7f54cc0ffb40 2024-09-13T22:05:48.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.936+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54cc073620 con 0x7f54b406cc50 2024-09-13T22:05:48.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.938+0000 7f54d0a53640 1 -- 172.21.15.89:0/740153280 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28057 (secure 0 0 0) 0x7f54cc073620 con 0x7f54b406cc50 2024-09-13T22:05:48.939 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:05:48.940 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-13T22:05:48.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f54b406cc50 msgr2=0x7f54b406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:48.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f54b406cc50 0x7f54b406f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54cc073ee0 tx=0x7f54bc006c90 comp rx=0 tx=0).stop 2024-09-13T22:05:48.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0ffb40 msgr2=0x7f54cc0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:48.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0ffb40 0x7f54cc0727b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54c002a9c0 tx=0x7f54c00055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:48.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 shutdown_connections 2024-09-13T22:05:48.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f54b406cc50 0x7f54b406f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:48.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54cc105bf0 0x7f54cc072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:48.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 --2- 172.21.15.89:0/740153280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0ffb40 0x7f54cc0727b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:48.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 >> 172.21.15.89:0/740153280 conn(0x7f54cc0fb860 msgr2=0x7f54cc0fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:48.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 shutdown_connections 2024-09-13T22:05:48.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:48.940+0000 7f54d1a55640 1 -- 172.21.15.89:0/740153280 wait complete. 2024-09-13T22:05:49.611 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:49 smithi089 ceph-mon[27921]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:49.633 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-13T22:05:48.183320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":186488,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":182518,"kb_avail":562284424,"statfs":{"total":575970213888,"available":575779250176,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":186899111},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002265"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T22:04:56.380791+0000","last_change":"2024-09-13T22:04:29.869788+0000","last_active":"2024-09-13T22:04:56.380791+0000","last_peered":"2024-09-13T22:04:56.380791+0000","last_clean":"2024-09-13T22:04:56.380791+0000","last_became_active":"2024-09-13T22:04:29.869409+0000","last_became_peered":"2024-09-13T22:04:29.869409+0000","last_unstale":"2024-09-13T22:04:56.380791+0000","last_undegraded":"2024-09-13T22:04:56.380791+0000","last_fullsized":"2024-09-13T22:04:56.380791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T22:03:44.452200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T22:03:44.452200+0000","last_clean_scrub_stamp":"2024-09-13T22:03:44.452200+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:55.960102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:05:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":12.353999999999999,"5min":12.353999999999999,"15min":12.353999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.373}]},{"osd":1,"last update":"Fri Sep 13 22:05:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.442},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":12.377000000000001,"5min":12.377000000000001,"15min":12.377000000000001},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Sep 13 22:05:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Sep 13 22:05:30 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:05:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Sep 13 22:05:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.443}]},{"osd":2,"last update":"Fri Sep 13 22:05:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.38400000000000001}]},{"osd":4,"last update":"Fri Sep 13 22:05:32 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.32700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Sep 13 22:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.245}]},{"osd":3,"last update":"Fri Sep 13 22:05:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.435},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Sep 13 22:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.378,"15min":0.36099999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Sep 13 22:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.24299999999999999}]},{"osd":3,"last update":"Fri Sep 13 22:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Sep 13 22:05:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 22:05:18 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.315,"15min":0.313},"min":{"1min":0.254,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.312,"15min":0.311},"min":{"1min":0.26200000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.42499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.222}]},{"osd":2,"last update":"Fri Sep 13 22:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.24099999999999999}]},{"osd":3,"last update":"Fri Sep 13 22:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":7.5359999999999996,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Sep 13 22:05:35 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.7189999999999994,"5min":9.7189999999999994,"15min":9.7189999999999994},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":7.6050000000000004,"5min":7.6050000000000004,"15min":7.6050000000000004},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T22:05:49.636 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T22:05:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:49 smithi159 ceph-mon[35348]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:49.833 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:50.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:50 smithi089 ceph-mon[27921]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:05:50.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:50 smithi159 ceph-mon[35348]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:05:51.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.501+0000 7fc2e7e40640 1 -- 172.21.15.89:0/1362009886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 msgr2=0x7fc2e0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.501+0000 7fc2e7e40640 1 --2- 172.21.15.89:0/1362009886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 0x7fc2e0100180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009880 tx=0x7fc2dc02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.502+0000 7fc2e7e40640 1 -- 172.21.15.89:0/1362009886 shutdown_connections 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.502+0000 7fc2e7e40640 1 --2- 172.21.15.89:0/1362009886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e0100750 0x7fc2e01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.502+0000 7fc2e7e40640 1 --2- 172.21.15.89:0/1362009886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 0x7fc2e0100180 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.502+0000 7fc2e7e40640 1 -- 172.21.15.89:0/1362009886 >> 172.21.15.89:0/1362009886 conn(0x7fc2e00fb840 msgr2=0x7fc2e00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.502+0000 7fc2e7e40640 1 -- 172.21.15.89:0/1362009886 shutdown_connections 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.502+0000 7fc2e7e40640 1 -- 172.21.15.89:0/1362009886 wait complete. 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.502+0000 7fc2e7e40640 1 Processor -- start 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.502+0000 7fc2e7e40640 1 -- start start 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e7e40640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 0x7fc2e019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:51.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e7e40640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e0100750 0x7fc2e019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e7e40640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0195a10 con 0x7fc2e00ffda0 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e7e40640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0195b50 con 0x7fc2e0100750 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e5bdc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 0x7fc2e019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e5bdc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 0x7fc2e019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41820/0 (socket says 172.21.15.89:41820) 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e5bdc640 1 -- 172.21.15.89:0/403291546 learned_addr learned my addr 172.21.15.89:0/403291546 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e53db640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e0100750 0x7fc2e019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e5bdc640 1 -- 172.21.15.89:0/403291546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e0100750 msgr2=0x7fc2e019bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e5bdc640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e0100750 0x7fc2e019bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e5bdc640 1 -- 172.21.15.89:0/403291546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc009560 con 0x7fc2e00ffda0 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e5bdc640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 0x7fc2e019b9b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc02a9c0 tx=0x7fc2dc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2d6ffd640 1 -- 172.21.15.89:0/403291546 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc004aa0 con 0x7fc2e00ffda0 2024-09-13T22:05:51.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2d6ffd640 1 -- 172.21.15.89:0/403291546 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2dc004c00 con 0x7fc2e00ffda0 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2d6ffd640 1 -- 172.21.15.89:0/403291546 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc003ab0 con 0x7fc2e00ffda0 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e0195dd0 con 0x7fc2e00ffda0 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.503+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e01962c0 con 0x7fc2e00ffda0 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.504+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e0101280 con 0x7fc2e00ffda0 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.505+0000 7fc2d6ffd640 1 -- 172.21.15.89:0/403291546 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc2dc003c10 con 0x7fc2e00ffda0 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.505+0000 7fc2d6ffd640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc2cc06cc50 0x7fc2cc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.505+0000 7fc2d6ffd640 1 -- 172.21.15.89:0/403291546 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc2dc0acf20 con 0x7fc2e00ffda0 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.505+0000 7fc2e53db640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc2cc06cc50 0x7fc2cc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.506+0000 7fc2e53db640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc2cc06cc50 0x7fc2cc06f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0005fd0 tx=0x7fc2d0005e20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:51.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.510+0000 7fc2d6ffd640 1 -- 172.21.15.89:0/403291546 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc2dc0e0e20 con 0x7fc2e00ffda0 2024-09-13T22:05:51.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.668+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2e0196f40 con 0x7fc2cc06cc50 2024-09-13T22:05:51.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:51 smithi089 ceph-mon[27921]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:51.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.669+0000 7fc2d6ffd640 1 -- 172.21.15.89:0/403291546 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27966 (secure 0 0 0) 0x7fc2e0196f40 con 0x7fc2cc06cc50 2024-09-13T22:05:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:05:51.671 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc2cc06cc50 msgr2=0x7fc2cc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc2cc06cc50 0x7fc2cc06f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0005fd0 tx=0x7fc2d0005e20 comp rx=0 tx=0).stop 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 msgr2=0x7fc2e019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 0x7fc2e019b9b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc02a9c0 tx=0x7fc2dc0055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 shutdown_connections 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc2cc06cc50 0x7fc2cc06f110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2e0100750 0x7fc2e019bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 --2- 172.21.15.89:0/403291546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00ffda0 0x7fc2e019b9b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 >> 172.21.15.89:0/403291546 conn(0x7fc2e00fb840 msgr2=0x7fc2e00fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 shutdown_connections 2024-09-13T22:05:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:51.671+0000 7fc2e7e40640 1 -- 172.21.15.89:0/403291546 wait complete. 2024-09-13T22:05:51.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:51 smithi159 ceph-mon[35348]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:52.332 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-13T22:05:50.183651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":186488,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":182518,"kb_avail":562284424,"statfs":{"total":575970213888,"available":575779250176,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":186899111},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002147"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T22:04:56.380791+0000","last_change":"2024-09-13T22:04:29.869788+0000","last_active":"2024-09-13T22:04:56.380791+0000","last_peered":"2024-09-13T22:04:56.380791+0000","last_clean":"2024-09-13T22:04:56.380791+0000","last_became_active":"2024-09-13T22:04:29.869409+0000","last_became_peered":"2024-09-13T22:04:29.869409+0000","last_unstale":"2024-09-13T22:04:56.380791+0000","last_undegraded":"2024-09-13T22:04:56.380791+0000","last_fullsized":"2024-09-13T22:04:56.380791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T22:03:44.452200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T22:03:44.452200+0000","last_clean_scrub_stamp":"2024-09-13T22:03:44.452200+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:55.960102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:05:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":12.353999999999999,"5min":12.353999999999999,"15min":12.353999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.373}]},{"osd":1,"last update":"Fri Sep 13 22:05:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.442},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":12.377000000000001,"5min":12.377000000000001,"15min":12.377000000000001},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Sep 13 22:05:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Sep 13 22:05:30 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:05:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Sep 13 22:05:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.443}]},{"osd":2,"last update":"Fri Sep 13 22:05:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.38400000000000001}]},{"osd":4,"last update":"Fri Sep 13 22:05:32 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.32700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32800000000000001,"15min":0.33200000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.40400000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.33200000000000002,"15min":0.33500000000000002},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.41699999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Sep 13 22:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.34499999999999997,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.39200000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.245,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.40400000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.26100000000000001}]},{"osd":3,"last update":"Fri Sep 13 22:05:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.439}]},{"osd":4,"last update":"Fri Sep 13 22:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.378,"15min":0.36099999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Sep 13 22:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.41099999999999998,"15min":0.39200000000000002},"min":{"1min":0.26800000000000002,"5min":0.193,"15min":0.193},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.216},"max":{"1min":3.2400000000000002,"5min":3.2400000000000002,"15min":3.2400000000000002},"last":0.309}]},{"osd":3,"last update":"Fri Sep 13 22:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Sep 13 22:05:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 22:05:18 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.315,"15min":0.313},"min":{"1min":0.254,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.246},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.312,"15min":0.311},"min":{"1min":0.26200000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.42499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.20100000000000001}]},{"osd":2,"last update":"Fri Sep 13 22:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.34399999999999997,"15min":0.34999999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.432,"5min":0.498,"15min":0.498},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.35499999999999998,"15min":0.35999999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.215}]},{"osd":3,"last update":"Fri Sep 13 22:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":7.5359999999999996,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Sep 13 22:05:35 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.7189999999999994,"5min":9.7189999999999994,"15min":9.7189999999999994},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":7.6050000000000004,"5min":7.6050000000000004,"15min":7.6050000000000004},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T22:05:52.334 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T22:05:52.334 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T22:05:52.334 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T22:05:52.334 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T22:05:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:53.588 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:53 smithi089 ceph-mon[27921]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:05:53.589 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:53 smithi089 ceph-mon[27921]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:53 smithi159 ceph-mon[35348]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:05:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:53 smithi159 ceph-mon[35348]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:54.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.050+0000 7ff43add1640 1 -- 172.21.15.89:0/3452814708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 msgr2=0x7ff4340fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.050+0000 7ff43add1640 1 --2- 172.21.15.89:0/3452814708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 0x7ff4340fec80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff430009880 tx=0x7ff43002a490 comp rx=0 tx=0).stop 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.050+0000 7ff43add1640 1 -- 172.21.15.89:0/3452814708 shutdown_connections 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.050+0000 7ff43add1640 1 --2- 172.21.15.89:0/3452814708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4340ff250 0x7ff43410bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.050+0000 7ff43add1640 1 --2- 172.21.15.89:0/3452814708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 0x7ff4340fec80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.050+0000 7ff43add1640 1 -- 172.21.15.89:0/3452814708 >> 172.21.15.89:0/3452814708 conn(0x7ff4340758a0 msgr2=0x7ff4340fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.050+0000 7ff43add1640 1 -- 172.21.15.89:0/3452814708 shutdown_connections 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.050+0000 7ff43add1640 1 -- 172.21.15.89:0/3452814708 wait complete. 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.051+0000 7ff43add1640 1 Processor -- start 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.051+0000 7ff43add1640 1 -- start start 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.051+0000 7ff43add1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 0x7ff434197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.051+0000 7ff43add1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4340ff250 0x7ff434198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.051+0000 7ff43add1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434198850 con 0x7ff4340fe8a0 2024-09-13T22:05:54.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.051+0000 7ff43add1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4341989c0 con 0x7ff4340ff250 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.051+0000 7ff438b6d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 0x7ff434197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.051+0000 7ff438b6d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 0x7ff434197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43506/0 (socket says 172.21.15.89:43506) 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.051+0000 7ff438b6d640 1 -- 172.21.15.89:0/3401635021 learned_addr learned my addr 172.21.15.89:0/3401635021 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff42bfff640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4340ff250 0x7ff434198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff438b6d640 1 -- 172.21.15.89:0/3401635021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4340ff250 msgr2=0x7ff434198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff438b6d640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4340ff250 0x7ff434198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff438b6d640 1 -- 172.21.15.89:0/3401635021 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430009560 con 0x7ff4340fe8a0 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff42bfff640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4340ff250 0x7ff434198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff438b6d640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 0x7ff434197cc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff43002a9b0 tx=0x7ff4300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff429ffb640 1 -- 172.21.15.89:0/3401635021 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff430004aa0 con 0x7ff4340fe8a0 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff429ffb640 1 -- 172.21.15.89:0/3401635021 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff430004c00 con 0x7ff4340fe8a0 2024-09-13T22:05:54.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43419b6a0 con 0x7ff4340fe8a0 2024-09-13T22:05:54.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff429ffb640 1 -- 172.21.15.89:0/3401635021 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff430003ab0 con 0x7ff4340fe8a0 2024-09-13T22:05:54.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.052+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43419bbf0 con 0x7ff4340fe8a0 2024-09-13T22:05:54.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.053+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4340684b0 con 0x7ff4340fe8a0 2024-09-13T22:05:54.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.054+0000 7ff429ffb640 1 -- 172.21.15.89:0/3401635021 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff430031d20 con 0x7ff4340fe8a0 2024-09-13T22:05:54.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.054+0000 7ff429ffb640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff41c06cc50 0x7ff41c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:54.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.054+0000 7ff429ffb640 1 -- 172.21.15.89:0/3401635021 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff4300ad020 con 0x7ff4340fe8a0 2024-09-13T22:05:54.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.054+0000 7ff42bfff640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff41c06cc50 0x7ff41c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:54.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.055+0000 7ff42bfff640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff41c06cc50 0x7ff41c06f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff434199230 tx=0x7ff424005d90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:54.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.059+0000 7ff429ffb640 1 -- 172.21.15.89:0/3401635021 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff430077730 con 0x7ff4340fe8a0 2024-09-13T22:05:54.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.259+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff4340fec80 con 0x7ff4340fe8a0 2024-09-13T22:05:54.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.259+0000 7ff429ffb640 1 -- 172.21.15.89:0/3401635021 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff43007ad50 con 0x7ff4340fe8a0 2024-09-13T22:05:54.261 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:05:54.261 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T22:05:54.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff41c06cc50 msgr2=0x7ff41c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:54.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff41c06cc50 0x7ff41c06f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff434199230 tx=0x7ff424005d90 comp rx=0 tx=0).stop 2024-09-13T22:05:54.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 msgr2=0x7ff434197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:54.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 0x7ff434197cc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff43002a9b0 tx=0x7ff4300055a0 comp rx=0 tx=0).stop 2024-09-13T22:05:54.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 shutdown_connections 2024-09-13T22:05:54.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff41c06cc50 0x7ff41c06f110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:54.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4340ff250 0x7ff434198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:54.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 --2- 172.21.15.89:0/3401635021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4340fe8a0 0x7ff434197cc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:54.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 >> 172.21.15.89:0/3401635021 conn(0x7ff4340758a0 msgr2=0x7ff4340fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:54.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 shutdown_connections 2024-09-13T22:05:54.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:54.261+0000 7ff43add1640 1 -- 172.21.15.89:0/3401635021 wait complete. 2024-09-13T22:05:54.619 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:05:54.619 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:54 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3401635021' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T22:05:54.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:05:54.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:54 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3401635021' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T22:05:55.023 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T22:05:55.023 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T22:05:55.024 INFO:teuthology.run_tasks:Running task print... 2024-09-13T22:05:55.037 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-09-13T22:05:55.038 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:05:55.049 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:05:55.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T22:05:55.249 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:55.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:55 smithi159 ceph-mon[35348]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:55.715 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:55 smithi089 ceph-mon[27921]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:57.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.058+0000 7ffa5f841640 1 -- 172.21.15.89:0/3121173065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 msgr2=0x7ffa581031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:57.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.058+0000 7ffa5f841640 1 --2- 172.21.15.89:0/3121173065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 0x7ffa581031c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009880 tx=0x7ffa4802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.058+0000 7ffa5f841640 1 -- 172.21.15.89:0/3121173065 shutdown_connections 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.058+0000 7ffa5f841640 1 --2- 172.21.15.89:0/3121173065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 0x7ffa581031c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.058+0000 7ffa5f841640 1 --2- 172.21.15.89:0/3121173065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa580fe400 0x7ffa58100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.058+0000 7ffa5f841640 1 -- 172.21.15.89:0/3121173065 >> 172.21.15.89:0/3121173065 conn(0x7ffa580fa230 msgr2=0x7ffa580fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.058+0000 7ffa5f841640 1 -- 172.21.15.89:0/3121173065 shutdown_connections 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5f841640 1 -- 172.21.15.89:0/3121173065 wait complete. 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5f841640 1 Processor -- start 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5f841640 1 -- start start 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5f841640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa580fe400 0x7ffa5819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5f841640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 0x7ffa5819c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:57.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5f841640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5819c730 con 0x7ffa58100d50 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5f841640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5819c8a0 con 0x7ffa580fe400 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5cddc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 0x7ffa5819c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5cddc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 0x7ffa5819c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43528/0 (socket says 172.21.15.89:43528) 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5cddc640 1 -- 172.21.15.89:0/2397766718 learned_addr learned my addr 172.21.15.89:0/2397766718 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.059+0000 7ffa5d5dd640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa580fe400 0x7ffa5819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.060+0000 7ffa5cddc640 1 -- 172.21.15.89:0/2397766718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa580fe400 msgr2=0x7ffa5819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.060+0000 7ffa5cddc640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa580fe400 0x7ffa5819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.060+0000 7ffa5cddc640 1 -- 172.21.15.89:0/2397766718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48009560 con 0x7ffa58100d50 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.060+0000 7ffa5cddc640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 0x7ffa5819c160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa48005520 tx=0x7ffa48005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.060+0000 7ffa4e7fc640 1 -- 172.21.15.89:0/2397766718 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa48004aa0 con 0x7ffa58100d50 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.060+0000 7ffa4e7fc640 1 -- 172.21.15.89:0/2397766718 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa48004c00 con 0x7ffa58100d50 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.060+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa581a1290 con 0x7ffa58100d50 2024-09-13T22:05:57.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.060+0000 7ffa4e7fc640 1 -- 172.21.15.89:0/2397766718 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa48003b10 con 0x7ffa58100d50 2024-09-13T22:05:57.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.060+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa581a1800 con 0x7ffa58100d50 2024-09-13T22:05:57.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.061+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5810ed70 con 0x7ffa58100d50 2024-09-13T22:05:57.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.062+0000 7ffa4e7fc640 1 -- 172.21.15.89:0/2397766718 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffa48003d40 con 0x7ffa58100d50 2024-09-13T22:05:57.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.062+0000 7ffa4e7fc640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffa4406cc50 0x7ffa4406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:57.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.062+0000 7ffa5d5dd640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffa4406cc50 0x7ffa4406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:57.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.062+0000 7ffa4e7fc640 1 -- 172.21.15.89:0/2397766718 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ffa480ad060 con 0x7ffa58100d50 2024-09-13T22:05:57.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.063+0000 7ffa5d5dd640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffa4406cc50 0x7ffa4406f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffa54005fd0 tx=0x7ffa5400b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:57.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.066+0000 7ffa4e7fc640 1 -- 172.21.15.89:0/2397766718 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffa48077820 con 0x7ffa58100d50 2024-09-13T22:05:57.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.227+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7ffa5810ef00 con 0x7ffa58100d50 2024-09-13T22:05:57.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.232+0000 7ffa4e7fc640 1 -- 172.21.15.89:0/2397766718 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v25)=0 v25) v1 ==== 143+0+0 (secure 0 0 0) 0x7ffa4807ae40 con 0x7ffa58100d50 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffa4406cc50 msgr2=0x7ffa4406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffa4406cc50 0x7ffa4406f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffa54005fd0 tx=0x7ffa5400b390 comp rx=0 tx=0).stop 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 msgr2=0x7ffa5819c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 0x7ffa5819c160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa48005520 tx=0x7ffa48005550 comp rx=0 tx=0).stop 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 shutdown_connections 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffa4406cc50 0x7ffa4406f110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa58100d50 0x7ffa5819c160 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 --2- 172.21.15.89:0/2397766718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa580fe400 0x7ffa5819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 >> 172.21.15.89:0/2397766718 conn(0x7ffa580fa230 msgr2=0x7ffa580fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 shutdown_connections 2024-09-13T22:05:57.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:57.234+0000 7ffa5f841640 1 -- 172.21.15.89:0/2397766718 wait complete. 2024-09-13T22:05:57.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:57 smithi089 ceph-mon[27921]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:57.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:57 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2397766718' entity='client.admin' 2024-09-13T22:05:57.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:57 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:05:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:57 smithi159 ceph-mon[35348]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:57 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2397766718' entity='client.admin' 2024-09-13T22:05:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:57 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:05:57.940 INFO:teuthology.run_tasks:Running task print... 2024-09-13T22:05:57.948 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T22:05:57.948 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:05:57.956 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:05:57.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T22:05:58.164 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:05:58.587 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:05:58.588 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:05:58.588 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:58 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:05:58.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:05:58.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:05:58.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:58 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:05:59.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:05:59 smithi089 ceph-mon[27921]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:59.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.722+0000 7fabf229b640 1 -- 172.21.15.89:0/135744381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 msgr2=0x7fabec0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.722+0000 7fabf229b640 1 --2- 172.21.15.89:0/135744381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 0x7fabec0fff90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009880 tx=0x7fabdc02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.722+0000 7fabf229b640 1 -- 172.21.15.89:0/135744381 shutdown_connections 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.722+0000 7fabf229b640 1 --2- 172.21.15.89:0/135744381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabec100d90 0x7fabec101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.722+0000 7fabf229b640 1 --2- 172.21.15.89:0/135744381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 0x7fabec0fff90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.722+0000 7fabf229b640 1 -- 172.21.15.89:0/135744381 >> 172.21.15.89:0/135744381 conn(0x7fabec0fb320 msgr2=0x7fabec0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.722+0000 7fabf229b640 1 -- 172.21.15.89:0/135744381 shutdown_connections 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.722+0000 7fabf229b640 1 -- 172.21.15.89:0/135744381 wait complete. 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.723+0000 7fabf229b640 1 Processor -- start 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.723+0000 7fabf229b640 1 -- start start 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.723+0000 7fabf229b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 0x7fabec195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:59.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.723+0000 7fabf229b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabec100d90 0x7fabec195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.723+0000 7fabf229b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec1961a0 con 0x7fabec0ffb90 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.723+0000 7fabf229b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec196310 con 0x7fabec100d90 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.723+0000 7fabebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 0x7fabec195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.723+0000 7fabebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 0x7fabec195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43540/0 (socket says 172.21.15.89:43540) 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.723+0000 7fabebfff640 1 -- 172.21.15.89:0/350460394 learned_addr learned my addr 172.21.15.89:0/350460394 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabeb7fe640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabec100d90 0x7fabec195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabebfff640 1 -- 172.21.15.89:0/350460394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabec100d90 msgr2=0x7fabec195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabebfff640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabec100d90 0x7fabec195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabebfff640 1 -- 172.21.15.89:0/350460394 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc009560 con 0x7fabec0ffb90 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabebfff640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 0x7fabec195690 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0054f0 tx=0x7fabdc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabe97fa640 1 -- 172.21.15.89:0/350460394 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabdc004aa0 con 0x7fabec0ffb90 2024-09-13T22:05:59.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabe97fa640 1 -- 172.21.15.89:0/350460394 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabdc004c00 con 0x7fabec0ffb90 2024-09-13T22:05:59.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec19ad00 con 0x7fabec0ffb90 2024-09-13T22:05:59.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabe97fa640 1 -- 172.21.15.89:0/350460394 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabdc003ac0 con 0x7fabec0ffb90 2024-09-13T22:05:59.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.724+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec19b220 con 0x7fabec0ffb90 2024-09-13T22:05:59.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.725+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec18f730 con 0x7fabec0ffb90 2024-09-13T22:05:59.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.726+0000 7fabe97fa640 1 -- 172.21.15.89:0/350460394 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fabdc003d30 con 0x7fabec0ffb90 2024-09-13T22:05:59.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.726+0000 7fabe97fa640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fabd406cc50 0x7fabd406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:05:59.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.726+0000 7fabe97fa640 1 -- 172.21.15.89:0/350460394 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fabdc0acfd0 con 0x7fabec0ffb90 2024-09-13T22:05:59.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.726+0000 7fabeb7fe640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fabd406cc50 0x7fabd406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:05:59.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.726+0000 7fabeb7fe640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fabd406cc50 0x7fabd406f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabec196b60 tx=0x7fabe000b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:05:59.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.730+0000 7fabe97fa640 1 -- 172.21.15.89:0/350460394 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fabdc077810 con 0x7fabec0ffb90 2024-09-13T22:05:59.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:05:59 smithi159 ceph-mon[35348]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:05:59.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.906+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabec02c550 con 0x7fabd406cc50 2024-09-13T22:05:59.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.907+0000 7fabe97fa640 1 -- 172.21.15.89:0/350460394 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fabec02c550 con 0x7fabd406cc50 2024-09-13T22:05:59.909 INFO:teuthology.orchestra.run.smithi089.stdout:Backend: cephadm 2024-09-13T22:05:59.909 INFO:teuthology.orchestra.run.smithi089.stdout:Available: Yes 2024-09-13T22:05:59.909 INFO:teuthology.orchestra.run.smithi089.stdout:Paused: No 2024-09-13T22:05:59.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fabd406cc50 msgr2=0x7fabd406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:59.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fabd406cc50 0x7fabd406f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabec196b60 tx=0x7fabe000b390 comp rx=0 tx=0).stop 2024-09-13T22:05:59.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 msgr2=0x7fabec195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:05:59.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 0x7fabec195690 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0054f0 tx=0x7fabdc005520 comp rx=0 tx=0).stop 2024-09-13T22:05:59.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 shutdown_connections 2024-09-13T22:05:59.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fabd406cc50 0x7fabd406f110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:59.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabec100d90 0x7fabec195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:59.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 --2- 172.21.15.89:0/350460394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabec0ffb90 0x7fabec195690 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:05:59.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 >> 172.21.15.89:0/350460394 conn(0x7fabec0fb320 msgr2=0x7fabec1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:05:59.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 shutdown_connections 2024-09-13T22:05:59.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:05:59.909+0000 7fabf229b640 1 -- 172.21.15.89:0/350460394 wait complete. 2024-09-13T22:06:00.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T22:06:00.709 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:01.480 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:01 smithi089 ceph-mon[27921]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:01.480 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:01 smithi089 ceph-mon[27921]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:01.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:01 smithi159 ceph-mon[35348]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:01.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:01 smithi159 ceph-mon[35348]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.237+0000 7f5c5b90f640 1 -- 172.21.15.89:0/2630100864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540ffca0 msgr2=0x7f5c54100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.237+0000 7f5c5b90f640 1 --2- 172.21.15.89:0/2630100864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540ffca0 0x7f5c54100120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009880 tx=0x7f5c4402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.237+0000 7f5c5b90f640 1 -- 172.21.15.89:0/2630100864 shutdown_connections 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.237+0000 7f5c5b90f640 1 --2- 172.21.15.89:0/2630100864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540ffca0 0x7f5c54100120 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.237+0000 7f5c5b90f640 1 --2- 172.21.15.89:0/2630100864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c540feaa0 0x7f5c540feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.237+0000 7f5c5b90f640 1 -- 172.21.15.89:0/2630100864 >> 172.21.15.89:0/2630100864 conn(0x7f5c540fa250 msgr2=0x7f5c540fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.237+0000 7f5c5b90f640 1 -- 172.21.15.89:0/2630100864 shutdown_connections 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.237+0000 7f5c5b90f640 1 -- 172.21.15.89:0/2630100864 wait complete. 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.237+0000 7f5c5b90f640 1 Processor -- start 2024-09-13T22:06:02.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c5b90f640 1 -- start start 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c5b90f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540feaa0 0x7f5c54068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c5b90f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c540ffca0 0x7f5c5419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c5b90f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5419a8f0 con 0x7f5c540feaa0 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c5b90f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5419aa30 con 0x7f5c540ffca0 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c596ab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540feaa0 0x7f5c54068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c596ab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540feaa0 0x7f5c54068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43562/0 (socket says 172.21.15.89:43562) 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c596ab640 1 -- 172.21.15.89:0/889220238 learned_addr learned my addr 172.21.15.89:0/889220238 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c58eaa640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c540ffca0 0x7f5c5419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c596ab640 1 -- 172.21.15.89:0/889220238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c540ffca0 msgr2=0x7f5c5419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c596ab640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c540ffca0 0x7f5c5419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c596ab640 1 -- 172.21.15.89:0/889220238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009560 con 0x7f5c540feaa0 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c58eaa640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c540ffca0 0x7f5c5419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:06:02.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c596ab640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540feaa0 0x7f5c54068fb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c8f0 tx=0x7f5c5000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c4a7fc640 1 -- 172.21.15.89:0/889220238 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c50007b80 con 0x7f5c540feaa0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c4a7fc640 1 -- 172.21.15.89:0/889220238 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c50007ce0 con 0x7f5c540feaa0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5419ace0 con 0x7f5c540feaa0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c4a7fc640 1 -- 172.21.15.89:0/889220238 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c50018870 con 0x7f5c540feaa0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.238+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5419b2b0 con 0x7f5c540feaa0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.239+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5418e620 con 0x7f5c540feaa0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.240+0000 7f5c4a7fc640 1 -- 172.21.15.89:0/889220238 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5c50018ae0 con 0x7f5c540feaa0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.240+0000 7f5c4a7fc640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f5c4006cc50 0x7f5c4006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.240+0000 7f5c4a7fc640 1 -- 172.21.15.89:0/889220238 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5c5008c060 con 0x7f5c540feaa0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.240+0000 7f5c58eaa640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f5c4006cc50 0x7f5c4006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.241+0000 7f5c58eaa640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f5c4006cc50 0x7f5c4006f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5c44000c00 tx=0x7f5c44005de0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:02.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.244+0000 7f5c4a7fc640 1 -- 172.21.15.89:0/889220238 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5c50056770 con 0x7f5c540feaa0 2024-09-13T22:06:02.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.417+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c5402c550 con 0x7f5c4006cc50 2024-09-13T22:06:02.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.426+0000 7f5c4a7fc640 1 -- 172.21.15.89:0/889220238 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3080 (secure 0 0 0) 0x7f5c5402c550 con 0x7f5c4006cc50 2024-09-13T22:06:02.428 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:06:02.428 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (3m) 2m ago 5m 26.0M - 0.25.0 c8568f914cd2 6ef74b73ca3e 2024-09-13T22:06:02.428 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (5m) 2m ago 5m 7134k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:06:02.428 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (4m) 68s ago 4m 7071k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:06:02.428 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (5m) 2m ago 5m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:06:02.428 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (4m) 68s ago 4m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:06:02.428 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (3m) 2m ago 4m 80.4M - 9.4.7 954c08fa6188 59724cff87bd 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:9283,8765,8443 running (6m) 2m ago 6m 479M - 18.2.4-845-ge4e227b3 67ddd33fa72f deeaa986e2d7 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (4m) 68s ago 4m 440M - 18.2.4-845-ge4e227b3 67ddd33fa72f e126d541e564 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (6m) 2m ago 6m 46.3M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (4m) 68s ago 4m 41.6M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (5m) 2m ago 5m 16.0M - 1.5.0 0da6a335fe13 eeaf1dd44f97 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (4m) 68s ago 4m 16.4M - 1.5.0 0da6a335fe13 c76544fc91f3 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (3m) 2m ago 3m 49.1M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (2m) 2m ago 2m 42.8M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (2m) 2m ago 2m 49.3M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (2m) 68s ago 2m 48.4M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (99s) 68s ago 99s 45.8M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (74s) 68s ago 73s 12.1M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:06:02.429 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (3m) 2m ago 4m 42.6M - 2.43.0 a07b618ecd1d 4bb2a482e0e5 2024-09-13T22:06:02.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.428+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f5c4006cc50 msgr2=0x7f5c4006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:02.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.428+0000 7f5c5b90f640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f5c4006cc50 0x7f5c4006f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5c44000c00 tx=0x7f5c44005de0 comp rx=0 tx=0).stop 2024-09-13T22:06:02.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.428+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540feaa0 msgr2=0x7f5c54068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:02.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.428+0000 7f5c5b90f640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540feaa0 0x7f5c54068fb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c8f0 tx=0x7f5c5000cdb0 comp rx=0 tx=0).stop 2024-09-13T22:06:02.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.428+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 shutdown_connections 2024-09-13T22:06:02.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.428+0000 7f5c5b90f640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f5c4006cc50 0x7f5c4006f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:02.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.428+0000 7f5c5b90f640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c540ffca0 0x7f5c5419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:02.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.428+0000 7f5c5b90f640 1 --2- 172.21.15.89:0/889220238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c540feaa0 0x7f5c54068fb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:02.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.428+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 >> 172.21.15.89:0/889220238 conn(0x7f5c540fa250 msgr2=0x7f5c54103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:02.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.429+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 shutdown_connections 2024-09-13T22:06:02.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:02.429+0000 7f5c5b90f640 1 -- 172.21.15.89:0/889220238 wait complete. 2024-09-13T22:06:03.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T22:06:03.288 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:03.640 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:03 smithi089 ceph-mon[27921]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:03.640 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:03 smithi089 ceph-mon[27921]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:03.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:03 smithi159 ceph-mon[35348]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:03.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:03 smithi159 ceph-mon[35348]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:04.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.850+0000 7f2a41bfc640 1 -- 172.21.15.89:0/352379205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0ffcf0 msgr2=0x7f2a3c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:04.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.850+0000 7f2a41bfc640 1 --2- 172.21.15.89:0/352379205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0ffcf0 0x7f2a3c100170 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009880 tx=0x7f2a2c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:04.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.850+0000 7f2a41bfc640 1 -- 172.21.15.89:0/352379205 shutdown_connections 2024-09-13T22:06:04.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.850+0000 7f2a41bfc640 1 --2- 172.21.15.89:0/352379205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0ffcf0 0x7f2a3c100170 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:04.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.850+0000 7f2a41bfc640 1 --2- 172.21.15.89:0/352379205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0feaf0 0x7f2a3c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:04.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.850+0000 7f2a41bfc640 1 -- 172.21.15.89:0/352379205 >> 172.21.15.89:0/352379205 conn(0x7f2a3c0fa280 msgr2=0x7f2a3c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:04.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.850+0000 7f2a41bfc640 1 -- 172.21.15.89:0/352379205 shutdown_connections 2024-09-13T22:06:04.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.850+0000 7f2a41bfc640 1 -- 172.21.15.89:0/352379205 wait complete. 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.850+0000 7f2a41bfc640 1 Processor -- start 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a41bfc640 1 -- start start 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a41bfc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0feaf0 0x7f2a3c195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a41bfc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0ffcf0 0x7f2a3c195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a41bfc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c1962a0 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a41bfc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c196410 con 0x7f2a3c0ffcf0 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a3b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0feaf0 0x7f2a3c195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a3b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0feaf0 0x7f2a3c195790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41040/0 (socket says 172.21.15.89:41040) 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a3b7fe640 1 -- 172.21.15.89:0/467386982 learned_addr learned my addr 172.21.15.89:0/467386982 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a3affd640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0ffcf0 0x7f2a3c195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a3b7fe640 1 -- 172.21.15.89:0/467386982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0ffcf0 msgr2=0x7f2a3c195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a3b7fe640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0ffcf0 0x7f2a3c195cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:04.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a3b7fe640 1 -- 172.21.15.89:0/467386982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009560 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.851+0000 7f2a3b7fe640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0feaf0 0x7f2a3c195790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400b400 tx=0x7f2a2400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.852+0000 7f2a38ff9640 1 -- 172.21.15.89:0/467386982 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a24011800 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.852+0000 7f2a38ff9640 1 -- 172.21.15.89:0/467386982 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a24011e20 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.852+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c19aeb0 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.852+0000 7f2a38ff9640 1 -- 172.21.15.89:0/467386982 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2400f2e0 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.852+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c19b420 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.853+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c107780 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.853+0000 7f2a38ff9640 1 -- 172.21.15.89:0/467386982 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2a24011960 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.853+0000 7f2a38ff9640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2a2806cc50 0x7f2a2806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.854+0000 7f2a38ff9640 1 -- 172.21.15.89:0/467386982 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2a2408bc50 con 0x7f2a3c0feaf0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.854+0000 7f2a3affd640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2a2806cc50 0x7f2a2806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.854+0000 7f2a3affd640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2a2806cc50 0x7f2a2806f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c006010 tx=0x7f2a2c000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:04.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:04.858+0000 7f2a38ff9640 1 -- 172.21.15.89:0/467386982 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2a24056360 con 0x7f2a3c0feaf0 2024-09-13T22:06:05.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.027+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a3c19b6a0 con 0x7f2a2806cc50 2024-09-13T22:06:05.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.032+0000 7f2a38ff9640 1 -- 172.21.15.89:0/467386982 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f2a3c19b6a0 con 0x7f2a2806cc50 2024-09-13T22:06:05.033 INFO:teuthology.orchestra.run.smithi089.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T22:06:05.033 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T22:06:05.033 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-13T22:06:05.033 INFO:teuthology.orchestra.run.smithi089.stdout:crash 2/2 2m ago 5m * 2024-09-13T22:06:05.033 INFO:teuthology.orchestra.run.smithi089.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-13T22:06:05.033 INFO:teuthology.orchestra.run.smithi089.stdout:mgr 2/2 2m ago 5m count:2 2024-09-13T22:06:05.033 INFO:teuthology.orchestra.run.smithi089.stdout:mon 2/2 2m ago 5m smithi089:172.21.15.89=smithi089;smithi159:172.21.15.159=smithi159;count:2 2024-09-13T22:06:05.033 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-13T22:06:05.034 INFO:teuthology.orchestra.run.smithi089.stdout:osd 6 2m ago - 2024-09-13T22:06:05.034 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-13T22:06:05.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2a2806cc50 msgr2=0x7f2a2806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2a2806cc50 0x7f2a2806f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c006010 tx=0x7f2a2c000bc0 comp rx=0 tx=0).stop 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0feaf0 msgr2=0x7f2a3c195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0feaf0 0x7f2a3c195790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400b400 tx=0x7f2a2400b8c0 comp rx=0 tx=0).stop 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 shutdown_connections 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2a2806cc50 0x7f2a2806f110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3c0ffcf0 0x7f2a3c195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 --2- 172.21.15.89:0/467386982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c0feaf0 0x7f2a3c195790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 >> 172.21.15.89:0/467386982 conn(0x7f2a3c0fa280 msgr2=0x7f2a3c067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 shutdown_connections 2024-09-13T22:06:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:05.034+0000 7f2a41bfc640 1 -- 172.21.15.89:0/467386982 wait complete. 2024-09-13T22:06:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:05 smithi159 ceph-mon[35348]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:05.743 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:05 smithi089 ceph-mon[27921]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:05.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T22:06:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:06.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:06 smithi089 ceph-mon[27921]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:06.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:06 smithi159 ceph-mon[35348]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:07.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:07 smithi089 ceph-mon[27921]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:07.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.616+0000 7f2f08257640 1 -- 172.21.15.89:0/3217729821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000ff410 msgr2=0x7f2f000ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:07.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.616+0000 7f2f08257640 1 --2- 172.21.15.89:0/3217729821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000ff410 0x7f2f000ff890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009880 tx=0x7f2ef402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:07.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.616+0000 7f2f08257640 1 -- 172.21.15.89:0/3217729821 shutdown_connections 2024-09-13T22:06:07.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.616+0000 7f2f08257640 1 --2- 172.21.15.89:0/3217729821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000ff410 0x7f2f000ff890 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:07.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.616+0000 7f2f08257640 1 --2- 172.21.15.89:0/3217729821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f000fe210 0x7f2f000fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:07.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.616+0000 7f2f08257640 1 -- 172.21.15.89:0/3217729821 >> 172.21.15.89:0/3217729821 conn(0x7f2f000f99c0 msgr2=0x7f2f000fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:07.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.616+0000 7f2f08257640 1 -- 172.21.15.89:0/3217729821 shutdown_connections 2024-09-13T22:06:07.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.616+0000 7f2f08257640 1 -- 172.21.15.89:0/3217729821 wait complete. 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.617+0000 7f2f08257640 1 Processor -- start 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.617+0000 7f2f08257640 1 -- start start 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.617+0000 7f2f08257640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000fe210 0x7f2f001021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.617+0000 7f2f08257640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f000ff410 0x7f2f001007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.617+0000 7f2f08257640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f00100d30 con 0x7f2f000fe210 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.617+0000 7f2f08257640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f00100ea0 con 0x7f2f000ff410 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.617+0000 7f2f05ff3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000fe210 0x7f2f001021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.617+0000 7f2f05ff3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000fe210 0x7f2f001021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41066/0 (socket says 172.21.15.89:41066) 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.617+0000 7f2f05ff3640 1 -- 172.21.15.89:0/3911884242 learned_addr learned my addr 172.21.15.89:0/3911884242 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2f057f2640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f000ff410 0x7f2f001007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2f05ff3640 1 -- 172.21.15.89:0/3911884242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f000ff410 msgr2=0x7f2f001007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2f05ff3640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f000ff410 0x7f2f001007f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2f05ff3640 1 -- 172.21.15.89:0/3911884242 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4009560 con 0x7f2f000fe210 2024-09-13T22:06:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2f05ff3640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000fe210 0x7f2f001021a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000b9c0 tx=0x7f2ef000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:07.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2efeffd640 1 -- 172.21.15.89:0/3911884242 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ef000caf0 con 0x7f2f000fe210 2024-09-13T22:06:07.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2efeffd640 1 -- 172.21.15.89:0/3911884242 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ef000cc50 con 0x7f2f000fe210 2024-09-13T22:06:07.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2efeffd640 1 -- 172.21.15.89:0/3911884242 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ef0012780 con 0x7f2f000fe210 2024-09-13T22:06:07.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f00101180 con 0x7f2f000fe210 2024-09-13T22:06:07.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.618+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0019d790 con 0x7f2f000fe210 2024-09-13T22:06:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.619+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f00106ea0 con 0x7f2f000fe210 2024-09-13T22:06:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.619+0000 7f2efeffd640 1 -- 172.21.15.89:0/3911884242 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2ef00129f0 con 0x7f2f000fe210 2024-09-13T22:06:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.620+0000 7f2efeffd640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2ee806cc50 0x7f2ee806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:07.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.620+0000 7f2f057f2640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2ee806cc50 0x7f2ee806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:07.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.620+0000 7f2efeffd640 1 -- 172.21.15.89:0/3911884242 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2ef008b890 con 0x7f2f000fe210 2024-09-13T22:06:07.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.621+0000 7f2f057f2640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2ee806cc50 0x7f2ee806f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4031540 tx=0x7f2ef4000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:07.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.624+0000 7f2efeffd640 1 -- 172.21.15.89:0/3911884242 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ef0056050 con 0x7f2f000fe210 2024-09-13T22:06:07.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:07 smithi159 ceph-mon[35348]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:07.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.793+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f00103850 con 0x7f2ee806cc50 2024-09-13T22:06:07.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.794+0000 7f2efeffd640 1 -- 172.21.15.89:0/3911884242 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f2f00103850 con 0x7f2ee806cc50 2024-09-13T22:06:07.796 INFO:teuthology.orchestra.run.smithi089.stdout:HOST ADDR LABELS STATUS 2024-09-13T22:06:07.796 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089 172.21.15.89 2024-09-13T22:06:07.796 INFO:teuthology.orchestra.run.smithi089.stdout:smithi159 172.21.15.159 2024-09-13T22:06:07.796 INFO:teuthology.orchestra.run.smithi089.stdout:2 hosts in cluster 2024-09-13T22:06:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2ee806cc50 msgr2=0x7f2ee806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2ee806cc50 0x7f2ee806f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4031540 tx=0x7f2ef4000bc0 comp rx=0 tx=0).stop 2024-09-13T22:06:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000fe210 msgr2=0x7f2f001021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000fe210 0x7f2f001021a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000b9c0 tx=0x7f2ef000be80 comp rx=0 tx=0).stop 2024-09-13T22:06:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 shutdown_connections 2024-09-13T22:06:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2ee806cc50 0x7f2ee806f110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f000ff410 0x7f2f001007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 --2- 172.21.15.89:0/3911884242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f000fe210 0x7f2f001021a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 >> 172.21.15.89:0/3911884242 conn(0x7f2f000f99c0 msgr2=0x7f2f000fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 shutdown_connections 2024-09-13T22:06:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:07.796+0000 7f2f08257640 1 -- 172.21.15.89:0/3911884242 wait complete. 2024-09-13T22:06:08.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T22:06:08.673 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:09.723 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:09 smithi089 ceph-mon[27921]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:09.723 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:09 smithi089 ceph-mon[27921]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:09.723 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:06:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:09 smithi159 ceph-mon[35348]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:09 smithi159 ceph-mon[35348]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:06:10.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.189+0000 7f96c2b6a640 1 -- 172.21.15.89:0/1693998845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc102fb0 msgr2=0x7f96bc1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:10.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.189+0000 7f96c2b6a640 1 --2- 172.21.15.89:0/1693998845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc102fb0 0x7f96bc1053a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f96a80098b0 tx=0x7f96a802a4d0 comp rx=0 tx=0).stop 2024-09-13T22:06:10.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.189+0000 7f96c2b6a640 1 -- 172.21.15.89:0/1693998845 shutdown_connections 2024-09-13T22:06:10.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.189+0000 7f96c2b6a640 1 --2- 172.21.15.89:0/1693998845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc102fb0 0x7f96bc1053a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:10.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.189+0000 7f96c2b6a640 1 --2- 172.21.15.89:0/1693998845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96bc100680 0x7f96bc102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.189+0000 7f96c2b6a640 1 -- 172.21.15.89:0/1693998845 >> 172.21.15.89:0/1693998845 conn(0x7f96bc0fa280 msgr2=0x7f96bc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.189+0000 7f96c2b6a640 1 -- 172.21.15.89:0/1693998845 shutdown_connections 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.189+0000 7f96c2b6a640 1 -- 172.21.15.89:0/1693998845 wait complete. 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c2b6a640 1 Processor -- start 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c2b6a640 1 -- start start 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c2b6a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc100680 0x7f96bc195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c2b6a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96bc102fb0 0x7f96bc195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c2b6a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc196230 con 0x7f96bc100680 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c2b6a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc1963a0 con 0x7f96bc102fb0 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c0906640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc100680 0x7f96bc195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c0906640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc100680 0x7f96bc195720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41088/0 (socket says 172.21.15.89:41088) 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c0906640 1 -- 172.21.15.89:0/3260279464 learned_addr learned my addr 172.21.15.89:0/3260279464 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c0906640 1 -- 172.21.15.89:0/3260279464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96bc102fb0 msgr2=0x7f96bc195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96bbfff640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96bc102fb0 0x7f96bc195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c0906640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96bc102fb0 0x7f96bc195c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.190+0000 7f96c0906640 1 -- 172.21.15.89:0/3260279464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a8009560 con 0x7f96bc100680 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.191+0000 7f96c0906640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc100680 0x7f96bc195720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f96b000d720 tx=0x7f96b000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.191+0000 7f96b9ffb640 1 -- 172.21.15.89:0/3260279464 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96b00051f0 con 0x7f96bc100680 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.191+0000 7f96b9ffb640 1 -- 172.21.15.89:0/3260279464 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96b0009ce0 con 0x7f96bc100680 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.191+0000 7f96b9ffb640 1 -- 172.21.15.89:0/3260279464 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96b0010460 con 0x7f96bc100680 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.191+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc19ae40 con 0x7f96bc100680 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.191+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc19b330 con 0x7f96bc100680 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.192+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc108800 con 0x7f96bc100680 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.192+0000 7f96b9ffb640 1 -- 172.21.15.89:0/3260279464 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f96b0005350 con 0x7f96bc100680 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.193+0000 7f96b9ffb640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f96ac06cc50 0x7f96ac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.193+0000 7f96bbfff640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f96ac06cc50 0x7f96ac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.193+0000 7f96b9ffb640 1 -- 172.21.15.89:0/3260279464 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f96b008b9f0 con 0x7f96bc100680 2024-09-13T22:06:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.193+0000 7f96bbfff640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f96ac06cc50 0x7f96ac06f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009230 tx=0x7f96a8000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.197+0000 7f96b9ffb640 1 -- 172.21.15.89:0/3260279464 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f96b008de60 con 0x7f96bc100680 2024-09-13T22:06:10.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.369+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f96bc19b5a0 con 0x7f96ac06cc50 2024-09-13T22:06:10.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.370+0000 7f96b9ffb640 1 -- 172.21.15.89:0/3260279464 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f96bc19b5a0 con 0x7f96ac06cc50 2024-09-13T22:06:10.372 INFO:teuthology.orchestra.run.smithi089.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T22:06:10.372 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040126400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-13T22:06:10.372 INFO:teuthology.orchestra.run.smithi089.stdout:smithi159 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GH400BGN 372G No 73s ago Has a FileSystem, LVM detected 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.372+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f96ac06cc50 msgr2=0x7f96ac06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.372+0000 7f96c2b6a640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f96ac06cc50 0x7f96ac06f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009230 tx=0x7f96a8000bc0 comp rx=0 tx=0).stop 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.372+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc100680 msgr2=0x7f96bc195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.372+0000 7f96c2b6a640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc100680 0x7f96bc195720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f96b000d720 tx=0x7f96b000dbe0 comp rx=0 tx=0).stop 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.372+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 shutdown_connections 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.372+0000 7f96c2b6a640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f96ac06cc50 0x7f96ac06f110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.372+0000 7f96c2b6a640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96bc102fb0 0x7f96bc195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.372+0000 7f96c2b6a640 1 --2- 172.21.15.89:0/3260279464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc100680 0x7f96bc195720 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.372+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 >> 172.21.15.89:0/3260279464 conn(0x7f96bc0fa280 msgr2=0x7f96bc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.373+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 shutdown_connections 2024-09-13T22:06:10.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:10.373+0000 7f96c2b6a640 1 -- 172.21.15.89:0/3260279464 wait complete. 2024-09-13T22:06:11.043 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:06:11.052 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:06:11.052 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T22:06:11.253 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:11.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:11 smithi089 ceph-mon[27921]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:11.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:11 smithi089 ceph-mon[27921]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:11 smithi159 ceph-mon[35348]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:11 smithi159 ceph-mon[35348]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:12.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.689+0000 7fb863853640 1 -- 172.21.15.89:0/2291792261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0ffcf0 msgr2=0x7fb85c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:12.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.689+0000 7fb863853640 1 --2- 172.21.15.89:0/2291792261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0ffcf0 0x7fb85c100170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009880 tx=0x7fb84c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:12.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.689+0000 7fb863853640 1 -- 172.21.15.89:0/2291792261 shutdown_connections 2024-09-13T22:06:12.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.689+0000 7fb863853640 1 --2- 172.21.15.89:0/2291792261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0ffcf0 0x7fb85c100170 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.689+0000 7fb863853640 1 --2- 172.21.15.89:0/2291792261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c0feaf0 0x7fb85c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.689+0000 7fb863853640 1 -- 172.21.15.89:0/2291792261 >> 172.21.15.89:0/2291792261 conn(0x7fb85c0fa280 msgr2=0x7fb85c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.689+0000 7fb863853640 1 -- 172.21.15.89:0/2291792261 shutdown_connections 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.689+0000 7fb863853640 1 -- 172.21.15.89:0/2291792261 wait complete. 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb863853640 1 Processor -- start 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb863853640 1 -- start start 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb863853640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0feaf0 0x7fb85c195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb863853640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c0ffcf0 0x7fb85c195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb863853640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c196260 con 0x7fb85c0feaf0 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb863853640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1963d0 con 0x7fb85c0ffcf0 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb8615ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0feaf0 0x7fb85c195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb8615ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0feaf0 0x7fb85c195750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41108/0 (socket says 172.21.15.89:41108) 2024-09-13T22:06:12.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb8615ef640 1 -- 172.21.15.89:0/570754004 learned_addr learned my addr 172.21.15.89:0/570754004 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:12.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb8615ef640 1 -- 172.21.15.89:0/570754004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c0ffcf0 msgr2=0x7fb85c195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:12.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb8615ef640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c0ffcf0 0x7fb85c195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:12.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb8615ef640 1 -- 172.21.15.89:0/570754004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c009560 con 0x7fb85c0feaf0 2024-09-13T22:06:12.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb8615ef640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0feaf0 0x7fb85c195750 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b400 tx=0x7fb85800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:12.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.690+0000 7fb8527fc640 1 -- 172.21.15.89:0/570754004 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb858011800 con 0x7fb85c0feaf0 2024-09-13T22:06:12.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.691+0000 7fb8527fc640 1 -- 172.21.15.89:0/570754004 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb858011e20 con 0x7fb85c0feaf0 2024-09-13T22:06:12.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.691+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c19ae70 con 0x7fb85c0feaf0 2024-09-13T22:06:12.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.691+0000 7fb8527fc640 1 -- 172.21.15.89:0/570754004 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb85800f2e0 con 0x7fb85c0feaf0 2024-09-13T22:06:12.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.691+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c19b3c0 con 0x7fb85c0feaf0 2024-09-13T22:06:12.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.692+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c0feef0 con 0x7fb85c0feaf0 2024-09-13T22:06:12.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.692+0000 7fb8527fc640 1 -- 172.21.15.89:0/570754004 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb858010380 con 0x7fb85c0feaf0 2024-09-13T22:06:12.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.693+0000 7fb8527fc640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb84806cc50 0x7fb84806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:12.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.693+0000 7fb8527fc640 1 -- 172.21.15.89:0/570754004 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb85808bbe0 con 0x7fb85c0feaf0 2024-09-13T22:06:12.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.693+0000 7fb860dee640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb84806cc50 0x7fb84806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:12.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.693+0000 7fb860dee640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb84806cc50 0x7fb84806f110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb84c02a9c0 tx=0x7fb84c000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:12.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.697+0000 7fb8527fc640 1 -- 172.21.15.89:0/570754004 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb8580562f0 con 0x7fb85c0feaf0 2024-09-13T22:06:12.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:12.889+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb85c068430 con 0x7fb84806cc50 2024-09-13T22:06:13.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:13 smithi089 ceph-mon[27921]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:13.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:13 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T22:06:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:13 smithi159 ceph-mon[35348]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:13 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T22:06:14.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.410+0000 7fb8527fc640 1 -- 172.21.15.89:0/570754004 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb85c068430 con 0x7fb84806cc50 2024-09-13T22:06:14.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb84806cc50 msgr2=0x7fb84806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:14.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb84806cc50 0x7fb84806f110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb84c02a9c0 tx=0x7fb84c000bc0 comp rx=0 tx=0).stop 2024-09-13T22:06:14.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0feaf0 msgr2=0x7fb85c195750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:14.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0feaf0 0x7fb85c195750 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b400 tx=0x7fb85800b8c0 comp rx=0 tx=0).stop 2024-09-13T22:06:14.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 shutdown_connections 2024-09-13T22:06:14.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fb84806cc50 0x7fb84806f110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:14.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c0ffcf0 0x7fb85c195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:14.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 --2- 172.21.15.89:0/570754004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb85c0feaf0 0x7fb85c195750 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:14.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 >> 172.21.15.89:0/570754004 conn(0x7fb85c0fa280 msgr2=0x7fb85c067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:14.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 shutdown_connections 2024-09-13T22:06:14.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:14.414+0000 7fb863853640 1 -- 172.21.15.89:0/570754004 wait complete. 2024-09-13T22:06:14.743 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:14 smithi089 ceph-mon[27921]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:14.743 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:14 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T22:06:14.743 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:14 smithi089 ceph-mon[27921]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T22:06:14.744 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:14 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T22:06:14.744 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:14 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089[27917]: 2024-09-13T22:06:14.393+0000 7fb989aee640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:06:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:14 smithi159 ceph-mon[35348]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:06:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:14 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T22:06:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:14 smithi159 ceph-mon[35348]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T22:06:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:14 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T22:06:15.055 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T22:06:15.275 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:15.647 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: pgmap v174: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:15.647 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T22:06:15.647 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T22:06:15.647 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T22:06:15.647 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: fsmap cephfs:0 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: Saving service mds.cephfs spec with placement count:4 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.euhfjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:06:15.648 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.euhfjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:06:15.649 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:15 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:15.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: pgmap v174: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:15.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T22:06:15.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: fsmap cephfs:0 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: Saving service mds.cephfs spec with placement count:4 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:06:15.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:15.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.euhfjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:06:15.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.euhfjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:06:15.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:15 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:16.685 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:16 smithi089 ceph-mon[27921]: Deploying daemon mds.cephfs.smithi089.euhfjz on smithi089 2024-09-13T22:06:16.685 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:16 smithi089 ceph-mon[27921]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T22:06:16.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:16 smithi159 ceph-mon[35348]: Deploying daemon mds.cephfs.smithi089.euhfjz on smithi089 2024-09-13T22:06:16.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:16 smithi159 ceph-mon[35348]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T22:06:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 -- 172.21.15.89:0/1941717155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf64100d90 msgr2=0x7fbf64101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 --2- 172.21.15.89:0/1941717155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf64100d90 0x7fbf64101210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009880 tx=0x7fbf5402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 -- 172.21.15.89:0/1941717155 shutdown_connections 2024-09-13T22:06:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 --2- 172.21.15.89:0/1941717155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf64100d90 0x7fbf64101210 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 --2- 172.21.15.89:0/1941717155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf640ffb90 0x7fbf640fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 -- 172.21.15.89:0/1941717155 >> 172.21.15.89:0/1941717155 conn(0x7fbf640fb320 msgr2=0x7fbf640fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 -- 172.21.15.89:0/1941717155 shutdown_connections 2024-09-13T22:06:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 -- 172.21.15.89:0/1941717155 wait complete. 2024-09-13T22:06:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 Processor -- start 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.875+0000 7fbf6bd77640 1 -- start start 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf6bd77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf640ffb90 0x7fbf64195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf6bd77640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf64100d90 0x7fbf64195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf6bd77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf64196220 con 0x7fbf640ffb90 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf6bd77640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf64196390 con 0x7fbf64100d90 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf69b13640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf640ffb90 0x7fbf64195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf69b13640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf640ffb90 0x7fbf64195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42940/0 (socket says 172.21.15.89:42940) 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf69b13640 1 -- 172.21.15.89:0/485677089 learned_addr learned my addr 172.21.15.89:0/485677089 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf69312640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf64100d90 0x7fbf64195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf69b13640 1 -- 172.21.15.89:0/485677089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf64100d90 msgr2=0x7fbf64195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf69b13640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf64100d90 0x7fbf64195c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf69b13640 1 -- 172.21.15.89:0/485677089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf54009560 con 0x7fbf640ffb90 2024-09-13T22:06:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf69b13640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf640ffb90 0x7fbf64195710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000b400 tx=0x7fbf6000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf5affd640 1 -- 172.21.15.89:0/485677089 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf60011800 con 0x7fbf640ffb90 2024-09-13T22:06:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf5affd640 1 -- 172.21.15.89:0/485677089 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf60011e20 con 0x7fbf640ffb90 2024-09-13T22:06:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6419ae30 con 0x7fbf640ffb90 2024-09-13T22:06:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf5affd640 1 -- 172.21.15.89:0/485677089 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf6000f2e0 con 0x7fbf640ffb90 2024-09-13T22:06:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.876+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6419b370 con 0x7fbf640ffb90 2024-09-13T22:06:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.877+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf64100010 con 0x7fbf640ffb90 2024-09-13T22:06:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.878+0000 7fbf5affd640 1 -- 172.21.15.89:0/485677089 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbf60010380 con 0x7fbf640ffb90 2024-09-13T22:06:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.878+0000 7fbf5affd640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fbf5006cc50 0x7fbf5006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.878+0000 7fbf5affd640 1 -- 172.21.15.89:0/485677089 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fbf6008bdf0 con 0x7fbf640ffb90 2024-09-13T22:06:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.878+0000 7fbf69312640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fbf5006cc50 0x7fbf5006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.879+0000 7fbf69312640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fbf5006cc50 0x7fbf5006f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf54000c00 tx=0x7fbf540314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:16.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:16.883+0000 7fbf5affd640 1 -- 172.21.15.89:0/485677089 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbf60056240 con 0x7fbf640ffb90 2024-09-13T22:06:17.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.085+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbf6402c480 con 0x7fbf640ffb90 2024-09-13T22:06:17.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.085+0000 7fbf5affd640 1 -- 172.21.15.89:0/485677089 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1114 (secure 0 0 0) 0x7fbf60059860 con 0x7fbf640ffb90 2024-09-13T22:06:17.088 INFO:teuthology.orchestra.run.smithi089.stdout:e2 2024-09-13T22:06:17.088 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:06:17.088 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:06:17.088 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:06:17.088 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:06:17.088 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 2 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:14.394570+0000 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:06:17.089 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 0 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:in 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:up {} 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 0 2024-09-13T22:06:17.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:06:17.091 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:06:17.091 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 2 2024-09-13T22:06:17.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fbf5006cc50 msgr2=0x7fbf5006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:17.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fbf5006cc50 0x7fbf5006f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf54000c00 tx=0x7fbf540314e0 comp rx=0 tx=0).stop 2024-09-13T22:06:17.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf640ffb90 msgr2=0x7fbf64195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:17.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf640ffb90 0x7fbf64195710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000b400 tx=0x7fbf6000b8c0 comp rx=0 tx=0).stop 2024-09-13T22:06:17.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 shutdown_connections 2024-09-13T22:06:17.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fbf5006cc50 0x7fbf5006f110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:17.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf64100d90 0x7fbf64195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:17.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 --2- 172.21.15.89:0/485677089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf640ffb90 0x7fbf64195710 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:17.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 >> 172.21.15.89:0/485677089 conn(0x7fbf640fb320 msgr2=0x7fbf641044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:17.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 shutdown_connections 2024-09-13T22:06:17.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:17.088+0000 7fbf6bd77640 1 -- 172.21.15.89:0/485677089 wait complete. 2024-09-13T22:06:17.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:17 smithi089 ceph-mon[27921]: pgmap v178: 65 pgs: 13 creating+peering, 42 unknown, 10 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:17.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:17 smithi089 ceph-mon[27921]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T22:06:17.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:17 smithi089 ceph-mon[27921]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T22:06:17.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:17 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/485677089' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:06:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:17 smithi159 ceph-mon[35348]: pgmap v178: 65 pgs: 13 creating+peering, 42 unknown, 10 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:17 smithi159 ceph-mon[35348]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T22:06:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:17 smithi159 ceph-mon[35348]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T22:06:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:17 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/485677089' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:06:17.865 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:06:17.874 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:06:17.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-13T22:06:18.688 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:19.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:19 smithi089 ceph-mon[27921]: pgmap v180: 65 pgs: 13 creating+peering, 14 unknown, 38 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:19 smithi159 ceph-mon[35348]: pgmap v180: 65 pgs: 13 creating+peering, 14 unknown, 38 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:20.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.483+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/334056518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 msgr2=0x7fcdac100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:20.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.483+0000 7fcdb3e2b640 1 --2- 172.21.15.89:0/334056518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 0x7fcdac100170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009880 tx=0x7fcd9c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:20.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.483+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/334056518 shutdown_connections 2024-09-13T22:06:20.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.483+0000 7fcdb3e2b640 1 --2- 172.21.15.89:0/334056518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 0x7fcdac100170 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:20.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.483+0000 7fcdb3e2b640 1 --2- 172.21.15.89:0/334056518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdac0feaf0 0x7fcdac0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:20.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.483+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/334056518 >> 172.21.15.89:0/334056518 conn(0x7fcdac0fa280 msgr2=0x7fcdac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:20.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.483+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/334056518 shutdown_connections 2024-09-13T22:06:20.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.483+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/334056518 wait complete. 2024-09-13T22:06:20.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb3e2b640 1 Processor -- start 2024-09-13T22:06:20.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb3e2b640 1 -- start start 2024-09-13T22:06:20.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb3e2b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdac0feaf0 0x7fcdac197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:20.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb3e2b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 0x7fcdac197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:20.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb3e2b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac198440 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb3e2b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1985b0 con 0x7fcdac0feaf0 2024-09-13T22:06:20.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb13c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 0x7fcdac197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:20.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb13c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 0x7fcdac197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42962/0 (socket says 172.21.15.89:42962) 2024-09-13T22:06:20.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb13c6640 1 -- 172.21.15.89:0/2392926039 learned_addr learned my addr 172.21.15.89:0/2392926039 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:20.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb1bc7640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdac0feaf0 0x7fcdac197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:20.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb13c6640 1 -- 172.21.15.89:0/2392926039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdac0feaf0 msgr2=0x7fcdac197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:20.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb13c6640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdac0feaf0 0x7fcdac197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:20.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.484+0000 7fcdb13c6640 1 -- 172.21.15.89:0/2392926039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c009560 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.485+0000 7fcdb13c6640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 0x7fcdac197e70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c006010 tx=0x7fcd9c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:20.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.485+0000 7fcda2ffd640 1 -- 172.21.15.89:0/2392926039 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c004aa0 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.485+0000 7fcda2ffd640 1 -- 172.21.15.89:0/2392926039 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd9c004c00 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.485+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac19cff0 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.485+0000 7fcda2ffd640 1 -- 172.21.15.89:0/2392926039 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c003a80 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.485+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac19d4b0 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.486+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0feef0 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.486+0000 7fcda2ffd640 1 -- 172.21.15.89:0/2392926039 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcd9c003cf0 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.487+0000 7fcda2ffd640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcd9806cc60 0x7fcd9806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.487+0000 7fcda2ffd640 1 -- 172.21.15.89:0/2392926039 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fcd9c0ad540 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.487+0000 7fcdb1bc7640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcd9806cc60 0x7fcd9806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.487+0000 7fcdb1bc7640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcd9806cc60 0x7fcd9806f120 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005fd0 tx=0x7fcda8005850 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.491+0000 7fcda2ffd640 1 -- 172.21.15.89:0/2392926039 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd9c0779d0 con 0x7fcdac0ffcf0 2024-09-13T22:06:20.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:20.693+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fcdac19d6a0 con 0x7fcdac0ffcf0 2024-09-13T22:06:21.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.409+0000 7fcda2ffd640 1 -- 172.21.15.89:0/2392926039 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v3) v1 ==== 105+0+0 (secure 0 0 0) 0x7fcd9c07aff0 con 0x7fcdac0ffcf0 2024-09-13T22:06:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcd9806cc60 msgr2=0x7fcd9806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcd9806cc60 0x7fcd9806f120 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005fd0 tx=0x7fcda8005850 comp rx=0 tx=0).stop 2024-09-13T22:06:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 msgr2=0x7fcdac197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 0x7fcdac197e70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c006010 tx=0x7fcd9c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:06:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 shutdown_connections 2024-09-13T22:06:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcd9806cc60 0x7fcd9806f120 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdac0ffcf0 0x7fcdac197e70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 --2- 172.21.15.89:0/2392926039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdac0feaf0 0x7fcdac197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 >> 172.21.15.89:0/2392926039 conn(0x7fcdac0fa280 msgr2=0x7fcdac067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 shutdown_connections 2024-09-13T22:06:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:21.412+0000 7fcdb3e2b640 1 -- 172.21.15.89:0/2392926039 wait complete. 2024-09-13T22:06:21.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:21 smithi159 ceph-mon[35348]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:21.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:21 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2392926039' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T22:06:21.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:21 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:21.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:21 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:21.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:21 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:21.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:21 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.hqlvpx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:06:21.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:21 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.hqlvpx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:06:21.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:21 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:21 smithi089 ceph-mon[27921]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:21 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2392926039' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T22:06:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:21 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:21 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:21 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:21 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.hqlvpx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:06:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:21 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.hqlvpx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:06:21.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:21 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:22.079 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:06:22.092 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:06:22.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-13T22:06:22.296 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:22.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: Deploying daemon mds.cephfs.smithi159.hqlvpx on smithi159 2024-09-13T22:06:22.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2392926039' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T22:06:22.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.89:6826/216662831,v1:172.21.15.89:6827/216662831] up:boot 2024-09-13T22:06:22.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: daemon mds.cephfs.smithi089.euhfjz assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T22:06:22.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T22:06:22.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T22:06:22.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: Cluster is now healthy 2024-09-13T22:06:22.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: fsmap cephfs:0 1 up:standby 2024-09-13T22:06:22.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:06:22.711 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:creating} 2024-09-13T22:06:22.711 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:22 smithi159 ceph-mon[35348]: daemon mds.cephfs.smithi089.euhfjz is now active in filesystem cephfs as rank 0 2024-09-13T22:06:22.720 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: Deploying daemon mds.cephfs.smithi159.hqlvpx on smithi159 2024-09-13T22:06:22.720 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2392926039' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T22:06:22.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.89:6826/216662831,v1:172.21.15.89:6827/216662831] up:boot 2024-09-13T22:06:22.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: daemon mds.cephfs.smithi089.euhfjz assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T22:06:22.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T22:06:22.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T22:06:22.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: Cluster is now healthy 2024-09-13T22:06:22.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: fsmap cephfs:0 1 up:standby 2024-09-13T22:06:22.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:06:22.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:creating} 2024-09-13T22:06:22.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:22 smithi089 ceph-mon[27921]: daemon mds.cephfs.smithi089.euhfjz is now active in filesystem cephfs as rank 0 2024-09-13T22:06:23.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:23 smithi089 ceph-mon[27921]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:23.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:23 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.89:6826/216662831,v1:172.21.15.89:6827/216662831] up:active 2024-09-13T22:06:23.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:23 smithi089 ceph-mon[27921]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 2024-09-13T22:06:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:23 smithi159 ceph-mon[35348]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:06:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:23 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.89:6826/216662831,v1:172.21.15.89:6827/216662831] up:active 2024-09-13T22:06:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:23 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 2024-09-13T22:06:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.846+0000 7fd580eb0640 1 -- 172.21.15.89:0/797533459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 msgr2=0x7fd57c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.846+0000 7fd580eb0640 1 --2- 172.21.15.89:0/797533459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 0x7fd57c0fff90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009c20 tx=0x7fd56c02a970 comp rx=0 tx=0).stop 2024-09-13T22:06:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.846+0000 7fd580eb0640 1 -- 172.21.15.89:0/797533459 shutdown_connections 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.846+0000 7fd580eb0640 1 --2- 172.21.15.89:0/797533459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd57c100d90 0x7fd57c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.846+0000 7fd580eb0640 1 --2- 172.21.15.89:0/797533459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 0x7fd57c0fff90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.846+0000 7fd580eb0640 1 -- 172.21.15.89:0/797533459 >> 172.21.15.89:0/797533459 conn(0x7fd57c0fb360 msgr2=0x7fd57c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.846+0000 7fd580eb0640 1 -- 172.21.15.89:0/797533459 shutdown_connections 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.846+0000 7fd580eb0640 1 -- 172.21.15.89:0/797533459 wait complete. 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd580eb0640 1 Processor -- start 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd580eb0640 1 -- start start 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd580eb0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 0x7fd57c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd580eb0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd57c100d90 0x7fd57c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd580eb0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c072de0 con 0x7fd57c0ffb90 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd580eb0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c072f50 con 0x7fd57c100d90 2024-09-13T22:06:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd57a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 0x7fd57c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd57a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 0x7fd57c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41810/0 (socket says 172.21.15.89:41810) 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd57a59c640 1 -- 172.21.15.89:0/3062623369 learned_addr learned my addr 172.21.15.89:0/3062623369 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd579d9b640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd57c100d90 0x7fd57c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd57a59c640 1 -- 172.21.15.89:0/3062623369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd57c100d90 msgr2=0x7fd57c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd57a59c640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd57c100d90 0x7fd57c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd57a59c640 1 -- 172.21.15.89:0/3062623369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c009900 con 0x7fd57c0ffb90 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd579d9b640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd57c100d90 0x7fd57c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd57a59c640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 0x7fd57c074250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd56c02fd20 tx=0x7fd56c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.847+0000 7fd56b7fe640 1 -- 172.21.15.89:0/3062623369 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56c030670 con 0x7fd57c0ffb90 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.848+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c0731d0 con 0x7fd57c0ffb90 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.848+0000 7fd56b7fe640 1 -- 172.21.15.89:0/3062623369 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd56c030c90 con 0x7fd57c0ffb90 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.848+0000 7fd56b7fe640 1 -- 172.21.15.89:0/3062623369 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56c039680 con 0x7fd57c0ffb90 2024-09-13T22:06:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.848+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c19d6f0 con 0x7fd57c0ffb90 2024-09-13T22:06:23.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.849+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c0fff90 con 0x7fd57c0ffb90 2024-09-13T22:06:23.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.849+0000 7fd56b7fe640 1 -- 172.21.15.89:0/3062623369 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd56c00a040 con 0x7fd57c0ffb90 2024-09-13T22:06:23.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.849+0000 7fd56b7fe640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd56406cc50 0x7fd56406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:23.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.850+0000 7fd56b7fe640 1 -- 172.21.15.89:0/3062623369 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd56c02c040 con 0x7fd57c0ffb90 2024-09-13T22:06:23.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.850+0000 7fd579d9b640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd56406cc50 0x7fd56406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:23.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.850+0000 7fd579d9b640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd56406cc50 0x7fd56406f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd57c073fd0 tx=0x7fd570005e50 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:23.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:23.854+0000 7fd56b7fe640 1 -- 172.21.15.89:0/3062623369 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd56c077960 con 0x7fd57c0ffb90 2024-09-13T22:06:24.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.059+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd57c108a50 con 0x7fd57c0ffb90 2024-09-13T22:06:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.514+0000 7fd56b7fe640 1 -- 172.21.15.89:0/3062623369 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd56c07af80 con 0x7fd57c0ffb90 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd56406cc50 msgr2=0x7fd56406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd56406cc50 0x7fd56406f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd57c073fd0 tx=0x7fd570005e50 comp rx=0 tx=0).stop 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 msgr2=0x7fd57c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 0x7fd57c074250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd56c02fd20 tx=0x7fd56c02f5f0 comp rx=0 tx=0).stop 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 shutdown_connections 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd56406cc50 0x7fd56406f110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd57c100d90 0x7fd57c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 --2- 172.21.15.89:0/3062623369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd57c0ffb90 0x7fd57c074250 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 >> 172.21.15.89:0/3062623369 conn(0x7fd57c0fb360 msgr2=0x7fd57c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 shutdown_connections 2024-09-13T22:06:24.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:24.516+0000 7fd580eb0640 1 -- 172.21.15.89:0/3062623369 wait complete. 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:boot 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 1 up:standby 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 1 up:standby 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.egpifu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.egpifu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:06:24.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:24.633 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: Deploying daemon mds.cephfs.smithi089.egpifu on smithi089 2024-09-13T22:06:24.633 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3062623369' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-13T22:06:24.633 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:06:24.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:boot 2024-09-13T22:06:24.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 1 up:standby 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 1 up:standby 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.egpifu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.egpifu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: Deploying daemon mds.cephfs.smithi089.egpifu on smithi089 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3062623369' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-13T22:06:24.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:06:25.318 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:06:25.329 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:06:25.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-13T22:06:25.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:25 smithi159 ceph-mon[35348]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 232 B/s wr, 2 op/s 2024-09-13T22:06:25.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:25 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3062623369' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-13T22:06:25.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:25 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 1 up:standby 2024-09-13T22:06:25.821 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:25 smithi089 ceph-mon[27921]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 232 B/s wr, 2 op/s 2024-09-13T22:06:25.821 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:25 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3062623369' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-13T22:06:25.822 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:25 smithi089 ceph-mon[27921]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 1 up:standby 2024-09-13T22:06:25.880 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:27.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.593+0000 7f1340865640 1 -- 172.21.15.89:0/1948528969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 msgr2=0x7f133c100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:27.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.593+0000 7f1340865640 1 --2- 172.21.15.89:0/1948528969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 0x7f133c100100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f132c009880 tx=0x7f132c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:27.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.593+0000 7f1340865640 1 -- 172.21.15.89:0/1948528969 shutdown_connections 2024-09-13T22:06:27.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.593+0000 7f1340865640 1 --2- 172.21.15.89:0/1948528969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 0x7f133c100100 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:27.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.593+0000 7f1340865640 1 --2- 172.21.15.89:0/1948528969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c0fea80 0x7f133c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:27.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.593+0000 7f1340865640 1 -- 172.21.15.89:0/1948528969 >> 172.21.15.89:0/1948528969 conn(0x7f133c0fa230 msgr2=0x7f133c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:27.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.593+0000 7f1340865640 1 -- 172.21.15.89:0/1948528969 shutdown_connections 2024-09-13T22:06:27.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.593+0000 7f1340865640 1 -- 172.21.15.89:0/1948528969 wait complete. 2024-09-13T22:06:27.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.594+0000 7f1340865640 1 Processor -- start 2024-09-13T22:06:27.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.594+0000 7f1340865640 1 -- start start 2024-09-13T22:06:27.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.594+0000 7f1340865640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c0fea80 0x7f133c068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:27.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.594+0000 7f1340865640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 0x7f133c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.594+0000 7f1340865640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c19aa30 con 0x7f133c0ffc80 2024-09-13T22:06:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.594+0000 7f1340865640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c19ab70 con 0x7f133c0fea80 2024-09-13T22:06:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.594+0000 7f1339d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 0x7f133c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.594+0000 7f1339d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 0x7f133c19a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41826/0 (socket says 172.21.15.89:41826) 2024-09-13T22:06:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.594+0000 7f1339d9b640 1 -- 172.21.15.89:0/200834988 learned_addr learned my addr 172.21.15.89:0/200834988 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f1339d9b640 1 -- 172.21.15.89:0/200834988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c0fea80 msgr2=0x7f133c068fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:27.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f133a59c640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c0fea80 0x7f133c068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f1339d9b640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c0fea80 0x7f133c068fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f1339d9b640 1 -- 172.21.15.89:0/200834988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009560 con 0x7f133c0ffc80 2024-09-13T22:06:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f133a59c640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c0fea80 0x7f133c068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:06:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f1339d9b640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 0x7f133c19a460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f132c005610 tx=0x7f132c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f13337fe640 1 -- 172.21.15.89:0/200834988 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132c004ba0 con 0x7f133c0ffc80 2024-09-13T22:06:27.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f13337fe640 1 -- 172.21.15.89:0/200834988 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f132c004d00 con 0x7f133c0ffc80 2024-09-13T22:06:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c19adc0 con 0x7f133c0ffc80 2024-09-13T22:06:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f13337fe640 1 -- 172.21.15.89:0/200834988 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132c003bd0 con 0x7f133c0ffc80 2024-09-13T22:06:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.595+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c19b330 con 0x7f133c0ffc80 2024-09-13T22:06:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.596+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c107710 con 0x7f133c0ffc80 2024-09-13T22:06:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.597+0000 7f13337fe640 1 -- 172.21.15.89:0/200834988 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f132c031640 con 0x7f133c0ffc80 2024-09-13T22:06:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.597+0000 7f13337fe640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f132806cc50 0x7f132806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.597+0000 7f13337fe640 1 -- 172.21.15.89:0/200834988 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f132c0ad510 con 0x7f133c0ffc80 2024-09-13T22:06:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.597+0000 7f133a59c640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f132806cc50 0x7f132806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.597+0000 7f133a59c640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f132806cc50 0x7f132806f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1324006fd0 tx=0x7f1324008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.601+0000 7f13337fe640 1 -- 172.21.15.89:0/200834988 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f132c077960 con 0x7f133c0ffc80 2024-09-13T22:06:27.614 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:27 smithi089 ceph-mon[27921]: pgmap v184: 65 pgs: 65 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-13T22:06:27.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:27.813+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f133c19b570 con 0x7f133c0ffc80 2024-09-13T22:06:28.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:27 smithi159 ceph-mon[35348]: pgmap v184: 65 pgs: 65 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-13T22:06:28.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.523+0000 7f13337fe640 1 -- 172.21.15.89:0/200834988 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) v1 ==== 168+0+0 (secure 0 0 0) 0x7f132c07af80 con 0x7f133c0ffc80 2024-09-13T22:06:28.525 INFO:teuthology.orchestra.run.smithi089.stderr:inline data enabled 2024-09-13T22:06:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.525+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f132806cc50 msgr2=0x7f132806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.525+0000 7f1340865640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f132806cc50 0x7f132806f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1324006fd0 tx=0x7f1324008040 comp rx=0 tx=0).stop 2024-09-13T22:06:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.525+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 msgr2=0x7f133c19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.525+0000 7f1340865640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 0x7f133c19a460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f132c005610 tx=0x7f132c005640 comp rx=0 tx=0).stop 2024-09-13T22:06:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.526+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 shutdown_connections 2024-09-13T22:06:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.526+0000 7f1340865640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f132806cc50 0x7f132806f110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.526+0000 7f1340865640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0ffc80 0x7f133c19a460 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.526+0000 7f1340865640 1 --2- 172.21.15.89:0/200834988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c0fea80 0x7f133c068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:28.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.526+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 >> 172.21.15.89:0/200834988 conn(0x7f133c0fa230 msgr2=0x7f133c102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:28.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.526+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 shutdown_connections 2024-09-13T22:06:28.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:28.526+0000 7f1340865640 1 -- 172.21.15.89:0/200834988 wait complete. 2024-09-13T22:06:28.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:28 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/200834988' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T22:06:28.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:28.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:28.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:28.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.rowsot", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:06:28.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.rowsot", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:06:28.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:28.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:28 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/200834988' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T22:06:28.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:28.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:28.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:28.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.rowsot", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:06:28.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.rowsot", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:06:28.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:29.154 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:06:29.164 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:06:29.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T22:06:29.374 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:29.702 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:29 smithi159 ceph-mon[35348]: Deploying daemon mds.cephfs.smithi159.rowsot on smithi159 2024-09-13T22:06:29.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:29 smithi159 ceph-mon[35348]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-13T22:06:29.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:29 smithi159 ceph-mon[35348]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T22:06:29.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:29 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/200834988' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T22:06:29.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:29 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] up:boot 2024-09-13T22:06:29.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:29 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 2 up:standby 2024-09-13T22:06:29.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:29 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:06:29.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:29 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:29.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:29 smithi089 ceph-mon[27921]: Deploying daemon mds.cephfs.smithi159.rowsot on smithi159 2024-09-13T22:06:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:29 smithi089 ceph-mon[27921]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-13T22:06:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:29 smithi089 ceph-mon[27921]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T22:06:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:29 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/200834988' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T22:06:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:29 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] up:boot 2024-09-13T22:06:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:29 smithi089 ceph-mon[27921]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 2 up:standby 2024-09-13T22:06:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:06:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:29 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 -- 172.21.15.89:0/3250933610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 msgr2=0x7f7844100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 --2- 172.21.15.89:0/3250933610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 0x7f7844100120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7830009880 tx=0x7f783002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 -- 172.21.15.89:0/3250933610 shutdown_connections 2024-09-13T22:06:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 --2- 172.21.15.89:0/3250933610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 0x7f7844100120 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 --2- 172.21.15.89:0/3250933610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78440feaa0 0x7f78440feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 -- 172.21.15.89:0/3250933610 >> 172.21.15.89:0/3250933610 conn(0x7f78440fa250 msgr2=0x7f78440fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 -- 172.21.15.89:0/3250933610 shutdown_connections 2024-09-13T22:06:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 -- 172.21.15.89:0/3250933610 wait complete. 2024-09-13T22:06:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 Processor -- start 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 -- start start 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78440feaa0 0x7f7844068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 0x7f784419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784419a8f0 con 0x7f78440ffca0 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.006+0000 7f784ad4d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784419aa60 con 0x7f78440feaa0 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7843fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 0x7f784419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7843fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 0x7f784419a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41862/0 (socket says 172.21.15.89:41862) 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7843fff640 1 -- 172.21.15.89:0/2711540147 learned_addr learned my addr 172.21.15.89:0/2711540147 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7848ae9640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78440feaa0 0x7f7844068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7843fff640 1 -- 172.21.15.89:0/2711540147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78440feaa0 msgr2=0x7f7844068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7843fff640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78440feaa0 0x7f7844068f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7843fff640 1 -- 172.21.15.89:0/2711540147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7830009560 con 0x7f78440ffca0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7843fff640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 0x7f784419a3b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7830004650 tx=0x7f78300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7841ffb640 1 -- 172.21.15.89:0/2711540147 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7830004aa0 con 0x7f78440ffca0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7841ffb640 1 -- 172.21.15.89:0/2711540147 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7830005d50 con 0x7f78440ffca0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784419ace0 con 0x7f78440ffca0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f7841ffb640 1 -- 172.21.15.89:0/2711540147 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78300039e0 con 0x7f78440ffca0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.007+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784419b250 con 0x7f78440ffca0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.008+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784418e640 con 0x7f78440ffca0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.009+0000 7f7841ffb640 1 -- 172.21.15.89:0/2711540147 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7830031c00 con 0x7f78440ffca0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.009+0000 7f7841ffb640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f783406cc50 0x7f783406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.009+0000 7f7848ae9640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f783406cc50 0x7f783406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.010+0000 7f7841ffb640 1 -- 172.21.15.89:0/2711540147 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f78300ad340 con 0x7f78440ffca0 2024-09-13T22:06:31.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.010+0000 7f7848ae9640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f783406cc50 0x7f783406f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78440ffb00 tx=0x7f7838005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:31.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.014+0000 7f7841ffb640 1 -- 172.21.15.89:0/2711540147 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7830077730 con 0x7f78440ffca0 2024-09-13T22:06:31.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.255+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f78441076b0 con 0x7f78440ffca0 2024-09-13T22:06:31.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.255+0000 7f7841ffb640 1 -- 172.21.15.89:0/2711540147 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 10 v10) v1 ==== 76+0+1791 (secure 0 0 0) 0x7f783007ad50 con 0x7f78440ffca0 2024-09-13T22:06:31.257 INFO:teuthology.orchestra.run.smithi089.stdout:e10 2024-09-13T22:06:31.257 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:06:31.257 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:06:31.257 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:06:31.257 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:06:31.257 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 9 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:28.517410+0000 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:06:31.258 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 0 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14484} 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:06:31.259 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{0:14484} state up:active seq 2 addr [v2:172.21.15.89:6826/216662831,v1:172.21.15.89:6827/216662831] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:06:31.260 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:06:31.260 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:06:31.260 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:06:31.260 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:06:31.260 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:06:31.260 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{-1:24247} state up:standby seq 1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:06:31.260 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:06:31.261 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 10 2024-09-13T22:06:31.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.257+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f783406cc50 msgr2=0x7f783406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:31.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.257+0000 7f784ad4d640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f783406cc50 0x7f783406f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78440ffb00 tx=0x7f7838005f90 comp rx=0 tx=0).stop 2024-09-13T22:06:31.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.257+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 msgr2=0x7f784419a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:31.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.257+0000 7f784ad4d640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 0x7f784419a3b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7830004650 tx=0x7f78300055a0 comp rx=0 tx=0).stop 2024-09-13T22:06:31.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.257+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 shutdown_connections 2024-09-13T22:06:31.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.257+0000 7f784ad4d640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f783406cc50 0x7f783406f110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:31.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.257+0000 7f784ad4d640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440ffca0 0x7f784419a3b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:31.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.257+0000 7f784ad4d640 1 --2- 172.21.15.89:0/2711540147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78440feaa0 0x7f7844068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:31.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.257+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 >> 172.21.15.89:0/2711540147 conn(0x7f78440fa250 msgr2=0x7f7844103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:31.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.258+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 shutdown_connections 2024-09-13T22:06:31.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:31.258+0000 7f784ad4d640 1 -- 172.21.15.89:0/2711540147 wait complete. 2024-09-13T22:06:31.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-13T22:06:31.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:06:31.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:boot 2024-09-13T22:06:31.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:06:31.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:06:31.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:31 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2711540147' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:06:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-13T22:06:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:06:31.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:boot 2024-09-13T22:06:31.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:06:31.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:06:31.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:31 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2711540147' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:06:32.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T22:06:32.683 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:32.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:32 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:standby 2024-09-13T22:06:32.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:32 smithi089 ceph-mon[27921]: Dropping low affinity active daemon mds.cephfs.smithi089.euhfjz in favor of higher affinity standby. 2024-09-13T22:06:32.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:32 smithi089 ceph-mon[27921]: Replacing daemon mds.cephfs.smithi089.euhfjz as rank 0 with standby daemon mds.cephfs.smithi159.hqlvpx 2024-09-13T22:06:32.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:32 smithi089 ceph-mon[27921]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T22:06:32.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:32 smithi089 ceph-mon[27921]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:06:32.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:32 smithi089 ceph-mon[27921]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T22:06:32.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:32 smithi089 ceph-mon[27921]: fsmap cephfs:1/1 {0=cephfs.smithi159.hqlvpx=up:replay} 2 up:standby 2024-09-13T22:06:32.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:32 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:standby 2024-09-13T22:06:32.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:32 smithi159 ceph-mon[35348]: Dropping low affinity active daemon mds.cephfs.smithi089.euhfjz in favor of higher affinity standby. 2024-09-13T22:06:32.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:32 smithi159 ceph-mon[35348]: Replacing daemon mds.cephfs.smithi089.euhfjz as rank 0 with standby daemon mds.cephfs.smithi159.hqlvpx 2024-09-13T22:06:32.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:32 smithi159 ceph-mon[35348]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T22:06:32.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:32 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:06:32.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:32 smithi159 ceph-mon[35348]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T22:06:32.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:32 smithi159 ceph-mon[35348]: fsmap cephfs:1/1 {0=cephfs.smithi159.hqlvpx=up:replay} 2 up:standby 2024-09-13T22:06:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:33 smithi089 ceph-mon[27921]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-13T22:06:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:33 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:reconnect 2024-09-13T22:06:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:33 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] up:boot 2024-09-13T22:06:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:33 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] up:standby 2024-09-13T22:06:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:33 smithi089 ceph-mon[27921]: fsmap cephfs:1/1 {0=cephfs.smithi159.hqlvpx=up:reconnect} 3 up:standby 2024-09-13T22:06:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:33 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:06:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:33 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:33 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:34.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:33 smithi159 ceph-mon[35348]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-13T22:06:34.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:33 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:reconnect 2024-09-13T22:06:34.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:33 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] up:boot 2024-09-13T22:06:34.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:33 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] up:standby 2024-09-13T22:06:34.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:33 smithi159 ceph-mon[35348]: fsmap cephfs:1/1 {0=cephfs.smithi159.hqlvpx=up:reconnect} 3 up:standby 2024-09-13T22:06:34.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:33 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:06:34.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:33 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:34.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:33 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:34.973 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:34 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:rejoin 2024-09-13T22:06:34.973 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:34 smithi089 ceph-mon[27921]: fsmap cephfs:1/1 {0=cephfs.smithi159.hqlvpx=up:rejoin} 3 up:standby 2024-09-13T22:06:34.973 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:34 smithi089 ceph-mon[27921]: daemon mds.cephfs.smithi159.hqlvpx is now active in filesystem cephfs as rank 0 2024-09-13T22:06:34.973 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:35.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:34 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:rejoin 2024-09-13T22:06:35.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:34 smithi159 ceph-mon[35348]: fsmap cephfs:1/1 {0=cephfs.smithi159.hqlvpx=up:rejoin} 3 up:standby 2024-09-13T22:06:35.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:34 smithi159 ceph-mon[35348]: daemon mds.cephfs.smithi159.hqlvpx is now active in filesystem cephfs as rank 0 2024-09-13T22:06:35.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:34 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:35.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:35 smithi089 ceph-mon[27921]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-13T22:06:35.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:35 smithi089 ceph-mon[27921]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T22:06:35.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:35 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:active 2024-09-13T22:06:35.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:35 smithi089 ceph-mon[27921]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:standby 2024-09-13T22:06:35.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:35 smithi089 ceph-mon[27921]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:06:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:35 smithi159 ceph-mon[35348]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-13T22:06:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:35 smithi159 ceph-mon[35348]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T22:06:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:35 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] up:active 2024-09-13T22:06:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:35 smithi159 ceph-mon[35348]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:standby 2024-09-13T22:06:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:35 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:06:36.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.107+0000 7f14eee92640 1 -- 172.21.15.89:0/1929691813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e8103010 msgr2=0x7f14e8105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:36.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.107+0000 7f14eee92640 1 --2- 172.21.15.89:0/1929691813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e8103010 0x7f14e8105400 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009880 tx=0x7f14d402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:36.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.107+0000 7f14eee92640 1 -- 172.21.15.89:0/1929691813 shutdown_connections 2024-09-13T22:06:36.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.107+0000 7f14eee92640 1 --2- 172.21.15.89:0/1929691813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e8103010 0x7f14e8105400 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:36.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.107+0000 7f14eee92640 1 --2- 172.21.15.89:0/1929691813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14e81006e0 0x7f14e8102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:36.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.107+0000 7f14eee92640 1 -- 172.21.15.89:0/1929691813 >> 172.21.15.89:0/1929691813 conn(0x7f14e80fa280 msgr2=0x7f14e80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:36.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.107+0000 7f14eee92640 1 -- 172.21.15.89:0/1929691813 shutdown_connections 2024-09-13T22:06:36.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.107+0000 7f14eee92640 1 -- 172.21.15.89:0/1929691813 wait complete. 2024-09-13T22:06:36.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14eee92640 1 Processor -- start 2024-09-13T22:06:36.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14eee92640 1 -- start start 2024-09-13T22:06:36.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14eee92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e81006e0 0x7f14e81956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:36.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14eee92640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14e8103010 0x7f14e8195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:36.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14eee92640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e81961c0 con 0x7f14e81006e0 2024-09-13T22:06:36.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14eee92640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8196330 con 0x7f14e8103010 2024-09-13T22:06:36.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14ecc2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e81006e0 0x7f14e81956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:36.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14ecc2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e81006e0 0x7f14e81956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59616/0 (socket says 172.21.15.89:59616) 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14ecc2e640 1 -- 172.21.15.89:0/1690765984 learned_addr learned my addr 172.21.15.89:0/1690765984 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14e7fff640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14e8103010 0x7f14e8195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14ecc2e640 1 -- 172.21.15.89:0/1690765984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14e8103010 msgr2=0x7f14e8195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14ecc2e640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14e8103010 0x7f14e8195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.108+0000 7f14ecc2e640 1 -- 172.21.15.89:0/1690765984 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d4009560 con 0x7f14e81006e0 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.109+0000 7f14ecc2e640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e81006e0 0x7f14e81956b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00d900 tx=0x7f14dc00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.109+0000 7f14e5ffb640 1 -- 172.21.15.89:0/1690765984 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14dc009c00 con 0x7f14e81006e0 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.109+0000 7f14e5ffb640 1 -- 172.21.15.89:0/1690765984 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14dc00b660 con 0x7f14e81006e0 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.109+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e819ad80 con 0x7f14e81006e0 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.109+0000 7f14e5ffb640 1 -- 172.21.15.89:0/1690765984 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14dc00f680 con 0x7f14e81006e0 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.109+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e819b240 con 0x7f14e81006e0 2024-09-13T22:06:36.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.110+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e8108770 con 0x7f14e81006e0 2024-09-13T22:06:36.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.110+0000 7f14e5ffb640 1 -- 172.21.15.89:0/1690765984 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f14dc010ab0 con 0x7f14e81006e0 2024-09-13T22:06:36.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.111+0000 7f14e5ffb640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f14d806cc60 0x7f14d806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:36.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.111+0000 7f14e5ffb640 1 -- 172.21.15.89:0/1690765984 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f14dc08bf20 con 0x7f14e81006e0 2024-09-13T22:06:36.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.111+0000 7f14e7fff640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f14d806cc60 0x7f14d806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:36.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.111+0000 7f14e7fff640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f14d806cc60 0x7f14d806f120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14d4006010 tx=0x7f14d40314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.115+0000 7f14e5ffb640 1 -- 172.21.15.89:0/1690765984 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f14dc0bfe20 con 0x7f14e81006e0 2024-09-13T22:06:36.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.313+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14e8108970 con 0x7f14e81006e0 2024-09-13T22:06:36.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.314+0000 7f14e5ffb640 1 -- 172.21.15.89:0/1690765984 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4825 (secure 0 0 0) 0x7f14dc059e50 con 0x7f14e81006e0 2024-09-13T22:06:36.315 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:06:36.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f14d806cc60 msgr2=0x7f14d806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f14d806cc60 0x7f14d806f120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14d4006010 tx=0x7f14d40314e0 comp rx=0 tx=0).stop 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e81006e0 msgr2=0x7f14e81956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e81006e0 0x7f14e81956b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00d900 tx=0x7f14dc00ddc0 comp rx=0 tx=0).stop 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 shutdown_connections 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f14d806cc60 0x7f14d806f120 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14e8103010 0x7f14e8195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 --2- 172.21.15.89:0/1690765984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e81006e0 0x7f14e81956b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 >> 172.21.15.89:0/1690765984 conn(0x7f14e80fa280 msgr2=0x7f14e80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 shutdown_connections 2024-09-13T22:06:36.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:36.316+0000 7f14eee92640 1 -- 172.21.15.89:0/1690765984 wait complete. 2024-09-13T22:06:36.326 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:06:36.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:36 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1690765984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:06:36.910 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T22:06:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:36 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/1690765984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:06:37.471 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:37.899 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:37 smithi089 ceph-mon[27921]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 307 B/s wr, 3 op/s 2024-09-13T22:06:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:37 smithi159 ceph-mon[35348]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 307 B/s wr, 3 op/s 2024-09-13T22:06:38.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:38 smithi089 ceph-mon[27921]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T22:06:38.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:38 smithi159 ceph-mon[35348]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T22:06:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 -- 172.21.15.89:0/2084269183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 msgr2=0x7f1390100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 --2- 172.21.15.89:0/2084269183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 0x7f1390100100 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1384009880 tx=0x7f138402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 -- 172.21.15.89:0/2084269183 shutdown_connections 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 --2- 172.21.15.89:0/2084269183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 0x7f1390100100 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 --2- 172.21.15.89:0/2084269183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13900fea80 0x7f13900fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 -- 172.21.15.89:0/2084269183 >> 172.21.15.89:0/2084269183 conn(0x7f13900fa230 msgr2=0x7f13900fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 -- 172.21.15.89:0/2084269183 shutdown_connections 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 -- 172.21.15.89:0/2084269183 wait complete. 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 Processor -- start 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.002+0000 7f1395c36640 1 -- start start 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f1395c36640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13900fea80 0x7f1390195740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f1395c36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 0x7f1390195c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f1395c36640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1390196250 con 0x7f13900ffc80 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f1395c36640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13901963c0 con 0x7f13900fea80 2024-09-13T22:06:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 0x7f1390195c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 0x7f1390195c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59640/0 (socket says 172.21.15.89:59640) 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138effd640 1 -- 172.21.15.89:0/2208175282 learned_addr learned my addr 172.21.15.89:0/2208175282 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138f7fe640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13900fea80 0x7f1390195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138effd640 1 -- 172.21.15.89:0/2208175282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13900fea80 msgr2=0x7f1390195740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138effd640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13900fea80 0x7f1390195740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138effd640 1 -- 172.21.15.89:0/2208175282 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1384009560 con 0x7f13900ffc80 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138effd640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 0x7f1390195c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1384005640 tx=0x7f1384005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138cff9640 1 -- 172.21.15.89:0/2208175282 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1384004ba0 con 0x7f13900ffc80 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138cff9640 1 -- 172.21.15.89:0/2208175282 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1384004d00 con 0x7f13900ffc80 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139019ae00 con 0x7f13900ffc80 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f138cff9640 1 -- 172.21.15.89:0/2208175282 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1384003c30 con 0x7f13900ffc80 2024-09-13T22:06:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.003+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139019b340 con 0x7f13900ffc80 2024-09-13T22:06:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.005+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13900fef00 con 0x7f13900ffc80 2024-09-13T22:06:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.005+0000 7f138cff9640 1 -- 172.21.15.89:0/2208175282 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1384031640 con 0x7f13900ffc80 2024-09-13T22:06:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.005+0000 7f138cff9640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f137806cc50 0x7f137806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.006+0000 7f138cff9640 1 -- 172.21.15.89:0/2208175282 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f13840ad4a0 con 0x7f13900ffc80 2024-09-13T22:06:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.006+0000 7f138f7fe640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f137806cc50 0x7f137806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.006+0000 7f138f7fe640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f137806cc50 0x7f137806f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f13900ffae0 tx=0x7f138000d040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.010+0000 7f138cff9640 1 -- 172.21.15.89:0/2208175282 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f13840778c0 con 0x7f13900ffc80 2024-09-13T22:06:39.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.270+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f1390107710 con 0x7f13900ffc80 2024-09-13T22:06:39.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.271+0000 7f138cff9640 1 -- 172.21.15.89:0/2208175282 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+97 (secure 0 0 0) 0x7f138407aee0 con 0x7f13900ffc80 2024-09-13T22:06:39.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f137806cc50 msgr2=0x7f137806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:39.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f137806cc50 0x7f137806f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f13900ffae0 tx=0x7f138000d040 comp rx=0 tx=0).stop 2024-09-13T22:06:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 msgr2=0x7f1390195c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 0x7f1390195c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1384005640 tx=0x7f1384005670 comp rx=0 tx=0).stop 2024-09-13T22:06:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 shutdown_connections 2024-09-13T22:06:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f137806cc50 0x7f137806f110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13900ffc80 0x7f1390195c80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 --2- 172.21.15.89:0/2208175282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13900fea80 0x7f1390195740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 >> 172.21.15.89:0/2208175282 conn(0x7f13900fa230 msgr2=0x7f1390068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 shutdown_connections 2024-09-13T22:06:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:39.273+0000 7f1395c36640 1 -- 172.21.15.89:0/2208175282 wait complete. 2024-09-13T22:06:39.284 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:06:39.943 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T22:06:39.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T22:06:40.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:40.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:40.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:40.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:06:40.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:40.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:40.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:06:40.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:40 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:06:40.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:40 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2208175282' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T22:06:40.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:40.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:40.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:40.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:06:40.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:40.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:40.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:06:40.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:40 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:06:40.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:40 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2208175282' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T22:06:40.828 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:41.343 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:41 smithi089 ceph-mon[27921]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T22:06:41.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:41 smithi159 ceph-mon[35348]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T22:06:42.416 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:42 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:42.416 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:42 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:42.495 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:42 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:42.495 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:42 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.495+0000 7f7105003640 1 -- 172.21.15.89:0/1613150508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 msgr2=0x7f7100104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.495+0000 7f7105003640 1 --2- 172.21.15.89:0/1613150508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 0x7f7100104dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009880 tx=0x7f70f002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.495+0000 7f7105003640 1 -- 172.21.15.89:0/1613150508 shutdown_connections 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.495+0000 7f7105003640 1 --2- 172.21.15.89:0/1613150508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71000fe9f0 0x7f71000fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.495+0000 7f7105003640 1 --2- 172.21.15.89:0/1613150508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 0x7f7100104dd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.495+0000 7f7105003640 1 -- 172.21.15.89:0/1613150508 >> 172.21.15.89:0/1613150508 conn(0x7f71000758a0 msgr2=0x7f71000fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.495+0000 7f7105003640 1 -- 172.21.15.89:0/1613150508 shutdown_connections 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.495+0000 7f7105003640 1 -- 172.21.15.89:0/1613150508 wait complete. 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f7105003640 1 Processor -- start 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f7105003640 1 -- start start 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f7105003640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71000fe9f0 0x7f710019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:42.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f7105003640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 0x7f710019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f7105003640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710019c2d0 con 0x7f71001049f0 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f7105003640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71001958f0 con 0x7f71000fe9f0 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 0x7f710019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 0x7f710019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59658/0 (socket says 172.21.15.89:59658) 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f70fe59c640 1 -- 172.21.15.89:0/170951645 learned_addr learned my addr 172.21.15.89:0/170951645 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f70fed9d640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71000fe9f0 0x7f710019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f70fe59c640 1 -- 172.21.15.89:0/170951645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71000fe9f0 msgr2=0x7f710019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f70fe59c640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71000fe9f0 0x7f710019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f70fe59c640 1 -- 172.21.15.89:0/170951645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0009560 con 0x7f71001049f0 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.496+0000 7f70fed9d640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71000fe9f0 0x7f710019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.497+0000 7f70fe59c640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 0x7f710019bd40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c8a0 tx=0x7f70f400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.497+0000 7f70e7fff640 1 -- 172.21.15.89:0/170951645 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70f4007b80 con 0x7f71001049f0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.497+0000 7f70e7fff640 1 -- 172.21.15.89:0/170951645 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70f4007ce0 con 0x7f71001049f0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.497+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7100195bd0 con 0x7f71001049f0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.497+0000 7f70e7fff640 1 -- 172.21.15.89:0/170951645 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70f4018810 con 0x7f71001049f0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.497+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7100196120 con 0x7f71001049f0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.498+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7100100130 con 0x7f71001049f0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.498+0000 7f70e7fff640 1 -- 172.21.15.89:0/170951645 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f70f4018a80 con 0x7f71001049f0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.499+0000 7f70e7fff640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f70e806cc50 0x7f70e806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.499+0000 7f70e7fff640 1 -- 172.21.15.89:0/170951645 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f70f408c500 con 0x7f71001049f0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.499+0000 7f70fed9d640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f70e806cc50 0x7f70e806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.499+0000 7f70fed9d640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f70e806cc50 0x7f70e806f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70f0000c00 tx=0x7f70f0005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:42.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.503+0000 7f70e7fff640 1 -- 172.21.15.89:0/170951645 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f70f4056870 con 0x7f71001049f0 2024-09-13T22:06:42.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.719+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7100104dd0 con 0x7f71001049f0 2024-09-13T22:06:42.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.719+0000 7f70e7fff640 1 -- 172.21.15.89:0/170951645 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4825 (secure 0 0 0) 0x7f70f4059e90 con 0x7f71001049f0 2024-09-13T22:06:42.721 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:06:42.721 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14500,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6829/4253852693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":4253852693},{"type":"v1","addr":"172.21.15.89:6829","nonce":4253852693}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":14512,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/684466941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":684466941},{"type":"v1","addr":"172.21.15.89:6827","nonce":684466941}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:06:34.551891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi159.hqlvpx","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6825/782752998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":782752998},{"type":"v1","addr":"172.21.15.159:6825","nonce":782752998}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T22:06:42.721 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:06:42.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f70e806cc50 msgr2=0x7f70e806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f70e806cc50 0x7f70e806f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70f0000c00 tx=0x7f70f0005a20 comp rx=0 tx=0).stop 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 msgr2=0x7f710019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 0x7f710019bd40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c8a0 tx=0x7f70f400cd60 comp rx=0 tx=0).stop 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 shutdown_connections 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f70e806cc50 0x7f70e806f110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71001049f0 0x7f710019bd40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 --2- 172.21.15.89:0/170951645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71000fe9f0 0x7f710019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 >> 172.21.15.89:0/170951645 conn(0x7f71000758a0 msgr2=0x7f71000fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 shutdown_connections 2024-09-13T22:06:42.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:42.721+0000 7f7105003640 1 -- 172.21.15.89:0/170951645 wait complete. 2024-09-13T22:06:43.428 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:43 smithi089 ceph-mon[27921]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T22:06:43.429 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:43 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/170951645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:06:43.430 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-09-13T22:06:43.430 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T22:06:43.458 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T22:06:43.458 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-13T22:06:43.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:43.458 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-13T22:06:43.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:43.477 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-09-13T22:06:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:43 smithi159 ceph-mon[35348]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T22:06:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:43 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/170951645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:06:43.547 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2024-09-13T22:06:43.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:06:43.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:43.548 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-09-13T22:06:43.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:43.570 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2024-09-13T22:06:43.645 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2024-09-13T22:06:43.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:06:43.647 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T22:06:43.647 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T22:06:43.647 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T22:06:43.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T22:06:43.937 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:45.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:45 smithi159 ceph-mon[35348]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T22:06:45.533 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:45 smithi089 ceph-mon[27921]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T22:06:47.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 -- 172.21.15.89:0/1438923855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 msgr2=0x7f7c740fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:47.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 --2- 172.21.15.89:0/1438923855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 0x7f7c740fee80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009880 tx=0x7f7c5c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:47.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 -- 172.21.15.89:0/1438923855 shutdown_connections 2024-09-13T22:06:47.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 --2- 172.21.15.89:0/1438923855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 0x7f7c740fee80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 --2- 172.21.15.89:0/1438923855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c74104a20 0x7f7c74104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 -- 172.21.15.89:0/1438923855 >> 172.21.15.89:0/1438923855 conn(0x7f7c740fa700 msgr2=0x7f7c740fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 -- 172.21.15.89:0/1438923855 shutdown_connections 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 -- 172.21.15.89:0/1438923855 wait complete. 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 Processor -- start 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.330+0000 7f7c7a667640 1 -- start start 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c7a667640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 0x7f7c740fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c7a667640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c74104a20 0x7f7c740fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c7a667640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740fcf80 con 0x7f7c740fea20 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c7a667640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740fba30 con 0x7f7c74104a20 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c73fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 0x7f7c740fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c73fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 0x7f7c740fafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36070/0 (socket says 172.21.15.89:36070) 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c73fff640 1 -- 172.21.15.89:0/3302319481 learned_addr learned my addr 172.21.15.89:0/3302319481 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c737fe640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c74104a20 0x7f7c740fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c73fff640 1 -- 172.21.15.89:0/3302319481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c74104a20 msgr2=0x7f7c740fb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c73fff640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c74104a20 0x7f7c740fb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c73fff640 1 -- 172.21.15.89:0/3302319481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c009560 con 0x7f7c740fea20 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.331+0000 7f7c73fff640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 0x7f7c740fafb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c8a0 tx=0x7f7c6400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.332+0000 7f7c717fa640 1 -- 172.21.15.89:0/3302319481 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c64007b80 con 0x7f7c740fea20 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.332+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c740fbd10 con 0x7f7c740fea20 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.332+0000 7f7c717fa640 1 -- 172.21.15.89:0/3302319481 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c64007ce0 con 0x7f7c740fea20 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.332+0000 7f7c717fa640 1 -- 172.21.15.89:0/3302319481 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c64018810 con 0x7f7c740fea20 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.332+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c741a1ee0 con 0x7f7c740fea20 2024-09-13T22:06:47.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.333+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c74100160 con 0x7f7c740fea20 2024-09-13T22:06:47.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.333+0000 7f7c717fa640 1 -- 172.21.15.89:0/3302319481 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7c64018a80 con 0x7f7c740fea20 2024-09-13T22:06:47.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.334+0000 7f7c717fa640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c6006cc50 0x7f7c6006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:47.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.334+0000 7f7c717fa640 1 -- 172.21.15.89:0/3302319481 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7c6408c500 con 0x7f7c740fea20 2024-09-13T22:06:47.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.334+0000 7f7c737fe640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c6006cc50 0x7f7c6006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:47.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.334+0000 7f7c737fe640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c6006cc50 0x7f7c6006f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c000c00 tx=0x7f7c5c005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:47.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.338+0000 7f7c717fa640 1 -- 172.21.15.89:0/3302319481 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c64056870 con 0x7f7c740fea20 2024-09-13T22:06:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:47 smithi159 ceph-mon[35348]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T22:06:47.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:47 smithi089 ceph-mon[27921]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T22:06:47.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.554+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c740fee80 con 0x7f7c740fea20 2024-09-13T22:06:47.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.555+0000 7f7c717fa640 1 -- 172.21.15.89:0/3302319481 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f7c64059e90 con 0x7f7c740fea20 2024-09-13T22:06:47.557 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T22:06:47.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c6006cc50 msgr2=0x7f7c6006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:47.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c6006cc50 0x7f7c6006f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c000c00 tx=0x7f7c5c005a20 comp rx=0 tx=0).stop 2024-09-13T22:06:47.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 msgr2=0x7f7c740fafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:47.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 0x7f7c740fafb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c8a0 tx=0x7f7c6400cd60 comp rx=0 tx=0).stop 2024-09-13T22:06:47.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 shutdown_connections 2024-09-13T22:06:47.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f7c6006cc50 0x7f7c6006f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:47.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c74104a20 0x7f7c740fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:47.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 --2- 172.21.15.89:0/3302319481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c740fea20 0x7f7c740fafb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:47.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 >> 172.21.15.89:0/3302319481 conn(0x7f7c740fa700 msgr2=0x7f7c74068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:47.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 shutdown_connections 2024-09-13T22:06:47.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:47.557+0000 7f7c7a667640 1 -- 172.21.15.89:0/3302319481 wait complete. 2024-09-13T22:06:48.135 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T22:06:48.135 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T22:06:48.135 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2024-09-13T22:06:48.135 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T22:06:48.135 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T22:06:48.135 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T22:06:48.135 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T22:06:48.135 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T22:06:48.135 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T22:06:48.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:48.136 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2024-09-13T22:06:48.152 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T22:06:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T22:06:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T22:06:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:06:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-09-13T22:06:48.152 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42311sec preferred_lft 42311sec 2024-09-13T22:06:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2024-09-13T22:06:48.154 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:06:48.154 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T22:06:48.154 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:48.154 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T22:06:48.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2024-09-13T22:06:48.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2024-09-13T22:06:48.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2024-09-13T22:06:48.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T22:06:48.155 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T22:06:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:48.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:48.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:48.359 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T22:06:48.384 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-09-13T22:06:48.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:48.386 DEBUG:teuthology.orchestra.run.smithi089:> route 2024-09-13T22:06:48.463 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2024-09-13T22:06:48.464 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T22:06:48.464 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T22:06:48.464 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T22:06:48.464 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T22:06:48.464 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:48.464 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T22:06:48.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T22:06:48.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T22:06:48.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T22:06:48.465 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T22:06:48.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:48.671 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:48 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:48.671 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:48 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:48.671 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:48 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:48.671 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:48 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:06:48.671 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:48 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:48.671 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:48 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3302319481' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T22:06:48.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:48.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:48.778 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-13T22:06:48.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:48.794 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2024-09-13T22:06:48.850 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:48.850 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T22:06:48.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T22:06:48.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T22:06:48.850 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T22:06:48.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:48.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:48.966 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T22:06:48.967 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:48.967 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T22:06:48.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T22:06:48.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T22:06:48.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T22:06:48.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T22:06:48.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T22:06:48.967 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T22:06:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:48 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:48 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:48 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:06:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:48 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:06:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:48 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:06:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:48 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3302319481' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T22:06:49.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:49.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:49.093 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:49.093 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T22:06:49.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2024-09-13T22:06:49.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T22:06:49.094 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T22:06:49.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:49.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:49.169 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T22:06:49.170 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T22:06:49.185 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T22:06:49.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T22:06:49.185 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T22:06:49.241 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T22:06:49.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:49.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T22:06:49.331 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T22:06:49.331 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T22:06:49.331 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2024-09-13T22:06:49.459 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T22:06:49.460 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T22:06:49.460 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2024-09-13T22:06:49.460 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.159:3300" 2024-09-13T22:06:49.460 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T22:06:49.469 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T22:06:49.470 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T22:06:49.470 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2024-09-13T22:06:49.470 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.159:3300" 2024-09-13T22:06:49.470 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T22:06:49.470 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:6789,172.21.15.159:6789" 2024-09-13T22:06:49.470 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.89:6789,172.21.15.159:6789:/ 2024-09-13T22:06:49.470 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=39489060-721b-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T22:06:49.471 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T22:06:49.471 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2024-09-13T22:06:49.471 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T22:06:49.471 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T22:06:49.471 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T22:06:49.473 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T22:06:49.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:49.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T22:06:49.498 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T22:06:49.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T22:06:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:49.602 INFO:teuthology.orchestra.run.smithi089.stdout:client14530 2024-09-13T22:06:49.602 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:06:49.602 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T22:06:49.619 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T22:06:49.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T22:06:49.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:49.721 INFO:teuthology.orchestra.run.smithi089.stdout:client14530 2024-09-13T22:06:49.722 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T22:06:49.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:49 smithi089 ceph-mon[27921]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T22:06:49.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T22:06:49.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:49.783 INFO:teuthology.orchestra.run.smithi089.stdout:client14530 2024-09-13T22:06:49.783 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/39489060-721b-11ef-bceb-c7b262605968.client14530/status') 2024-09-13T22:06:49.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:49.886 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.14530 (3)192.168.0.1:0/2270496495 2024-09-13T22:06:49.886 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2024-09-13T22:06:49.887 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2024-09-13T22:06:49.887 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2024-09-13T22:06:49.887 INFO:teuthology.orchestra.run.smithi089.stderr:70 bytes copied, 2.2336e-05 s, 3.1 MB/s 2024-09-13T22:06:49.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:49.894 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-13T22:06:49.894 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T22:06:49.894 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T22:06:49.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T22:06:50.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:49 smithi159 ceph-mon[35348]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T22:06:50.092 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.714+0000 7fc591b32640 1 -- 172.21.15.89:0/1670101649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 msgr2=0x7fc58c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.714+0000 7fc591b32640 1 --2- 172.21.15.89:0/1670101649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 0x7fc58c104dd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009880 tx=0x7fc57c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.714+0000 7fc591b32640 1 -- 172.21.15.89:0/1670101649 shutdown_connections 2024-09-13T22:06:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.714+0000 7fc591b32640 1 --2- 172.21.15.89:0/1670101649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc58c0fe9f0 0x7fc58c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.714+0000 7fc591b32640 1 --2- 172.21.15.89:0/1670101649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 0x7fc58c104dd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.714+0000 7fc591b32640 1 -- 172.21.15.89:0/1670101649 >> 172.21.15.89:0/1670101649 conn(0x7fc58c0758a0 msgr2=0x7fc58c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.714+0000 7fc591b32640 1 -- 172.21.15.89:0/1670101649 shutdown_connections 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.714+0000 7fc591b32640 1 -- 172.21.15.89:0/1670101649 wait complete. 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc591b32640 1 Processor -- start 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc591b32640 1 -- start start 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc591b32640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc58c0fe9f0 0x7fc58c196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc591b32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 0x7fc58c196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc591b32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c197490 con 0x7fc58c1049f0 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc591b32640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c197600 con 0x7fc58c0fe9f0 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc58affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 0x7fc58c196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc58affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 0x7fc58c196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36082/0 (socket says 172.21.15.89:36082) 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc58affd640 1 -- 172.21.15.89:0/696397443 learned_addr learned my addr 172.21.15.89:0/696397443 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc58b7fe640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc58c0fe9f0 0x7fc58c196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc58affd640 1 -- 172.21.15.89:0/696397443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc58c0fe9f0 msgr2=0x7fc58c196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc58affd640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc58c0fe9f0 0x7fc58c196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.715+0000 7fc58affd640 1 -- 172.21.15.89:0/696397443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c009560 con 0x7fc58c1049f0 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.716+0000 7fc58affd640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 0x7fc58c196ec0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc57400c8f0 tx=0x7fc57400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.716+0000 7fc588ff9640 1 -- 172.21.15.89:0/696397443 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc574007b80 con 0x7fc58c1049f0 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.716+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c19f9f0 con 0x7fc58c1049f0 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.716+0000 7fc588ff9640 1 -- 172.21.15.89:0/696397443 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5740054e0 con 0x7fc58c1049f0 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.716+0000 7fc588ff9640 1 -- 172.21.15.89:0/696397443 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc57400f450 con 0x7fc58c1049f0 2024-09-13T22:06:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.716+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c19fe60 con 0x7fc58c1049f0 2024-09-13T22:06:51.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.717+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c100130 con 0x7fc58c1049f0 2024-09-13T22:06:51.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.717+0000 7fc588ff9640 1 -- 172.21.15.89:0/696397443 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc574004f60 con 0x7fc58c1049f0 2024-09-13T22:06:51.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.718+0000 7fc588ff9640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc57806cc50 0x7fc57806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.718+0000 7fc588ff9640 1 -- 172.21.15.89:0/696397443 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc57408c110 con 0x7fc58c1049f0 2024-09-13T22:06:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.718+0000 7fc58b7fe640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc57806cc50 0x7fc57806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.718+0000 7fc58b7fe640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc57806cc50 0x7fc57806f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc57c000c00 tx=0x7fc57c005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.722+0000 7fc588ff9640 1 -- 172.21.15.89:0/696397443 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc574056480 con 0x7fc58c1049f0 2024-09-13T22:06:51.816 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:51 smithi089 ceph-mon[27921]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T22:06:51.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.921+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc58c106f90 con 0x7fc58c1049f0 2024-09-13T22:06:51.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.922+0000 7fc588ff9640 1 -- 172.21.15.89:0/696397443 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fc574059aa0 con 0x7fc58c1049f0 2024-09-13T22:06:51.923 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T22:06:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc57806cc50 msgr2=0x7fc57806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc57806cc50 0x7fc57806f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc57c000c00 tx=0x7fc57c005a20 comp rx=0 tx=0).stop 2024-09-13T22:06:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 msgr2=0x7fc58c196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 0x7fc58c196ec0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc57400c8f0 tx=0x7fc57400cdb0 comp rx=0 tx=0).stop 2024-09-13T22:06:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 shutdown_connections 2024-09-13T22:06:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc57806cc50 0x7fc57806f110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc58c1049f0 0x7fc58c196ec0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 --2- 172.21.15.89:0/696397443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc58c0fe9f0 0x7fc58c196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 >> 172.21.15.89:0/696397443 conn(0x7fc58c0758a0 msgr2=0x7fc58c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 shutdown_connections 2024-09-13T22:06:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:51.924+0000 7fc591b32640 1 -- 172.21.15.89:0/696397443 wait complete. 2024-09-13T22:06:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:51 smithi159 ceph-mon[35348]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T22:06:52.593 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T22:06:52.593 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T22:06:52.593 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2024-09-13T22:06:52.593 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T22:06:52.593 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T22:06:52.593 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T22:06:52.593 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T22:06:52.593 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T22:06:52.593 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T22:06:52.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:52.594 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2024-09-13T22:06:52.613 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T22:06:52.613 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T22:06:52.614 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T22:06:52.614 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:06:52.614 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-09-13T22:06:52.614 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:06:52.614 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:06:52.614 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:06:52.614 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2024-09-13T22:06:52.614 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42304sec preferred_lft 42304sec 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link noprefixroute 2024-09-13T22:06:52.615 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:06:52.615 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T22:06:52.616 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:52.616 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-13T22:06:52.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2024-09-13T22:06:52.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2024-09-13T22:06:52.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2024-09-13T22:06:52.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T22:06:52.616 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-13T22:06:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:52.811 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:52 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/696397443' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T22:06:52.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:52.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:52.842 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T22:06:52.867 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-09-13T22:06:52.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:52.869 DEBUG:teuthology.orchestra.run.smithi159:> route 2024-09-13T22:06:52.940 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2024-09-13T22:06:52.941 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T22:06:52.941 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T22:06:52.941 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T22:06:52.941 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T22:06:52.941 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:52.941 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-13T22:06:52.941 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T22:06:52.941 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T22:06:52.942 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T22:06:52.942 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-13T22:06:52.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:52 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/696397443' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T22:06:53.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:53.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:53.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:53.240 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-09-13T22:06:53.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:53.258 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2024-09-13T22:06:53.314 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:53.314 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-13T22:06:53.314 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T22:06:53.314 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T22:06:53.314 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-13T22:06:53.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:53.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:53.435 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T22:06:53.435 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:53.435 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-13T22:06:53.435 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T22:06:53.435 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T22:06:53.435 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T22:06:53.435 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T22:06:53.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T22:06:53.436 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-13T22:06:53.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:53.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:53.560 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:06:53.560 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-13T22:06:53.561 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2024-09-13T22:06:53.561 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T22:06:53.561 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-13T22:06:53.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:53.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:53.640 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T22:06:53.640 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T22:06:53.655 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T22:06:53.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T22:06:53.655 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T22:06:53.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:53 smithi159 ceph-mon[35348]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T22:06:53.697 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T22:06:53.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:53.698 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T22:06:53.798 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T22:06:53.798 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T22:06:53.798 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-09-13T22:06:53.929 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T22:06:53.929 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T22:06:53.929 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-09-13T22:06:53.929 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.159:3300" 2024-09-13T22:06:53.929 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T22:06:53.934 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T22:06:53.934 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T22:06:53.934 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-09-13T22:06:53.934 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.159:3300" 2024-09-13T22:06:53.934 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T22:06:53.934 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.89:6789,172.21.15.159:6789" 2024-09-13T22:06:53.934 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.89:6789,172.21.15.159:6789:/ 2024-09-13T22:06:53.934 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=39489060-721b-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T22:06:53.935 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T22:06:53.935 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2024-09-13T22:06:53.935 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T22:06:53.936 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T22:06:53.936 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T22:06:53.937 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T22:06:53.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:06:53.938 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T22:06:53.963 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T22:06:53.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:53 smithi089 ceph-mon[27921]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T22:06:54.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T22:06:54.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:54.060 INFO:teuthology.orchestra.run.smithi159.stdout:client24277 2024-09-13T22:06:54.061 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:06:54.061 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T22:06:54.078 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T22:06:54.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T22:06:54.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:54.174 INFO:teuthology.orchestra.run.smithi159.stdout:client24277 2024-09-13T22:06:54.174 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T22:06:54.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T22:06:54.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:54.229 INFO:teuthology.orchestra.run.smithi159.stdout:client24277 2024-09-13T22:06:54.229 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/39489060-721b-11ef-bceb-c7b262605968.client24277/status') 2024-09-13T22:06:54.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:06:54.287 INFO:teuthology.orchestra.run.smithi159.stdout:instance: client.24277 (3)192.168.0.1:0/234772953 2024-09-13T22:06:54.287 INFO:teuthology.orchestra.run.smithi159.stdout:blocklisted: false 2024-09-13T22:06:54.288 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records in 2024-09-13T22:06:54.288 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records out 2024-09-13T22:06:54.288 INFO:teuthology.orchestra.run.smithi159.stderr:69 bytes copied, 2.1951e-05 s, 3.1 MB/s 2024-09-13T22:06:54.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-13T22:06:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:06:54.295 INFO:teuthology.run_tasks:Running task print... 2024-09-13T22:06:54.307 INFO:teuthology.task.print:**** done client 2024-09-13T22:06:54.307 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T22:06:54.959 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T22:06:54.959 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T22:06:54.960 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T22:06:54.961 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:06:54.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T22:06:54.962 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T22:06:54.962 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T22:06:54.967 INFO:tasks.workunit:Pulling workunits from ref ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:06:54.968 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T22:06:54.968 INFO:tasks.workunit:timeout=3h 2024-09-13T22:06:54.968 INFO:tasks.workunit:cleanup=True 2024-09-13T22:06:54.968 DEBUG:teuthology.orchestra.run.smithi089:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T22:06:54.989 INFO:teuthology.orchestra.run.smithi089.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T22:06:54.989 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T22:06:54.989 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 87h/135d Inode: 1 Links: 2 2024-09-13T22:06:54.989 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:06:54.990 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T22:06:54.990 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T22:06:54.990 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 22:06:21.416382034 +0000 2024-09-13T22:06:54.990 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 22:06:49.495194346 +0000 2024-09-13T22:06:54.990 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 22:06:21.416382034 +0000 2024-09-13T22:06:54.990 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T22:06:54.990 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T22:06:54.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:06:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:06:55.028 DEBUG:teuthology.orchestra.run.smithi159:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T22:06:55.044 INFO:teuthology.orchestra.run.smithi159.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T22:06:55.044 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-13T22:06:55.044 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-13T22:06:55.045 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:06:55.045 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T22:06:55.045 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T22:06:55.045 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-13 22:06:55.022065995 +0000 2024-09-13T22:06:55.045 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-13 22:06:55.022065995 +0000 2024-09-13T22:06:55.045 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-13 22:06:21.416382034 +0000 2024-09-13T22:06:55.045 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T22:06:55.045 DEBUG:teuthology.orchestra.run.smithi159:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T22:06:55.114 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:06:55.115 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:06:55.131 INFO:tasks.workunit.client.0.smithi089.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T22:06:55.171 INFO:tasks.workunit.client.1.smithi159.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T22:06:55.189 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:55.947 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:55 smithi159 ceph-mon[35348]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T22:06:55.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:55 smithi089 ceph-mon[27921]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T22:06:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.849+0000 7fd122694640 1 -- 172.21.15.89:0/85330980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 msgr2=0x7fd11c0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.849+0000 7fd122694640 1 --2- 172.21.15.89:0/85330980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 0x7fd11c0fee80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009880 tx=0x7fd10c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.849+0000 7fd122694640 1 -- 172.21.15.89:0/85330980 shutdown_connections 2024-09-13T22:06:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.849+0000 7fd122694640 1 --2- 172.21.15.89:0/85330980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd11c0ffc80 0x7fd11c100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.849+0000 7fd122694640 1 --2- 172.21.15.89:0/85330980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 0x7fd11c0fee80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.849+0000 7fd122694640 1 -- 172.21.15.89:0/85330980 >> 172.21.15.89:0/85330980 conn(0x7fd11c0fa230 msgr2=0x7fd11c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.849+0000 7fd122694640 1 -- 172.21.15.89:0/85330980 shutdown_connections 2024-09-13T22:06:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.849+0000 7fd122694640 1 -- 172.21.15.89:0/85330980 wait complete. 2024-09-13T22:06:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.850+0000 7fd122694640 1 Processor -- start 2024-09-13T22:06:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.850+0000 7fd122694640 1 -- start start 2024-09-13T22:06:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.850+0000 7fd122694640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 0x7fd11c195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.850+0000 7fd122694640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd11c0ffc80 0x7fd11c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.850+0000 7fd122694640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c196140 con 0x7fd11c0fea80 2024-09-13T22:06:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.850+0000 7fd122694640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c1962b0 con 0x7fd11c0ffc80 2024-09-13T22:06:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.850+0000 7fd11bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 0x7fd11c195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.850+0000 7fd11bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 0x7fd11c195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56336/0 (socket says 172.21.15.89:56336) 2024-09-13T22:06:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.850+0000 7fd11bfff640 1 -- 172.21.15.89:0/4038370103 learned_addr learned my addr 172.21.15.89:0/4038370103 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.851+0000 7fd11bfff640 1 -- 172.21.15.89:0/4038370103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd11c0ffc80 msgr2=0x7fd11c195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.851+0000 7fd11bfff640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd11c0ffc80 0x7fd11c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.851+0000 7fd11bfff640 1 -- 172.21.15.89:0/4038370103 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c009560 con 0x7fd11c0fea80 2024-09-13T22:06:56.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.851+0000 7fd11bfff640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 0x7fd11c195630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0054f0 tx=0x7fd10c005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.851+0000 7fd1197fa640 1 -- 172.21.15.89:0/4038370103 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10c004aa0 con 0x7fd11c0fea80 2024-09-13T22:06:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.851+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11c19acf0 con 0x7fd11c0fea80 2024-09-13T22:06:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.851+0000 7fd1197fa640 1 -- 172.21.15.89:0/4038370103 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd10c004c00 con 0x7fd11c0fea80 2024-09-13T22:06:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.851+0000 7fd1197fa640 1 -- 172.21.15.89:0/4038370103 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10c003ac0 con 0x7fd11c0fea80 2024-09-13T22:06:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.851+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c19b260 con 0x7fd11c0fea80 2024-09-13T22:06:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.852+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11c107690 con 0x7fd11c0fea80 2024-09-13T22:06:56.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.853+0000 7fd1197fa640 1 -- 172.21.15.89:0/4038370103 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd10c003d80 con 0x7fd11c0fea80 2024-09-13T22:06:56.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.853+0000 7fd1197fa640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd10406cc50 0x7fd10406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:56.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.853+0000 7fd11b7fe640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd10406cc50 0x7fd10406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:56.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.853+0000 7fd1197fa640 1 -- 172.21.15.89:0/4038370103 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd10c0ad4e0 con 0x7fd11c0fea80 2024-09-13T22:06:56.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.854+0000 7fd11b7fe640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd10406cc50 0x7fd10406f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd110005fd0 tx=0x7fd110005850 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:56.857+0000 7fd1197fa640 1 -- 172.21.15.89:0/4038370103 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd10c077850 con 0x7fd11c0fea80 2024-09-13T22:06:57.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.020+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fd11c107820 con 0x7fd11c0fea80 2024-09-13T22:06:57.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.021+0000 7fd1197fa640 1 -- 172.21.15.89:0/4038370103 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v26)=0 v26) v1 ==== 155+0+0 (secure 0 0 0) 0x7fd10c07ae70 con 0x7fd11c0fea80 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.022+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd10406cc50 msgr2=0x7fd10406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.022+0000 7fd122694640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd10406cc50 0x7fd10406f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd110005fd0 tx=0x7fd110005850 comp rx=0 tx=0).stop 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.022+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 msgr2=0x7fd11c195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.022+0000 7fd122694640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 0x7fd11c195630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0054f0 tx=0x7fd10c005520 comp rx=0 tx=0).stop 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.023+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 shutdown_connections 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.023+0000 7fd122694640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd10406cc50 0x7fd10406f110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.023+0000 7fd122694640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd11c0ffc80 0x7fd11c195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.023+0000 7fd122694640 1 --2- 172.21.15.89:0/4038370103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd11c0fea80 0x7fd11c195630 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.023+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 >> 172.21.15.89:0/4038370103 conn(0x7fd11c0fa230 msgr2=0x7fd11c068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:57.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.023+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 shutdown_connections 2024-09-13T22:06:57.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:57.023+0000 7fd122694640 1 -- 172.21.15.89:0/4038370103 wait complete. 2024-09-13T22:06:57.616 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T22:06:57.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:57 smithi089 ceph-mon[27921]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T22:06:57.855 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:06:58.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:57 smithi159 ceph-mon[35348]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T22:06:58.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:06:58 smithi089 ceph-mon[27921]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-13T22:06:59.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:06:58 smithi159 ceph-mon[35348]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-13T22:06:59.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.372+0000 7f32a5b2f640 1 -- 172.21.15.89:0/1025682819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00feaf0 msgr2=0x7f32a00feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:59.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.372+0000 7f32a5b2f640 1 --2- 172.21.15.89:0/1025682819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00feaf0 0x7f32a00feef0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3290009880 tx=0x7f329002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:06:59.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.372+0000 7f32a5b2f640 1 -- 172.21.15.89:0/1025682819 shutdown_connections 2024-09-13T22:06:59.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.372+0000 7f32a5b2f640 1 --2- 172.21.15.89:0/1025682819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32a00ffcf0 0x7f32a0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:59.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.372+0000 7f32a5b2f640 1 --2- 172.21.15.89:0/1025682819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00feaf0 0x7f32a00feef0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:59.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.372+0000 7f32a5b2f640 1 -- 172.21.15.89:0/1025682819 >> 172.21.15.89:0/1025682819 conn(0x7f32a00fa280 msgr2=0x7f32a00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:59.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.372+0000 7f32a5b2f640 1 -- 172.21.15.89:0/1025682819 shutdown_connections 2024-09-13T22:06:59.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.372+0000 7f32a5b2f640 1 -- 172.21.15.89:0/1025682819 wait complete. 2024-09-13T22:06:59.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.372+0000 7f32a5b2f640 1 Processor -- start 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f32a5b2f640 1 -- start start 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f32a5b2f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32a00feaf0 0x7f32a0102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f32a5b2f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00ffcf0 0x7f32a01010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f32a5b2f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a0102fc0 con 0x7f32a00ffcf0 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f32a5b2f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a0101640 con 0x7f32a00feaf0 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f329effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00ffcf0 0x7f32a01010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f329effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00ffcf0 0x7f32a01010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56346/0 (socket says 172.21.15.89:56346) 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f329effd640 1 -- 172.21.15.89:0/3551055304 learned_addr learned my addr 172.21.15.89:0/3551055304 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f329f7fe640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32a00feaf0 0x7f32a0102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f329effd640 1 -- 172.21.15.89:0/3551055304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32a00feaf0 msgr2=0x7f32a0102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f329effd640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32a00feaf0 0x7f32a0102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.373+0000 7f329effd640 1 -- 172.21.15.89:0/3551055304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290009560 con 0x7f32a00ffcf0 2024-09-13T22:06:59.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.374+0000 7f329effd640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00ffcf0 0x7f32a01010d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f329400c8a0 tx=0x7f329400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:59.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.374+0000 7f329cff9640 1 -- 172.21.15.89:0/3551055304 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3294007b80 con 0x7f32a00ffcf0 2024-09-13T22:06:59.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.374+0000 7f329cff9640 1 -- 172.21.15.89:0/3551055304 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3294007ce0 con 0x7f32a00ffcf0 2024-09-13T22:06:59.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.374+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a0101920 con 0x7f32a00ffcf0 2024-09-13T22:06:59.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.374+0000 7f329cff9640 1 -- 172.21.15.89:0/3551055304 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3294018810 con 0x7f32a00ffcf0 2024-09-13T22:06:59.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.374+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a0101e70 con 0x7f32a00ffcf0 2024-09-13T22:06:59.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.375+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a01076e0 con 0x7f32a00ffcf0 2024-09-13T22:06:59.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.375+0000 7f329cff9640 1 -- 172.21.15.89:0/3551055304 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f329400f450 con 0x7f32a00ffcf0 2024-09-13T22:06:59.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.376+0000 7f329cff9640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f328806cc50 0x7f328806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:06:59.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.376+0000 7f329cff9640 1 -- 172.21.15.89:0/3551055304 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f329408c4b0 con 0x7f32a00ffcf0 2024-09-13T22:06:59.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.376+0000 7f329f7fe640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f328806cc50 0x7f328806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:06:59.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.376+0000 7f329f7fe640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f328806cc50 0x7f328806f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3290031540 tx=0x7f3290000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:06:59.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.380+0000 7f329cff9640 1 -- 172.21.15.89:0/3551055304 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3294056820 con 0x7f32a00ffcf0 2024-09-13T22:06:59.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.542+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f32a0107870 con 0x7f32a00ffcf0 2024-09-13T22:06:59.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.543+0000 7f329cff9640 1 -- 172.21.15.89:0/3551055304 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v26)=0 v26) v1 ==== 163+0+0 (secure 0 0 0) 0x7f3294059e40 con 0x7f32a00ffcf0 2024-09-13T22:06:59.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f328806cc50 msgr2=0x7f328806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:59.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f328806cc50 0x7f328806f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3290031540 tx=0x7f3290000bc0 comp rx=0 tx=0).stop 2024-09-13T22:06:59.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00ffcf0 msgr2=0x7f32a01010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:06:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00ffcf0 0x7f32a01010d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f329400c8a0 tx=0x7f329400cd60 comp rx=0 tx=0).stop 2024-09-13T22:06:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 shutdown_connections 2024-09-13T22:06:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f328806cc50 0x7f328806f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a00ffcf0 0x7f32a01010d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 --2- 172.21.15.89:0/3551055304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32a00feaf0 0x7f32a0102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:06:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 >> 172.21.15.89:0/3551055304 conn(0x7f32a00fa280 msgr2=0x7f32a0067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:06:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 shutdown_connections 2024-09-13T22:06:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:06:59.545+0000 7f32a5b2f640 1 -- 172.21.15.89:0/3551055304 wait complete. 2024-09-13T22:07:00.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T22:07:00.358 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:07:01.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:01 smithi159 ceph-mon[35348]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-13T22:07:01.633 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:01 smithi089 ceph-mon[27921]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-13T22:07:01.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.953+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3979329002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 msgr2=0x7f66dc105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:01.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.953+0000 7f66e3b2e640 1 --2- 172.21.15.89:0/3979329002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 0x7f66dc105350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0098b0 tx=0x7f66cc02a4d0 comp rx=0 tx=0).stop 2024-09-13T22:07:01.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.953+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3979329002 shutdown_connections 2024-09-13T22:07:01.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.953+0000 7f66e3b2e640 1 --2- 172.21.15.89:0/3979329002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 0x7f66dc105350 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:01.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.953+0000 7f66e3b2e640 1 --2- 172.21.15.89:0/3979329002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66dc100630 0x7f66dc102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:01.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.953+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3979329002 >> 172.21.15.89:0/3979329002 conn(0x7f66dc0fa230 msgr2=0x7f66dc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.953+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3979329002 shutdown_connections 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.953+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3979329002 wait complete. 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e3b2e640 1 Processor -- start 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e3b2e640 1 -- start start 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e3b2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66dc100630 0x7f66dc1957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e3b2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 0x7f66dc195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e3b2e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc1962d0 con 0x7f66dc102f60 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e3b2e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc196440 con 0x7f66dc100630 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e10c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 0x7f66dc195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e10c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 0x7f66dc195d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56354/0 (socket says 172.21.15.89:56354) 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e10c9640 1 -- 172.21.15.89:0/3455271472 learned_addr learned my addr 172.21.15.89:0/3455271472 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:07:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e18ca640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66dc100630 0x7f66dc1957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e10c9640 1 -- 172.21.15.89:0/3455271472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66dc100630 msgr2=0x7f66dc1957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e10c9640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66dc100630 0x7f66dc1957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e10c9640 1 -- 172.21.15.89:0/3455271472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc009560 con 0x7f66dc102f60 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e18ca640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66dc100630 0x7f66dc1957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.954+0000 7f66e10c9640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 0x7f66dc195d00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f66cc005610 tx=0x7f66cc005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.955+0000 7f66d2ffd640 1 -- 172.21.15.89:0/3455271472 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66cc004ba0 con 0x7f66dc102f60 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.955+0000 7f66d2ffd640 1 -- 172.21.15.89:0/3455271472 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66cc004d00 con 0x7f66dc102f60 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.955+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc19ae30 con 0x7f66dc102f60 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.955+0000 7f66d2ffd640 1 -- 172.21.15.89:0/3455271472 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66cc003bf0 con 0x7f66dc102f60 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.955+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc19b370 con 0x7f66dc102f60 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.956+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc100a90 con 0x7f66dc102f60 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.956+0000 7f66d2ffd640 1 -- 172.21.15.89:0/3455271472 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f66cc031640 con 0x7f66dc102f60 2024-09-13T22:07:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.956+0000 7f66d2ffd640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f66c806cc50 0x7f66c806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:01.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.957+0000 7f66d2ffd640 1 -- 172.21.15.89:0/3455271472 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f66cc0ad5d0 con 0x7f66dc102f60 2024-09-13T22:07:01.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.957+0000 7f66e18ca640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f66c806cc50 0x7f66c806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:01.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.957+0000 7f66e18ca640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f66c806cc50 0x7f66c806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66d8006fd0 tx=0x7f66d8008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:01.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:01.961+0000 7f66d2ffd640 1 -- 172.21.15.89:0/3455271472 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f66cc077940 con 0x7f66dc102f60 2024-09-13T22:07:02.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.122+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f66dc108a30 con 0x7f66dc102f60 2024-09-13T22:07:02.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.122+0000 7f66d2ffd640 1 -- 172.21.15.89:0/3455271472 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v26)=0 v26) v1 ==== 135+0+0 (secure 0 0 0) 0x7f66cc07af60 con 0x7f66dc102f60 2024-09-13T22:07:02.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.124+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f66c806cc50 msgr2=0x7f66c806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.124+0000 7f66e3b2e640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f66c806cc50 0x7f66c806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66d8006fd0 tx=0x7f66d8008040 comp rx=0 tx=0).stop 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.124+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 msgr2=0x7f66dc195d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.124+0000 7f66e3b2e640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 0x7f66dc195d00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f66cc005610 tx=0x7f66cc005640 comp rx=0 tx=0).stop 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.124+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 shutdown_connections 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.124+0000 7f66e3b2e640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f66c806cc50 0x7f66c806f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.124+0000 7f66e3b2e640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc102f60 0x7f66dc195d00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.124+0000 7f66e3b2e640 1 --2- 172.21.15.89:0/3455271472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66dc100630 0x7f66dc1957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.124+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 >> 172.21.15.89:0/3455271472 conn(0x7f66dc0fa230 msgr2=0x7f66dc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.125+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 shutdown_connections 2024-09-13T22:07:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:02.125+0000 7f66e3b2e640 1 -- 172.21.15.89:0/3455271472 wait complete. 2024-09-13T22:07:02.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-13T22:07:03.083 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:07:03.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:03 smithi089 ceph-mon[27921]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-13T22:07:03.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:03 smithi159 ceph-mon[35348]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-13T22:07:04.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.746+0000 7ff0f3417640 1 -- 172.21.15.89:0/3773544527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 msgr2=0x7ff0ec105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:04.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.746+0000 7ff0f3417640 1 --2- 172.21.15.89:0/3773544527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 0x7ff0ec105330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0098b0 tx=0x7ff0dc02a4d0 comp rx=0 tx=0).stop 2024-09-13T22:07:04.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.746+0000 7ff0f3417640 1 -- 172.21.15.89:0/3773544527 shutdown_connections 2024-09-13T22:07:04.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.746+0000 7ff0f3417640 1 --2- 172.21.15.89:0/3773544527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 0x7ff0ec105330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:04.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.746+0000 7ff0f3417640 1 --2- 172.21.15.89:0/3773544527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ec100610 0x7ff0ec102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:04.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.746+0000 7ff0f3417640 1 -- 172.21.15.89:0/3773544527 >> 172.21.15.89:0/3773544527 conn(0x7ff0ec0fa230 msgr2=0x7ff0ec0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:04.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.746+0000 7ff0f3417640 1 -- 172.21.15.89:0/3773544527 shutdown_connections 2024-09-13T22:07:04.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.746+0000 7ff0f3417640 1 -- 172.21.15.89:0/3773544527 wait complete. 2024-09-13T22:07:04.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f3417640 1 Processor -- start 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f3417640 1 -- start start 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f3417640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ec100610 0x7ff0ec195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f3417640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 0x7ff0ec195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f3417640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec196240 con 0x7ff0ec102f40 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f3417640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1963b0 con 0x7ff0ec100610 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f09b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 0x7ff0ec195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f09b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 0x7ff0ec195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39372/0 (socket says 172.21.15.89:39372) 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f09b2640 1 -- 172.21.15.89:0/1733146929 learned_addr learned my addr 172.21.15.89:0/1733146929 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f11b3640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ec100610 0x7ff0ec195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f09b2640 1 -- 172.21.15.89:0/1733146929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ec100610 msgr2=0x7ff0ec195730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f09b2640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ec100610 0x7ff0ec195730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f09b2640 1 -- 172.21.15.89:0/1733146929 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc009560 con 0x7ff0ec102f40 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f11b3640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ec100610 0x7ff0ec195730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:07:04.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.747+0000 7ff0f09b2640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 0x7ff0ec195c70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc005610 tx=0x7ff0dc005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:04.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.748+0000 7ff0e27fc640 1 -- 172.21.15.89:0/1733146929 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0dc004ba0 con 0x7ff0ec102f40 2024-09-13T22:07:04.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.748+0000 7ff0e27fc640 1 -- 172.21.15.89:0/1733146929 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0dc004d00 con 0x7ff0ec102f40 2024-09-13T22:07:04.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.748+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec19adf0 con 0x7ff0ec102f40 2024-09-13T22:07:04.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.748+0000 7ff0e27fc640 1 -- 172.21.15.89:0/1733146929 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0dc003bf0 con 0x7ff0ec102f40 2024-09-13T22:07:04.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.748+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec19b330 con 0x7ff0ec102f40 2024-09-13T22:07:04.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.749+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec100a70 con 0x7ff0ec102f40 2024-09-13T22:07:04.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.749+0000 7ff0e27fc640 1 -- 172.21.15.89:0/1733146929 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff0dc031640 con 0x7ff0ec102f40 2024-09-13T22:07:04.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.750+0000 7ff0e27fc640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff0d806cc50 0x7ff0d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:04.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.750+0000 7ff0f11b3640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff0d806cc50 0x7ff0d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:04.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.750+0000 7ff0e27fc640 1 -- 172.21.15.89:0/1733146929 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff0dc0ad5d0 con 0x7ff0ec102f40 2024-09-13T22:07:04.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.750+0000 7ff0f11b3640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff0d806cc50 0x7ff0d806f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8006fd0 tx=0x7ff0e8008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:04.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.754+0000 7ff0e27fc640 1 -- 172.21.15.89:0/1733146929 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff0dc077940 con 0x7ff0ec102f40 2024-09-13T22:07:04.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:04.930+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0ec103a30 con 0x7ff0d806cc50 2024-09-13T22:07:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:05 smithi159 ceph-mon[35348]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T22:07:05.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:05 smithi089 ceph-mon[27921]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T22:07:06.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:06 smithi159 ceph-mon[35348]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:06.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:06 smithi089 ceph-mon[27921]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:07.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:07 smithi089 ceph-mon[27921]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T22:07:07.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:07 smithi159 ceph-mon[35348]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T22:07:09.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:09 smithi089 ceph-mon[27921]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T22:07:09.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:07:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:09 smithi159 ceph-mon[35348]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T22:07:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:07:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:11 smithi159 ceph-mon[35348]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:11.728 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:11 smithi089 ceph-mon[27921]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:13.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:13 smithi089 ceph-mon[27921]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:13 smithi159 ceph-mon[35348]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:15.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:15 smithi089 ceph-mon[27921]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:15.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:15 smithi159 ceph-mon[35348]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:17.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:17 smithi089 ceph-mon[27921]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:17 smithi159 ceph-mon[35348]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:19.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:19 smithi089 ceph-mon[27921]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:19 smithi159 ceph-mon[35348]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:21.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:21 smithi089 ceph-mon[27921]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:21 smithi159 ceph-mon[35348]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:23.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:23 smithi089 ceph-mon[27921]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:23 smithi159 ceph-mon[35348]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:25.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:25 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:07:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:25 smithi089 ceph-mon[27921]: pgmap v214: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:25.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:25 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:07:25.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:25 smithi159 ceph-mon[35348]: pgmap v214: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:27.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:27 smithi159 ceph-mon[35348]: pgmap v215: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:27.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:27 smithi089 ceph-mon[27921]: pgmap v215: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:29.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:29 smithi089 ceph-mon[27921]: pgmap v216: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:29 smithi159 ceph-mon[35348]: pgmap v216: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:31.561 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:31 smithi159 ceph-mon[35348]: pgmap v217: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:31.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:31 smithi089 ceph-mon[27921]: pgmap v217: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:33.188 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:07:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.185+0000 7ff0e27fc640 1 -- 172.21.15.89:0/1733146929 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff0ec103a30 con 0x7ff0d806cc50 2024-09-13T22:07:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.188+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff0d806cc50 msgr2=0x7ff0d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.188+0000 7ff0f3417640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff0d806cc50 0x7ff0d806f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8006fd0 tx=0x7ff0e8008040 comp rx=0 tx=0).stop 2024-09-13T22:07:33.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.188+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 msgr2=0x7ff0ec195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:33.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.188+0000 7ff0f3417640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 0x7ff0ec195c70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc005610 tx=0x7ff0dc005640 comp rx=0 tx=0).stop 2024-09-13T22:07:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.191+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 shutdown_connections 2024-09-13T22:07:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.191+0000 7ff0f3417640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ff0d806cc50 0x7ff0d806f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.191+0000 7ff0f3417640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0ec102f40 0x7ff0ec195c70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.191+0000 7ff0f3417640 1 --2- 172.21.15.89:0/1733146929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0ec100610 0x7ff0ec195730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.191+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 >> 172.21.15.89:0/1733146929 conn(0x7ff0ec0fa230 msgr2=0x7ff0ec0fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.191+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 shutdown_connections 2024-09-13T22:07:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:33.191+0000 7ff0f3417640 1 -- 172.21.15.89:0/1733146929 wait complete. 2024-09-13T22:07:33.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:33 smithi089 ceph-mon[27921]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:33.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:33 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:07:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:33 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:07:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:33 smithi159 ceph-mon[35348]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:33 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:07:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:33 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:07:33.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-13T22:07:34.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:34 smithi089 ceph-mon[27921]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:07:34.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:07:34.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:07:34.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:34 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:07:34.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:34 smithi159 ceph-mon[35348]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:07:34.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:34 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:07:34.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:34 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:07:34.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:34 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:07:35.196 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:07:35.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:35 smithi089 ceph-mon[27921]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:07:35.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:35 smithi089 ceph-mon[27921]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:35.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:35 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:07:35.448 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:35 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:07:35.448 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:35 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:07:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:35 smithi159 ceph-mon[35348]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:07:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:35 smithi159 ceph-mon[35348]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:35 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:07:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:35 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:07:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:35 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:07:36.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:36 smithi089 ceph-mon[27921]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T22:07:36.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:36 smithi089 ceph-mon[27921]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T22:07:36.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:36 smithi089 ceph-mon[27921]: Upgrade: Need to upgrade myself (mgr.smithi089.naneiw) 2024-09-13T22:07:36.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:36 smithi089 ceph-mon[27921]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi159 2024-09-13T22:07:36.717 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:36 smithi159 ceph-mon[35348]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T22:07:36.718 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:36 smithi159 ceph-mon[35348]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T22:07:36.718 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:36 smithi159 ceph-mon[35348]: Upgrade: Need to upgrade myself (mgr.smithi089.naneiw) 2024-09-13T22:07:36.718 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:36 smithi159 ceph-mon[35348]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi159 2024-09-13T22:07:37.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.008+0000 7f073a8d3640 1 -- 172.21.15.89:0/3789479150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340feaf0 msgr2=0x7f07340feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.008+0000 7f073a8d3640 1 --2- 172.21.15.89:0/3789479150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340feaf0 0x7f07340feef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0724009880 tx=0x7f072402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.008+0000 7f073a8d3640 1 -- 172.21.15.89:0/3789479150 shutdown_connections 2024-09-13T22:07:37.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.008+0000 7f073a8d3640 1 --2- 172.21.15.89:0/3789479150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07340ffcf0 0x7f0734100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.008+0000 7f073a8d3640 1 --2- 172.21.15.89:0/3789479150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340feaf0 0x7f07340feef0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.008+0000 7f073a8d3640 1 -- 172.21.15.89:0/3789479150 >> 172.21.15.89:0/3789479150 conn(0x7f07340fa280 msgr2=0x7f07340fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:37.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.008+0000 7f073a8d3640 1 -- 172.21.15.89:0/3789479150 shutdown_connections 2024-09-13T22:07:37.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.008+0000 7f073a8d3640 1 -- 172.21.15.89:0/3789479150 wait complete. 2024-09-13T22:07:37.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.008+0000 7f073a8d3640 1 Processor -- start 2024-09-13T22:07:37.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f073a8d3640 1 -- start start 2024-09-13T22:07:37.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f073a8d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07340feaf0 0x7f0734068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:37.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f073a8d3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340ffcf0 0x7f073419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:37.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f0733fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07340feaf0 0x7f0734068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:37.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f0733fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07340feaf0 0x7f0734068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.89:49180/0 (socket says 172.21.15.89:49180) 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f07337fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340ffcf0 0x7f073419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f07337fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340ffcf0 0x7f073419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49534/0 (socket says 172.21.15.89:49534) 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f0733fff640 1 -- 172.21.15.89:0/90769992 learned_addr learned my addr 172.21.15.89:0/90769992 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0734196290 con 0x7f07340ffcf0 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.009+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073419cd60 con 0x7f07340feaf0 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.010+0000 7f0733fff640 1 -- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340ffcf0 msgr2=0x7f073419c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.010+0000 7f0733fff640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340ffcf0 0x7f073419c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.010+0000 7f0733fff640 1 -- 172.21.15.89:0/90769992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724009560 con 0x7f07340feaf0 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.010+0000 7f07337fe640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340ffcf0 0x7f073419c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.010+0000 7f0733fff640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07340feaf0 0x7f0734068790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f072402a9c0 tx=0x7f07240055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.010+0000 7f07317fa640 1 -- 172.21.15.89:0/90769992 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0724004aa0 con 0x7f07340feaf0 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.011+0000 7f07317fa640 1 -- 172.21.15.89:0/90769992 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0724004c00 con 0x7f07340feaf0 2024-09-13T22:07:37.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.011+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073419cf90 con 0x7f07340feaf0 2024-09-13T22:07:37.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.011+0000 7f07317fa640 1 -- 172.21.15.89:0/90769992 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07240039b0 con 0x7f07340feaf0 2024-09-13T22:07:37.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.011+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073419d390 con 0x7f07340feaf0 2024-09-13T22:07:37.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.013+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073418e690 con 0x7f07340feaf0 2024-09-13T22:07:37.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.013+0000 7f07317fa640 1 -- 172.21.15.89:0/90769992 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0724003c40 con 0x7f07340feaf0 2024-09-13T22:07:37.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.013+0000 7f07317fa640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f071c06cc50 0x7f071c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:37.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.014+0000 7f07317fa640 1 -- 172.21.15.89:0/90769992 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f07240ad3b0 con 0x7f07340feaf0 2024-09-13T22:07:37.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.014+0000 7f07337fe640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f071c06cc50 0x7f071c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:37.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.015+0000 7f07337fe640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f071c06cc50 0x7f071c06f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0734068d10 tx=0x7f0728005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:37.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.019+0000 7f07317fa640 1 -- 172.21.15.89:0/90769992 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f07240777f0 con 0x7f07340feaf0 2024-09-13T22:07:37.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.389+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f073402c550 con 0x7f071c06cc50 2024-09-13T22:07:37.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.391+0000 7f07317fa640 1 -- 172.21.15.89:0/90769992 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f073402c550 con 0x7f071c06cc50 2024-09-13T22:07:37.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.393+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f071c06cc50 msgr2=0x7f071c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.393+0000 7f073a8d3640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f071c06cc50 0x7f071c06f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0734068d10 tx=0x7f0728005f90 comp rx=0 tx=0).stop 2024-09-13T22:07:37.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.394+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07340feaf0 msgr2=0x7f0734068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.394+0000 7f073a8d3640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07340feaf0 0x7f0734068790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f072402a9c0 tx=0x7f07240055a0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.394+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 shutdown_connections 2024-09-13T22:07:37.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.394+0000 7f073a8d3640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f071c06cc50 0x7f071c06f110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.394+0000 7f073a8d3640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07340ffcf0 0x7f073419c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.394+0000 7f073a8d3640 1 --2- 172.21.15.89:0/90769992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07340feaf0 0x7f0734068790 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.394+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 >> 172.21.15.89:0/90769992 conn(0x7f07340fa280 msgr2=0x7f07341033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:37.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.394+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 shutdown_connections 2024-09-13T22:07:37.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.394+0000 7f073a8d3640 1 -- 172.21.15.89:0/90769992 wait complete. 2024-09-13T22:07:37.408 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:07:37.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.489+0000 7eff199b9640 1 -- 172.21.15.89:0/3636606937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff140ffca0 msgr2=0x7eff14100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.489+0000 7eff199b9640 1 --2- 172.21.15.89:0/3636606937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff140ffca0 0x7eff14100120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff08009880 tx=0x7eff0802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.489+0000 7eff199b9640 1 -- 172.21.15.89:0/3636606937 shutdown_connections 2024-09-13T22:07:37.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.489+0000 7eff199b9640 1 --2- 172.21.15.89:0/3636606937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff140ffca0 0x7eff14100120 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.489+0000 7eff199b9640 1 --2- 172.21.15.89:0/3636606937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140feaa0 0x7eff140feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.489+0000 7eff199b9640 1 -- 172.21.15.89:0/3636606937 >> 172.21.15.89:0/3636606937 conn(0x7eff140fa230 msgr2=0x7eff140fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.489+0000 7eff199b9640 1 -- 172.21.15.89:0/3636606937 shutdown_connections 2024-09-13T22:07:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.489+0000 7eff199b9640 1 -- 172.21.15.89:0/3636606937 wait complete. 2024-09-13T22:07:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.490+0000 7eff199b9640 1 Processor -- start 2024-09-13T22:07:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.490+0000 7eff199b9640 1 -- start start 2024-09-13T22:07:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.490+0000 7eff199b9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140feaa0 0x7eff14195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.490+0000 7eff199b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff14195d60 0x7eff1419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.490+0000 7eff199b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff141961e0 con 0x7eff14195d60 2024-09-13T22:07:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.490+0000 7eff199b9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff14196350 con 0x7eff140feaa0 2024-09-13T22:07:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.490+0000 7eff127fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff14195d60 0x7eff1419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.490+0000 7eff127fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff14195d60 0x7eff1419add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49556/0 (socket says 172.21.15.89:49556) 2024-09-13T22:07:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.490+0000 7eff127fc640 1 -- 172.21.15.89:0/3854617120 learned_addr learned my addr 172.21.15.89:0/3854617120 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:07:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.491+0000 7eff127fc640 1 -- 172.21.15.89:0/3854617120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140feaa0 msgr2=0x7eff14195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.491+0000 7eff127fc640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140feaa0 0x7eff14195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.491+0000 7eff127fc640 1 -- 172.21.15.89:0/3854617120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009560 con 0x7eff14195d60 2024-09-13T22:07:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.491+0000 7eff127fc640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff14195d60 0x7eff1419add0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff08006010 tx=0x7eff08005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:37.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.491+0000 7eff189b7640 1 -- 172.21.15.89:0/3854617120 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff08004aa0 con 0x7eff14195d60 2024-09-13T22:07:37.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.491+0000 7eff189b7640 1 -- 172.21.15.89:0/3854617120 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff08004c00 con 0x7eff14195d60 2024-09-13T22:07:37.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.491+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1419b310 con 0x7eff14195d60 2024-09-13T22:07:37.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.491+0000 7eff189b7640 1 -- 172.21.15.89:0/3854617120 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff08003940 con 0x7eff14195d60 2024-09-13T22:07:37.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.491+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1419b7b0 con 0x7eff14195d60 2024-09-13T22:07:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.493+0000 7eff189b7640 1 -- 172.21.15.89:0/3854617120 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7eff08003ba0 con 0x7eff14195d60 2024-09-13T22:07:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.493+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff14108790 con 0x7eff14195d60 2024-09-13T22:07:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.493+0000 7eff189b7640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7efefc06cca0 0x7efefc06f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.493+0000 7eff189b7640 1 -- 172.21.15.89:0/3854617120 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7eff080ad440 con 0x7eff14195d60 2024-09-13T22:07:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.494+0000 7eff12ffd640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7efefc06cca0 0x7efefc06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.494+0000 7eff12ffd640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7efefc06cca0 0x7efefc06f160 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff140ffb00 tx=0x7eff04005ed0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:37.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.502+0000 7eff189b7640 1 -- 172.21.15.89:0/3854617120 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7eff08077700 con 0x7eff14195d60 2024-09-13T22:07:37.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:37 smithi089 ceph-mon[27921]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:37 smithi159 ceph-mon[35348]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:37.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.874+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff141045f0 con 0x7efefc06cca0 2024-09-13T22:07:37.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.876+0000 7eff189b7640 1 -- 172.21.15.89:0/3854617120 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7eff141045f0 con 0x7efefc06cca0 2024-09-13T22:07:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.878+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7efefc06cca0 msgr2=0x7efefc06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.878+0000 7eff199b9640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7efefc06cca0 0x7efefc06f160 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff140ffb00 tx=0x7eff04005ed0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.878+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff14195d60 msgr2=0x7eff1419add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.878+0000 7eff199b9640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff14195d60 0x7eff1419add0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff08006010 tx=0x7eff08005530 comp rx=0 tx=0).stop 2024-09-13T22:07:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.879+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 shutdown_connections 2024-09-13T22:07:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.879+0000 7eff199b9640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7efefc06cca0 0x7efefc06f160 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.879+0000 7eff199b9640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff14195d60 0x7eff1419add0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.879+0000 7eff199b9640 1 --2- 172.21.15.89:0/3854617120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff140feaa0 0x7eff14195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.879+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 >> 172.21.15.89:0/3854617120 conn(0x7eff140fa230 msgr2=0x7eff14102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.879+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 shutdown_connections 2024-09-13T22:07:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.879+0000 7eff199b9640 1 -- 172.21.15.89:0/3854617120 wait complete. 2024-09-13T22:07:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.965+0000 7f3dfa231640 1 -- 172.21.15.89:0/10326000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df40feaf0 msgr2=0x7f3df40feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.965+0000 7f3dfa231640 1 --2- 172.21.15.89:0/10326000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df40feaf0 0x7f3df40feef0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009880 tx=0x7f3de402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.965+0000 7f3dfa231640 1 -- 172.21.15.89:0/10326000 shutdown_connections 2024-09-13T22:07:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.965+0000 7f3dfa231640 1 --2- 172.21.15.89:0/10326000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3df40ffcf0 0x7f3df4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.965+0000 7f3dfa231640 1 --2- 172.21.15.89:0/10326000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df40feaf0 0x7f3df40feef0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.965+0000 7f3dfa231640 1 -- 172.21.15.89:0/10326000 >> 172.21.15.89:0/10326000 conn(0x7f3df40fa280 msgr2=0x7f3df40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.966+0000 7f3dfa231640 1 -- 172.21.15.89:0/10326000 shutdown_connections 2024-09-13T22:07:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.966+0000 7f3dfa231640 1 -- 172.21.15.89:0/10326000 wait complete. 2024-09-13T22:07:37.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.966+0000 7f3dfa231640 1 Processor -- start 2024-09-13T22:07:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.967+0000 7f3dfa231640 1 -- start start 2024-09-13T22:07:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.967+0000 7f3dfa231640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3df40ffcf0 0x7f3df4194790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.967+0000 7f3dfa231640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df4194cd0 0x7f3df4199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.967+0000 7f3dfa231640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4195150 con 0x7f3df4194cd0 2024-09-13T22:07:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.967+0000 7f3dfa231640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df41952c0 con 0x7f3df40ffcf0 2024-09-13T22:07:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.967+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df4194cd0 0x7f3df4199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.967+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df4194cd0 0x7f3df4199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49578/0 (socket says 172.21.15.89:49578) 2024-09-13T22:07:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.967+0000 7f3df2ffd640 1 -- 172.21.15.89:0/50152295 learned_addr learned my addr 172.21.15.89:0/50152295 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:07:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.968+0000 7f3df37fe640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3df40ffcf0 0x7f3df4194790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.968+0000 7f3df2ffd640 1 -- 172.21.15.89:0/50152295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3df40ffcf0 msgr2=0x7f3df4194790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.968+0000 7f3df2ffd640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3df40ffcf0 0x7f3df4194790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.968+0000 7f3df2ffd640 1 -- 172.21.15.89:0/50152295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4009560 con 0x7f3df4194cd0 2024-09-13T22:07:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.969+0000 7f3df2ffd640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df4194cd0 0x7f3df4199d40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3de800e970 tx=0x7f3de800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.969+0000 7f3df0ff9640 1 -- 172.21.15.89:0/50152295 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de800cc90 con 0x7f3df4194cd0 2024-09-13T22:07:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.969+0000 7f3df0ff9640 1 -- 172.21.15.89:0/50152295 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3de800cdf0 con 0x7f3df4194cd0 2024-09-13T22:07:37.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.969+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df4067c90 con 0x7f3df4194cd0 2024-09-13T22:07:37.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.969+0000 7f3df0ff9640 1 -- 172.21.15.89:0/50152295 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de8010430 con 0x7f3df4194cd0 2024-09-13T22:07:37.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.969+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df4068130 con 0x7f3df4194cd0 2024-09-13T22:07:37.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.971+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df4107700 con 0x7f3df4194cd0 2024-09-13T22:07:37.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.972+0000 7f3df0ff9640 1 -- 172.21.15.89:0/50152295 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3de8004fc0 con 0x7f3df4194cd0 2024-09-13T22:07:37.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.972+0000 7f3df0ff9640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3ddc06cc50 0x7f3ddc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:37.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.972+0000 7f3df0ff9640 1 -- 172.21.15.89:0/50152295 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3de8014070 con 0x7f3df4194cd0 2024-09-13T22:07:37.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.973+0000 7f3df37fe640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3ddc06cc50 0x7f3ddc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:37.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.973+0000 7f3df37fe640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3ddc06cc50 0x7f3ddc06f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3de4008000 tx=0x7f3de4004260 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:37.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:37.980+0000 7f3df0ff9640 1 -- 172.21.15.89:0/50152295 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3de8056bd0 con 0x7f3df4194cd0 2024-09-13T22:07:38.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.331+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3df4068930 con 0x7f3ddc06cc50 2024-09-13T22:07:38.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.349+0000 7f3df0ff9640 1 -- 172.21.15.89:0/50152295 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f3df4068930 con 0x7f3ddc06cc50 2024-09-13T22:07:38.350 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:07:38.350 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (5m) 50s ago 6m 25.0M - 0.25.0 c8568f914cd2 6ef74b73ca3e 2024-09-13T22:07:38.350 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (6m) 50s ago 6m 7528k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:07:38.350 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (6m) 57s ago 6m 7356k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (6m) 50s ago 6m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (5m) 57s ago 5m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (5m) 50s ago 6m 88.2M - 9.4.7 954c08fa6188 59724cff87bd 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (70s) 50s ago 70s 13.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (77s) 50s ago 77s 11.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (75s) 57s ago 74s 16.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (68s) 57s ago 67s 13.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:9283,8765,8443 running (8m) 50s ago 8m 487M - 18.2.4-845-ge4e227b3 67ddd33fa72f deeaa986e2d7 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (5m) 57s ago 5m 441M - 18.2.4-845-ge4e227b3 67ddd33fa72f e126d541e564 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (8m) 50s ago 8m 47.7M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (5m) 57s ago 5m 35.3M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (6m) 50s ago 6m 15.9M - 1.5.0 0da6a335fe13 eeaf1dd44f97 2024-09-13T22:07:38.351 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (5m) 57s ago 5m 15.6M - 1.5.0 0da6a335fe13 c76544fc91f3 2024-09-13T22:07:38.352 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (5m) 50s ago 5m 55.6M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:07:38.352 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (4m) 50s ago 4m 50.2M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:07:38.352 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (4m) 50s ago 4m 55.9M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:07:38.352 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (3m) 57s ago 3m 52.6M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:07:38.352 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (3m) 57s ago 3m 50.9M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:07:38.352 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (2m) 57s ago 2m 51.2M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:07:38.352 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (5m) 50s ago 6m 58.3M - 2.43.0 a07b618ecd1d 4bb2a482e0e5 2024-09-13T22:07:38.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.351+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3ddc06cc50 msgr2=0x7f3ddc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:38.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.351+0000 7f3dfa231640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3ddc06cc50 0x7f3ddc06f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3de4008000 tx=0x7f3de4004260 comp rx=0 tx=0).stop 2024-09-13T22:07:38.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.351+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df4194cd0 msgr2=0x7f3df4199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:38.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.351+0000 7f3dfa231640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df4194cd0 0x7f3df4199d40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3de800e970 tx=0x7f3de800ed70 comp rx=0 tx=0).stop 2024-09-13T22:07:38.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.351+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 shutdown_connections 2024-09-13T22:07:38.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.351+0000 7f3dfa231640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f3ddc06cc50 0x7f3ddc06f110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.351+0000 7f3dfa231640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df4194cd0 0x7f3df4199d40 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3de800e970 tx=0x7f3de800ed70 comp rx=0 tx=0).stop 2024-09-13T22:07:38.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.351+0000 7f3dfa231640 1 --2- 172.21.15.89:0/50152295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3df40ffcf0 0x7f3df4194790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.351+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 >> 172.21.15.89:0/50152295 conn(0x7f3df40fa280 msgr2=0x7f3df4102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:38.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.352+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 shutdown_connections 2024-09-13T22:07:38.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.352+0000 7f3dfa231640 1 -- 172.21.15.89:0/50152295 wait complete. 2024-09-13T22:07:38.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.479+0000 7f40ea67a640 1 -- 172.21.15.89:0/1558869485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 msgr2=0x7f40e4100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:38.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.479+0000 7f40ea67a640 1 --2- 172.21.15.89:0/1558869485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 0x7f40e4100170 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009880 tx=0x7f40d802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.479+0000 7f40ea67a640 1 -- 172.21.15.89:0/1558869485 shutdown_connections 2024-09-13T22:07:38.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.479+0000 7f40ea67a640 1 --2- 172.21.15.89:0/1558869485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 0x7f40e4100170 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.479+0000 7f40ea67a640 1 --2- 172.21.15.89:0/1558869485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40feaf0 0x7f40e40feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.479+0000 7f40ea67a640 1 -- 172.21.15.89:0/1558869485 >> 172.21.15.89:0/1558869485 conn(0x7f40e40fa280 msgr2=0x7f40e40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:38.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.481+0000 7f40ea67a640 1 -- 172.21.15.89:0/1558869485 shutdown_connections 2024-09-13T22:07:38.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.481+0000 7f40ea67a640 1 -- 172.21.15.89:0/1558869485 wait complete. 2024-09-13T22:07:38.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.481+0000 7f40ea67a640 1 Processor -- start 2024-09-13T22:07:38.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.481+0000 7f40ea67a640 1 -- start start 2024-09-13T22:07:38.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.482+0000 7f40ea67a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40feaf0 0x7f40e40714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:38.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.482+0000 7f40ea67a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 0x7f40e4071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:38.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.482+0000 7f40ea67a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4071fd0 con 0x7f40e40ffcf0 2024-09-13T22:07:38.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.482+0000 7f40ea67a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4072140 con 0x7f40e40feaf0 2024-09-13T22:07:38.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.482+0000 7f40e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 0x7f40e4071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:38.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.482+0000 7f40e3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40feaf0 0x7f40e40714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:38.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.482+0000 7f40e3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40feaf0 0x7f40e40714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.89:49240/0 (socket says 172.21.15.89:49240) 2024-09-13T22:07:38.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.482+0000 7f40e3fff640 1 -- 172.21.15.89:0/1970052741 learned_addr learned my addr 172.21.15.89:0/1970052741 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:07:38.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.482+0000 7f40e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 0x7f40e4071a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49590/0 (socket says 172.21.15.89:49590) 2024-09-13T22:07:38.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.483+0000 7f40e3fff640 1 -- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 msgr2=0x7f40e4071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:38.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.483+0000 7f40e3fff640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 0x7f40e4071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.483+0000 7f40e3fff640 1 -- 172.21.15.89:0/1970052741 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8009560 con 0x7f40e40feaf0 2024-09-13T22:07:38.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.483+0000 7f40e37fe640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 0x7f40e4071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:07:38.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.483+0000 7f40e3fff640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40feaf0 0x7f40e40714c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40d400e940 tx=0x7f40d400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:38.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.484+0000 7f40e17fa640 1 -- 172.21.15.89:0/1970052741 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d40096e0 con 0x7f40e40feaf0 2024-09-13T22:07:38.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.484+0000 7f40e17fa640 1 -- 172.21.15.89:0/1970052741 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40d40044f0 con 0x7f40e40feaf0 2024-09-13T22:07:38.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.484+0000 7f40e17fa640 1 -- 172.21.15.89:0/1970052741 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d4010430 con 0x7f40e40feaf0 2024-09-13T22:07:38.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.484+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e41053a0 con 0x7f40e40feaf0 2024-09-13T22:07:38.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.484+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e41058f0 con 0x7f40e40feaf0 2024-09-13T22:07:38.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.486+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4106d50 con 0x7f40e40feaf0 2024-09-13T22:07:38.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.487+0000 7f40e17fa640 1 -- 172.21.15.89:0/1970052741 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f40d400cc90 con 0x7f40e40feaf0 2024-09-13T22:07:38.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.488+0000 7f40e17fa640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f40cc06ccf0 0x7f40cc06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:38.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.488+0000 7f40e17fa640 1 -- 172.21.15.89:0/1970052741 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f40d4014070 con 0x7f40e40feaf0 2024-09-13T22:07:38.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.488+0000 7f40e37fe640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f40cc06ccf0 0x7f40cc06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:38.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.489+0000 7f40e37fe640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f40cc06ccf0 0x7f40cc06f1b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000c00 tx=0x7f40d8031500 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:38.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.495+0000 7f40e17fa640 1 -- 172.21.15.89:0/1970052741 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f40d4056d70 con 0x7f40e40feaf0 2024-09-13T22:07:38.531 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:38 smithi089 ceph-mon[27921]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:38.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.748+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f40e4105530 con 0x7f40e40feaf0 2024-09-13T22:07:38.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.749+0000 7f40e17fa640 1 -- 172.21.15.89:0/1970052741 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f40e4105530 con 0x7f40e40feaf0 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:07:38.751 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:07:38.752 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:07:38.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:07:38.752 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:07:38.752 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 14 2024-09-13T22:07:38.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:07:38.752 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:07:38.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.751+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f40cc06ccf0 msgr2=0x7f40cc06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:38.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.751+0000 7f40ea67a640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f40cc06ccf0 0x7f40cc06f1b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000c00 tx=0x7f40d8031500 comp rx=0 tx=0).stop 2024-09-13T22:07:38.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.751+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40feaf0 msgr2=0x7f40e40714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:38.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.751+0000 7f40ea67a640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40feaf0 0x7f40e40714c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40d400e940 tx=0x7f40d400ee00 comp rx=0 tx=0).stop 2024-09-13T22:07:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.751+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 shutdown_connections 2024-09-13T22:07:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.751+0000 7f40ea67a640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f40cc06ccf0 0x7f40cc06f1b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.751+0000 7f40ea67a640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40e40ffcf0 0x7f40e4071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.751+0000 7f40ea67a640 1 --2- 172.21.15.89:0/1970052741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e40feaf0 0x7f40e40714c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.751+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 >> 172.21.15.89:0/1970052741 conn(0x7f40e40fa280 msgr2=0x7f40e41032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.752+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 shutdown_connections 2024-09-13T22:07:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.752+0000 7f40ea67a640 1 -- 172.21.15.89:0/1970052741 wait complete. 2024-09-13T22:07:38.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:38 smithi159 ceph-mon[35348]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.840+0000 7f9a39431640 1 -- 172.21.15.89:0/1054065664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 msgr2=0x7f9a34100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.840+0000 7f9a39431640 1 --2- 172.21.15.89:0/1054065664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 0x7f9a34100440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009880 tx=0x7f9a2402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.840+0000 7f9a39431640 1 -- 172.21.15.89:0/1054065664 shutdown_connections 2024-09-13T22:07:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.840+0000 7f9a39431640 1 --2- 172.21.15.89:0/1054065664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a340fec50 0x7f9a340ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.840+0000 7f9a39431640 1 --2- 172.21.15.89:0/1054065664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 0x7f9a34100440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.840+0000 7f9a39431640 1 -- 172.21.15.89:0/1054065664 >> 172.21.15.89:0/1054065664 conn(0x7f9a340f9950 msgr2=0x7f9a340fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.840+0000 7f9a39431640 1 -- 172.21.15.89:0/1054065664 shutdown_connections 2024-09-13T22:07:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.840+0000 7f9a39431640 1 -- 172.21.15.89:0/1054065664 wait complete. 2024-09-13T22:07:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.841+0000 7f9a39431640 1 Processor -- start 2024-09-13T22:07:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.841+0000 7f9a39431640 1 -- start start 2024-09-13T22:07:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.841+0000 7f9a39431640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a340fec50 0x7f9a34197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.841+0000 7f9a39431640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 0x7f9a34197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.841+0000 7f9a39431640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34198320 con 0x7f9a34100040 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.841+0000 7f9a39431640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34198490 con 0x7f9a340fec50 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.842+0000 7f9a327fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 0x7f9a34197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.842+0000 7f9a327fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 0x7f9a34197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49608/0 (socket says 172.21.15.89:49608) 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.842+0000 7f9a327fc640 1 -- 172.21.15.89:0/2373803554 learned_addr learned my addr 172.21.15.89:0/2373803554 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.842+0000 7f9a32ffd640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a340fec50 0x7f9a34197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.842+0000 7f9a327fc640 1 -- 172.21.15.89:0/2373803554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a340fec50 msgr2=0x7f9a34197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.842+0000 7f9a327fc640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a340fec50 0x7f9a34197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.842+0000 7f9a327fc640 1 -- 172.21.15.89:0/2373803554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24009560 con 0x7f9a34100040 2024-09-13T22:07:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.843+0000 7f9a327fc640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 0x7f9a34197d50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00e9a0 tx=0x7f9a1c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.843+0000 7f9a2bfff640 1 -- 172.21.15.89:0/2373803554 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a1c00cd50 con 0x7f9a34100040 2024-09-13T22:07:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.843+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3419cf30 con 0x7f9a34100040 2024-09-13T22:07:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.843+0000 7f9a2bfff640 1 -- 172.21.15.89:0/2373803554 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a1c00ceb0 con 0x7f9a34100040 2024-09-13T22:07:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.843+0000 7f9a2bfff640 1 -- 172.21.15.89:0/2373803554 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a1c010660 con 0x7f9a34100040 2024-09-13T22:07:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.843+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3419d4d0 con 0x7f9a34100040 2024-09-13T22:07:38.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.844+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3418d4f0 con 0x7f9a34100040 2024-09-13T22:07:38.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.846+0000 7f9a2bfff640 1 -- 172.21.15.89:0/2373803554 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9a1c0048a0 con 0x7f9a34100040 2024-09-13T22:07:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.846+0000 7f9a2bfff640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f9a2006cc50 0x7f9a2006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:07:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.846+0000 7f9a2bfff640 1 -- 172.21.15.89:0/2373803554 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9a1c014070 con 0x7f9a34100040 2024-09-13T22:07:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.847+0000 7f9a32ffd640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f9a2006cc50 0x7f9a2006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:07:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.848+0000 7f9a32ffd640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f9a2006cc50 0x7f9a2006f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a24031540 tx=0x7f9a24000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:07:38.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:38.850+0000 7f9a2bfff640 1 -- 172.21.15.89:0/2373803554 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9a1c056dc0 con 0x7f9a34100040 2024-09-13T22:07:39.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.041+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a3402c550 con 0x7f9a2006cc50 2024-09-13T22:07:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.043+0000 7f9a2bfff640 1 -- 172.21.15.89:0/2373803554 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f9a3402c550 con 0x7f9a2006cc50 2024-09-13T22:07:39.044 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:07:39.044 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:07:39.044 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:07:39.044 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:07:39.045 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T22:07:39.045 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/2 daemons upgraded", 2024-09-13T22:07:39.045 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 image on host smithi159", 2024-09-13T22:07:39.045 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:07:39.045 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:07:39.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.045+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f9a2006cc50 msgr2=0x7f9a2006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:39.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.045+0000 7f9a39431640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f9a2006cc50 0x7f9a2006f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a24031540 tx=0x7f9a24000bc0 comp rx=0 tx=0).stop 2024-09-13T22:07:39.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.045+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 msgr2=0x7f9a34197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:07:39.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.045+0000 7f9a39431640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 0x7f9a34197d50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00e9a0 tx=0x7f9a1c00eda0 comp rx=0 tx=0).stop 2024-09-13T22:07:39.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.046+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 shutdown_connections 2024-09-13T22:07:39.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.046+0000 7f9a39431640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f9a2006cc50 0x7f9a2006f110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.046+0000 7f9a39431640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34100040 0x7f9a34197d50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.046+0000 7f9a39431640 1 --2- 172.21.15.89:0/2373803554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a340fec50 0x7f9a34197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:07:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.046+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 >> 172.21.15.89:0/2373803554 conn(0x7f9a340f9950 msgr2=0x7f9a341033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:07:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.046+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 shutdown_connections 2024-09-13T22:07:39.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:07:39.046+0000 7f9a39431640 1 -- 172.21.15.89:0/2373803554 wait complete. 2024-09-13T22:07:39.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:39 smithi089 ceph-mon[27921]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:39.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:39 smithi089 ceph-mon[27921]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:39.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:39 smithi089 ceph-mon[27921]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:39.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:39 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1970052741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:07:39.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:39 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:07:39.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:39 smithi159 ceph-mon[35348]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:39.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:39 smithi159 ceph-mon[35348]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:39.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:39 smithi159 ceph-mon[35348]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:39.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:39 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/1970052741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:07:39.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:39 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:07:40.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:40 smithi089 ceph-mon[27921]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:40.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:40 smithi159 ceph-mon[35348]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:07:41.647 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:41 smithi089 ceph-mon[27921]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T22:07:41.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:41 smithi159 ceph-mon[35348]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T22:07:43.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:43 smithi089 ceph-mon[27921]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:43.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:43 smithi159 ceph-mon[35348]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T22:07:45.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:45 smithi089 ceph-mon[27921]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:45 smithi159 ceph-mon[35348]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:47.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:47 smithi089 ceph-mon[27921]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:47.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:47 smithi159 ceph-mon[35348]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:49.665 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:49 smithi089 ceph-mon[27921]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:49 smithi159 ceph-mon[35348]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:51.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:51 smithi089 ceph-mon[27921]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:51.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:51 smithi159 ceph-mon[35348]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:07:53.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:53 smithi089 ceph-mon[27921]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:53 smithi159 ceph-mon[35348]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:54.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:07:54.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:07:55.559 INFO:tasks.workunit.client.0.smithi089.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T22:07:55.559 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T22:07:55.559 INFO:tasks.workunit.client.0.smithi089.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T22:07:55.559 INFO:tasks.workunit.client.0.smithi089.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T22:07:55.559 INFO:tasks.workunit.client.0.smithi089.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T22:07:55.559 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T22:07:55.559 INFO:tasks.workunit.client.0.smithi089.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T22:07:55.559 INFO:tasks.workunit.client.0.smithi089.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T22:07:55.559 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T22:07:55.560 INFO:tasks.workunit.client.0.smithi089.stderr: git switch -c 2024-09-13T22:07:55.560 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T22:07:55.560 INFO:tasks.workunit.client.0.smithi089.stderr:Or undo this operation with: 2024-09-13T22:07:55.560 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T22:07:55.560 INFO:tasks.workunit.client.0.smithi089.stderr: git switch - 2024-09-13T22:07:55.560 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T22:07:55.560 INFO:tasks.workunit.client.0.smithi089.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T22:07:55.560 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T22:07:55.560 INFO:tasks.workunit.client.0.smithi089.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T22:07:55.565 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T22:07:55.588 INFO:tasks.workunit.client.0.smithi089.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T22:07:55.590 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T22:07:55.590 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T22:07:55.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:55 smithi089 ceph-mon[27921]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:55.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:55 smithi159 ceph-mon[35348]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:56.353 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T22:07:56.434 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T22:07:56.475 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T22:07:56.476 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T22:07:56.476 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T22:07:56.515 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T22:07:56.519 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:07:56.519 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T22:07:56.575 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T22:07:56.577 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T22:07:56.577 DEBUG:teuthology.orchestra.run.smithi089:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T22:07:56.638 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir -p fsstress 2024-09-13T22:07:56.640 INFO:tasks.workunit.client.0.smithi089.stderr:+ pushd fsstress 2024-09-13T22:07:56.640 INFO:tasks.workunit.client.0.smithi089.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T22:07:56.640 INFO:tasks.workunit.client.0.smithi089.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T22:07:56.719 INFO:tasks.workunit.client.1.smithi159.stderr:Updating files: 81% (10522/12889) Updating files: 82% (10569/12889) Updating files: 83% (10698/12889) Updating files: 84% (10827/12889) Updating files: 85% (10956/12889) Updating files: 86% (11085/12889) Updating files: 87% (11214/12889) Updating files: 88% (11343/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-13T22:07:57.316 INFO:tasks.workunit.client.0.smithi089.stderr:+ tar xzf ltp-full.tgz 2024-09-13T22:07:57.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:57 smithi159 ceph-mon[35348]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:57.731 INFO:tasks.workunit.client.1.smithi159.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr: 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr: 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr: 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr: git switch -c 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr: 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr:Or undo this operation with: 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr: 2024-09-13T22:07:57.732 INFO:tasks.workunit.client.1.smithi159.stderr: git switch - 2024-09-13T22:07:57.733 INFO:tasks.workunit.client.1.smithi159.stderr: 2024-09-13T22:07:57.733 INFO:tasks.workunit.client.1.smithi159.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T22:07:57.733 INFO:tasks.workunit.client.1.smithi159.stderr: 2024-09-13T22:07:57.733 INFO:tasks.workunit.client.1.smithi159.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T22:07:57.738 DEBUG:teuthology.orchestra.run.smithi159:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T22:07:57.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:57 smithi089 ceph-mon[27921]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:57.805 INFO:tasks.workunit.client.1.smithi159.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T22:07:57.807 INFO:tasks.workunit.client.1.smithi159.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T22:07:57.807 INFO:tasks.workunit.client.1.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T22:07:58.759 INFO:tasks.workunit.client.1.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T22:07:58.853 INFO:tasks.workunit.client.1.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T22:07:58.905 INFO:tasks.workunit.client.1.smithi159.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T22:07:58.908 INFO:tasks.workunit.client.1.smithi159.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T22:07:58.908 INFO:tasks.workunit.client.1.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T22:07:58.963 INFO:tasks.workunit.client.1.smithi159.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T22:07:58.967 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:07:58.967 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T22:07:59.029 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T22:07:59.030 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T22:07:59.030 DEBUG:teuthology.orchestra.run.smithi159:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T22:07:59.101 INFO:tasks.workunit.client.1.smithi159.stderr:+ mkdir -p fsstress 2024-09-13T22:07:59.104 INFO:tasks.workunit.client.1.smithi159.stderr:+ pushd fsstress 2024-09-13T22:07:59.105 INFO:tasks.workunit.client.1.smithi159.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T22:07:59.105 INFO:tasks.workunit.client.1.smithi159.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T22:07:59.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:07:59 smithi089 ceph-mon[27921]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:07:59.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:07:59 smithi159 ceph-mon[35348]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:08:00.019 INFO:tasks.workunit.client.1.smithi159.stderr:+ tar xzf ltp-full.tgz 2024-09-13T22:08:01.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:01 smithi089 ceph-mon[27921]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.6 KiB/s wr, 0 op/s 2024-09-13T22:08:01.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:01 smithi159 ceph-mon[35348]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.6 KiB/s wr, 0 op/s 2024-09-13T22:08:03.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:03 smithi159 ceph-mon[35348]: pgmap v233: 65 pgs: 65 active+clean; 8.6 MiB data, 199 MiB used, 536 GiB / 536 GiB avail; 687 KiB/s wr, 0 op/s 2024-09-13T22:08:03.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:03 smithi089 ceph-mon[27921]: pgmap v233: 65 pgs: 65 active+clean; 8.6 MiB data, 199 MiB used, 536 GiB / 536 GiB avail; 687 KiB/s wr, 0 op/s 2024-09-13T22:08:04.932 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:04 smithi089 ceph-mon[27921]: Upgrade: Updating mgr.smithi159.ghpomd 2024-09-13T22:08:04.933 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:04 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:04.933 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:04 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:08:04.933 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:04 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:08:04.933 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:04 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:08:04.933 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:04 smithi089 ceph-mon[27921]: Deploying daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:08:04.933 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:04 smithi089 ceph-mon[27921]: pgmap v234: 65 pgs: 65 active+clean; 16 MiB data, 234 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s wr, 71 op/s 2024-09-13T22:08:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:04 smithi159 ceph-mon[35348]: Upgrade: Updating mgr.smithi159.ghpomd 2024-09-13T22:08:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:04 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:04 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:08:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:04 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:08:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:04 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:08:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:04 smithi159 ceph-mon[35348]: Deploying daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:08:05.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:04 smithi159 ceph-mon[35348]: pgmap v234: 65 pgs: 65 active+clean; 16 MiB data, 234 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s wr, 71 op/s 2024-09-13T22:08:07.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:07 smithi089 ceph-mon[27921]: pgmap v235: 65 pgs: 65 active+clean; 28 MiB data, 303 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s wr, 172 op/s 2024-09-13T22:08:07.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:07 smithi159 ceph-mon[35348]: pgmap v235: 65 pgs: 65 active+clean; 28 MiB data, 303 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s wr, 172 op/s 2024-09-13T22:08:09.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.136+0000 7f96558dd640 1 -- 172.21.15.89:0/4094491493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500ffcf0 msgr2=0x7f9650100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.136+0000 7f96558dd640 1 --2- 172.21.15.89:0/4094491493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500ffcf0 0x7f9650100170 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9644009880 tx=0x7f964402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.136+0000 7f96558dd640 1 -- 172.21.15.89:0/4094491493 shutdown_connections 2024-09-13T22:08:09.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.136+0000 7f96558dd640 1 --2- 172.21.15.89:0/4094491493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500ffcf0 0x7f9650100170 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.136+0000 7f96558dd640 1 --2- 172.21.15.89:0/4094491493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96500feaf0 0x7f96500feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.136+0000 7f96558dd640 1 -- 172.21.15.89:0/4094491493 >> 172.21.15.89:0/4094491493 conn(0x7f96500fa280 msgr2=0x7f96500fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:09.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.136+0000 7f96558dd640 1 -- 172.21.15.89:0/4094491493 shutdown_connections 2024-09-13T22:08:09.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.136+0000 7f96558dd640 1 -- 172.21.15.89:0/4094491493 wait complete. 2024-09-13T22:08:09.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f96558dd640 1 Processor -- start 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f96558dd640 1 -- start start 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f96558dd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500feaf0 0x7f9650068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f96558dd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96500ffcf0 0x7f965019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f96558dd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96501962c0 con 0x7f96500feaf0 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f96558dd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965019cd90 con 0x7f96500ffcf0 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f964effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500feaf0 0x7f9650068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f964effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500feaf0 0x7f9650068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34068/0 (socket says 172.21.15.89:34068) 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f964effd640 1 -- 172.21.15.89:0/2581638830 learned_addr learned my addr 172.21.15.89:0/2581638830 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.137+0000 7f964e7fc640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96500ffcf0 0x7f965019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.138+0000 7f964effd640 1 -- 172.21.15.89:0/2581638830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96500ffcf0 msgr2=0x7f965019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.138+0000 7f964effd640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96500ffcf0 0x7f965019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.138+0000 7f964effd640 1 -- 172.21.15.89:0/2581638830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644009560 con 0x7f96500feaf0 2024-09-13T22:08:09.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.138+0000 7f964effd640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500feaf0 0x7f9650068790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f964000e940 tx=0x7f964000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:09.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.138+0000 7f96548db640 1 -- 172.21.15.89:0/2581638830 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96400096e0 con 0x7f96500feaf0 2024-09-13T22:08:09.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.138+0000 7f96548db640 1 -- 172.21.15.89:0/2581638830 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96400044f0 con 0x7f96500feaf0 2024-09-13T22:08:09.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.138+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965019cfc0 con 0x7f96500feaf0 2024-09-13T22:08:09.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.138+0000 7f96548db640 1 -- 172.21.15.89:0/2581638830 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9640010430 con 0x7f96500feaf0 2024-09-13T22:08:09.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.138+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965019d4e0 con 0x7f96500feaf0 2024-09-13T22:08:09.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.139+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96500feef0 con 0x7f96500feaf0 2024-09-13T22:08:09.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.140+0000 7f96548db640 1 -- 172.21.15.89:0/2581638830 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f964000cc80 con 0x7f96500feaf0 2024-09-13T22:08:09.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.140+0000 7f96548db640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f963806cc50 0x7f963806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.140+0000 7f96548db640 1 -- 172.21.15.89:0/2581638830 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9640014070 con 0x7f96500feaf0 2024-09-13T22:08:09.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.140+0000 7f964e7fc640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f963806cc50 0x7f963806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.141+0000 7f964e7fc640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f963806cc50 0x7f963806f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9644009230 tx=0x7f96440058d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:09.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.144+0000 7f96548db640 1 -- 172.21.15.89:0/2581638830 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9640056a80 con 0x7f96500feaf0 2024-09-13T22:08:09.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.340+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f965002c550 con 0x7f963806cc50 2024-09-13T22:08:09.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.341+0000 7f96548db640 1 -- 172.21.15.89:0/2581638830 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f965002c550 con 0x7f963806cc50 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.343+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f963806cc50 msgr2=0x7f963806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.343+0000 7f96558dd640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f963806cc50 0x7f963806f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9644009230 tx=0x7f96440058d0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.343+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500feaf0 msgr2=0x7f9650068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.343+0000 7f96558dd640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500feaf0 0x7f9650068790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f964000e940 tx=0x7f964000ee00 comp rx=0 tx=0).stop 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.343+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 shutdown_connections 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.343+0000 7f96558dd640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f963806cc50 0x7f963806f110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.343+0000 7f96558dd640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96500ffcf0 0x7f965019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.343+0000 7f96558dd640 1 --2- 172.21.15.89:0/2581638830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96500feaf0 0x7f9650068790 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.343+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 >> 172.21.15.89:0/2581638830 conn(0x7f96500fa280 msgr2=0x7f96501033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:09.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.344+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 shutdown_connections 2024-09-13T22:08:09.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.344+0000 7f96558dd640 1 -- 172.21.15.89:0/2581638830 wait complete. 2024-09-13T22:08:09.353 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:08:09.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.425+0000 7f35423b0640 1 -- 172.21.15.89:0/2392586552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c100d90 msgr2=0x7f353c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.425+0000 7f35423b0640 1 --2- 172.21.15.89:0/2392586552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c100d90 0x7f353c101210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3524009880 tx=0x7f352402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.425+0000 7f35423b0640 1 -- 172.21.15.89:0/2392586552 shutdown_connections 2024-09-13T22:08:09.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.425+0000 7f35423b0640 1 --2- 172.21.15.89:0/2392586552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c100d90 0x7f353c101210 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.425+0000 7f35423b0640 1 --2- 172.21.15.89:0/2392586552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f353c0ffb90 0x7f353c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.425+0000 7f35423b0640 1 -- 172.21.15.89:0/2392586552 >> 172.21.15.89:0/2392586552 conn(0x7f353c0fb320 msgr2=0x7f353c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:09.427 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:09 smithi089 ceph-mon[27921]: pgmap v236: 65 pgs: 65 active+clean; 49 MiB data, 380 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s wr, 323 op/s 2024-09-13T22:08:09.427 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:08:09.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.425+0000 7f35423b0640 1 -- 172.21.15.89:0/2392586552 shutdown_connections 2024-09-13T22:08:09.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.425+0000 7f35423b0640 1 -- 172.21.15.89:0/2392586552 wait complete. 2024-09-13T22:08:09.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.426+0000 7f35423b0640 1 Processor -- start 2024-09-13T22:08:09.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.426+0000 7f35423b0640 1 -- start start 2024-09-13T22:08:09.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.426+0000 7f35423b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c0ffb90 0x7f353c195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.426+0000 7f35423b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f353c100d90 0x7f353c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f35423b0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c196140 con 0x7f353c0ffb90 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f35423b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c1962b0 con 0x7f353c100d90 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f353bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c0ffb90 0x7f353c195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f353bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c0ffb90 0x7f353c195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34096/0 (socket says 172.21.15.89:34096) 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f353bfff640 1 -- 172.21.15.89:0/2559381927 learned_addr learned my addr 172.21.15.89:0/2559381927 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f353b7fe640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f353c100d90 0x7f353c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f353bfff640 1 -- 172.21.15.89:0/2559381927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f353c100d90 msgr2=0x7f353c195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f353bfff640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f353c100d90 0x7f353c195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f353bfff640 1 -- 172.21.15.89:0/2559381927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524009560 con 0x7f353c0ffb90 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f353bfff640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c0ffb90 0x7f353c195630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f352c00e970 tx=0x7f352c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f35397fa640 1 -- 172.21.15.89:0/2559381927 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f352c0096e0 con 0x7f353c0ffb90 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f35397fa640 1 -- 172.21.15.89:0/2559381927 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f352c0044f0 con 0x7f353c0ffb90 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.427+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353c19ad50 con 0x7f353c0ffb90 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.428+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353c19b290 con 0x7f353c0ffb90 2024-09-13T22:08:09.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.428+0000 7f35397fa640 1 -- 172.21.15.89:0/2559381927 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f352c010430 con 0x7f353c0ffb90 2024-09-13T22:08:09.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.429+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353c18f730 con 0x7f353c0ffb90 2024-09-13T22:08:09.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.429+0000 7f35397fa640 1 -- 172.21.15.89:0/2559381927 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f352c00cc90 con 0x7f353c0ffb90 2024-09-13T22:08:09.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.430+0000 7f35397fa640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f352806cc50 0x7f352806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.430+0000 7f35397fa640 1 -- 172.21.15.89:0/2559381927 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f352c014070 con 0x7f353c0ffb90 2024-09-13T22:08:09.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.430+0000 7f353b7fe640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f352806cc50 0x7f352806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.430+0000 7f353b7fe640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f352806cc50 0x7f352806f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3524000c00 tx=0x7f35240314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:09.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.434+0000 7f35397fa640 1 -- 172.21.15.89:0/2559381927 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f352c056ac0 con 0x7f353c0ffb90 2024-09-13T22:08:09.599 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:09 smithi159 ceph-mon[35348]: pgmap v236: 65 pgs: 65 active+clean; 49 MiB data, 380 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s wr, 323 op/s 2024-09-13T22:08:09.599 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:08:09.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.619+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f353c02c560 con 0x7f352806cc50 2024-09-13T22:08:09.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.620+0000 7f35397fa640 1 -- 172.21.15.89:0/2559381927 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f353c02c560 con 0x7f352806cc50 2024-09-13T22:08:09.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.622+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f352806cc50 msgr2=0x7f352806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.622+0000 7f35423b0640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f352806cc50 0x7f352806f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3524000c00 tx=0x7f35240314e0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.622+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c0ffb90 msgr2=0x7f353c195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.622+0000 7f35423b0640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c0ffb90 0x7f353c195630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f352c00e970 tx=0x7f352c00ee30 comp rx=0 tx=0).stop 2024-09-13T22:08:09.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.623+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 shutdown_connections 2024-09-13T22:08:09.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.623+0000 7f35423b0640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f352806cc50 0x7f352806f110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.623+0000 7f35423b0640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f353c100d90 0x7f353c195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.623+0000 7f35423b0640 1 --2- 172.21.15.89:0/2559381927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f353c0ffb90 0x7f353c195630 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.623+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 >> 172.21.15.89:0/2559381927 conn(0x7f353c0fb320 msgr2=0x7f353c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.623+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 shutdown_connections 2024-09-13T22:08:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.623+0000 7f35423b0640 1 -- 172.21.15.89:0/2559381927 wait complete. 2024-09-13T22:08:09.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.703+0000 7fd2c9fee640 1 -- 172.21.15.89:0/1754065793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4102f40 msgr2=0x7fd2c4105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.703+0000 7fd2c9fee640 1 --2- 172.21.15.89:0/1754065793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4102f40 0x7fd2c4105330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40098b0 tx=0x7fd2b402a4d0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.703+0000 7fd2c9fee640 1 -- 172.21.15.89:0/1754065793 shutdown_connections 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.703+0000 7fd2c9fee640 1 --2- 172.21.15.89:0/1754065793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4102f40 0x7fd2c4105330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.703+0000 7fd2c9fee640 1 --2- 172.21.15.89:0/1754065793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2c4100610 0x7fd2c4102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.703+0000 7fd2c9fee640 1 -- 172.21.15.89:0/1754065793 >> 172.21.15.89:0/1754065793 conn(0x7fd2c40fa230 msgr2=0x7fd2c40fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.703+0000 7fd2c9fee640 1 -- 172.21.15.89:0/1754065793 shutdown_connections 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.703+0000 7fd2c9fee640 1 -- 172.21.15.89:0/1754065793 wait complete. 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c9fee640 1 Processor -- start 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c9fee640 1 -- start start 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c9fee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4100610 0x7fd2c4195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c9fee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2c4102f40 0x7fd2c4195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c9fee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4196190 con 0x7fd2c4100610 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c9fee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4196300 con 0x7fd2c4102f40 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4100610 0x7fd2c4195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4100610 0x7fd2c4195680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34108/0 (socket says 172.21.15.89:34108) 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c37fe640 1 -- 172.21.15.89:0/2490739197 learned_addr learned my addr 172.21.15.89:0/2490739197 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.704+0000 7fd2c2ffd640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2c4102f40 0x7fd2c4195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.705+0000 7fd2c37fe640 1 -- 172.21.15.89:0/2490739197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2c4102f40 msgr2=0x7fd2c4195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.705+0000 7fd2c37fe640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2c4102f40 0x7fd2c4195bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.705+0000 7fd2c37fe640 1 -- 172.21.15.89:0/2490739197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4009560 con 0x7fd2c4100610 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.705+0000 7fd2c37fe640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4100610 0x7fd2c4195680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00e9a0 tx=0x7fd2ac00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:09.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.705+0000 7fd2c0ff9640 1 -- 172.21.15.89:0/2490739197 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ac00cc90 con 0x7fd2c4100610 2024-09-13T22:08:09.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.705+0000 7fd2c0ff9640 1 -- 172.21.15.89:0/2490739197 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2ac00cdf0 con 0x7fd2c4100610 2024-09-13T22:08:09.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.705+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c419ada0 con 0x7fd2c4100610 2024-09-13T22:08:09.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.705+0000 7fd2c0ff9640 1 -- 172.21.15.89:0/2490739197 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ac0187f0 con 0x7fd2c4100610 2024-09-13T22:08:09.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.705+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c419b2e0 con 0x7fd2c4100610 2024-09-13T22:08:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.706+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c4108770 con 0x7fd2c4100610 2024-09-13T22:08:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.707+0000 7fd2c0ff9640 1 -- 172.21.15.89:0/2490739197 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd2ac010c10 con 0x7fd2c4100610 2024-09-13T22:08:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.707+0000 7fd2c0ff9640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd2b006cc50 0x7fd2b006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.707+0000 7fd2c0ff9640 1 -- 172.21.15.89:0/2490739197 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd2ac014070 con 0x7fd2c4100610 2024-09-13T22:08:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.707+0000 7fd2c2ffd640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd2b006cc50 0x7fd2b006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.708+0000 7fd2c2ffd640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd2b006cc50 0x7fd2b006f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009880 tx=0x7fd2b40314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:09.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.712+0000 7fd2c0ff9640 1 -- 172.21.15.89:0/2490739197 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd2ac052e20 con 0x7fd2c4100610 2024-09-13T22:08:09.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.899+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2c419b610 con 0x7fd2b006cc50 2024-09-13T22:08:09.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.910+0000 7fd2c0ff9640 1 -- 172.21.15.89:0/2490739197 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fd2c419b610 con 0x7fd2b006cc50 2024-09-13T22:08:09.912 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:08:09.912 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (5m) 82s ago 7m 25.0M - 0.25.0 c8568f914cd2 6ef74b73ca3e 2024-09-13T22:08:09.912 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (7m) 82s ago 7m 7528k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:08:09.912 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (6m) 88s ago 6m 7356k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:08:09.912 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (7m) 82s ago 7m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:08:09.913 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (6m) 88s ago 6m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:08:09.913 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (5m) 82s ago 7m 88.2M - 9.4.7 954c08fa6188 59724cff87bd 2024-09-13T22:08:09.913 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (102s) 82s ago 101s 13.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:08:09.913 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (109s) 82s ago 108s 11.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:08:09.913 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (106s) 88s ago 106s 16.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:08:09.913 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (99s) 88s ago 99s 13.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:08:09.913 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:9283,8765,8443 running (8m) 82s ago 8m 487M - 18.2.4-845-ge4e227b3 67ddd33fa72f deeaa986e2d7 2024-09-13T22:08:09.913 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (6m) 88s ago 6m 441M - 18.2.4-845-ge4e227b3 67ddd33fa72f e126d541e564 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (8m) 82s ago 8m 47.7M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (6m) 88s ago 6m 35.3M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 82s ago 7m 15.9M - 1.5.0 0da6a335fe13 eeaf1dd44f97 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (6m) 88s ago 6m 15.6M - 1.5.0 0da6a335fe13 c76544fc91f3 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (5m) 82s ago 5m 55.6M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (5m) 82s ago 5m 50.2M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (4m) 82s ago 4m 55.9M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (4m) 88s ago 4m 52.6M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (3m) 88s ago 3m 50.9M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (3m) 88s ago 3m 51.2M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:08:09.914 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (5m) 82s ago 6m 58.3M - 2.43.0 a07b618ecd1d 4bb2a482e0e5 2024-09-13T22:08:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.913+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd2b006cc50 msgr2=0x7fd2b006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.913+0000 7fd2c9fee640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd2b006cc50 0x7fd2b006f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009880 tx=0x7fd2b40314e0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.913+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4100610 msgr2=0x7fd2c4195680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.913+0000 7fd2c9fee640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4100610 0x7fd2c4195680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00e9a0 tx=0x7fd2ac00ee60 comp rx=0 tx=0).stop 2024-09-13T22:08:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.914+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 shutdown_connections 2024-09-13T22:08:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.914+0000 7fd2c9fee640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd2b006cc50 0x7fd2b006f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.914+0000 7fd2c9fee640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2c4102f40 0x7fd2c4195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.914+0000 7fd2c9fee640 1 --2- 172.21.15.89:0/2490739197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2c4100610 0x7fd2c4195680 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.914+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 >> 172.21.15.89:0/2490739197 conn(0x7fd2c40fa230 msgr2=0x7fd2c40fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.914+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 shutdown_connections 2024-09-13T22:08:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.914+0000 7fd2c9fee640 1 -- 172.21.15.89:0/2490739197 wait complete. 2024-09-13T22:08:09.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.994+0000 7f8f86e2a640 1 -- 172.21.15.89:0/2654215337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f80100d50 msgr2=0x7f8f801031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.994+0000 7f8f86e2a640 1 --2- 172.21.15.89:0/2654215337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f80100d50 0x7f8f801031c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009880 tx=0x7f8f6c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.994+0000 7f8f86e2a640 1 -- 172.21.15.89:0/2654215337 shutdown_connections 2024-09-13T22:08:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.994+0000 7f8f86e2a640 1 --2- 172.21.15.89:0/2654215337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f80100d50 0x7f8f801031c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.994+0000 7f8f86e2a640 1 --2- 172.21.15.89:0/2654215337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f800fe400 0x7f8f80100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.994+0000 7f8f86e2a640 1 -- 172.21.15.89:0/2654215337 >> 172.21.15.89:0/2654215337 conn(0x7f8f800fa230 msgr2=0x7f8f800fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.994+0000 7f8f86e2a640 1 -- 172.21.15.89:0/2654215337 shutdown_connections 2024-09-13T22:08:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.994+0000 7f8f86e2a640 1 -- 172.21.15.89:0/2654215337 wait complete. 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f86e2a640 1 Processor -- start 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f86e2a640 1 -- start start 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f86e2a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f800fe400 0x7f8f8019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f86e2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f80100d50 0x7f8f8019c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f86e2a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8019c740 con 0x7f8f80100d50 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f86e2a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8019c8b0 con 0x7f8f800fe400 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f84bc6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f800fe400 0x7f8f8019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f7ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f80100d50 0x7f8f8019c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f84bc6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f800fe400 0x7f8f8019bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.89:45164/0 (socket says 172.21.15.89:45164) 2024-09-13T22:08:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.995+0000 7f8f84bc6640 1 -- 172.21.15.89:0/3632660788 learned_addr learned my addr 172.21.15.89:0/3632660788 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:10.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.996+0000 7f8f7ffff640 1 -- 172.21.15.89:0/3632660788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f800fe400 msgr2=0x7f8f8019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:10.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.996+0000 7f8f7ffff640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f800fe400 0x7f8f8019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.996+0000 7f8f7ffff640 1 -- 172.21.15.89:0/3632660788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c009560 con 0x7f8f80100d50 2024-09-13T22:08:10.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.996+0000 7f8f84bc6640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f800fe400 0x7f8f8019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:08:10.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.996+0000 7f8f7ffff640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f80100d50 0x7f8f8019c170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009880 tx=0x7f8f6c0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:10.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.996+0000 7f8f7dffb640 1 -- 172.21.15.89:0/3632660788 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6c004aa0 con 0x7f8f80100d50 2024-09-13T22:08:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.996+0000 7f8f7dffb640 1 -- 172.21.15.89:0/3632660788 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f6c004c00 con 0x7f8f80100d50 2024-09-13T22:08:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.996+0000 7f8f7dffb640 1 -- 172.21.15.89:0/3632660788 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6c003a80 con 0x7f8f80100d50 2024-09-13T22:08:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.996+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f801a12a0 con 0x7f8f80100d50 2024-09-13T22:08:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.997+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f801a16d0 con 0x7f8f80100d50 2024-09-13T22:08:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.998+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8010ed50 con 0x7f8f80100d50 2024-09-13T22:08:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.998+0000 7f8f7dffb640 1 -- 172.21.15.89:0/3632660788 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8f6c031c90 con 0x7f8f80100d50 2024-09-13T22:08:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.999+0000 7f8f7dffb640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8f7006cc50 0x7f8f7006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.999+0000 7f8f7dffb640 1 -- 172.21.15.89:0/3632660788 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8f6c0ad270 con 0x7f8f80100d50 2024-09-13T22:08:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.999+0000 7f8f84bc6640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8f7006cc50 0x7f8f7006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:09.999+0000 7f8f84bc6640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8f7006cc50 0x7f8f7006f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f74005fd0 tx=0x7f8f7400b4a0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.003+0000 7f8f7dffb640 1 -- 172.21.15.89:0/3632660788 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8f6c077710 con 0x7f8f80100d50 2024-09-13T22:08:10.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.245+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8f801a1c30 con 0x7f8f80100d50 2024-09-13T22:08:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.245+0000 7f8f7dffb640 1 -- 172.21.15.89:0/3632660788 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f8f6c07ad30 con 0x7f8f80100d50 2024-09-13T22:08:10.247 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:08:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:08:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:08:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:08:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:08:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:08:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:08:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:08:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:08:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:08:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:08:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:08:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:08:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:08:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 14 2024-09-13T22:08:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:08:10.249 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:08:10.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8f7006cc50 msgr2=0x7f8f7006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:10.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8f7006cc50 0x7f8f7006f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f74005fd0 tx=0x7f8f7400b4a0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f80100d50 msgr2=0x7f8f8019c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:10.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f80100d50 0x7f8f8019c170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009880 tx=0x7f8f6c0054f0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 shutdown_connections 2024-09-13T22:08:10.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f8f7006cc50 0x7f8f7006f110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f80100d50 0x7f8f8019c170 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 --2- 172.21.15.89:0/3632660788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f800fe400 0x7f8f8019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 >> 172.21.15.89:0/3632660788 conn(0x7f8f800fa230 msgr2=0x7f8f800fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:10.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 shutdown_connections 2024-09-13T22:08:10.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.247+0000 7f8f86e2a640 1 -- 172.21.15.89:0/3632660788 wait complete. 2024-09-13T22:08:10.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.330+0000 7fcf42288640 1 -- 172.21.15.89:0/2055934086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0fea80 msgr2=0x7fcf3c0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:10.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.330+0000 7fcf42288640 1 --2- 172.21.15.89:0/2055934086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0fea80 0x7fcf3c0fee80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009c20 tx=0x7fcf2c02a970 comp rx=0 tx=0).stop 2024-09-13T22:08:10.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.330+0000 7fcf42288640 1 -- 172.21.15.89:0/2055934086 shutdown_connections 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.330+0000 7fcf42288640 1 --2- 172.21.15.89:0/2055934086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf3c0ffc80 0x7fcf3c100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.330+0000 7fcf42288640 1 --2- 172.21.15.89:0/2055934086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0fea80 0x7fcf3c0fee80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.330+0000 7fcf42288640 1 -- 172.21.15.89:0/2055934086 >> 172.21.15.89:0/2055934086 conn(0x7fcf3c0fa230 msgr2=0x7fcf3c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf42288640 1 -- 172.21.15.89:0/2055934086 shutdown_connections 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf42288640 1 -- 172.21.15.89:0/2055934086 wait complete. 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf42288640 1 Processor -- start 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf42288640 1 -- start start 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf42288640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf3c0fea80 0x7fcf3c195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf42288640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0ffc80 0x7fcf3c195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf42288640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c196180 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf42288640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c1962f0 con 0x7fcf3c0fea80 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf33fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0ffc80 0x7fcf3c195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf33fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0ffc80 0x7fcf3c195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34156/0 (socket says 172.21.15.89:34156) 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.331+0000 7fcf33fff640 1 -- 172.21.15.89:0/1901181549 learned_addr learned my addr 172.21.15.89:0/1901181549 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf3bfff640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf3c0fea80 0x7fcf3c195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf33fff640 1 -- 172.21.15.89:0/1901181549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf3c0fea80 msgr2=0x7fcf3c195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf33fff640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf3c0fea80 0x7fcf3c195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf33fff640 1 -- 172.21.15.89:0/1901181549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c009900 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf33fff640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0ffc80 0x7fcf3c195bb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400d720 tx=0x7fcf2400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf39ffb640 1 -- 172.21.15.89:0/1901181549 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf240051f0 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf39ffb640 1 -- 172.21.15.89:0/1901181549 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf24009ce0 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c19ad40 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf39ffb640 1 -- 172.21.15.89:0/1901181549 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf24010460 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.332+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c19b310 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.333+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c107690 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.334+0000 7fcf39ffb640 1 -- 172.21.15.89:0/1901181549 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcf24005350 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.334+0000 7fcf39ffb640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcf2806cc50 0x7fcf2806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:10.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.334+0000 7fcf39ffb640 1 -- 172.21.15.89:0/1901181549 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fcf2408bd70 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.334+0000 7fcf3bfff640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcf2806cc50 0x7fcf2806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:10.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.335+0000 7fcf3bfff640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcf2806cc50 0x7fcf2806f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c000f80 tx=0x7fcf2c03d040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:10.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.339+0000 7fcf39ffb640 1 -- 172.21.15.89:0/1901181549 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcf24056190 con 0x7fcf3c0ffc80 2024-09-13T22:08:10.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:10 smithi089 ceph-mon[27921]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:10.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:10 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3632660788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:08:10.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.529+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf3c0fc3c0 con 0x7fcf2806cc50 2024-09-13T22:08:10.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.530+0000 7fcf39ffb640 1 -- 172.21.15.89:0/1901181549 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fcf3c0fc3c0 con 0x7fcf2806cc50 2024-09-13T22:08:10.531 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:08:10.531 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:08:10.531 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:08:10.532 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:08:10.532 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T22:08:10.532 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/2 daemons upgraded", 2024-09-13T22:08:10.532 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T22:08:10.532 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:08:10.532 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:08:10.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcf2806cc50 msgr2=0x7fcf2806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:10.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcf2806cc50 0x7fcf2806f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c000f80 tx=0x7fcf2c03d040 comp rx=0 tx=0).stop 2024-09-13T22:08:10.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0ffc80 msgr2=0x7fcf3c195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:10.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0ffc80 0x7fcf3c195bb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400d720 tx=0x7fcf2400dbe0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 shutdown_connections 2024-09-13T22:08:10.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fcf2806cc50 0x7fcf2806f110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf3c0ffc80 0x7fcf3c195bb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 --2- 172.21.15.89:0/1901181549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf3c0fea80 0x7fcf3c195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:10.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 >> 172.21.15.89:0/1901181549 conn(0x7fcf3c0fa230 msgr2=0x7fcf3c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:10.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 shutdown_connections 2024-09-13T22:08:10.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:10.532+0000 7fcf42288640 1 -- 172.21.15.89:0/1901181549 wait complete. 2024-09-13T22:08:10.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:10 smithi159 ceph-mon[35348]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:10.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:10 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3632660788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:08:11.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:11 smithi089 ceph-mon[27921]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:11 smithi089 ceph-mon[27921]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:11 smithi089 ceph-mon[27921]: pgmap v237: 65 pgs: 65 active+clean; 61 MiB data, 424 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s wr, 353 op/s 2024-09-13T22:08:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:11 smithi089 ceph-mon[27921]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:11 smithi159 ceph-mon[35348]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:11 smithi159 ceph-mon[35348]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:11 smithi159 ceph-mon[35348]: pgmap v237: 65 pgs: 65 active+clean; 61 MiB data, 424 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s wr, 353 op/s 2024-09-13T22:08:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:11 smithi159 ceph-mon[35348]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:13.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:13 smithi159 ceph-mon[35348]: pgmap v238: 65 pgs: 65 active+clean; 74 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s wr, 360 op/s 2024-09-13T22:08:13.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:13 smithi089 ceph-mon[27921]: pgmap v238: 65 pgs: 65 active+clean; 74 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s wr, 360 op/s 2024-09-13T22:08:15.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:15 smithi089 ceph-mon[27921]: pgmap v239: 65 pgs: 65 active+clean; 74 MiB data, 459 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s wr, 359 op/s 2024-09-13T22:08:15.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:15 smithi159 ceph-mon[35348]: pgmap v239: 65 pgs: 65 active+clean; 74 MiB data, 459 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s wr, 359 op/s 2024-09-13T22:08:17.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:17 smithi159 ceph-mon[35348]: pgmap v240: 65 pgs: 65 active+clean; 86 MiB data, 496 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s wr, 378 op/s 2024-09-13T22:08:17.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:17 smithi089 ceph-mon[27921]: pgmap v240: 65 pgs: 65 active+clean; 86 MiB data, 496 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s wr, 378 op/s 2024-09-13T22:08:19.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:19 smithi089 ceph-mon[27921]: pgmap v241: 65 pgs: 65 active+clean; 105 MiB data, 537 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s wr, 435 op/s 2024-09-13T22:08:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:19 smithi159 ceph-mon[35348]: pgmap v241: 65 pgs: 65 active+clean; 105 MiB data, 537 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s wr, 435 op/s 2024-09-13T22:08:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:21 smithi089 ceph-mon[27921]: pgmap v242: 65 pgs: 65 active+clean; 120 MiB data, 605 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 487 op/s 2024-09-13T22:08:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:21 smithi159 ceph-mon[35348]: pgmap v242: 65 pgs: 65 active+clean; 120 MiB data, 605 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 487 op/s 2024-09-13T22:08:23.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:23 smithi089 ceph-mon[27921]: pgmap v243: 65 pgs: 65 active+clean; 143 MiB data, 713 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s wr, 691 op/s 2024-09-13T22:08:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:23 smithi159 ceph-mon[35348]: pgmap v243: 65 pgs: 65 active+clean; 143 MiB data, 713 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s wr, 691 op/s 2024-09-13T22:08:24.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:24 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:08:24.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:24 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:08:25.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:25 smithi159 ceph-mon[35348]: pgmap v244: 65 pgs: 65 active+clean; 156 MiB data, 772 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s wr, 805 op/s 2024-09-13T22:08:25.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:25 smithi089 ceph-mon[27921]: pgmap v244: 65 pgs: 65 active+clean; 156 MiB data, 772 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s wr, 805 op/s 2024-09-13T22:08:27.482 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:27 smithi159 ceph-mon[35348]: pgmap v245: 65 pgs: 65 active+clean; 160 MiB data, 788 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s wr, 810 op/s 2024-09-13T22:08:27.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:27 smithi089 ceph-mon[27921]: pgmap v245: 65 pgs: 65 active+clean; 160 MiB data, 788 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s wr, 810 op/s 2024-09-13T22:08:28.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:28.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:28.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:28 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:08:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:28 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:08:29.534 INFO:tasks.workunit.client.0.smithi089.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T22:08:29.545 INFO:tasks.workunit.client.0.smithi089.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T22:08:29.546 INFO:tasks.workunit.client.0.smithi089.stderr:+ make 2024-09-13T22:08:29.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:29 smithi089 ceph-mon[27921]: pgmap v246: 65 pgs: 65 active+clean; 168 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s wr, 727 op/s 2024-09-13T22:08:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:29 smithi159 ceph-mon[35348]: pgmap v246: 65 pgs: 65 active+clean; 168 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s wr, 727 op/s 2024-09-13T22:08:30.641 INFO:tasks.workunit.client.0.smithi089.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T22:08:30.934 INFO:tasks.workunit.client.0.smithi089.stderr:++ readlink -f fsstress 2024-09-13T22:08:30.935 INFO:tasks.workunit.client.0.smithi089.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T22:08:30.935 INFO:tasks.workunit.client.0.smithi089.stderr:+ popd 2024-09-13T22:08:30.935 INFO:tasks.workunit.client.0.smithi089.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T22:08:30.936 INFO:tasks.workunit.client.0.smithi089.stderr:+ popd 2024-09-13T22:08:30.936 INFO:tasks.workunit.client.0.smithi089.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T22:08:30.936 INFO:tasks.workunit.client.0.smithi089.stderr:++ mktemp -d -p . 2024-09-13T22:08:30.938 INFO:tasks.workunit.client.0.smithi089.stderr:+ T=./tmp.sKhXxecTPl 2024-09-13T22:08:30.938 INFO:tasks.workunit.client.0.smithi089.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.sKhXxecTPl -l 1 -n 1000 -p 10 -v 2024-09-13T22:08:30.940 INFO:tasks.workunit.client.0.smithi089.stdout:seed = 1726672546 2024-09-13T22:08:30.945 INFO:tasks.workunit.client.0.smithi089.stdout:0/0: fsync - no filename 2024-09-13T22:08:30.946 INFO:tasks.workunit.client.0.smithi089.stdout:0/1: write - no filename 2024-09-13T22:08:30.946 INFO:tasks.workunit.client.0.smithi089.stdout:0/2: chown . 871 1 2024-09-13T22:08:30.947 INFO:tasks.workunit.client.0.smithi089.stdout:1/0: stat - no entries 2024-09-13T22:08:30.948 INFO:tasks.workunit.client.0.smithi089.stdout:1/1: dwrite - no filename 2024-09-13T22:08:30.948 INFO:tasks.workunit.client.0.smithi089.stdout:1/2: write - no filename 2024-09-13T22:08:30.948 INFO:tasks.workunit.client.0.smithi089.stdout:1/3: write - no filename 2024-09-13T22:08:30.949 INFO:tasks.workunit.client.0.smithi089.stdout:0/3: creat f0 x:0 0 0 2024-09-13T22:08:30.949 INFO:tasks.workunit.client.0.smithi089.stdout:0/4: dread - f0 zero size 2024-09-13T22:08:30.949 INFO:tasks.workunit.client.0.smithi089.stdout:0/5: dread - f0 zero size 2024-09-13T22:08:30.949 INFO:tasks.workunit.client.0.smithi089.stdout:0/6: stat f0 0 2024-09-13T22:08:30.949 INFO:tasks.workunit.client.0.smithi089.stdout:0/7: read - f0 zero size 2024-09-13T22:08:30.952 INFO:tasks.workunit.client.0.smithi089.stdout:1/4: creat f0 x:0 0 0 2024-09-13T22:08:30.954 INFO:tasks.workunit.client.0.smithi089.stdout:0/8: mkdir d1 0 2024-09-13T22:08:30.954 INFO:tasks.workunit.client.0.smithi089.stdout:0/9: dread - f0 zero size 2024-09-13T22:08:30.954 INFO:tasks.workunit.client.0.smithi089.stdout:0/10: write f0 [857996,57398] 0 2024-09-13T22:08:30.954 INFO:tasks.workunit.client.0.smithi089.stdout:3/0: dread - no filename 2024-09-13T22:08:30.954 INFO:tasks.workunit.client.0.smithi089.stdout:3/1: rmdir - no directory 2024-09-13T22:08:30.955 INFO:tasks.workunit.client.0.smithi089.stdout:3/2: chown . 554 1 2024-09-13T22:08:30.956 INFO:tasks.workunit.client.0.smithi089.stdout:2/0: symlink l0 0 2024-09-13T22:08:30.957 INFO:tasks.workunit.client.0.smithi089.stdout:4/0: chown . 278737 1 2024-09-13T22:08:30.969 INFO:tasks.workunit.client.0.smithi089.stdout:2/1: mknod c1 0 2024-09-13T22:08:30.969 INFO:tasks.workunit.client.0.smithi089.stdout:3/3: creat f0 x:0 0 0 2024-09-13T22:08:30.969 INFO:tasks.workunit.client.0.smithi089.stdout:2/2: dwrite - no filename 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/3: truncate - no filename 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/4: dread - no filename 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/5: rmdir - no directory 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/6: read - no filename 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/7: read - no filename 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/8: dwrite - no filename 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:3/4: chown f0 137920581 1 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/9: readlink l0 0 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/10: chown l0 46 1 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/11: dread - no filename 2024-09-13T22:08:30.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/12: fsync - no filename 2024-09-13T22:08:30.971 INFO:tasks.workunit.client.0.smithi089.stdout:0/11: dread f0 [0,4194304] 0 2024-09-13T22:08:30.995 INFO:tasks.workunit.client.0.smithi089.stdout:1/5: dwrite f0 [0,4194304] 0 2024-09-13T22:08:30.995 INFO:tasks.workunit.client.0.smithi089.stdout:3/5: mkdir d1 0 2024-09-13T22:08:30.995 INFO:tasks.workunit.client.0.smithi089.stdout:3/6: write f0 [172075,122695] 0 2024-09-13T22:08:30.995 INFO:tasks.workunit.client.0.smithi089.stdout:2/13: mknod c2 0 2024-09-13T22:08:30.995 INFO:tasks.workunit.client.0.smithi089.stdout:2/14: write - no filename 2024-09-13T22:08:31.004 INFO:tasks.workunit.client.0.smithi089.stdout:0/12: mknod d1/c2 0 2024-09-13T22:08:31.004 INFO:tasks.workunit.client.0.smithi089.stdout:0/13: chown d1/c2 7388524 1 2024-09-13T22:08:31.012 INFO:tasks.workunit.client.0.smithi089.stdout:2/15: unlink c2 0 2024-09-13T22:08:31.020 INFO:tasks.workunit.client.0.smithi089.stdout:2/16: creat f3 x:0 0 0 2024-09-13T22:08:31.021 INFO:tasks.workunit.client.0.smithi089.stdout:2/17: readlink l0 0 2024-09-13T22:08:31.021 INFO:tasks.workunit.client.0.smithi089.stdout:2/18: dread - f3 zero size 2024-09-13T22:08:31.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:31 smithi159 ceph-mon[35348]: pgmap v247: 65 pgs: 65 active+clean; 172 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s wr, 575 op/s 2024-09-13T22:08:31.585 INFO:tasks.workunit.client.0.smithi089.stdout:3/7: fdatasync f0 0 2024-09-13T22:08:31.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:31 smithi089 ceph-mon[27921]: pgmap v247: 65 pgs: 65 active+clean; 172 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s wr, 575 op/s 2024-09-13T22:08:32.005 INFO:tasks.workunit.client.0.smithi089.stdout:5/0: rename - no filename 2024-09-13T22:08:32.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/0: dwrite - no filename 2024-09-13T22:08:32.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/1: fdatasync - no filename 2024-09-13T22:08:32.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/2: unlink - no file 2024-09-13T22:08:32.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/3: unlink - no file 2024-09-13T22:08:32.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/4: write - no filename 2024-09-13T22:08:32.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/5: chown . 539 1 2024-09-13T22:08:32.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/6: chown . 67882 1 2024-09-13T22:08:32.006 INFO:tasks.workunit.client.0.smithi089.stdout:6/7: chown . 1 1 2024-09-13T22:08:32.006 INFO:tasks.workunit.client.0.smithi089.stdout:6/8: chown . 28986 1 2024-09-13T22:08:32.006 INFO:tasks.workunit.client.0.smithi089.stdout:8/0: dwrite - no filename 2024-09-13T22:08:32.006 INFO:tasks.workunit.client.0.smithi089.stdout:8/1: fsync - no filename 2024-09-13T22:08:32.006 INFO:tasks.workunit.client.0.smithi089.stdout:8/2: getdents . 0 2024-09-13T22:08:32.006 INFO:tasks.workunit.client.0.smithi089.stdout:8/3: getdents . 0 2024-09-13T22:08:32.076 INFO:tasks.workunit.client.0.smithi089.stdout:2/19: dwrite f3 [0,4194304] 0 2024-09-13T22:08:32.135 INFO:tasks.workunit.client.0.smithi089.stdout:1/6: dread f0 [0,4194304] 0 2024-09-13T22:08:32.917 INFO:tasks.workunit.client.0.smithi089.stdout:3/8: mkdir d1/d2 0 2024-09-13T22:08:32.994 INFO:tasks.workunit.client.0.smithi089.stdout:0/14: getdents d1 0 2024-09-13T22:08:33.051 INFO:tasks.workunit.client.0.smithi089.stdout:7/0: mkdir d0 0 2024-09-13T22:08:33.051 INFO:tasks.workunit.client.0.smithi089.stdout:7/1: write - no filename 2024-09-13T22:08:33.051 INFO:tasks.workunit.client.0.smithi089.stdout:7/2: dread - no filename 2024-09-13T22:08:33.052 INFO:tasks.workunit.client.0.smithi089.stdout:5/1: mknod c0 0 2024-09-13T22:08:33.053 INFO:tasks.workunit.client.0.smithi089.stdout:9/0: creat f0 x:0 0 0 2024-09-13T22:08:33.053 INFO:tasks.workunit.client.0.smithi089.stdout:9/1: creat f1 x:0 0 0 2024-09-13T22:08:33.054 INFO:tasks.workunit.client.0.smithi089.stdout:9/2: rmdir - no directory 2024-09-13T22:08:33.054 INFO:tasks.workunit.client.0.smithi089.stdout:6/9: mkdir d0 0 2024-09-13T22:08:33.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/10: write - no filename 2024-09-13T22:08:33.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/11: dread - no filename 2024-09-13T22:08:33.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/12: chown d0 4329 1 2024-09-13T22:08:33.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/13: fsync - no filename 2024-09-13T22:08:33.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/14: rename d0 to d0/d1 22 2024-09-13T22:08:33.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/15: fdatasync - no filename 2024-09-13T22:08:33.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/16: write - no filename 2024-09-13T22:08:33.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/17: stat d0 0 2024-09-13T22:08:33.066 INFO:tasks.workunit.client.0.smithi089.stdout:2/20: symlink l4 0 2024-09-13T22:08:33.082 INFO:tasks.workunit.client.0.smithi089.stdout:1/7: mknod c1 0 2024-09-13T22:08:33.082 INFO:tasks.workunit.client.0.smithi089.stdout:1/8: readlink - no filename 2024-09-13T22:08:33.082 INFO:tasks.workunit.client.0.smithi089.stdout:1/9: readlink - no filename 2024-09-13T22:08:33.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:33 smithi089 ceph-mon[27921]: pgmap v248: 65 pgs: 65 active+clean; 186 MiB data, 865 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s wr, 439 op/s 2024-09-13T22:08:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:33 smithi089 ceph-mon[27921]: Standby manager daemon smithi159.ghpomd restarted 2024-09-13T22:08:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:33 smithi089 ceph-mon[27921]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:08:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:33 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:08:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:33 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:08:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:33 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:08:33.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:33 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:08:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:33 smithi159 ceph-mon[35348]: pgmap v248: 65 pgs: 65 active+clean; 186 MiB data, 865 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s wr, 439 op/s 2024-09-13T22:08:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:33 smithi159 ceph-mon[35348]: Standby manager daemon smithi159.ghpomd restarted 2024-09-13T22:08:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:33 smithi159 ceph-mon[35348]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:08:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:33 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:08:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:33 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:08:33.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:33 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:08:33.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:33 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:08:34.390 INFO:tasks.workunit.client.0.smithi089.stdout:2/21: dwrite f3 [4194304,4194304] 0 2024-09-13T22:08:34.574 INFO:tasks.workunit.client.0.smithi089.stdout:0/15: creat d1/f3 x:0 0 0 2024-09-13T22:08:34.576 INFO:tasks.workunit.client.0.smithi089.stdout:7/3: mknod d0/c1 0 2024-09-13T22:08:34.578 INFO:tasks.workunit.client.0.smithi089.stdout:5/2: mknod c1 0 2024-09-13T22:08:34.583 INFO:tasks.workunit.client.0.smithi089.stdout:6/18: creat d0/f2 x:0 0 0 2024-09-13T22:08:34.583 INFO:tasks.workunit.client.0.smithi089.stdout:6/19: chown d0/f2 3640 1 2024-09-13T22:08:34.583 INFO:tasks.workunit.client.0.smithi089.stdout:6/20: creat d0/f3 x:0 0 0 2024-09-13T22:08:34.584 INFO:tasks.workunit.client.0.smithi089.stdout:1/10: mknod c2 0 2024-09-13T22:08:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:2/22: mkdir d5 0 2024-09-13T22:08:34.618 INFO:tasks.workunit.client.0.smithi089.stdout:3/9: link f0 d1/d2/f3 0 2024-09-13T22:08:34.619 INFO:tasks.workunit.client.0.smithi089.stdout:0/16: creat d1/f4 x:0 0 0 2024-09-13T22:08:34.621 INFO:tasks.workunit.client.0.smithi089.stdout:0/17: write f0 [502748,16435] 0 2024-09-13T22:08:34.621 INFO:tasks.workunit.client.0.smithi089.stdout:7/4: unlink d0/c1 0 2024-09-13T22:08:34.622 INFO:tasks.workunit.client.0.smithi089.stdout:5/3: creat f2 x:0 0 0 2024-09-13T22:08:34.625 INFO:tasks.workunit.client.0.smithi089.stdout:6/21: mkdir d0/d4 0 2024-09-13T22:08:34.625 INFO:tasks.workunit.client.0.smithi089.stdout:6/22: truncate d0/f3 775154 0 2024-09-13T22:08:34.626 INFO:tasks.workunit.client.0.smithi089.stdout:1/11: symlink l3 0 2024-09-13T22:08:34.630 INFO:tasks.workunit.client.0.smithi089.stdout:3/10: mkdir d1/d2/d4 0 2024-09-13T22:08:34.631 INFO:tasks.workunit.client.0.smithi089.stdout:0/18: creat d1/f5 x:0 0 0 2024-09-13T22:08:34.631 INFO:tasks.workunit.client.0.smithi089.stdout:0/19: chown d1/f4 2065799 1 2024-09-13T22:08:34.632 INFO:tasks.workunit.client.0.smithi089.stdout:1/12: dread f0 [0,4194304] 0 2024-09-13T22:08:34.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/5: mknod d0/c2 0 2024-09-13T22:08:34.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/6: dwrite - no filename 2024-09-13T22:08:34.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/7: chown d0/c2 210058784 1 2024-09-13T22:08:34.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/8: truncate - no filename 2024-09-13T22:08:34.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/9: dread - no filename 2024-09-13T22:08:34.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/10: write - no filename 2024-09-13T22:08:34.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/11: write - no filename 2024-09-13T22:08:34.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/12: stat d0 0 2024-09-13T22:08:34.637 INFO:tasks.workunit.client.0.smithi089.stdout:3/11: link f0 d1/d2/d4/f5 0 2024-09-13T22:08:34.639 INFO:tasks.workunit.client.0.smithi089.stdout:0/20: creat d1/f6 x:0 0 0 2024-09-13T22:08:34.639 INFO:tasks.workunit.client.0.smithi089.stdout:0/21: write d1/f6 [764575,20443] 0 2024-09-13T22:08:34.639 INFO:tasks.workunit.client.0.smithi089.stdout:0/22: chown f0 241 1 2024-09-13T22:08:34.641 INFO:tasks.workunit.client.0.smithi089.stdout:1/13: mknod c4 0 2024-09-13T22:08:34.641 INFO:tasks.workunit.client.0.smithi089.stdout:1/14: chown c4 2009377 1 2024-09-13T22:08:34.646 INFO:tasks.workunit.client.0.smithi089.stdout:3/12: creat d1/f6 x:0 0 0 2024-09-13T22:08:34.649 INFO:tasks.workunit.client.0.smithi089.stdout:1/15: link c2 c5 0 2024-09-13T22:08:34.652 INFO:tasks.workunit.client.0.smithi089.stdout:3/13: mkdir d1/d7 0 2024-09-13T22:08:34.652 INFO:tasks.workunit.client.0.smithi089.stdout:3/14: write d1/d2/d4/f5 [917757,9329] 0 2024-09-13T22:08:34.652 INFO:tasks.workunit.client.0.smithi089.stdout:3/15: write d1/d2/d4/f5 [1103375,24083] 0 2024-09-13T22:08:34.652 INFO:tasks.workunit.client.0.smithi089.stdout:3/16: rename d1 to d1/d8 22 2024-09-13T22:08:34.654 INFO:tasks.workunit.client.0.smithi089.stdout:0/23: link d1/f5 d1/f7 0 2024-09-13T22:08:34.654 INFO:tasks.workunit.client.0.smithi089.stdout:0/24: write d1/f4 [561822,125253] 0 2024-09-13T22:08:34.655 INFO:tasks.workunit.client.0.smithi089.stdout:1/16: rename c2 to c6 0 2024-09-13T22:08:34.657 INFO:tasks.workunit.client.0.smithi089.stdout:3/17: creat d1/d2/d4/f9 x:0 0 0 2024-09-13T22:08:34.659 INFO:tasks.workunit.client.0.smithi089.stdout:3/18: mkdir d1/d2/d4/da 0 2024-09-13T22:08:34.660 INFO:tasks.workunit.client.0.smithi089.stdout:3/19: mknod d1/d7/cb 0 2024-09-13T22:08:34.663 INFO:tasks.workunit.client.0.smithi089.stdout:3/20: mknod d1/d7/cc 0 2024-09-13T22:08:34.682 INFO:tasks.workunit.client.0.smithi089.stdout:1/17: dwrite f0 [0,4194304] 0 2024-09-13T22:08:34.682 INFO:tasks.workunit.client.0.smithi089.stdout:1/18: chown c1 2 1 2024-09-13T22:08:34.685 INFO:tasks.workunit.client.0.smithi089.stdout:1/19: mkdir d7 0 2024-09-13T22:08:34.690 INFO:tasks.workunit.client.0.smithi089.stdout:3/21: dwrite d1/d2/f3 [0,4194304] 0 2024-09-13T22:08:34.695 INFO:tasks.workunit.client.0.smithi089.stdout:3/22: mknod d1/d2/d4/cd 0 2024-09-13T22:08:34.695 INFO:tasks.workunit.client.0.smithi089.stdout:0/25: dwrite d1/f6 [0,4194304] 0 2024-09-13T22:08:34.695 INFO:tasks.workunit.client.0.smithi089.stdout:1/20: dread f0 [0,4194304] 0 2024-09-13T22:08:34.695 INFO:tasks.workunit.client.0.smithi089.stdout:0/26: dread - d1/f3 zero size 2024-09-13T22:08:34.700 INFO:tasks.workunit.client.0.smithi089.stdout:0/27: unlink d1/f3 0 2024-09-13T22:08:34.700 INFO:tasks.workunit.client.0.smithi089.stdout:0/28: chown d1 0 1 2024-09-13T22:08:34.700 INFO:tasks.workunit.client.0.smithi089.stdout:0/29: truncate d1/f4 1382166 0 2024-09-13T22:08:34.701 INFO:tasks.workunit.client.0.smithi089.stdout:1/21: creat d7/f8 x:0 0 0 2024-09-13T22:08:34.711 INFO:tasks.workunit.client.0.smithi089.stdout:0/30: dread d1/f6 [0,4194304] 0 2024-09-13T22:08:34.715 INFO:tasks.workunit.client.0.smithi089.stdout:0/31: rename d1/f6 to d1/f8 0 2024-09-13T22:08:34.719 INFO:tasks.workunit.client.0.smithi089.stdout:0/32: symlink d1/l9 0 2024-09-13T22:08:34.725 INFO:tasks.workunit.client.0.smithi089.stdout:1/22: dwrite d7/f8 [0,4194304] 0 2024-09-13T22:08:34.725 INFO:tasks.workunit.client.0.smithi089.stdout:1/23: creat d7/f9 x:0 0 0 2024-09-13T22:08:34.727 INFO:tasks.workunit.client.0.smithi089.stdout:1/24: mknod d7/ca 0 2024-09-13T22:08:34.727 INFO:tasks.workunit.client.0.smithi089.stdout:1/25: fsync f0 0 2024-09-13T22:08:34.729 INFO:tasks.workunit.client.0.smithi089.stdout:1/26: rename d7/f8 to d7/fb 0 2024-09-13T22:08:34.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:34 smithi089 ceph-mon[27921]: mgrmap e20: smithi089.naneiw(active, since 7m), standbys: smithi159.ghpomd 2024-09-13T22:08:34.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:34 smithi159 ceph-mon[35348]: mgrmap e20: smithi089.naneiw(active, since 7m), standbys: smithi159.ghpomd 2024-09-13T22:08:35.474 INFO:tasks.workunit.client.0.smithi089.stdout:9/3: getdents . 0 2024-09-13T22:08:35.475 INFO:tasks.workunit.client.0.smithi089.stdout:9/4: readlink - no filename 2024-09-13T22:08:35.475 INFO:tasks.workunit.client.0.smithi089.stdout:4/1: sync 2024-09-13T22:08:35.475 INFO:tasks.workunit.client.0.smithi089.stdout:4/2: dread - no filename 2024-09-13T22:08:35.475 INFO:tasks.workunit.client.0.smithi089.stdout:4/3: fdatasync - no filename 2024-09-13T22:08:35.475 INFO:tasks.workunit.client.0.smithi089.stdout:9/5: mknod c2 0 2024-09-13T22:08:35.476 INFO:tasks.workunit.client.0.smithi089.stdout:4/4: mkdir d0 0 2024-09-13T22:08:35.476 INFO:tasks.workunit.client.0.smithi089.stdout:4/5: chown d0 2338270 1 2024-09-13T22:08:35.477 INFO:tasks.workunit.client.0.smithi089.stdout:4/6: dread - no filename 2024-09-13T22:08:35.477 INFO:tasks.workunit.client.0.smithi089.stdout:4/7: fdatasync - no filename 2024-09-13T22:08:35.477 INFO:tasks.workunit.client.0.smithi089.stdout:4/8: write - no filename 2024-09-13T22:08:35.478 INFO:tasks.workunit.client.0.smithi089.stdout:4/9: mknod d0/c1 0 2024-09-13T22:08:35.478 INFO:tasks.workunit.client.0.smithi089.stdout:4/10: write - no filename 2024-09-13T22:08:35.478 INFO:tasks.workunit.client.0.smithi089.stdout:4/11: write - no filename 2024-09-13T22:08:35.478 INFO:tasks.workunit.client.0.smithi089.stdout:4/12: dread - no filename 2024-09-13T22:08:35.478 INFO:tasks.workunit.client.0.smithi089.stdout:4/13: dwrite - no filename 2024-09-13T22:08:35.478 INFO:tasks.workunit.client.0.smithi089.stdout:4/14: truncate - no filename 2024-09-13T22:08:35.478 INFO:tasks.workunit.client.0.smithi089.stdout:4/15: dread - no filename 2024-09-13T22:08:35.479 INFO:tasks.workunit.client.0.smithi089.stdout:9/6: symlink l3 0 2024-09-13T22:08:35.480 INFO:tasks.workunit.client.0.smithi089.stdout:4/16: creat d0/f2 x:0 0 0 2024-09-13T22:08:35.480 INFO:tasks.workunit.client.0.smithi089.stdout:9/7: write f0 [168798,24555] 0 2024-09-13T22:08:35.482 INFO:tasks.workunit.client.0.smithi089.stdout:4/17: rename d0/c1 to d0/c3 0 2024-09-13T22:08:35.493 INFO:tasks.workunit.client.0.smithi089.stdout:8/4: sync 2024-09-13T22:08:35.493 INFO:tasks.workunit.client.0.smithi089.stdout:8/5: dread - no filename 2024-09-13T22:08:35.493 INFO:tasks.workunit.client.0.smithi089.stdout:8/6: link - no file 2024-09-13T22:08:35.494 INFO:tasks.workunit.client.0.smithi089.stdout:8/7: mkdir d0 0 2024-09-13T22:08:35.495 INFO:tasks.workunit.client.0.smithi089.stdout:8/8: creat d0/f1 x:0 0 0 2024-09-13T22:08:35.495 INFO:tasks.workunit.client.0.smithi089.stdout:8/9: write d0/f1 [193531,26313] 0 2024-09-13T22:08:35.497 INFO:tasks.workunit.client.0.smithi089.stdout:9/8: dwrite f0 [0,4194304] 0 2024-09-13T22:08:35.497 INFO:tasks.workunit.client.0.smithi089.stdout:9/9: readlink l3 0 2024-09-13T22:08:35.499 INFO:tasks.workunit.client.0.smithi089.stdout:9/10: symlink l4 0 2024-09-13T22:08:35.500 INFO:tasks.workunit.client.0.smithi089.stdout:9/11: fdatasync f1 0 2024-09-13T22:08:35.500 INFO:tasks.workunit.client.0.smithi089.stdout:3/23: getdents d1/d2 0 2024-09-13T22:08:35.502 INFO:tasks.workunit.client.0.smithi089.stdout:8/10: dread d0/f1 [0,4194304] 0 2024-09-13T22:08:35.502 INFO:tasks.workunit.client.0.smithi089.stdout:8/11: truncate d0/f1 354826 0 2024-09-13T22:08:35.502 INFO:tasks.workunit.client.0.smithi089.stdout:9/12: symlink l5 0 2024-09-13T22:08:35.505 INFO:tasks.workunit.client.0.smithi089.stdout:2/23: truncate f3 4309 0 2024-09-13T22:08:35.506 INFO:tasks.workunit.client.0.smithi089.stdout:2/24: rmdir d5 0 2024-09-13T22:08:35.506 INFO:tasks.workunit.client.0.smithi089.stdout:2/25: chown l0 15875847 1 2024-09-13T22:08:35.507 INFO:tasks.workunit.client.0.smithi089.stdout:3/24: write f0 [3946651,61582] 0 2024-09-13T22:08:35.508 INFO:tasks.workunit.client.0.smithi089.stdout:2/26: rename l0 to l6 0 2024-09-13T22:08:35.511 INFO:tasks.workunit.client.0.smithi089.stdout:6/23: truncate d0/f3 539232 0 2024-09-13T22:08:35.511 INFO:tasks.workunit.client.0.smithi089.stdout:6/24: dread - d0/f2 zero size 2024-09-13T22:08:35.511 INFO:tasks.workunit.client.0.smithi089.stdout:6/25: dread - d0/f2 zero size 2024-09-13T22:08:35.512 INFO:tasks.workunit.client.0.smithi089.stdout:6/26: mkdir d0/d5 0 2024-09-13T22:08:35.524 INFO:tasks.workunit.client.0.smithi089.stdout:1/27: truncate f0 4079282 0 2024-09-13T22:08:35.524 INFO:tasks.workunit.client.0.smithi089.stdout:8/12: dwrite d0/f1 [0,4194304] 0 2024-09-13T22:08:35.529 INFO:tasks.workunit.client.0.smithi089.stdout:3/25: rmdir d1/d2/d4 39 2024-09-13T22:08:35.529 INFO:tasks.workunit.client.0.smithi089.stdout:3/26: write d1/d2/f3 [4869321,41751] 0 2024-09-13T22:08:35.530 INFO:tasks.workunit.client.0.smithi089.stdout:3/27: symlink d1/d7/le 0 2024-09-13T22:08:35.531 INFO:tasks.workunit.client.0.smithi089.stdout:3/28: creat d1/d2/ff x:0 0 0 2024-09-13T22:08:35.531 INFO:tasks.workunit.client.0.smithi089.stdout:3/29: write d1/d2/d4/f5 [2948163,111321] 0 2024-09-13T22:08:35.531 INFO:tasks.workunit.client.0.smithi089.stdout:3/30: creat d1/d2/f10 x:0 0 0 2024-09-13T22:08:35.531 INFO:tasks.workunit.client.0.smithi089.stdout:3/31: write d1/f6 [518060,65071] 0 2024-09-13T22:08:35.532 INFO:tasks.workunit.client.0.smithi089.stdout:3/32: symlink d1/d7/l11 0 2024-09-13T22:08:35.533 INFO:tasks.workunit.client.0.smithi089.stdout:3/33: creat d1/d2/d4/f12 x:0 0 0 2024-09-13T22:08:35.534 INFO:tasks.workunit.client.0.smithi089.stdout:3/34: rmdir d1/d2/d4/da 0 2024-09-13T22:08:35.535 INFO:tasks.workunit.client.0.smithi089.stdout:3/35: stat d1/d7 0 2024-09-13T22:08:35.544 INFO:tasks.workunit.client.0.smithi089.stdout:0/33: getdents d1 0 2024-09-13T22:08:35.544 INFO:tasks.workunit.client.0.smithi089.stdout:0/34: fdatasync d1/f7 0 2024-09-13T22:08:35.545 INFO:tasks.workunit.client.0.smithi089.stdout:0/35: fsync d1/f7 0 2024-09-13T22:08:35.545 INFO:tasks.workunit.client.0.smithi089.stdout:0/36: fdatasync d1/f5 0 2024-09-13T22:08:35.545 INFO:tasks.workunit.client.0.smithi089.stdout:0/37: truncate d1/f4 748882 0 2024-09-13T22:08:35.545 INFO:tasks.workunit.client.0.smithi089.stdout:0/38: write d1/f5 [622771,59647] 0 2024-09-13T22:08:35.560 INFO:tasks.workunit.client.0.smithi089.stdout:0/39: dwrite d1/f8 [4194304,4194304] 0 2024-09-13T22:08:35.561 INFO:tasks.workunit.client.0.smithi089.stdout:0/40: rmdir d1 39 2024-09-13T22:08:35.573 INFO:tasks.workunit.client.0.smithi089.stdout:0/41: dwrite f0 [0,4194304] 0 2024-09-13T22:08:35.575 INFO:tasks.workunit.client.0.smithi089.stdout:0/42: rmdir d1 39 2024-09-13T22:08:35.584 INFO:tasks.workunit.client.0.smithi089.stdout:0/43: dread d1/f8 [4194304,4194304] 0 2024-09-13T22:08:35.584 INFO:tasks.workunit.client.0.smithi089.stdout:0/44: fsync d1/f8 0 2024-09-13T22:08:35.586 INFO:tasks.workunit.client.0.smithi089.stdout:0/45: mknod d1/ca 0 2024-09-13T22:08:35.586 INFO:tasks.workunit.client.0.smithi089.stdout:0/46: chown d1/f8 319 1 2024-09-13T22:08:35.589 INFO:tasks.workunit.client.0.smithi089.stdout:0/47: creat d1/fb x:0 0 0 2024-09-13T22:08:35.715 INFO:tasks.workunit.client.0.smithi089.stdout:4/18: unlink d0/c3 0 2024-09-13T22:08:35.715 INFO:tasks.workunit.client.0.smithi089.stdout:4/19: fdatasync d0/f2 0 2024-09-13T22:08:35.715 INFO:tasks.workunit.client.0.smithi089.stdout:4/20: write d0/f2 [988670,14390] 0 2024-09-13T22:08:35.716 INFO:tasks.workunit.client.0.smithi089.stdout:4/21: rename d0/f2 to d0/f4 0 2024-09-13T22:08:35.718 INFO:tasks.workunit.client.0.smithi089.stdout:9/13: getdents . 0 2024-09-13T22:08:35.723 INFO:tasks.workunit.client.0.smithi089.stdout:4/22: dread d0/f4 [0,4194304] 0 2024-09-13T22:08:35.724 INFO:tasks.workunit.client.0.smithi089.stdout:4/23: mknod d0/c5 0 2024-09-13T22:08:35.724 INFO:tasks.workunit.client.0.smithi089.stdout:5/4: sync 2024-09-13T22:08:35.724 INFO:tasks.workunit.client.0.smithi089.stdout:7/13: sync 2024-09-13T22:08:35.724 INFO:tasks.workunit.client.0.smithi089.stdout:5/5: write f2 [490869,2631] 0 2024-09-13T22:08:35.727 INFO:tasks.workunit.client.0.smithi089.stdout:4/24: dread d0/f4 [0,4194304] 0 2024-09-13T22:08:35.727 INFO:tasks.workunit.client.0.smithi089.stdout:4/25: creat d0/f6 x:0 0 0 2024-09-13T22:08:35.727 INFO:tasks.workunit.client.0.smithi089.stdout:9/14: dread f0 [0,4194304] 0 2024-09-13T22:08:35.727 INFO:tasks.workunit.client.0.smithi089.stdout:9/15: chown l3 51884891 1 2024-09-13T22:08:35.728 INFO:tasks.workunit.client.0.smithi089.stdout:9/16: getdents . 0 2024-09-13T22:08:35.728 INFO:tasks.workunit.client.0.smithi089.stdout:9/17: dread - f1 zero size 2024-09-13T22:08:35.728 INFO:tasks.workunit.client.0.smithi089.stdout:5/6: mknod c3 0 2024-09-13T22:08:35.729 INFO:tasks.workunit.client.0.smithi089.stdout:3/36: getdents d1/d7 0 2024-09-13T22:08:35.730 INFO:tasks.workunit.client.0.smithi089.stdout:7/14: getdents d0 0 2024-09-13T22:08:35.731 INFO:tasks.workunit.client.0.smithi089.stdout:1/28: write f0 [633089,112402] 0 2024-09-13T22:08:35.733 INFO:tasks.workunit.client.0.smithi089.stdout:9/18: mkdir d6 0 2024-09-13T22:08:35.734 INFO:tasks.workunit.client.0.smithi089.stdout:5/7: mkdir d4 0 2024-09-13T22:08:35.735 INFO:tasks.workunit.client.0.smithi089.stdout:5/8: write f2 [327328,124648] 0 2024-09-13T22:08:35.737 INFO:tasks.workunit.client.0.smithi089.stdout:7/15: mknod d0/c3 0 2024-09-13T22:08:35.737 INFO:tasks.workunit.client.0.smithi089.stdout:1/29: mknod d7/cc 0 2024-09-13T22:08:35.737 INFO:tasks.workunit.client.0.smithi089.stdout:3/37: dread d1/d2/d4/f5 [0,4194304] 0 2024-09-13T22:08:35.738 INFO:tasks.workunit.client.0.smithi089.stdout:1/30: read f0 [467379,74847] 0 2024-09-13T22:08:35.738 INFO:tasks.workunit.client.0.smithi089.stdout:1/31: dread - d7/f9 zero size 2024-09-13T22:08:35.738 INFO:tasks.workunit.client.0.smithi089.stdout:1/32: creat d7/fd x:0 0 0 2024-09-13T22:08:35.742 INFO:tasks.workunit.client.0.smithi089.stdout:3/38: dread d1/d2/d4/f5 [0,4194304] 0 2024-09-13T22:08:35.742 INFO:tasks.workunit.client.0.smithi089.stdout:3/39: creat d1/f13 x:0 0 0 2024-09-13T22:08:35.742 INFO:tasks.workunit.client.0.smithi089.stdout:3/40: creat d1/d2/f14 x:0 0 0 2024-09-13T22:08:35.743 INFO:tasks.workunit.client.0.smithi089.stdout:3/41: creat d1/d7/f15 x:0 0 0 2024-09-13T22:08:35.744 INFO:tasks.workunit.client.0.smithi089.stdout:2/27: dwrite f3 [0,4194304] 0 2024-09-13T22:08:35.744 INFO:tasks.workunit.client.0.smithi089.stdout:2/28: readlink l4 0 2024-09-13T22:08:35.744 INFO:tasks.workunit.client.0.smithi089.stdout:6/27: dwrite d0/f3 [0,4194304] 0 2024-09-13T22:08:35.745 INFO:tasks.workunit.client.0.smithi089.stdout:7/16: link d0/c2 d0/c4 0 2024-09-13T22:08:35.745 INFO:tasks.workunit.client.0.smithi089.stdout:7/17: stat d0/c3 0 2024-09-13T22:08:35.746 INFO:tasks.workunit.client.0.smithi089.stdout:7/18: dread - no filename 2024-09-13T22:08:35.746 INFO:tasks.workunit.client.0.smithi089.stdout:7/19: dwrite - no filename 2024-09-13T22:08:35.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:35 smithi089 ceph-mon[27921]: pgmap v249: 65 pgs: 65 active+clean; 197 MiB data, 918 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s rd, 4.6 MiB/s wr, 359 op/s 2024-09-13T22:08:35.752 INFO:tasks.workunit.client.0.smithi089.stdout:6/28: symlink d0/l6 0 2024-09-13T22:08:35.753 INFO:tasks.workunit.client.0.smithi089.stdout:7/20: creat d0/f5 x:0 0 0 2024-09-13T22:08:35.753 INFO:tasks.workunit.client.0.smithi089.stdout:3/42: truncate d1/d2/f3 263877 0 2024-09-13T22:08:35.758 INFO:tasks.workunit.client.0.smithi089.stdout:2/29: dread f3 [0,4194304] 0 2024-09-13T22:08:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:35 smithi159 ceph-mon[35348]: pgmap v249: 65 pgs: 65 active+clean; 197 MiB data, 918 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s rd, 4.6 MiB/s wr, 359 op/s 2024-09-13T22:08:35.767 INFO:tasks.workunit.client.0.smithi089.stdout:6/29: rename d0/f3 to d0/d5/f7 0 2024-09-13T22:08:35.771 INFO:tasks.workunit.client.0.smithi089.stdout:2/30: write f3 [2731403,56355] 0 2024-09-13T22:08:35.774 INFO:tasks.workunit.client.0.smithi089.stdout:6/30: creat d0/d4/f8 x:0 0 0 2024-09-13T22:08:35.774 INFO:tasks.workunit.client.0.smithi089.stdout:6/31: write d0/d4/f8 [17994,111711] 0 2024-09-13T22:08:35.774 INFO:tasks.workunit.client.0.smithi089.stdout:5/9: dwrite f2 [0,4194304] 0 2024-09-13T22:08:35.775 INFO:tasks.workunit.client.0.smithi089.stdout:7/21: mknod d0/c6 0 2024-09-13T22:08:35.781 INFO:tasks.workunit.client.0.smithi089.stdout:5/10: creat d4/f5 x:0 0 0 2024-09-13T22:08:35.782 INFO:tasks.workunit.client.0.smithi089.stdout:7/22: creat d0/f7 x:0 0 0 2024-09-13T22:08:35.790 INFO:tasks.workunit.client.0.smithi089.stdout:0/48: sync 2024-09-13T22:08:35.790 INFO:tasks.workunit.client.0.smithi089.stdout:8/13: sync 2024-09-13T22:08:35.790 INFO:tasks.workunit.client.0.smithi089.stdout:5/11: read f2 [2253494,9003] 0 2024-09-13T22:08:35.792 INFO:tasks.workunit.client.0.smithi089.stdout:5/12: symlink d4/l6 0 2024-09-13T22:08:35.794 INFO:tasks.workunit.client.0.smithi089.stdout:6/32: dwrite d0/d4/f8 [0,4194304] 0 2024-09-13T22:08:35.798 INFO:tasks.workunit.client.0.smithi089.stdout:8/14: write d0/f1 [227167,29340] 0 2024-09-13T22:08:35.798 INFO:tasks.workunit.client.0.smithi089.stdout:8/15: stat d0/f1 0 2024-09-13T22:08:35.798 INFO:tasks.workunit.client.0.smithi089.stdout:8/16: rename d0 to d0/d2 22 2024-09-13T22:08:35.798 INFO:tasks.workunit.client.0.smithi089.stdout:5/13: dread f2 [0,4194304] 0 2024-09-13T22:08:35.798 INFO:tasks.workunit.client.0.smithi089.stdout:5/14: read f2 [3880320,93821] 0 2024-09-13T22:08:35.798 INFO:tasks.workunit.client.0.smithi089.stdout:6/33: unlink d0/l6 0 2024-09-13T22:08:35.804 INFO:tasks.workunit.client.0.smithi089.stdout:3/43: getdents d1 0 2024-09-13T22:08:35.805 INFO:tasks.workunit.client.0.smithi089.stdout:3/44: chown d1/d2/f10 7869189 1 2024-09-13T22:08:35.805 INFO:tasks.workunit.client.0.smithi089.stdout:3/45: creat d1/d2/d4/f16 x:0 0 0 2024-09-13T22:08:35.806 INFO:tasks.workunit.client.0.smithi089.stdout:0/49: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:08:35.811 INFO:tasks.workunit.client.0.smithi089.stdout:6/34: read d0/d5/f7 [854631,11820] 0 2024-09-13T22:08:35.811 INFO:tasks.workunit.client.0.smithi089.stdout:6/35: readlink - no filename 2024-09-13T22:08:35.811 INFO:tasks.workunit.client.0.smithi089.stdout:6/36: read d0/d5/f7 [2702367,126514] 0 2024-09-13T22:08:35.815 INFO:tasks.workunit.client.0.smithi089.stdout:0/50: rename d1/l9 to d1/lc 0 2024-09-13T22:08:35.815 INFO:tasks.workunit.client.0.smithi089.stdout:0/51: stat d1/fb 0 2024-09-13T22:08:35.815 INFO:tasks.workunit.client.0.smithi089.stdout:0/52: chown d1/f4 220910 1 2024-09-13T22:08:35.815 INFO:tasks.workunit.client.0.smithi089.stdout:0/53: dread - d1/fb zero size 2024-09-13T22:08:35.823 INFO:tasks.workunit.client.0.smithi089.stdout:8/17: dwrite d0/f1 [0,4194304] 0 2024-09-13T22:08:35.826 INFO:tasks.workunit.client.0.smithi089.stdout:8/18: symlink d0/l3 0 2024-09-13T22:08:35.827 INFO:tasks.workunit.client.0.smithi089.stdout:5/15: fsync d4/f5 0 2024-09-13T22:08:35.832 INFO:tasks.workunit.client.0.smithi089.stdout:0/54: dwrite f0 [0,4194304] 0 2024-09-13T22:08:35.832 INFO:tasks.workunit.client.0.smithi089.stdout:0/55: stat f0 0 2024-09-13T22:08:35.836 INFO:tasks.workunit.client.0.smithi089.stdout:0/56: read d1/f8 [3612927,1194] 0 2024-09-13T22:08:35.837 INFO:tasks.workunit.client.0.smithi089.stdout:0/57: chown d1/f7 442228 1 2024-09-13T22:08:35.837 INFO:tasks.workunit.client.0.smithi089.stdout:5/16: rmdir d4 39 2024-09-13T22:08:35.837 INFO:tasks.workunit.client.0.smithi089.stdout:5/17: dread - d4/f5 zero size 2024-09-13T22:08:35.839 INFO:tasks.workunit.client.0.smithi089.stdout:5/18: mknod d4/c7 0 2024-09-13T22:08:35.839 INFO:tasks.workunit.client.0.smithi089.stdout:5/19: dread - d4/f5 zero size 2024-09-13T22:08:35.841 INFO:tasks.workunit.client.0.smithi089.stdout:6/37: getdents d0 0 2024-09-13T22:08:35.843 INFO:tasks.workunit.client.0.smithi089.stdout:5/20: rmdir d4 39 2024-09-13T22:08:35.847 INFO:tasks.workunit.client.0.smithi089.stdout:5/21: creat d4/f8 x:0 0 0 2024-09-13T22:08:35.847 INFO:tasks.workunit.client.0.smithi089.stdout:5/22: write f2 [2793950,111944] 0 2024-09-13T22:08:35.856 INFO:tasks.workunit.client.0.smithi089.stdout:0/58: dwrite d1/f7 [0,4194304] 0 2024-09-13T22:08:35.863 INFO:tasks.workunit.client.0.smithi089.stdout:0/59: rename d1/fb to d1/fd 0 2024-09-13T22:08:35.866 INFO:tasks.workunit.client.0.smithi089.stdout:8/19: rmdir d0 39 2024-09-13T22:08:35.872 INFO:tasks.workunit.client.0.smithi089.stdout:0/60: dread d1/f4 [0,4194304] 0 2024-09-13T22:08:35.873 INFO:tasks.workunit.client.0.smithi089.stdout:0/61: chown d1/f4 0 1 2024-09-13T22:08:35.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/20: truncate d0/f1 3788844 0 2024-09-13T22:08:35.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/21: rename d0 to d0/d4 22 2024-09-13T22:08:35.874 INFO:tasks.workunit.client.0.smithi089.stdout:0/62: dread d1/f4 [0,4194304] 0 2024-09-13T22:08:35.874 INFO:tasks.workunit.client.0.smithi089.stdout:0/63: write d1/f4 [4672018,19752] 0 2024-09-13T22:08:35.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/22: creat d0/f5 x:0 0 0 2024-09-13T22:08:35.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/23: truncate d0/f5 199047 0 2024-09-13T22:08:35.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/24: truncate d0/f5 292546 0 2024-09-13T22:08:35.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/25: creat d0/f6 x:0 0 0 2024-09-13T22:08:35.876 INFO:tasks.workunit.client.0.smithi089.stdout:0/64: mkdir d1/de 0 2024-09-13T22:08:35.877 INFO:tasks.workunit.client.0.smithi089.stdout:0/65: fdatasync d1/f4 0 2024-09-13T22:08:35.881 INFO:tasks.workunit.client.0.smithi089.stdout:3/46: truncate d1/d2/f3 95881 0 2024-09-13T22:08:35.882 INFO:tasks.workunit.client.0.smithi089.stdout:5/23: getdents d4 0 2024-09-13T22:08:35.882 INFO:tasks.workunit.client.0.smithi089.stdout:5/24: truncate d4/f8 1014959 0 2024-09-13T22:08:35.883 INFO:tasks.workunit.client.0.smithi089.stdout:5/25: dread d4/f8 [0,4194304] 0 2024-09-13T22:08:35.886 INFO:tasks.workunit.client.0.smithi089.stdout:5/26: creat d4/f9 x:0 0 0 2024-09-13T22:08:35.890 INFO:tasks.workunit.client.0.smithi089.stdout:5/27: link f2 d4/fa 0 2024-09-13T22:08:35.893 INFO:tasks.workunit.client.0.smithi089.stdout:5/28: rename d4/l6 to d4/lb 0 2024-09-13T22:08:35.893 INFO:tasks.workunit.client.0.smithi089.stdout:5/29: creat d4/fc x:0 0 0 2024-09-13T22:08:35.893 INFO:tasks.workunit.client.0.smithi089.stdout:5/30: fdatasync d4/f9 0 2024-09-13T22:08:35.896 INFO:tasks.workunit.client.0.smithi089.stdout:0/66: dwrite d1/fd [0,4194304] 0 2024-09-13T22:08:35.896 INFO:tasks.workunit.client.0.smithi089.stdout:0/67: chown d1/ca 1050 1 2024-09-13T22:08:35.897 INFO:tasks.workunit.client.0.smithi089.stdout:5/31: mknod d4/cd 0 2024-09-13T22:08:35.910 INFO:tasks.workunit.client.0.smithi089.stdout:5/32: mknod d4/ce 0 2024-09-13T22:08:35.913 INFO:tasks.workunit.client.0.smithi089.stdout:3/47: truncate d1/d2/d4/f5 136579 0 2024-09-13T22:08:35.913 INFO:tasks.workunit.client.0.smithi089.stdout:4/26: sync 2024-09-13T22:08:35.914 INFO:tasks.workunit.client.0.smithi089.stdout:4/27: truncate d0/f4 932856 0 2024-09-13T22:08:35.915 INFO:tasks.workunit.client.0.smithi089.stdout:0/68: dwrite d1/f8 [0,4194304] 0 2024-09-13T22:08:35.916 INFO:tasks.workunit.client.0.smithi089.stdout:3/48: mknod d1/d2/c17 0 2024-09-13T22:08:35.916 INFO:tasks.workunit.client.0.smithi089.stdout:3/49: chown d1 449719909 1 2024-09-13T22:08:35.923 INFO:tasks.workunit.client.0.smithi089.stdout:3/50: mkdir d1/d2/d18 0 2024-09-13T22:08:35.923 INFO:tasks.workunit.client.0.smithi089.stdout:3/51: dread - d1/d7/f15 zero size 2024-09-13T22:08:35.924 INFO:tasks.workunit.client.0.smithi089.stdout:0/69: dread d1/f8 [4194304,4194304] 0 2024-09-13T22:08:35.928 INFO:tasks.workunit.client.0.smithi089.stdout:0/70: write d1/f4 [2710922,25845] 0 2024-09-13T22:08:35.938 INFO:tasks.workunit.client.0.smithi089.stdout:5/33: dwrite d4/fa [0,4194304] 0 2024-09-13T22:08:35.938 INFO:tasks.workunit.client.0.smithi089.stdout:5/34: creat d4/ff x:0 0 0 2024-09-13T22:08:35.941 INFO:tasks.workunit.client.0.smithi089.stdout:4/28: read d0/f4 [228739,27662] 0 2024-09-13T22:08:35.941 INFO:tasks.workunit.client.0.smithi089.stdout:4/29: creat d0/f7 x:0 0 0 2024-09-13T22:08:35.941 INFO:tasks.workunit.client.0.smithi089.stdout:3/52: dwrite d1/d2/d4/f16 [0,4194304] 0 2024-09-13T22:08:35.942 INFO:tasks.workunit.client.0.smithi089.stdout:5/35: mknod d4/c10 0 2024-09-13T22:08:35.942 INFO:tasks.workunit.client.0.smithi089.stdout:3/53: dread f0 [0,4194304] 0 2024-09-13T22:08:35.945 INFO:tasks.workunit.client.0.smithi089.stdout:4/30: link d0/f4 d0/f8 0 2024-09-13T22:08:35.947 INFO:tasks.workunit.client.0.smithi089.stdout:9/19: sync 2024-09-13T22:08:35.947 INFO:tasks.workunit.client.0.smithi089.stdout:9/20: truncate f1 791880 0 2024-09-13T22:08:35.948 INFO:tasks.workunit.client.0.smithi089.stdout:2/31: sync 2024-09-13T22:08:35.948 INFO:tasks.workunit.client.0.smithi089.stdout:7/23: sync 2024-09-13T22:08:35.948 INFO:tasks.workunit.client.0.smithi089.stdout:1/33: sync 2024-09-13T22:08:35.948 INFO:tasks.workunit.client.0.smithi089.stdout:1/34: dread - d7/f9 zero size 2024-09-13T22:08:35.948 INFO:tasks.workunit.client.0.smithi089.stdout:0/71: dwrite d1/f8 [4194304,4194304] 0 2024-09-13T22:08:35.953 INFO:tasks.workunit.client.0.smithi089.stdout:5/36: mknod d4/c11 0 2024-09-13T22:08:35.954 INFO:tasks.workunit.client.0.smithi089.stdout:5/37: readlink d4/lb 0 2024-09-13T22:08:35.954 INFO:tasks.workunit.client.0.smithi089.stdout:5/38: creat d4/f12 x:0 0 0 2024-09-13T22:08:35.954 INFO:tasks.workunit.client.0.smithi089.stdout:5/39: write d4/ff [690247,102181] 0 2024-09-13T22:08:35.955 INFO:tasks.workunit.client.0.smithi089.stdout:4/31: truncate d0/f4 86786 0 2024-09-13T22:08:35.957 INFO:tasks.workunit.client.0.smithi089.stdout:9/21: symlink d6/l7 0 2024-09-13T22:08:35.961 INFO:tasks.workunit.client.0.smithi089.stdout:1/35: mkdir d7/de 0 2024-09-13T22:08:35.966 INFO:tasks.workunit.client.0.smithi089.stdout:0/72: mknod d1/de/cf 0 2024-09-13T22:08:35.966 INFO:tasks.workunit.client.0.smithi089.stdout:0/73: fsync d1/f5 0 2024-09-13T22:08:35.967 INFO:tasks.workunit.client.0.smithi089.stdout:6/38: sync 2024-09-13T22:08:35.970 INFO:tasks.workunit.client.0.smithi089.stdout:5/40: rename c0 to d4/c13 0 2024-09-13T22:08:35.974 INFO:tasks.workunit.client.0.smithi089.stdout:9/22: creat d6/f8 x:0 0 0 2024-09-13T22:08:35.976 INFO:tasks.workunit.client.0.smithi089.stdout:7/24: symlink d0/l8 0 2024-09-13T22:08:35.976 INFO:tasks.workunit.client.0.smithi089.stdout:7/25: write d0/f5 [512185,20850] 0 2024-09-13T22:08:35.976 INFO:tasks.workunit.client.0.smithi089.stdout:7/26: stat d0/c3 0 2024-09-13T22:08:35.976 INFO:tasks.workunit.client.0.smithi089.stdout:7/27: readlink d0/l8 0 2024-09-13T22:08:35.978 INFO:tasks.workunit.client.0.smithi089.stdout:2/32: getdents . 0 2024-09-13T22:08:35.980 INFO:tasks.workunit.client.0.smithi089.stdout:1/36: creat d7/de/ff x:0 0 0 2024-09-13T22:08:35.982 INFO:tasks.workunit.client.0.smithi089.stdout:0/74: mkdir d1/de/d10 0 2024-09-13T22:08:35.983 INFO:tasks.workunit.client.0.smithi089.stdout:0/75: creat d1/f11 x:0 0 0 2024-09-13T22:08:35.985 INFO:tasks.workunit.client.0.smithi089.stdout:7/28: fdatasync d0/f5 0 2024-09-13T22:08:35.985 INFO:tasks.workunit.client.0.smithi089.stdout:3/54: dwrite d1/d2/d4/f16 [4194304,4194304] 0 2024-09-13T22:08:35.985 INFO:tasks.workunit.client.0.smithi089.stdout:6/39: mkdir d0/d9 0 2024-09-13T22:08:35.985 INFO:tasks.workunit.client.0.smithi089.stdout:6/40: readlink - no filename 2024-09-13T22:08:35.985 INFO:tasks.workunit.client.0.smithi089.stdout:6/41: chown d0/d4 1 1 2024-09-13T22:08:35.985 INFO:tasks.workunit.client.0.smithi089.stdout:8/26: sync 2024-09-13T22:08:35.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/41: mknod d4/c14 0 2024-09-13T22:08:35.990 INFO:tasks.workunit.client.0.smithi089.stdout:7/29: dread d0/f5 [0,4194304] 0 2024-09-13T22:08:35.990 INFO:tasks.workunit.client.0.smithi089.stdout:7/30: write d0/f5 [1286965,33580] 0 2024-09-13T22:08:35.990 INFO:tasks.workunit.client.0.smithi089.stdout:4/32: rmdir d0 39 2024-09-13T22:08:35.993 INFO:tasks.workunit.client.0.smithi089.stdout:2/33: mknod c7 0 2024-09-13T22:08:35.995 INFO:tasks.workunit.client.0.smithi089.stdout:1/37: stat c6 0 2024-09-13T22:08:35.995 INFO:tasks.workunit.client.0.smithi089.stdout:9/23: dwrite d6/f8 [0,4194304] 0 2024-09-13T22:08:35.995 INFO:tasks.workunit.client.0.smithi089.stdout:1/38: creat d7/f10 x:0 0 0 2024-09-13T22:08:35.996 INFO:tasks.workunit.client.0.smithi089.stdout:1/39: read - d7/fd zero size 2024-09-13T22:08:35.999 INFO:tasks.workunit.client.0.smithi089.stdout:0/76: mknod d1/de/d10/c12 0 2024-09-13T22:08:36.002 INFO:tasks.workunit.client.0.smithi089.stdout:3/55: mknod d1/d7/c19 0 2024-09-13T22:08:36.002 INFO:tasks.workunit.client.0.smithi089.stdout:3/56: creat d1/d2/d4/f1a x:0 0 0 2024-09-13T22:08:36.005 INFO:tasks.workunit.client.0.smithi089.stdout:8/27: rename d0/l3 to d0/l7 0 2024-09-13T22:08:36.005 INFO:tasks.workunit.client.0.smithi089.stdout:8/28: creat d0/f8 x:0 0 0 2024-09-13T22:08:36.005 INFO:tasks.workunit.client.0.smithi089.stdout:8/29: creat d0/f9 x:0 0 0 2024-09-13T22:08:36.005 INFO:tasks.workunit.client.0.smithi089.stdout:8/30: chown d0/f8 457 1 2024-09-13T22:08:36.006 INFO:tasks.workunit.client.0.smithi089.stdout:9/24: dread d6/f8 [0,4194304] 0 2024-09-13T22:08:36.006 INFO:tasks.workunit.client.0.smithi089.stdout:6/42: dwrite d0/d4/f8 [0,4194304] 0 2024-09-13T22:08:36.009 INFO:tasks.workunit.client.0.smithi089.stdout:4/33: creat d0/f9 x:0 0 0 2024-09-13T22:08:36.010 INFO:tasks.workunit.client.0.smithi089.stdout:4/34: dread - d0/f9 zero size 2024-09-13T22:08:36.010 INFO:tasks.workunit.client.0.smithi089.stdout:4/35: truncate d0/f6 113126 0 2024-09-13T22:08:36.010 INFO:tasks.workunit.client.0.smithi089.stdout:4/36: write d0/f4 [676793,26072] 0 2024-09-13T22:08:36.010 INFO:tasks.workunit.client.0.smithi089.stdout:4/37: stat d0/f6 0 2024-09-13T22:08:36.010 INFO:tasks.workunit.client.0.smithi089.stdout:0/77: dread d1/f7 [0,4194304] 0 2024-09-13T22:08:36.018 INFO:tasks.workunit.client.0.smithi089.stdout:2/34: chown f3 52089537 1 2024-09-13T22:08:36.021 INFO:tasks.workunit.client.0.smithi089.stdout:6/43: dwrite d0/d5/f7 [0,4194304] 0 2024-09-13T22:08:36.022 INFO:tasks.workunit.client.0.smithi089.stdout:6/44: chown d0/d4/f8 29 1 2024-09-13T22:08:36.022 INFO:tasks.workunit.client.0.smithi089.stdout:6/45: chown d0/d4 0 1 2024-09-13T22:08:36.022 INFO:tasks.workunit.client.0.smithi089.stdout:1/40: truncate f0 3428181 0 2024-09-13T22:08:36.022 INFO:tasks.workunit.client.0.smithi089.stdout:1/41: fdatasync d7/f10 0 2024-09-13T22:08:36.026 INFO:tasks.workunit.client.0.smithi089.stdout:3/57: mkdir d1/d7/d1b 0 2024-09-13T22:08:36.031 INFO:tasks.workunit.client.0.smithi089.stdout:8/31: truncate d0/f1 3553243 0 2024-09-13T22:08:36.034 INFO:tasks.workunit.client.0.smithi089.stdout:7/31: symlink d0/l9 0 2024-09-13T22:08:36.036 INFO:tasks.workunit.client.0.smithi089.stdout:4/38: mknod d0/ca 0 2024-09-13T22:08:36.038 INFO:tasks.workunit.client.0.smithi089.stdout:1/42: dwrite d7/de/ff [0,4194304] 0 2024-09-13T22:08:36.038 INFO:tasks.workunit.client.0.smithi089.stdout:1/43: creat d7/de/f11 x:0 0 0 2024-09-13T22:08:36.041 INFO:tasks.workunit.client.0.smithi089.stdout:6/46: unlink d0/f2 0 2024-09-13T22:08:36.046 INFO:tasks.workunit.client.0.smithi089.stdout:3/58: mkdir d1/d2/d4/d1c 0 2024-09-13T22:08:36.048 INFO:tasks.workunit.client.0.smithi089.stdout:8/32: unlink d0/f9 0 2024-09-13T22:08:36.048 INFO:tasks.workunit.client.0.smithi089.stdout:8/33: chown d0/f5 9 1 2024-09-13T22:08:36.049 INFO:tasks.workunit.client.0.smithi089.stdout:9/25: rmdir d6 39 2024-09-13T22:08:36.057 INFO:tasks.workunit.client.0.smithi089.stdout:6/47: dwrite d0/d4/f8 [4194304,4194304] 0 2024-09-13T22:08:36.057 INFO:tasks.workunit.client.0.smithi089.stdout:3/59: write d1/d2/d4/f16 [4301257,62954] 0 2024-09-13T22:08:36.058 INFO:tasks.workunit.client.0.smithi089.stdout:3/60: dread d1/d2/d4/f5 [0,4194304] 0 2024-09-13T22:08:36.058 INFO:tasks.workunit.client.0.smithi089.stdout:3/61: write d1/d2/d4/f9 [963193,47602] 0 2024-09-13T22:08:36.059 INFO:tasks.workunit.client.0.smithi089.stdout:3/62: dread d1/d2/d4/f5 [0,4194304] 0 2024-09-13T22:08:36.060 INFO:tasks.workunit.client.0.smithi089.stdout:1/44: mknod d7/de/c12 0 2024-09-13T22:08:36.064 INFO:tasks.workunit.client.0.smithi089.stdout:8/34: mkdir d0/da 0 2024-09-13T22:08:36.066 INFO:tasks.workunit.client.0.smithi089.stdout:7/32: mknod d0/ca 0 2024-09-13T22:08:36.066 INFO:tasks.workunit.client.0.smithi089.stdout:7/33: dread - d0/f7 zero size 2024-09-13T22:08:36.066 INFO:tasks.workunit.client.0.smithi089.stdout:7/34: fdatasync d0/f7 0 2024-09-13T22:08:36.066 INFO:tasks.workunit.client.0.smithi089.stdout:7/35: truncate d0/f7 691619 0 2024-09-13T22:08:36.066 INFO:tasks.workunit.client.0.smithi089.stdout:7/36: chown d0/l9 3700 1 2024-09-13T22:08:36.067 INFO:tasks.workunit.client.0.smithi089.stdout:4/39: rmdir d0 39 2024-09-13T22:08:36.069 INFO:tasks.workunit.client.0.smithi089.stdout:9/26: dwrite d6/f8 [0,4194304] 0 2024-09-13T22:08:36.071 INFO:tasks.workunit.client.0.smithi089.stdout:6/48: mknod d0/ca 0 2024-09-13T22:08:36.074 INFO:tasks.workunit.client.0.smithi089.stdout:1/45: unlink d7/f10 0 2024-09-13T22:08:36.074 INFO:tasks.workunit.client.0.smithi089.stdout:1/46: readlink l3 0 2024-09-13T22:08:36.076 INFO:tasks.workunit.client.0.smithi089.stdout:2/35: rename l4 to l8 0 2024-09-13T22:08:36.078 INFO:tasks.workunit.client.0.smithi089.stdout:7/37: unlink d0/l8 0 2024-09-13T22:08:36.080 INFO:tasks.workunit.client.0.smithi089.stdout:3/63: dwrite d1/d2/d4/f9 [0,4194304] 0 2024-09-13T22:08:36.081 INFO:tasks.workunit.client.0.smithi089.stdout:3/64: write d1/d2/ff [28073,126921] 0 2024-09-13T22:08:36.081 INFO:tasks.workunit.client.0.smithi089.stdout:3/65: write d1/f13 [14977,62974] 0 2024-09-13T22:08:36.081 INFO:tasks.workunit.client.0.smithi089.stdout:9/27: mknod d6/c9 0 2024-09-13T22:08:36.081 INFO:tasks.workunit.client.0.smithi089.stdout:8/35: dwrite d0/f8 [0,4194304] 0 2024-09-13T22:08:36.083 INFO:tasks.workunit.client.0.smithi089.stdout:1/47: mknod d7/de/c13 0 2024-09-13T22:08:36.083 INFO:tasks.workunit.client.0.smithi089.stdout:1/48: creat d7/de/f14 x:0 0 0 2024-09-13T22:08:36.089 INFO:tasks.workunit.client.0.smithi089.stdout:3/66: mkdir d1/d2/d4/d1c/d1d 0 2024-09-13T22:08:36.090 INFO:tasks.workunit.client.0.smithi089.stdout:9/28: creat d6/fa x:0 0 0 2024-09-13T22:08:36.095 INFO:tasks.workunit.client.0.smithi089.stdout:1/49: link d7/de/c12 d7/c15 0 2024-09-13T22:08:36.095 INFO:tasks.workunit.client.0.smithi089.stdout:1/50: truncate d7/de/f14 253378 0 2024-09-13T22:08:36.095 INFO:tasks.workunit.client.0.smithi089.stdout:1/51: chown d7/fd 4224 1 2024-09-13T22:08:36.095 INFO:tasks.workunit.client.0.smithi089.stdout:1/52: write d7/f9 [82486,50222] 0 2024-09-13T22:08:36.095 INFO:tasks.workunit.client.0.smithi089.stdout:1/53: dread - d7/fd zero size 2024-09-13T22:08:36.095 INFO:tasks.workunit.client.0.smithi089.stdout:1/54: rename d7 to d7/d16 22 2024-09-13T22:08:36.095 INFO:tasks.workunit.client.0.smithi089.stdout:2/36: mknod c9 0 2024-09-13T22:08:36.096 INFO:tasks.workunit.client.0.smithi089.stdout:3/67: link d1/d7/cb d1/d2/d4/d1c/d1d/c1e 0 2024-09-13T22:08:36.097 INFO:tasks.workunit.client.0.smithi089.stdout:9/29: mknod d6/cb 0 2024-09-13T22:08:36.097 INFO:tasks.workunit.client.0.smithi089.stdout:9/30: creat d6/fc x:0 0 0 2024-09-13T22:08:36.100 INFO:tasks.workunit.client.0.smithi089.stdout:9/31: symlink d6/ld 0 2024-09-13T22:08:36.101 INFO:tasks.workunit.client.0.smithi089.stdout:8/36: dwrite d0/f5 [0,4194304] 0 2024-09-13T22:08:36.102 INFO:tasks.workunit.client.0.smithi089.stdout:2/37: link f3 fa 0 2024-09-13T22:08:36.103 INFO:tasks.workunit.client.0.smithi089.stdout:1/55: dread f0 [0,4194304] 0 2024-09-13T22:08:36.104 INFO:tasks.workunit.client.0.smithi089.stdout:7/38: dwrite d0/f5 [0,4194304] 0 2024-09-13T22:08:36.109 INFO:tasks.workunit.client.0.smithi089.stdout:8/37: creat d0/da/fb x:0 0 0 2024-09-13T22:08:36.109 INFO:tasks.workunit.client.0.smithi089.stdout:8/38: chown d0 13122 1 2024-09-13T22:08:36.109 INFO:tasks.workunit.client.0.smithi089.stdout:8/39: fsync d0/f1 0 2024-09-13T22:08:36.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/38: creat fb x:0 0 0 2024-09-13T22:08:36.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/39: truncate fb 159616 0 2024-09-13T22:08:36.113 INFO:tasks.workunit.client.0.smithi089.stdout:3/68: dwrite d1/d2/d4/f16 [0,4194304] 0 2024-09-13T22:08:36.117 INFO:tasks.workunit.client.0.smithi089.stdout:1/56: truncate f0 1906229 0 2024-09-13T22:08:36.122 INFO:tasks.workunit.client.0.smithi089.stdout:3/69: symlink d1/d2/d4/l1f 0 2024-09-13T22:08:36.124 INFO:tasks.workunit.client.0.smithi089.stdout:1/57: symlink d7/l17 0 2024-09-13T22:08:36.124 INFO:tasks.workunit.client.0.smithi089.stdout:1/58: truncate d7/de/f11 430578 0 2024-09-13T22:08:36.124 INFO:tasks.workunit.client.0.smithi089.stdout:1/59: truncate d7/fd 277647 0 2024-09-13T22:08:36.125 INFO:tasks.workunit.client.0.smithi089.stdout:1/60: creat d7/f18 x:0 0 0 2024-09-13T22:08:36.125 INFO:tasks.workunit.client.0.smithi089.stdout:1/61: creat d7/f19 x:0 0 0 2024-09-13T22:08:36.130 INFO:tasks.workunit.client.0.smithi089.stdout:9/32: dwrite d6/fa [0,4194304] 0 2024-09-13T22:08:36.130 INFO:tasks.workunit.client.0.smithi089.stdout:8/40: dwrite d0/f8 [0,4194304] 0 2024-09-13T22:08:36.130 INFO:tasks.workunit.client.0.smithi089.stdout:7/39: truncate d0/f7 612202 0 2024-09-13T22:08:36.131 INFO:tasks.workunit.client.0.smithi089.stdout:1/62: unlink c1 0 2024-09-13T22:08:36.132 INFO:tasks.workunit.client.0.smithi089.stdout:1/63: write d7/f19 [372091,84999] 0 2024-09-13T22:08:36.132 INFO:tasks.workunit.client.0.smithi089.stdout:1/64: chown d7/f9 192 1 2024-09-13T22:08:36.133 INFO:tasks.workunit.client.0.smithi089.stdout:9/33: read f0 [3672887,40727] 0 2024-09-13T22:08:36.142 INFO:tasks.workunit.client.0.smithi089.stdout:3/70: dwrite d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:36.147 INFO:tasks.workunit.client.0.smithi089.stdout:5/42: sync 2024-09-13T22:08:36.147 INFO:tasks.workunit.client.0.smithi089.stdout:5/43: write d4/f9 [468513,27225] 0 2024-09-13T22:08:36.147 INFO:tasks.workunit.client.0.smithi089.stdout:8/41: rename d0/f1 to d0/fc 0 2024-09-13T22:08:36.151 INFO:tasks.workunit.client.0.smithi089.stdout:9/34: rename d6/c9 to d6/ce 0 2024-09-13T22:08:36.151 INFO:tasks.workunit.client.0.smithi089.stdout:9/35: creat d6/ff x:0 0 0 2024-09-13T22:08:36.151 INFO:tasks.workunit.client.0.smithi089.stdout:9/36: write f0 [1349886,86808] 0 2024-09-13T22:08:36.151 INFO:tasks.workunit.client.0.smithi089.stdout:9/37: write d6/fc [18689,22570] 0 2024-09-13T22:08:36.156 INFO:tasks.workunit.client.0.smithi089.stdout:3/71: link d1/d7/cb d1/d2/c20 0 2024-09-13T22:08:36.157 INFO:tasks.workunit.client.0.smithi089.stdout:2/40: getdents . 0 2024-09-13T22:08:36.158 INFO:tasks.workunit.client.0.smithi089.stdout:5/44: mknod d4/c15 0 2024-09-13T22:08:36.206 INFO:tasks.workunit.client.0.smithi089.stdout:5/45: write d4/ff [777254,62425] 0 2024-09-13T22:08:36.206 INFO:tasks.workunit.client.0.smithi089.stdout:5/46: truncate d4/ff 1643578 0 2024-09-13T22:08:36.209 INFO:tasks.workunit.client.0.smithi089.stdout:8/42: unlink d0/f6 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:9/38: rename d6/f8 to d6/f10 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:9/39: creat d6/f11 x:0 0 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:2/41: mkdir dc 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:5/47: unlink d4/f12 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:5/48: dread d4/f8 [0,4194304] 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:7/40: dread d0/f7 [0,4194304] 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:3/72: getdents d1/d2/d4 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:3/73: truncate d1/d2/f3 374109 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:2/42: rmdir dc 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:5/49: unlink d4/fc 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:5/50: read d4/f8 [697819,5570] 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:1/65: truncate d7/de/f11 303099 0 2024-09-13T22:08:36.210 INFO:tasks.workunit.client.0.smithi089.stdout:7/41: creat d0/fb x:0 0 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:7/42: dread - d0/fb zero size 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:9/40: link d6/f11 d6/f12 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:3/74: mknod d1/d2/d4/d1c/c21 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:3/75: dread - d1/d2/d4/f1a zero size 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:8/43: rename d0/da to d0/dd 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:9/41: symlink d6/l13 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:9/42: creat d6/f14 x:0 0 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:9/43: read - d6/ff zero size 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:9/44: stat d6/l7 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:0/78: sync 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:5/51: dwrite d4/f8 [0,4194304] 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:2/43: dwrite f3 [4194304,4194304] 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:3/76: rename d1/d7/cc to d1/c22 0 2024-09-13T22:08:36.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/66: dwrite d7/fd [0,4194304] 0 2024-09-13T22:08:36.212 INFO:tasks.workunit.client.0.smithi089.stdout:5/52: dread d4/f9 [0,4194304] 0 2024-09-13T22:08:36.212 INFO:tasks.workunit.client.0.smithi089.stdout:0/79: dread d1/f4 [0,4194304] 0 2024-09-13T22:08:36.220 INFO:tasks.workunit.client.0.smithi089.stdout:3/77: stat d1/d7/cb 0 2024-09-13T22:08:36.222 INFO:tasks.workunit.client.0.smithi089.stdout:8/44: rename d0/l7 to d0/dd/le 0 2024-09-13T22:08:36.227 INFO:tasks.workunit.client.0.smithi089.stdout:3/78: mkdir d1/d2/d23 0 2024-09-13T22:08:36.228 INFO:tasks.workunit.client.0.smithi089.stdout:3/79: read - d1/d2/f10 zero size 2024-09-13T22:08:36.229 INFO:tasks.workunit.client.0.smithi089.stdout:1/67: rename c4 to d7/de/c1a 0 2024-09-13T22:08:36.230 INFO:tasks.workunit.client.0.smithi089.stdout:8/45: dread d0/f5 [0,4194304] 0 2024-09-13T22:08:36.231 INFO:tasks.workunit.client.0.smithi089.stdout:3/80: dread d1/f6 [0,4194304] 0 2024-09-13T22:08:36.232 INFO:tasks.workunit.client.0.smithi089.stdout:0/80: rename f0 to d1/de/d10/f13 0 2024-09-13T22:08:36.233 INFO:tasks.workunit.client.0.smithi089.stdout:1/68: mkdir d7/de/d1b 0 2024-09-13T22:08:36.236 INFO:tasks.workunit.client.0.smithi089.stdout:3/81: stat d1/c22 0 2024-09-13T22:08:36.236 INFO:tasks.workunit.client.0.smithi089.stdout:2/44: dwrite fa [0,4194304] 0 2024-09-13T22:08:36.238 INFO:tasks.workunit.client.0.smithi089.stdout:5/53: dwrite f2 [0,4194304] 0 2024-09-13T22:08:36.238 INFO:tasks.workunit.client.0.smithi089.stdout:5/54: write d4/f9 [1176590,80949] 0 2024-09-13T22:08:36.239 INFO:tasks.workunit.client.0.smithi089.stdout:5/55: chown d4/f8 3788 1 2024-09-13T22:08:36.239 INFO:tasks.workunit.client.0.smithi089.stdout:8/46: rename d0/fc to d0/dd/ff 0 2024-09-13T22:08:36.242 INFO:tasks.workunit.client.0.smithi089.stdout:1/69: unlink l3 0 2024-09-13T22:08:36.242 INFO:tasks.workunit.client.0.smithi089.stdout:1/70: truncate d7/f9 742628 0 2024-09-13T22:08:36.244 INFO:tasks.workunit.client.0.smithi089.stdout:3/82: mkdir d1/d2/d24 0 2024-09-13T22:08:36.244 INFO:tasks.workunit.client.0.smithi089.stdout:3/83: chown d1/d2 7 1 2024-09-13T22:08:36.249 INFO:tasks.workunit.client.0.smithi089.stdout:5/56: symlink d4/l16 0 2024-09-13T22:08:36.249 INFO:tasks.workunit.client.0.smithi089.stdout:5/57: chown d4/c10 1250211 1 2024-09-13T22:08:36.249 INFO:tasks.workunit.client.0.smithi089.stdout:0/81: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:08:36.253 INFO:tasks.workunit.client.0.smithi089.stdout:8/47: mkdir d0/d10 0 2024-09-13T22:08:36.253 INFO:tasks.workunit.client.0.smithi089.stdout:7/43: rmdir d0 39 2024-09-13T22:08:36.255 INFO:tasks.workunit.client.0.smithi089.stdout:3/84: mknod d1/d2/d4/d1c/d1d/c25 0 2024-09-13T22:08:36.257 INFO:tasks.workunit.client.0.smithi089.stdout:3/85: dread f0 [0,4194304] 0 2024-09-13T22:08:36.257 INFO:tasks.workunit.client.0.smithi089.stdout:5/58: link d4/c7 d4/c17 0 2024-09-13T22:08:36.259 INFO:tasks.workunit.client.0.smithi089.stdout:8/48: mkdir d0/dd/d11 0 2024-09-13T22:08:36.259 INFO:tasks.workunit.client.0.smithi089.stdout:8/49: chown d0/dd 2618113 1 2024-09-13T22:08:36.261 INFO:tasks.workunit.client.0.smithi089.stdout:4/40: sync 2024-09-13T22:08:36.261 INFO:tasks.workunit.client.0.smithi089.stdout:6/49: sync 2024-09-13T22:08:36.261 INFO:tasks.workunit.client.0.smithi089.stdout:7/44: rmdir d0 39 2024-09-13T22:08:36.261 INFO:tasks.workunit.client.0.smithi089.stdout:7/45: stat d0/ca 0 2024-09-13T22:08:36.261 INFO:tasks.workunit.client.0.smithi089.stdout:7/46: write d0/fb [1028401,120469] 0 2024-09-13T22:08:36.264 INFO:tasks.workunit.client.0.smithi089.stdout:4/41: mknod d0/cb 0 2024-09-13T22:08:36.264 INFO:tasks.workunit.client.0.smithi089.stdout:4/42: fdatasync d0/f6 0 2024-09-13T22:08:36.266 INFO:tasks.workunit.client.0.smithi089.stdout:6/50: creat d0/d5/fb x:0 0 0 2024-09-13T22:08:36.268 INFO:tasks.workunit.client.0.smithi089.stdout:8/50: read d0/f8 [1903631,95994] 0 2024-09-13T22:08:36.272 INFO:tasks.workunit.client.0.smithi089.stdout:4/43: mknod d0/cc 0 2024-09-13T22:08:36.272 INFO:tasks.workunit.client.0.smithi089.stdout:8/51: dread d0/f8 [0,4194304] 0 2024-09-13T22:08:36.273 INFO:tasks.workunit.client.0.smithi089.stdout:6/51: mknod d0/d4/cc 0 2024-09-13T22:08:36.273 INFO:tasks.workunit.client.0.smithi089.stdout:3/86: write d1/d2/d4/f9 [1676837,60562] 0 2024-09-13T22:08:36.274 INFO:tasks.workunit.client.0.smithi089.stdout:3/87: chown d1/d2/d4/l1f 9818 1 2024-09-13T22:08:36.274 INFO:tasks.workunit.client.0.smithi089.stdout:2/45: dwrite f3 [4194304,4194304] 0 2024-09-13T22:08:36.276 INFO:tasks.workunit.client.0.smithi089.stdout:8/52: unlink d0/dd/le 0 2024-09-13T22:08:36.281 INFO:tasks.workunit.client.0.smithi089.stdout:2/46: mknod cd 0 2024-09-13T22:08:36.283 INFO:tasks.workunit.client.0.smithi089.stdout:8/53: mkdir d0/dd/d12 0 2024-09-13T22:08:36.288 INFO:tasks.workunit.client.0.smithi089.stdout:1/71: dwrite f0 [0,4194304] 0 2024-09-13T22:08:36.288 INFO:tasks.workunit.client.0.smithi089.stdout:0/82: dwrite d1/f4 [4194304,4194304] 0 2024-09-13T22:08:36.288 INFO:tasks.workunit.client.0.smithi089.stdout:2/47: creat fe x:0 0 0 2024-09-13T22:08:36.290 INFO:tasks.workunit.client.0.smithi089.stdout:7/47: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T22:08:36.290 INFO:tasks.workunit.client.0.smithi089.stdout:3/88: dwrite d1/d2/d4/f1a [0,4194304] 0 2024-09-13T22:08:36.290 INFO:tasks.workunit.client.0.smithi089.stdout:8/54: symlink d0/dd/l13 0 2024-09-13T22:08:36.294 INFO:tasks.workunit.client.0.smithi089.stdout:1/72: mkdir d7/d1c 0 2024-09-13T22:08:36.294 INFO:tasks.workunit.client.0.smithi089.stdout:1/73: chown d7 26 1 2024-09-13T22:08:36.298 INFO:tasks.workunit.client.0.smithi089.stdout:0/83: link d1/f11 d1/de/f14 0 2024-09-13T22:08:36.311 INFO:tasks.workunit.client.0.smithi089.stdout:2/48: dwrite f3 [4194304,4194304] 0 2024-09-13T22:08:36.312 INFO:tasks.workunit.client.0.smithi089.stdout:1/74: dwrite d7/fd [0,4194304] 0 2024-09-13T22:08:36.312 INFO:tasks.workunit.client.0.smithi089.stdout:5/59: getdents d4 0 2024-09-13T22:08:36.319 INFO:tasks.workunit.client.0.smithi089.stdout:3/89: link d1/d2/d4/l1f d1/d2/d4/l26 0 2024-09-13T22:08:36.320 INFO:tasks.workunit.client.0.smithi089.stdout:3/90: chown d1/d2/d24 11391 1 2024-09-13T22:08:36.322 INFO:tasks.workunit.client.0.smithi089.stdout:8/55: link d0/f8 d0/dd/f14 0 2024-09-13T22:08:36.322 INFO:tasks.workunit.client.0.smithi089.stdout:5/60: dread d4/fa [0,4194304] 0 2024-09-13T22:08:36.325 INFO:tasks.workunit.client.0.smithi089.stdout:7/48: mknod d0/cc 0 2024-09-13T22:08:36.325 INFO:tasks.workunit.client.0.smithi089.stdout:6/52: rmdir d0 39 2024-09-13T22:08:36.327 INFO:tasks.workunit.client.0.smithi089.stdout:2/49: mkdir df 0 2024-09-13T22:08:36.327 INFO:tasks.workunit.client.0.smithi089.stdout:2/50: read fb [144531,111980] 0 2024-09-13T22:08:36.330 INFO:tasks.workunit.client.0.smithi089.stdout:1/75: link d7/de/f11 d7/de/f1d 0 2024-09-13T22:08:36.333 INFO:tasks.workunit.client.0.smithi089.stdout:3/91: unlink d1/d2/f10 0 2024-09-13T22:08:36.335 INFO:tasks.workunit.client.0.smithi089.stdout:8/56: creat d0/dd/f15 x:0 0 0 2024-09-13T22:08:36.337 INFO:tasks.workunit.client.0.smithi089.stdout:5/61: mknod d4/c18 0 2024-09-13T22:08:36.339 INFO:tasks.workunit.client.0.smithi089.stdout:1/76: write f0 [3495661,46585] 0 2024-09-13T22:08:36.344 INFO:tasks.workunit.client.0.smithi089.stdout:5/62: write f2 [2095177,14311] 0 2024-09-13T22:08:36.344 INFO:tasks.workunit.client.0.smithi089.stdout:6/53: mknod d0/cd 0 2024-09-13T22:08:36.344 INFO:tasks.workunit.client.0.smithi089.stdout:7/49: creat d0/fd x:0 0 0 2024-09-13T22:08:36.344 INFO:tasks.workunit.client.0.smithi089.stdout:7/50: truncate d0/fd 544605 0 2024-09-13T22:08:36.344 INFO:tasks.workunit.client.0.smithi089.stdout:7/51: dread d0/f7 [0,4194304] 0 2024-09-13T22:08:36.345 INFO:tasks.workunit.client.0.smithi089.stdout:2/51: creat df/f10 x:0 0 0 2024-09-13T22:08:36.345 INFO:tasks.workunit.client.0.smithi089.stdout:2/52: readlink l6 0 2024-09-13T22:08:36.345 INFO:tasks.workunit.client.0.smithi089.stdout:2/53: creat df/f11 x:0 0 0 2024-09-13T22:08:36.347 INFO:tasks.workunit.client.0.smithi089.stdout:3/92: creat d1/d2/d23/f27 x:0 0 0 2024-09-13T22:08:36.349 INFO:tasks.workunit.client.0.smithi089.stdout:1/77: unlink d7/de/c13 0 2024-09-13T22:08:36.350 INFO:tasks.workunit.client.0.smithi089.stdout:0/84: rmdir d1 39 2024-09-13T22:08:36.350 INFO:tasks.workunit.client.0.smithi089.stdout:0/85: fdatasync d1/f11 0 2024-09-13T22:08:36.351 INFO:tasks.workunit.client.0.smithi089.stdout:8/57: dwrite d0/dd/f14 [0,4194304] 0 2024-09-13T22:08:36.352 INFO:tasks.workunit.client.0.smithi089.stdout:6/54: unlink d0/d4/f8 0 2024-09-13T22:08:36.353 INFO:tasks.workunit.client.0.smithi089.stdout:5/63: mkdir d4/d19 0 2024-09-13T22:08:36.359 INFO:tasks.workunit.client.0.smithi089.stdout:2/54: unlink c9 0 2024-09-13T22:08:36.361 INFO:tasks.workunit.client.0.smithi089.stdout:1/78: rename d7/de/f1d to d7/de/f1e 0 2024-09-13T22:08:36.362 INFO:tasks.workunit.client.0.smithi089.stdout:3/93: dwrite d1/d2/f3 [0,4194304] 0 2024-09-13T22:08:36.362 INFO:tasks.workunit.client.0.smithi089.stdout:3/94: chown d1/d2/d4/d1c/c21 1318 1 2024-09-13T22:08:36.362 INFO:tasks.workunit.client.0.smithi089.stdout:3/95: chown d1/d2/d4/d1c/d1d 1 1 2024-09-13T22:08:36.363 INFO:tasks.workunit.client.0.smithi089.stdout:0/86: unlink d1/f8 0 2024-09-13T22:08:36.363 INFO:tasks.workunit.client.0.smithi089.stdout:0/87: stat d1/f7 0 2024-09-13T22:08:36.364 INFO:tasks.workunit.client.0.smithi089.stdout:0/88: write d1/de/d10/f13 [4218420,54296] 0 2024-09-13T22:08:36.364 INFO:tasks.workunit.client.0.smithi089.stdout:9/45: sync 2024-09-13T22:08:36.364 INFO:tasks.workunit.client.0.smithi089.stdout:9/46: creat d6/f15 x:0 0 0 2024-09-13T22:08:36.364 INFO:tasks.workunit.client.0.smithi089.stdout:9/47: write d6/fc [797641,87842] 0 2024-09-13T22:08:36.370 INFO:tasks.workunit.client.0.smithi089.stdout:3/96: dread d1/d2/d4/f5 [0,4194304] 0 2024-09-13T22:08:36.372 INFO:tasks.workunit.client.0.smithi089.stdout:8/58: mkdir d0/d16 0 2024-09-13T22:08:36.372 INFO:tasks.workunit.client.0.smithi089.stdout:8/59: chown d0/f5 7954 1 2024-09-13T22:08:36.374 INFO:tasks.workunit.client.0.smithi089.stdout:6/55: rmdir d0/d5 39 2024-09-13T22:08:36.376 INFO:tasks.workunit.client.0.smithi089.stdout:5/64: symlink d4/d19/l1a 0 2024-09-13T22:08:36.376 INFO:tasks.workunit.client.0.smithi089.stdout:5/65: chown d4/c17 27280458 1 2024-09-13T22:08:36.376 INFO:tasks.workunit.client.0.smithi089.stdout:5/66: readlink d4/lb 0 2024-09-13T22:08:36.378 INFO:tasks.workunit.client.0.smithi089.stdout:7/52: link d0/l9 d0/le 0 2024-09-13T22:08:36.380 INFO:tasks.workunit.client.0.smithi089.stdout:2/55: dwrite fb [0,4194304] 0 2024-09-13T22:08:36.380 INFO:tasks.workunit.client.0.smithi089.stdout:1/79: symlink d7/l1f 0 2024-09-13T22:08:36.384 INFO:tasks.workunit.client.0.smithi089.stdout:0/89: truncate d1/f7 1187993 0 2024-09-13T22:08:36.391 INFO:tasks.workunit.client.0.smithi089.stdout:3/97: dwrite d1/d2/f3 [0,4194304] 0 2024-09-13T22:08:36.392 INFO:tasks.workunit.client.0.smithi089.stdout:9/48: link d6/fa d6/f16 0 2024-09-13T22:08:36.394 INFO:tasks.workunit.client.0.smithi089.stdout:8/60: creat d0/d10/f17 x:0 0 0 2024-09-13T22:08:36.394 INFO:tasks.workunit.client.0.smithi089.stdout:2/56: write f3 [1637588,76920] 0 2024-09-13T22:08:36.395 INFO:tasks.workunit.client.0.smithi089.stdout:2/57: creat df/f12 x:0 0 0 2024-09-13T22:08:36.395 INFO:tasks.workunit.client.0.smithi089.stdout:2/58: dread - df/f12 zero size 2024-09-13T22:08:36.395 INFO:tasks.workunit.client.0.smithi089.stdout:2/59: chown l6 4016628 1 2024-09-13T22:08:36.395 INFO:tasks.workunit.client.0.smithi089.stdout:6/56: mknod d0/d9/ce 0 2024-09-13T22:08:36.395 INFO:tasks.workunit.client.0.smithi089.stdout:6/57: fsync d0/d5/f7 0 2024-09-13T22:08:36.396 INFO:tasks.workunit.client.0.smithi089.stdout:0/90: dread d1/de/d10/f13 [0,4194304] 0 2024-09-13T22:08:36.397 INFO:tasks.workunit.client.0.smithi089.stdout:5/67: creat d4/d19/f1b x:0 0 0 2024-09-13T22:08:36.399 INFO:tasks.workunit.client.0.smithi089.stdout:0/91: read d1/de/d10/f13 [1794494,108773] 0 2024-09-13T22:08:36.399 INFO:tasks.workunit.client.0.smithi089.stdout:7/53: truncate d0/f7 434733 0 2024-09-13T22:08:36.403 INFO:tasks.workunit.client.0.smithi089.stdout:1/80: dwrite d7/de/f1e [0,4194304] 0 2024-09-13T22:08:36.406 INFO:tasks.workunit.client.0.smithi089.stdout:3/98: mkdir d1/d7/d1b/d28 0 2024-09-13T22:08:36.407 INFO:tasks.workunit.client.0.smithi089.stdout:9/49: dread d6/f16 [0,4194304] 0 2024-09-13T22:08:36.413 INFO:tasks.workunit.client.0.smithi089.stdout:2/60: link l6 df/l13 0 2024-09-13T22:08:36.416 INFO:tasks.workunit.client.0.smithi089.stdout:0/92: mkdir d1/de/d15 0 2024-09-13T22:08:36.418 INFO:tasks.workunit.client.0.smithi089.stdout:4/44: sync 2024-09-13T22:08:36.418 INFO:tasks.workunit.client.0.smithi089.stdout:4/45: truncate d0/f6 217311 0 2024-09-13T22:08:36.422 INFO:tasks.workunit.client.0.smithi089.stdout:1/81: mkdir d7/de/d1b/d20 0 2024-09-13T22:08:36.427 INFO:tasks.workunit.client.0.smithi089.stdout:3/99: link d1/d2/f14 d1/d2/f29 0 2024-09-13T22:08:36.427 INFO:tasks.workunit.client.0.smithi089.stdout:3/100: readlink d1/d2/d4/l26 0 2024-09-13T22:08:36.428 INFO:tasks.workunit.client.0.smithi089.stdout:9/50: mknod d6/c17 0 2024-09-13T22:08:36.432 INFO:tasks.workunit.client.0.smithi089.stdout:8/61: rmdir d0/dd 39 2024-09-13T22:08:36.432 INFO:tasks.workunit.client.0.smithi089.stdout:8/62: creat d0/d10/f18 x:0 0 0 2024-09-13T22:08:36.433 INFO:tasks.workunit.client.0.smithi089.stdout:2/61: mkdir df/d14 0 2024-09-13T22:08:36.438 INFO:tasks.workunit.client.0.smithi089.stdout:0/93: mkdir d1/d16 0 2024-09-13T22:08:36.441 INFO:tasks.workunit.client.0.smithi089.stdout:4/46: creat d0/fd x:0 0 0 2024-09-13T22:08:36.441 INFO:tasks.workunit.client.0.smithi089.stdout:4/47: stat d0/cc 0 2024-09-13T22:08:36.444 INFO:tasks.workunit.client.0.smithi089.stdout:3/101: rename d1/d2/d4/f5 to d1/d2/d4/d1c/f2a 0 2024-09-13T22:08:36.444 INFO:tasks.workunit.client.0.smithi089.stdout:5/68: getdents d4/d19 0 2024-09-13T22:08:36.444 INFO:tasks.workunit.client.0.smithi089.stdout:5/69: write d4/fa [4951852,107096] 0 2024-09-13T22:08:36.448 INFO:tasks.workunit.client.0.smithi089.stdout:5/70: dread d4/f9 [0,4194304] 0 2024-09-13T22:08:36.451 INFO:tasks.workunit.client.0.smithi089.stdout:2/62: dwrite fe [0,4194304] 0 2024-09-13T22:08:36.451 INFO:tasks.workunit.client.0.smithi089.stdout:9/51: dwrite d6/f10 [0,4194304] 0 2024-09-13T22:08:36.451 INFO:tasks.workunit.client.0.smithi089.stdout:9/52: chown d6 133772890 1 2024-09-13T22:08:36.452 INFO:tasks.workunit.client.0.smithi089.stdout:0/94: creat d1/de/f17 x:0 0 0 2024-09-13T22:08:36.455 INFO:tasks.workunit.client.0.smithi089.stdout:4/48: unlink d0/f9 0 2024-09-13T22:08:36.457 INFO:tasks.workunit.client.0.smithi089.stdout:3/102: mkdir d1/d2/d23/d2b 0 2024-09-13T22:08:36.458 INFO:tasks.workunit.client.0.smithi089.stdout:9/53: dread d6/fa [0,4194304] 0 2024-09-13T22:08:36.460 INFO:tasks.workunit.client.0.smithi089.stdout:2/63: read fb [1263610,67951] 0 2024-09-13T22:08:36.460 INFO:tasks.workunit.client.0.smithi089.stdout:2/64: dread - df/f10 zero size 2024-09-13T22:08:36.460 INFO:tasks.workunit.client.0.smithi089.stdout:2/65: chown fa 0 1 2024-09-13T22:08:36.461 INFO:tasks.workunit.client.0.smithi089.stdout:5/71: dread d4/fa [0,4194304] 0 2024-09-13T22:08:36.467 INFO:tasks.workunit.client.0.smithi089.stdout:2/66: write fe [3688226,126825] 0 2024-09-13T22:08:36.467 INFO:tasks.workunit.client.0.smithi089.stdout:2/67: chown l8 386 1 2024-09-13T22:08:36.471 INFO:tasks.workunit.client.0.smithi089.stdout:4/49: link d0/f6 d0/fe 0 2024-09-13T22:08:36.471 INFO:tasks.workunit.client.0.smithi089.stdout:4/50: write d0/f4 [1181190,21108] 0 2024-09-13T22:08:36.471 INFO:tasks.workunit.client.0.smithi089.stdout:4/51: chown d0/cb 5791153 1 2024-09-13T22:08:36.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/103: creat d1/d7/d1b/d28/f2c x:0 0 0 2024-09-13T22:08:36.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/104: stat d1 0 2024-09-13T22:08:36.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/105: truncate d1/f6 1245337 0 2024-09-13T22:08:36.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/106: read - d1/d2/f29 zero size 2024-09-13T22:08:36.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/107: write d1/d2/f29 [346352,15899] 0 2024-09-13T22:08:36.474 INFO:tasks.workunit.client.0.smithi089.stdout:2/68: dread fe [0,4194304] 0 2024-09-13T22:08:36.474 INFO:tasks.workunit.client.0.smithi089.stdout:9/54: mkdir d6/d18 0 2024-09-13T22:08:36.476 INFO:tasks.workunit.client.0.smithi089.stdout:5/72: creat d4/f1c x:0 0 0 2024-09-13T22:08:36.478 INFO:tasks.workunit.client.0.smithi089.stdout:0/95: dwrite d1/f11 [0,4194304] 0 2024-09-13T22:08:36.478 INFO:tasks.workunit.client.0.smithi089.stdout:0/96: fdatasync d1/de/d10/f13 0 2024-09-13T22:08:36.479 INFO:tasks.workunit.client.0.smithi089.stdout:4/52: symlink d0/lf 0 2024-09-13T22:08:36.481 INFO:tasks.workunit.client.0.smithi089.stdout:9/55: mkdir d6/d19 0 2024-09-13T22:08:36.482 INFO:tasks.workunit.client.0.smithi089.stdout:5/73: rename d4/c17 to d4/d19/c1d 0 2024-09-13T22:08:36.489 INFO:tasks.workunit.client.0.smithi089.stdout:8/63: getdents d0/d10 0 2024-09-13T22:08:36.490 INFO:tasks.workunit.client.0.smithi089.stdout:8/64: readlink d0/dd/l13 0 2024-09-13T22:08:36.496 INFO:tasks.workunit.client.0.smithi089.stdout:0/97: symlink d1/d16/l18 0 2024-09-13T22:08:36.497 INFO:tasks.workunit.client.0.smithi089.stdout:3/108: dwrite d1/d2/d4/f9 [4194304,4194304] 0 2024-09-13T22:08:36.497 INFO:tasks.workunit.client.0.smithi089.stdout:2/69: dwrite df/f10 [0,4194304] 0 2024-09-13T22:08:36.497 INFO:tasks.workunit.client.0.smithi089.stdout:2/70: chown fa 0 1 2024-09-13T22:08:36.498 INFO:tasks.workunit.client.0.smithi089.stdout:4/53: unlink d0/f4 0 2024-09-13T22:08:36.499 INFO:tasks.workunit.client.0.smithi089.stdout:4/54: truncate d0/fe 1164408 0 2024-09-13T22:08:36.501 INFO:tasks.workunit.client.0.smithi089.stdout:9/56: symlink d6/l1a 0 2024-09-13T22:08:36.501 INFO:tasks.workunit.client.0.smithi089.stdout:9/57: write d6/f12 [96648,58998] 0 2024-09-13T22:08:36.501 INFO:tasks.workunit.client.0.smithi089.stdout:9/58: write d6/f12 [179519,8124] 0 2024-09-13T22:08:36.501 INFO:tasks.workunit.client.0.smithi089.stdout:9/59: dread - d6/f14 zero size 2024-09-13T22:08:36.502 INFO:tasks.workunit.client.0.smithi089.stdout:5/74: mkdir d4/d19/d1e 0 2024-09-13T22:08:36.503 INFO:tasks.workunit.client.0.smithi089.stdout:5/75: stat d4/f8 0 2024-09-13T22:08:36.504 INFO:tasks.workunit.client.0.smithi089.stdout:8/65: creat d0/dd/f19 x:0 0 0 2024-09-13T22:08:36.504 INFO:tasks.workunit.client.0.smithi089.stdout:8/66: chown d0/dd/d11 21 1 2024-09-13T22:08:36.505 INFO:tasks.workunit.client.0.smithi089.stdout:8/67: write d0/d10/f17 [383921,103596] 0 2024-09-13T22:08:36.506 INFO:tasks.workunit.client.0.smithi089.stdout:6/58: sync 2024-09-13T22:08:36.506 INFO:tasks.workunit.client.0.smithi089.stdout:7/54: sync 2024-09-13T22:08:36.506 INFO:tasks.workunit.client.0.smithi089.stdout:6/59: dread - d0/d5/fb zero size 2024-09-13T22:08:36.515 INFO:tasks.workunit.client.0.smithi089.stdout:2/71: mkdir df/d15 0 2024-09-13T22:08:36.515 INFO:tasks.workunit.client.0.smithi089.stdout:2/72: rename df to df/d14/d16 22 2024-09-13T22:08:36.521 INFO:tasks.workunit.client.0.smithi089.stdout:9/60: rmdir d6/d19 0 2024-09-13T22:08:36.522 INFO:tasks.workunit.client.0.smithi089.stdout:5/76: rmdir d4/d19 39 2024-09-13T22:08:36.524 INFO:tasks.workunit.client.0.smithi089.stdout:8/68: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T22:08:36.524 INFO:tasks.workunit.client.0.smithi089.stdout:8/69: write d0/dd/f19 [311701,98816] 0 2024-09-13T22:08:36.524 INFO:tasks.workunit.client.0.smithi089.stdout:8/70: dread - d0/d10/f18 zero size 2024-09-13T22:08:36.524 INFO:tasks.workunit.client.0.smithi089.stdout:3/109: dwrite d1/d7/d1b/d28/f2c [0,4194304] 0 2024-09-13T22:08:36.527 INFO:tasks.workunit.client.0.smithi089.stdout:6/60: link d0/ca d0/cf 0 2024-09-13T22:08:36.530 INFO:tasks.workunit.client.0.smithi089.stdout:2/73: mknod df/c17 0 2024-09-13T22:08:36.535 INFO:tasks.workunit.client.0.smithi089.stdout:9/61: mkdir d6/d18/d1b 0 2024-09-13T22:08:36.535 INFO:tasks.workunit.client.0.smithi089.stdout:1/82: sync 2024-09-13T22:08:36.538 INFO:tasks.workunit.client.0.smithi089.stdout:5/77: creat d4/d19/f1f x:0 0 0 2024-09-13T22:08:36.538 INFO:tasks.workunit.client.0.smithi089.stdout:4/55: dwrite d0/f8 [0,4194304] 0 2024-09-13T22:08:36.542 INFO:tasks.workunit.client.0.smithi089.stdout:0/98: truncate d1/f11 3714061 0 2024-09-13T22:08:36.542 INFO:tasks.workunit.client.0.smithi089.stdout:0/99: truncate d1/f4 8527156 0 2024-09-13T22:08:36.542 INFO:tasks.workunit.client.0.smithi089.stdout:0/100: readlink d1/d16/l18 0 2024-09-13T22:08:36.552 INFO:tasks.workunit.client.0.smithi089.stdout:6/61: mknod d0/d4/c10 0 2024-09-13T22:08:36.555 INFO:tasks.workunit.client.0.smithi089.stdout:9/62: mknod d6/c1c 0 2024-09-13T22:08:36.556 INFO:tasks.workunit.client.0.smithi089.stdout:8/71: dwrite d0/dd/f19 [0,4194304] 0 2024-09-13T22:08:36.556 INFO:tasks.workunit.client.0.smithi089.stdout:2/74: dwrite f3 [4194304,4194304] 0 2024-09-13T22:08:36.557 INFO:tasks.workunit.client.0.smithi089.stdout:1/83: symlink d7/l21 0 2024-09-13T22:08:36.559 INFO:tasks.workunit.client.0.smithi089.stdout:5/78: rename d4/c13 to d4/d19/d1e/c20 0 2024-09-13T22:08:36.559 INFO:tasks.workunit.client.0.smithi089.stdout:5/79: readlink d4/lb 0 2024-09-13T22:08:36.559 INFO:tasks.workunit.client.0.smithi089.stdout:5/80: chown d4/f5 0 1 2024-09-13T22:08:36.559 INFO:tasks.workunit.client.0.smithi089.stdout:5/81: creat d4/d19/f21 x:0 0 0 2024-09-13T22:08:36.567 INFO:tasks.workunit.client.0.smithi089.stdout:4/56: symlink d0/l10 0 2024-09-13T22:08:36.570 INFO:tasks.workunit.client.0.smithi089.stdout:6/62: creat d0/f11 x:0 0 0 2024-09-13T22:08:36.570 INFO:tasks.workunit.client.0.smithi089.stdout:6/63: chown d0 2899 1 2024-09-13T22:08:36.570 INFO:tasks.workunit.client.0.smithi089.stdout:1/84: dwrite f0 [4194304,4194304] 0 2024-09-13T22:08:36.571 INFO:tasks.workunit.client.0.smithi089.stdout:9/63: creat d6/d18/f1d x:0 0 0 2024-09-13T22:08:36.573 INFO:tasks.workunit.client.0.smithi089.stdout:9/64: dread d6/f11 [0,4194304] 0 2024-09-13T22:08:36.574 INFO:tasks.workunit.client.0.smithi089.stdout:8/72: creat d0/dd/d12/f1a x:0 0 0 2024-09-13T22:08:36.574 INFO:tasks.workunit.client.0.smithi089.stdout:8/73: fsync d0/dd/f14 0 2024-09-13T22:08:36.574 INFO:tasks.workunit.client.0.smithi089.stdout:8/74: chown d0/dd/d12/f1a 230681 1 2024-09-13T22:08:36.574 INFO:tasks.workunit.client.0.smithi089.stdout:8/75: write d0/dd/fb [1025674,60958] 0 2024-09-13T22:08:36.576 INFO:tasks.workunit.client.0.smithi089.stdout:2/75: link df/c17 df/c18 0 2024-09-13T22:08:36.579 INFO:tasks.workunit.client.0.smithi089.stdout:0/101: rename d1/de/d10/c12 to d1/c19 0 2024-09-13T22:08:36.579 INFO:tasks.workunit.client.0.smithi089.stdout:0/102: write d1/de/d10/f13 [2675727,33523] 0 2024-09-13T22:08:36.581 INFO:tasks.workunit.client.0.smithi089.stdout:0/103: write d1/f5 [863835,104604] 0 2024-09-13T22:08:36.583 INFO:tasks.workunit.client.0.smithi089.stdout:4/57: fdatasync d0/fd 0 2024-09-13T22:08:36.585 INFO:tasks.workunit.client.0.smithi089.stdout:6/64: mkdir d0/d4/d12 0 2024-09-13T22:08:36.589 INFO:tasks.workunit.client.0.smithi089.stdout:9/65: rename d6/f11 to d6/f1e 0 2024-09-13T22:08:36.589 INFO:tasks.workunit.client.0.smithi089.stdout:9/66: creat d6/d18/f1f x:0 0 0 2024-09-13T22:08:36.591 INFO:tasks.workunit.client.0.smithi089.stdout:8/76: symlink d0/dd/d12/l1b 0 2024-09-13T22:08:36.592 INFO:tasks.workunit.client.0.smithi089.stdout:9/67: write d6/fa [1909531,14412] 0 2024-09-13T22:08:36.592 INFO:tasks.workunit.client.0.smithi089.stdout:2/76: link c1 df/c19 0 2024-09-13T22:08:36.594 INFO:tasks.workunit.client.0.smithi089.stdout:1/85: rename d7/de/f1e to d7/d1c/f22 0 2024-09-13T22:08:36.606 INFO:tasks.workunit.client.0.smithi089.stdout:0/104: creat d1/f1a x:0 0 0 2024-09-13T22:08:36.606 INFO:tasks.workunit.client.0.smithi089.stdout:0/105: dread - d1/f1a zero size 2024-09-13T22:08:36.610 INFO:tasks.workunit.client.0.smithi089.stdout:8/77: mkdir d0/d10/d1c 0 2024-09-13T22:08:36.612 INFO:tasks.workunit.client.0.smithi089.stdout:9/68: symlink d6/d18/d1b/l20 0 2024-09-13T22:08:36.613 INFO:tasks.workunit.client.0.smithi089.stdout:2/77: rename df/d15 to df/d1a 0 2024-09-13T22:08:36.620 INFO:tasks.workunit.client.0.smithi089.stdout:1/86: symlink d7/l23 0 2024-09-13T22:08:36.622 INFO:tasks.workunit.client.0.smithi089.stdout:0/106: creat d1/de/d10/f1b x:0 0 0 2024-09-13T22:08:36.623 INFO:tasks.workunit.client.0.smithi089.stdout:4/58: mkdir d0/d11 0 2024-09-13T22:08:36.626 INFO:tasks.workunit.client.0.smithi089.stdout:8/78: mkdir d0/dd/d1d 0 2024-09-13T22:08:36.626 INFO:tasks.workunit.client.0.smithi089.stdout:8/79: stat d0 0 2024-09-13T22:08:36.628 INFO:tasks.workunit.client.0.smithi089.stdout:9/69: dwrite d6/d18/f1d [0,4194304] 0 2024-09-13T22:08:36.630 INFO:tasks.workunit.client.0.smithi089.stdout:1/87: rename f0 to d7/f24 0 2024-09-13T22:08:36.630 INFO:tasks.workunit.client.0.smithi089.stdout:1/88: creat d7/f25 x:0 0 0 2024-09-13T22:08:36.632 INFO:tasks.workunit.client.0.smithi089.stdout:0/107: dread d1/f4 [0,4194304] 0 2024-09-13T22:08:36.632 INFO:tasks.workunit.client.0.smithi089.stdout:8/80: mknod d0/d10/d1c/c1e 0 2024-09-13T22:08:36.635 INFO:tasks.workunit.client.0.smithi089.stdout:9/70: mkdir d6/d18/d21 0 2024-09-13T22:08:36.638 INFO:tasks.workunit.client.0.smithi089.stdout:0/108: symlink d1/de/d15/l1c 0 2024-09-13T22:08:36.638 INFO:tasks.workunit.client.0.smithi089.stdout:0/109: write d1/f1a [459029,22265] 0 2024-09-13T22:08:36.638 INFO:tasks.workunit.client.0.smithi089.stdout:0/110: creat d1/de/d10/f1d x:0 0 0 2024-09-13T22:08:36.638 INFO:tasks.workunit.client.0.smithi089.stdout:0/111: write d1/f4 [9542239,37055] 0 2024-09-13T22:08:36.639 INFO:tasks.workunit.client.0.smithi089.stdout:8/81: mknod d0/dd/d1d/c1f 0 2024-09-13T22:08:36.641 INFO:tasks.workunit.client.0.smithi089.stdout:2/78: dwrite fa [0,4194304] 0 2024-09-13T22:08:36.646 INFO:tasks.workunit.client.0.smithi089.stdout:0/112: unlink d1/f1a 0 2024-09-13T22:08:36.646 INFO:tasks.workunit.client.0.smithi089.stdout:0/113: creat d1/f1e x:0 0 0 2024-09-13T22:08:36.648 INFO:tasks.workunit.client.0.smithi089.stdout:7/55: sync 2024-09-13T22:08:36.649 INFO:tasks.workunit.client.0.smithi089.stdout:1/89: dwrite d7/fd [0,4194304] 0 2024-09-13T22:08:36.652 INFO:tasks.workunit.client.0.smithi089.stdout:2/79: mknod df/d14/c1b 0 2024-09-13T22:08:36.655 INFO:tasks.workunit.client.0.smithi089.stdout:0/114: mkdir d1/de/d1f 0 2024-09-13T22:08:36.656 INFO:tasks.workunit.client.0.smithi089.stdout:0/115: write d1/de/d10/f1b [523583,8814] 0 2024-09-13T22:08:36.656 INFO:tasks.workunit.client.0.smithi089.stdout:0/116: chown d1/de 12057651 1 2024-09-13T22:08:36.659 INFO:tasks.workunit.client.0.smithi089.stdout:1/90: link d7/d1c/f22 d7/f26 0 2024-09-13T22:08:36.660 INFO:tasks.workunit.client.0.smithi089.stdout:2/80: mknod df/c1c 0 2024-09-13T22:08:36.660 INFO:tasks.workunit.client.0.smithi089.stdout:2/81: write fb [4892351,21610] 0 2024-09-13T22:08:36.661 INFO:tasks.workunit.client.0.smithi089.stdout:7/56: rmdir d0 39 2024-09-13T22:08:36.665 INFO:tasks.workunit.client.0.smithi089.stdout:0/117: dread d1/de/d10/f13 [0,4194304] 0 2024-09-13T22:08:36.665 INFO:tasks.workunit.client.0.smithi089.stdout:7/57: dread d0/fd [0,4194304] 0 2024-09-13T22:08:36.666 INFO:tasks.workunit.client.0.smithi089.stdout:7/58: dread d0/f7 [0,4194304] 0 2024-09-13T22:08:36.668 INFO:tasks.workunit.client.0.smithi089.stdout:8/82: dwrite d0/dd/d12/f1a [0,4194304] 0 2024-09-13T22:08:36.670 INFO:tasks.workunit.client.0.smithi089.stdout:7/59: rename d0/fb to d0/ff 0 2024-09-13T22:08:36.674 INFO:tasks.workunit.client.0.smithi089.stdout:9/71: dwrite d6/d18/f1f [0,4194304] 0 2024-09-13T22:08:36.674 INFO:tasks.workunit.client.0.smithi089.stdout:1/91: write d7/de/ff [1415378,107400] 0 2024-09-13T22:08:36.674 INFO:tasks.workunit.client.0.smithi089.stdout:1/92: write d7/de/ff [596256,51876] 0 2024-09-13T22:08:36.674 INFO:tasks.workunit.client.0.smithi089.stdout:1/93: read d7/f9 [394861,6950] 0 2024-09-13T22:08:36.674 INFO:tasks.workunit.client.0.smithi089.stdout:1/94: creat d7/de/f27 x:0 0 0 2024-09-13T22:08:36.676 INFO:tasks.workunit.client.0.smithi089.stdout:8/83: rename d0/d10 to d0/dd/d12/d20 0 2024-09-13T22:08:36.676 INFO:tasks.workunit.client.0.smithi089.stdout:8/84: write d0/dd/d12/d20/f18 [973696,12371] 0 2024-09-13T22:08:36.679 INFO:tasks.workunit.client.0.smithi089.stdout:8/85: dread d0/dd/fb [0,4194304] 0 2024-09-13T22:08:36.682 INFO:tasks.workunit.client.0.smithi089.stdout:9/72: dread d6/d18/f1d [0,4194304] 0 2024-09-13T22:08:36.682 INFO:tasks.workunit.client.0.smithi089.stdout:9/73: truncate d6/ff 358749 0 2024-09-13T22:08:36.687 INFO:tasks.workunit.client.0.smithi089.stdout:1/95: dwrite d7/de/f14 [0,4194304] 0 2024-09-13T22:08:36.692 INFO:tasks.workunit.client.0.smithi089.stdout:9/74: dread d6/d18/f1f [0,4194304] 0 2024-09-13T22:08:36.692 INFO:tasks.workunit.client.0.smithi089.stdout:7/60: rename d0/l9 to d0/l10 0 2024-09-13T22:08:36.694 INFO:tasks.workunit.client.0.smithi089.stdout:8/86: creat d0/dd/d1d/f21 x:0 0 0 2024-09-13T22:08:36.702 INFO:tasks.workunit.client.0.smithi089.stdout:8/87: write d0/f8 [1620713,113813] 0 2024-09-13T22:08:36.709 INFO:tasks.workunit.client.0.smithi089.stdout:9/75: dwrite f0 [0,4194304] 0 2024-09-13T22:08:36.709 INFO:tasks.workunit.client.0.smithi089.stdout:9/76: readlink l3 0 2024-09-13T22:08:36.709 INFO:tasks.workunit.client.0.smithi089.stdout:9/77: chown d6/cb 121205475 1 2024-09-13T22:08:36.711 INFO:tasks.workunit.client.0.smithi089.stdout:9/78: unlink l3 0 2024-09-13T22:08:36.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/79: mkdir d6/d18/d22 0 2024-09-13T22:08:36.716 INFO:tasks.workunit.client.0.smithi089.stdout:9/80: rename d6/c1c to d6/d18/d21/c23 0 2024-09-13T22:08:36.720 INFO:tasks.workunit.client.0.smithi089.stdout:6/65: sync 2024-09-13T22:08:36.721 INFO:tasks.workunit.client.0.smithi089.stdout:4/59: sync 2024-09-13T22:08:36.721 INFO:tasks.workunit.client.0.smithi089.stdout:3/110: sync 2024-09-13T22:08:36.721 INFO:tasks.workunit.client.0.smithi089.stdout:6/66: chown d0/cf 7031 1 2024-09-13T22:08:36.721 INFO:tasks.workunit.client.0.smithi089.stdout:6/67: fdatasync d0/f11 0 2024-09-13T22:08:36.721 INFO:tasks.workunit.client.0.smithi089.stdout:5/82: sync 2024-09-13T22:08:36.721 INFO:tasks.workunit.client.0.smithi089.stdout:5/83: fdatasync d4/f9 0 2024-09-13T22:08:36.722 INFO:tasks.workunit.client.0.smithi089.stdout:1/96: dwrite d7/f18 [0,4194304] 0 2024-09-13T22:08:36.722 INFO:tasks.workunit.client.0.smithi089.stdout:1/97: chown d7/f26 117623327 1 2024-09-13T22:08:36.722 INFO:tasks.workunit.client.0.smithi089.stdout:8/88: dwrite d0/dd/d12/d20/f18 [0,4194304] 0 2024-09-13T22:08:36.722 INFO:tasks.workunit.client.0.smithi089.stdout:8/89: write d0/dd/f15 [707125,8233] 0 2024-09-13T22:08:36.722 INFO:tasks.workunit.client.0.smithi089.stdout:8/90: chown d0/f5 1500458 1 2024-09-13T22:08:36.725 INFO:tasks.workunit.client.0.smithi089.stdout:3/111: unlink d1/d2/c17 0 2024-09-13T22:08:36.725 INFO:tasks.workunit.client.0.smithi089.stdout:3/112: fsync d1/d2/f3 0 2024-09-13T22:08:36.725 INFO:tasks.workunit.client.0.smithi089.stdout:3/113: truncate d1/d2/ff 226019 0 2024-09-13T22:08:36.727 INFO:tasks.workunit.client.0.smithi089.stdout:9/81: dread d6/f10 [0,4194304] 0 2024-09-13T22:08:36.727 INFO:tasks.workunit.client.0.smithi089.stdout:9/82: creat d6/f24 x:0 0 0 2024-09-13T22:08:36.727 INFO:tasks.workunit.client.0.smithi089.stdout:6/68: creat d0/d4/d12/f13 x:0 0 0 2024-09-13T22:08:36.728 INFO:tasks.workunit.client.0.smithi089.stdout:5/84: link c1 d4/c22 0 2024-09-13T22:08:36.728 INFO:tasks.workunit.client.0.smithi089.stdout:5/85: read - d4/f1c zero size 2024-09-13T22:08:36.732 INFO:tasks.workunit.client.0.smithi089.stdout:3/114: dread d1/d2/d4/d1c/f2a [0,4194304] 0 2024-09-13T22:08:36.736 INFO:tasks.workunit.client.0.smithi089.stdout:8/91: symlink d0/dd/d1d/l22 0 2024-09-13T22:08:36.741 INFO:tasks.workunit.client.0.smithi089.stdout:9/83: rename c2 to d6/d18/d1b/c25 0 2024-09-13T22:08:36.741 INFO:tasks.workunit.client.0.smithi089.stdout:9/84: write f0 [4602162,69384] 0 2024-09-13T22:08:36.741 INFO:tasks.workunit.client.0.smithi089.stdout:1/98: dwrite d7/de/ff [0,4194304] 0 2024-09-13T22:08:36.743 INFO:tasks.workunit.client.0.smithi089.stdout:6/69: creat d0/d5/f14 x:0 0 0 2024-09-13T22:08:36.746 INFO:tasks.workunit.client.0.smithi089.stdout:3/115: mknod d1/d2/d23/d2b/c2d 0 2024-09-13T22:08:36.748 INFO:tasks.workunit.client.0.smithi089.stdout:8/92: unlink d0/dd/d12/l1b 0 2024-09-13T22:08:36.748 INFO:tasks.workunit.client.0.smithi089.stdout:8/93: chown d0/dd/ff 9177399 1 2024-09-13T22:08:36.750 INFO:tasks.workunit.client.0.smithi089.stdout:4/60: rename d0/fe to d0/f12 0 2024-09-13T22:08:36.750 INFO:tasks.workunit.client.0.smithi089.stdout:8/94: dread d0/dd/fb [0,4194304] 0 2024-09-13T22:08:36.757 INFO:tasks.workunit.client.0.smithi089.stdout:1/99: creat d7/de/d1b/d20/f28 x:0 0 0 2024-09-13T22:08:36.757 INFO:tasks.workunit.client.0.smithi089.stdout:1/100: fdatasync d7/de/f14 0 2024-09-13T22:08:36.760 INFO:tasks.workunit.client.0.smithi089.stdout:6/70: unlink d0/d5/fb 0 2024-09-13T22:08:36.762 INFO:tasks.workunit.client.0.smithi089.stdout:5/86: rmdir d4 39 2024-09-13T22:08:36.764 INFO:tasks.workunit.client.0.smithi089.stdout:4/61: dwrite d0/f12 [0,4194304] 0 2024-09-13T22:08:36.768 INFO:tasks.workunit.client.0.smithi089.stdout:8/95: creat d0/dd/d11/f23 x:0 0 0 2024-09-13T22:08:36.769 INFO:tasks.workunit.client.0.smithi089.stdout:1/101: truncate d7/de/f11 480366 0 2024-09-13T22:08:36.769 INFO:tasks.workunit.client.0.smithi089.stdout:1/102: fsync d7/fb 0 2024-09-13T22:08:36.771 INFO:tasks.workunit.client.0.smithi089.stdout:6/71: mkdir d0/d4/d12/d15 0 2024-09-13T22:08:36.772 INFO:tasks.workunit.client.0.smithi089.stdout:5/87: mknod d4/d19/d1e/c23 0 2024-09-13T22:08:36.772 INFO:tasks.workunit.client.0.smithi089.stdout:5/88: write d4/f5 [321608,82066] 0 2024-09-13T22:08:36.772 INFO:tasks.workunit.client.0.smithi089.stdout:5/89: truncate d4/d19/f1f 626799 0 2024-09-13T22:08:36.777 INFO:tasks.workunit.client.0.smithi089.stdout:4/62: creat d0/f13 x:0 0 0 2024-09-13T22:08:36.779 INFO:tasks.workunit.client.0.smithi089.stdout:1/103: symlink d7/l29 0 2024-09-13T22:08:36.780 INFO:tasks.workunit.client.0.smithi089.stdout:6/72: symlink d0/d4/d12/d15/l16 0 2024-09-13T22:08:36.780 INFO:tasks.workunit.client.0.smithi089.stdout:6/73: chown d0/d5/f14 1285 1 2024-09-13T22:08:36.780 INFO:tasks.workunit.client.0.smithi089.stdout:6/74: fdatasync d0/f11 0 2024-09-13T22:08:36.782 INFO:tasks.workunit.client.0.smithi089.stdout:5/90: creat d4/d19/f24 x:0 0 0 2024-09-13T22:08:36.786 INFO:tasks.workunit.client.0.smithi089.stdout:8/96: truncate d0/dd/d12/d20/f18 4017945 0 2024-09-13T22:08:36.789 INFO:tasks.workunit.client.0.smithi089.stdout:5/91: mknod d4/c25 0 2024-09-13T22:08:36.789 INFO:tasks.workunit.client.0.smithi089.stdout:5/92: write d4/f5 [693927,127561] 0 2024-09-13T22:08:36.790 INFO:tasks.workunit.client.0.smithi089.stdout:2/82: sync 2024-09-13T22:08:36.790 INFO:tasks.workunit.client.0.smithi089.stdout:0/118: sync 2024-09-13T22:08:36.790 INFO:tasks.workunit.client.0.smithi089.stdout:2/83: dread - df/f11 zero size 2024-09-13T22:08:36.790 INFO:tasks.workunit.client.0.smithi089.stdout:2/84: fdatasync fe 0 2024-09-13T22:08:36.790 INFO:tasks.workunit.client.0.smithi089.stdout:0/119: creat d1/de/f20 x:0 0 0 2024-09-13T22:08:36.790 INFO:tasks.workunit.client.0.smithi089.stdout:0/120: rename d1/de to d1/de/d21 22 2024-09-13T22:08:36.791 INFO:tasks.workunit.client.0.smithi089.stdout:8/97: symlink d0/dd/d12/d20/l24 0 2024-09-13T22:08:36.791 INFO:tasks.workunit.client.0.smithi089.stdout:8/98: creat d0/dd/d11/f25 x:0 0 0 2024-09-13T22:08:36.791 INFO:tasks.workunit.client.0.smithi089.stdout:8/99: creat d0/dd/d1d/f26 x:0 0 0 2024-09-13T22:08:36.791 INFO:tasks.workunit.client.0.smithi089.stdout:8/100: dread - d0/dd/d11/f23 zero size 2024-09-13T22:08:36.794 INFO:tasks.workunit.client.0.smithi089.stdout:2/85: creat df/d1a/f1d x:0 0 0 2024-09-13T22:08:36.794 INFO:tasks.workunit.client.0.smithi089.stdout:2/86: chown l8 1213494 1 2024-09-13T22:08:36.794 INFO:tasks.workunit.client.0.smithi089.stdout:2/87: readlink l6 0 2024-09-13T22:08:36.796 INFO:tasks.workunit.client.0.smithi089.stdout:0/121: mknod d1/de/d1f/c22 0 2024-09-13T22:08:36.797 INFO:tasks.workunit.client.0.smithi089.stdout:7/61: sync 2024-09-13T22:08:36.797 INFO:tasks.workunit.client.0.smithi089.stdout:7/62: chown d0/f7 279004 1 2024-09-13T22:08:36.799 INFO:tasks.workunit.client.0.smithi089.stdout:4/63: write d0/f6 [1018775,72321] 0 2024-09-13T22:08:36.799 INFO:tasks.workunit.client.0.smithi089.stdout:4/64: getdents d0/d11 0 2024-09-13T22:08:36.801 INFO:tasks.workunit.client.0.smithi089.stdout:5/93: write d4/f8 [871929,11023] 0 2024-09-13T22:08:36.802 INFO:tasks.workunit.client.0.smithi089.stdout:0/122: mknod d1/d16/c23 0 2024-09-13T22:08:36.802 INFO:tasks.workunit.client.0.smithi089.stdout:0/123: write d1/f1e [151612,74500] 0 2024-09-13T22:08:36.803 INFO:tasks.workunit.client.0.smithi089.stdout:4/65: symlink d0/d11/l14 0 2024-09-13T22:08:36.803 INFO:tasks.workunit.client.0.smithi089.stdout:4/66: dread - d0/f13 zero size 2024-09-13T22:08:36.803 INFO:tasks.workunit.client.0.smithi089.stdout:4/67: chown d0/f13 14661770 1 2024-09-13T22:08:36.804 INFO:tasks.workunit.client.0.smithi089.stdout:4/68: stat d0/f6 0 2024-09-13T22:08:36.804 INFO:tasks.workunit.client.0.smithi089.stdout:2/88: write f3 [8185939,1743] 0 2024-09-13T22:08:36.806 INFO:tasks.workunit.client.0.smithi089.stdout:5/94: mknod d4/c26 0 2024-09-13T22:08:36.812 INFO:tasks.workunit.client.0.smithi089.stdout:1/104: dread d7/f26 [0,4194304] 0 2024-09-13T22:08:36.812 INFO:tasks.workunit.client.0.smithi089.stdout:1/105: read - d7/de/d1b/d20/f28 zero size 2024-09-13T22:08:36.812 INFO:tasks.workunit.client.0.smithi089.stdout:1/106: write d7/fd [4310617,72770] 0 2024-09-13T22:08:36.812 INFO:tasks.workunit.client.0.smithi089.stdout:1/107: creat d7/de/f2a x:0 0 0 2024-09-13T22:08:36.812 INFO:tasks.workunit.client.0.smithi089.stdout:1/108: write d7/de/f11 [1097113,119385] 0 2024-09-13T22:08:36.812 INFO:tasks.workunit.client.0.smithi089.stdout:4/69: readlink d0/lf 0 2024-09-13T22:08:36.816 INFO:tasks.workunit.client.0.smithi089.stdout:5/95: rename d4/fa to d4/f27 0 2024-09-13T22:08:36.816 INFO:tasks.workunit.client.0.smithi089.stdout:5/96: read - d4/d19/f1b zero size 2024-09-13T22:08:36.818 INFO:tasks.workunit.client.0.smithi089.stdout:0/124: write d1/de/f14 [1797946,24316] 0 2024-09-13T22:08:36.820 INFO:tasks.workunit.client.0.smithi089.stdout:1/109: mkdir d7/de/d1b/d2b 0 2024-09-13T22:08:36.822 INFO:tasks.workunit.client.0.smithi089.stdout:4/70: chown d0/c5 1019 1 2024-09-13T22:08:36.824 INFO:tasks.workunit.client.0.smithi089.stdout:5/97: mkdir d4/d19/d1e/d28 0 2024-09-13T22:08:36.827 INFO:tasks.workunit.client.0.smithi089.stdout:0/125: creat d1/de/d15/f24 x:0 0 0 2024-09-13T22:08:36.827 INFO:tasks.workunit.client.0.smithi089.stdout:0/126: write d1/f5 [1212247,101706] 0 2024-09-13T22:08:36.827 INFO:tasks.workunit.client.0.smithi089.stdout:0/127: readlink d1/lc 0 2024-09-13T22:08:36.827 INFO:tasks.workunit.client.0.smithi089.stdout:0/128: chown d1/f5 0 1 2024-09-13T22:08:36.827 INFO:tasks.workunit.client.0.smithi089.stdout:0/129: stat d1/de/d1f 0 2024-09-13T22:08:36.827 INFO:tasks.workunit.client.0.smithi089.stdout:0/130: dread - d1/de/d15/f24 zero size 2024-09-13T22:08:36.828 INFO:tasks.workunit.client.0.smithi089.stdout:0/131: stat d1/de 0 2024-09-13T22:08:36.828 INFO:tasks.workunit.client.0.smithi089.stdout:0/132: dread - d1/de/d15/f24 zero size 2024-09-13T22:08:36.834 INFO:tasks.workunit.client.0.smithi089.stdout:1/110: write d7/f18 [2796521,35938] 0 2024-09-13T22:08:36.835 INFO:tasks.workunit.client.0.smithi089.stdout:6/75: dwrite d0/d5/f7 [0,4194304] 0 2024-09-13T22:08:36.835 INFO:tasks.workunit.client.0.smithi089.stdout:6/76: write d0/f11 [359646,42607] 0 2024-09-13T22:08:36.836 INFO:tasks.workunit.client.0.smithi089.stdout:8/101: dwrite d0/dd/d12/f1a [0,4194304] 0 2024-09-13T22:08:36.836 INFO:tasks.workunit.client.0.smithi089.stdout:7/63: dwrite d0/f5 [0,4194304] 0 2024-09-13T22:08:36.836 INFO:tasks.workunit.client.0.smithi089.stdout:7/64: readlink d0/l10 0 2024-09-13T22:08:36.837 INFO:tasks.workunit.client.0.smithi089.stdout:2/89: dwrite df/f11 [0,4194304] 0 2024-09-13T22:08:36.839 INFO:tasks.workunit.client.0.smithi089.stdout:1/111: rename d7/d1c/f22 to d7/de/d1b/d2b/f2c 0 2024-09-13T22:08:36.841 INFO:tasks.workunit.client.0.smithi089.stdout:5/98: dread d4/f8 [0,4194304] 0 2024-09-13T22:08:36.843 INFO:tasks.workunit.client.0.smithi089.stdout:1/112: dread d7/f9 [0,4194304] 0 2024-09-13T22:08:36.843 INFO:tasks.workunit.client.0.smithi089.stdout:1/113: dread - d7/de/f2a zero size 2024-09-13T22:08:36.844 INFO:tasks.workunit.client.0.smithi089.stdout:1/114: fdatasync d7/f18 0 2024-09-13T22:08:36.845 INFO:tasks.workunit.client.0.smithi089.stdout:0/133: dread d1/de/f14 [0,4194304] 0 2024-09-13T22:08:36.850 INFO:tasks.workunit.client.0.smithi089.stdout:4/71: dwrite d0/f8 [0,4194304] 0 2024-09-13T22:08:36.850 INFO:tasks.workunit.client.0.smithi089.stdout:4/72: readlink d0/lf 0 2024-09-13T22:08:36.853 INFO:tasks.workunit.client.0.smithi089.stdout:1/115: dread d7/de/f14 [0,4194304] 0 2024-09-13T22:08:36.857 INFO:tasks.workunit.client.0.smithi089.stdout:7/65: getdents d0 0 2024-09-13T22:08:36.857 INFO:tasks.workunit.client.0.smithi089.stdout:7/66: chown d0/c4 13 1 2024-09-13T22:08:36.858 INFO:tasks.workunit.client.0.smithi089.stdout:7/67: read d0/ff [447812,99733] 0 2024-09-13T22:08:36.859 INFO:tasks.workunit.client.0.smithi089.stdout:8/102: rename d0/dd/d12/d20/d1c/c1e to d0/d16/c27 0 2024-09-13T22:08:36.862 INFO:tasks.workunit.client.0.smithi089.stdout:6/77: dwrite d0/f11 [0,4194304] 0 2024-09-13T22:08:36.863 INFO:tasks.workunit.client.0.smithi089.stdout:0/134: symlink d1/d16/l25 0 2024-09-13T22:08:36.870 INFO:tasks.workunit.client.0.smithi089.stdout:1/116: creat d7/de/d1b/d2b/f2d x:0 0 0 2024-09-13T22:08:36.872 INFO:tasks.workunit.client.0.smithi089.stdout:6/78: dread d0/d5/f7 [0,4194304] 0 2024-09-13T22:08:36.872 INFO:tasks.workunit.client.0.smithi089.stdout:6/79: read - d0/d4/d12/f13 zero size 2024-09-13T22:08:36.872 INFO:tasks.workunit.client.0.smithi089.stdout:6/80: write d0/d5/f14 [719684,15504] 0 2024-09-13T22:08:36.872 INFO:tasks.workunit.client.0.smithi089.stdout:6/81: write d0/d5/f14 [1653926,75046] 0 2024-09-13T22:08:36.872 INFO:tasks.workunit.client.0.smithi089.stdout:8/103: truncate d0/dd/fb 351468 0 2024-09-13T22:08:36.873 INFO:tasks.workunit.client.0.smithi089.stdout:8/104: truncate d0/dd/d1d/f21 225363 0 2024-09-13T22:08:36.875 INFO:tasks.workunit.client.0.smithi089.stdout:0/135: link d1/d16/l25 d1/l26 0 2024-09-13T22:08:36.876 INFO:tasks.workunit.client.0.smithi089.stdout:4/73: mkdir d0/d15 0 2024-09-13T22:08:36.877 INFO:tasks.workunit.client.0.smithi089.stdout:1/117: dread d7/f24 [4194304,4194304] 0 2024-09-13T22:08:36.877 INFO:tasks.workunit.client.0.smithi089.stdout:1/118: readlink d7/l17 0 2024-09-13T22:08:36.879 INFO:tasks.workunit.client.0.smithi089.stdout:7/68: dwrite d0/f7 [0,4194304] 0 2024-09-13T22:08:36.879 INFO:tasks.workunit.client.0.smithi089.stdout:8/105: symlink d0/dd/d1d/l28 0 2024-09-13T22:08:36.879 INFO:tasks.workunit.client.0.smithi089.stdout:8/106: write d0/dd/d12/d20/f17 [1443023,16523] 0 2024-09-13T22:08:36.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/136: dread d1/f5 [0,4194304] 0 2024-09-13T22:08:36.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/137: chown d1/f1e 27 1 2024-09-13T22:08:36.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/138: write d1/de/d15/f24 [758709,30370] 0 2024-09-13T22:08:36.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/139: write d1/f11 [4499901,72057] 0 2024-09-13T22:08:36.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/140: read - d1/de/f17 zero size 2024-09-13T22:08:36.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/141: creat d1/f27 x:0 0 0 2024-09-13T22:08:36.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/142: chown d1/f11 1077150 1 2024-09-13T22:08:36.882 INFO:tasks.workunit.client.0.smithi089.stdout:4/74: mkdir d0/d11/d16 0 2024-09-13T22:08:36.883 INFO:tasks.workunit.client.0.smithi089.stdout:1/119: rename d7/de/f2a to d7/de/d1b/d2b/f2e 0 2024-09-13T22:08:36.884 INFO:tasks.workunit.client.0.smithi089.stdout:1/120: dread d7/f9 [0,4194304] 0 2024-09-13T22:08:36.889 INFO:tasks.workunit.client.0.smithi089.stdout:0/143: mkdir d1/de/d10/d28 0 2024-09-13T22:08:36.889 INFO:tasks.workunit.client.0.smithi089.stdout:4/75: truncate d0/f7 875321 0 2024-09-13T22:08:36.890 INFO:tasks.workunit.client.0.smithi089.stdout:6/82: dwrite d0/d4/d12/f13 [0,4194304] 0 2024-09-13T22:08:36.890 INFO:tasks.workunit.client.0.smithi089.stdout:6/83: chown d0/cd 2976273 1 2024-09-13T22:08:36.891 INFO:tasks.workunit.client.0.smithi089.stdout:1/121: mknod d7/de/d1b/d20/c2f 0 2024-09-13T22:08:36.894 INFO:tasks.workunit.client.0.smithi089.stdout:7/69: write d0/f5 [4877635,86029] 0 2024-09-13T22:08:36.894 INFO:tasks.workunit.client.0.smithi089.stdout:7/70: fdatasync d0/ff 0 2024-09-13T22:08:36.896 INFO:tasks.workunit.client.0.smithi089.stdout:4/76: dread d0/f8 [0,4194304] 0 2024-09-13T22:08:36.898 INFO:tasks.workunit.client.0.smithi089.stdout:8/107: write d0/dd/ff [1176937,94872] 0 2024-09-13T22:08:36.906 INFO:tasks.workunit.client.0.smithi089.stdout:3/116: sync 2024-09-13T22:08:36.906 INFO:tasks.workunit.client.0.smithi089.stdout:9/85: sync 2024-09-13T22:08:36.907 INFO:tasks.workunit.client.0.smithi089.stdout:3/117: stat d1/d2/d4/d1c 0 2024-09-13T22:08:36.907 INFO:tasks.workunit.client.0.smithi089.stdout:9/86: readlink d6/ld 0 2024-09-13T22:08:36.907 INFO:tasks.workunit.client.0.smithi089.stdout:9/87: write f1 [1018764,28530] 0 2024-09-13T22:08:36.907 INFO:tasks.workunit.client.0.smithi089.stdout:9/88: write d6/f15 [286542,58898] 0 2024-09-13T22:08:36.908 INFO:tasks.workunit.client.0.smithi089.stdout:1/122: rename d7/f24 to d7/de/f30 0 2024-09-13T22:08:36.908 INFO:tasks.workunit.client.0.smithi089.stdout:4/77: rename d0 to d0/d11/d17 22 2024-09-13T22:08:36.912 INFO:tasks.workunit.client.0.smithi089.stdout:7/71: creat d0/f11 x:0 0 0 2024-09-13T22:08:36.913 INFO:tasks.workunit.client.0.smithi089.stdout:8/108: link d0/dd/d1d/f26 d0/dd/d11/f29 0 2024-09-13T22:08:36.915 INFO:tasks.workunit.client.0.smithi089.stdout:3/118: link d1/d7/c19 d1/d2/d18/c2e 0 2024-09-13T22:08:36.917 INFO:tasks.workunit.client.0.smithi089.stdout:8/109: dread d0/f8 [0,4194304] 0 2024-09-13T22:08:36.918 INFO:tasks.workunit.client.0.smithi089.stdout:1/123: mknod d7/de/d1b/d20/c31 0 2024-09-13T22:08:36.920 INFO:tasks.workunit.client.0.smithi089.stdout:4/78: creat d0/d11/f18 x:0 0 0 2024-09-13T22:08:36.921 INFO:tasks.workunit.client.0.smithi089.stdout:7/72: truncate d0/ff 261112 0 2024-09-13T22:08:36.921 INFO:tasks.workunit.client.0.smithi089.stdout:7/73: readlink d0/l10 0 2024-09-13T22:08:36.923 INFO:tasks.workunit.client.0.smithi089.stdout:3/119: truncate d1/d2/d4/f9 64961 0 2024-09-13T22:08:36.925 INFO:tasks.workunit.client.0.smithi089.stdout:9/89: getdents d6/d18 0 2024-09-13T22:08:36.927 INFO:tasks.workunit.client.0.smithi089.stdout:8/110: truncate d0/f5 343222 0 2024-09-13T22:08:36.927 INFO:tasks.workunit.client.0.smithi089.stdout:8/111: creat d0/dd/d1d/f2a x:0 0 0 2024-09-13T22:08:36.929 INFO:tasks.workunit.client.0.smithi089.stdout:1/124: mknod d7/de/d1b/c32 0 2024-09-13T22:08:36.929 INFO:tasks.workunit.client.0.smithi089.stdout:1/125: fsync d7/f18 0 2024-09-13T22:08:36.930 INFO:tasks.workunit.client.0.smithi089.stdout:4/79: unlink d0/d11/l14 0 2024-09-13T22:08:36.930 INFO:tasks.workunit.client.0.smithi089.stdout:9/90: dread d6/f16 [0,4194304] 0 2024-09-13T22:08:36.930 INFO:tasks.workunit.client.0.smithi089.stdout:9/91: write d6/f24 [583046,46088] 0 2024-09-13T22:08:36.931 INFO:tasks.workunit.client.0.smithi089.stdout:9/92: chown d6/ce 191 1 2024-09-13T22:08:36.933 INFO:tasks.workunit.client.0.smithi089.stdout:3/120: symlink d1/d2/l2f 0 2024-09-13T22:08:36.934 INFO:tasks.workunit.client.0.smithi089.stdout:3/121: dread d1/d2/f29 [0,4194304] 0 2024-09-13T22:08:36.936 INFO:tasks.workunit.client.0.smithi089.stdout:8/112: link d0/dd/d12/f1a d0/f2b 0 2024-09-13T22:08:36.938 INFO:tasks.workunit.client.0.smithi089.stdout:1/126: link d7/fd d7/f33 0 2024-09-13T22:08:36.939 INFO:tasks.workunit.client.0.smithi089.stdout:0/144: rmdir d1/de 39 2024-09-13T22:08:36.939 INFO:tasks.workunit.client.0.smithi089.stdout:0/145: chown d1/d16/c23 1424991 1 2024-09-13T22:08:36.941 INFO:tasks.workunit.client.0.smithi089.stdout:9/93: creat d6/d18/d1b/f26 x:0 0 0 2024-09-13T22:08:36.944 INFO:tasks.workunit.client.0.smithi089.stdout:3/122: mknod d1/c30 0 2024-09-13T22:08:36.946 INFO:tasks.workunit.client.0.smithi089.stdout:8/113: creat d0/d16/f2c x:0 0 0 2024-09-13T22:08:36.946 INFO:tasks.workunit.client.0.smithi089.stdout:8/114: creat d0/dd/d11/f2d x:0 0 0 2024-09-13T22:08:36.946 INFO:tasks.workunit.client.0.smithi089.stdout:8/115: write d0/dd/ff [2507167,36544] 0 2024-09-13T22:08:36.946 INFO:tasks.workunit.client.0.smithi089.stdout:8/116: read d0/dd/fb [231035,73109] 0 2024-09-13T22:08:36.948 INFO:tasks.workunit.client.0.smithi089.stdout:0/146: link d1/c19 d1/de/d10/d28/c29 0 2024-09-13T22:08:36.949 INFO:tasks.workunit.client.0.smithi089.stdout:5/99: sync 2024-09-13T22:08:36.949 INFO:tasks.workunit.client.0.smithi089.stdout:2/90: sync 2024-09-13T22:08:36.953 INFO:tasks.workunit.client.0.smithi089.stdout:9/94: rmdir d6/d18/d22 0 2024-09-13T22:08:36.956 INFO:tasks.workunit.client.0.smithi089.stdout:2/91: dread fb [0,4194304] 0 2024-09-13T22:08:36.957 INFO:tasks.workunit.client.0.smithi089.stdout:9/95: getdents d6/d18/d21 0 2024-09-13T22:08:36.957 INFO:tasks.workunit.client.0.smithi089.stdout:9/96: chown d6 23 1 2024-09-13T22:08:36.958 INFO:tasks.workunit.client.0.smithi089.stdout:2/92: link df/c1c df/d14/c1e 0 2024-09-13T22:08:36.959 INFO:tasks.workunit.client.0.smithi089.stdout:9/97: dread d6/f12 [0,4194304] 0 2024-09-13T22:08:36.962 INFO:tasks.workunit.client.0.smithi089.stdout:9/98: creat d6/d18/d21/f27 x:0 0 0 2024-09-13T22:08:36.962 INFO:tasks.workunit.client.0.smithi089.stdout:9/99: readlink d6/ld 0 2024-09-13T22:08:36.962 INFO:tasks.workunit.client.0.smithi089.stdout:9/100: truncate d6/ff 1398669 0 2024-09-13T22:08:36.965 INFO:tasks.workunit.client.0.smithi089.stdout:9/101: link d6/l13 d6/d18/d1b/l28 0 2024-09-13T22:08:36.967 INFO:tasks.workunit.client.0.smithi089.stdout:1/127: rename d7/de/d1b/d20 to d7/d34 0 2024-09-13T22:08:36.967 INFO:tasks.workunit.client.0.smithi089.stdout:5/100: dwrite d4/d19/f1b [0,4194304] 0 2024-09-13T22:08:36.968 INFO:tasks.workunit.client.0.smithi089.stdout:7/74: rmdir d0 39 2024-09-13T22:08:36.969 INFO:tasks.workunit.client.0.smithi089.stdout:9/102: rmdir d6/d18 39 2024-09-13T22:08:36.972 INFO:tasks.workunit.client.0.smithi089.stdout:3/123: rename d1/d2/d4/d1c/d1d to d1/d2/d31 0 2024-09-13T22:08:36.972 INFO:tasks.workunit.client.0.smithi089.stdout:3/124: readlink d1/d2/l2f 0 2024-09-13T22:08:36.973 INFO:tasks.workunit.client.0.smithi089.stdout:6/84: dwrite d0/d4/d12/f13 [4194304,4194304] 0 2024-09-13T22:08:36.973 INFO:tasks.workunit.client.0.smithi089.stdout:6/85: chown d0/d5 35971 1 2024-09-13T22:08:36.973 INFO:tasks.workunit.client.0.smithi089.stdout:6/86: chown d0/cf 3879 1 2024-09-13T22:08:36.975 INFO:tasks.workunit.client.0.smithi089.stdout:1/128: creat d7/d1c/f35 x:0 0 0 2024-09-13T22:08:36.979 INFO:tasks.workunit.client.0.smithi089.stdout:5/101: stat d4/d19/c1d 0 2024-09-13T22:08:36.980 INFO:tasks.workunit.client.0.smithi089.stdout:4/80: rmdir d0 39 2024-09-13T22:08:36.982 INFO:tasks.workunit.client.0.smithi089.stdout:7/75: creat d0/f12 x:0 0 0 2024-09-13T22:08:36.982 INFO:tasks.workunit.client.0.smithi089.stdout:2/93: dwrite fb [0,4194304] 0 2024-09-13T22:08:36.984 INFO:tasks.workunit.client.0.smithi089.stdout:5/102: write d4/ff [928101,21993] 0 2024-09-13T22:08:36.989 INFO:tasks.workunit.client.0.smithi089.stdout:3/125: symlink d1/l32 0 2024-09-13T22:08:36.989 INFO:tasks.workunit.client.0.smithi089.stdout:3/126: chown d1/d7/le 0 1 2024-09-13T22:08:36.995 INFO:tasks.workunit.client.0.smithi089.stdout:1/129: truncate d7/de/f11 147841 0 2024-09-13T22:08:36.998 INFO:tasks.workunit.client.0.smithi089.stdout:3/127: write d1/d2/d4/d1c/f2a [1416181,28590] 0 2024-09-13T22:08:36.998 INFO:tasks.workunit.client.0.smithi089.stdout:8/117: dwrite d0/f5 [0,4194304] 0 2024-09-13T22:08:36.998 INFO:tasks.workunit.client.0.smithi089.stdout:3/128: write d1/f13 [745244,72687] 0 2024-09-13T22:08:37.001 INFO:tasks.workunit.client.0.smithi089.stdout:2/94: link df/c18 df/d1a/c1f 0 2024-09-13T22:08:37.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/87: rmdir d0/d4/d12 39 2024-09-13T22:08:37.007 INFO:tasks.workunit.client.0.smithi089.stdout:0/147: rename d1/de/d10/d28 to d1/de/d15/d2a 0 2024-09-13T22:08:37.007 INFO:tasks.workunit.client.0.smithi089.stdout:4/81: symlink d0/l19 0 2024-09-13T22:08:37.012 INFO:tasks.workunit.client.0.smithi089.stdout:7/76: dwrite d0/fd [0,4194304] 0 2024-09-13T22:08:37.012 INFO:tasks.workunit.client.0.smithi089.stdout:7/77: chown d0/cc 19 1 2024-09-13T22:08:37.012 INFO:tasks.workunit.client.0.smithi089.stdout:5/103: dwrite d4/f5 [0,4194304] 0 2024-09-13T22:08:37.013 INFO:tasks.workunit.client.0.smithi089.stdout:4/82: read d0/f8 [3893920,18755] 0 2024-09-13T22:08:37.014 INFO:tasks.workunit.client.0.smithi089.stdout:3/129: rename d1/c22 to d1/d2/d31/c33 0 2024-09-13T22:08:37.016 INFO:tasks.workunit.client.0.smithi089.stdout:8/118: getdents d0/dd 0 2024-09-13T22:08:37.016 INFO:tasks.workunit.client.0.smithi089.stdout:8/119: truncate d0/dd/d11/f29 8365 0 2024-09-13T22:08:37.022 INFO:tasks.workunit.client.0.smithi089.stdout:4/83: dread d0/f12 [0,4194304] 0 2024-09-13T22:08:37.024 INFO:tasks.workunit.client.0.smithi089.stdout:9/103: getdents d6/d18/d1b 0 2024-09-13T22:08:37.024 INFO:tasks.workunit.client.0.smithi089.stdout:9/104: fdatasync d6/ff 0 2024-09-13T22:08:37.026 INFO:tasks.workunit.client.0.smithi089.stdout:5/104: creat d4/f29 x:0 0 0 2024-09-13T22:08:37.028 INFO:tasks.workunit.client.0.smithi089.stdout:2/95: getdents df 0 2024-09-13T22:08:37.028 INFO:tasks.workunit.client.0.smithi089.stdout:2/96: write f3 [9036117,23316] 0 2024-09-13T22:08:37.029 INFO:tasks.workunit.client.0.smithi089.stdout:3/130: mkdir d1/d7/d34 0 2024-09-13T22:08:37.029 INFO:tasks.workunit.client.0.smithi089.stdout:3/131: fsync d1/d2/ff 0 2024-09-13T22:08:37.031 INFO:tasks.workunit.client.0.smithi089.stdout:8/120: rename d0/dd/f15 to d0/dd/d12/d20/f2e 0 2024-09-13T22:08:37.032 INFO:tasks.workunit.client.0.smithi089.stdout:4/84: creat d0/f1a x:0 0 0 2024-09-13T22:08:37.033 INFO:tasks.workunit.client.0.smithi089.stdout:4/85: write d0/f13 [879545,73422] 0 2024-09-13T22:08:37.033 INFO:tasks.workunit.client.0.smithi089.stdout:4/86: write d0/f13 [1213006,91467] 0 2024-09-13T22:08:37.033 INFO:tasks.workunit.client.0.smithi089.stdout:9/105: symlink d6/d18/l29 0 2024-09-13T22:08:37.034 INFO:tasks.workunit.client.0.smithi089.stdout:0/148: dwrite d1/f7 [0,4194304] 0 2024-09-13T22:08:37.035 INFO:tasks.workunit.client.0.smithi089.stdout:6/88: dwrite d0/d4/d12/f13 [4194304,4194304] 0 2024-09-13T22:08:37.036 INFO:tasks.workunit.client.0.smithi089.stdout:5/105: symlink d4/d19/d1e/l2a 0 2024-09-13T22:08:37.036 INFO:tasks.workunit.client.0.smithi089.stdout:5/106: chown d4/c25 5302 1 2024-09-13T22:08:37.043 INFO:tasks.workunit.client.0.smithi089.stdout:9/106: dread d6/f15 [0,4194304] 0 2024-09-13T22:08:37.044 INFO:tasks.workunit.client.0.smithi089.stdout:2/97: dread fa [4194304,4194304] 0 2024-09-13T22:08:37.045 INFO:tasks.workunit.client.0.smithi089.stdout:4/87: getdents d0/d11 0 2024-09-13T22:08:37.045 INFO:tasks.workunit.client.0.smithi089.stdout:4/88: write d0/f13 [1732836,44499] 0 2024-09-13T22:08:37.045 INFO:tasks.workunit.client.0.smithi089.stdout:4/89: write d0/f7 [1568202,17527] 0 2024-09-13T22:08:37.049 INFO:tasks.workunit.client.0.smithi089.stdout:0/149: link d1/ca d1/d16/c2b 0 2024-09-13T22:08:37.051 INFO:tasks.workunit.client.0.smithi089.stdout:6/89: mknod d0/c17 0 2024-09-13T22:08:37.056 INFO:tasks.workunit.client.0.smithi089.stdout:2/98: write df/f11 [159856,43368] 0 2024-09-13T22:08:37.057 INFO:tasks.workunit.client.0.smithi089.stdout:8/121: creat d0/dd/d12/d20/d1c/f2f x:0 0 0 2024-09-13T22:08:37.057 INFO:tasks.workunit.client.0.smithi089.stdout:8/122: dread - d0/d16/f2c zero size 2024-09-13T22:08:37.058 INFO:tasks.workunit.client.0.smithi089.stdout:3/132: dwrite d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:37.058 INFO:tasks.workunit.client.0.smithi089.stdout:3/133: creat d1/d2/d23/f35 x:0 0 0 2024-09-13T22:08:37.058 INFO:tasks.workunit.client.0.smithi089.stdout:7/78: dwrite d0/f5 [8388608,4194304] 0 2024-09-13T22:08:37.064 INFO:tasks.workunit.client.0.smithi089.stdout:6/90: write d0/d4/d12/f13 [6522031,116175] 0 2024-09-13T22:08:37.065 INFO:tasks.workunit.client.0.smithi089.stdout:1/130: dwrite d7/f26 [0,4194304] 0 2024-09-13T22:08:37.067 INFO:tasks.workunit.client.0.smithi089.stdout:2/99: stat df/c18 0 2024-09-13T22:08:37.067 INFO:tasks.workunit.client.0.smithi089.stdout:2/100: fdatasync df/f10 0 2024-09-13T22:08:37.080 INFO:tasks.workunit.client.0.smithi089.stdout:7/79: symlink d0/l13 0 2024-09-13T22:08:37.080 INFO:tasks.workunit.client.0.smithi089.stdout:7/80: creat d0/f14 x:0 0 0 2024-09-13T22:08:37.080 INFO:tasks.workunit.client.0.smithi089.stdout:7/81: truncate d0/f5 12755893 0 2024-09-13T22:08:37.082 INFO:tasks.workunit.client.0.smithi089.stdout:9/107: rmdir d6/d18/d21 39 2024-09-13T22:08:37.083 INFO:tasks.workunit.client.0.smithi089.stdout:4/90: link d0/l19 d0/l1b 0 2024-09-13T22:08:37.087 INFO:tasks.workunit.client.0.smithi089.stdout:3/134: dwrite d1/d2/d23/f27 [0,4194304] 0 2024-09-13T22:08:37.088 INFO:tasks.workunit.client.0.smithi089.stdout:2/101: link df/c19 df/c20 0 2024-09-13T22:08:37.089 INFO:tasks.workunit.client.0.smithi089.stdout:2/102: chown l6 3378103 1 2024-09-13T22:08:37.090 INFO:tasks.workunit.client.0.smithi089.stdout:6/91: dwrite d0/f11 [4194304,4194304] 0 2024-09-13T22:08:37.090 INFO:tasks.workunit.client.0.smithi089.stdout:1/131: dwrite d7/fb [0,4194304] 0 2024-09-13T22:08:37.094 INFO:tasks.workunit.client.0.smithi089.stdout:6/92: write d0/d5/f14 [1580360,6384] 0 2024-09-13T22:08:37.099 INFO:tasks.workunit.client.0.smithi089.stdout:8/123: symlink d0/dd/d1d/l30 0 2024-09-13T22:08:37.104 INFO:tasks.workunit.client.0.smithi089.stdout:7/82: mknod d0/c15 0 2024-09-13T22:08:37.104 INFO:tasks.workunit.client.0.smithi089.stdout:9/108: dwrite d6/f1e [0,4194304] 0 2024-09-13T22:08:37.105 INFO:tasks.workunit.client.0.smithi089.stdout:4/91: truncate d0/f6 626069 0 2024-09-13T22:08:37.109 INFO:tasks.workunit.client.0.smithi089.stdout:2/103: creat df/d14/f21 x:0 0 0 2024-09-13T22:08:37.110 INFO:tasks.workunit.client.0.smithi089.stdout:3/135: dwrite d1/d2/f14 [0,4194304] 0 2024-09-13T22:08:37.112 INFO:tasks.workunit.client.0.smithi089.stdout:7/83: dread d0/fd [0,4194304] 0 2024-09-13T22:08:37.115 INFO:tasks.workunit.client.0.smithi089.stdout:7/84: write d0/fd [2751916,84138] 0 2024-09-13T22:08:37.115 INFO:tasks.workunit.client.0.smithi089.stdout:7/85: fdatasync d0/f11 0 2024-09-13T22:08:37.116 INFO:tasks.workunit.client.0.smithi089.stdout:7/86: fdatasync d0/f11 0 2024-09-13T22:08:37.118 INFO:tasks.workunit.client.0.smithi089.stdout:9/109: read d6/f12 [2966211,65947] 0 2024-09-13T22:08:37.118 INFO:tasks.workunit.client.0.smithi089.stdout:1/132: dwrite d7/f18 [0,4194304] 0 2024-09-13T22:08:37.118 INFO:tasks.workunit.client.0.smithi089.stdout:6/93: mknod d0/d9/c18 0 2024-09-13T22:08:37.118 INFO:tasks.workunit.client.0.smithi089.stdout:8/124: rmdir d0/dd/d12/d20 39 2024-09-13T22:08:37.123 INFO:tasks.workunit.client.0.smithi089.stdout:3/136: dread d1/d7/d1b/d28/f2c [0,4194304] 0 2024-09-13T22:08:37.123 INFO:tasks.workunit.client.0.smithi089.stdout:1/133: dread d7/de/f30 [4194304,4194304] 0 2024-09-13T22:08:37.123 INFO:tasks.workunit.client.0.smithi089.stdout:1/134: fsync d7/fd 0 2024-09-13T22:08:37.123 INFO:tasks.workunit.client.0.smithi089.stdout:2/104: creat df/f22 x:0 0 0 2024-09-13T22:08:37.123 INFO:tasks.workunit.client.0.smithi089.stdout:2/105: dread - df/f22 zero size 2024-09-13T22:08:37.135 INFO:tasks.workunit.client.0.smithi089.stdout:9/110: rename d6/f1e to d6/d18/f2a 0 2024-09-13T22:08:37.140 INFO:tasks.workunit.client.0.smithi089.stdout:1/135: mknod d7/d34/c36 0 2024-09-13T22:08:37.142 INFO:tasks.workunit.client.0.smithi089.stdout:9/111: rename f1 to d6/f2b 0 2024-09-13T22:08:37.144 INFO:tasks.workunit.client.0.smithi089.stdout:8/125: mkdir d0/dd/d31 0 2024-09-13T22:08:37.144 INFO:tasks.workunit.client.0.smithi089.stdout:7/87: dwrite d0/f12 [0,4194304] 0 2024-09-13T22:08:37.147 INFO:tasks.workunit.client.0.smithi089.stdout:1/136: creat d7/d34/f37 x:0 0 0 2024-09-13T22:08:37.147 INFO:tasks.workunit.client.0.smithi089.stdout:6/94: dwrite d0/d5/f7 [0,4194304] 0 2024-09-13T22:08:37.149 INFO:tasks.workunit.client.0.smithi089.stdout:8/126: mkdir d0/dd/d12/d20/d32 0 2024-09-13T22:08:37.149 INFO:tasks.workunit.client.0.smithi089.stdout:2/106: dwrite fb [0,4194304] 0 2024-09-13T22:08:37.154 INFO:tasks.workunit.client.0.smithi089.stdout:7/88: symlink d0/l16 0 2024-09-13T22:08:37.155 INFO:tasks.workunit.client.0.smithi089.stdout:7/89: creat d0/f17 x:0 0 0 2024-09-13T22:08:37.160 INFO:tasks.workunit.client.0.smithi089.stdout:1/137: write d7/de/f11 [3474493,93696] 0 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/107: symlink df/d1a/l23 0 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/108: write df/f11 [4327099,120076] 0 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/109: truncate fe 4208918 0 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/110: write df/f22 [172463,35061] 0 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/111: creat df/d14/f24 x:0 0 0 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/112: readlink l8 0 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/113: creat df/d14/f25 x:0 0 0 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/114: dread - df/d14/f21 zero size 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/115: creat df/f26 x:0 0 0 2024-09-13T22:08:37.163 INFO:tasks.workunit.client.0.smithi089.stdout:2/116: chown fb 46059589 1 2024-09-13T22:08:37.166 INFO:tasks.workunit.client.0.smithi089.stdout:7/90: unlink d0/f12 0 2024-09-13T22:08:37.166 INFO:tasks.workunit.client.0.smithi089.stdout:4/92: dwrite d0/f12 [0,4194304] 0 2024-09-13T22:08:37.167 INFO:tasks.workunit.client.0.smithi089.stdout:4/93: fdatasync d0/f1a 0 2024-09-13T22:08:37.167 INFO:tasks.workunit.client.0.smithi089.stdout:4/94: dread - d0/d11/f18 zero size 2024-09-13T22:08:37.177 INFO:tasks.workunit.client.0.smithi089.stdout:7/91: rename d0/ca to d0/c18 0 2024-09-13T22:08:37.177 INFO:tasks.workunit.client.0.smithi089.stdout:7/92: write d0/fd [1692964,92293] 0 2024-09-13T22:08:37.177 INFO:tasks.workunit.client.0.smithi089.stdout:7/93: write d0/f11 [1010151,71800] 0 2024-09-13T22:08:37.177 INFO:tasks.workunit.client.0.smithi089.stdout:4/95: rmdir d0/d11 39 2024-09-13T22:08:37.178 INFO:tasks.workunit.client.0.smithi089.stdout:0/150: sync 2024-09-13T22:08:37.178 INFO:tasks.workunit.client.0.smithi089.stdout:5/107: sync 2024-09-13T22:08:37.178 INFO:tasks.workunit.client.0.smithi089.stdout:5/108: dread - d4/d19/f21 zero size 2024-09-13T22:08:37.180 INFO:tasks.workunit.client.0.smithi089.stdout:7/94: mkdir d0/d19 0 2024-09-13T22:08:37.183 INFO:tasks.workunit.client.0.smithi089.stdout:8/127: dwrite d0/dd/d12/d20/f17 [0,4194304] 0 2024-09-13T22:08:37.184 INFO:tasks.workunit.client.0.smithi089.stdout:6/95: dwrite d0/d5/f7 [0,4194304] 0 2024-09-13T22:08:37.185 INFO:tasks.workunit.client.0.smithi089.stdout:1/138: dwrite d7/de/f14 [0,4194304] 0 2024-09-13T22:08:37.185 INFO:tasks.workunit.client.0.smithi089.stdout:1/139: chown c6 36367056 1 2024-09-13T22:08:37.186 INFO:tasks.workunit.client.0.smithi089.stdout:1/140: creat d7/d34/f38 x:0 0 0 2024-09-13T22:08:37.186 INFO:tasks.workunit.client.0.smithi089.stdout:1/141: write d7/de/f27 [481786,122214] 0 2024-09-13T22:08:37.186 INFO:tasks.workunit.client.0.smithi089.stdout:1/142: chown d7/fd 1950 1 2024-09-13T22:08:37.186 INFO:tasks.workunit.client.0.smithi089.stdout:9/112: dwrite d6/f15 [0,4194304] 0 2024-09-13T22:08:37.189 INFO:tasks.workunit.client.0.smithi089.stdout:0/151: dread d1/fd [0,4194304] 0 2024-09-13T22:08:37.189 INFO:tasks.workunit.client.0.smithi089.stdout:0/152: write d1/f27 [167919,93903] 0 2024-09-13T22:08:37.189 INFO:tasks.workunit.client.0.smithi089.stdout:0/153: chown d1/d16/c2b 4749 1 2024-09-13T22:08:37.189 INFO:tasks.workunit.client.0.smithi089.stdout:0/154: chown d1/de 40928446 1 2024-09-13T22:08:37.193 INFO:tasks.workunit.client.0.smithi089.stdout:8/128: chown d0/dd/d11/f25 20165 1 2024-09-13T22:08:37.205 INFO:tasks.workunit.client.0.smithi089.stdout:1/143: mkdir d7/de/d1b/d2b/d39 0 2024-09-13T22:08:37.208 INFO:tasks.workunit.client.0.smithi089.stdout:9/113: rename d6/l7 to d6/d18/d1b/l2c 0 2024-09-13T22:08:37.210 INFO:tasks.workunit.client.0.smithi089.stdout:5/109: dwrite d4/f29 [0,4194304] 0 2024-09-13T22:08:37.210 INFO:tasks.workunit.client.0.smithi089.stdout:5/110: creat d4/d19/f2b x:0 0 0 2024-09-13T22:08:37.210 INFO:tasks.workunit.client.0.smithi089.stdout:7/95: dwrite d0/f17 [0,4194304] 0 2024-09-13T22:08:37.210 INFO:tasks.workunit.client.0.smithi089.stdout:7/96: chown d0/c3 15858 1 2024-09-13T22:08:37.210 INFO:tasks.workunit.client.0.smithi089.stdout:7/97: fdatasync d0/ff 0 2024-09-13T22:08:37.212 INFO:tasks.workunit.client.0.smithi089.stdout:0/155: mknod d1/de/d10/c2c 0 2024-09-13T22:08:37.214 INFO:tasks.workunit.client.0.smithi089.stdout:6/96: rmdir d0/d5 39 2024-09-13T22:08:37.216 INFO:tasks.workunit.client.0.smithi089.stdout:1/144: mkdir d7/de/d3a 0 2024-09-13T22:08:37.217 INFO:tasks.workunit.client.0.smithi089.stdout:9/114: mknod d6/d18/d1b/c2d 0 2024-09-13T22:08:37.223 INFO:tasks.workunit.client.0.smithi089.stdout:2/117: truncate fe 2366777 0 2024-09-13T22:08:37.224 INFO:tasks.workunit.client.0.smithi089.stdout:5/111: dwrite d4/d19/f24 [0,4194304] 0 2024-09-13T22:08:37.224 INFO:tasks.workunit.client.0.smithi089.stdout:5/112: write d4/f8 [745001,98441] 0 2024-09-13T22:08:37.228 INFO:tasks.workunit.client.0.smithi089.stdout:1/145: write d7/fd [3115653,106] 0 2024-09-13T22:08:37.228 INFO:tasks.workunit.client.0.smithi089.stdout:1/146: write d7/f33 [4911142,7519] 0 2024-09-13T22:08:37.229 INFO:tasks.workunit.client.0.smithi089.stdout:1/147: write d7/f9 [1537460,12382] 0 2024-09-13T22:08:37.229 INFO:tasks.workunit.client.0.smithi089.stdout:7/98: unlink d0/c3 0 2024-09-13T22:08:37.229 INFO:tasks.workunit.client.0.smithi089.stdout:7/99: creat d0/f1a x:0 0 0 2024-09-13T22:08:37.231 INFO:tasks.workunit.client.0.smithi089.stdout:0/156: getdents d1/d16 0 2024-09-13T22:08:37.231 INFO:tasks.workunit.client.0.smithi089.stdout:0/157: chown d1/fd 19418 1 2024-09-13T22:08:37.232 INFO:tasks.workunit.client.0.smithi089.stdout:6/97: symlink d0/d4/l19 0 2024-09-13T22:08:37.234 INFO:tasks.workunit.client.0.smithi089.stdout:9/115: creat d6/d18/d1b/f2e x:0 0 0 2024-09-13T22:08:37.234 INFO:tasks.workunit.client.0.smithi089.stdout:9/116: fdatasync d6/f12 0 2024-09-13T22:08:37.234 INFO:tasks.workunit.client.0.smithi089.stdout:2/118: symlink df/l27 0 2024-09-13T22:08:37.238 INFO:tasks.workunit.client.0.smithi089.stdout:7/100: dread d0/f17 [0,4194304] 0 2024-09-13T22:08:37.245 INFO:tasks.workunit.client.0.smithi089.stdout:5/113: symlink d4/d19/d1e/d28/l2c 0 2024-09-13T22:08:37.250 INFO:tasks.workunit.client.0.smithi089.stdout:1/148: creat d7/de/d1b/d2b/d39/f3b x:0 0 0 2024-09-13T22:08:37.254 INFO:tasks.workunit.client.0.smithi089.stdout:0/158: symlink d1/de/d15/d2a/l2d 0 2024-09-13T22:08:37.256 INFO:tasks.workunit.client.0.smithi089.stdout:6/98: rename d0/d4/l19 to d0/d4/d12/d15/l1a 0 2024-09-13T22:08:37.258 INFO:tasks.workunit.client.0.smithi089.stdout:5/114: mknod d4/d19/c2d 0 2024-09-13T22:08:37.260 INFO:tasks.workunit.client.0.smithi089.stdout:1/149: mkdir d7/d1c/d3c 0 2024-09-13T22:08:37.260 INFO:tasks.workunit.client.0.smithi089.stdout:1/150: write d7/fd [3474533,116496] 0 2024-09-13T22:08:37.260 INFO:tasks.workunit.client.0.smithi089.stdout:1/151: fdatasync d7/de/f14 0 2024-09-13T22:08:37.261 INFO:tasks.workunit.client.0.smithi089.stdout:6/99: dread d0/d4/d12/f13 [4194304,4194304] 0 2024-09-13T22:08:37.261 INFO:tasks.workunit.client.0.smithi089.stdout:1/152: write d7/de/f27 [134272,80653] 0 2024-09-13T22:08:37.261 INFO:tasks.workunit.client.0.smithi089.stdout:1/153: chown d7/de 60474995 1 2024-09-13T22:08:37.261 INFO:tasks.workunit.client.0.smithi089.stdout:9/117: dwrite d6/f2b [0,4194304] 0 2024-09-13T22:08:37.262 INFO:tasks.workunit.client.0.smithi089.stdout:0/159: mknod d1/de/d15/d2a/c2e 0 2024-09-13T22:08:37.262 INFO:tasks.workunit.client.0.smithi089.stdout:0/160: read - d1/de/f20 zero size 2024-09-13T22:08:37.262 INFO:tasks.workunit.client.0.smithi089.stdout:9/118: write d6/ff [1193682,78778] 0 2024-09-13T22:08:37.262 INFO:tasks.workunit.client.0.smithi089.stdout:9/119: stat d6/d18/f2a 0 2024-09-13T22:08:37.263 INFO:tasks.workunit.client.0.smithi089.stdout:2/119: rename l8 to df/d1a/l28 0 2024-09-13T22:08:37.264 INFO:tasks.workunit.client.0.smithi089.stdout:5/115: mknod d4/c2e 0 2024-09-13T22:08:37.271 INFO:tasks.workunit.client.0.smithi089.stdout:1/154: mkdir d7/de/d3a/d3d 0 2024-09-13T22:08:37.274 INFO:tasks.workunit.client.0.smithi089.stdout:9/120: mknod d6/d18/c2f 0 2024-09-13T22:08:37.276 INFO:tasks.workunit.client.0.smithi089.stdout:7/101: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T22:08:37.276 INFO:tasks.workunit.client.0.smithi089.stdout:0/161: dread d1/f7 [0,4194304] 0 2024-09-13T22:08:37.277 INFO:tasks.workunit.client.0.smithi089.stdout:5/116: rename d4/c7 to d4/d19/d1e/c2f 0 2024-09-13T22:08:37.284 INFO:tasks.workunit.client.0.smithi089.stdout:5/117: dread d4/d19/f24 [0,4194304] 0 2024-09-13T22:08:37.286 INFO:tasks.workunit.client.0.smithi089.stdout:3/137: sync 2024-09-13T22:08:37.287 INFO:tasks.workunit.client.0.smithi089.stdout:6/100: dwrite d0/f11 [0,4194304] 0 2024-09-13T22:08:37.287 INFO:tasks.workunit.client.0.smithi089.stdout:6/101: readlink d0/d4/d12/d15/l16 0 2024-09-13T22:08:37.291 INFO:tasks.workunit.client.0.smithi089.stdout:7/102: mkdir d0/d19/d1b 0 2024-09-13T22:08:37.291 INFO:tasks.workunit.client.0.smithi089.stdout:7/103: readlink d0/le 0 2024-09-13T22:08:37.293 INFO:tasks.workunit.client.0.smithi089.stdout:0/162: creat d1/de/d1f/f2f x:0 0 0 2024-09-13T22:08:37.293 INFO:tasks.workunit.client.0.smithi089.stdout:0/163: write d1/de/d10/f1d [902200,52521] 0 2024-09-13T22:08:37.293 INFO:tasks.workunit.client.0.smithi089.stdout:0/164: fdatasync d1/de/f20 0 2024-09-13T22:08:37.294 INFO:tasks.workunit.client.0.smithi089.stdout:0/165: dread - d1/de/f17 zero size 2024-09-13T22:08:37.295 INFO:tasks.workunit.client.0.smithi089.stdout:5/118: rename d4/cd to d4/d19/c30 0 2024-09-13T22:08:37.296 INFO:tasks.workunit.client.0.smithi089.stdout:9/121: dread d6/f15 [0,4194304] 0 2024-09-13T22:08:37.298 INFO:tasks.workunit.client.0.smithi089.stdout:3/138: dread d1/d2/d4/f1a [0,4194304] 0 2024-09-13T22:08:37.299 INFO:tasks.workunit.client.0.smithi089.stdout:2/120: dwrite df/f10 [0,4194304] 0 2024-09-13T22:08:37.300 INFO:tasks.workunit.client.0.smithi089.stdout:1/155: dwrite d7/de/d1b/d2b/f2c [4194304,4194304] 0 2024-09-13T22:08:37.300 INFO:tasks.workunit.client.0.smithi089.stdout:7/104: creat d0/d19/d1b/f1c x:0 0 0 2024-09-13T22:08:37.301 INFO:tasks.workunit.client.0.smithi089.stdout:6/102: write d0/d5/f7 [2171837,96281] 0 2024-09-13T22:08:37.303 INFO:tasks.workunit.client.0.smithi089.stdout:0/166: link d1/de/f14 d1/de/f30 0 2024-09-13T22:08:37.305 INFO:tasks.workunit.client.0.smithi089.stdout:3/139: symlink d1/d2/d23/l36 0 2024-09-13T22:08:37.311 INFO:tasks.workunit.client.0.smithi089.stdout:2/121: rmdir df/d1a 39 2024-09-13T22:08:37.311 INFO:tasks.workunit.client.0.smithi089.stdout:2/122: fsync df/d14/f24 0 2024-09-13T22:08:37.312 INFO:tasks.workunit.client.0.smithi089.stdout:1/156: link d7/d34/c2f d7/de/d1b/d2b/d39/c3e 0 2024-09-13T22:08:37.314 INFO:tasks.workunit.client.0.smithi089.stdout:7/105: mkdir d0/d19/d1b/d1d 0 2024-09-13T22:08:37.315 INFO:tasks.workunit.client.0.smithi089.stdout:7/106: creat d0/f1e x:0 0 0 2024-09-13T22:08:37.316 INFO:tasks.workunit.client.0.smithi089.stdout:1/157: dread d7/f19 [0,4194304] 0 2024-09-13T22:08:37.319 INFO:tasks.workunit.client.0.smithi089.stdout:9/122: dwrite d6/d18/d1b/f26 [0,4194304] 0 2024-09-13T22:08:37.322 INFO:tasks.workunit.client.0.smithi089.stdout:0/167: creat d1/de/d15/d2a/f31 x:0 0 0 2024-09-13T22:08:37.322 INFO:tasks.workunit.client.0.smithi089.stdout:0/168: creat d1/f32 x:0 0 0 2024-09-13T22:08:37.324 INFO:tasks.workunit.client.0.smithi089.stdout:3/140: symlink d1/d2/l37 0 2024-09-13T22:08:37.327 INFO:tasks.workunit.client.0.smithi089.stdout:2/123: link df/c20 df/d1a/c29 0 2024-09-13T22:08:37.329 INFO:tasks.workunit.client.0.smithi089.stdout:8/129: sync 2024-09-13T22:08:37.329 INFO:tasks.workunit.client.0.smithi089.stdout:4/96: sync 2024-09-13T22:08:37.329 INFO:tasks.workunit.client.0.smithi089.stdout:8/130: fsync d0/dd/d12/d20/f18 0 2024-09-13T22:08:37.329 INFO:tasks.workunit.client.0.smithi089.stdout:8/131: truncate d0/dd/d11/f23 875087 0 2024-09-13T22:08:37.339 INFO:tasks.workunit.client.0.smithi089.stdout:0/169: truncate d1/de/f14 3205540 0 2024-09-13T22:08:37.342 INFO:tasks.workunit.client.0.smithi089.stdout:2/124: unlink df/d1a/f1d 0 2024-09-13T22:08:37.346 INFO:tasks.workunit.client.0.smithi089.stdout:9/123: rmdir d6/d18/d1b 39 2024-09-13T22:08:37.346 INFO:tasks.workunit.client.0.smithi089.stdout:9/124: truncate d6/d18/f2a 4518186 0 2024-09-13T22:08:37.346 INFO:tasks.workunit.client.0.smithi089.stdout:9/125: chown d6/f15 5783230 1 2024-09-13T22:08:37.346 INFO:tasks.workunit.client.0.smithi089.stdout:9/126: write d6/f14 [161697,37491] 0 2024-09-13T22:08:37.347 INFO:tasks.workunit.client.0.smithi089.stdout:0/170: creat d1/d16/f33 x:0 0 0 2024-09-13T22:08:37.349 INFO:tasks.workunit.client.0.smithi089.stdout:2/125: symlink df/d1a/l2a 0 2024-09-13T22:08:37.351 INFO:tasks.workunit.client.0.smithi089.stdout:8/132: getdents d0/dd/d12/d20/d1c 0 2024-09-13T22:08:37.353 INFO:tasks.workunit.client.0.smithi089.stdout:3/141: dwrite d1/d2/d4/f16 [0,4194304] 0 2024-09-13T22:08:37.353 INFO:tasks.workunit.client.0.smithi089.stdout:0/171: mknod d1/de/d15/d2a/c34 0 2024-09-13T22:08:37.354 INFO:tasks.workunit.client.0.smithi089.stdout:1/158: dwrite d7/f18 [0,4194304] 0 2024-09-13T22:08:37.354 INFO:tasks.workunit.client.0.smithi089.stdout:1/159: dread - d7/de/d1b/d2b/f2d zero size 2024-09-13T22:08:37.354 INFO:tasks.workunit.client.0.smithi089.stdout:4/97: dwrite d0/f12 [0,4194304] 0 2024-09-13T22:08:37.355 INFO:tasks.workunit.client.0.smithi089.stdout:6/103: truncate d0/d5/f7 1915863 0 2024-09-13T22:08:37.359 INFO:tasks.workunit.client.0.smithi089.stdout:7/107: truncate d0/f5 8521329 0 2024-09-13T22:08:37.359 INFO:tasks.workunit.client.0.smithi089.stdout:7/108: creat d0/f1f x:0 0 0 2024-09-13T22:08:37.361 INFO:tasks.workunit.client.0.smithi089.stdout:0/172: mknod d1/de/d15/d2a/c35 0 2024-09-13T22:08:37.372 INFO:tasks.workunit.client.0.smithi089.stdout:1/160: dwrite d7/f26 [0,4194304] 0 2024-09-13T22:08:37.372 INFO:tasks.workunit.client.0.smithi089.stdout:3/142: getdents d1/d7 0 2024-09-13T22:08:37.375 INFO:tasks.workunit.client.0.smithi089.stdout:7/109: mknod d0/d19/d1b/c20 0 2024-09-13T22:08:37.375 INFO:tasks.workunit.client.0.smithi089.stdout:7/110: chown d0/l10 189002470 1 2024-09-13T22:08:37.381 INFO:tasks.workunit.client.0.smithi089.stdout:0/173: mkdir d1/de/d10/d36 0 2024-09-13T22:08:37.381 INFO:tasks.workunit.client.0.smithi089.stdout:8/133: rename d0/dd/d1d to d0/dd/d11/d33 0 2024-09-13T22:08:37.381 INFO:tasks.workunit.client.0.smithi089.stdout:8/134: fsync d0/dd/d11/d33/f2a 0 2024-09-13T22:08:37.384 INFO:tasks.workunit.client.0.smithi089.stdout:1/161: creat d7/d1c/d3c/f3f x:0 0 0 2024-09-13T22:08:37.384 INFO:tasks.workunit.client.0.smithi089.stdout:1/162: chown d7/d1c 1 1 2024-09-13T22:08:37.385 INFO:tasks.workunit.client.0.smithi089.stdout:7/111: rename d0/f1f to d0/f21 0 2024-09-13T22:08:37.387 INFO:tasks.workunit.client.0.smithi089.stdout:3/143: dwrite d1/d2/d23/f27 [0,4194304] 0 2024-09-13T22:08:37.388 INFO:tasks.workunit.client.0.smithi089.stdout:0/174: mkdir d1/de/d10/d37 0 2024-09-13T22:08:37.390 INFO:tasks.workunit.client.0.smithi089.stdout:4/98: rename d0/l1b to d0/d15/l1c 0 2024-09-13T22:08:37.392 INFO:tasks.workunit.client.0.smithi089.stdout:8/135: mknod d0/dd/d11/c34 0 2024-09-13T22:08:37.393 INFO:tasks.workunit.client.0.smithi089.stdout:0/175: dread d1/f11 [0,4194304] 0 2024-09-13T22:08:37.395 INFO:tasks.workunit.client.0.smithi089.stdout:7/112: truncate d0/f11 418171 0 2024-09-13T22:08:37.395 INFO:tasks.workunit.client.0.smithi089.stdout:7/113: chown d0/f21 380866989 1 2024-09-13T22:08:37.395 INFO:tasks.workunit.client.0.smithi089.stdout:7/114: chown d0/d19/d1b/d1d 0 1 2024-09-13T22:08:37.395 INFO:tasks.workunit.client.0.smithi089.stdout:7/115: write d0/f1e [946090,95576] 0 2024-09-13T22:08:37.395 INFO:tasks.workunit.client.0.smithi089.stdout:7/116: fdatasync d0/f1a 0 2024-09-13T22:08:37.399 INFO:tasks.workunit.client.0.smithi089.stdout:3/144: mkdir d1/d2/d18/d38 0 2024-09-13T22:08:37.402 INFO:tasks.workunit.client.0.smithi089.stdout:6/104: rename d0/d4/cc to d0/d4/d12/c1b 0 2024-09-13T22:08:37.403 INFO:tasks.workunit.client.0.smithi089.stdout:8/136: fdatasync d0/dd/fb 0 2024-09-13T22:08:37.404 INFO:tasks.workunit.client.0.smithi089.stdout:0/176: mkdir d1/de/d10/d36/d38 0 2024-09-13T22:08:37.404 INFO:tasks.workunit.client.0.smithi089.stdout:0/177: truncate d1/de/d1f/f2f 440614 0 2024-09-13T22:08:37.408 INFO:tasks.workunit.client.0.smithi089.stdout:4/99: dwrite d0/f1a [0,4194304] 0 2024-09-13T22:08:37.408 INFO:tasks.workunit.client.0.smithi089.stdout:3/145: symlink d1/d2/d18/d38/l39 0 2024-09-13T22:08:37.408 INFO:tasks.workunit.client.0.smithi089.stdout:3/146: read d1/d2/f3 [2006963,109449] 0 2024-09-13T22:08:37.408 INFO:tasks.workunit.client.0.smithi089.stdout:3/147: stat d1/d7/le 0 2024-09-13T22:08:37.410 INFO:tasks.workunit.client.0.smithi089.stdout:1/163: rename d7/de/d3a/d3d to d7/d40 0 2024-09-13T22:08:37.410 INFO:tasks.workunit.client.0.smithi089.stdout:1/164: fdatasync d7/d34/f38 0 2024-09-13T22:08:37.410 INFO:tasks.workunit.client.0.smithi089.stdout:1/165: dread - d7/de/d1b/d2b/f2e zero size 2024-09-13T22:08:37.411 INFO:tasks.workunit.client.0.smithi089.stdout:6/105: symlink d0/d9/l1c 0 2024-09-13T22:08:37.413 INFO:tasks.workunit.client.0.smithi089.stdout:0/178: truncate d1/de/d10/f13 167229 0 2024-09-13T22:08:37.414 INFO:tasks.workunit.client.0.smithi089.stdout:5/119: sync 2024-09-13T22:08:37.414 INFO:tasks.workunit.client.0.smithi089.stdout:0/179: read d1/de/d10/f1d [112221,51301] 0 2024-09-13T22:08:37.416 INFO:tasks.workunit.client.0.smithi089.stdout:5/120: write d4/ff [31454,22310] 0 2024-09-13T22:08:37.422 INFO:tasks.workunit.client.0.smithi089.stdout:4/100: symlink d0/d15/l1d 0 2024-09-13T22:08:37.422 INFO:tasks.workunit.client.0.smithi089.stdout:4/101: read d0/f8 [222265,78028] 0 2024-09-13T22:08:37.424 INFO:tasks.workunit.client.0.smithi089.stdout:3/148: rename d1/d7/d34 to d1/d3a 0 2024-09-13T22:08:37.425 INFO:tasks.workunit.client.0.smithi089.stdout:3/149: fdatasync d1/d2/d4/f12 0 2024-09-13T22:08:37.427 INFO:tasks.workunit.client.0.smithi089.stdout:1/166: mknod d7/de/d3a/c41 0 2024-09-13T22:08:37.427 INFO:tasks.workunit.client.0.smithi089.stdout:1/167: fdatasync d7/de/f27 0 2024-09-13T22:08:37.427 INFO:tasks.workunit.client.0.smithi089.stdout:1/168: stat d7/de/f14 0 2024-09-13T22:08:37.427 INFO:tasks.workunit.client.0.smithi089.stdout:6/106: mkdir d0/d5/d1d 0 2024-09-13T22:08:37.429 INFO:tasks.workunit.client.0.smithi089.stdout:0/180: mkdir d1/de/d10/d36/d39 0 2024-09-13T22:08:37.434 INFO:tasks.workunit.client.0.smithi089.stdout:5/121: mkdir d4/d19/d1e/d28/d31 0 2024-09-13T22:08:37.435 INFO:tasks.workunit.client.0.smithi089.stdout:4/102: symlink d0/d15/l1e 0 2024-09-13T22:08:37.437 INFO:tasks.workunit.client.0.smithi089.stdout:1/169: write d7/de/f11 [1180055,38434] 0 2024-09-13T22:08:37.440 INFO:tasks.workunit.client.0.smithi089.stdout:0/181: rename d1/de/d10/d37 to d1/d16/d3a 0 2024-09-13T22:08:37.440 INFO:tasks.workunit.client.0.smithi089.stdout:0/182: write d1/d16/f33 [58060,58091] 0 2024-09-13T22:08:37.440 INFO:tasks.workunit.client.0.smithi089.stdout:0/183: write d1/f11 [4173032,25833] 0 2024-09-13T22:08:37.441 INFO:tasks.workunit.client.0.smithi089.stdout:0/184: write d1/f1e [821998,28428] 0 2024-09-13T22:08:37.441 INFO:tasks.workunit.client.0.smithi089.stdout:4/103: truncate d0/f12 552649 0 2024-09-13T22:08:37.444 INFO:tasks.workunit.client.0.smithi089.stdout:2/126: sync 2024-09-13T22:08:37.444 INFO:tasks.workunit.client.0.smithi089.stdout:9/127: sync 2024-09-13T22:08:37.446 INFO:tasks.workunit.client.0.smithi089.stdout:0/185: mknod d1/de/d10/d36/d38/c3b 0 2024-09-13T22:08:37.446 INFO:tasks.workunit.client.0.smithi089.stdout:0/186: write d1/de/d1f/f2f [109926,22185] 0 2024-09-13T22:08:37.446 INFO:tasks.workunit.client.0.smithi089.stdout:3/150: dwrite d1/f6 [0,4194304] 0 2024-09-13T22:08:37.446 INFO:tasks.workunit.client.0.smithi089.stdout:3/151: chown d1/c30 639221 1 2024-09-13T22:08:37.447 INFO:tasks.workunit.client.0.smithi089.stdout:4/104: mkdir d0/d15/d1f 0 2024-09-13T22:08:37.448 INFO:tasks.workunit.client.0.smithi089.stdout:2/127: mkdir df/d14/d2b 0 2024-09-13T22:08:37.448 INFO:tasks.workunit.client.0.smithi089.stdout:2/128: fdatasync df/f22 0 2024-09-13T22:08:37.450 INFO:tasks.workunit.client.0.smithi089.stdout:9/128: symlink d6/d18/d21/l30 0 2024-09-13T22:08:37.453 INFO:tasks.workunit.client.0.smithi089.stdout:3/152: creat d1/d2/d24/f3b x:0 0 0 2024-09-13T22:08:37.456 INFO:tasks.workunit.client.0.smithi089.stdout:2/129: rename df/c17 to df/d14/d2b/c2c 0 2024-09-13T22:08:37.457 INFO:tasks.workunit.client.0.smithi089.stdout:9/129: mkdir d6/d31 0 2024-09-13T22:08:37.458 INFO:tasks.workunit.client.0.smithi089.stdout:4/105: getdents d0 0 2024-09-13T22:08:37.465 INFO:tasks.workunit.client.0.smithi089.stdout:3/153: dread d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:37.465 INFO:tasks.workunit.client.0.smithi089.stdout:3/154: readlink d1/d2/l37 0 2024-09-13T22:08:37.466 INFO:tasks.workunit.client.0.smithi089.stdout:3/155: mkdir d1/d2/d24/d3c 0 2024-09-13T22:08:37.468 INFO:tasks.workunit.client.0.smithi089.stdout:3/156: unlink d1/d2/d31/c25 0 2024-09-13T22:08:37.469 INFO:tasks.workunit.client.0.smithi089.stdout:3/157: mkdir d1/d2/d23/d3d 0 2024-09-13T22:08:37.471 INFO:tasks.workunit.client.0.smithi089.stdout:3/158: mknod d1/d2/d24/c3e 0 2024-09-13T22:08:37.471 INFO:tasks.workunit.client.0.smithi089.stdout:3/159: fsync d1/d2/f29 0 2024-09-13T22:08:37.472 INFO:tasks.workunit.client.0.smithi089.stdout:9/130: write f0 [3839210,18223] 0 2024-09-13T22:08:37.472 INFO:tasks.workunit.client.0.smithi089.stdout:6/107: dwrite d0/f11 [4194304,4194304] 0 2024-09-13T22:08:37.473 INFO:tasks.workunit.client.0.smithi089.stdout:6/108: readlink d0/d4/d12/d15/l16 0 2024-09-13T22:08:37.473 INFO:tasks.workunit.client.0.smithi089.stdout:6/109: write d0/d4/d12/f13 [6390003,126714] 0 2024-09-13T22:08:37.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/160: creat d1/d2/d31/f3f x:0 0 0 2024-09-13T22:08:37.474 INFO:tasks.workunit.client.0.smithi089.stdout:6/110: truncate d0/d5/f7 809413 0 2024-09-13T22:08:37.477 INFO:tasks.workunit.client.0.smithi089.stdout:3/161: mkdir d1/d2/d18/d40 0 2024-09-13T22:08:37.477 INFO:tasks.workunit.client.0.smithi089.stdout:6/111: rmdir d0/d4/d12/d15 39 2024-09-13T22:08:37.477 INFO:tasks.workunit.client.0.smithi089.stdout:9/131: dread d6/f15 [0,4194304] 0 2024-09-13T22:08:37.477 INFO:tasks.workunit.client.0.smithi089.stdout:9/132: write d6/fa [636025,17216] 0 2024-09-13T22:08:37.478 INFO:tasks.workunit.client.0.smithi089.stdout:3/162: symlink d1/d2/d23/l41 0 2024-09-13T22:08:37.479 INFO:tasks.workunit.client.0.smithi089.stdout:5/122: dwrite d4/d19/f24 [0,4194304] 0 2024-09-13T22:08:37.480 INFO:tasks.workunit.client.0.smithi089.stdout:3/163: symlink d1/d2/d23/d3d/l42 0 2024-09-13T22:08:37.481 INFO:tasks.workunit.client.0.smithi089.stdout:2/130: dwrite fb [4194304,4194304] 0 2024-09-13T22:08:37.481 INFO:tasks.workunit.client.0.smithi089.stdout:3/164: dread d1/d2/d4/f9 [0,4194304] 0 2024-09-13T22:08:37.483 INFO:tasks.workunit.client.0.smithi089.stdout:5/123: mknod d4/d19/d1e/c32 0 2024-09-13T22:08:37.489 INFO:tasks.workunit.client.0.smithi089.stdout:3/165: getdents d1/d2/d18/d38 0 2024-09-13T22:08:37.489 INFO:tasks.workunit.client.0.smithi089.stdout:3/166: write d1/d2/d4/f12 [6479,83565] 0 2024-09-13T22:08:37.491 INFO:tasks.workunit.client.0.smithi089.stdout:5/124: creat d4/d19/d1e/d28/d31/f33 x:0 0 0 2024-09-13T22:08:37.493 INFO:tasks.workunit.client.0.smithi089.stdout:5/125: truncate d4/f5 571191 0 2024-09-13T22:08:37.494 INFO:tasks.workunit.client.0.smithi089.stdout:4/106: truncate d0/f12 1587840 0 2024-09-13T22:08:37.499 INFO:tasks.workunit.client.0.smithi089.stdout:9/133: dwrite d6/f10 [0,4194304] 0 2024-09-13T22:08:37.499 INFO:tasks.workunit.client.0.smithi089.stdout:9/134: write d6/fc [1311918,38557] 0 2024-09-13T22:08:37.500 INFO:tasks.workunit.client.0.smithi089.stdout:9/135: write d6/ff [2244829,87504] 0 2024-09-13T22:08:37.500 INFO:tasks.workunit.client.0.smithi089.stdout:9/136: chown d6/d18/d21/f27 261 1 2024-09-13T22:08:37.510 INFO:tasks.workunit.client.0.smithi089.stdout:4/107: dread d0/f1a [0,4194304] 0 2024-09-13T22:08:37.510 INFO:tasks.workunit.client.0.smithi089.stdout:4/108: read - d0/d11/f18 zero size 2024-09-13T22:08:37.510 INFO:tasks.workunit.client.0.smithi089.stdout:4/109: getdents d0/d11 0 2024-09-13T22:08:37.512 INFO:tasks.workunit.client.0.smithi089.stdout:2/131: getdents df 0 2024-09-13T22:08:37.514 INFO:tasks.workunit.client.0.smithi089.stdout:4/110: symlink d0/d11/d16/l20 0 2024-09-13T22:08:37.515 INFO:tasks.workunit.client.0.smithi089.stdout:2/132: mkdir df/d14/d2b/d2d 0 2024-09-13T22:08:37.515 INFO:tasks.workunit.client.0.smithi089.stdout:2/133: read - df/f26 zero size 2024-09-13T22:08:37.516 INFO:tasks.workunit.client.0.smithi089.stdout:2/134: mkdir df/d14/d2b/d2d/d2e 0 2024-09-13T22:08:37.518 INFO:tasks.workunit.client.0.smithi089.stdout:2/135: creat df/d14/d2b/d2d/d2e/f2f x:0 0 0 2024-09-13T22:08:37.526 INFO:tasks.workunit.client.0.smithi089.stdout:3/167: dwrite d1/d2/d4/f12 [0,4194304] 0 2024-09-13T22:08:37.526 INFO:tasks.workunit.client.0.smithi089.stdout:3/168: read - d1/d2/d24/f3b zero size 2024-09-13T22:08:37.530 INFO:tasks.workunit.client.0.smithi089.stdout:3/169: mkdir d1/d2/d43 0 2024-09-13T22:08:37.532 INFO:tasks.workunit.client.0.smithi089.stdout:3/170: mkdir d1/d7/d44 0 2024-09-13T22:08:37.536 INFO:tasks.workunit.client.0.smithi089.stdout:2/136: dwrite df/d14/f25 [0,4194304] 0 2024-09-13T22:08:37.540 INFO:tasks.workunit.client.0.smithi089.stdout:6/112: truncate d0/f11 2984740 0 2024-09-13T22:08:37.551 INFO:tasks.workunit.client.0.smithi089.stdout:2/137: dwrite df/f11 [0,4194304] 0 2024-09-13T22:08:37.551 INFO:tasks.workunit.client.0.smithi089.stdout:2/138: dread - df/d14/f21 zero size 2024-09-13T22:08:37.553 INFO:tasks.workunit.client.0.smithi089.stdout:2/139: mknod df/c30 0 2024-09-13T22:08:37.555 INFO:tasks.workunit.client.0.smithi089.stdout:2/140: link df/d1a/c29 df/d14/c31 0 2024-09-13T22:08:37.555 INFO:tasks.workunit.client.0.smithi089.stdout:2/141: readlink df/d1a/l28 0 2024-09-13T22:08:37.557 INFO:tasks.workunit.client.0.smithi089.stdout:2/142: symlink df/d14/d2b/l32 0 2024-09-13T22:08:37.559 INFO:tasks.workunit.client.0.smithi089.stdout:2/143: stat df/d14/c1e 0 2024-09-13T22:08:37.563 INFO:tasks.workunit.client.0.smithi089.stdout:2/144: creat df/d14/d2b/f33 x:0 0 0 2024-09-13T22:08:37.563 INFO:tasks.workunit.client.0.smithi089.stdout:2/145: fdatasync df/f11 0 2024-09-13T22:08:37.578 INFO:tasks.workunit.client.0.smithi089.stdout:2/146: dwrite df/d14/f21 [0,4194304] 0 2024-09-13T22:08:37.578 INFO:tasks.workunit.client.0.smithi089.stdout:2/147: write df/f12 [246764,39807] 0 2024-09-13T22:08:37.586 INFO:tasks.workunit.client.0.smithi089.stdout:2/148: read df/f10 [1612198,77645] 0 2024-09-13T22:08:37.588 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:37 smithi159 ceph-mon[35348]: pgmap v250: 65 pgs: 65 active+clean; 224 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.2 MiB/s wr, 399 op/s 2024-09-13T22:08:37.589 INFO:tasks.workunit.client.0.smithi089.stdout:2/149: symlink df/d1a/l34 0 2024-09-13T22:08:37.590 INFO:tasks.workunit.client.0.smithi089.stdout:2/150: symlink df/d14/d2b/l35 0 2024-09-13T22:08:37.603 INFO:tasks.workunit.client.0.smithi089.stdout:6/113: rmdir d0 39 2024-09-13T22:08:37.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/114: dwrite d0/d4/d12/f13 [4194304,4194304] 0 2024-09-13T22:08:37.621 INFO:tasks.workunit.client.0.smithi089.stdout:6/115: mkdir d0/d4/d1e 0 2024-09-13T22:08:37.621 INFO:tasks.workunit.client.0.smithi089.stdout:6/116: readlink d0/d4/d12/d15/l16 0 2024-09-13T22:08:37.622 INFO:tasks.workunit.client.0.smithi089.stdout:6/117: write d0/d5/f7 [119360,45281] 0 2024-09-13T22:08:37.625 INFO:tasks.workunit.client.0.smithi089.stdout:6/118: mknod d0/c1f 0 2024-09-13T22:08:37.629 INFO:tasks.workunit.client.0.smithi089.stdout:7/117: read d0/f11 [310478,73150] 0 2024-09-13T22:08:37.629 INFO:tasks.workunit.client.0.smithi089.stdout:6/119: creat d0/d4/d12/f20 x:0 0 0 2024-09-13T22:08:37.629 INFO:tasks.workunit.client.0.smithi089.stdout:6/120: write d0/d5/f14 [1782485,91396] 0 2024-09-13T22:08:37.629 INFO:tasks.workunit.client.0.smithi089.stdout:6/121: dread - d0/d4/d12/f20 zero size 2024-09-13T22:08:37.630 INFO:tasks.workunit.client.0.smithi089.stdout:7/118: dread d0/ff [0,4194304] 0 2024-09-13T22:08:37.634 INFO:tasks.workunit.client.0.smithi089.stdout:8/137: dwrite d0/f2b [0,4194304] 0 2024-09-13T22:08:37.636 INFO:tasks.workunit.client.0.smithi089.stdout:6/122: stat d0/d4/d12/d15/l1a 0 2024-09-13T22:08:37.646 INFO:tasks.workunit.client.0.smithi089.stdout:8/138: write d0/dd/d12/d20/f18 [653910,36015] 0 2024-09-13T22:08:37.650 INFO:tasks.workunit.client.0.smithi089.stdout:8/139: creat d0/dd/f35 x:0 0 0 2024-09-13T22:08:37.652 INFO:tasks.workunit.client.0.smithi089.stdout:8/140: fsync d0/dd/ff 0 2024-09-13T22:08:37.655 INFO:tasks.workunit.client.0.smithi089.stdout:8/141: rename d0/dd/d11/d33 to d0/dd/d12/d20/d36 0 2024-09-13T22:08:37.670 INFO:tasks.workunit.client.0.smithi089.stdout:1/170: dwrite d7/de/d1b/d2b/f2e [0,4194304] 0 2024-09-13T22:08:37.675 INFO:tasks.workunit.client.0.smithi089.stdout:8/142: write d0/dd/d12/f1a [3425850,40526] 0 2024-09-13T22:08:37.675 INFO:tasks.workunit.client.0.smithi089.stdout:5/126: dwrite d4/f29 [0,4194304] 0 2024-09-13T22:08:37.676 INFO:tasks.workunit.client.0.smithi089.stdout:1/171: mknod d7/d1c/d3c/c42 0 2024-09-13T22:08:37.676 INFO:tasks.workunit.client.0.smithi089.stdout:1/172: write d7/f9 [1772101,26565] 0 2024-09-13T22:08:37.676 INFO:tasks.workunit.client.0.smithi089.stdout:0/187: dwrite d1/f32 [0,4194304] 0 2024-09-13T22:08:37.676 INFO:tasks.workunit.client.0.smithi089.stdout:7/119: dwrite d0/f7 [0,4194304] 0 2024-09-13T22:08:37.676 INFO:tasks.workunit.client.0.smithi089.stdout:3/171: dwrite d1/d2/d31/f3f [0,4194304] 0 2024-09-13T22:08:37.677 INFO:tasks.workunit.client.0.smithi089.stdout:8/143: dread d0/dd/d11/f23 [0,4194304] 0 2024-09-13T22:08:37.683 INFO:tasks.workunit.client.0.smithi089.stdout:0/188: write d1/f7 [2681178,87230] 0 2024-09-13T22:08:37.683 INFO:tasks.workunit.client.0.smithi089.stdout:5/127: rename d4/lb to d4/d19/d1e/d28/l34 0 2024-09-13T22:08:37.686 INFO:tasks.workunit.client.0.smithi089.stdout:0/189: read d1/fd [836715,82913] 0 2024-09-13T22:08:37.691 INFO:tasks.workunit.client.0.smithi089.stdout:3/172: dwrite d1/d2/f29 [0,4194304] 0 2024-09-13T22:08:37.692 INFO:tasks.workunit.client.0.smithi089.stdout:3/173: chown d1/d2/d4/d1c/f2a 4907 1 2024-09-13T22:08:37.693 INFO:tasks.workunit.client.0.smithi089.stdout:7/120: unlink d0/f17 0 2024-09-13T22:08:37.693 INFO:tasks.workunit.client.0.smithi089.stdout:7/121: creat d0/f22 x:0 0 0 2024-09-13T22:08:37.707 INFO:tasks.workunit.client.0.smithi089.stdout:8/144: rename d0/dd/d31 to d0/dd/d12/d20/d36/d37 0 2024-09-13T22:08:37.709 INFO:tasks.workunit.client.0.smithi089.stdout:5/128: mkdir d4/d19/d1e/d28/d31/d35 0 2024-09-13T22:08:37.709 INFO:tasks.workunit.client.0.smithi089.stdout:5/129: write d4/f27 [5415787,125867] 0 2024-09-13T22:08:37.711 INFO:tasks.workunit.client.0.smithi089.stdout:0/190: creat d1/d16/d3a/f3c x:0 0 0 2024-09-13T22:08:37.715 INFO:tasks.workunit.client.0.smithi089.stdout:7/122: mkdir d0/d19/d1b/d1d/d23 0 2024-09-13T22:08:37.716 INFO:tasks.workunit.client.0.smithi089.stdout:7/123: dread - d0/d19/d1b/f1c zero size 2024-09-13T22:08:37.718 INFO:tasks.workunit.client.0.smithi089.stdout:3/174: rename d1/d2/d23/d3d/l42 to d1/d2/d24/l45 0 2024-09-13T22:08:37.720 INFO:tasks.workunit.client.0.smithi089.stdout:8/145: link d0/dd/d12/d20/d36/l28 d0/dd/d12/d20/d36/l38 0 2024-09-13T22:08:37.721 INFO:tasks.workunit.client.0.smithi089.stdout:8/146: fdatasync d0/f5 0 2024-09-13T22:08:37.725 INFO:tasks.workunit.client.0.smithi089.stdout:7/124: mkdir d0/d19/d1b/d1d/d23/d24 0 2024-09-13T22:08:37.727 INFO:tasks.workunit.client.0.smithi089.stdout:8/147: dread d0/dd/d12/d20/f18 [0,4194304] 0 2024-09-13T22:08:37.727 INFO:tasks.workunit.client.0.smithi089.stdout:8/148: creat d0/d16/f39 x:0 0 0 2024-09-13T22:08:37.727 INFO:tasks.workunit.client.0.smithi089.stdout:8/149: write d0/dd/fb [1062648,56486] 0 2024-09-13T22:08:37.728 INFO:tasks.workunit.client.0.smithi089.stdout:0/191: dwrite d1/de/d10/f13 [0,4194304] 0 2024-09-13T22:08:37.733 INFO:tasks.workunit.client.0.smithi089.stdout:3/175: write d1/d2/d23/f27 [3015919,124348] 0 2024-09-13T22:08:37.733 INFO:tasks.workunit.client.0.smithi089.stdout:3/176: readlink d1/d2/d23/l41 0 2024-09-13T22:08:37.733 INFO:tasks.workunit.client.0.smithi089.stdout:0/192: mkdir d1/de/d10/d36/d3d 0 2024-09-13T22:08:37.734 INFO:tasks.workunit.client.0.smithi089.stdout:8/150: getdents d0 0 2024-09-13T22:08:37.736 INFO:tasks.workunit.client.0.smithi089.stdout:3/177: rmdir d1/d7/d44 0 2024-09-13T22:08:37.736 INFO:tasks.workunit.client.0.smithi089.stdout:3/178: write d1/d2/f3 [5039117,82510] 0 2024-09-13T22:08:37.738 INFO:tasks.workunit.client.0.smithi089.stdout:0/193: link d1/f4 d1/de/f3e 0 2024-09-13T22:08:37.739 INFO:tasks.workunit.client.0.smithi089.stdout:3/179: getdents d1/d2/d18 0 2024-09-13T22:08:37.740 INFO:tasks.workunit.client.0.smithi089.stdout:0/194: mkdir d1/de/d15/d2a/d3f 0 2024-09-13T22:08:37.743 INFO:tasks.workunit.client.0.smithi089.stdout:3/180: getdents d1/d7/d1b/d28 0 2024-09-13T22:08:37.743 INFO:tasks.workunit.client.0.smithi089.stdout:3/181: fsync d1/f13 0 2024-09-13T22:08:37.746 INFO:tasks.workunit.client.0.smithi089.stdout:8/151: read d0/dd/d12/d20/f17 [3684106,91847] 0 2024-09-13T22:08:37.746 INFO:tasks.workunit.client.0.smithi089.stdout:3/182: unlink d1/d2/d23/l36 0 2024-09-13T22:08:37.746 INFO:tasks.workunit.client.0.smithi089.stdout:3/183: write d1/d2/d23/f27 [2211978,40032] 0 2024-09-13T22:08:37.746 INFO:tasks.workunit.client.0.smithi089.stdout:3/184: dread - d1/d2/d23/f35 zero size 2024-09-13T22:08:37.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:37 smithi089 ceph-mon[27921]: pgmap v250: 65 pgs: 65 active+clean; 224 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.2 MiB/s wr, 399 op/s 2024-09-13T22:08:37.748 INFO:tasks.workunit.client.0.smithi089.stdout:8/152: mkdir d0/dd/d12/d3a 0 2024-09-13T22:08:37.748 INFO:tasks.workunit.client.0.smithi089.stdout:8/153: write d0/dd/d12/d20/d1c/f2f [114281,64007] 0 2024-09-13T22:08:37.750 INFO:tasks.workunit.client.0.smithi089.stdout:3/185: mkdir d1/d2/d23/d3d/d46 0 2024-09-13T22:08:37.750 INFO:tasks.workunit.client.0.smithi089.stdout:3/186: write d1/d2/d4/f16 [7958647,5687] 0 2024-09-13T22:08:37.750 INFO:tasks.workunit.client.0.smithi089.stdout:0/195: write d1/de/f3e [903197,53298] 0 2024-09-13T22:08:37.750 INFO:tasks.workunit.client.0.smithi089.stdout:7/125: dwrite d0/fd [0,4194304] 0 2024-09-13T22:08:37.750 INFO:tasks.workunit.client.0.smithi089.stdout:7/126: write d0/f21 [721921,111616] 0 2024-09-13T22:08:37.752 INFO:tasks.workunit.client.0.smithi089.stdout:3/187: mknod d1/d2/d23/c47 0 2024-09-13T22:08:37.768 INFO:tasks.workunit.client.0.smithi089.stdout:8/154: rename d0/dd/d12/d20/d36/d37 to d0/dd/d12/d20/d32/d3b 0 2024-09-13T22:08:37.769 INFO:tasks.workunit.client.0.smithi089.stdout:3/188: dwrite d1/d2/d4/f9 [0,4194304] 0 2024-09-13T22:08:37.769 INFO:tasks.workunit.client.0.smithi089.stdout:3/189: chown d1/d2/d31/c1e 4073134 1 2024-09-13T22:08:37.769 INFO:tasks.workunit.client.0.smithi089.stdout:3/190: chown d1/d2/d4/cd 2014967 1 2024-09-13T22:08:37.769 INFO:tasks.workunit.client.0.smithi089.stdout:3/191: chown d1/f6 826 1 2024-09-13T22:08:37.769 INFO:tasks.workunit.client.0.smithi089.stdout:3/192: fdatasync d1/d2/d23/f35 0 2024-09-13T22:08:37.771 INFO:tasks.workunit.client.0.smithi089.stdout:0/196: rename d1/de/d1f/f2f to d1/de/d15/f40 0 2024-09-13T22:08:37.776 INFO:tasks.workunit.client.0.smithi089.stdout:3/193: write d1/d2/f29 [3793871,54740] 0 2024-09-13T22:08:37.776 INFO:tasks.workunit.client.0.smithi089.stdout:3/194: write f0 [2929235,10882] 0 2024-09-13T22:08:37.779 INFO:tasks.workunit.client.0.smithi089.stdout:7/127: rename d0/f21 to d0/d19/d1b/d1d/d23/f25 0 2024-09-13T22:08:37.782 INFO:tasks.workunit.client.0.smithi089.stdout:0/197: stat d1/lc 0 2024-09-13T22:08:37.784 INFO:tasks.workunit.client.0.smithi089.stdout:8/155: symlink d0/dd/l3c 0 2024-09-13T22:08:37.784 INFO:tasks.workunit.client.0.smithi089.stdout:9/137: sync 2024-09-13T22:08:37.793 INFO:tasks.workunit.client.0.smithi089.stdout:0/198: mkdir d1/de/d15/d41 0 2024-09-13T22:08:37.793 INFO:tasks.workunit.client.0.smithi089.stdout:0/199: chown d1/de/f17 312 1 2024-09-13T22:08:37.793 INFO:tasks.workunit.client.0.smithi089.stdout:0/200: fdatasync d1/f1e 0 2024-09-13T22:08:37.793 INFO:tasks.workunit.client.0.smithi089.stdout:7/128: write d0/f5 [2148770,64300] 0 2024-09-13T22:08:37.793 INFO:tasks.workunit.client.0.smithi089.stdout:9/138: creat d6/d18/f32 x:0 0 0 2024-09-13T22:08:37.793 INFO:tasks.workunit.client.0.smithi089.stdout:0/201: dread d1/fd [0,4194304] 0 2024-09-13T22:08:37.794 INFO:tasks.workunit.client.0.smithi089.stdout:8/156: truncate d0/dd/f19 1836919 0 2024-09-13T22:08:37.795 INFO:tasks.workunit.client.0.smithi089.stdout:8/157: truncate d0/dd/d11/f2d 1040246 0 2024-09-13T22:08:37.795 INFO:tasks.workunit.client.0.smithi089.stdout:8/158: write d0/dd/d12/d20/d36/f26 [677899,89021] 0 2024-09-13T22:08:37.795 INFO:tasks.workunit.client.0.smithi089.stdout:8/159: dread d0/dd/d11/f2d [0,4194304] 0 2024-09-13T22:08:37.795 INFO:tasks.workunit.client.0.smithi089.stdout:8/160: write d0/dd/d12/d20/f17 [2137025,11928] 0 2024-09-13T22:08:37.797 INFO:tasks.workunit.client.0.smithi089.stdout:9/139: unlink d6/d18/f2a 0 2024-09-13T22:08:37.799 INFO:tasks.workunit.client.0.smithi089.stdout:0/202: mknod d1/de/d1f/c42 0 2024-09-13T22:08:37.799 INFO:tasks.workunit.client.0.smithi089.stdout:7/129: dread d0/f5 [0,4194304] 0 2024-09-13T22:08:37.801 INFO:tasks.workunit.client.0.smithi089.stdout:8/161: mknod d0/dd/d12/c3d 0 2024-09-13T22:08:37.802 INFO:tasks.workunit.client.0.smithi089.stdout:9/140: mkdir d6/d18/d33 0 2024-09-13T22:08:37.802 INFO:tasks.workunit.client.0.smithi089.stdout:9/141: dread - d6/d18/d1b/f2e zero size 2024-09-13T22:08:37.804 INFO:tasks.workunit.client.0.smithi089.stdout:0/203: creat d1/de/d10/d36/d3d/f43 x:0 0 0 2024-09-13T22:08:37.805 INFO:tasks.workunit.client.0.smithi089.stdout:7/130: mknod d0/d19/c26 0 2024-09-13T22:08:37.807 INFO:tasks.workunit.client.0.smithi089.stdout:9/142: creat d6/d18/d21/f34 x:0 0 0 2024-09-13T22:08:37.809 INFO:tasks.workunit.client.0.smithi089.stdout:0/204: creat d1/de/d10/d36/d38/f44 x:0 0 0 2024-09-13T22:08:37.809 INFO:tasks.workunit.client.0.smithi089.stdout:0/205: dread - d1/de/d15/d2a/f31 zero size 2024-09-13T22:08:37.811 INFO:tasks.workunit.client.0.smithi089.stdout:9/143: symlink d6/d18/d21/l35 0 2024-09-13T22:08:37.812 INFO:tasks.workunit.client.0.smithi089.stdout:0/206: creat d1/de/d10/f45 x:0 0 0 2024-09-13T22:08:37.817 INFO:tasks.workunit.client.0.smithi089.stdout:7/131: write d0/f5 [6143453,106098] 0 2024-09-13T22:08:37.818 INFO:tasks.workunit.client.0.smithi089.stdout:8/162: dwrite d0/dd/d11/f29 [0,4194304] 0 2024-09-13T22:08:37.819 INFO:tasks.workunit.client.0.smithi089.stdout:7/132: truncate d0/f7 3307133 0 2024-09-13T22:08:37.823 INFO:tasks.workunit.client.0.smithi089.stdout:8/163: symlink d0/dd/d11/l3e 0 2024-09-13T22:08:37.824 INFO:tasks.workunit.client.0.smithi089.stdout:8/164: symlink d0/d16/l3f 0 2024-09-13T22:08:37.827 INFO:tasks.workunit.client.0.smithi089.stdout:4/111: sync 2024-09-13T22:08:37.827 INFO:tasks.workunit.client.0.smithi089.stdout:1/173: sync 2024-09-13T22:08:37.827 INFO:tasks.workunit.client.0.smithi089.stdout:2/151: sync 2024-09-13T22:08:37.827 INFO:tasks.workunit.client.0.smithi089.stdout:6/123: sync 2024-09-13T22:08:37.828 INFO:tasks.workunit.client.0.smithi089.stdout:8/165: mkdir d0/dd/d12/d20/d40 0 2024-09-13T22:08:37.830 INFO:tasks.workunit.client.0.smithi089.stdout:6/124: creat d0/d5/f21 x:0 0 0 2024-09-13T22:08:37.833 INFO:tasks.workunit.client.0.smithi089.stdout:0/207: rename d1/de/d15/f40 to d1/de/f46 0 2024-09-13T22:08:37.833 INFO:tasks.workunit.client.0.smithi089.stdout:4/112: dread d0/f8 [0,4194304] 0 2024-09-13T22:08:37.833 INFO:tasks.workunit.client.0.smithi089.stdout:4/113: readlink d0/d11/d16/l20 0 2024-09-13T22:08:37.836 INFO:tasks.workunit.client.0.smithi089.stdout:5/130: sync 2024-09-13T22:08:37.837 INFO:tasks.workunit.client.0.smithi089.stdout:1/174: dread d7/de/d1b/d2b/f2c [4194304,4194304] 0 2024-09-13T22:08:37.837 INFO:tasks.workunit.client.0.smithi089.stdout:1/175: readlink d7/l1f 0 2024-09-13T22:08:37.837 INFO:tasks.workunit.client.0.smithi089.stdout:1/176: creat d7/f43 x:0 0 0 2024-09-13T22:08:37.837 INFO:tasks.workunit.client.0.smithi089.stdout:7/133: dwrite d0/fd [0,4194304] 0 2024-09-13T22:08:37.839 INFO:tasks.workunit.client.0.smithi089.stdout:5/131: creat d4/d19/d1e/d28/d31/d35/f36 x:0 0 0 2024-09-13T22:08:37.842 INFO:tasks.workunit.client.0.smithi089.stdout:8/166: dread d0/dd/d12/d20/d36/f26 [0,4194304] 0 2024-09-13T22:08:37.846 INFO:tasks.workunit.client.0.smithi089.stdout:5/132: getdents d4/d19/d1e 0 2024-09-13T22:08:37.846 INFO:tasks.workunit.client.0.smithi089.stdout:5/133: creat d4/d19/d1e/d28/d31/f37 x:0 0 0 2024-09-13T22:08:37.848 INFO:tasks.workunit.client.0.smithi089.stdout:7/134: write d0/fd [393033,4725] 0 2024-09-13T22:08:37.850 INFO:tasks.workunit.client.0.smithi089.stdout:8/167: link d0/dd/d12/d20/d36/f21 d0/dd/d12/d20/d32/f41 0 2024-09-13T22:08:37.851 INFO:tasks.workunit.client.0.smithi089.stdout:1/177: rmdir d7/d34 39 2024-09-13T22:08:37.854 INFO:tasks.workunit.client.0.smithi089.stdout:5/134: rename d4/c18 to d4/d19/c38 0 2024-09-13T22:08:37.862 INFO:tasks.workunit.client.0.smithi089.stdout:2/152: dwrite df/f11 [0,4194304] 0 2024-09-13T22:08:37.864 INFO:tasks.workunit.client.0.smithi089.stdout:9/144: getdents d6/d18/d21 0 2024-09-13T22:08:37.864 INFO:tasks.workunit.client.0.smithi089.stdout:1/178: write d7/de/f14 [2466233,12260] 0 2024-09-13T22:08:37.865 INFO:tasks.workunit.client.0.smithi089.stdout:0/208: dwrite d1/de/d10/f1d [0,4194304] 0 2024-09-13T22:08:37.865 INFO:tasks.workunit.client.0.smithi089.stdout:0/209: chown d1/f5 3989588 1 2024-09-13T22:08:37.865 INFO:tasks.workunit.client.0.smithi089.stdout:0/210: fdatasync d1/de/f3e 0 2024-09-13T22:08:37.866 INFO:tasks.workunit.client.0.smithi089.stdout:9/145: creat d6/d18/f36 x:0 0 0 2024-09-13T22:08:37.869 INFO:tasks.workunit.client.0.smithi089.stdout:1/179: mknod d7/d1c/c44 0 2024-09-13T22:08:37.869 INFO:tasks.workunit.client.0.smithi089.stdout:1/180: truncate d7/d34/f38 563289 0 2024-09-13T22:08:37.874 INFO:tasks.workunit.client.0.smithi089.stdout:2/153: rmdir df/d14/d2b/d2d/d2e 39 2024-09-13T22:08:37.874 INFO:tasks.workunit.client.0.smithi089.stdout:2/154: truncate df/d14/f24 212176 0 2024-09-13T22:08:37.874 INFO:tasks.workunit.client.0.smithi089.stdout:2/155: creat df/d14/d2b/f36 x:0 0 0 2024-09-13T22:08:37.884 INFO:tasks.workunit.client.0.smithi089.stdout:1/181: rmdir d7/d1c/d3c 39 2024-09-13T22:08:37.885 INFO:tasks.workunit.client.0.smithi089.stdout:6/125: dwrite d0/d5/f7 [0,4194304] 0 2024-09-13T22:08:37.889 INFO:tasks.workunit.client.0.smithi089.stdout:0/211: dwrite d1/de/f3e [8388608,4194304] 0 2024-09-13T22:08:37.892 INFO:tasks.workunit.client.0.smithi089.stdout:0/212: write d1/de/f14 [2006764,66391] 0 2024-09-13T22:08:37.892 INFO:tasks.workunit.client.0.smithi089.stdout:0/213: chown d1/de/d10/d36/d3d 73202118 1 2024-09-13T22:08:37.897 INFO:tasks.workunit.client.0.smithi089.stdout:6/126: symlink d0/d5/l22 0 2024-09-13T22:08:37.897 INFO:tasks.workunit.client.0.smithi089.stdout:6/127: creat d0/d5/f23 x:0 0 0 2024-09-13T22:08:37.897 INFO:tasks.workunit.client.0.smithi089.stdout:6/128: stat d0/d9/l1c 0 2024-09-13T22:08:37.897 INFO:tasks.workunit.client.0.smithi089.stdout:6/129: dread - d0/d5/f21 zero size 2024-09-13T22:08:37.898 INFO:tasks.workunit.client.0.smithi089.stdout:7/135: dwrite d0/fd [0,4194304] 0 2024-09-13T22:08:37.900 INFO:tasks.workunit.client.0.smithi089.stdout:1/182: rmdir d7/de/d1b/d2b 39 2024-09-13T22:08:37.904 INFO:tasks.workunit.client.0.smithi089.stdout:8/168: rename d0/d16 to d0/dd/d12/d42 0 2024-09-13T22:08:37.909 INFO:tasks.workunit.client.0.smithi089.stdout:6/130: rmdir d0/d9 39 2024-09-13T22:08:37.909 INFO:tasks.workunit.client.0.smithi089.stdout:6/131: fsync d0/d4/d12/f13 0 2024-09-13T22:08:37.909 INFO:tasks.workunit.client.0.smithi089.stdout:6/132: fdatasync d0/d5/f23 0 2024-09-13T22:08:37.916 INFO:tasks.workunit.client.0.smithi089.stdout:1/183: mknod d7/de/c45 0 2024-09-13T22:08:37.916 INFO:tasks.workunit.client.0.smithi089.stdout:1/184: chown d7/de/d1b/d2b/f2d 264579626 1 2024-09-13T22:08:37.916 INFO:tasks.workunit.client.0.smithi089.stdout:1/185: write d7/d1c/d3c/f3f [779042,43183] 0 2024-09-13T22:08:37.920 INFO:tasks.workunit.client.0.smithi089.stdout:5/135: rename d4/d19/c2d to d4/c39 0 2024-09-13T22:08:37.923 INFO:tasks.workunit.client.0.smithi089.stdout:9/146: rename l5 to d6/d18/d21/l37 0 2024-09-13T22:08:37.927 INFO:tasks.workunit.client.0.smithi089.stdout:2/156: rename df/f11 to df/d14/d2b/d2d/d2e/f37 0 2024-09-13T22:08:37.927 INFO:tasks.workunit.client.0.smithi089.stdout:2/157: stat df/d14 0 2024-09-13T22:08:37.933 INFO:tasks.workunit.client.0.smithi089.stdout:0/214: rename d1/de/f30 to d1/de/d10/d36/d39/f47 0 2024-09-13T22:08:37.934 INFO:tasks.workunit.client.0.smithi089.stdout:1/186: dread d7/fb [0,4194304] 0 2024-09-13T22:08:37.938 INFO:tasks.workunit.client.0.smithi089.stdout:1/187: mknod d7/de/d1b/c46 0 2024-09-13T22:08:37.945 INFO:tasks.workunit.client.0.smithi089.stdout:2/158: write df/d14/f21 [3014444,98794] 0 2024-09-13T22:08:37.946 INFO:tasks.workunit.client.0.smithi089.stdout:7/136: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T22:08:37.947 INFO:tasks.workunit.client.0.smithi089.stdout:6/133: dwrite d0/d5/f23 [0,4194304] 0 2024-09-13T22:08:37.947 INFO:tasks.workunit.client.0.smithi089.stdout:8/169: dwrite d0/dd/d12/d20/d1c/f2f [0,4194304] 0 2024-09-13T22:08:37.947 INFO:tasks.workunit.client.0.smithi089.stdout:8/170: truncate d0/dd/d11/f25 567869 0 2024-09-13T22:08:37.947 INFO:tasks.workunit.client.0.smithi089.stdout:8/171: chown d0/dd/d11/f23 14918728 1 2024-09-13T22:08:37.948 INFO:tasks.workunit.client.0.smithi089.stdout:8/172: write d0/dd/d12/f1a [3356629,56690] 0 2024-09-13T22:08:37.948 INFO:tasks.workunit.client.0.smithi089.stdout:8/173: stat d0/dd/d12/d42 0 2024-09-13T22:08:37.948 INFO:tasks.workunit.client.0.smithi089.stdout:5/136: dwrite d4/d19/f21 [0,4194304] 0 2024-09-13T22:08:37.948 INFO:tasks.workunit.client.0.smithi089.stdout:5/137: read d4/f27 [846157,98871] 0 2024-09-13T22:08:37.952 INFO:tasks.workunit.client.0.smithi089.stdout:2/159: link cd df/d1a/c38 0 2024-09-13T22:08:37.954 INFO:tasks.workunit.client.0.smithi089.stdout:7/137: unlink d0/l13 0 2024-09-13T22:08:37.958 INFO:tasks.workunit.client.0.smithi089.stdout:6/134: creat d0/d4/f24 x:0 0 0 2024-09-13T22:08:37.959 INFO:tasks.workunit.client.0.smithi089.stdout:2/160: dread fe [0,4194304] 0 2024-09-13T22:08:37.959 INFO:tasks.workunit.client.0.smithi089.stdout:2/161: chown df/f12 1959 1 2024-09-13T22:08:37.963 INFO:tasks.workunit.client.0.smithi089.stdout:8/174: creat d0/dd/d12/d3a/f43 x:0 0 0 2024-09-13T22:08:37.967 INFO:tasks.workunit.client.0.smithi089.stdout:9/147: dwrite d6/ff [0,4194304] 0 2024-09-13T22:08:37.968 INFO:tasks.workunit.client.0.smithi089.stdout:5/138: mknod d4/d19/d1e/c3a 0 2024-09-13T22:08:37.968 INFO:tasks.workunit.client.0.smithi089.stdout:5/139: write d4/f5 [1084198,6332] 0 2024-09-13T22:08:37.968 INFO:tasks.workunit.client.0.smithi089.stdout:0/215: dwrite d1/fd [0,4194304] 0 2024-09-13T22:08:37.968 INFO:tasks.workunit.client.0.smithi089.stdout:1/188: dwrite d7/f18 [0,4194304] 0 2024-09-13T22:08:37.969 INFO:tasks.workunit.client.0.smithi089.stdout:1/189: dread - d7/d1c/f35 zero size 2024-09-13T22:08:37.970 INFO:tasks.workunit.client.0.smithi089.stdout:7/138: unlink d0/d19/d1b/c20 0 2024-09-13T22:08:37.971 INFO:tasks.workunit.client.0.smithi089.stdout:7/139: stat d0/d19/d1b/d1d/d23/f25 0 2024-09-13T22:08:37.971 INFO:tasks.workunit.client.0.smithi089.stdout:1/190: dread d7/de/f27 [0,4194304] 0 2024-09-13T22:08:37.971 INFO:tasks.workunit.client.0.smithi089.stdout:1/191: write d7/de/d1b/d2b/f2d [202351,101767] 0 2024-09-13T22:08:37.973 INFO:tasks.workunit.client.0.smithi089.stdout:6/135: symlink d0/d4/d12/l25 0 2024-09-13T22:08:37.975 INFO:tasks.workunit.client.0.smithi089.stdout:2/162: link cd df/d1a/c39 0 2024-09-13T22:08:37.975 INFO:tasks.workunit.client.0.smithi089.stdout:2/163: chown df/d14/d2b/l32 2361 1 2024-09-13T22:08:37.978 INFO:tasks.workunit.client.0.smithi089.stdout:3/195: sync 2024-09-13T22:08:37.979 INFO:tasks.workunit.client.0.smithi089.stdout:4/114: sync 2024-09-13T22:08:37.983 INFO:tasks.workunit.client.0.smithi089.stdout:5/140: mknod d4/d19/d1e/d28/d31/d35/c3b 0 2024-09-13T22:08:37.983 INFO:tasks.workunit.client.0.smithi089.stdout:5/141: chown d4/d19/d1e/d28/d31/d35 1976 1 2024-09-13T22:08:37.986 INFO:tasks.workunit.client.0.smithi089.stdout:0/216: symlink d1/d16/d3a/l48 0 2024-09-13T22:08:37.987 INFO:tasks.workunit.client.0.smithi089.stdout:7/140: getdents d0/d19/d1b/d1d/d23 0 2024-09-13T22:08:37.987 INFO:tasks.workunit.client.0.smithi089.stdout:3/196: dread d1/d2/d4/f16 [4194304,4194304] 0 2024-09-13T22:08:37.989 INFO:tasks.workunit.client.0.smithi089.stdout:1/192: mknod d7/de/d3a/c47 0 2024-09-13T22:08:37.991 INFO:tasks.workunit.client.0.smithi089.stdout:6/136: symlink d0/l26 0 2024-09-13T22:08:37.991 INFO:tasks.workunit.client.0.smithi089.stdout:6/137: stat d0/d5/f23 0 2024-09-13T22:08:37.991 INFO:tasks.workunit.client.0.smithi089.stdout:6/138: stat d0/d4/d1e 0 2024-09-13T22:08:37.991 INFO:tasks.workunit.client.0.smithi089.stdout:6/139: creat d0/d5/f27 x:0 0 0 2024-09-13T22:08:37.992 INFO:tasks.workunit.client.0.smithi089.stdout:2/164: unlink df/c30 0 2024-09-13T22:08:37.992 INFO:tasks.workunit.client.0.smithi089.stdout:2/165: fsync fe 0 2024-09-13T22:08:37.992 INFO:tasks.workunit.client.0.smithi089.stdout:5/142: dread d4/f29 [0,4194304] 0 2024-09-13T22:08:37.994 INFO:tasks.workunit.client.0.smithi089.stdout:8/175: getdents d0/dd/d12 0 2024-09-13T22:08:37.995 INFO:tasks.workunit.client.0.smithi089.stdout:5/143: fsync d4/f5 0 2024-09-13T22:08:37.995 INFO:tasks.workunit.client.0.smithi089.stdout:5/144: chown d4/d19/d1e/c32 11546522 1 2024-09-13T22:08:37.995 INFO:tasks.workunit.client.0.smithi089.stdout:5/145: creat d4/d19/f3c x:0 0 0 2024-09-13T22:08:37.995 INFO:tasks.workunit.client.0.smithi089.stdout:5/146: write d4/ff [2347065,43438] 0 2024-09-13T22:08:37.995 INFO:tasks.workunit.client.0.smithi089.stdout:5/147: write d4/f8 [2078770,130132] 0 2024-09-13T22:08:37.997 INFO:tasks.workunit.client.0.smithi089.stdout:4/115: creat d0/d11/f21 x:0 0 0 2024-09-13T22:08:37.997 INFO:tasks.workunit.client.0.smithi089.stdout:4/116: chown d0/f6 448 1 2024-09-13T22:08:37.997 INFO:tasks.workunit.client.0.smithi089.stdout:4/117: chown d0/d15 96082681 1 2024-09-13T22:08:37.997 INFO:tasks.workunit.client.0.smithi089.stdout:4/118: stat d0/ca 0 2024-09-13T22:08:37.997 INFO:tasks.workunit.client.0.smithi089.stdout:4/119: fdatasync d0/d11/f21 0 2024-09-13T22:08:37.997 INFO:tasks.workunit.client.0.smithi089.stdout:4/120: write d0/d11/f18 [320569,54550] 0 2024-09-13T22:08:38.000 INFO:tasks.workunit.client.0.smithi089.stdout:9/148: link d6/l1a d6/d18/d1b/l38 0 2024-09-13T22:08:38.001 INFO:tasks.workunit.client.0.smithi089.stdout:0/217: mkdir d1/de/d15/d41/d49 0 2024-09-13T22:08:38.001 INFO:tasks.workunit.client.0.smithi089.stdout:0/218: write d1/de/f17 [330445,97830] 0 2024-09-13T22:08:38.001 INFO:tasks.workunit.client.0.smithi089.stdout:0/219: fsync d1/f27 0 2024-09-13T22:08:38.002 INFO:tasks.workunit.client.0.smithi089.stdout:7/141: unlink d0/c15 0 2024-09-13T22:08:38.006 INFO:tasks.workunit.client.0.smithi089.stdout:3/197: creat d1/d7/d1b/f48 x:0 0 0 2024-09-13T22:08:38.008 INFO:tasks.workunit.client.0.smithi089.stdout:1/193: link c6 d7/de/d3a/c48 0 2024-09-13T22:08:38.008 INFO:tasks.workunit.client.0.smithi089.stdout:1/194: chown d7/d40 14201 1 2024-09-13T22:08:38.009 INFO:tasks.workunit.client.0.smithi089.stdout:1/195: write d7/d34/f38 [394853,8695] 0 2024-09-13T22:08:38.010 INFO:tasks.workunit.client.0.smithi089.stdout:8/176: dwrite d0/dd/d12/d20/f2e [0,4194304] 0 2024-09-13T22:08:38.010 INFO:tasks.workunit.client.0.smithi089.stdout:8/177: write d0/dd/d12/d3a/f43 [844657,128726] 0 2024-09-13T22:08:38.010 INFO:tasks.workunit.client.0.smithi089.stdout:8/178: chown d0/dd/d12/d20/d36/l22 258682 1 2024-09-13T22:08:38.010 INFO:tasks.workunit.client.0.smithi089.stdout:8/179: chown d0/f2b 312893 1 2024-09-13T22:08:38.012 INFO:tasks.workunit.client.0.smithi089.stdout:6/140: rename d0/d4/d1e to d0/d9/d28 0 2024-09-13T22:08:38.015 INFO:tasks.workunit.client.0.smithi089.stdout:2/166: rename df/d1a/l2a to df/d1a/l3a 0 2024-09-13T22:08:38.020 INFO:tasks.workunit.client.0.smithi089.stdout:4/121: mknod d0/c22 0 2024-09-13T22:08:38.025 INFO:tasks.workunit.client.0.smithi089.stdout:2/167: read df/d14/f25 [3918038,68567] 0 2024-09-13T22:08:38.026 INFO:tasks.workunit.client.0.smithi089.stdout:9/149: chown d6/ce 989 1 2024-09-13T22:08:38.033 INFO:tasks.workunit.client.0.smithi089.stdout:0/220: dwrite d1/fd [0,4194304] 0 2024-09-13T22:08:38.033 INFO:tasks.workunit.client.0.smithi089.stdout:1/196: dwrite d7/de/ff [0,4194304] 0 2024-09-13T22:08:38.038 INFO:tasks.workunit.client.0.smithi089.stdout:7/142: symlink d0/d19/l27 0 2024-09-13T22:08:38.040 INFO:tasks.workunit.client.0.smithi089.stdout:3/198: symlink d1/d2/d43/l49 0 2024-09-13T22:08:38.041 INFO:tasks.workunit.client.0.smithi089.stdout:3/199: write d1/d2/d23/f27 [480378,98001] 0 2024-09-13T22:08:38.041 INFO:tasks.workunit.client.0.smithi089.stdout:3/200: read d1/f13 [373925,117807] 0 2024-09-13T22:08:38.045 INFO:tasks.workunit.client.0.smithi089.stdout:8/180: creat d0/dd/d12/d20/d32/f44 x:0 0 0 2024-09-13T22:08:38.045 INFO:tasks.workunit.client.0.smithi089.stdout:8/181: truncate d0/dd/ff 4242953 0 2024-09-13T22:08:38.048 INFO:tasks.workunit.client.0.smithi089.stdout:0/221: dwrite d1/d16/d3a/f3c [0,4194304] 0 2024-09-13T22:08:38.048 INFO:tasks.workunit.client.0.smithi089.stdout:0/222: truncate d1/de/d15/d2a/f31 1021336 0 2024-09-13T22:08:38.048 INFO:tasks.workunit.client.0.smithi089.stdout:6/141: symlink d0/d5/l29 0 2024-09-13T22:08:38.049 INFO:tasks.workunit.client.0.smithi089.stdout:6/142: dread - d0/d5/f27 zero size 2024-09-13T22:08:38.049 INFO:tasks.workunit.client.0.smithi089.stdout:6/143: fdatasync d0/d5/f23 0 2024-09-13T22:08:38.049 INFO:tasks.workunit.client.0.smithi089.stdout:6/144: readlink d0/d5/l29 0 2024-09-13T22:08:38.049 INFO:tasks.workunit.client.0.smithi089.stdout:0/223: dread d1/de/d15/f24 [0,4194304] 0 2024-09-13T22:08:38.050 INFO:tasks.workunit.client.0.smithi089.stdout:4/122: link d0/f8 d0/f23 0 2024-09-13T22:08:38.050 INFO:tasks.workunit.client.0.smithi089.stdout:4/123: write d0/f13 [2812664,12916] 0 2024-09-13T22:08:38.053 INFO:tasks.workunit.client.0.smithi089.stdout:2/168: symlink df/d14/d2b/d2d/l3b 0 2024-09-13T22:08:38.055 INFO:tasks.workunit.client.0.smithi089.stdout:9/150: mkdir d6/d18/d33/d39 0 2024-09-13T22:08:38.058 INFO:tasks.workunit.client.0.smithi089.stdout:1/197: creat d7/d1c/d3c/f49 x:0 0 0 2024-09-13T22:08:38.062 INFO:tasks.workunit.client.0.smithi089.stdout:8/182: dwrite d0/dd/d12/d20/d36/f21 [0,4194304] 0 2024-09-13T22:08:38.063 INFO:tasks.workunit.client.0.smithi089.stdout:3/201: symlink d1/d3a/l4a 0 2024-09-13T22:08:38.063 INFO:tasks.workunit.client.0.smithi089.stdout:3/202: fdatasync d1/d2/d4/f9 0 2024-09-13T22:08:38.066 INFO:tasks.workunit.client.0.smithi089.stdout:3/203: dread d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:38.068 INFO:tasks.workunit.client.0.smithi089.stdout:6/145: unlink d0/c1f 0 2024-09-13T22:08:38.069 INFO:tasks.workunit.client.0.smithi089.stdout:6/146: readlink d0/d4/d12/d15/l16 0 2024-09-13T22:08:38.071 INFO:tasks.workunit.client.0.smithi089.stdout:0/224: unlink d1/de/d10/d36/d38/f44 0 2024-09-13T22:08:38.074 INFO:tasks.workunit.client.0.smithi089.stdout:4/124: mkdir d0/d11/d16/d24 0 2024-09-13T22:08:38.077 INFO:tasks.workunit.client.0.smithi089.stdout:2/169: rename fe to df/d14/d2b/d2d/d2e/f3c 0 2024-09-13T22:08:38.077 INFO:tasks.workunit.client.0.smithi089.stdout:2/170: fsync df/f12 0 2024-09-13T22:08:38.077 INFO:tasks.workunit.client.0.smithi089.stdout:2/171: creat df/d14/f3d x:0 0 0 2024-09-13T22:08:38.079 INFO:tasks.workunit.client.0.smithi089.stdout:1/198: mkdir d7/de/d1b/d2b/d39/d4a 0 2024-09-13T22:08:38.085 INFO:tasks.workunit.client.0.smithi089.stdout:3/204: dwrite d1/d2/d4/f12 [0,4194304] 0 2024-09-13T22:08:38.085 INFO:tasks.workunit.client.0.smithi089.stdout:3/205: chown d1/d2/d4/cd 1 1 2024-09-13T22:08:38.090 INFO:tasks.workunit.client.0.smithi089.stdout:1/199: write d7/de/f30 [5927526,52438] 0 2024-09-13T22:08:38.090 INFO:tasks.workunit.client.0.smithi089.stdout:1/200: write d7/d1c/d3c/f3f [1012475,5633] 0 2024-09-13T22:08:38.093 INFO:tasks.workunit.client.0.smithi089.stdout:8/183: symlink d0/dd/d12/d20/d32/l45 0 2024-09-13T22:08:38.096 INFO:tasks.workunit.client.0.smithi089.stdout:6/147: unlink d0/d5/l22 0 2024-09-13T22:08:38.096 INFO:tasks.workunit.client.0.smithi089.stdout:6/148: truncate d0/d5/f21 332259 0 2024-09-13T22:08:38.097 INFO:tasks.workunit.client.0.smithi089.stdout:0/225: symlink d1/de/d15/d2a/l4a 0 2024-09-13T22:08:38.098 INFO:tasks.workunit.client.0.smithi089.stdout:4/125: symlink d0/d11/d16/d24/l25 0 2024-09-13T22:08:38.101 INFO:tasks.workunit.client.0.smithi089.stdout:2/172: symlink df/d14/d2b/l3e 0 2024-09-13T22:08:38.101 INFO:tasks.workunit.client.0.smithi089.stdout:2/173: fsync df/d14/d2b/f33 0 2024-09-13T22:08:38.102 INFO:tasks.workunit.client.0.smithi089.stdout:9/151: rename d6/l1a to d6/d31/l3a 0 2024-09-13T22:08:38.104 INFO:tasks.workunit.client.0.smithi089.stdout:7/143: rename d0/d19/d1b to d0/d19/d28 0 2024-09-13T22:08:38.106 INFO:tasks.workunit.client.0.smithi089.stdout:1/201: rmdir d7/de/d1b/d2b/d39/d4a 0 2024-09-13T22:08:38.107 INFO:tasks.workunit.client.0.smithi089.stdout:8/184: creat d0/dd/f46 x:0 0 0 2024-09-13T22:08:38.107 INFO:tasks.workunit.client.0.smithi089.stdout:8/185: read d0/dd/ff [3157461,123501] 0 2024-09-13T22:08:38.109 INFO:tasks.workunit.client.0.smithi089.stdout:6/149: truncate d0/f11 2084153 0 2024-09-13T22:08:38.111 INFO:tasks.workunit.client.0.smithi089.stdout:4/126: link d0/fd d0/d11/d16/f26 0 2024-09-13T22:08:38.115 INFO:tasks.workunit.client.0.smithi089.stdout:1/202: fsync d7/de/f30 0 2024-09-13T22:08:38.115 INFO:tasks.workunit.client.0.smithi089.stdout:4/127: dread d0/f8 [0,4194304] 0 2024-09-13T22:08:38.115 INFO:tasks.workunit.client.0.smithi089.stdout:2/174: dwrite df/d14/d2b/d2d/d2e/f3c [0,4194304] 0 2024-09-13T22:08:38.116 INFO:tasks.workunit.client.0.smithi089.stdout:3/206: rename d1/d2/f14 to d1/d2/d24/f4b 0 2024-09-13T22:08:38.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/175: read df/d14/f24 [80911,59258] 0 2024-09-13T22:08:38.121 INFO:tasks.workunit.client.0.smithi089.stdout:6/150: creat d0/d9/f2a x:0 0 0 2024-09-13T22:08:38.121 INFO:tasks.workunit.client.0.smithi089.stdout:6/151: chown d0/d5/f27 574 1 2024-09-13T22:08:38.121 INFO:tasks.workunit.client.0.smithi089.stdout:6/152: creat d0/d4/f2b x:0 0 0 2024-09-13T22:08:38.121 INFO:tasks.workunit.client.0.smithi089.stdout:8/186: read d0/dd/d12/d20/d1c/f2f [3320289,30492] 0 2024-09-13T22:08:38.125 INFO:tasks.workunit.client.0.smithi089.stdout:1/203: write d7/de/d1b/d2b/f2e [486334,93443] 0 2024-09-13T22:08:38.126 INFO:tasks.workunit.client.0.smithi089.stdout:0/226: rename d1/de/d15/d2a/l2d to d1/de/d10/d36/d3d/l4b 0 2024-09-13T22:08:38.127 INFO:tasks.workunit.client.0.smithi089.stdout:3/207: rmdir d1/d2/d24/d3c 0 2024-09-13T22:08:38.129 INFO:tasks.workunit.client.0.smithi089.stdout:2/176: mkdir df/d14/d3f 0 2024-09-13T22:08:38.129 INFO:tasks.workunit.client.0.smithi089.stdout:2/177: truncate df/d14/d2b/f36 752956 0 2024-09-13T22:08:38.129 INFO:tasks.workunit.client.0.smithi089.stdout:4/128: dwrite d0/f6 [0,4194304] 0 2024-09-13T22:08:38.129 INFO:tasks.workunit.client.0.smithi089.stdout:2/178: write df/f26 [70251,119335] 0 2024-09-13T22:08:38.132 INFO:tasks.workunit.client.0.smithi089.stdout:8/187: symlink d0/dd/d12/d3a/l47 0 2024-09-13T22:08:38.135 INFO:tasks.workunit.client.0.smithi089.stdout:1/204: symlink d7/d34/l4b 0 2024-09-13T22:08:38.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/144: rename d0/f11 to d0/d19/d28/d1d/d23/d24/f29 0 2024-09-13T22:08:38.138 INFO:tasks.workunit.client.0.smithi089.stdout:0/227: symlink d1/de/d15/d41/d49/l4c 0 2024-09-13T22:08:38.140 INFO:tasks.workunit.client.0.smithi089.stdout:3/208: link d1/d2/d23/d2b/c2d d1/d2/d23/d2b/c4c 0 2024-09-13T22:08:38.141 INFO:tasks.workunit.client.0.smithi089.stdout:4/129: creat d0/d11/d16/d24/f27 x:0 0 0 2024-09-13T22:08:38.143 INFO:tasks.workunit.client.0.smithi089.stdout:2/179: symlink df/d14/d3f/l40 0 2024-09-13T22:08:38.145 INFO:tasks.workunit.client.0.smithi089.stdout:9/152: rename d6/cb to d6/c3b 0 2024-09-13T22:08:38.146 INFO:tasks.workunit.client.0.smithi089.stdout:0/228: write d1/de/f3e [8729651,21023] 0 2024-09-13T22:08:38.147 INFO:tasks.workunit.client.0.smithi089.stdout:8/188: symlink d0/dd/d12/d3a/l48 0 2024-09-13T22:08:38.150 INFO:tasks.workunit.client.0.smithi089.stdout:1/205: creat d7/de/d1b/d2b/d39/f4c x:0 0 0 2024-09-13T22:08:38.150 INFO:tasks.workunit.client.0.smithi089.stdout:1/206: fsync d7/f25 0 2024-09-13T22:08:38.153 INFO:tasks.workunit.client.0.smithi089.stdout:7/145: dwrite d0/f1e [0,4194304] 0 2024-09-13T22:08:38.155 INFO:tasks.workunit.client.0.smithi089.stdout:5/148: sync 2024-09-13T22:08:38.157 INFO:tasks.workunit.client.0.smithi089.stdout:4/130: rename d0/cb to d0/d11/c28 0 2024-09-13T22:08:38.162 INFO:tasks.workunit.client.0.smithi089.stdout:2/180: mknod df/d14/d2b/d2d/d2e/c41 0 2024-09-13T22:08:38.162 INFO:tasks.workunit.client.0.smithi089.stdout:5/149: dread d4/d19/f1f [0,4194304] 0 2024-09-13T22:08:38.162 INFO:tasks.workunit.client.0.smithi089.stdout:5/150: dread - d4/d19/d1e/d28/d31/d35/f36 zero size 2024-09-13T22:08:38.162 INFO:tasks.workunit.client.0.smithi089.stdout:5/151: write d4/ff [593917,27812] 0 2024-09-13T22:08:38.164 INFO:tasks.workunit.client.0.smithi089.stdout:3/209: dwrite d1/d2/d31/f3f [0,4194304] 0 2024-09-13T22:08:38.164 INFO:tasks.workunit.client.0.smithi089.stdout:1/207: creat d7/d40/f4d x:0 0 0 2024-09-13T22:08:38.165 INFO:tasks.workunit.client.0.smithi089.stdout:1/208: chown d7/d1c/c44 37 1 2024-09-13T22:08:38.173 INFO:tasks.workunit.client.0.smithi089.stdout:7/146: getdents d0/d19 0 2024-09-13T22:08:38.176 INFO:tasks.workunit.client.0.smithi089.stdout:0/229: rename d1/de/d15/d2a/c29 to d1/de/d10/d36/c4d 0 2024-09-13T22:08:38.178 INFO:tasks.workunit.client.0.smithi089.stdout:4/131: creat d0/f29 x:0 0 0 2024-09-13T22:08:38.180 INFO:tasks.workunit.client.0.smithi089.stdout:2/181: truncate f3 6560615 0 2024-09-13T22:08:38.183 INFO:tasks.workunit.client.0.smithi089.stdout:6/153: write d0/f11 [1478009,123471] 0 2024-09-13T22:08:38.183 INFO:tasks.workunit.client.0.smithi089.stdout:9/153: dwrite d6/d18/d21/f27 [0,4194304] 0 2024-09-13T22:08:38.183 INFO:tasks.workunit.client.0.smithi089.stdout:8/189: dwrite d0/dd/d12/d42/f39 [0,4194304] 0 2024-09-13T22:08:38.183 INFO:tasks.workunit.client.0.smithi089.stdout:8/190: chown d0/dd/d12/d20/d36/f21 738256633 1 2024-09-13T22:08:38.183 INFO:tasks.workunit.client.0.smithi089.stdout:3/210: creat d1/d2/d23/d3d/f4d x:0 0 0 2024-09-13T22:08:38.184 INFO:tasks.workunit.client.0.smithi089.stdout:1/209: creat d7/de/d1b/f4e x:0 0 0 2024-09-13T22:08:38.184 INFO:tasks.workunit.client.0.smithi089.stdout:1/210: readlink d7/l23 0 2024-09-13T22:08:38.184 INFO:tasks.workunit.client.0.smithi089.stdout:1/211: dread - d7/f43 zero size 2024-09-13T22:08:38.184 INFO:tasks.workunit.client.0.smithi089.stdout:7/147: getdents d0/d19/d28/d1d 0 2024-09-13T22:08:38.184 INFO:tasks.workunit.client.0.smithi089.stdout:3/211: dread d1/d2/ff [0,4194304] 0 2024-09-13T22:08:38.186 INFO:tasks.workunit.client.0.smithi089.stdout:0/230: mkdir d1/de/d10/d36/d38/d4e 0 2024-09-13T22:08:38.186 INFO:tasks.workunit.client.0.smithi089.stdout:5/152: dwrite d4/d19/f2b [0,4194304] 0 2024-09-13T22:08:38.187 INFO:tasks.workunit.client.0.smithi089.stdout:4/132: symlink d0/d11/d16/d24/l2a 0 2024-09-13T22:08:38.189 INFO:tasks.workunit.client.0.smithi089.stdout:2/182: rmdir df/d14/d2b/d2d/d2e 39 2024-09-13T22:08:38.198 INFO:tasks.workunit.client.0.smithi089.stdout:6/154: mknod d0/c2c 0 2024-09-13T22:08:38.199 INFO:tasks.workunit.client.0.smithi089.stdout:9/154: chown d6/f12 125477491 1 2024-09-13T22:08:38.201 INFO:tasks.workunit.client.0.smithi089.stdout:3/212: dwrite d1/d7/d1b/f48 [0,4194304] 0 2024-09-13T22:08:38.205 INFO:tasks.workunit.client.0.smithi089.stdout:8/191: dwrite d0/dd/d12/d20/d36/f2a [0,4194304] 0 2024-09-13T22:08:38.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/212: symlink d7/d1c/d3c/l4f 0 2024-09-13T22:08:38.207 INFO:tasks.workunit.client.0.smithi089.stdout:7/148: mkdir d0/d19/d2a 0 2024-09-13T22:08:38.210 INFO:tasks.workunit.client.0.smithi089.stdout:0/231: creat d1/de/d10/d36/d39/f4f x:0 0 0 2024-09-13T22:08:38.210 INFO:tasks.workunit.client.0.smithi089.stdout:0/232: read d1/f7 [499514,11622] 0 2024-09-13T22:08:38.212 INFO:tasks.workunit.client.0.smithi089.stdout:0/233: dread d1/de/f17 [0,4194304] 0 2024-09-13T22:08:38.216 INFO:tasks.workunit.client.0.smithi089.stdout:5/153: mkdir d4/d19/d1e/d28/d3d 0 2024-09-13T22:08:38.216 INFO:tasks.workunit.client.0.smithi089.stdout:5/154: chown d4/d19/d1e/c32 102091035 1 2024-09-13T22:08:38.216 INFO:tasks.workunit.client.0.smithi089.stdout:5/155: truncate d4/ff 2394275 0 2024-09-13T22:08:38.217 INFO:tasks.workunit.client.0.smithi089.stdout:4/133: link d0/c22 d0/d11/c2b 0 2024-09-13T22:08:38.218 INFO:tasks.workunit.client.0.smithi089.stdout:4/134: write d0/d11/f18 [1395308,45667] 0 2024-09-13T22:08:38.219 INFO:tasks.workunit.client.0.smithi089.stdout:2/183: creat df/d1a/f42 x:0 0 0 2024-09-13T22:08:38.221 INFO:tasks.workunit.client.0.smithi089.stdout:6/155: mkdir d0/d5/d1d/d2d 0 2024-09-13T22:08:38.221 INFO:tasks.workunit.client.0.smithi089.stdout:6/156: dread - d0/d9/f2a zero size 2024-09-13T22:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:9/155: fdatasync d6/f16 0 2024-09-13T22:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:7/149: dwrite d0/ff [0,4194304] 0 2024-09-13T22:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:0/234: read d1/f4 [7716695,77374] 0 2024-09-13T22:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:0/235: chown d1/f1e 92150 1 2024-09-13T22:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:0/236: fsync d1/de/f17 0 2024-09-13T22:08:38.241 INFO:tasks.workunit.client.0.smithi089.stdout:5/156: symlink d4/d19/d1e/d28/d3d/l3e 0 2024-09-13T22:08:38.244 INFO:tasks.workunit.client.0.smithi089.stdout:6/157: creat d0/f2e x:0 0 0 2024-09-13T22:08:38.244 INFO:tasks.workunit.client.0.smithi089.stdout:6/158: chown d0/d9/c18 4 1 2024-09-13T22:08:38.244 INFO:tasks.workunit.client.0.smithi089.stdout:6/159: write d0/d5/f27 [1029148,11169] 0 2024-09-13T22:08:38.244 INFO:tasks.workunit.client.0.smithi089.stdout:6/160: dread - d0/f2e zero size 2024-09-13T22:08:38.244 INFO:tasks.workunit.client.0.smithi089.stdout:6/161: chown d0/d9/d28 1 1 2024-09-13T22:08:38.244 INFO:tasks.workunit.client.0.smithi089.stdout:6/162: fsync d0/f11 0 2024-09-13T22:08:38.245 INFO:tasks.workunit.client.0.smithi089.stdout:9/156: symlink d6/d18/d21/l3c 0 2024-09-13T22:08:38.245 INFO:tasks.workunit.client.0.smithi089.stdout:9/157: dread - d6/d18/f32 zero size 2024-09-13T22:08:38.250 INFO:tasks.workunit.client.0.smithi089.stdout:7/150: creat d0/d19/f2b x:0 0 0 2024-09-13T22:08:38.250 INFO:tasks.workunit.client.0.smithi089.stdout:9/158: read d6/d18/f1f [792621,87808] 0 2024-09-13T22:08:38.252 INFO:tasks.workunit.client.0.smithi089.stdout:0/237: unlink d1/de/d1f/c22 0 2024-09-13T22:08:38.254 INFO:tasks.workunit.client.0.smithi089.stdout:8/192: rename d0/dd/d12/d20/d36/f2a to d0/dd/f49 0 2024-09-13T22:08:38.254 INFO:tasks.workunit.client.0.smithi089.stdout:8/193: write d0/dd/d12/d20/f17 [2427695,50590] 0 2024-09-13T22:08:38.258 INFO:tasks.workunit.client.0.smithi089.stdout:1/213: getdents d7/de/d1b/d2b/d39 0 2024-09-13T22:08:38.258 INFO:tasks.workunit.client.0.smithi089.stdout:1/214: fdatasync d7/fb 0 2024-09-13T22:08:38.258 INFO:tasks.workunit.client.0.smithi089.stdout:1/215: chown d7/d34/c2f 15 1 2024-09-13T22:08:38.259 INFO:tasks.workunit.client.0.smithi089.stdout:0/238: dread d1/fd [0,4194304] 0 2024-09-13T22:08:38.260 INFO:tasks.workunit.client.0.smithi089.stdout:0/239: truncate d1/de/d10/f1b 662548 0 2024-09-13T22:08:38.260 INFO:tasks.workunit.client.0.smithi089.stdout:0/240: write d1/de/f14 [2462897,11944] 0 2024-09-13T22:08:38.260 INFO:tasks.workunit.client.0.smithi089.stdout:0/241: dread - d1/de/d10/d36/d39/f4f zero size 2024-09-13T22:08:38.261 INFO:tasks.workunit.client.0.smithi089.stdout:5/157: creat d4/d19/d1e/d28/d3d/f3f x:0 0 0 2024-09-13T22:08:38.261 INFO:tasks.workunit.client.0.smithi089.stdout:9/159: write d6/ff [1314506,33360] 0 2024-09-13T22:08:38.263 INFO:tasks.workunit.client.0.smithi089.stdout:8/194: dread d0/dd/fb [0,4194304] 0 2024-09-13T22:08:38.264 INFO:tasks.workunit.client.0.smithi089.stdout:4/135: getdents d0/d11 0 2024-09-13T22:08:38.264 INFO:tasks.workunit.client.0.smithi089.stdout:4/136: write d0/f8 [3623074,62257] 0 2024-09-13T22:08:38.270 INFO:tasks.workunit.client.0.smithi089.stdout:6/163: mknod d0/c2f 0 2024-09-13T22:08:38.270 INFO:tasks.workunit.client.0.smithi089.stdout:4/137: dread d0/f13 [0,4194304] 0 2024-09-13T22:08:38.270 INFO:tasks.workunit.client.0.smithi089.stdout:4/138: chown d0/d11/d16 14 1 2024-09-13T22:08:38.270 INFO:tasks.workunit.client.0.smithi089.stdout:4/139: fsync d0/f13 0 2024-09-13T22:08:38.270 INFO:tasks.workunit.client.0.smithi089.stdout:7/151: dwrite d0/d19/d28/d1d/d23/d24/f29 [0,4194304] 0 2024-09-13T22:08:38.271 INFO:tasks.workunit.client.0.smithi089.stdout:2/184: rename df/c1c to df/d14/d2b/d2d/c43 0 2024-09-13T22:08:38.274 INFO:tasks.workunit.client.0.smithi089.stdout:0/242: getdents d1/de/d10/d36 0 2024-09-13T22:08:38.278 INFO:tasks.workunit.client.0.smithi089.stdout:9/160: mknod d6/d18/d33/d39/c3d 0 2024-09-13T22:08:38.279 INFO:tasks.workunit.client.0.smithi089.stdout:8/195: truncate d0/dd/d12/d20/d1c/f2f 2991454 0 2024-09-13T22:08:38.281 INFO:tasks.workunit.client.0.smithi089.stdout:6/164: symlink d0/d4/d12/l30 0 2024-09-13T22:08:38.283 INFO:tasks.workunit.client.0.smithi089.stdout:4/140: mkdir d0/d2c 0 2024-09-13T22:08:38.283 INFO:tasks.workunit.client.0.smithi089.stdout:4/141: dread - d0/d11/d16/f26 zero size 2024-09-13T22:08:38.283 INFO:tasks.workunit.client.0.smithi089.stdout:4/142: truncate d0/f7 2342881 0 2024-09-13T22:08:38.283 INFO:tasks.workunit.client.0.smithi089.stdout:4/143: fsync d0/f13 0 2024-09-13T22:08:38.288 INFO:tasks.workunit.client.0.smithi089.stdout:7/152: creat d0/d19/d28/d1d/f2c x:0 0 0 2024-09-13T22:08:38.291 INFO:tasks.workunit.client.0.smithi089.stdout:1/216: rename d7/d34/l4b to d7/l50 0 2024-09-13T22:08:38.291 INFO:tasks.workunit.client.0.smithi089.stdout:1/217: creat d7/de/f51 x:0 0 0 2024-09-13T22:08:38.293 INFO:tasks.workunit.client.0.smithi089.stdout:2/185: unlink df/d14/f3d 0 2024-09-13T22:08:38.295 INFO:tasks.workunit.client.0.smithi089.stdout:0/243: symlink d1/de/d10/d36/d39/l50 0 2024-09-13T22:08:38.304 INFO:tasks.workunit.client.0.smithi089.stdout:9/161: mkdir d6/d18/d1b/d3e 0 2024-09-13T22:08:38.305 INFO:tasks.workunit.client.0.smithi089.stdout:5/158: rmdir d4 39 2024-09-13T22:08:38.306 INFO:tasks.workunit.client.0.smithi089.stdout:2/186: write fa [2538093,64248] 0 2024-09-13T22:08:38.306 INFO:tasks.workunit.client.0.smithi089.stdout:2/187: fdatasync df/d14/d2b/f36 0 2024-09-13T22:08:38.306 INFO:tasks.workunit.client.0.smithi089.stdout:8/196: mkdir d0/dd/d12/d20/d40/d4a 0 2024-09-13T22:08:38.308 INFO:tasks.workunit.client.0.smithi089.stdout:7/153: truncate d0/f5 83039 0 2024-09-13T22:08:38.308 INFO:tasks.workunit.client.0.smithi089.stdout:7/154: chown d0/d19 10376 1 2024-09-13T22:08:38.309 INFO:tasks.workunit.client.0.smithi089.stdout:4/144: dwrite d0/fd [0,4194304] 0 2024-09-13T22:08:38.309 INFO:tasks.workunit.client.0.smithi089.stdout:4/145: write d0/d11/f21 [289624,52000] 0 2024-09-13T22:08:38.310 INFO:tasks.workunit.client.0.smithi089.stdout:1/218: dwrite d7/f33 [0,4194304] 0 2024-09-13T22:08:38.311 INFO:tasks.workunit.client.0.smithi089.stdout:3/213: sync 2024-09-13T22:08:38.313 INFO:tasks.workunit.client.0.smithi089.stdout:0/244: symlink d1/de/d15/d2a/l51 0 2024-09-13T22:08:38.313 INFO:tasks.workunit.client.0.smithi089.stdout:0/245: dread - d1/de/d10/f45 zero size 2024-09-13T22:08:38.314 INFO:tasks.workunit.client.0.smithi089.stdout:1/219: dread d7/de/f30 [4194304,4194304] 0 2024-09-13T22:08:38.316 INFO:tasks.workunit.client.0.smithi089.stdout:5/159: creat d4/d19/d1e/d28/d31/f40 x:0 0 0 2024-09-13T22:08:38.317 INFO:tasks.workunit.client.0.smithi089.stdout:5/160: fsync d4/f8 0 2024-09-13T22:08:38.321 INFO:tasks.workunit.client.0.smithi089.stdout:2/188: creat df/d14/d2b/d2d/f44 x:0 0 0 2024-09-13T22:08:38.324 INFO:tasks.workunit.client.0.smithi089.stdout:8/197: mknod d0/dd/d12/d42/c4b 0 2024-09-13T22:08:38.326 INFO:tasks.workunit.client.0.smithi089.stdout:7/155: mkdir d0/d19/d28/d1d/d2d 0 2024-09-13T22:08:38.335 INFO:tasks.workunit.client.0.smithi089.stdout:7/156: write d0/f7 [1467915,70277] 0 2024-09-13T22:08:38.335 INFO:tasks.workunit.client.0.smithi089.stdout:7/157: dread - d0/d19/f2b zero size 2024-09-13T22:08:38.335 INFO:tasks.workunit.client.0.smithi089.stdout:7/158: chown d0/d19/d2a 10 1 2024-09-13T22:08:38.335 INFO:tasks.workunit.client.0.smithi089.stdout:4/146: dwrite d0/f23 [4194304,4194304] 0 2024-09-13T22:08:38.336 INFO:tasks.workunit.client.0.smithi089.stdout:9/162: dwrite d6/f24 [0,4194304] 0 2024-09-13T22:08:38.339 INFO:tasks.workunit.client.0.smithi089.stdout:5/161: mkdir d4/d19/d1e/d28/d3d/d41 0 2024-09-13T22:08:38.342 INFO:tasks.workunit.client.0.smithi089.stdout:7/159: write d0/fd [1230632,128249] 0 2024-09-13T22:08:38.344 INFO:tasks.workunit.client.0.smithi089.stdout:8/198: symlink d0/dd/d12/d20/d36/l4c 0 2024-09-13T22:08:38.345 INFO:tasks.workunit.client.0.smithi089.stdout:6/165: rename d0/d9 to d0/d4/d12/d31 0 2024-09-13T22:08:38.346 INFO:tasks.workunit.client.0.smithi089.stdout:3/214: getdents d1/d2 0 2024-09-13T22:08:38.347 INFO:tasks.workunit.client.0.smithi089.stdout:3/215: creat d1/d7/d1b/f4e x:0 0 0 2024-09-13T22:08:38.354 INFO:tasks.workunit.client.0.smithi089.stdout:0/246: rmdir d1/de/d15/d2a 39 2024-09-13T22:08:38.355 INFO:tasks.workunit.client.0.smithi089.stdout:0/247: write d1/f27 [52770,62507] 0 2024-09-13T22:08:38.356 INFO:tasks.workunit.client.0.smithi089.stdout:9/163: stat d6/c3b 0 2024-09-13T22:08:38.358 INFO:tasks.workunit.client.0.smithi089.stdout:1/220: rmdir d7/de/d1b 39 2024-09-13T22:08:38.360 INFO:tasks.workunit.client.0.smithi089.stdout:5/162: rmdir d4/d19/d1e/d28/d3d/d41 0 2024-09-13T22:08:38.360 INFO:tasks.workunit.client.0.smithi089.stdout:5/163: chown d4/d19/d1e/c3a 0 1 2024-09-13T22:08:38.360 INFO:tasks.workunit.client.0.smithi089.stdout:5/164: stat d4/f1c 0 2024-09-13T22:08:38.363 INFO:tasks.workunit.client.0.smithi089.stdout:2/189: rmdir df/d1a 39 2024-09-13T22:08:38.365 INFO:tasks.workunit.client.0.smithi089.stdout:6/166: creat d0/d4/d12/d15/f32 x:0 0 0 2024-09-13T22:08:38.365 INFO:tasks.workunit.client.0.smithi089.stdout:6/167: write d0/f2e [969964,54165] 0 2024-09-13T22:08:38.367 INFO:tasks.workunit.client.0.smithi089.stdout:1/221: dread d7/de/f14 [0,4194304] 0 2024-09-13T22:08:38.367 INFO:tasks.workunit.client.0.smithi089.stdout:4/147: dwrite d0/d11/d16/f26 [0,4194304] 0 2024-09-13T22:08:38.369 INFO:tasks.workunit.client.0.smithi089.stdout:3/216: symlink d1/d2/d23/l4f 0 2024-09-13T22:08:38.371 INFO:tasks.workunit.client.0.smithi089.stdout:7/160: dwrite d0/d19/d28/d1d/f2c [0,4194304] 0 2024-09-13T22:08:38.372 INFO:tasks.workunit.client.0.smithi089.stdout:7/161: stat d0/ff 0 2024-09-13T22:08:38.372 INFO:tasks.workunit.client.0.smithi089.stdout:7/162: fsync d0/f1e 0 2024-09-13T22:08:38.372 INFO:tasks.workunit.client.0.smithi089.stdout:0/248: link d1/de/d15/d2a/c35 d1/de/d15/d41/c52 0 2024-09-13T22:08:38.372 INFO:tasks.workunit.client.0.smithi089.stdout:1/222: dread d7/f19 [0,4194304] 0 2024-09-13T22:08:38.372 INFO:tasks.workunit.client.0.smithi089.stdout:8/199: dwrite d0/dd/d12/d20/d36/f26 [0,4194304] 0 2024-09-13T22:08:38.373 INFO:tasks.workunit.client.0.smithi089.stdout:3/217: dread d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:38.373 INFO:tasks.workunit.client.0.smithi089.stdout:9/164: creat d6/d18/d1b/f3f x:0 0 0 2024-09-13T22:08:38.373 INFO:tasks.workunit.client.0.smithi089.stdout:9/165: write d6/d18/d21/f34 [935215,57901] 0 2024-09-13T22:08:38.376 INFO:tasks.workunit.client.0.smithi089.stdout:2/190: rename df/d1a/c38 to df/d14/d2b/c45 0 2024-09-13T22:08:38.376 INFO:tasks.workunit.client.0.smithi089.stdout:2/191: creat df/d14/d2b/f46 x:0 0 0 2024-09-13T22:08:38.376 INFO:tasks.workunit.client.0.smithi089.stdout:4/148: dread d0/f23 [0,4194304] 0 2024-09-13T22:08:38.378 INFO:tasks.workunit.client.0.smithi089.stdout:3/218: write d1/d7/d1b/d28/f2c [3514685,102279] 0 2024-09-13T22:08:38.379 INFO:tasks.workunit.client.0.smithi089.stdout:5/165: dwrite d4/d19/f1b [0,4194304] 0 2024-09-13T22:08:38.380 INFO:tasks.workunit.client.0.smithi089.stdout:5/166: fdatasync d4/d19/d1e/d28/d31/f33 0 2024-09-13T22:08:38.385 INFO:tasks.workunit.client.0.smithi089.stdout:7/163: mkdir d0/d19/d28/d1d/d23/d2e 0 2024-09-13T22:08:38.385 INFO:tasks.workunit.client.0.smithi089.stdout:7/164: fsync d0/f5 0 2024-09-13T22:08:38.386 INFO:tasks.workunit.client.0.smithi089.stdout:8/200: rename d0/f8 to d0/f4d 0 2024-09-13T22:08:38.388 INFO:tasks.workunit.client.0.smithi089.stdout:1/223: mknod d7/de/d1b/d2b/d39/c52 0 2024-09-13T22:08:38.388 INFO:tasks.workunit.client.0.smithi089.stdout:1/224: write d7/de/f27 [1147293,120813] 0 2024-09-13T22:08:38.390 INFO:tasks.workunit.client.0.smithi089.stdout:9/166: symlink d6/d18/d33/l40 0 2024-09-13T22:08:38.391 INFO:tasks.workunit.client.0.smithi089.stdout:4/149: read d0/f23 [5797044,4088] 0 2024-09-13T22:08:38.396 INFO:tasks.workunit.client.0.smithi089.stdout:2/192: mknod df/d14/d3f/c47 0 2024-09-13T22:08:38.409 INFO:tasks.workunit.client.0.smithi089.stdout:0/249: dwrite d1/f11 [0,4194304] 0 2024-09-13T22:08:38.412 INFO:tasks.workunit.client.0.smithi089.stdout:2/193: dread df/f22 [0,4194304] 0 2024-09-13T22:08:38.413 INFO:tasks.workunit.client.0.smithi089.stdout:3/219: mkdir d1/d2/d18/d40/d50 0 2024-09-13T22:08:38.415 INFO:tasks.workunit.client.0.smithi089.stdout:7/165: dwrite d0/d19/f2b [0,4194304] 0 2024-09-13T22:08:38.415 INFO:tasks.workunit.client.0.smithi089.stdout:7/166: fsync d0/f14 0 2024-09-13T22:08:38.418 INFO:tasks.workunit.client.0.smithi089.stdout:7/167: dread d0/f7 [0,4194304] 0 2024-09-13T22:08:38.418 INFO:tasks.workunit.client.0.smithi089.stdout:7/168: getdents d0/d19/d28/d1d/d23/d2e 0 2024-09-13T22:08:38.430 INFO:tasks.workunit.client.0.smithi089.stdout:9/167: dwrite d6/f24 [0,4194304] 0 2024-09-13T22:08:38.430 INFO:tasks.workunit.client.0.smithi089.stdout:9/168: dread - d6/d18/f36 zero size 2024-09-13T22:08:38.432 INFO:tasks.workunit.client.0.smithi089.stdout:8/201: dwrite d0/dd/d11/f29 [0,4194304] 0 2024-09-13T22:08:38.433 INFO:tasks.workunit.client.0.smithi089.stdout:4/150: dwrite d0/d11/d16/f26 [0,4194304] 0 2024-09-13T22:08:38.435 INFO:tasks.workunit.client.0.smithi089.stdout:4/151: dread d0/d11/f21 [0,4194304] 0 2024-09-13T22:08:38.452 INFO:tasks.workunit.client.0.smithi089.stdout:5/167: mknod d4/d19/d1e/d28/d3d/c42 0 2024-09-13T22:08:38.455 INFO:tasks.workunit.client.0.smithi089.stdout:1/225: mknod d7/de/d1b/d2b/c53 0 2024-09-13T22:08:38.455 INFO:tasks.workunit.client.0.smithi089.stdout:1/226: fdatasync d7/de/d1b/d2b/f2d 0 2024-09-13T22:08:38.457 INFO:tasks.workunit.client.0.smithi089.stdout:0/250: symlink d1/de/d15/d41/l53 0 2024-09-13T22:08:38.459 INFO:tasks.workunit.client.0.smithi089.stdout:2/194: mkdir df/d14/d48 0 2024-09-13T22:08:38.465 INFO:tasks.workunit.client.0.smithi089.stdout:8/202: dwrite d0/dd/d12/f1a [0,4194304] 0 2024-09-13T22:08:38.465 INFO:tasks.workunit.client.0.smithi089.stdout:9/169: dwrite d6/d18/d1b/f2e [0,4194304] 0 2024-09-13T22:08:38.478 INFO:tasks.workunit.client.0.smithi089.stdout:0/251: dwrite d1/de/d10/d36/d3d/f43 [0,4194304] 0 2024-09-13T22:08:38.479 INFO:tasks.workunit.client.0.smithi089.stdout:0/252: write d1/f5 [2911536,11322] 0 2024-09-13T22:08:38.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/152: creat d0/d11/d16/f2d x:0 0 0 2024-09-13T22:08:38.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/153: read - d0/d11/d16/d24/f27 zero size 2024-09-13T22:08:38.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/154: chown d0/d15/d1f 2382 1 2024-09-13T22:08:38.506 INFO:tasks.workunit.client.0.smithi089.stdout:4/155: write d0/f13 [2731463,95571] 0 2024-09-13T22:08:38.510 INFO:tasks.workunit.client.0.smithi089.stdout:5/168: creat d4/d19/f43 x:0 0 0 2024-09-13T22:08:38.512 INFO:tasks.workunit.client.0.smithi089.stdout:1/227: getdents d7/de/d1b/d2b/d39 0 2024-09-13T22:08:38.512 INFO:tasks.workunit.client.0.smithi089.stdout:1/228: fdatasync d7/de/d1b/f4e 0 2024-09-13T22:08:38.514 INFO:tasks.workunit.client.0.smithi089.stdout:2/195: link df/d14/d2b/d2d/d2e/f3c df/d14/d3f/f49 0 2024-09-13T22:08:38.514 INFO:tasks.workunit.client.0.smithi089.stdout:2/196: fsync df/f12 0 2024-09-13T22:08:38.517 INFO:tasks.workunit.client.0.smithi089.stdout:8/203: link d0/dd/d12/d20/d36/l22 d0/dd/d12/d20/d32/d3b/l4e 0 2024-09-13T22:08:38.520 INFO:tasks.workunit.client.0.smithi089.stdout:8/204: write d0/dd/f19 [556243,48512] 0 2024-09-13T22:08:38.522 INFO:tasks.workunit.client.0.smithi089.stdout:9/170: creat d6/d18/d33/d39/f41 x:0 0 0 2024-09-13T22:08:38.529 INFO:tasks.workunit.client.0.smithi089.stdout:0/253: symlink d1/de/d10/d36/d38/l54 0 2024-09-13T22:08:38.529 INFO:tasks.workunit.client.0.smithi089.stdout:0/254: creat d1/f55 x:0 0 0 2024-09-13T22:08:38.531 INFO:tasks.workunit.client.0.smithi089.stdout:4/156: creat d0/d15/f2e x:0 0 0 2024-09-13T22:08:38.531 INFO:tasks.workunit.client.0.smithi089.stdout:9/171: write d6/d18/d21/f27 [2922640,113811] 0 2024-09-13T22:08:38.540 INFO:tasks.workunit.client.0.smithi089.stdout:5/169: link d4/l16 d4/d19/d1e/d28/d3d/l44 0 2024-09-13T22:08:38.540 INFO:tasks.workunit.client.0.smithi089.stdout:5/170: chown d4 42 1 2024-09-13T22:08:38.540 INFO:tasks.workunit.client.0.smithi089.stdout:5/171: write f2 [3413783,13111] 0 2024-09-13T22:08:38.540 INFO:tasks.workunit.client.0.smithi089.stdout:1/229: creat d7/de/d1b/d2b/f54 x:0 0 0 2024-09-13T22:08:38.541 INFO:tasks.workunit.client.0.smithi089.stdout:4/157: dread d0/fd [0,4194304] 0 2024-09-13T22:08:38.541 INFO:tasks.workunit.client.0.smithi089.stdout:2/197: link df/d1a/l34 df/d14/d2b/l4a 0 2024-09-13T22:08:38.541 INFO:tasks.workunit.client.0.smithi089.stdout:8/205: readlink d0/dd/l13 0 2024-09-13T22:08:38.543 INFO:tasks.workunit.client.0.smithi089.stdout:0/255: rmdir d1/de/d15/d41 39 2024-09-13T22:08:38.543 INFO:tasks.workunit.client.0.smithi089.stdout:0/256: write d1/f55 [8795,125727] 0 2024-09-13T22:08:38.545 INFO:tasks.workunit.client.0.smithi089.stdout:9/172: fsync d6/f15 0 2024-09-13T22:08:38.546 INFO:tasks.workunit.client.0.smithi089.stdout:5/172: symlink d4/d19/d1e/d28/l45 0 2024-09-13T22:08:38.547 INFO:tasks.workunit.client.0.smithi089.stdout:1/230: mkdir d7/d40/d55 0 2024-09-13T22:08:38.548 INFO:tasks.workunit.client.0.smithi089.stdout:8/206: getdents d0/dd/d12/d20/d36 0 2024-09-13T22:08:38.549 INFO:tasks.workunit.client.0.smithi089.stdout:8/207: stat d0/dd/d11/f25 0 2024-09-13T22:08:38.550 INFO:tasks.workunit.client.0.smithi089.stdout:0/257: mkdir d1/de/d56 0 2024-09-13T22:08:38.550 INFO:tasks.workunit.client.0.smithi089.stdout:0/258: fsync d1/de/d10/d36/d39/f4f 0 2024-09-13T22:08:38.553 INFO:tasks.workunit.client.0.smithi089.stdout:5/173: mkdir d4/d19/d1e/d28/d31/d35/d46 0 2024-09-13T22:08:38.555 INFO:tasks.workunit.client.0.smithi089.stdout:1/231: mknod d7/d40/c56 0 2024-09-13T22:08:38.560 INFO:tasks.workunit.client.0.smithi089.stdout:5/174: creat d4/d19/d1e/d28/d31/d35/f47 x:0 0 0 2024-09-13T22:08:38.560 INFO:tasks.workunit.client.0.smithi089.stdout:5/175: dread - d4/d19/d1e/d28/d31/f40 zero size 2024-09-13T22:08:38.562 INFO:tasks.workunit.client.0.smithi089.stdout:1/232: rmdir d7/d40/d55 0 2024-09-13T22:08:38.565 INFO:tasks.workunit.client.0.smithi089.stdout:1/233: symlink d7/d40/l57 0 2024-09-13T22:08:38.566 INFO:tasks.workunit.client.0.smithi089.stdout:0/259: rename d1/d16 to d1/de/d10/d36/d57 0 2024-09-13T22:08:38.569 INFO:tasks.workunit.client.0.smithi089.stdout:5/176: rename d4/d19/d1e/d28/d31/d35/f36 to d4/d19/f48 0 2024-09-13T22:08:38.570 INFO:tasks.workunit.client.0.smithi089.stdout:0/260: unlink d1/de/d15/d41/d49/l4c 0 2024-09-13T22:08:38.570 INFO:tasks.workunit.client.0.smithi089.stdout:0/261: rename d1/de to d1/de/d15/d58 22 2024-09-13T22:08:38.573 INFO:tasks.workunit.client.0.smithi089.stdout:0/262: creat d1/de/d10/d36/d57/d3a/f59 x:0 0 0 2024-09-13T22:08:38.573 INFO:tasks.workunit.client.0.smithi089.stdout:0/263: read d1/f7 [556078,38949] 0 2024-09-13T22:08:38.578 INFO:tasks.workunit.client.0.smithi089.stdout:8/208: dwrite d0/dd/d12/d20/d36/f26 [0,4194304] 0 2024-09-13T22:08:38.583 INFO:tasks.workunit.client.0.smithi089.stdout:4/158: dwrite d0/f23 [4194304,4194304] 0 2024-09-13T22:08:38.583 INFO:tasks.workunit.client.0.smithi089.stdout:2/198: dwrite df/d14/f25 [4194304,4194304] 0 2024-09-13T22:08:38.583 INFO:tasks.workunit.client.0.smithi089.stdout:9/173: dwrite d6/fa [0,4194304] 0 2024-09-13T22:08:38.587 INFO:tasks.workunit.client.0.smithi089.stdout:6/168: sync 2024-09-13T22:08:38.590 INFO:tasks.workunit.client.0.smithi089.stdout:9/174: unlink d6/f24 0 2024-09-13T22:08:38.592 INFO:tasks.workunit.client.0.smithi089.stdout:6/169: creat d0/d5/d1d/f33 x:0 0 0 2024-09-13T22:08:38.592 INFO:tasks.workunit.client.0.smithi089.stdout:6/170: fsync d0/d4/f24 0 2024-09-13T22:08:38.593 INFO:tasks.workunit.client.0.smithi089.stdout:9/175: chown d6/fc 1647 1 2024-09-13T22:08:38.596 INFO:tasks.workunit.client.0.smithi089.stdout:0/264: dwrite d1/de/d10/d36/d39/f4f [0,4194304] 0 2024-09-13T22:08:38.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/176: creat d6/d18/d33/f42 x:0 0 0 2024-09-13T22:08:38.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/177: truncate d6/d18/f1f 5109114 0 2024-09-13T22:08:38.600 INFO:tasks.workunit.client.0.smithi089.stdout:0/265: mknod d1/de/d10/d36/d39/c5a 0 2024-09-13T22:08:38.602 INFO:tasks.workunit.client.0.smithi089.stdout:9/178: read d6/f15 [2114791,102495] 0 2024-09-13T22:08:38.602 INFO:tasks.workunit.client.0.smithi089.stdout:0/266: dread d1/de/f46 [0,4194304] 0 2024-09-13T22:08:38.602 INFO:tasks.workunit.client.0.smithi089.stdout:0/267: chown d1/de/d10/d36/d39/l50 2302 1 2024-09-13T22:08:38.603 INFO:tasks.workunit.client.0.smithi089.stdout:3/220: sync 2024-09-13T22:08:38.603 INFO:tasks.workunit.client.0.smithi089.stdout:7/169: sync 2024-09-13T22:08:38.603 INFO:tasks.workunit.client.0.smithi089.stdout:7/170: getdents d0/d19/d28/d1d/d2d 0 2024-09-13T22:08:38.604 INFO:tasks.workunit.client.0.smithi089.stdout:7/171: dread - d0/f14 zero size 2024-09-13T22:08:38.604 INFO:tasks.workunit.client.0.smithi089.stdout:0/268: mkdir d1/de/d15/d2a/d3f/d5b 0 2024-09-13T22:08:38.605 INFO:tasks.workunit.client.0.smithi089.stdout:0/269: write d1/f5 [2797327,37319] 0 2024-09-13T22:08:38.605 INFO:tasks.workunit.client.0.smithi089.stdout:1/234: rmdir d7/de 39 2024-09-13T22:08:38.607 INFO:tasks.workunit.client.0.smithi089.stdout:9/179: link d6/ld d6/d18/d33/l43 0 2024-09-13T22:08:38.613 INFO:tasks.workunit.client.0.smithi089.stdout:2/199: dwrite df/d14/d2b/d2d/d2e/f3c [0,4194304] 0 2024-09-13T22:08:38.613 INFO:tasks.workunit.client.0.smithi089.stdout:2/200: readlink df/d1a/l34 0 2024-09-13T22:08:38.613 INFO:tasks.workunit.client.0.smithi089.stdout:4/159: dwrite d0/d11/d16/d24/f27 [0,4194304] 0 2024-09-13T22:08:38.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/209: dwrite d0/dd/d11/f23 [0,4194304] 0 2024-09-13T22:08:38.613 INFO:tasks.workunit.client.0.smithi089.stdout:7/172: link d0/c18 d0/c2f 0 2024-09-13T22:08:38.613 INFO:tasks.workunit.client.0.smithi089.stdout:0/270: rename d1/de/d10/d36/d57/d3a/f59 to d1/de/d15/f5c 0 2024-09-13T22:08:38.616 INFO:tasks.workunit.client.0.smithi089.stdout:1/235: creat d7/de/d1b/f58 x:0 0 0 2024-09-13T22:08:38.617 INFO:tasks.workunit.client.0.smithi089.stdout:9/180: truncate d6/d18/f1d 4164452 0 2024-09-13T22:08:38.618 INFO:tasks.workunit.client.0.smithi089.stdout:7/173: dread d0/d19/d28/d1d/d23/f25 [0,4194304] 0 2024-09-13T22:08:38.623 INFO:tasks.workunit.client.0.smithi089.stdout:3/221: dwrite d1/d2/d24/f3b [0,4194304] 0 2024-09-13T22:08:38.629 INFO:tasks.workunit.client.0.smithi089.stdout:3/222: dread d1/d2/f3 [0,4194304] 0 2024-09-13T22:08:38.630 INFO:tasks.workunit.client.0.smithi089.stdout:1/236: mkdir d7/de/d1b/d2b/d59 0 2024-09-13T22:08:38.630 INFO:tasks.workunit.client.0.smithi089.stdout:1/237: chown d7/de/d1b/d2b/f2d 1 1 2024-09-13T22:08:38.632 INFO:tasks.workunit.client.0.smithi089.stdout:1/238: dread d7/d34/f38 [0,4194304] 0 2024-09-13T22:08:38.634 INFO:tasks.workunit.client.0.smithi089.stdout:9/181: creat d6/d18/d21/f44 x:0 0 0 2024-09-13T22:08:38.636 INFO:tasks.workunit.client.0.smithi089.stdout:7/174: mkdir d0/d19/d28/d1d/d30 0 2024-09-13T22:08:38.636 INFO:tasks.workunit.client.0.smithi089.stdout:5/177: truncate d4/f27 581905 0 2024-09-13T22:08:38.642 INFO:tasks.workunit.client.0.smithi089.stdout:3/223: symlink d1/d2/d18/d40/l51 0 2024-09-13T22:08:38.642 INFO:tasks.workunit.client.0.smithi089.stdout:0/271: write d1/de/d10/d36/d39/f4f [1608041,37736] 0 2024-09-13T22:08:38.642 INFO:tasks.workunit.client.0.smithi089.stdout:3/224: rename d1/d2/d4 to d1/d2/d4/d52 22 2024-09-13T22:08:38.642 INFO:tasks.workunit.client.0.smithi089.stdout:3/225: chown d1/d2/d31 511440 1 2024-09-13T22:08:38.643 INFO:tasks.workunit.client.0.smithi089.stdout:3/226: readlink d1/d7/le 0 2024-09-13T22:08:38.643 INFO:tasks.workunit.client.0.smithi089.stdout:0/272: creat d1/de/d10/f5d x:0 0 0 2024-09-13T22:08:38.643 INFO:tasks.workunit.client.0.smithi089.stdout:1/239: mknod d7/d1c/c5a 0 2024-09-13T22:08:38.644 INFO:tasks.workunit.client.0.smithi089.stdout:6/171: getdents d0/d5/d1d 0 2024-09-13T22:08:38.647 INFO:tasks.workunit.client.0.smithi089.stdout:7/175: rename d0/d19/d28/d1d/d23/f25 to d0/d19/d28/d1d/d23/f31 0 2024-09-13T22:08:38.648 INFO:tasks.workunit.client.0.smithi089.stdout:5/178: creat d4/d19/d1e/d28/f49 x:0 0 0 2024-09-13T22:08:38.648 INFO:tasks.workunit.client.0.smithi089.stdout:5/179: fsync d4/f1c 0 2024-09-13T22:08:38.651 INFO:tasks.workunit.client.0.smithi089.stdout:2/201: dwrite df/d14/d2b/f36 [0,4194304] 0 2024-09-13T22:08:38.652 INFO:tasks.workunit.client.0.smithi089.stdout:8/210: dwrite d0/dd/f35 [0,4194304] 0 2024-09-13T22:08:38.652 INFO:tasks.workunit.client.0.smithi089.stdout:4/160: dwrite d0/d11/d16/f26 [0,4194304] 0 2024-09-13T22:08:38.653 INFO:tasks.workunit.client.0.smithi089.stdout:0/273: mkdir d1/de/d15/d2a/d3f/d5b/d5e 0 2024-09-13T22:08:38.655 INFO:tasks.workunit.client.0.smithi089.stdout:1/240: rmdir d7/d34 39 2024-09-13T22:08:38.655 INFO:tasks.workunit.client.0.smithi089.stdout:1/241: write d7/de/f51 [246228,83146] 0 2024-09-13T22:08:38.655 INFO:tasks.workunit.client.0.smithi089.stdout:1/242: truncate d7/de/d1b/f58 496895 0 2024-09-13T22:08:38.657 INFO:tasks.workunit.client.0.smithi089.stdout:0/274: dread d1/f27 [0,4194304] 0 2024-09-13T22:08:38.658 INFO:tasks.workunit.client.0.smithi089.stdout:0/275: dread - d1/de/d15/f5c zero size 2024-09-13T22:08:38.658 INFO:tasks.workunit.client.0.smithi089.stdout:0/276: readlink d1/de/d10/d36/d57/l18 0 2024-09-13T22:08:38.661 INFO:tasks.workunit.client.0.smithi089.stdout:5/180: rename d4/l16 to d4/d19/d1e/d28/d31/d35/d46/l4a 0 2024-09-13T22:08:38.662 INFO:tasks.workunit.client.0.smithi089.stdout:6/172: dwrite d0/d4/d12/f20 [0,4194304] 0 2024-09-13T22:08:38.666 INFO:tasks.workunit.client.0.smithi089.stdout:2/202: mkdir df/d14/d2b/d4b 0 2024-09-13T22:08:38.666 INFO:tasks.workunit.client.0.smithi089.stdout:2/203: truncate df/f22 795763 0 2024-09-13T22:08:38.670 INFO:tasks.workunit.client.0.smithi089.stdout:9/182: dwrite d6/d18/d21/f27 [0,4194304] 0 2024-09-13T22:08:38.673 INFO:tasks.workunit.client.0.smithi089.stdout:8/211: symlink d0/dd/d12/d20/d32/d3b/l4f 0 2024-09-13T22:08:38.674 INFO:tasks.workunit.client.0.smithi089.stdout:8/212: chown d0/dd/f49 0 1 2024-09-13T22:08:38.674 INFO:tasks.workunit.client.0.smithi089.stdout:8/213: chown d0/dd/d11/l3e 1003240639 1 2024-09-13T22:08:38.687 INFO:tasks.workunit.client.0.smithi089.stdout:9/183: dwrite d6/d18/f1f [0,4194304] 0 2024-09-13T22:08:38.689 INFO:tasks.workunit.client.0.smithi089.stdout:1/243: getdents d7/de 0 2024-09-13T22:08:38.693 INFO:tasks.workunit.client.0.smithi089.stdout:7/176: rmdir d0/d19 39 2024-09-13T22:08:38.695 INFO:tasks.workunit.client.0.smithi089.stdout:0/277: rmdir d1/de/d15/d2a/d3f/d5b 39 2024-09-13T22:08:38.697 INFO:tasks.workunit.client.0.smithi089.stdout:5/181: symlink d4/d19/l4b 0 2024-09-13T22:08:38.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/204: symlink df/d14/l4c 0 2024-09-13T22:08:38.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/205: dread - df/d1a/f42 zero size 2024-09-13T22:08:38.702 INFO:tasks.workunit.client.0.smithi089.stdout:0/278: read d1/f32 [3134902,72104] 0 2024-09-13T22:08:38.705 INFO:tasks.workunit.client.0.smithi089.stdout:0/279: dread d1/f32 [0,4194304] 0 2024-09-13T22:08:38.710 INFO:tasks.workunit.client.0.smithi089.stdout:4/161: rmdir d0 39 2024-09-13T22:08:38.712 INFO:tasks.workunit.client.0.smithi089.stdout:9/184: rmdir d6/d31 39 2024-09-13T22:08:38.714 INFO:tasks.workunit.client.0.smithi089.stdout:1/244: rename d7/l50 to d7/d34/l5b 0 2024-09-13T22:08:38.715 INFO:tasks.workunit.client.0.smithi089.stdout:7/177: mkdir d0/d19/d28/d1d/d2d/d32 0 2024-09-13T22:08:38.717 INFO:tasks.workunit.client.0.smithi089.stdout:5/182: symlink d4/d19/l4c 0 2024-09-13T22:08:38.717 INFO:tasks.workunit.client.0.smithi089.stdout:5/183: write d4/ff [625009,57183] 0 2024-09-13T22:08:38.717 INFO:tasks.workunit.client.0.smithi089.stdout:5/184: dread - d4/d19/d1e/d28/d31/f33 zero size 2024-09-13T22:08:38.719 INFO:tasks.workunit.client.0.smithi089.stdout:2/206: dwrite df/f12 [0,4194304] 0 2024-09-13T22:08:38.726 INFO:tasks.workunit.client.0.smithi089.stdout:8/214: getdents d0/dd/d11 0 2024-09-13T22:08:38.729 INFO:tasks.workunit.client.0.smithi089.stdout:0/280: mkdir d1/de/d15/d2a/d3f/d5f 0 2024-09-13T22:08:38.729 INFO:tasks.workunit.client.0.smithi089.stdout:0/281: chown d1/de/d15/f24 32 1 2024-09-13T22:08:38.729 INFO:tasks.workunit.client.0.smithi089.stdout:0/282: creat d1/de/d10/d36/d38/f60 x:0 0 0 2024-09-13T22:08:38.729 INFO:tasks.workunit.client.0.smithi089.stdout:0/283: write d1/f4 [6051994,84687] 0 2024-09-13T22:08:38.730 INFO:tasks.workunit.client.0.smithi089.stdout:4/162: unlink d0/f12 0 2024-09-13T22:08:38.735 INFO:tasks.workunit.client.0.smithi089.stdout:4/163: read d0/f13 [577330,124628] 0 2024-09-13T22:08:38.736 INFO:tasks.workunit.client.0.smithi089.stdout:5/185: dwrite d4/f1c [0,4194304] 0 2024-09-13T22:08:38.736 INFO:tasks.workunit.client.0.smithi089.stdout:5/186: stat d4/f29 0 2024-09-13T22:08:38.736 INFO:tasks.workunit.client.0.smithi089.stdout:5/187: creat d4/d19/d1e/d28/d31/f4d x:0 0 0 2024-09-13T22:08:38.742 INFO:tasks.workunit.client.0.smithi089.stdout:1/245: mkdir d7/d34/d5c 0 2024-09-13T22:08:38.742 INFO:tasks.workunit.client.0.smithi089.stdout:8/215: dread d0/dd/d12/d20/d32/f41 [0,4194304] 0 2024-09-13T22:08:38.744 INFO:tasks.workunit.client.0.smithi089.stdout:7/178: mknod d0/d19/d28/c33 0 2024-09-13T22:08:38.744 INFO:tasks.workunit.client.0.smithi089.stdout:7/179: dread - d0/f22 zero size 2024-09-13T22:08:38.744 INFO:tasks.workunit.client.0.smithi089.stdout:7/180: chown d0/ff 242 1 2024-09-13T22:08:38.745 INFO:tasks.workunit.client.0.smithi089.stdout:0/284: dwrite d1/de/d10/d36/d57/f33 [0,4194304] 0 2024-09-13T22:08:38.745 INFO:tasks.workunit.client.0.smithi089.stdout:0/285: write d1/de/d10/d36/d38/f60 [599579,96475] 0 2024-09-13T22:08:38.751 INFO:tasks.workunit.client.0.smithi089.stdout:4/164: link d0/d11/f18 d0/d11/d16/d24/f2f 0 2024-09-13T22:08:38.756 INFO:tasks.workunit.client.0.smithi089.stdout:5/188: creat d4/d19/d1e/d28/d31/d35/d46/f4e x:0 0 0 2024-09-13T22:08:38.757 INFO:tasks.workunit.client.0.smithi089.stdout:1/246: truncate d7/de/d1b/d2b/f2d 207655 0 2024-09-13T22:08:38.759 INFO:tasks.workunit.client.0.smithi089.stdout:8/216: mknod d0/dd/d12/d20/c50 0 2024-09-13T22:08:38.761 INFO:tasks.workunit.client.0.smithi089.stdout:7/181: creat d0/d19/d28/d1d/f34 x:0 0 0 2024-09-13T22:08:38.771 INFO:tasks.workunit.client.0.smithi089.stdout:0/286: rename d1/de/d10/d36/d57/l18 to d1/de/d15/d2a/d3f/d5b/l61 0 2024-09-13T22:08:38.774 INFO:tasks.workunit.client.0.smithi089.stdout:4/165: creat d0/d11/f30 x:0 0 0 2024-09-13T22:08:38.776 INFO:tasks.workunit.client.0.smithi089.stdout:5/189: symlink d4/d19/d1e/d28/d3d/l4f 0 2024-09-13T22:08:38.776 INFO:tasks.workunit.client.0.smithi089.stdout:5/190: chown d4/d19/d1e/d28/d31 3344 1 2024-09-13T22:08:38.777 INFO:tasks.workunit.client.0.smithi089.stdout:8/217: dwrite d0/dd/d12/f1a [0,4194304] 0 2024-09-13T22:08:38.778 INFO:tasks.workunit.client.0.smithi089.stdout:1/247: mkdir d7/d34/d5c/d5d 0 2024-09-13T22:08:38.778 INFO:tasks.workunit.client.0.smithi089.stdout:1/248: creat d7/d1c/d3c/f5e x:0 0 0 2024-09-13T22:08:38.780 INFO:tasks.workunit.client.0.smithi089.stdout:7/182: creat d0/d19/d28/d1d/d23/f35 x:0 0 0 2024-09-13T22:08:38.781 INFO:tasks.workunit.client.0.smithi089.stdout:5/191: dread d4/f5 [0,4194304] 0 2024-09-13T22:08:38.784 INFO:tasks.workunit.client.0.smithi089.stdout:4/166: rmdir d0/d11/d16 39 2024-09-13T22:08:38.787 INFO:tasks.workunit.client.0.smithi089.stdout:8/218: dread d0/f2b [0,4194304] 0 2024-09-13T22:08:38.787 INFO:tasks.workunit.client.0.smithi089.stdout:5/192: dread d4/f8 [0,4194304] 0 2024-09-13T22:08:38.788 INFO:tasks.workunit.client.0.smithi089.stdout:3/227: sync 2024-09-13T22:08:38.788 INFO:tasks.workunit.client.0.smithi089.stdout:3/228: write f0 [6015208,100138] 0 2024-09-13T22:08:38.789 INFO:tasks.workunit.client.0.smithi089.stdout:1/249: rename d7/de/f14 to d7/de/f5f 0 2024-09-13T22:08:38.789 INFO:tasks.workunit.client.0.smithi089.stdout:1/250: write d7/d1c/d3c/f49 [365848,100416] 0 2024-09-13T22:08:38.793 INFO:tasks.workunit.client.0.smithi089.stdout:0/287: rename d1/de/d15/d2a/d3f to d1/de/d10/d36/d38/d4e/d62 0 2024-09-13T22:08:38.794 INFO:tasks.workunit.client.0.smithi089.stdout:4/167: unlink d0/lf 0 2024-09-13T22:08:38.797 INFO:tasks.workunit.client.0.smithi089.stdout:0/288: dread d1/f1e [0,4194304] 0 2024-09-13T22:08:38.797 INFO:tasks.workunit.client.0.smithi089.stdout:0/289: dread - d1/de/f20 zero size 2024-09-13T22:08:38.799 INFO:tasks.workunit.client.0.smithi089.stdout:1/251: dread d7/de/f30 [0,4194304] 0 2024-09-13T22:08:38.799 INFO:tasks.workunit.client.0.smithi089.stdout:1/252: creat d7/d1c/d3c/f60 x:0 0 0 2024-09-13T22:08:38.799 INFO:tasks.workunit.client.0.smithi089.stdout:8/219: symlink d0/l51 0 2024-09-13T22:08:38.800 INFO:tasks.workunit.client.0.smithi089.stdout:5/193: symlink d4/d19/d1e/l50 0 2024-09-13T22:08:38.803 INFO:tasks.workunit.client.0.smithi089.stdout:7/183: getdents d0/d19/d28/d1d/d23 0 2024-09-13T22:08:38.804 INFO:tasks.workunit.client.0.smithi089.stdout:4/168: creat d0/d15/d1f/f31 x:0 0 0 2024-09-13T22:08:38.807 INFO:tasks.workunit.client.0.smithi089.stdout:0/290: creat d1/de/d10/d36/d38/d4e/d62/d5b/f63 x:0 0 0 2024-09-13T22:08:38.807 INFO:tasks.workunit.client.0.smithi089.stdout:0/291: write d1/de/d10/d36/d39/f4f [5154341,41612] 0 2024-09-13T22:08:38.807 INFO:tasks.workunit.client.0.smithi089.stdout:0/292: dread - d1/de/d10/f5d zero size 2024-09-13T22:08:38.807 INFO:tasks.workunit.client.0.smithi089.stdout:4/169: dread d0/f7 [0,4194304] 0 2024-09-13T22:08:38.810 INFO:tasks.workunit.client.0.smithi089.stdout:1/253: unlink d7/fd 0 2024-09-13T22:08:38.810 INFO:tasks.workunit.client.0.smithi089.stdout:1/254: write d7/de/f5f [2664694,28612] 0 2024-09-13T22:08:38.811 INFO:tasks.workunit.client.0.smithi089.stdout:8/220: unlink d0/dd/d11/f23 0 2024-09-13T22:08:38.813 INFO:tasks.workunit.client.0.smithi089.stdout:8/221: write d0/dd/f19 [1238977,9214] 0 2024-09-13T22:08:38.813 INFO:tasks.workunit.client.0.smithi089.stdout:8/222: chown d0/dd/d12/d20/d32/d3b 252254 1 2024-09-13T22:08:38.814 INFO:tasks.workunit.client.0.smithi089.stdout:6/173: sync 2024-09-13T22:08:38.815 INFO:tasks.workunit.client.0.smithi089.stdout:7/184: unlink d0/f1a 0 2024-09-13T22:08:38.815 INFO:tasks.workunit.client.0.smithi089.stdout:7/185: readlink d0/l16 0 2024-09-13T22:08:38.816 INFO:tasks.workunit.client.0.smithi089.stdout:0/293: truncate d1/de/d10/f1b 599312 0 2024-09-13T22:08:38.817 INFO:tasks.workunit.client.0.smithi089.stdout:0/294: creat d1/de/d10/f64 x:0 0 0 2024-09-13T22:08:38.819 INFO:tasks.workunit.client.0.smithi089.stdout:4/170: creat d0/d11/d16/d24/f32 x:0 0 0 2024-09-13T22:08:38.819 INFO:tasks.workunit.client.0.smithi089.stdout:4/171: chown d0/d11/d16/f2d 161 1 2024-09-13T22:08:38.819 INFO:tasks.workunit.client.0.smithi089.stdout:4/172: write d0/d11/f18 [1589898,100824] 0 2024-09-13T22:08:38.820 INFO:tasks.workunit.client.0.smithi089.stdout:8/223: write d0/dd/d11/f29 [3971238,63828] 0 2024-09-13T22:08:38.821 INFO:tasks.workunit.client.0.smithi089.stdout:1/255: mknod d7/de/d1b/d2b/c61 0 2024-09-13T22:08:38.823 INFO:tasks.workunit.client.0.smithi089.stdout:6/174: creat d0/d4/d12/d31/f34 x:0 0 0 2024-09-13T22:08:38.823 INFO:tasks.workunit.client.0.smithi089.stdout:6/175: stat d0/d5 0 2024-09-13T22:08:38.824 INFO:tasks.workunit.client.0.smithi089.stdout:7/186: write d0/d19/d28/d1d/d23/d24/f29 [2403377,89901] 0 2024-09-13T22:08:38.829 INFO:tasks.workunit.client.0.smithi089.stdout:0/295: dread d1/de/d10/d36/d3d/f43 [0,4194304] 0 2024-09-13T22:08:38.836 INFO:tasks.workunit.client.0.smithi089.stdout:6/176: symlink d0/d5/d1d/d2d/l35 0 2024-09-13T22:08:38.840 INFO:tasks.workunit.client.0.smithi089.stdout:0/296: truncate d1/de/f3e 5235028 0 2024-09-13T22:08:38.843 INFO:tasks.workunit.client.0.smithi089.stdout:6/177: symlink d0/d4/d12/d31/d28/l36 0 2024-09-13T22:08:38.845 INFO:tasks.workunit.client.0.smithi089.stdout:0/297: mknod d1/de/c65 0 2024-09-13T22:08:38.853 INFO:tasks.workunit.client.0.smithi089.stdout:6/178: dread d0/d4/d12/f13 [4194304,4194304] 0 2024-09-13T22:08:38.856 INFO:tasks.workunit.client.0.smithi089.stdout:0/298: dread d1/de/d10/f13 [0,4194304] 0 2024-09-13T22:08:38.856 INFO:tasks.workunit.client.0.smithi089.stdout:0/299: getdents d1/de/d10/d36/d38/d4e/d62/d5f 0 2024-09-13T22:08:38.859 INFO:tasks.workunit.client.0.smithi089.stdout:8/224: dwrite d0/dd/f19 [0,4194304] 0 2024-09-13T22:08:38.859 INFO:tasks.workunit.client.0.smithi089.stdout:1/256: dwrite d7/de/d1b/d2b/d39/f4c [0,4194304] 0 2024-09-13T22:08:38.862 INFO:tasks.workunit.client.0.smithi089.stdout:8/225: truncate d0/dd/d12/d20/f17 1240913 0 2024-09-13T22:08:38.863 INFO:tasks.workunit.client.0.smithi089.stdout:6/179: write d0/d4/d12/f20 [2728280,53378] 0 2024-09-13T22:08:38.863 INFO:tasks.workunit.client.0.smithi089.stdout:6/180: chown d0/d4/d12/d31/f2a 106901546 1 2024-09-13T22:08:38.863 INFO:tasks.workunit.client.0.smithi089.stdout:6/181: truncate d0/d4/d12/f20 4477511 0 2024-09-13T22:08:38.863 INFO:tasks.workunit.client.0.smithi089.stdout:6/182: creat d0/d4/d12/f37 x:0 0 0 2024-09-13T22:08:38.865 INFO:tasks.workunit.client.0.smithi089.stdout:6/183: dread d0/d5/f27 [0,4194304] 0 2024-09-13T22:08:38.865 INFO:tasks.workunit.client.0.smithi089.stdout:6/184: write d0/d4/f24 [164000,1459] 0 2024-09-13T22:08:38.865 INFO:tasks.workunit.client.0.smithi089.stdout:6/185: creat d0/d4/f38 x:0 0 0 2024-09-13T22:08:38.865 INFO:tasks.workunit.client.0.smithi089.stdout:6/186: dread - d0/d4/f38 zero size 2024-09-13T22:08:38.870 INFO:tasks.workunit.client.0.smithi089.stdout:1/257: readlink d7/l21 0 2024-09-13T22:08:38.878 INFO:tasks.workunit.client.0.smithi089.stdout:6/187: creat d0/d5/d1d/d2d/f39 x:0 0 0 2024-09-13T22:08:38.879 INFO:tasks.workunit.client.0.smithi089.stdout:1/258: truncate d7/de/d1b/f58 625151 0 2024-09-13T22:08:38.879 INFO:tasks.workunit.client.0.smithi089.stdout:1/259: write d7/de/f51 [1319298,130590] 0 2024-09-13T22:08:38.880 INFO:tasks.workunit.client.0.smithi089.stdout:6/188: fdatasync d0/d4/d12/f20 0 2024-09-13T22:08:38.880 INFO:tasks.workunit.client.0.smithi089.stdout:6/189: chown d0/d5/d1d/d2d/l35 24139 1 2024-09-13T22:08:38.881 INFO:tasks.workunit.client.0.smithi089.stdout:6/190: chown d0/d5/f23 13261 1 2024-09-13T22:08:38.881 INFO:tasks.workunit.client.0.smithi089.stdout:6/191: fdatasync d0/d4/d12/f20 0 2024-09-13T22:08:38.881 INFO:tasks.workunit.client.0.smithi089.stdout:8/226: rmdir d0/dd/d11 39 2024-09-13T22:08:38.883 INFO:tasks.workunit.client.0.smithi089.stdout:6/192: link d0/d4/f24 d0/d4/d12/d31/f3a 0 2024-09-13T22:08:38.886 INFO:tasks.workunit.client.0.smithi089.stdout:1/260: creat d7/d34/d5c/d5d/f62 x:0 0 0 2024-09-13T22:08:38.887 INFO:tasks.workunit.client.0.smithi089.stdout:6/193: rmdir d0/d5/d1d 39 2024-09-13T22:08:38.891 INFO:tasks.workunit.client.0.smithi089.stdout:6/194: mkdir d0/d4/d12/d15/d3b 0 2024-09-13T22:08:38.892 INFO:tasks.workunit.client.0.smithi089.stdout:2/207: sync 2024-09-13T22:08:38.892 INFO:tasks.workunit.client.0.smithi089.stdout:9/185: sync 2024-09-13T22:08:38.892 INFO:tasks.workunit.client.0.smithi089.stdout:9/186: chown d6/d31/l3a 0 1 2024-09-13T22:08:38.892 INFO:tasks.workunit.client.0.smithi089.stdout:9/187: fsync d6/d18/d21/f34 0 2024-09-13T22:08:38.894 INFO:tasks.workunit.client.0.smithi089.stdout:1/261: rename d7/d1c/d3c/l4f to d7/de/d1b/l63 0 2024-09-13T22:08:38.899 INFO:tasks.workunit.client.0.smithi089.stdout:8/227: dwrite d0/dd/f14 [0,4194304] 0 2024-09-13T22:08:38.899 INFO:tasks.workunit.client.0.smithi089.stdout:8/228: write d0/dd/d12/d20/d36/f26 [1502381,7985] 0 2024-09-13T22:08:38.899 INFO:tasks.workunit.client.0.smithi089.stdout:8/229: chown d0/dd/d12/d3a/f43 21267 1 2024-09-13T22:08:38.900 INFO:tasks.workunit.client.0.smithi089.stdout:6/195: rename d0/c17 to d0/c3c 0 2024-09-13T22:08:38.901 INFO:tasks.workunit.client.0.smithi089.stdout:2/208: symlink df/l4d 0 2024-09-13T22:08:38.903 INFO:tasks.workunit.client.0.smithi089.stdout:9/188: mknod d6/d18/d1b/d3e/c45 0 2024-09-13T22:08:38.907 INFO:tasks.workunit.client.0.smithi089.stdout:8/230: mknod d0/dd/c52 0 2024-09-13T22:08:38.908 INFO:tasks.workunit.client.0.smithi089.stdout:8/231: write d0/dd/ff [2423774,52783] 0 2024-09-13T22:08:38.910 INFO:tasks.workunit.client.0.smithi089.stdout:8/232: mknod d0/dd/d11/c53 0 2024-09-13T22:08:38.914 INFO:tasks.workunit.client.0.smithi089.stdout:8/233: mknod d0/dd/d12/c54 0 2024-09-13T22:08:38.919 INFO:tasks.workunit.client.0.smithi089.stdout:8/234: rename d0/f2b to d0/dd/d12/d20/d32/d3b/f55 0 2024-09-13T22:08:38.933 INFO:tasks.workunit.client.0.smithi089.stdout:2/209: dwrite df/f10 [0,4194304] 0 2024-09-13T22:08:38.935 INFO:tasks.workunit.client.0.smithi089.stdout:2/210: truncate df/d14/f25 8114320 0 2024-09-13T22:08:38.937 INFO:tasks.workunit.client.0.smithi089.stdout:2/211: symlink df/d1a/l4e 0 2024-09-13T22:08:38.937 INFO:tasks.workunit.client.0.smithi089.stdout:2/212: readlink df/d14/d3f/l40 0 2024-09-13T22:08:38.937 INFO:tasks.workunit.client.0.smithi089.stdout:2/213: read f3 [4719835,41772] 0 2024-09-13T22:08:38.938 INFO:tasks.workunit.client.0.smithi089.stdout:2/214: truncate df/f26 303782 0 2024-09-13T22:08:38.938 INFO:tasks.workunit.client.0.smithi089.stdout:2/215: write df/d14/d2b/d2d/d2e/f37 [4920492,35118] 0 2024-09-13T22:08:38.938 INFO:tasks.workunit.client.0.smithi089.stdout:2/216: symlink df/d14/d2b/d4b/l4f 0 2024-09-13T22:08:38.939 INFO:tasks.workunit.client.0.smithi089.stdout:2/217: truncate df/d14/f24 13126 0 2024-09-13T22:08:38.939 INFO:tasks.workunit.client.0.smithi089.stdout:2/218: stat df/d14/d2b/d2d 0 2024-09-13T22:08:38.941 INFO:tasks.workunit.client.0.smithi089.stdout:2/219: rename df/d14/d2b/d2d/c43 to df/d14/d2b/d4b/c50 0 2024-09-13T22:08:38.942 INFO:tasks.workunit.client.0.smithi089.stdout:2/220: getdents df/d14/d48 0 2024-09-13T22:08:38.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/196: dwrite d0/f2e [0,4194304] 0 2024-09-13T22:08:38.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/197: dread - d0/d4/d12/d15/f32 zero size 2024-09-13T22:08:38.942 INFO:tasks.workunit.client.0.smithi089.stdout:1/262: dwrite d7/f43 [0,4194304] 0 2024-09-13T22:08:38.942 INFO:tasks.workunit.client.0.smithi089.stdout:1/263: chown d7/de/c12 259711426 1 2024-09-13T22:08:38.943 INFO:tasks.workunit.client.0.smithi089.stdout:8/235: dwrite d0/dd/fb [0,4194304] 0 2024-09-13T22:08:38.943 INFO:tasks.workunit.client.0.smithi089.stdout:2/221: rename fa to df/d14/d2b/d2d/f51 0 2024-09-13T22:08:38.944 INFO:tasks.workunit.client.0.smithi089.stdout:9/189: dwrite d6/d18/f1d [4194304,4194304] 0 2024-09-13T22:08:38.958 INFO:tasks.workunit.client.0.smithi089.stdout:6/198: dwrite d0/d5/f14 [0,4194304] 0 2024-09-13T22:08:38.958 INFO:tasks.workunit.client.0.smithi089.stdout:6/199: creat d0/d5/f3d x:0 0 0 2024-09-13T22:08:38.965 INFO:tasks.workunit.client.1.smithi159.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T22:08:38.966 INFO:tasks.workunit.client.0.smithi089.stdout:8/236: mknod d0/dd/d12/d20/d32/d3b/c56 0 2024-09-13T22:08:38.966 INFO:tasks.workunit.client.1.smithi159.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T22:08:38.966 INFO:tasks.workunit.client.1.smithi159.stderr:+ make 2024-09-13T22:08:38.966 INFO:tasks.workunit.client.0.smithi089.stdout:9/190: dwrite d6/f12 [4194304,4194304] 0 2024-09-13T22:08:38.967 INFO:tasks.workunit.client.0.smithi089.stdout:1/264: rename d7/de/f51 to d7/d1c/f64 0 2024-09-13T22:08:38.967 INFO:tasks.workunit.client.0.smithi089.stdout:1/265: creat d7/d1c/d3c/f65 x:0 0 0 2024-09-13T22:08:38.967 INFO:tasks.workunit.client.0.smithi089.stdout:2/222: write df/d14/f25 [1813233,92780] 0 2024-09-13T22:08:38.968 INFO:tasks.workunit.client.0.smithi089.stdout:2/223: dread - df/d14/d2b/d2d/f44 zero size 2024-09-13T22:08:38.985 INFO:tasks.workunit.client.0.smithi089.stdout:8/237: mkdir d0/dd/d12/d20/d36/d57 0 2024-09-13T22:08:38.987 INFO:tasks.workunit.client.0.smithi089.stdout:9/191: creat d6/d18/d1b/d3e/f46 x:0 0 0 2024-09-13T22:08:38.989 INFO:tasks.workunit.client.0.smithi089.stdout:1/266: mknod d7/de/d1b/d2b/c66 0 2024-09-13T22:08:38.990 INFO:tasks.workunit.client.0.smithi089.stdout:3/229: sync 2024-09-13T22:08:38.991 INFO:tasks.workunit.client.0.smithi089.stdout:2/224: symlink df/d14/d2b/d2d/l52 0 2024-09-13T22:08:38.994 INFO:tasks.workunit.client.0.smithi089.stdout:8/238: link d0/dd/d11/f29 d0/dd/d12/d20/d36/f58 0 2024-09-13T22:08:38.998 INFO:tasks.workunit.client.0.smithi089.stdout:9/192: link d6/d18/f1d d6/d18/f47 0 2024-09-13T22:08:38.999 INFO:tasks.workunit.client.0.smithi089.stdout:2/225: getdents df/d14/d2b/d2d/d2e 0 2024-09-13T22:08:39.003 INFO:tasks.workunit.client.0.smithi089.stdout:8/239: dread d0/dd/d12/d20/d32/d3b/f55 [0,4194304] 0 2024-09-13T22:08:39.003 INFO:tasks.workunit.client.0.smithi089.stdout:8/240: truncate d0/dd/d11/f2d 1766078 0 2024-09-13T22:08:39.007 INFO:tasks.workunit.client.0.smithi089.stdout:4/173: sync 2024-09-13T22:08:39.007 INFO:tasks.workunit.client.0.smithi089.stdout:5/194: sync 2024-09-13T22:08:39.007 INFO:tasks.workunit.client.0.smithi089.stdout:0/300: sync 2024-09-13T22:08:39.007 INFO:tasks.workunit.client.0.smithi089.stdout:4/174: chown d0/d15/d1f/f31 2 1 2024-09-13T22:08:39.007 INFO:tasks.workunit.client.0.smithi089.stdout:5/195: read - d4/d19/d1e/d28/d31/f33 zero size 2024-09-13T22:08:39.007 INFO:tasks.workunit.client.0.smithi089.stdout:5/196: creat d4/d19/d1e/d28/f51 x:0 0 0 2024-09-13T22:08:39.007 INFO:tasks.workunit.client.0.smithi089.stdout:5/197: dread - d4/d19/d1e/d28/d31/f37 zero size 2024-09-13T22:08:39.012 INFO:tasks.workunit.client.0.smithi089.stdout:5/198: rename d4/d19/f43 to d4/d19/d1e/d28/d31/f52 0 2024-09-13T22:08:39.012 INFO:tasks.workunit.client.0.smithi089.stdout:5/199: fsync d4/d19/f21 0 2024-09-13T22:08:39.013 INFO:tasks.workunit.client.0.smithi089.stdout:7/187: sync 2024-09-13T22:08:39.015 INFO:tasks.workunit.client.0.smithi089.stdout:4/175: read d0/f1a [654914,35283] 0 2024-09-13T22:08:39.017 INFO:tasks.workunit.client.0.smithi089.stdout:7/188: symlink d0/d19/d28/d1d/d23/d24/l36 0 2024-09-13T22:08:39.019 INFO:tasks.workunit.client.0.smithi089.stdout:4/176: symlink d0/d2c/l33 0 2024-09-13T22:08:39.026 INFO:tasks.workunit.client.0.smithi089.stdout:0/301: write d1/de/d10/f1d [3225150,104769] 0 2024-09-13T22:08:39.026 INFO:tasks.workunit.client.0.smithi089.stdout:0/302: stat d1/de/d15/f5c 0 2024-09-13T22:08:39.026 INFO:tasks.workunit.client.0.smithi089.stdout:4/177: rename d0/c22 to d0/d15/c34 0 2024-09-13T22:08:39.026 INFO:tasks.workunit.client.0.smithi089.stdout:0/303: creat d1/de/d10/d36/f66 x:0 0 0 2024-09-13T22:08:39.026 INFO:tasks.workunit.client.0.smithi089.stdout:0/304: chown d1/de/d10/d36/d39/l50 208 1 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:4/178: mkdir d0/d2c/d35 0 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:6/200: getdents d0/d5 0 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:6/201: chown d0/c2f 195780 1 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:6/202: truncate d0/d5/f21 805672 0 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:6/203: fsync d0/d5/f14 0 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:6/204: write d0/d4/f38 [190522,58216] 0 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:6/205: dread - d0/d4/f2b zero size 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:6/206: chown d0/d4/d12/d31/d28/l36 92695 1 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:6/207: chown d0/d5/d1d/d2d/l35 82492286 1 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:6/208: write d0/d4/d12/f13 [9247899,15064] 0 2024-09-13T22:08:39.027 INFO:tasks.workunit.client.0.smithi089.stdout:9/193: dwrite d6/d18/f47 [0,4194304] 0 2024-09-13T22:08:39.028 INFO:tasks.workunit.client.0.smithi089.stdout:1/267: dwrite d7/de/d1b/d2b/d39/f4c [0,4194304] 0 2024-09-13T22:08:39.028 INFO:tasks.workunit.client.0.smithi089.stdout:6/209: creat d0/f3e x:0 0 0 2024-09-13T22:08:39.028 INFO:tasks.workunit.client.0.smithi089.stdout:6/210: creat d0/d4/d12/d31/f3f x:0 0 0 2024-09-13T22:08:39.028 INFO:tasks.workunit.client.0.smithi089.stdout:0/305: creat d1/de/d10/d36/d38/d4e/d62/d5b/f67 x:0 0 0 2024-09-13T22:08:39.029 INFO:tasks.workunit.client.0.smithi089.stdout:4/179: link d0/f23 d0/d11/d16/d24/f36 0 2024-09-13T22:08:39.031 INFO:tasks.workunit.client.0.smithi089.stdout:1/268: stat c6 0 2024-09-13T22:08:39.033 INFO:tasks.workunit.client.0.smithi089.stdout:9/194: mkdir d6/d18/d21/d48 0 2024-09-13T22:08:39.033 INFO:tasks.workunit.client.0.smithi089.stdout:9/195: creat d6/d18/d33/f49 x:0 0 0 2024-09-13T22:08:39.033 INFO:tasks.workunit.client.0.smithi089.stdout:9/196: chown d6/d18/d1b/f2e 232032 1 2024-09-13T22:08:39.033 INFO:tasks.workunit.client.0.smithi089.stdout:9/197: creat d6/d18/d21/f4a x:0 0 0 2024-09-13T22:08:39.034 INFO:tasks.workunit.client.0.smithi089.stdout:0/306: rename d1/de/d10/d36/d57/f33 to d1/de/d15/d41/f68 0 2024-09-13T22:08:39.036 INFO:tasks.workunit.client.0.smithi089.stdout:4/180: dread d0/d11/d16/d24/f2f [0,4194304] 0 2024-09-13T22:08:39.036 INFO:tasks.workunit.client.0.smithi089.stdout:2/226: dwrite df/d14/f24 [0,4194304] 0 2024-09-13T22:08:39.036 INFO:tasks.workunit.client.0.smithi089.stdout:1/269: creat d7/de/d1b/d2b/d59/f67 x:0 0 0 2024-09-13T22:08:39.036 INFO:tasks.workunit.client.0.smithi089.stdout:1/270: fdatasync d7/d1c/d3c/f60 0 2024-09-13T22:08:39.038 INFO:tasks.workunit.client.0.smithi089.stdout:8/241: dwrite d0/dd/d12/d20/d32/f41 [0,4194304] 0 2024-09-13T22:08:39.038 INFO:tasks.workunit.client.0.smithi089.stdout:8/242: fsync d0/dd/d11/f29 0 2024-09-13T22:08:39.038 INFO:tasks.workunit.client.0.smithi089.stdout:8/243: fdatasync d0/dd/d12/d42/f39 0 2024-09-13T22:08:39.038 INFO:tasks.workunit.client.0.smithi089.stdout:0/307: symlink d1/de/d15/l69 0 2024-09-13T22:08:39.040 INFO:tasks.workunit.client.0.smithi089.stdout:5/200: dwrite d4/d19/f21 [0,4194304] 0 2024-09-13T22:08:39.040 INFO:tasks.workunit.client.0.smithi089.stdout:5/201: write d4/f8 [1077400,22529] 0 2024-09-13T22:08:39.042 INFO:tasks.workunit.client.0.smithi089.stdout:4/181: dread d0/f8 [0,4194304] 0 2024-09-13T22:08:39.042 INFO:tasks.workunit.client.0.smithi089.stdout:2/227: creat df/d14/d3f/f53 x:0 0 0 2024-09-13T22:08:39.043 INFO:tasks.workunit.client.0.smithi089.stdout:2/228: chown df/d14/d3f/c47 1548382 1 2024-09-13T22:08:39.044 INFO:tasks.workunit.client.0.smithi089.stdout:9/198: truncate d6/f10 2413573 0 2024-09-13T22:08:39.044 INFO:tasks.workunit.client.0.smithi089.stdout:9/199: chown d6/d31 447843678 1 2024-09-13T22:08:39.046 INFO:tasks.workunit.client.0.smithi089.stdout:0/308: symlink d1/de/d10/d36/d3d/l6a 0 2024-09-13T22:08:39.048 INFO:tasks.workunit.client.0.smithi089.stdout:5/202: mkdir d4/d19/d1e/d53 0 2024-09-13T22:08:39.050 INFO:tasks.workunit.client.0.smithi089.stdout:4/182: rename d0/c5 to d0/d2c/d35/c37 0 2024-09-13T22:08:39.050 INFO:tasks.workunit.client.0.smithi089.stdout:1/271: write d7/f33 [2653511,85069] 0 2024-09-13T22:08:39.050 INFO:tasks.workunit.client.0.smithi089.stdout:2/229: symlink df/d14/d3f/l54 0 2024-09-13T22:08:39.051 INFO:tasks.workunit.client.0.smithi089.stdout:9/200: creat d6/d18/d21/d48/f4b x:0 0 0 2024-09-13T22:08:39.051 INFO:tasks.workunit.client.0.smithi089.stdout:9/201: readlink d6/d18/l29 0 2024-09-13T22:08:39.051 INFO:tasks.workunit.client.0.smithi089.stdout:9/202: fsync d6/d18/d1b/f3f 0 2024-09-13T22:08:39.055 INFO:tasks.workunit.client.0.smithi089.stdout:0/309: creat d1/de/d10/d36/d38/d4e/d62/d5b/d5e/f6b x:0 0 0 2024-09-13T22:08:39.057 INFO:tasks.workunit.client.0.smithi089.stdout:5/203: creat d4/f54 x:0 0 0 2024-09-13T22:08:39.057 INFO:tasks.workunit.client.0.smithi089.stdout:5/204: chown d4/d19/d1e/d28/d3d/c42 580250322 1 2024-09-13T22:08:39.057 INFO:tasks.workunit.client.0.smithi089.stdout:5/205: fdatasync d4/d19/f1f 0 2024-09-13T22:08:39.058 INFO:tasks.workunit.client.0.smithi089.stdout:2/230: write df/d14/f24 [2299593,97247] 0 2024-09-13T22:08:39.059 INFO:tasks.workunit.client.0.smithi089.stdout:4/183: unlink d0/cc 0 2024-09-13T22:08:39.059 INFO:tasks.workunit.client.0.smithi089.stdout:4/184: read - d0/d11/d16/d24/f32 zero size 2024-09-13T22:08:39.061 INFO:tasks.workunit.client.0.smithi089.stdout:8/244: dwrite d0/dd/f49 [4194304,4194304] 0 2024-09-13T22:08:39.062 INFO:tasks.workunit.client.0.smithi089.stdout:1/272: mkdir d7/de/d68 0 2024-09-13T22:08:39.065 INFO:tasks.workunit.client.0.smithi089.stdout:9/203: unlink d6/f16 0 2024-09-13T22:08:39.066 INFO:tasks.workunit.client.0.smithi089.stdout:9/204: creat d6/d18/d33/d39/f4c x:0 0 0 2024-09-13T22:08:39.066 INFO:tasks.workunit.client.0.smithi089.stdout:0/310: mknod d1/de/d10/d36/d57/c6c 0 2024-09-13T22:08:39.069 INFO:tasks.workunit.client.0.smithi089.stdout:2/231: rmdir df/d14/d2b/d4b 39 2024-09-13T22:08:39.069 INFO:tasks.workunit.client.0.smithi089.stdout:2/232: write df/d14/d2b/d2d/f51 [1096613,20490] 0 2024-09-13T22:08:39.069 INFO:tasks.workunit.client.0.smithi089.stdout:2/233: dread - df/d14/d3f/f53 zero size 2024-09-13T22:08:39.071 INFO:tasks.workunit.client.0.smithi089.stdout:0/311: dread d1/de/d10/f1d [0,4194304] 0 2024-09-13T22:08:39.071 INFO:tasks.workunit.client.0.smithi089.stdout:0/312: stat d1/de/d15/d41/d49 0 2024-09-13T22:08:39.071 INFO:tasks.workunit.client.0.smithi089.stdout:8/245: mkdir d0/dd/d12/d20/d36/d59 0 2024-09-13T22:08:39.073 INFO:tasks.workunit.client.0.smithi089.stdout:1/273: chown d7/d40/l57 630465 1 2024-09-13T22:08:39.073 INFO:tasks.workunit.client.0.smithi089.stdout:1/274: fsync d7/de/f27 0 2024-09-13T22:08:39.077 INFO:tasks.workunit.client.0.smithi089.stdout:0/313: mkdir d1/d6d 0 2024-09-13T22:08:39.077 INFO:tasks.workunit.client.0.smithi089.stdout:5/206: dwrite d4/d19/d1e/d28/d31/f52 [0,4194304] 0 2024-09-13T22:08:39.078 INFO:tasks.workunit.client.0.smithi089.stdout:1/275: mknod d7/de/d1b/d2b/d59/c69 0 2024-09-13T22:08:39.081 INFO:tasks.workunit.client.0.smithi089.stdout:0/314: rmdir d1/d6d 0 2024-09-13T22:08:39.084 INFO:tasks.workunit.client.0.smithi089.stdout:0/315: dread d1/de/d10/d36/d38/f60 [0,4194304] 0 2024-09-13T22:08:39.084 INFO:tasks.workunit.client.0.smithi089.stdout:5/207: dread f2 [0,4194304] 0 2024-09-13T22:08:39.084 INFO:tasks.workunit.client.0.smithi089.stdout:5/208: read - d4/d19/d1e/d28/d31/f40 zero size 2024-09-13T22:08:39.086 INFO:tasks.workunit.client.0.smithi089.stdout:0/316: write d1/f1e [658238,111931] 0 2024-09-13T22:08:39.086 INFO:tasks.workunit.client.0.smithi089.stdout:0/317: write d1/de/d10/d36/d38/d4e/d62/d5b/f63 [444620,81883] 0 2024-09-13T22:08:39.087 INFO:tasks.workunit.client.0.smithi089.stdout:0/318: write d1/de/d15/f24 [556059,108001] 0 2024-09-13T22:08:39.089 INFO:tasks.workunit.client.0.smithi089.stdout:0/319: rename d1/de/d15/d41/c52 to d1/de/d1f/c6e 0 2024-09-13T22:08:39.089 INFO:tasks.workunit.client.0.smithi089.stdout:0/320: dread - d1/de/d10/d36/d38/d4e/d62/d5b/d5e/f6b zero size 2024-09-13T22:08:39.090 INFO:tasks.workunit.client.0.smithi089.stdout:0/321: symlink d1/de/d10/d36/d38/d4e/d62/d5b/l6f 0 2024-09-13T22:08:39.090 INFO:tasks.workunit.client.0.smithi089.stdout:0/322: write d1/de/f46 [1370635,20278] 0 2024-09-13T22:08:39.090 INFO:tasks.workunit.client.0.smithi089.stdout:0/323: creat d1/de/d10/d36/d38/f70 x:0 0 0 2024-09-13T22:08:39.092 INFO:tasks.workunit.client.0.smithi089.stdout:0/324: rmdir d1/de/d15/d2a 39 2024-09-13T22:08:39.094 INFO:tasks.workunit.client.0.smithi089.stdout:0/325: mknod d1/de/d10/d36/d38/d4e/d62/d5b/c71 0 2024-09-13T22:08:39.095 INFO:tasks.workunit.client.0.smithi089.stdout:0/326: mkdir d1/de/d10/d36/d38/d4e/d62/d5f/d72 0 2024-09-13T22:08:39.097 INFO:tasks.workunit.client.0.smithi089.stdout:0/327: unlink d1/lc 0 2024-09-13T22:08:39.098 INFO:tasks.workunit.client.0.smithi089.stdout:0/328: truncate d1/de/d10/d36/d38/d4e/d62/d5b/d5e/f6b 218863 0 2024-09-13T22:08:39.098 INFO:tasks.workunit.client.0.smithi089.stdout:1/276: dread d7/f26 [4194304,4194304] 0 2024-09-13T22:08:39.098 INFO:tasks.workunit.client.0.smithi089.stdout:1/277: truncate d7/d34/f38 1167343 0 2024-09-13T22:08:39.099 INFO:tasks.workunit.client.0.smithi089.stdout:0/329: mknod d1/de/d10/d36/d3d/c73 0 2024-09-13T22:08:39.099 INFO:tasks.workunit.client.0.smithi089.stdout:0/330: dread - d1/de/d10/f45 zero size 2024-09-13T22:08:39.100 INFO:tasks.workunit.client.1.smithi159.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T22:08:39.100 INFO:tasks.workunit.client.0.smithi089.stdout:0/331: creat d1/de/d10/d36/d38/d4e/d62/f74 x:0 0 0 2024-09-13T22:08:39.101 INFO:tasks.workunit.client.0.smithi089.stdout:0/332: truncate d1/de/d10/d36/d38/f70 1003632 0 2024-09-13T22:08:39.101 INFO:tasks.workunit.client.0.smithi089.stdout:0/333: truncate d1/de/d10/d36/d38/d4e/d62/d5b/d5e/f6b 1053869 0 2024-09-13T22:08:39.106 INFO:tasks.workunit.client.0.smithi089.stdout:9/205: dwrite d6/d18/d21/f44 [0,4194304] 0 2024-09-13T22:08:39.108 INFO:tasks.workunit.client.0.smithi089.stdout:8/246: dwrite d0/dd/d12/d20/d36/f26 [0,4194304] 0 2024-09-13T22:08:39.109 INFO:tasks.workunit.client.0.smithi089.stdout:5/209: dwrite d4/d19/d1e/d28/d31/f52 [0,4194304] 0 2024-09-13T22:08:39.110 INFO:tasks.workunit.client.0.smithi089.stdout:2/234: dwrite df/f10 [4194304,4194304] 0 2024-09-13T22:08:39.115 INFO:tasks.workunit.client.0.smithi089.stdout:9/206: truncate d6/d18/f1f 2577913 0 2024-09-13T22:08:39.115 INFO:tasks.workunit.client.0.smithi089.stdout:8/247: truncate d0/dd/d11/f2d 868730 0 2024-09-13T22:08:39.118 INFO:tasks.workunit.client.0.smithi089.stdout:5/210: mkdir d4/d19/d1e/d28/d31/d55 0 2024-09-13T22:08:39.118 INFO:tasks.workunit.client.0.smithi089.stdout:5/211: fdatasync d4/d19/d1e/d28/d31/f33 0 2024-09-13T22:08:39.118 INFO:tasks.workunit.client.0.smithi089.stdout:5/212: creat d4/d19/f56 x:0 0 0 2024-09-13T22:08:39.119 INFO:tasks.workunit.client.0.smithi089.stdout:0/334: dwrite d1/de/d10/f1b [0,4194304] 0 2024-09-13T22:08:39.122 INFO:tasks.workunit.client.0.smithi089.stdout:8/248: dread d0/dd/d12/d20/f18 [0,4194304] 0 2024-09-13T22:08:39.122 INFO:tasks.workunit.client.0.smithi089.stdout:8/249: dread - d0/dd/d12/d20/d32/f44 zero size 2024-09-13T22:08:39.123 INFO:tasks.workunit.client.0.smithi089.stdout:8/250: chown d0/dd/d12/d20/d40 6028766 1 2024-09-13T22:08:39.123 INFO:tasks.workunit.client.0.smithi089.stdout:2/235: unlink df/f10 0 2024-09-13T22:08:39.123 INFO:tasks.workunit.client.0.smithi089.stdout:2/236: fdatasync df/d14/f25 0 2024-09-13T22:08:39.123 INFO:tasks.workunit.client.0.smithi089.stdout:9/207: fdatasync d6/f2b 0 2024-09-13T22:08:39.126 INFO:tasks.workunit.client.0.smithi089.stdout:5/213: creat d4/d19/d1e/d28/d3d/f57 x:0 0 0 2024-09-13T22:08:39.132 INFO:tasks.workunit.client.0.smithi089.stdout:0/335: rename d1/de/d10/d36/d38/d4e/d62/d5b/l6f to d1/de/d10/l75 0 2024-09-13T22:08:39.132 INFO:tasks.workunit.client.0.smithi089.stdout:2/237: dread df/f12 [0,4194304] 0 2024-09-13T22:08:39.133 INFO:tasks.workunit.client.0.smithi089.stdout:8/251: mkdir d0/dd/d12/d20/d1c/d5a 0 2024-09-13T22:08:39.133 INFO:tasks.workunit.client.0.smithi089.stdout:8/252: creat d0/dd/d12/d3a/f5b x:0 0 0 2024-09-13T22:08:39.133 INFO:tasks.workunit.client.0.smithi089.stdout:8/253: fsync d0/dd/d12/d20/d32/f44 0 2024-09-13T22:08:39.134 INFO:tasks.workunit.client.0.smithi089.stdout:5/214: mkdir d4/d19/d1e/d28/d31/d55/d58 0 2024-09-13T22:08:39.136 INFO:tasks.workunit.client.0.smithi089.stdout:8/254: mknod d0/dd/d12/d20/c5c 0 2024-09-13T22:08:39.136 INFO:tasks.workunit.client.0.smithi089.stdout:8/255: readlink d0/dd/d12/d20/d36/l28 0 2024-09-13T22:08:39.136 INFO:tasks.workunit.client.0.smithi089.stdout:8/256: truncate d0/dd/d12/d3a/f43 1369985 0 2024-09-13T22:08:39.136 INFO:tasks.workunit.client.0.smithi089.stdout:9/208: dwrite d6/d18/f36 [0,4194304] 0 2024-09-13T22:08:39.136 INFO:tasks.workunit.client.0.smithi089.stdout:0/336: dread d1/fd [0,4194304] 0 2024-09-13T22:08:39.137 INFO:tasks.workunit.client.0.smithi089.stdout:5/215: rename d4/c10 to d4/d19/d1e/d28/d3d/c59 0 2024-09-13T22:08:39.138 INFO:tasks.workunit.client.0.smithi089.stdout:8/257: mkdir d0/dd/d12/d20/d36/d59/d5d 0 2024-09-13T22:08:39.138 INFO:tasks.workunit.client.0.smithi089.stdout:8/258: readlink d0/dd/d12/d3a/l48 0 2024-09-13T22:08:39.141 INFO:tasks.workunit.client.0.smithi089.stdout:0/337: dread d1/de/f3e [0,4194304] 0 2024-09-13T22:08:39.141 INFO:tasks.workunit.client.0.smithi089.stdout:9/209: mknod d6/d18/c4d 0 2024-09-13T22:08:39.141 INFO:tasks.workunit.client.0.smithi089.stdout:9/210: chown d6/d18/d33/d39/f41 123399881 1 2024-09-13T22:08:39.142 INFO:tasks.workunit.client.0.smithi089.stdout:9/211: creat d6/d18/d21/d48/f4e x:0 0 0 2024-09-13T22:08:39.143 INFO:tasks.workunit.client.0.smithi089.stdout:5/216: unlink d4/d19/d1e/d28/d31/f33 0 2024-09-13T22:08:39.144 INFO:tasks.workunit.client.0.smithi089.stdout:8/259: creat d0/dd/d12/d42/f5e x:0 0 0 2024-09-13T22:08:39.145 INFO:tasks.workunit.client.0.smithi089.stdout:0/338: mkdir d1/de/d15/d41/d49/d76 0 2024-09-13T22:08:39.145 INFO:tasks.workunit.client.0.smithi089.stdout:0/339: chown d1/de/d10/d36/d38/f70 242 1 2024-09-13T22:08:39.145 INFO:tasks.workunit.client.0.smithi089.stdout:0/340: fsync d1/de/d10/f1b 0 2024-09-13T22:08:39.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/341: dread d1/de/f17 [0,4194304] 0 2024-09-13T22:08:39.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/342: dread - d1/de/d10/f5d zero size 2024-09-13T22:08:39.147 INFO:tasks.workunit.client.0.smithi089.stdout:3/230: sync 2024-09-13T22:08:39.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/343: write d1/de/d10/d36/d38/d4e/d62/f74 [342522,78567] 0 2024-09-13T22:08:39.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/344: write d1/de/d10/d36/d38/d4e/d62/d5b/d5e/f6b [1120428,77774] 0 2024-09-13T22:08:39.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/345: getdents d1/de/d56 0 2024-09-13T22:08:39.148 INFO:tasks.workunit.client.0.smithi089.stdout:5/217: creat d4/d19/d1e/d28/d31/d55/f5a x:0 0 0 2024-09-13T22:08:39.149 INFO:tasks.workunit.client.0.smithi089.stdout:2/238: dwrite df/f26 [0,4194304] 0 2024-09-13T22:08:39.149 INFO:tasks.workunit.client.0.smithi089.stdout:2/239: read df/d14/d2b/d2d/f51 [65917,71594] 0 2024-09-13T22:08:39.149 INFO:tasks.workunit.client.0.smithi089.stdout:8/260: mknod d0/dd/d12/d20/d36/d57/c5f 0 2024-09-13T22:08:39.150 INFO:tasks.workunit.client.0.smithi089.stdout:3/231: creat d1/d2/d18/d38/f53 x:0 0 0 2024-09-13T22:08:39.150 INFO:tasks.workunit.client.0.smithi089.stdout:3/232: chown d1/d2/d23 0 1 2024-09-13T22:08:39.152 INFO:tasks.workunit.client.0.smithi089.stdout:7/189: sync 2024-09-13T22:08:39.152 INFO:tasks.workunit.client.0.smithi089.stdout:6/211: sync 2024-09-13T22:08:39.152 INFO:tasks.workunit.client.0.smithi089.stdout:6/212: creat d0/d4/f40 x:0 0 0 2024-09-13T22:08:39.152 INFO:tasks.workunit.client.0.smithi089.stdout:6/213: creat d0/d4/d12/f41 x:0 0 0 2024-09-13T22:08:39.153 INFO:tasks.workunit.client.0.smithi089.stdout:6/214: fdatasync d0/f3e 0 2024-09-13T22:08:39.154 INFO:tasks.workunit.client.0.smithi089.stdout:9/212: dread d6/d18/d1b/f2e [0,4194304] 0 2024-09-13T22:08:39.154 INFO:tasks.workunit.client.0.smithi089.stdout:9/213: dread - d6/d18/d1b/f3f zero size 2024-09-13T22:08:39.154 INFO:tasks.workunit.client.0.smithi089.stdout:3/233: write d1/d7/f15 [961178,80939] 0 2024-09-13T22:08:39.156 INFO:tasks.workunit.client.0.smithi089.stdout:2/240: mknod df/d14/d3f/c55 0 2024-09-13T22:08:39.156 INFO:tasks.workunit.client.0.smithi089.stdout:2/241: fsync df/d14/d2b/d2d/d2e/f37 0 2024-09-13T22:08:39.157 INFO:tasks.workunit.client.0.smithi089.stdout:2/242: chown df/d14/d2b/d2d/d2e/f37 3473312 1 2024-09-13T22:08:39.157 INFO:tasks.workunit.client.0.smithi089.stdout:2/243: chown df/d14/d2b/c2c 41 1 2024-09-13T22:08:39.157 INFO:tasks.workunit.client.0.smithi089.stdout:8/261: dread d0/dd/d12/d20/d32/d3b/f55 [0,4194304] 0 2024-09-13T22:08:39.158 INFO:tasks.workunit.client.0.smithi089.stdout:8/262: stat d0/dd/d12/d3a/f5b 0 2024-09-13T22:08:39.158 INFO:tasks.workunit.client.0.smithi089.stdout:8/263: chown d0/dd/f14 3 1 2024-09-13T22:08:39.158 INFO:tasks.workunit.client.0.smithi089.stdout:8/264: readlink d0/dd/d12/d20/d36/l30 0 2024-09-13T22:08:39.158 INFO:tasks.workunit.client.0.smithi089.stdout:8/265: truncate d0/dd/d12/d20/d32/f44 526448 0 2024-09-13T22:08:39.158 INFO:tasks.workunit.client.0.smithi089.stdout:7/190: creat d0/d19/d2a/f37 x:0 0 0 2024-09-13T22:08:39.160 INFO:tasks.workunit.client.0.smithi089.stdout:9/214: unlink d6/ce 0 2024-09-13T22:08:39.162 INFO:tasks.workunit.client.0.smithi089.stdout:5/218: write d4/d19/f2b [351099,60116] 0 2024-09-13T22:08:39.163 INFO:tasks.workunit.client.0.smithi089.stdout:3/234: mkdir d1/d2/d23/d3d/d54 0 2024-09-13T22:08:39.163 INFO:tasks.workunit.client.0.smithi089.stdout:0/346: dwrite d1/de/f3e [0,4194304] 0 2024-09-13T22:08:39.164 INFO:tasks.workunit.client.0.smithi089.stdout:2/244: symlink df/l56 0 2024-09-13T22:08:39.166 INFO:tasks.workunit.client.0.smithi089.stdout:8/266: truncate d0/dd/f14 1958367 0 2024-09-13T22:08:39.173 INFO:tasks.workunit.client.0.smithi089.stdout:3/235: symlink d1/d2/d23/d2b/l55 0 2024-09-13T22:08:39.173 INFO:tasks.workunit.client.0.smithi089.stdout:3/236: dread - d1/d2/d23/d3d/f4d zero size 2024-09-13T22:08:39.177 INFO:tasks.workunit.client.0.smithi089.stdout:2/245: mkdir df/d1a/d57 0 2024-09-13T22:08:39.177 INFO:tasks.workunit.client.0.smithi089.stdout:2/246: stat df/d14/d2b/d2d/f51 0 2024-09-13T22:08:39.178 INFO:tasks.workunit.client.0.smithi089.stdout:9/215: dread d6/d18/d1b/f26 [0,4194304] 0 2024-09-13T22:08:39.178 INFO:tasks.workunit.client.0.smithi089.stdout:9/216: write d6/d18/f1f [2658202,102581] 0 2024-09-13T22:08:39.178 INFO:tasks.workunit.client.0.smithi089.stdout:8/267: rename d0/dd/fb to d0/dd/d12/d20/d36/d57/f60 0 2024-09-13T22:08:39.179 INFO:tasks.workunit.client.0.smithi089.stdout:5/219: rmdir d4/d19/d1e/d28/d3d 39 2024-09-13T22:08:39.179 INFO:tasks.workunit.client.0.smithi089.stdout:5/220: stat d4/d19/d1e/d28/d31/d35/d46 0 2024-09-13T22:08:39.182 INFO:tasks.workunit.client.0.smithi089.stdout:2/247: rename df/d14/d2b/c2c to df/d14/d2b/c58 0 2024-09-13T22:08:39.183 INFO:tasks.workunit.client.0.smithi089.stdout:9/217: mknod d6/d18/c4f 0 2024-09-13T22:08:39.183 INFO:tasks.workunit.client.0.smithi089.stdout:9/218: creat d6/d18/d33/d39/f50 x:0 0 0 2024-09-13T22:08:39.186 INFO:tasks.workunit.client.0.smithi089.stdout:5/221: unlink d4/d19/d1e/d28/d3d/l4f 0 2024-09-13T22:08:39.186 INFO:tasks.workunit.client.0.smithi089.stdout:5/222: chown d4/f29 21321145 1 2024-09-13T22:08:39.186 INFO:tasks.workunit.client.0.smithi089.stdout:5/223: creat d4/d19/d1e/d28/d31/d55/f5b x:0 0 0 2024-09-13T22:08:39.186 INFO:tasks.workunit.client.0.smithi089.stdout:2/248: truncate df/d14/f21 3503411 0 2024-09-13T22:08:39.188 INFO:tasks.workunit.client.0.smithi089.stdout:5/224: dread d4/f5 [0,4194304] 0 2024-09-13T22:08:39.188 INFO:tasks.workunit.client.0.smithi089.stdout:9/219: truncate d6/f15 1023913 0 2024-09-13T22:08:39.190 INFO:tasks.workunit.client.0.smithi089.stdout:6/215: dwrite d0/d4/d12/f13 [0,4194304] 0 2024-09-13T22:08:39.191 INFO:tasks.workunit.client.0.smithi089.stdout:4/185: sync 2024-09-13T22:08:39.192 INFO:tasks.workunit.client.0.smithi089.stdout:5/225: symlink d4/d19/d1e/d28/l5c 0 2024-09-13T22:08:39.193 INFO:tasks.workunit.client.0.smithi089.stdout:2/249: write df/f26 [4253511,26562] 0 2024-09-13T22:08:39.193 INFO:tasks.workunit.client.0.smithi089.stdout:6/216: write d0/d5/f27 [150347,109195] 0 2024-09-13T22:08:39.193 INFO:tasks.workunit.client.0.smithi089.stdout:2/250: readlink df/d1a/l23 0 2024-09-13T22:08:39.193 INFO:tasks.workunit.client.0.smithi089.stdout:6/217: creat d0/f42 x:0 0 0 2024-09-13T22:08:39.193 INFO:tasks.workunit.client.0.smithi089.stdout:2/251: creat df/d14/d2b/f59 x:0 0 0 2024-09-13T22:08:39.193 INFO:tasks.workunit.client.0.smithi089.stdout:2/252: write df/d14/d2b/f33 [897965,41914] 0 2024-09-13T22:08:39.194 INFO:tasks.workunit.client.0.smithi089.stdout:9/220: link d6/ff d6/f51 0 2024-09-13T22:08:39.195 INFO:tasks.workunit.client.0.smithi089.stdout:2/253: mknod df/d14/d2b/c5a 0 2024-09-13T22:08:39.196 INFO:tasks.workunit.client.0.smithi089.stdout:2/254: chown df/d14/d3f/l54 21045 1 2024-09-13T22:08:39.197 INFO:tasks.workunit.client.0.smithi089.stdout:2/255: mkdir df/d5b 0 2024-09-13T22:08:39.197 INFO:tasks.workunit.client.0.smithi089.stdout:2/256: chown df/d14/d2b/l35 132555467 1 2024-09-13T22:08:39.199 INFO:tasks.workunit.client.0.smithi089.stdout:7/191: dwrite d0/d19/d28/d1d/d23/f31 [0,4194304] 0 2024-09-13T22:08:39.199 INFO:tasks.workunit.client.0.smithi089.stdout:7/192: truncate d0/f22 872612 0 2024-09-13T22:08:39.199 INFO:tasks.workunit.client.0.smithi089.stdout:7/193: chown d0/cc 19857 1 2024-09-13T22:08:39.199 INFO:tasks.workunit.client.0.smithi089.stdout:0/347: dwrite d1/de/d10/d36/d38/d4e/d62/d5b/f67 [0,4194304] 0 2024-09-13T22:08:39.200 INFO:tasks.workunit.client.0.smithi089.stdout:3/237: dwrite d1/d2/f3 [4194304,4194304] 0 2024-09-13T22:08:39.201 INFO:tasks.workunit.client.0.smithi089.stdout:0/348: dread d1/f27 [0,4194304] 0 2024-09-13T22:08:39.217 INFO:tasks.workunit.client.0.smithi089.stdout:7/194: mkdir d0/d19/d28/d1d/d2d/d32/d38 0 2024-09-13T22:08:39.218 INFO:tasks.workunit.client.0.smithi089.stdout:3/238: symlink d1/d7/l56 0 2024-09-13T22:08:39.220 INFO:tasks.workunit.client.0.smithi089.stdout:0/349: rename d1/de/d10/d36/d39/l50 to d1/de/d10/d36/l77 0 2024-09-13T22:08:39.222 INFO:tasks.workunit.client.0.smithi089.stdout:9/221: rmdir d6/d18 39 2024-09-13T22:08:39.224 INFO:tasks.workunit.client.0.smithi089.stdout:9/222: chown d6/f14 58 1 2024-09-13T22:08:39.225 INFO:tasks.workunit.client.0.smithi089.stdout:7/195: write d0/f1e [880051,118374] 0 2024-09-13T22:08:39.225 INFO:tasks.workunit.client.0.smithi089.stdout:8/268: truncate d0/dd/d12/d20/d32/f44 334958 0 2024-09-13T22:08:39.225 INFO:tasks.workunit.client.0.smithi089.stdout:8/269: readlink d0/dd/d12/d20/l24 0 2024-09-13T22:08:39.225 INFO:tasks.workunit.client.0.smithi089.stdout:9/223: dread - d6/d18/d33/d39/f41 zero size 2024-09-13T22:08:39.227 INFO:tasks.workunit.client.0.smithi089.stdout:7/196: creat d0/d19/d28/d1d/d2d/d32/d38/f39 x:0 0 0 2024-09-13T22:08:39.227 INFO:tasks.workunit.client.0.smithi089.stdout:7/197: creat d0/d19/d28/d1d/d2d/d32/d38/f3a x:0 0 0 2024-09-13T22:08:39.227 INFO:tasks.workunit.client.0.smithi089.stdout:7/198: write d0/d19/d28/d1d/f34 [508109,82637] 0 2024-09-13T22:08:39.228 INFO:tasks.workunit.client.0.smithi089.stdout:9/224: getdents d6/d31 0 2024-09-13T22:08:39.228 INFO:tasks.workunit.client.0.smithi089.stdout:9/225: write d6/d18/f32 [1040530,54754] 0 2024-09-13T22:08:39.228 INFO:tasks.workunit.client.0.smithi089.stdout:8/270: dread d0/dd/d12/d20/f18 [0,4194304] 0 2024-09-13T22:08:39.232 INFO:tasks.workunit.client.0.smithi089.stdout:7/199: link d0/d19/d28/d1d/f34 d0/d19/d28/d1d/d30/f3b 0 2024-09-13T22:08:39.233 INFO:tasks.workunit.client.0.smithi089.stdout:7/200: dread - d0/d19/d28/d1d/d2d/d32/d38/f39 zero size 2024-09-13T22:08:39.233 INFO:tasks.workunit.client.0.smithi089.stdout:7/201: unlink d0/c4 0 2024-09-13T22:08:39.233 INFO:tasks.workunit.client.0.smithi089.stdout:7/202: dread - d0/d19/d28/d1d/d2d/d32/d38/f3a zero size 2024-09-13T22:08:39.233 INFO:tasks.workunit.client.0.smithi089.stdout:9/226: dread d6/d18/d1b/f26 [0,4194304] 0 2024-09-13T22:08:39.234 INFO:tasks.workunit.client.0.smithi089.stdout:0/350: dread d1/f55 [0,4194304] 0 2024-09-13T22:08:39.234 INFO:tasks.workunit.client.0.smithi089.stdout:0/351: fsync d1/de/d15/f24 0 2024-09-13T22:08:39.235 INFO:tasks.workunit.client.0.smithi089.stdout:9/227: rename d6/d18/d21/d48 to d6/d18/d33/d52 0 2024-09-13T22:08:39.236 INFO:tasks.workunit.client.0.smithi089.stdout:9/228: readlink d6/d31/l3a 0 2024-09-13T22:08:39.237 INFO:tasks.workunit.client.0.smithi089.stdout:0/352: link d1/fd d1/de/d10/d36/d57/f78 0 2024-09-13T22:08:39.237 INFO:tasks.workunit.client.0.smithi089.stdout:0/353: write d1/de/d10/d36/d3d/f43 [4703721,90952] 0 2024-09-13T22:08:39.239 INFO:tasks.workunit.client.0.smithi089.stdout:9/229: mknod d6/d31/c53 0 2024-09-13T22:08:39.239 INFO:tasks.workunit.client.0.smithi089.stdout:9/230: write d6/f14 [1097013,100474] 0 2024-09-13T22:08:39.240 INFO:tasks.workunit.client.0.smithi089.stdout:0/354: symlink d1/l79 0 2024-09-13T22:08:39.240 INFO:tasks.workunit.client.0.smithi089.stdout:0/355: creat d1/de/d10/f7a x:0 0 0 2024-09-13T22:08:39.242 INFO:tasks.workunit.client.0.smithi089.stdout:0/356: getdents d1/de/d10/d36/d38/d4e/d62/d5f 0 2024-09-13T22:08:39.242 INFO:tasks.workunit.client.0.smithi089.stdout:3/239: dread d1/d2/d4/f12 [0,4194304] 0 2024-09-13T22:08:39.242 INFO:tasks.workunit.client.0.smithi089.stdout:3/240: stat d1/f6 0 2024-09-13T22:08:39.242 INFO:tasks.workunit.client.0.smithi089.stdout:9/231: mkdir d6/d54 0 2024-09-13T22:08:39.250 INFO:tasks.workunit.client.0.smithi089.stdout:7/203: dread d0/d19/d28/d1d/d23/f31 [0,4194304] 0 2024-09-13T22:08:39.262 INFO:tasks.workunit.client.0.smithi089.stdout:3/241: dread d1/d2/d31/f3f [0,4194304] 0 2024-09-13T22:08:39.264 INFO:tasks.workunit.client.0.smithi089.stdout:3/242: symlink d1/d2/d31/l57 0 2024-09-13T22:08:39.264 INFO:tasks.workunit.client.0.smithi089.stdout:9/232: dread d6/d18/d21/f44 [0,4194304] 0 2024-09-13T22:08:39.265 INFO:tasks.workunit.client.0.smithi089.stdout:3/243: link d1/d2/d24/l45 d1/d7/d1b/l58 0 2024-09-13T22:08:39.265 INFO:tasks.workunit.client.0.smithi089.stdout:9/233: getdents d6/d18/d33/d52 0 2024-09-13T22:08:39.266 INFO:tasks.workunit.client.0.smithi089.stdout:9/234: mkdir d6/d55 0 2024-09-13T22:08:39.266 INFO:tasks.workunit.client.0.smithi089.stdout:9/235: chown d6/d18/d33 95 1 2024-09-13T22:08:39.267 INFO:tasks.workunit.client.0.smithi089.stdout:9/236: truncate d6/d18/d33/d39/f4c 838656 0 2024-09-13T22:08:39.267 INFO:tasks.workunit.client.0.smithi089.stdout:9/237: chown d6/d18/d33/d39/f41 2 1 2024-09-13T22:08:39.269 INFO:tasks.workunit.client.0.smithi089.stdout:4/186: dwrite d0/d11/f21 [0,4194304] 0 2024-09-13T22:08:39.269 INFO:tasks.workunit.client.0.smithi089.stdout:6/218: dwrite d0/d4/f2b [0,4194304] 0 2024-09-13T22:08:39.270 INFO:tasks.workunit.client.0.smithi089.stdout:2/257: dwrite df/d14/d2b/f59 [0,4194304] 0 2024-09-13T22:08:39.271 INFO:tasks.workunit.client.0.smithi089.stdout:0/357: dwrite d1/de/d15/d2a/f31 [0,4194304] 0 2024-09-13T22:08:39.271 INFO:tasks.workunit.client.0.smithi089.stdout:8/271: dwrite d0/dd/ff [0,4194304] 0 2024-09-13T22:08:39.274 INFO:tasks.workunit.client.0.smithi089.stdout:4/187: mknod d0/d2c/c38 0 2024-09-13T22:08:39.274 INFO:tasks.workunit.client.0.smithi089.stdout:4/188: dread - d0/d15/d1f/f31 zero size 2024-09-13T22:08:39.274 INFO:tasks.workunit.client.0.smithi089.stdout:9/238: dread d6/f15 [0,4194304] 0 2024-09-13T22:08:39.274 INFO:tasks.workunit.client.0.smithi089.stdout:8/272: dread d0/dd/d11/f25 [0,4194304] 0 2024-09-13T22:08:39.274 INFO:tasks.workunit.client.0.smithi089.stdout:5/226: dwrite f2 [0,4194304] 0 2024-09-13T22:08:39.274 INFO:tasks.workunit.client.0.smithi089.stdout:3/244: dread d1/d7/d1b/d28/f2c [0,4194304] 0 2024-09-13T22:08:39.278 INFO:tasks.workunit.client.0.smithi089.stdout:2/258: mknod df/d14/d2b/d4b/c5c 0 2024-09-13T22:08:39.282 INFO:tasks.workunit.client.0.smithi089.stdout:2/259: dread df/d14/d2b/d2d/d2e/f37 [4194304,4194304] 0 2024-09-13T22:08:39.282 INFO:tasks.workunit.client.0.smithi089.stdout:2/260: readlink df/d14/d3f/l54 0 2024-09-13T22:08:39.282 INFO:tasks.workunit.client.0.smithi089.stdout:3/245: dread d1/d2/d4/f1a [0,4194304] 0 2024-09-13T22:08:39.282 INFO:tasks.workunit.client.0.smithi089.stdout:3/246: creat d1/d7/d1b/f59 x:0 0 0 2024-09-13T22:08:39.283 INFO:tasks.workunit.client.0.smithi089.stdout:0/358: creat d1/de/d15/d41/d49/f7b x:0 0 0 2024-09-13T22:08:39.285 INFO:tasks.workunit.client.0.smithi089.stdout:4/189: unlink d0/d11/c2b 0 2024-09-13T22:08:39.287 INFO:tasks.workunit.client.0.smithi089.stdout:9/239: rename d6/d18/d1b/l2c to d6/d18/d1b/l56 0 2024-09-13T22:08:39.287 INFO:tasks.workunit.client.0.smithi089.stdout:1/278: sync 2024-09-13T22:08:39.287 INFO:tasks.workunit.client.0.smithi089.stdout:1/279: read d7/de/f30 [7033887,50645] 0 2024-09-13T22:08:39.289 INFO:tasks.workunit.client.0.smithi089.stdout:8/273: getdents d0/dd/d12 0 2024-09-13T22:08:39.292 INFO:tasks.workunit.client.0.smithi089.stdout:5/227: rename d4/d19/d1e/d28/d31/d55/f5b to d4/d19/d1e/d28/d3d/f5d 0 2024-09-13T22:08:39.297 INFO:tasks.workunit.client.0.smithi089.stdout:4/190: dread d0/d11/d16/d24/f27 [0,4194304] 0 2024-09-13T22:08:39.297 INFO:tasks.workunit.client.0.smithi089.stdout:4/191: write d0/d11/f30 [1008645,62609] 0 2024-09-13T22:08:39.298 INFO:tasks.workunit.client.0.smithi089.stdout:6/219: dwrite d0/d5/f27 [0,4194304] 0 2024-09-13T22:08:39.298 INFO:tasks.workunit.client.0.smithi089.stdout:6/220: dread - d0/d5/d1d/f33 zero size 2024-09-13T22:08:39.299 INFO:tasks.workunit.client.0.smithi089.stdout:0/359: dread d1/de/f14 [0,4194304] 0 2024-09-13T22:08:39.303 INFO:tasks.workunit.client.0.smithi089.stdout:9/240: write d6/d18/d21/f27 [1610567,40697] 0 2024-09-13T22:08:39.303 INFO:tasks.workunit.client.0.smithi089.stdout:1/280: rmdir d7/d40 39 2024-09-13T22:08:39.303 INFO:tasks.workunit.client.0.smithi089.stdout:1/281: read d7/de/d1b/d2b/f2e [265825,56700] 0 2024-09-13T22:08:39.303 INFO:tasks.workunit.client.0.smithi089.stdout:1/282: read - d7/d34/f28 zero size 2024-09-13T22:08:39.303 INFO:tasks.workunit.client.0.smithi089.stdout:1/283: readlink d7/d34/l5b 0 2024-09-13T22:08:39.303 INFO:tasks.workunit.client.0.smithi089.stdout:8/274: link d0/l51 d0/dd/d12/l61 0 2024-09-13T22:08:39.304 INFO:tasks.workunit.client.0.smithi089.stdout:5/228: mkdir d4/d19/d1e/d28/d3d/d5e 0 2024-09-13T22:08:39.307 INFO:tasks.workunit.client.0.smithi089.stdout:9/241: mknod d6/d18/d1b/d3e/c57 0 2024-09-13T22:08:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/247: dwrite d1/d2/f29 [0,4194304] 0 2024-09-13T22:08:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/248: fsync d1/d7/d1b/f48 0 2024-09-13T22:08:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/249: chown d1 907 1 2024-09-13T22:08:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/250: stat d1/l32 0 2024-09-13T22:08:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/251: dread - d1/d2/d18/d38/f53 zero size 2024-09-13T22:08:39.310 INFO:tasks.workunit.client.0.smithi089.stdout:1/284: creat d7/de/d3a/f6a x:0 0 0 2024-09-13T22:08:39.310 INFO:tasks.workunit.client.0.smithi089.stdout:2/261: dwrite df/d14/d2b/d2d/f51 [4194304,4194304] 0 2024-09-13T22:08:39.311 INFO:tasks.workunit.client.0.smithi089.stdout:6/221: read d0/d5/f7 [2216603,7905] 0 2024-09-13T22:08:39.312 INFO:tasks.workunit.client.0.smithi089.stdout:5/229: creat d4/d19/d1e/d28/d31/d55/d58/f5f x:0 0 0 2024-09-13T22:08:39.312 INFO:tasks.workunit.client.0.smithi089.stdout:5/230: fdatasync d4/d19/d1e/d28/d31/f4d 0 2024-09-13T22:08:39.312 INFO:tasks.workunit.client.0.smithi089.stdout:5/231: stat d4/f1c 0 2024-09-13T22:08:39.313 INFO:tasks.workunit.client.0.smithi089.stdout:5/232: chown d4/d19/d1e/d28/d31/d55/d58/f5f 2346 1 2024-09-13T22:08:39.313 INFO:tasks.workunit.client.0.smithi089.stdout:9/242: rename d6 to d6/d58 22 2024-09-13T22:08:39.313 INFO:tasks.workunit.client.0.smithi089.stdout:9/243: fdatasync d6/f2b 0 2024-09-13T22:08:39.315 INFO:tasks.workunit.client.0.smithi089.stdout:3/252: mkdir d1/d2/d4/d5a 0 2024-09-13T22:08:39.315 INFO:tasks.workunit.client.0.smithi089.stdout:3/253: chown f0 1248436 1 2024-09-13T22:08:39.316 INFO:tasks.workunit.client.0.smithi089.stdout:1/285: symlink d7/d34/d5c/d5d/l6b 0 2024-09-13T22:08:39.319 INFO:tasks.workunit.client.0.smithi089.stdout:2/262: symlink df/d14/d2b/d2d/d2e/l5d 0 2024-09-13T22:08:39.320 INFO:tasks.workunit.client.0.smithi089.stdout:8/275: getdents d0/dd 0 2024-09-13T22:08:39.320 INFO:tasks.workunit.client.0.smithi089.stdout:8/276: fdatasync d0/dd/d11/f2d 0 2024-09-13T22:08:39.320 INFO:tasks.workunit.client.0.smithi089.stdout:6/222: mkdir d0/d5/d43 0 2024-09-13T22:08:39.322 INFO:tasks.workunit.client.0.smithi089.stdout:9/244: creat d6/f59 x:0 0 0 2024-09-13T22:08:39.322 INFO:tasks.workunit.client.0.smithi089.stdout:9/245: stat d6/d18/d1b/f3f 0 2024-09-13T22:08:39.323 INFO:tasks.workunit.client.0.smithi089.stdout:3/254: creat d1/d2/d23/d2b/f5b x:0 0 0 2024-09-13T22:08:39.324 INFO:tasks.workunit.client.0.smithi089.stdout:3/255: chown d1/d2/d18/d38/l39 6004179 1 2024-09-13T22:08:39.324 INFO:tasks.workunit.client.0.smithi089.stdout:4/192: dwrite d0/d11/d16/d24/f27 [0,4194304] 0 2024-09-13T22:08:39.325 INFO:tasks.workunit.client.0.smithi089.stdout:1/286: unlink d7/de/d1b/d2b/f2c 0 2024-09-13T22:08:39.326 INFO:tasks.workunit.client.0.smithi089.stdout:2/263: symlink df/d14/d3f/l5e 0 2024-09-13T22:08:39.326 INFO:tasks.workunit.client.0.smithi089.stdout:2/264: chown df/d14 223856388 1 2024-09-13T22:08:39.328 INFO:tasks.workunit.client.0.smithi089.stdout:6/223: mknod d0/d4/d12/d31/d28/c44 0 2024-09-13T22:08:39.333 INFO:tasks.workunit.client.0.smithi089.stdout:4/193: truncate d0/d11/d16/d24/f36 4676492 0 2024-09-13T22:08:39.334 INFO:tasks.workunit.client.0.smithi089.stdout:1/287: symlink d7/d1c/d3c/l6c 0 2024-09-13T22:08:39.336 INFO:tasks.workunit.client.0.smithi089.stdout:2/265: rename df/d14/d3f/f53 to df/d5b/f5f 0 2024-09-13T22:08:39.337 INFO:tasks.workunit.client.0.smithi089.stdout:9/246: dwrite f0 [0,4194304] 0 2024-09-13T22:08:39.337 INFO:tasks.workunit.client.0.smithi089.stdout:9/247: chown d6/d18/d33/d39/f50 151 1 2024-09-13T22:08:39.337 INFO:tasks.workunit.client.0.smithi089.stdout:8/277: unlink d0/dd/d12/c54 0 2024-09-13T22:08:39.339 INFO:tasks.workunit.client.0.smithi089.stdout:6/224: link d0/d4/d12/d31/c18 d0/d5/d1d/c45 0 2024-09-13T22:08:39.339 INFO:tasks.workunit.client.0.smithi089.stdout:6/225: fsync d0/d4/d12/d31/f3f 0 2024-09-13T22:08:39.340 INFO:tasks.workunit.client.0.smithi089.stdout:4/194: mknod d0/d11/d16/c39 0 2024-09-13T22:08:39.342 INFO:tasks.workunit.client.0.smithi089.stdout:9/248: mkdir d6/d18/d33/d5a 0 2024-09-13T22:08:39.347 INFO:tasks.workunit.client.0.smithi089.stdout:9/249: symlink d6/d31/l5b 0 2024-09-13T22:08:39.348 INFO:tasks.workunit.client.0.smithi089.stdout:9/250: chown d6/d18/f47 56896 1 2024-09-13T22:08:39.348 INFO:tasks.workunit.client.0.smithi089.stdout:9/251: chown d6/d18/f47 480997910 1 2024-09-13T22:08:39.348 INFO:tasks.workunit.client.0.smithi089.stdout:5/233: rmdir d4/d19/d1e/d28/d31/d55 39 2024-09-13T22:08:39.348 INFO:tasks.workunit.client.0.smithi089.stdout:5/234: dread - d4/d19/d1e/d28/d31/f4d zero size 2024-09-13T22:08:39.349 INFO:tasks.workunit.client.0.smithi089.stdout:4/195: rmdir d0/d11/d16/d24 39 2024-09-13T22:08:39.351 INFO:tasks.workunit.client.0.smithi089.stdout:5/235: symlink d4/d19/d1e/d53/l60 0 2024-09-13T22:08:39.352 INFO:tasks.workunit.client.0.smithi089.stdout:4/196: mknod d0/c3a 0 2024-09-13T22:08:39.352 INFO:tasks.workunit.client.0.smithi089.stdout:4/197: write d0/f13 [2490281,70037] 0 2024-09-13T22:08:39.354 INFO:tasks.workunit.client.0.smithi089.stdout:4/198: mknod d0/d11/c3b 0 2024-09-13T22:08:39.354 INFO:tasks.workunit.client.0.smithi089.stdout:4/199: chown d0/f8 3410383 1 2024-09-13T22:08:39.354 INFO:tasks.workunit.client.0.smithi089.stdout:4/200: chown d0/d11/f30 26843562 1 2024-09-13T22:08:39.362 INFO:tasks.workunit.client.0.smithi089.stdout:7/204: sync 2024-09-13T22:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:5/236: dread d4/f29 [0,4194304] 0 2024-09-13T22:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:5/237: write d4/d19/d1e/d28/d31/d35/d46/f4e [975694,109469] 0 2024-09-13T22:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:5/238: mkdir d4/d19/d1e/d28/d31/d61 0 2024-09-13T22:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:5/239: write d4/d19/f56 [587727,105113] 0 2024-09-13T22:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:5/240: write d4/d19/f24 [4687219,105388] 0 2024-09-13T22:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:5/241: dread - d4/d19/d1e/d28/d31/d55/f5a zero size 2024-09-13T22:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:2/266: dwrite df/d14/d3f/f49 [4194304,4194304] 0 2024-09-13T22:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:7/205: write d0/d19/f2b [680215,91813] 0 2024-09-13T22:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:7/206: rename d0/d19/d2a to d0/d19/d28/d1d/d2d/d3c 0 2024-09-13T22:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:7/207: mkdir d0/d19/d28/d1d/d3d 0 2024-09-13T22:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:7/208: mknod d0/c3e 0 2024-09-13T22:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:7/209: dread - d0/d19/d28/d1d/d23/f35 zero size 2024-09-13T22:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:7/210: creat d0/f3f x:0 0 0 2024-09-13T22:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:7/211: mknod d0/d19/d28/d1d/d23/d2e/c40 0 2024-09-13T22:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:7/212: write d0/d19/d28/d1d/d23/d24/f29 [128262,123366] 0 2024-09-13T22:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:7/213: write d0/fd [4464811,105165] 0 2024-09-13T22:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:7/214: mkdir d0/d19/d28/d1d/d23/d2e/d41 0 2024-09-13T22:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:7/215: creat d0/d19/d28/d1d/d23/d24/f42 x:0 0 0 2024-09-13T22:08:39.378 INFO:tasks.workunit.client.0.smithi089.stdout:7/216: creat d0/d19/d28/d1d/d3d/f43 x:0 0 0 2024-09-13T22:08:39.378 INFO:tasks.workunit.client.0.smithi089.stdout:7/217: chown d0/cc 457779800 1 2024-09-13T22:08:39.379 INFO:tasks.workunit.client.0.smithi089.stdout:7/218: rename d0/d19/d28/d1d/d23/f31 to d0/d19/d28/f44 0 2024-09-13T22:08:39.387 INFO:tasks.workunit.client.0.smithi089.stdout:7/219: dread d0/f1e [0,4194304] 0 2024-09-13T22:08:39.387 INFO:tasks.workunit.client.0.smithi089.stdout:7/220: write d0/f1e [3799141,51854] 0 2024-09-13T22:08:39.389 INFO:tasks.workunit.client.0.smithi089.stdout:2/267: dread df/d14/d2b/d2d/f51 [4194304,4194304] 0 2024-09-13T22:08:39.390 INFO:tasks.workunit.client.0.smithi089.stdout:7/221: rename d0/d19/d28/d1d/d2d/d32 to d0/d19/d45 0 2024-09-13T22:08:39.391 INFO:tasks.workunit.client.0.smithi089.stdout:2/268: getdents df/d14/d2b/d2d 0 2024-09-13T22:08:39.392 INFO:tasks.workunit.client.0.smithi089.stdout:2/269: mknod df/d1a/c60 0 2024-09-13T22:08:39.392 INFO:tasks.workunit.client.0.smithi089.stdout:2/270: fsync df/d14/d2b/d2d/d2e/f3c 0 2024-09-13T22:08:39.393 INFO:tasks.workunit.client.0.smithi089.stdout:8/278: dwrite d0/dd/ff [0,4194304] 0 2024-09-13T22:08:39.393 INFO:tasks.workunit.client.0.smithi089.stdout:6/226: dwrite d0/d5/f7 [4194304,4194304] 0 2024-09-13T22:08:39.393 INFO:tasks.workunit.client.0.smithi089.stdout:9/252: dwrite d6/f59 [0,4194304] 0 2024-09-13T22:08:39.394 INFO:tasks.workunit.client.0.smithi089.stdout:1/288: dwrite d7/f26 [0,4194304] 0 2024-09-13T22:08:39.408 INFO:tasks.workunit.client.0.smithi089.stdout:5/242: getdents d4/d19/d1e/d28/d31 0 2024-09-13T22:08:39.411 INFO:tasks.workunit.client.0.smithi089.stdout:1/289: mknod d7/de/d1b/c6d 0 2024-09-13T22:08:39.414 INFO:tasks.workunit.client.0.smithi089.stdout:8/279: truncate d0/dd/d12/d20/f18 2569155 0 2024-09-13T22:08:39.414 INFO:tasks.workunit.client.0.smithi089.stdout:8/280: chown d0/dd/f46 83115405 1 2024-09-13T22:08:39.417 INFO:tasks.workunit.client.0.smithi089.stdout:2/271: rename df/d14/d3f to df/d14/d2b/d61 0 2024-09-13T22:08:39.419 INFO:tasks.workunit.client.0.smithi089.stdout:8/281: mknod d0/dd/d12/d20/d1c/c62 0 2024-09-13T22:08:39.419 INFO:tasks.workunit.client.0.smithi089.stdout:8/282: chown d0/dd/d12/d20/d36/l4c 10075 1 2024-09-13T22:08:39.421 INFO:tasks.workunit.client.0.smithi089.stdout:7/222: dwrite d0/d19/d45/d38/f3a [0,4194304] 0 2024-09-13T22:08:39.421 INFO:tasks.workunit.client.0.smithi089.stdout:6/227: dwrite d0/d5/f23 [0,4194304] 0 2024-09-13T22:08:39.421 INFO:tasks.workunit.client.0.smithi089.stdout:6/228: chown d0/d4/d12/l25 488 1 2024-09-13T22:08:39.421 INFO:tasks.workunit.client.0.smithi089.stdout:6/229: write d0/d4/d12/d31/f2a [376051,118530] 0 2024-09-13T22:08:39.421 INFO:tasks.workunit.client.0.smithi089.stdout:1/290: getdents d7/d34/d5c/d5d 0 2024-09-13T22:08:39.422 INFO:tasks.workunit.client.0.smithi089.stdout:8/283: mkdir d0/dd/d12/d20/d1c/d5a/d63 0 2024-09-13T22:08:39.427 INFO:tasks.workunit.client.0.smithi089.stdout:7/223: symlink d0/d19/d28/d1d/d3d/l46 0 2024-09-13T22:08:39.428 INFO:tasks.workunit.client.0.smithi089.stdout:7/224: dread d0/f22 [0,4194304] 0 2024-09-13T22:08:39.429 INFO:tasks.workunit.client.0.smithi089.stdout:6/230: creat d0/d5/d43/f46 x:0 0 0 2024-09-13T22:08:39.429 INFO:tasks.workunit.client.0.smithi089.stdout:6/231: write d0/d5/f7 [463151,80950] 0 2024-09-13T22:08:39.429 INFO:tasks.workunit.client.0.smithi089.stdout:6/232: chown d0/d4/d12/d31/c18 39446 1 2024-09-13T22:08:39.429 INFO:tasks.workunit.client.0.smithi089.stdout:7/225: fdatasync d0/f1e 0 2024-09-13T22:08:39.430 INFO:tasks.workunit.client.0.smithi089.stdout:5/243: dwrite d4/d19/d1e/d28/d31/d55/f5a [0,4194304] 0 2024-09-13T22:08:39.431 INFO:tasks.workunit.client.0.smithi089.stdout:9/253: rename d6/d18/d1b/f3f to d6/f5c 0 2024-09-13T22:08:39.432 INFO:tasks.workunit.client.0.smithi089.stdout:9/254: read - d6/d18/d33/f42 zero size 2024-09-13T22:08:39.433 INFO:tasks.workunit.client.0.smithi089.stdout:4/201: truncate d0/f23 1140507 0 2024-09-13T22:08:39.433 INFO:tasks.workunit.client.0.smithi089.stdout:4/202: chown d0/d11/f18 139583 1 2024-09-13T22:08:39.437 INFO:tasks.workunit.client.0.smithi089.stdout:4/203: chown d0/f1a 0 1 2024-09-13T22:08:39.438 INFO:tasks.workunit.client.0.smithi089.stdout:8/284: dread d0/dd/d12/d20/d1c/f2f [0,4194304] 0 2024-09-13T22:08:39.438 INFO:tasks.workunit.client.0.smithi089.stdout:7/226: symlink d0/d19/d45/d38/l47 0 2024-09-13T22:08:39.438 INFO:tasks.workunit.client.0.smithi089.stdout:7/227: chown d0/d19/d28/f44 846557 1 2024-09-13T22:08:39.440 INFO:tasks.workunit.client.0.smithi089.stdout:5/244: link d4/d19/d1e/d28/f51 d4/d19/d1e/f62 0 2024-09-13T22:08:39.441 INFO:tasks.workunit.client.0.smithi089.stdout:6/233: write d0/d5/f23 [1782606,19863] 0 2024-09-13T22:08:39.442 INFO:tasks.workunit.client.0.smithi089.stdout:1/291: getdents d7/de/d3a 0 2024-09-13T22:08:39.442 INFO:tasks.workunit.client.0.smithi089.stdout:6/234: write d0/d5/f21 [74035,68260] 0 2024-09-13T22:08:39.444 INFO:tasks.workunit.client.0.smithi089.stdout:6/235: dread d0/d4/d12/f13 [8388608,4194304] 0 2024-09-13T22:08:39.444 INFO:tasks.workunit.client.0.smithi089.stdout:6/236: creat d0/d4/d12/d31/f47 x:0 0 0 2024-09-13T22:08:39.446 INFO:tasks.workunit.client.0.smithi089.stdout:9/255: mkdir d6/d18/d21/d5d 0 2024-09-13T22:08:39.447 INFO:tasks.workunit.client.0.smithi089.stdout:4/204: symlink d0/d11/l3c 0 2024-09-13T22:08:39.447 INFO:tasks.workunit.client.0.smithi089.stdout:4/205: creat d0/d11/f3d x:0 0 0 2024-09-13T22:08:39.447 INFO:tasks.workunit.client.0.smithi089.stdout:4/206: stat d0/d2c/c38 0 2024-09-13T22:08:39.449 INFO:tasks.workunit.client.0.smithi089.stdout:5/245: mknod d4/d19/d1e/d53/c63 0 2024-09-13T22:08:39.452 INFO:tasks.workunit.client.0.smithi089.stdout:8/285: dread d0/dd/d12/d3a/f43 [0,4194304] 0 2024-09-13T22:08:39.453 INFO:tasks.workunit.client.0.smithi089.stdout:9/256: mkdir d6/d31/d5e 0 2024-09-13T22:08:39.454 INFO:tasks.workunit.client.0.smithi089.stdout:4/207: getdents d0/d2c 0 2024-09-13T22:08:39.455 INFO:tasks.workunit.client.0.smithi089.stdout:4/208: chown d0/d11/l3c 2575 1 2024-09-13T22:08:39.457 INFO:tasks.workunit.client.0.smithi089.stdout:0/360: sync 2024-09-13T22:08:39.457 INFO:tasks.workunit.client.0.smithi089.stdout:3/256: sync 2024-09-13T22:08:39.459 INFO:tasks.workunit.client.0.smithi089.stdout:6/237: dread d0/d4/f2b [0,4194304] 0 2024-09-13T22:08:39.460 INFO:tasks.workunit.client.0.smithi089.stdout:7/228: dwrite d0/f3f [0,4194304] 0 2024-09-13T22:08:39.463 INFO:tasks.workunit.client.0.smithi089.stdout:7/229: symlink d0/d19/d28/d1d/d3d/l48 0 2024-09-13T22:08:39.465 INFO:tasks.workunit.client.0.smithi089.stdout:7/230: creat d0/d19/d45/d38/f49 x:0 0 0 2024-09-13T22:08:39.470 INFO:tasks.workunit.client.0.smithi089.stdout:6/238: dread d0/d4/d12/f20 [0,4194304] 0 2024-09-13T22:08:39.470 INFO:tasks.workunit.client.0.smithi089.stdout:6/239: readlink d0/d5/l29 0 2024-09-13T22:08:39.470 INFO:tasks.workunit.client.0.smithi089.stdout:6/240: creat d0/f48 x:0 0 0 2024-09-13T22:08:39.476 INFO:tasks.workunit.client.0.smithi089.stdout:3/257: dread d1/f13 [0,4194304] 0 2024-09-13T22:08:39.476 INFO:tasks.workunit.client.0.smithi089.stdout:5/246: dwrite d4/d19/f1f [0,4194304] 0 2024-09-13T22:08:39.476 INFO:tasks.workunit.client.0.smithi089.stdout:5/247: fdatasync d4/d19/f3c 0 2024-09-13T22:08:39.477 INFO:tasks.workunit.client.0.smithi089.stdout:3/258: mkdir d1/d7/d5c 0 2024-09-13T22:08:39.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/259: truncate d1/d2/d4/f9 35392 0 2024-09-13T22:08:39.480 INFO:tasks.workunit.client.0.smithi089.stdout:3/260: stat d1/d3a 0 2024-09-13T22:08:39.480 INFO:tasks.workunit.client.0.smithi089.stdout:3/261: write f0 [1077164,5817] 0 2024-09-13T22:08:39.489 INFO:tasks.workunit.client.0.smithi089.stdout:3/262: dread d1/d2/f29 [0,4194304] 0 2024-09-13T22:08:39.489 INFO:tasks.workunit.client.0.smithi089.stdout:3/263: fdatasync d1/f13 0 2024-09-13T22:08:39.490 INFO:tasks.workunit.client.0.smithi089.stdout:3/264: getdents d1 0 2024-09-13T22:08:39.491 INFO:tasks.workunit.client.0.smithi089.stdout:3/265: mkdir d1/d2/d23/d3d/d54/d5d 0 2024-09-13T22:08:39.491 INFO:tasks.workunit.client.0.smithi089.stdout:3/266: dread - d1/d7/d1b/f59 zero size 2024-09-13T22:08:39.491 INFO:tasks.workunit.client.0.smithi089.stdout:3/267: getdents d1/d2 0 2024-09-13T22:08:39.493 INFO:tasks.workunit.client.0.smithi089.stdout:8/286: dwrite d0/dd/d12/d20/d32/f41 [0,4194304] 0 2024-09-13T22:08:39.494 INFO:tasks.workunit.client.0.smithi089.stdout:5/248: dread d4/f1c [0,4194304] 0 2024-09-13T22:08:39.503 INFO:tasks.workunit.client.0.smithi089.stdout:9/257: dwrite d6/f14 [0,4194304] 0 2024-09-13T22:08:39.506 INFO:tasks.workunit.client.0.smithi089.stdout:9/258: rename d6/d18/d21/l3c to d6/d18/d1b/l5f 0 2024-09-13T22:08:39.506 INFO:tasks.workunit.client.0.smithi089.stdout:9/259: fdatasync d6/f51 0 2024-09-13T22:08:39.507 INFO:tasks.workunit.client.0.smithi089.stdout:9/260: mknod d6/d31/c60 0 2024-09-13T22:08:39.508 INFO:tasks.workunit.client.0.smithi089.stdout:9/261: link d6/d18/c4f d6/d18/c61 0 2024-09-13T22:08:39.513 INFO:tasks.workunit.client.0.smithi089.stdout:4/209: dwrite d0/f13 [0,4194304] 0 2024-09-13T22:08:39.513 INFO:tasks.workunit.client.0.smithi089.stdout:4/210: chown d0/d11/d16/c39 1536841 1 2024-09-13T22:08:39.516 INFO:tasks.workunit.client.0.smithi089.stdout:4/211: creat d0/f3e x:0 0 0 2024-09-13T22:08:39.516 INFO:tasks.workunit.client.0.smithi089.stdout:9/262: dread d6/f51 [0,4194304] 0 2024-09-13T22:08:39.520 INFO:tasks.workunit.client.0.smithi089.stdout:6/241: dwrite d0/d4/d12/d15/f32 [0,4194304] 0 2024-09-13T22:08:39.520 INFO:tasks.workunit.client.0.smithi089.stdout:0/361: dwrite d1/de/d10/f1b [0,4194304] 0 2024-09-13T22:08:39.521 INFO:tasks.workunit.client.0.smithi089.stdout:0/362: truncate d1/f27 989743 0 2024-09-13T22:08:39.521 INFO:tasks.workunit.client.0.smithi089.stdout:0/363: dread - d1/de/f20 zero size 2024-09-13T22:08:39.521 INFO:tasks.workunit.client.0.smithi089.stdout:4/212: link d0/d2c/l33 d0/d15/d1f/l3f 0 2024-09-13T22:08:39.521 INFO:tasks.workunit.client.0.smithi089.stdout:4/213: dread - d0/d15/f2e zero size 2024-09-13T22:08:39.521 INFO:tasks.workunit.client.0.smithi089.stdout:7/231: dwrite d0/f14 [0,4194304] 0 2024-09-13T22:08:39.522 INFO:tasks.workunit.client.0.smithi089.stdout:3/268: dwrite d1/d2/d24/f3b [0,4194304] 0 2024-09-13T22:08:39.522 INFO:tasks.workunit.client.0.smithi089.stdout:3/269: chown d1/d2/d4/cd 6 1 2024-09-13T22:08:39.522 INFO:tasks.workunit.client.0.smithi089.stdout:9/263: rmdir d6/d18/d21 39 2024-09-13T22:08:39.524 INFO:tasks.workunit.client.0.smithi089.stdout:8/287: dwrite d0/dd/d12/d20/d32/f44 [0,4194304] 0 2024-09-13T22:08:39.524 INFO:tasks.workunit.client.0.smithi089.stdout:5/249: dwrite d4/f29 [0,4194304] 0 2024-09-13T22:08:39.526 INFO:tasks.workunit.client.0.smithi089.stdout:0/364: rename d1/f27 to d1/de/d10/d36/d38/d4e/d62/d5f/f7c 0 2024-09-13T22:08:39.528 INFO:tasks.workunit.client.0.smithi089.stdout:7/232: mkdir d0/d19/d28/d1d/d4a 0 2024-09-13T22:08:39.530 INFO:tasks.workunit.client.0.smithi089.stdout:3/270: creat d1/d2/d4/f5e x:0 0 0 2024-09-13T22:08:39.531 INFO:tasks.workunit.client.0.smithi089.stdout:3/271: write d1/d2/f29 [5096901,65191] 0 2024-09-13T22:08:39.531 INFO:tasks.workunit.client.0.smithi089.stdout:3/272: write d1/d7/d1b/d28/f2c [4167025,111776] 0 2024-09-13T22:08:39.531 INFO:tasks.workunit.client.0.smithi089.stdout:3/273: dread - d1/d2/d23/d2b/f5b zero size 2024-09-13T22:08:39.532 INFO:tasks.workunit.client.0.smithi089.stdout:9/264: creat d6/d18/d21/f62 x:0 0 0 2024-09-13T22:08:39.532 INFO:tasks.workunit.client.0.smithi089.stdout:9/265: dread - d6/d18/d1b/d3e/f46 zero size 2024-09-13T22:08:39.535 INFO:tasks.workunit.client.0.smithi089.stdout:8/288: symlink d0/dd/d12/d20/d36/d57/l64 0 2024-09-13T22:08:39.536 INFO:tasks.workunit.client.0.smithi089.stdout:8/289: chown d0/dd/c52 1 1 2024-09-13T22:08:39.536 INFO:tasks.workunit.client.0.smithi089.stdout:8/290: chown d0/dd/d12/d20/f18 15 1 2024-09-13T22:08:39.537 INFO:tasks.workunit.client.0.smithi089.stdout:6/242: getdents d0/d5/d43 0 2024-09-13T22:08:39.537 INFO:tasks.workunit.client.0.smithi089.stdout:5/250: dread d4/f27 [0,4194304] 0 2024-09-13T22:08:39.541 INFO:tasks.workunit.client.0.smithi089.stdout:9/266: dread d6/f59 [0,4194304] 0 2024-09-13T22:08:39.541 INFO:tasks.workunit.client.0.smithi089.stdout:7/233: symlink d0/d19/d28/d1d/d23/d2e/d41/l4b 0 2024-09-13T22:08:39.545 INFO:tasks.workunit.client.0.smithi089.stdout:8/291: truncate d0/dd/d12/d20/d36/f21 3998537 0 2024-09-13T22:08:39.547 INFO:tasks.workunit.client.0.smithi089.stdout:6/243: mknod d0/d4/d12/c49 0 2024-09-13T22:08:39.547 INFO:tasks.workunit.client.0.smithi089.stdout:9/267: symlink d6/d18/d33/d52/l63 0 2024-09-13T22:08:39.548 INFO:tasks.workunit.client.0.smithi089.stdout:7/234: symlink d0/d19/d45/l4c 0 2024-09-13T22:08:39.549 INFO:tasks.workunit.client.0.smithi089.stdout:8/292: mknod d0/dd/d12/d20/d40/c65 0 2024-09-13T22:08:39.550 INFO:tasks.workunit.client.0.smithi089.stdout:6/244: mkdir d0/d4/d12/d31/d4a 0 2024-09-13T22:08:39.550 INFO:tasks.workunit.client.0.smithi089.stdout:6/245: read - d0/d4/d12/d31/f47 zero size 2024-09-13T22:08:39.550 INFO:tasks.workunit.client.0.smithi089.stdout:9/268: mkdir d6/d31/d64 0 2024-09-13T22:08:39.551 INFO:tasks.workunit.client.0.smithi089.stdout:9/269: truncate d6/d18/d33/d52/f4b 520830 0 2024-09-13T22:08:39.551 INFO:tasks.workunit.client.0.smithi089.stdout:2/272: sync 2024-09-13T22:08:39.551 INFO:tasks.workunit.client.0.smithi089.stdout:7/235: creat d0/d19/d28/d1d/d23/d2e/d41/f4d x:0 0 0 2024-09-13T22:08:39.552 INFO:tasks.workunit.client.0.smithi089.stdout:8/293: creat d0/dd/d12/d20/d1c/d5a/d63/f66 x:0 0 0 2024-09-13T22:08:39.553 INFO:tasks.workunit.client.0.smithi089.stdout:6/246: mkdir d0/d4/d12/d31/d4b 0 2024-09-13T22:08:39.553 INFO:tasks.workunit.client.0.smithi089.stdout:2/273: rmdir df/d14/d2b/d2d 39 2024-09-13T22:08:39.554 INFO:tasks.workunit.client.0.smithi089.stdout:7/236: unlink d0/c6 0 2024-09-13T22:08:39.554 INFO:tasks.workunit.client.0.smithi089.stdout:7/237: truncate d0/d19/d28/f1c 946020 0 2024-09-13T22:08:39.554 INFO:tasks.workunit.client.0.smithi089.stdout:7/238: readlink d0/l10 0 2024-09-13T22:08:39.556 INFO:tasks.workunit.client.0.smithi089.stdout:7/239: creat d0/d19/d28/d1d/d2d/d3c/f4e x:0 0 0 2024-09-13T22:08:39.558 INFO:tasks.workunit.client.0.smithi089.stdout:9/270: write d6/d18/f36 [931632,13107] 0 2024-09-13T22:08:39.558 INFO:tasks.workunit.client.0.smithi089.stdout:6/247: getdents d0/d4/d12 0 2024-09-13T22:08:39.558 INFO:tasks.workunit.client.0.smithi089.stdout:6/248: chown d0/d4/d12/l25 26639562 1 2024-09-13T22:08:39.559 INFO:tasks.workunit.client.0.smithi089.stdout:9/271: symlink d6/d18/d1b/l65 0 2024-09-13T22:08:39.561 INFO:tasks.workunit.client.0.smithi089.stdout:9/272: symlink d6/d55/l66 0 2024-09-13T22:08:39.561 INFO:tasks.workunit.client.0.smithi089.stdout:9/273: getdents d6/d54 0 2024-09-13T22:08:39.564 INFO:tasks.workunit.client.0.smithi089.stdout:2/274: write df/d14/f25 [4858494,120601] 0 2024-09-13T22:08:39.566 INFO:tasks.workunit.client.0.smithi089.stdout:2/275: getdents df/d14 0 2024-09-13T22:08:39.566 INFO:tasks.workunit.client.0.smithi089.stdout:2/276: chown df/d14/f21 824174 1 2024-09-13T22:08:39.575 INFO:tasks.workunit.client.0.smithi089.stdout:5/251: dwrite d4/d19/d1e/d28/d31/d35/f47 [0,4194304] 0 2024-09-13T22:08:39.576 INFO:tasks.workunit.client.0.smithi089.stdout:2/277: write df/f26 [2098368,86305] 0 2024-09-13T22:08:39.577 INFO:tasks.workunit.client.0.smithi089.stdout:2/278: stat df/d14/d2b/d4b/c50 0 2024-09-13T22:08:39.577 INFO:tasks.workunit.client.0.smithi089.stdout:2/279: getdents df/d1a/d57 0 2024-09-13T22:08:39.578 INFO:tasks.workunit.client.0.smithi089.stdout:7/240: dwrite d0/ff [0,4194304] 0 2024-09-13T22:08:39.578 INFO:tasks.workunit.client.0.smithi089.stdout:7/241: write d0/f3f [4920935,58231] 0 2024-09-13T22:08:39.579 INFO:tasks.workunit.client.0.smithi089.stdout:5/252: creat d4/d19/d1e/d28/d3d/d5e/f64 x:0 0 0 2024-09-13T22:08:39.579 INFO:tasks.workunit.client.0.smithi089.stdout:5/253: dread - d4/d19/d1e/d28/d31/f37 zero size 2024-09-13T22:08:39.579 INFO:tasks.workunit.client.0.smithi089.stdout:5/254: readlink d4/d19/d1e/d53/l60 0 2024-09-13T22:08:39.579 INFO:tasks.workunit.client.0.smithi089.stdout:5/255: dread - d4/d19/d1e/d28/d3d/d5e/f64 zero size 2024-09-13T22:08:39.579 INFO:tasks.workunit.client.0.smithi089.stdout:5/256: truncate d4/d19/d1e/f62 689991 0 2024-09-13T22:08:39.579 INFO:tasks.workunit.client.0.smithi089.stdout:2/280: link df/d14/d2b/c5a df/d5b/c62 0 2024-09-13T22:08:39.579 INFO:tasks.workunit.client.0.smithi089.stdout:2/281: write df/d14/d2b/d2d/f44 [440887,125528] 0 2024-09-13T22:08:39.579 INFO:tasks.workunit.client.0.smithi089.stdout:2/282: readlink df/d14/d2b/d2d/d2e/l5d 0 2024-09-13T22:08:39.581 INFO:tasks.workunit.client.0.smithi089.stdout:7/242: link d0/d19/d28/d1d/d23/d24/l36 d0/d19/d28/d1d/d3d/l4f 0 2024-09-13T22:08:39.581 INFO:tasks.workunit.client.0.smithi089.stdout:7/243: dread - d0/d19/d28/d1d/d2d/d3c/f4e zero size 2024-09-13T22:08:39.581 INFO:tasks.workunit.client.0.smithi089.stdout:9/274: dwrite d6/ff [0,4194304] 0 2024-09-13T22:08:39.583 INFO:tasks.workunit.client.0.smithi089.stdout:2/283: rename fb to df/d14/d2b/f63 0 2024-09-13T22:08:39.583 INFO:tasks.workunit.client.0.smithi089.stdout:2/284: fsync df/f22 0 2024-09-13T22:08:39.583 INFO:tasks.workunit.client.0.smithi089.stdout:7/244: symlink d0/d19/d28/d1d/d3d/l50 0 2024-09-13T22:08:39.584 INFO:tasks.workunit.client.0.smithi089.stdout:7/245: fdatasync d0/d19/d45/d38/f3a 0 2024-09-13T22:08:39.586 INFO:tasks.workunit.client.0.smithi089.stdout:9/275: rename d6/d18/d33/l43 to d6/d54/l67 0 2024-09-13T22:08:39.586 INFO:tasks.workunit.client.0.smithi089.stdout:9/276: truncate d6/d18/d33/d39/f50 732399 0 2024-09-13T22:08:39.588 INFO:tasks.workunit.client.0.smithi089.stdout:7/246: creat d0/d19/d45/f51 x:0 0 0 2024-09-13T22:08:39.588 INFO:tasks.workunit.client.0.smithi089.stdout:2/285: write df/f12 [2827312,97720] 0 2024-09-13T22:08:39.588 INFO:tasks.workunit.client.0.smithi089.stdout:7/247: write d0/d19/d28/d1d/d30/f3b [629121,73022] 0 2024-09-13T22:08:39.590 INFO:tasks.workunit.client.0.smithi089.stdout:9/277: truncate d6/d18/f1f 2334428 0 2024-09-13T22:08:39.592 INFO:tasks.workunit.client.0.smithi089.stdout:9/278: mknod d6/c68 0 2024-09-13T22:08:39.592 INFO:tasks.workunit.client.0.smithi089.stdout:9/279: dread - d6/d18/d33/d52/f4e zero size 2024-09-13T22:08:39.593 INFO:tasks.workunit.client.0.smithi089.stdout:7/248: dread d0/d19/d28/d1d/d30/f3b [0,4194304] 0 2024-09-13T22:08:39.593 INFO:tasks.workunit.client.0.smithi089.stdout:7/249: chown d0/d19/c26 1434 1 2024-09-13T22:08:39.593 INFO:tasks.workunit.client.0.smithi089.stdout:9/280: creat d6/d18/d33/d39/f69 x:0 0 0 2024-09-13T22:08:39.595 INFO:tasks.workunit.client.0.smithi089.stdout:7/250: symlink d0/d19/d28/d1d/d4a/l52 0 2024-09-13T22:08:39.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/281: creat d6/d55/f6a x:0 0 0 2024-09-13T22:08:39.599 INFO:tasks.workunit.client.0.smithi089.stdout:9/282: symlink d6/d31/l6b 0 2024-09-13T22:08:39.599 INFO:tasks.workunit.client.0.smithi089.stdout:9/283: stat d6/d18/d21/d5d 0 2024-09-13T22:08:39.600 INFO:tasks.workunit.client.0.smithi089.stdout:9/284: mkdir d6/d18/d21/d5d/d6c 0 2024-09-13T22:08:39.600 INFO:tasks.workunit.client.0.smithi089.stdout:9/285: fsync d6/d18/d21/f62 0 2024-09-13T22:08:39.600 INFO:tasks.workunit.client.0.smithi089.stdout:9/286: chown d6/f15 553857820 1 2024-09-13T22:08:39.601 INFO:tasks.workunit.client.0.smithi089.stdout:9/287: rename d6/fa to d6/d55/f6d 0 2024-09-13T22:08:39.605 INFO:tasks.workunit.client.0.smithi089.stdout:7/251: write d0/f3f [3443516,3527] 0 2024-09-13T22:08:39.606 INFO:tasks.workunit.client.0.smithi089.stdout:2/286: dwrite df/f26 [0,4194304] 0 2024-09-13T22:08:39.612 INFO:tasks.workunit.client.0.smithi089.stdout:9/288: write d6/d18/f47 [531811,45486] 0 2024-09-13T22:08:39.612 INFO:tasks.workunit.client.0.smithi089.stdout:9/289: write d6/d18/d33/d39/f50 [1689029,102383] 0 2024-09-13T22:08:39.622 INFO:tasks.workunit.client.0.smithi089.stdout:7/252: dwrite d0/d19/d28/f1c [0,4194304] 0 2024-09-13T22:08:39.630 INFO:tasks.workunit.client.0.smithi089.stdout:7/253: write d0/d19/d28/d1d/f2c [1193811,68464] 0 2024-09-13T22:08:39.630 INFO:tasks.workunit.client.0.smithi089.stdout:7/254: read - d0/d19/d28/d1d/d3d/f43 zero size 2024-09-13T22:08:39.648 INFO:tasks.workunit.client.0.smithi089.stdout:2/287: link df/d14/d2b/d2d/l52 df/d1a/d57/l64 0 2024-09-13T22:08:39.658 INFO:tasks.workunit.client.0.smithi089.stdout:7/255: link d0/cc d0/d19/d28/d1d/d4a/c53 0 2024-09-13T22:08:39.659 INFO:tasks.workunit.client.0.smithi089.stdout:2/288: creat df/d14/f65 x:0 0 0 2024-09-13T22:08:39.659 INFO:tasks.workunit.client.0.smithi089.stdout:2/289: chown df/d1a/l3a 0 1 2024-09-13T22:08:39.662 INFO:tasks.workunit.client.0.smithi089.stdout:9/290: rename d6/c17 to d6/d18/d33/d39/c6e 0 2024-09-13T22:08:39.662 INFO:tasks.workunit.client.0.smithi089.stdout:9/291: getdents d6/d31/d64 0 2024-09-13T22:08:39.663 INFO:tasks.workunit.client.0.smithi089.stdout:7/256: getdents d0/d19 0 2024-09-13T22:08:39.664 INFO:tasks.workunit.client.0.smithi089.stdout:7/257: mkdir d0/d19/d45/d38/d54 0 2024-09-13T22:08:39.666 INFO:tasks.workunit.client.0.smithi089.stdout:1/292: sync 2024-09-13T22:08:39.666 INFO:tasks.workunit.client.0.smithi089.stdout:4/214: sync 2024-09-13T22:08:39.667 INFO:tasks.workunit.client.0.smithi089.stdout:0/365: sync 2024-09-13T22:08:39.667 INFO:tasks.workunit.client.0.smithi089.stdout:1/293: write d7/de/f5f [1298903,122583] 0 2024-09-13T22:08:39.667 INFO:tasks.workunit.client.0.smithi089.stdout:0/366: read - d1/de/f20 zero size 2024-09-13T22:08:39.667 INFO:tasks.workunit.client.0.smithi089.stdout:2/290: dread df/d14/d2b/f63 [4194304,4194304] 0 2024-09-13T22:08:39.667 INFO:tasks.workunit.client.0.smithi089.stdout:0/367: stat d1/de/d15/d41/f68 0 2024-09-13T22:08:39.667 INFO:tasks.workunit.client.0.smithi089.stdout:1/294: write d7/de/d1b/f4e [427820,46512] 0 2024-09-13T22:08:39.667 INFO:tasks.workunit.client.0.smithi089.stdout:1/295: fsync d7/de/ff 0 2024-09-13T22:08:39.667 INFO:tasks.workunit.client.0.smithi089.stdout:4/215: mknod d0/d15/c40 0 2024-09-13T22:08:39.668 INFO:tasks.workunit.client.0.smithi089.stdout:2/291: unlink df/d14/d2b/d61/c55 0 2024-09-13T22:08:39.668 INFO:tasks.workunit.client.0.smithi089.stdout:2/292: fsync df/f12 0 2024-09-13T22:08:39.668 INFO:tasks.workunit.client.0.smithi089.stdout:2/293: write df/d14/f65 [529251,60190] 0 2024-09-13T22:08:39.669 INFO:tasks.workunit.client.0.smithi089.stdout:0/368: mknod d1/de/c7d 0 2024-09-13T22:08:39.669 INFO:tasks.workunit.client.0.smithi089.stdout:0/369: dread - d1/de/d10/f7a zero size 2024-09-13T22:08:39.670 INFO:tasks.workunit.client.0.smithi089.stdout:1/296: creat d7/de/d3a/f6e x:0 0 0 2024-09-13T22:08:39.670 INFO:tasks.workunit.client.0.smithi089.stdout:4/216: getdents d0/d2c/d35 0 2024-09-13T22:08:39.673 INFO:tasks.workunit.client.0.smithi089.stdout:4/217: creat d0/d2c/f41 x:0 0 0 2024-09-13T22:08:39.676 INFO:tasks.workunit.client.0.smithi089.stdout:1/297: rename d7/f18 to d7/de/d68/f6f 0 2024-09-13T22:08:39.676 INFO:tasks.workunit.client.0.smithi089.stdout:0/370: write d1/fd [3170498,98045] 0 2024-09-13T22:08:39.678 INFO:tasks.workunit.client.0.smithi089.stdout:4/218: unlink d0/d11/d16/d24/f27 0 2024-09-13T22:08:39.678 INFO:tasks.workunit.client.0.smithi089.stdout:4/219: write d0/d11/d16/d24/f2f [1809677,1808] 0 2024-09-13T22:08:39.678 INFO:tasks.workunit.client.0.smithi089.stdout:4/220: write d0/d15/d1f/f31 [22326,58314] 0 2024-09-13T22:08:39.678 INFO:tasks.workunit.client.0.smithi089.stdout:4/221: write d0/d15/d1f/f31 [793984,84844] 0 2024-09-13T22:08:39.678 INFO:tasks.workunit.client.0.smithi089.stdout:1/298: mknod d7/d1c/d3c/c70 0 2024-09-13T22:08:39.679 INFO:tasks.workunit.client.0.smithi089.stdout:0/371: truncate d1/de/d10/d36/d3d/f43 2423056 0 2024-09-13T22:08:39.681 INFO:tasks.workunit.client.0.smithi089.stdout:4/222: unlink d0/d11/f3d 0 2024-09-13T22:08:39.682 INFO:tasks.workunit.client.0.smithi089.stdout:1/299: rename d7/d1c/f64 to d7/d40/f71 0 2024-09-13T22:08:39.683 INFO:tasks.workunit.client.0.smithi089.stdout:1/300: chown d7/fb 95 1 2024-09-13T22:08:39.683 INFO:tasks.workunit.client.0.smithi089.stdout:4/223: dread d0/f7 [0,4194304] 0 2024-09-13T22:08:39.684 INFO:tasks.workunit.client.0.smithi089.stdout:4/224: creat d0/d15/d1f/f42 x:0 0 0 2024-09-13T22:08:39.684 INFO:tasks.workunit.client.0.smithi089.stdout:2/294: dread df/d14/d2b/f59 [0,4194304] 0 2024-09-13T22:08:39.684 INFO:tasks.workunit.client.0.smithi089.stdout:1/301: readlink d7/l1f 0 2024-09-13T22:08:39.684 INFO:tasks.workunit.client.0.smithi089.stdout:1/302: chown d7/de/d1b/d2b/d39/f4c 64570938 1 2024-09-13T22:08:39.685 INFO:tasks.workunit.client.0.smithi089.stdout:1/303: dread - d7/de/d3a/f6e zero size 2024-09-13T22:08:39.686 INFO:tasks.workunit.client.0.smithi089.stdout:9/292: dwrite d6/d18/d21/f34 [0,4194304] 0 2024-09-13T22:08:39.686 INFO:tasks.workunit.client.0.smithi089.stdout:9/293: chown d6/d31/c60 116689002 1 2024-09-13T22:08:39.686 INFO:tasks.workunit.client.0.smithi089.stdout:4/225: creat d0/d11/d16/d24/f43 x:0 0 0 2024-09-13T22:08:39.687 INFO:tasks.workunit.client.0.smithi089.stdout:9/294: dread d6/d18/d33/d39/f4c [0,4194304] 0 2024-09-13T22:08:39.694 INFO:tasks.workunit.client.0.smithi089.stdout:4/226: rename d0/f29 to d0/d11/d16/f44 0 2024-09-13T22:08:39.694 INFO:tasks.workunit.client.0.smithi089.stdout:4/227: dread - d0/d11/d16/d24/f32 zero size 2024-09-13T22:08:39.694 INFO:tasks.workunit.client.0.smithi089.stdout:4/228: creat d0/d2c/f45 x:0 0 0 2024-09-13T22:08:39.697 INFO:tasks.workunit.client.0.smithi089.stdout:4/229: mknod d0/d11/d16/c46 0 2024-09-13T22:08:39.697 INFO:tasks.workunit.client.0.smithi089.stdout:9/295: dread d6/f14 [0,4194304] 0 2024-09-13T22:08:39.699 INFO:tasks.workunit.client.0.smithi089.stdout:7/258: dwrite d0/f14 [0,4194304] 0 2024-09-13T22:08:39.699 INFO:tasks.workunit.client.0.smithi089.stdout:7/259: write d0/d19/d45/d38/f49 [850973,7731] 0 2024-09-13T22:08:39.701 INFO:tasks.workunit.client.0.smithi089.stdout:9/296: dread d6/fc [0,4194304] 0 2024-09-13T22:08:39.701 INFO:tasks.workunit.client.0.smithi089.stdout:9/297: write f0 [5063566,72133] 0 2024-09-13T22:08:39.703 INFO:tasks.workunit.client.0.smithi089.stdout:1/304: getdents d7/de/d3a 0 2024-09-13T22:08:39.704 INFO:tasks.workunit.client.0.smithi089.stdout:1/305: chown d7/d1c/d3c/f60 7 1 2024-09-13T22:08:39.706 INFO:tasks.workunit.client.0.smithi089.stdout:1/306: rename d7/d40/f4d to d7/d1c/f72 0 2024-09-13T22:08:39.709 INFO:tasks.workunit.client.0.smithi089.stdout:1/307: mkdir d7/de/d1b/d2b/d39/d73 0 2024-09-13T22:08:39.709 INFO:tasks.workunit.client.0.smithi089.stdout:4/230: dread d0/d11/f21 [0,4194304] 0 2024-09-13T22:08:39.711 INFO:tasks.workunit.client.0.smithi089.stdout:1/308: mkdir d7/d34/d5c/d74 0 2024-09-13T22:08:39.712 INFO:tasks.workunit.client.0.smithi089.stdout:9/298: dread d6/d18/f1d [4194304,4194304] 0 2024-09-13T22:08:39.713 INFO:tasks.workunit.client.0.smithi089.stdout:4/231: symlink d0/d11/l47 0 2024-09-13T22:08:39.714 INFO:tasks.workunit.client.0.smithi089.stdout:1/309: creat d7/d40/f75 x:0 0 0 2024-09-13T22:08:39.715 INFO:tasks.workunit.client.0.smithi089.stdout:7/260: write d0/d19/d45/d38/f3a [4161742,62985] 0 2024-09-13T22:08:39.715 INFO:tasks.workunit.client.0.smithi089.stdout:9/299: symlink d6/d18/d33/d5a/l6f 0 2024-09-13T22:08:39.715 INFO:tasks.workunit.client.0.smithi089.stdout:9/300: dread - d6/d55/f6a zero size 2024-09-13T22:08:39.716 INFO:tasks.workunit.client.0.smithi089.stdout:4/232: dread d0/f7 [0,4194304] 0 2024-09-13T22:08:39.717 INFO:tasks.workunit.client.0.smithi089.stdout:7/261: mkdir d0/d19/d28/d1d/d2d/d55 0 2024-09-13T22:08:39.720 INFO:tasks.workunit.client.0.smithi089.stdout:7/262: write d0/d19/d28/d1d/d30/f3b [387148,76113] 0 2024-09-13T22:08:39.722 INFO:tasks.workunit.client.0.smithi089.stdout:9/301: dread d6/d18/f1d [0,4194304] 0 2024-09-13T22:08:39.723 INFO:tasks.workunit.client.0.smithi089.stdout:9/302: write d6/d18/d33/d39/f69 [29034,44166] 0 2024-09-13T22:08:39.724 INFO:tasks.workunit.client.0.smithi089.stdout:5/257: sync 2024-09-13T22:08:39.724 INFO:tasks.workunit.client.0.smithi089.stdout:8/294: sync 2024-09-13T22:08:39.725 INFO:tasks.workunit.client.0.smithi089.stdout:3/274: sync 2024-09-13T22:08:39.725 INFO:tasks.workunit.client.0.smithi089.stdout:8/295: readlink d0/dd/d12/d20/d32/l45 0 2024-09-13T22:08:39.725 INFO:tasks.workunit.client.0.smithi089.stdout:8/296: write d0/f4d [1973544,59363] 0 2024-09-13T22:08:39.726 INFO:tasks.workunit.client.0.smithi089.stdout:5/258: truncate d4/f29 720243 0 2024-09-13T22:08:39.726 INFO:tasks.workunit.client.0.smithi089.stdout:5/259: fsync d4/f8 0 2024-09-13T22:08:39.726 INFO:tasks.workunit.client.0.smithi089.stdout:6/249: sync 2024-09-13T22:08:39.728 INFO:tasks.workunit.client.0.smithi089.stdout:3/275: link d1/d7/le d1/d2/d18/d40/l5f 0 2024-09-13T22:08:39.728 INFO:tasks.workunit.client.0.smithi089.stdout:3/276: dread - d1/d2/d4/f5e zero size 2024-09-13T22:08:39.729 INFO:tasks.workunit.client.0.smithi089.stdout:6/250: creat d0/d4/d12/f4c x:0 0 0 2024-09-13T22:08:39.731 INFO:tasks.workunit.client.0.smithi089.stdout:9/303: read d6/d18/d21/f44 [1236668,101462] 0 2024-09-13T22:08:39.731 INFO:tasks.workunit.client.0.smithi089.stdout:6/251: link d0/d5/f14 d0/d5/f4d 0 2024-09-13T22:08:39.732 INFO:tasks.workunit.client.0.smithi089.stdout:4/233: dread d0/f13 [0,4194304] 0 2024-09-13T22:08:39.732 INFO:tasks.workunit.client.0.smithi089.stdout:7/263: dread d0/d19/d28/d1d/d30/f3b [0,4194304] 0 2024-09-13T22:08:39.732 INFO:tasks.workunit.client.0.smithi089.stdout:7/264: chown d0/f5 121030983 1 2024-09-13T22:08:39.732 INFO:tasks.workunit.client.0.smithi089.stdout:7/265: readlink d0/d19/d45/d38/l47 0 2024-09-13T22:08:39.733 INFO:tasks.workunit.client.0.smithi089.stdout:8/297: write d0/dd/d12/d20/d36/f26 [3833618,20906] 0 2024-09-13T22:08:39.734 INFO:tasks.workunit.client.0.smithi089.stdout:7/266: dread d0/d19/d28/d1d/d30/f3b [0,4194304] 0 2024-09-13T22:08:39.734 INFO:tasks.workunit.client.0.smithi089.stdout:7/267: readlink d0/d19/l27 0 2024-09-13T22:08:39.735 INFO:tasks.workunit.client.0.smithi089.stdout:5/260: dread d4/ff [0,4194304] 0 2024-09-13T22:08:39.735 INFO:tasks.workunit.client.0.smithi089.stdout:5/261: truncate d4/d19/d1e/d28/d31/f4d 197371 0 2024-09-13T22:08:39.736 INFO:tasks.workunit.client.0.smithi089.stdout:8/298: chown d0/dd/d12/d42/f5e 373127464 1 2024-09-13T22:08:39.736 INFO:tasks.workunit.client.0.smithi089.stdout:8/299: write d0/dd/d12/d20/f18 [3087267,11943] 0 2024-09-13T22:08:39.741 INFO:tasks.workunit.client.0.smithi089.stdout:7/268: creat d0/d19/d28/d1d/d23/f56 x:0 0 0 2024-09-13T22:08:39.741 INFO:tasks.workunit.client.0.smithi089.stdout:9/304: read d6/ff [3504873,71541] 0 2024-09-13T22:08:39.742 INFO:tasks.workunit.client.0.smithi089.stdout:9/305: creat d6/d18/f70 x:0 0 0 2024-09-13T22:08:39.743 INFO:tasks.workunit.client.0.smithi089.stdout:9/306: read - d6/d18/f70 zero size 2024-09-13T22:08:39.743 INFO:tasks.workunit.client.0.smithi089.stdout:9/307: readlink d6/d18/d33/d52/l63 0 2024-09-13T22:08:39.744 INFO:tasks.workunit.client.0.smithi089.stdout:9/308: mknod d6/d18/d1b/c71 0 2024-09-13T22:08:39.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:39 smithi089 ceph-mon[27921]: pgmap v251: 65 pgs: 65 active+clean; 315 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.8 MiB/s rd, 18 MiB/s wr, 605 op/s 2024-09-13T22:08:39.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:39 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:08:39.747 INFO:tasks.workunit.client.0.smithi089.stdout:9/309: creat d6/d18/d21/d5d/d6c/f72 x:0 0 0 2024-09-13T22:08:39.748 INFO:tasks.workunit.client.0.smithi089.stdout:9/310: mknod d6/d31/d64/c73 0 2024-09-13T22:08:39.748 INFO:tasks.workunit.client.0.smithi089.stdout:9/311: chown d6/f51 104314 1 2024-09-13T22:08:39.750 INFO:tasks.workunit.client.0.smithi089.stdout:9/312: truncate d6/d18/d33/d52/f4b 507503 0 2024-09-13T22:08:39.750 INFO:tasks.workunit.client.0.smithi089.stdout:9/313: fdatasync f0 0 2024-09-13T22:08:39.750 INFO:tasks.workunit.client.0.smithi089.stdout:9/314: write d6/d18/f36 [1676741,47223] 0 2024-09-13T22:08:39.751 INFO:tasks.workunit.client.0.smithi089.stdout:8/300: write d0/dd/ff [1301158,117424] 0 2024-09-13T22:08:39.752 INFO:tasks.workunit.client.0.smithi089.stdout:9/315: symlink d6/d54/l74 0 2024-09-13T22:08:39.754 INFO:tasks.workunit.client.0.smithi089.stdout:8/301: mknod d0/dd/d12/d20/d1c/d5a/c67 0 2024-09-13T22:08:39.754 INFO:tasks.workunit.client.0.smithi089.stdout:8/302: readlink d0/dd/l3c 0 2024-09-13T22:08:39.756 INFO:tasks.workunit.client.0.smithi089.stdout:9/316: dread d6/d18/d33/d52/f4b [0,4194304] 0 2024-09-13T22:08:39.757 INFO:tasks.workunit.client.0.smithi089.stdout:8/303: rmdir d0/dd/d12/d20/d32 39 2024-09-13T22:08:39.757 INFO:tasks.workunit.client.0.smithi089.stdout:8/304: fdatasync d0/dd/d12/d20/d36/f58 0 2024-09-13T22:08:39.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:39 smithi159 ceph-mon[35348]: pgmap v251: 65 pgs: 65 active+clean; 315 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.8 MiB/s rd, 18 MiB/s wr, 605 op/s 2024-09-13T22:08:39.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:39 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:08:39.763 INFO:tasks.workunit.client.0.smithi089.stdout:3/277: dwrite d1/d2/d18/d38/f53 [0,4194304] 0 2024-09-13T22:08:39.764 INFO:tasks.workunit.client.0.smithi089.stdout:5/262: dwrite d4/f27 [0,4194304] 0 2024-09-13T22:08:39.769 INFO:tasks.workunit.client.0.smithi089.stdout:3/278: dread d1/d2/d4/f1a [0,4194304] 0 2024-09-13T22:08:39.769 INFO:tasks.workunit.client.0.smithi089.stdout:3/279: readlink d1/d2/d31/l57 0 2024-09-13T22:08:39.770 INFO:tasks.workunit.client.0.smithi089.stdout:4/234: dwrite d0/f6 [0,4194304] 0 2024-09-13T22:08:39.777 INFO:tasks.workunit.client.0.smithi089.stdout:4/235: dread d0/f13 [0,4194304] 0 2024-09-13T22:08:39.777 INFO:tasks.workunit.client.0.smithi089.stdout:4/236: write d0/f1a [3380499,124335] 0 2024-09-13T22:08:39.778 INFO:tasks.workunit.client.0.smithi089.stdout:4/237: truncate d0/d11/f18 2231853 0 2024-09-13T22:08:39.778 INFO:tasks.workunit.client.0.smithi089.stdout:4/238: dread - d0/d11/d16/f2d zero size 2024-09-13T22:08:39.778 INFO:tasks.workunit.client.0.smithi089.stdout:4/239: mknod d0/d11/d16/d24/c48 0 2024-09-13T22:08:39.778 INFO:tasks.workunit.client.0.smithi089.stdout:3/280: dread d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:39.778 INFO:tasks.workunit.client.0.smithi089.stdout:3/281: chown d1/d2/d4/d1c/c21 21940 1 2024-09-13T22:08:39.779 INFO:tasks.workunit.client.0.smithi089.stdout:4/240: rename d0/d11/d16/f44 to d0/d2c/d35/f49 0 2024-09-13T22:08:39.780 INFO:tasks.workunit.client.0.smithi089.stdout:4/241: truncate d0/d11/d16/f26 4647158 0 2024-09-13T22:08:39.780 INFO:tasks.workunit.client.0.smithi089.stdout:3/282: getdents d1/d2/d31 0 2024-09-13T22:08:39.781 INFO:tasks.workunit.client.0.smithi089.stdout:3/283: read d1/f13 [778545,90858] 0 2024-09-13T22:08:39.781 INFO:tasks.workunit.client.0.smithi089.stdout:3/284: fdatasync d1/d2/d31/f3f 0 2024-09-13T22:08:39.784 INFO:tasks.workunit.client.0.smithi089.stdout:9/317: dwrite d6/d18/d21/d5d/d6c/f72 [0,4194304] 0 2024-09-13T22:08:39.785 INFO:tasks.workunit.client.0.smithi089.stdout:5/263: dwrite d4/f8 [0,4194304] 0 2024-09-13T22:08:39.785 INFO:tasks.workunit.client.0.smithi089.stdout:5/264: rename d4/d19 to d4/d19/d1e/d28/d31/d65 22 2024-09-13T22:08:39.787 INFO:tasks.workunit.client.0.smithi089.stdout:9/318: link d6/d18/d33/d52/f4b d6/d55/f75 0 2024-09-13T22:08:39.787 INFO:tasks.workunit.client.0.smithi089.stdout:8/305: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T22:08:39.789 INFO:tasks.workunit.client.0.smithi089.stdout:3/285: dread d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:39.793 INFO:tasks.workunit.client.0.smithi089.stdout:9/319: dread d6/d18/f1d [0,4194304] 0 2024-09-13T22:08:39.795 INFO:tasks.workunit.client.0.smithi089.stdout:8/306: mkdir d0/dd/d12/d20/d36/d68 0 2024-09-13T22:08:39.796 INFO:tasks.workunit.client.0.smithi089.stdout:5/265: rmdir d4/d19/d1e/d28/d31/d35 39 2024-09-13T22:08:39.797 INFO:tasks.workunit.client.0.smithi089.stdout:3/286: rename d1/d2/d23/d2b/c4c to d1/d2/c60 0 2024-09-13T22:08:39.798 INFO:tasks.workunit.client.0.smithi089.stdout:9/320: symlink d6/d18/d1b/d3e/l76 0 2024-09-13T22:08:39.798 INFO:tasks.workunit.client.0.smithi089.stdout:9/321: creat d6/d18/d21/f77 x:0 0 0 2024-09-13T22:08:39.799 INFO:tasks.workunit.client.0.smithi089.stdout:8/307: unlink d0/dd/d12/d20/c50 0 2024-09-13T22:08:39.799 INFO:tasks.workunit.client.0.smithi089.stdout:0/372: sync 2024-09-13T22:08:39.799 INFO:tasks.workunit.client.0.smithi089.stdout:2/295: sync 2024-09-13T22:08:39.800 INFO:tasks.workunit.client.0.smithi089.stdout:0/373: dread - d1/de/d10/f45 zero size 2024-09-13T22:08:39.800 INFO:tasks.workunit.client.0.smithi089.stdout:0/374: readlink d1/de/d10/d36/d57/l25 0 2024-09-13T22:08:39.800 INFO:tasks.workunit.client.0.smithi089.stdout:5/266: getdents d4/d19/d1e/d28/d31/d35/d46 0 2024-09-13T22:08:39.800 INFO:tasks.workunit.client.0.smithi089.stdout:5/267: truncate d4/d19/f48 571587 0 2024-09-13T22:08:39.800 INFO:tasks.workunit.client.0.smithi089.stdout:5/268: creat d4/d19/d1e/d28/d3d/d5e/f66 x:0 0 0 2024-09-13T22:08:39.800 INFO:tasks.workunit.client.0.smithi089.stdout:3/287: creat d1/d7/f61 x:0 0 0 2024-09-13T22:08:39.802 INFO:tasks.workunit.client.0.smithi089.stdout:8/308: rename d0/dd/d12/d20/d36/l22 to d0/dd/d12/d3a/l69 0 2024-09-13T22:08:39.802 INFO:tasks.workunit.client.0.smithi089.stdout:5/269: rename d4/d19/d1e/d28 to d4/d19/d1e/d28/d67 22 2024-09-13T22:08:39.802 INFO:tasks.workunit.client.0.smithi089.stdout:8/309: fdatasync d0/dd/d12/d20/d36/d57/f60 0 2024-09-13T22:08:39.802 INFO:tasks.workunit.client.0.smithi089.stdout:2/296: mkdir df/d14/d66 0 2024-09-13T22:08:39.803 INFO:tasks.workunit.client.0.smithi089.stdout:9/322: dread d6/d18/f1d [0,4194304] 0 2024-09-13T22:08:39.803 INFO:tasks.workunit.client.0.smithi089.stdout:0/375: unlink d1/de/d10/f1d 0 2024-09-13T22:08:39.803 INFO:tasks.workunit.client.0.smithi089.stdout:3/288: write d1/d2/d24/f4b [2014656,7957] 0 2024-09-13T22:08:39.804 INFO:tasks.workunit.client.0.smithi089.stdout:3/289: chown d1/d2/d31/c33 113 1 2024-09-13T22:08:39.804 INFO:tasks.workunit.client.0.smithi089.stdout:8/310: mkdir d0/d6a 0 2024-09-13T22:08:39.805 INFO:tasks.workunit.client.0.smithi089.stdout:2/297: link df/d1a/l34 df/d14/d2b/d4b/l67 0 2024-09-13T22:08:39.805 INFO:tasks.workunit.client.0.smithi089.stdout:9/323: mknod d6/d18/d33/d5a/c78 0 2024-09-13T22:08:39.806 INFO:tasks.workunit.client.0.smithi089.stdout:0/376: getdents d1/de/d15/d2a 0 2024-09-13T22:08:39.807 INFO:tasks.workunit.client.0.smithi089.stdout:3/290: symlink d1/d2/d23/d3d/d46/l62 0 2024-09-13T22:08:39.808 INFO:tasks.workunit.client.0.smithi089.stdout:3/291: write d1/d2/d31/f3f [4835529,119770] 0 2024-09-13T22:08:39.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/311: rename d0/dd/f19 to d0/dd/d12/d20/d32/d3b/f6b 0 2024-09-13T22:08:39.809 INFO:tasks.workunit.client.0.smithi089.stdout:2/298: mkdir df/d1a/d57/d68 0 2024-09-13T22:08:39.810 INFO:tasks.workunit.client.0.smithi089.stdout:0/377: symlink d1/de/d10/d36/d38/d4e/d62/d5f/l7e 0 2024-09-13T22:08:39.810 INFO:tasks.workunit.client.0.smithi089.stdout:0/378: truncate d1/f7 4952256 0 2024-09-13T22:08:39.810 INFO:tasks.workunit.client.0.smithi089.stdout:0/379: chown d1/de/d10/d36/d3d 231921 1 2024-09-13T22:08:39.811 INFO:tasks.workunit.client.0.smithi089.stdout:5/270: dread d4/d19/d1e/d28/d31/f52 [0,4194304] 0 2024-09-13T22:08:39.811 INFO:tasks.workunit.client.0.smithi089.stdout:3/292: mkdir d1/d7/d1b/d28/d63 0 2024-09-13T22:08:39.811 INFO:tasks.workunit.client.0.smithi089.stdout:8/312: link d0/dd/d12/d3a/l47 d0/dd/d12/d42/l6c 0 2024-09-13T22:08:39.812 INFO:tasks.workunit.client.0.smithi089.stdout:9/324: rename d6/d18/d21/d5d/d6c/f72 to d6/d31/d5e/f79 0 2024-09-13T22:08:39.825 INFO:tasks.workunit.client.0.smithi089.stdout:5/271: dread d4/d19/d1e/d28/d31/d35/f47 [0,4194304] 0 2024-09-13T22:08:39.826 INFO:tasks.workunit.client.0.smithi089.stdout:5/272: write d4/f9 [1087839,48027] 0 2024-09-13T22:08:39.829 INFO:tasks.workunit.client.0.smithi089.stdout:5/273: rename d4/d19/f1f to d4/d19/d1e/d28/d31/d55/f68 0 2024-09-13T22:08:39.848 INFO:tasks.workunit.client.0.smithi089.stdout:9/325: dwrite d6/d18/f47 [4194304,4194304] 0 2024-09-13T22:08:39.848 INFO:tasks.workunit.client.0.smithi089.stdout:3/293: dwrite d1/d2/d18/d38/f53 [0,4194304] 0 2024-09-13T22:08:39.849 INFO:tasks.workunit.client.0.smithi089.stdout:5/274: dwrite d4/d19/f21 [4194304,4194304] 0 2024-09-13T22:08:39.849 INFO:tasks.workunit.client.0.smithi089.stdout:2/299: dwrite df/d14/d2b/d2d/f44 [0,4194304] 0 2024-09-13T22:08:39.851 INFO:tasks.workunit.client.0.smithi089.stdout:9/326: rename d6/d18/d1b/l28 to d6/d18/d33/d5a/l7a 0 2024-09-13T22:08:39.855 INFO:tasks.workunit.client.0.smithi089.stdout:5/275: mkdir d4/d19/d1e/d28/d31/d61/d69 0 2024-09-13T22:08:39.855 INFO:tasks.workunit.client.0.smithi089.stdout:5/276: write d4/d19/d1e/d28/d3d/f5d [994583,50956] 0 2024-09-13T22:08:39.855 INFO:tasks.workunit.client.0.smithi089.stdout:3/294: dread d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:39.855 INFO:tasks.workunit.client.0.smithi089.stdout:3/295: write d1/f13 [972398,2697] 0 2024-09-13T22:08:39.855 INFO:tasks.workunit.client.0.smithi089.stdout:3/296: chown d1/d2/d4/f5e 5550674 1 2024-09-13T22:08:39.856 INFO:tasks.workunit.client.0.smithi089.stdout:2/300: rename df/d14/d2b/d2d to df/d14/d66/d69 0 2024-09-13T22:08:39.856 INFO:tasks.workunit.client.0.smithi089.stdout:9/327: truncate d6/d18/f36 1202308 0 2024-09-13T22:08:39.860 INFO:tasks.workunit.client.0.smithi089.stdout:3/297: mknod d1/d2/d18/d38/c64 0 2024-09-13T22:08:39.861 INFO:tasks.workunit.client.0.smithi089.stdout:9/328: symlink d6/d55/l7b 0 2024-09-13T22:08:39.862 INFO:tasks.workunit.client.0.smithi089.stdout:5/277: rmdir d4/d19/d1e/d28/d3d/d5e 39 2024-09-13T22:08:39.864 INFO:tasks.workunit.client.0.smithi089.stdout:9/329: symlink d6/d18/d33/d52/l7c 0 2024-09-13T22:08:39.864 INFO:tasks.workunit.client.0.smithi089.stdout:9/330: write d6/d18/f1f [2798236,82491] 0 2024-09-13T22:08:39.866 INFO:tasks.workunit.client.0.smithi089.stdout:2/301: dread df/d14/d66/d69/f51 [0,4194304] 0 2024-09-13T22:08:39.866 INFO:tasks.workunit.client.0.smithi089.stdout:2/302: truncate df/d14/d2b/f36 3483826 0 2024-09-13T22:08:39.867 INFO:tasks.workunit.client.0.smithi089.stdout:3/298: dread d1/d2/d4/f16 [0,4194304] 0 2024-09-13T22:08:39.868 INFO:tasks.workunit.client.0.smithi089.stdout:3/299: symlink d1/d2/d18/d40/d50/l65 0 2024-09-13T22:08:39.871 INFO:tasks.workunit.client.0.smithi089.stdout:3/300: dread d1/d2/d4/f9 [0,4194304] 0 2024-09-13T22:08:39.871 INFO:tasks.workunit.client.0.smithi089.stdout:3/301: chown d1/d7/f61 1877 1 2024-09-13T22:08:39.873 INFO:tasks.workunit.client.0.smithi089.stdout:3/302: creat d1/d2/f66 x:0 0 0 2024-09-13T22:08:39.890 INFO:tasks.workunit.client.0.smithi089.stdout:3/303: dread d1/d2/d4/d1c/f2a [4194304,4194304] 0 2024-09-13T22:08:39.890 INFO:tasks.workunit.client.0.smithi089.stdout:5/278: dwrite d4/f29 [0,4194304] 0 2024-09-13T22:08:39.890 INFO:tasks.workunit.client.0.smithi089.stdout:3/304: dread - d1/d2/d23/f35 zero size 2024-09-13T22:08:39.893 INFO:tasks.workunit.client.0.smithi089.stdout:5/279: creat d4/d19/d1e/d28/d31/d55/f6a x:0 0 0 2024-09-13T22:08:39.894 INFO:tasks.workunit.client.0.smithi089.stdout:9/331: dwrite d6/d18/d21/f77 [0,4194304] 0 2024-09-13T22:08:39.894 INFO:tasks.workunit.client.0.smithi089.stdout:9/332: chown d6/d18/c4d 80625093 1 2024-09-13T22:08:39.897 INFO:tasks.workunit.client.0.smithi089.stdout:7/269: sync 2024-09-13T22:08:39.897 INFO:tasks.workunit.client.0.smithi089.stdout:0/380: sync 2024-09-13T22:08:39.897 INFO:tasks.workunit.client.0.smithi089.stdout:4/242: sync 2024-09-13T22:08:39.898 INFO:tasks.workunit.client.0.smithi089.stdout:1/310: sync 2024-09-13T22:08:39.898 INFO:tasks.workunit.client.0.smithi089.stdout:6/252: sync 2024-09-13T22:08:39.898 INFO:tasks.workunit.client.0.smithi089.stdout:6/253: dread - d0/f48 zero size 2024-09-13T22:08:39.898 INFO:tasks.workunit.client.0.smithi089.stdout:4/243: truncate d0/d2c/d35/f49 599720 0 2024-09-13T22:08:39.898 INFO:tasks.workunit.client.0.smithi089.stdout:1/311: truncate d7/de/d1b/d2b/f54 1020907 0 2024-09-13T22:08:39.898 INFO:tasks.workunit.client.0.smithi089.stdout:1/312: stat d7/d1c/d3c/f65 0 2024-09-13T22:08:39.898 INFO:tasks.workunit.client.0.smithi089.stdout:0/381: write d1/de/d10/d36/d38/d4e/d62/d5f/f7c [49041,48980] 0 2024-09-13T22:08:39.899 INFO:tasks.workunit.client.0.smithi089.stdout:6/254: creat d0/d4/d12/d31/d4b/f4e x:0 0 0 2024-09-13T22:08:39.899 INFO:tasks.workunit.client.0.smithi089.stdout:6/255: dread - d0/d4/d12/f41 zero size 2024-09-13T22:08:39.899 INFO:tasks.workunit.client.0.smithi089.stdout:6/256: fsync d0/d4/f40 0 2024-09-13T22:08:39.899 INFO:tasks.workunit.client.0.smithi089.stdout:1/313: mknod d7/d1c/d3c/c76 0 2024-09-13T22:08:39.899 INFO:tasks.workunit.client.0.smithi089.stdout:0/382: truncate d1/f32 519522 0 2024-09-13T22:08:39.899 INFO:tasks.workunit.client.0.smithi089.stdout:0/383: stat d1/de/d15/f24 0 2024-09-13T22:08:39.899 INFO:tasks.workunit.client.0.smithi089.stdout:0/384: fsync d1/f1e 0 2024-09-13T22:08:39.900 INFO:tasks.workunit.client.0.smithi089.stdout:4/244: symlink d0/d11/l4a 0 2024-09-13T22:08:39.901 INFO:tasks.workunit.client.0.smithi089.stdout:6/257: mkdir d0/d4/d12/d31/d4a/d4f 0 2024-09-13T22:08:39.901 INFO:tasks.workunit.client.0.smithi089.stdout:6/258: creat d0/d4/d12/d15/f50 x:0 0 0 2024-09-13T22:08:39.902 INFO:tasks.workunit.client.0.smithi089.stdout:0/385: mknod d1/de/d10/d36/d38/d4e/d62/d5f/c7f 0 2024-09-13T22:08:39.902 INFO:tasks.workunit.client.0.smithi089.stdout:0/386: write d1/de/d10/d36/d57/d3a/f3c [4820921,54075] 0 2024-09-13T22:08:39.904 INFO:tasks.workunit.client.0.smithi089.stdout:1/314: dread d7/de/d1b/f58 [0,4194304] 0 2024-09-13T22:08:39.905 INFO:tasks.workunit.client.0.smithi089.stdout:3/305: dwrite d1/d2/f66 [0,4194304] 0 2024-09-13T22:08:39.907 INFO:tasks.workunit.client.0.smithi089.stdout:0/387: rename d1/de/d15/d41/l53 to d1/de/d10/d36/d57/d3a/l80 0 2024-09-13T22:08:39.907 INFO:tasks.workunit.client.0.smithi089.stdout:0/388: truncate d1/de/f46 1893343 0 2024-09-13T22:08:39.909 INFO:tasks.workunit.client.0.smithi089.stdout:3/306: dread d1/d2/d4/f9 [0,4194304] 0 2024-09-13T22:08:39.909 INFO:tasks.workunit.client.0.smithi089.stdout:1/315: mkdir d7/de/d3a/d77 0 2024-09-13T22:08:39.911 INFO:tasks.workunit.client.0.smithi089.stdout:4/245: write d0/f13 [1643669,49532] 0 2024-09-13T22:08:39.911 INFO:tasks.workunit.client.0.smithi089.stdout:4/246: dread - d0/d15/d1f/f42 zero size 2024-09-13T22:08:39.911 INFO:tasks.workunit.client.0.smithi089.stdout:4/247: dread - d0/d2c/f45 zero size 2024-09-13T22:08:39.911 INFO:tasks.workunit.client.0.smithi089.stdout:3/307: rename d1/d2/d23/f27 to d1/d2/d23/d3d/d46/f67 0 2024-09-13T22:08:39.913 INFO:tasks.workunit.client.0.smithi089.stdout:4/248: rename d0/d11/l3c to d0/d11/d16/l4b 0 2024-09-13T22:08:39.913 INFO:tasks.workunit.client.0.smithi089.stdout:4/249: chown d0/d2c/l33 13160 1 2024-09-13T22:08:39.915 INFO:tasks.workunit.client.0.smithi089.stdout:3/308: unlink d1/d7/d1b/d28/f2c 0 2024-09-13T22:08:39.915 INFO:tasks.workunit.client.0.smithi089.stdout:6/259: read d0/d4/d12/d15/f32 [2662519,82418] 0 2024-09-13T22:08:39.922 INFO:tasks.workunit.client.0.smithi089.stdout:3/309: dread d1/d2/f29 [0,4194304] 0 2024-09-13T22:08:39.923 INFO:tasks.workunit.client.0.smithi089.stdout:7/270: dwrite d0/ff [0,4194304] 0 2024-09-13T22:08:39.925 INFO:tasks.workunit.client.0.smithi089.stdout:9/333: dwrite d6/d18/f1f [0,4194304] 0 2024-09-13T22:08:39.925 INFO:tasks.workunit.client.0.smithi089.stdout:4/250: dread d0/d15/d1f/f31 [0,4194304] 0 2024-09-13T22:08:39.925 INFO:tasks.workunit.client.0.smithi089.stdout:4/251: write d0/d11/d16/d24/f36 [174204,74717] 0 2024-09-13T22:08:39.925 INFO:tasks.workunit.client.0.smithi089.stdout:4/252: dread - d0/d2c/f45 zero size 2024-09-13T22:08:39.925 INFO:tasks.workunit.client.0.smithi089.stdout:7/271: mknod d0/d19/d45/c57 0 2024-09-13T22:08:39.927 INFO:tasks.workunit.client.0.smithi089.stdout:6/260: read d0/d5/f4d [2414600,88250] 0 2024-09-13T22:08:39.927 INFO:tasks.workunit.client.0.smithi089.stdout:9/334: creat d6/d31/d5e/f7d x:0 0 0 2024-09-13T22:08:39.928 INFO:tasks.workunit.client.0.smithi089.stdout:3/310: dread d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:39.928 INFO:tasks.workunit.client.0.smithi089.stdout:3/311: read d1/d2/f3 [2947459,57439] 0 2024-09-13T22:08:39.931 INFO:tasks.workunit.client.0.smithi089.stdout:4/253: rename d0/f7 to d0/d2c/d35/f4c 0 2024-09-13T22:08:39.931 INFO:tasks.workunit.client.0.smithi089.stdout:6/261: mknod d0/c51 0 2024-09-13T22:08:39.931 INFO:tasks.workunit.client.0.smithi089.stdout:6/262: fdatasync d0/f42 0 2024-09-13T22:08:39.931 INFO:tasks.workunit.client.0.smithi089.stdout:6/263: write d0/d4/d12/d15/f32 [1372856,58191] 0 2024-09-13T22:08:39.931 INFO:tasks.workunit.client.0.smithi089.stdout:6/264: chown d0/d5/l29 1473973 1 2024-09-13T22:08:39.933 INFO:tasks.workunit.client.0.smithi089.stdout:6/265: mknod d0/d4/d12/d15/d3b/c52 0 2024-09-13T22:08:39.933 INFO:tasks.workunit.client.0.smithi089.stdout:9/335: dread d6/f59 [0,4194304] 0 2024-09-13T22:08:39.936 INFO:tasks.workunit.client.0.smithi089.stdout:7/272: dread d0/d19/d28/d1d/d23/d24/f29 [0,4194304] 0 2024-09-13T22:08:39.937 INFO:tasks.workunit.client.0.smithi089.stdout:7/273: symlink d0/d19/d45/d38/d54/l58 0 2024-09-13T22:08:39.947 INFO:tasks.workunit.client.0.smithi089.stdout:6/266: dread d0/d4/f2b [0,4194304] 0 2024-09-13T22:08:39.947 INFO:tasks.workunit.client.0.smithi089.stdout:6/267: truncate d0/d4/f24 311589 0 2024-09-13T22:08:39.948 INFO:tasks.workunit.client.0.smithi089.stdout:1/316: dwrite d7/de/d1b/d2b/f2d [0,4194304] 0 2024-09-13T22:08:39.948 INFO:tasks.workunit.client.0.smithi089.stdout:0/389: dwrite d1/f55 [0,4194304] 0 2024-09-13T22:08:39.948 INFO:tasks.workunit.client.0.smithi089.stdout:0/390: fdatasync d1/de/f14 0 2024-09-13T22:08:39.949 INFO:tasks.workunit.client.0.smithi089.stdout:1/317: write d7/d1c/d3c/f3f [663562,87136] 0 2024-09-13T22:08:39.949 INFO:tasks.workunit.client.0.smithi089.stdout:1/318: fdatasync d7/d1c/f35 0 2024-09-13T22:08:39.949 INFO:tasks.workunit.client.0.smithi089.stdout:0/391: dread d1/de/f17 [0,4194304] 0 2024-09-13T22:08:39.949 INFO:tasks.workunit.client.0.smithi089.stdout:0/392: readlink d1/de/d10/d36/d38/d4e/d62/d5b/l61 0 2024-09-13T22:08:39.952 INFO:tasks.workunit.client.0.smithi089.stdout:0/393: creat d1/de/d15/d2a/f81 x:0 0 0 2024-09-13T22:08:39.953 INFO:tasks.workunit.client.0.smithi089.stdout:0/394: dread d1/de/d10/d36/d38/f60 [0,4194304] 0 2024-09-13T22:08:39.955 INFO:tasks.workunit.client.0.smithi089.stdout:0/395: rename d1/de/d10/f7a to d1/de/d15/d41/f82 0 2024-09-13T22:08:39.955 INFO:tasks.workunit.client.0.smithi089.stdout:3/312: dwrite d1/d2/d24/f3b [0,4194304] 0 2024-09-13T22:08:39.955 INFO:tasks.workunit.client.0.smithi089.stdout:4/254: dwrite d0/d11/d16/f2d [0,4194304] 0 2024-09-13T22:08:39.960 INFO:tasks.workunit.client.0.smithi089.stdout:6/268: dread d0/d5/f7 [4194304,4194304] 0 2024-09-13T22:08:39.960 INFO:tasks.workunit.client.0.smithi089.stdout:1/319: dread d7/d1c/d3c/f3f [0,4194304] 0 2024-09-13T22:08:39.961 INFO:tasks.workunit.client.0.smithi089.stdout:9/336: dwrite d6/f59 [0,4194304] 0 2024-09-13T22:08:39.961 INFO:tasks.workunit.client.0.smithi089.stdout:4/255: creat d0/d15/f4d x:0 0 0 2024-09-13T22:08:39.961 INFO:tasks.workunit.client.0.smithi089.stdout:4/256: write d0/d2c/f41 [411438,72735] 0 2024-09-13T22:08:39.961 INFO:tasks.workunit.client.0.smithi089.stdout:3/313: write d1/d2/d4/f1a [3275790,81143] 0 2024-09-13T22:08:39.962 INFO:tasks.workunit.client.0.smithi089.stdout:6/269: creat d0/d5/d43/f53 x:0 0 0 2024-09-13T22:08:39.963 INFO:tasks.workunit.client.0.smithi089.stdout:1/320: creat d7/d34/d5c/f78 x:0 0 0 2024-09-13T22:08:39.963 INFO:tasks.workunit.client.0.smithi089.stdout:3/314: dread d1/d2/d24/f4b [4194304,4194304] 0 2024-09-13T22:08:39.966 INFO:tasks.workunit.client.0.smithi089.stdout:9/337: rmdir d6/d18/d33/d5a 39 2024-09-13T22:08:39.969 INFO:tasks.workunit.client.0.smithi089.stdout:6/270: mkdir d0/d5/d1d/d54 0 2024-09-13T22:08:39.970 INFO:tasks.workunit.client.0.smithi089.stdout:1/321: rename d7/de/d1b/d2b/d39/f3b to d7/d40/f79 0 2024-09-13T22:08:39.972 INFO:tasks.workunit.client.0.smithi089.stdout:9/338: mknod d6/d31/c7e 0 2024-09-13T22:08:39.972 INFO:tasks.workunit.client.0.smithi089.stdout:9/339: write d6/d18/d33/f49 [827242,22945] 0 2024-09-13T22:08:39.973 INFO:tasks.workunit.client.0.smithi089.stdout:4/257: getdents d0/d11 0 2024-09-13T22:08:39.974 INFO:tasks.workunit.client.0.smithi089.stdout:6/271: mkdir d0/d5/d1d/d2d/d55 0 2024-09-13T22:08:39.975 INFO:tasks.workunit.client.0.smithi089.stdout:6/272: dread - d0/d4/d12/d31/f34 zero size 2024-09-13T22:08:39.975 INFO:tasks.workunit.client.0.smithi089.stdout:4/258: mknod d0/d15/d1f/c4e 0 2024-09-13T22:08:39.978 INFO:tasks.workunit.client.0.smithi089.stdout:4/259: creat d0/d2c/d35/f4f x:0 0 0 2024-09-13T22:08:39.983 INFO:tasks.workunit.client.0.smithi089.stdout:1/322: write d7/f43 [420585,85118] 0 2024-09-13T22:08:39.984 INFO:tasks.workunit.client.0.smithi089.stdout:0/396: dwrite d1/de/d10/f45 [0,4194304] 0 2024-09-13T22:08:39.984 INFO:tasks.workunit.client.0.smithi089.stdout:0/397: fsync d1/de/d10/f45 0 2024-09-13T22:08:39.984 INFO:tasks.workunit.client.0.smithi089.stdout:6/273: rename d0/d4/d12/d31 to d0/d5/d1d/d56 0 2024-09-13T22:08:39.985 INFO:tasks.workunit.client.0.smithi089.stdout:9/340: write d6/d18/d1b/f26 [1853920,15253] 0 2024-09-13T22:08:39.985 INFO:tasks.workunit.client.0.smithi089.stdout:9/341: chown d6/d18/d33 27555 1 2024-09-13T22:08:39.987 INFO:tasks.workunit.client.0.smithi089.stdout:9/342: read d6/fc [290655,69573] 0 2024-09-13T22:08:39.988 INFO:tasks.workunit.client.0.smithi089.stdout:9/343: write d6/d18/d33/d39/f69 [382141,124261] 0 2024-09-13T22:08:39.990 INFO:tasks.workunit.client.0.smithi089.stdout:0/398: link d1/de/d10/f13 d1/de/d10/d36/d38/d4e/d62/d5f/d72/f83 0 2024-09-13T22:08:39.990 INFO:tasks.workunit.client.0.smithi089.stdout:6/274: stat d0/c3c 0 2024-09-13T22:08:39.990 INFO:tasks.workunit.client.0.smithi089.stdout:6/275: getdents d0/d5/d1d/d56/d4a/d4f 0 2024-09-13T22:08:39.990 INFO:tasks.workunit.client.0.smithi089.stdout:6/276: dread - d0/d5/d1d/d2d/f39 zero size 2024-09-13T22:08:39.991 INFO:tasks.workunit.client.0.smithi089.stdout:0/399: dread d1/de/d10/d36/d38/f70 [0,4194304] 0 2024-09-13T22:08:39.991 INFO:tasks.workunit.client.0.smithi089.stdout:0/400: write d1/de/d15/d41/f82 [692281,57495] 0 2024-09-13T22:08:39.998 INFO:tasks.workunit.client.0.smithi089.stdout:6/277: rmdir d0/d4 39 2024-09-13T22:08:39.998 INFO:tasks.workunit.client.0.smithi089.stdout:6/278: truncate d0/d5/d1d/f33 871599 0 2024-09-13T22:08:39.998 INFO:tasks.workunit.client.0.smithi089.stdout:6/279: fdatasync d0/d4/f40 0 2024-09-13T22:08:40.001 INFO:tasks.workunit.client.0.smithi089.stdout:8/313: sync 2024-09-13T22:08:40.001 INFO:tasks.workunit.client.0.smithi089.stdout:5/280: sync 2024-09-13T22:08:40.001 INFO:tasks.workunit.client.0.smithi089.stdout:2/303: sync 2024-09-13T22:08:40.001 INFO:tasks.workunit.client.0.smithi089.stdout:0/401: dread d1/de/d10/d36/d38/d4e/d62/f74 [0,4194304] 0 2024-09-13T22:08:40.001 INFO:tasks.workunit.client.0.smithi089.stdout:2/304: chown df/d1a/c39 21795211 1 2024-09-13T22:08:40.001 INFO:tasks.workunit.client.0.smithi089.stdout:5/281: dread - d4/d19/d1e/d28/d31/d55/d58/f5f zero size 2024-09-13T22:08:40.001 INFO:tasks.workunit.client.0.smithi089.stdout:5/282: chown d4/ce 1 1 2024-09-13T22:08:40.001 INFO:tasks.workunit.client.0.smithi089.stdout:0/402: creat d1/de/d1f/f84 x:0 0 0 2024-09-13T22:08:40.002 INFO:tasks.workunit.client.0.smithi089.stdout:6/280: rmdir d0/d5/d1d/d2d 39 2024-09-13T22:08:40.003 INFO:tasks.workunit.client.0.smithi089.stdout:5/283: creat d4/d19/d1e/d28/d31/d61/f6b x:0 0 0 2024-09-13T22:08:40.004 INFO:tasks.workunit.client.0.smithi089.stdout:6/281: getdents d0/d4 0 2024-09-13T22:08:40.004 INFO:tasks.workunit.client.0.smithi089.stdout:6/282: stat d0/d5/d1d/d56/f3f 0 2024-09-13T22:08:40.004 INFO:tasks.workunit.client.0.smithi089.stdout:5/284: rmdir d4/d19/d1e/d28/d31 39 2024-09-13T22:08:40.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/283: creat d0/d5/d1d/d2d/f57 x:0 0 0 2024-09-13T22:08:40.006 INFO:tasks.workunit.client.0.smithi089.stdout:0/403: dread d1/de/d10/d36/d38/d4e/d62/d5b/d5e/f6b [0,4194304] 0 2024-09-13T22:08:40.006 INFO:tasks.workunit.client.0.smithi089.stdout:2/305: dread df/d14/f65 [0,4194304] 0 2024-09-13T22:08:40.006 INFO:tasks.workunit.client.0.smithi089.stdout:0/404: truncate d1/de/f14 4198388 0 2024-09-13T22:08:40.008 INFO:tasks.workunit.client.0.smithi089.stdout:2/306: mknod df/d14/d66/c6a 0 2024-09-13T22:08:40.011 INFO:tasks.workunit.client.0.smithi089.stdout:0/405: rename d1/de/d56 to d1/de/d10/d85 0 2024-09-13T22:08:40.011 INFO:tasks.workunit.client.0.smithi089.stdout:0/406: chown d1/de/d10/d36/d57/d3a/l80 69 1 2024-09-13T22:08:40.011 INFO:tasks.workunit.client.0.smithi089.stdout:0/407: dread - d1/de/d10/f5d zero size 2024-09-13T22:08:40.011 INFO:tasks.workunit.client.0.smithi089.stdout:2/307: mknod df/d14/d2b/d4b/c6b 0 2024-09-13T22:08:40.013 INFO:tasks.workunit.client.0.smithi089.stdout:2/308: mknod df/d14/d66/d69/c6c 0 2024-09-13T22:08:40.013 INFO:tasks.workunit.client.0.smithi089.stdout:6/284: dread d0/d5/f7 [4194304,4194304] 0 2024-09-13T22:08:40.014 INFO:tasks.workunit.client.0.smithi089.stdout:0/408: rmdir d1/de/d15/d2a 39 2024-09-13T22:08:40.014 INFO:tasks.workunit.client.0.smithi089.stdout:0/409: chown d1/de/d10/d36/d39/c5a 229178245 1 2024-09-13T22:08:40.015 INFO:tasks.workunit.client.0.smithi089.stdout:0/410: creat d1/de/d10/d36/d38/f86 x:0 0 0 2024-09-13T22:08:40.015 INFO:tasks.workunit.client.0.smithi089.stdout:0/411: fdatasync d1/fd 0 2024-09-13T22:08:40.015 INFO:tasks.workunit.client.0.smithi089.stdout:0/412: chown d1/de/d10/d36/d57/d3a 11629 1 2024-09-13T22:08:40.015 INFO:tasks.workunit.client.0.smithi089.stdout:6/285: creat d0/d5/d1d/d56/d4a/f58 x:0 0 0 2024-09-13T22:08:40.015 INFO:tasks.workunit.client.0.smithi089.stdout:6/286: chown d0/d5/d1d/d56/d4b 3 1 2024-09-13T22:08:40.015 INFO:tasks.workunit.client.0.smithi089.stdout:6/287: read d0/d5/d1d/d56/f3a [111894,86548] 0 2024-09-13T22:08:40.015 INFO:tasks.workunit.client.0.smithi089.stdout:0/413: mkdir d1/de/d15/d41/d87 0 2024-09-13T22:08:40.015 INFO:tasks.workunit.client.0.smithi089.stdout:0/414: readlink d1/de/d15/l69 0 2024-09-13T22:08:40.016 INFO:tasks.workunit.client.0.smithi089.stdout:6/288: symlink d0/d5/d43/l59 0 2024-09-13T22:08:40.016 INFO:tasks.workunit.client.0.smithi089.stdout:6/289: write d0/d5/f21 [435085,16612] 0 2024-09-13T22:08:40.016 INFO:tasks.workunit.client.0.smithi089.stdout:6/290: fsync d0/f42 0 2024-09-13T22:08:40.017 INFO:tasks.workunit.client.0.smithi089.stdout:6/291: symlink d0/d5/d1d/l5a 0 2024-09-13T22:08:40.017 INFO:tasks.workunit.client.0.smithi089.stdout:0/415: dread d1/de/d15/f24 [0,4194304] 0 2024-09-13T22:08:40.018 INFO:tasks.workunit.client.0.smithi089.stdout:6/292: rename d0/d5/f14 to d0/d4/f5b 0 2024-09-13T22:08:40.018 INFO:tasks.workunit.client.0.smithi089.stdout:6/293: symlink d0/d5/d1d/d2d/d55/l5c 0 2024-09-13T22:08:40.019 INFO:tasks.workunit.client.0.smithi089.stdout:6/294: creat d0/d5/d1d/d54/f5d x:0 0 0 2024-09-13T22:08:40.020 INFO:tasks.workunit.client.0.smithi089.stdout:6/295: creat d0/d4/f5e x:0 0 0 2024-09-13T22:08:40.026 INFO:tasks.workunit.client.0.smithi089.stdout:4/260: dwrite d0/d11/f21 [0,4194304] 0 2024-09-13T22:08:40.026 INFO:tasks.workunit.client.0.smithi089.stdout:1/323: dwrite d7/d34/d5c/d5d/f62 [0,4194304] 0 2024-09-13T22:08:40.026 INFO:tasks.workunit.client.0.smithi089.stdout:4/261: truncate d0/d15/f4d 450633 0 2024-09-13T22:08:40.026 INFO:tasks.workunit.client.0.smithi089.stdout:4/262: write d0/d15/f2e [418801,95403] 0 2024-09-13T22:08:40.028 INFO:tasks.workunit.client.0.smithi089.stdout:9/344: dwrite d6/f51 [0,4194304] 0 2024-09-13T22:08:40.028 INFO:tasks.workunit.client.0.smithi089.stdout:8/314: dwrite d0/dd/d12/d3a/f43 [0,4194304] 0 2024-09-13T22:08:40.029 INFO:tasks.workunit.client.0.smithi089.stdout:8/315: fdatasync d0/dd/d11/f25 0 2024-09-13T22:08:40.029 INFO:tasks.workunit.client.0.smithi089.stdout:8/316: fsync d0/dd/d12/d20/f18 0 2024-09-13T22:08:40.029 INFO:tasks.workunit.client.0.smithi089.stdout:1/324: mkdir d7/d1c/d7a 0 2024-09-13T22:08:40.030 INFO:tasks.workunit.client.0.smithi089.stdout:4/263: link d0/d2c/d35/c37 d0/d11/c50 0 2024-09-13T22:08:40.030 INFO:tasks.workunit.client.0.smithi089.stdout:4/264: creat d0/d2c/d35/f51 x:0 0 0 2024-09-13T22:08:40.033 INFO:tasks.workunit.client.0.smithi089.stdout:9/345: mknod d6/d31/d64/c7f 0 2024-09-13T22:08:40.033 INFO:tasks.workunit.client.0.smithi089.stdout:9/346: stat d6/d18/d1b/c2d 0 2024-09-13T22:08:40.038 INFO:tasks.workunit.client.0.smithi089.stdout:6/296: dwrite d0/d5/d1d/d54/f5d [0,4194304] 0 2024-09-13T22:08:40.043 INFO:tasks.workunit.client.0.smithi089.stdout:8/317: rmdir d0/dd/d12/d20/d1c 39 2024-09-13T22:08:40.046 INFO:tasks.workunit.client.0.smithi089.stdout:1/325: creat d7/de/d3a/f7b x:0 0 0 2024-09-13T22:08:40.046 INFO:tasks.workunit.client.0.smithi089.stdout:1/326: chown d7/d1c/d3c/f3f 5177565 1 2024-09-13T22:08:40.048 INFO:tasks.workunit.client.0.smithi089.stdout:0/416: write d1/f11 [1378859,90864] 0 2024-09-13T22:08:40.049 INFO:tasks.workunit.client.0.smithi089.stdout:0/417: write d1/de/d15/d41/f82 [506508,115141] 0 2024-09-13T22:08:40.049 INFO:tasks.workunit.client.0.smithi089.stdout:0/418: fdatasync d1/de/d10/f13 0 2024-09-13T22:08:40.052 INFO:tasks.workunit.client.0.smithi089.stdout:4/265: truncate d0/d15/d1f/f31 467552 0 2024-09-13T22:08:40.052 INFO:tasks.workunit.client.0.smithi089.stdout:4/266: write d0/d11/f30 [12366,20913] 0 2024-09-13T22:08:40.054 INFO:tasks.workunit.client.0.smithi089.stdout:4/267: mkdir d0/d2c/d52 0 2024-09-13T22:08:40.055 INFO:tasks.workunit.client.0.smithi089.stdout:4/268: stat d0/d15/f2e 0 2024-09-13T22:08:40.055 INFO:tasks.workunit.client.0.smithi089.stdout:4/269: fdatasync d0/d2c/f45 0 2024-09-13T22:08:40.056 INFO:tasks.workunit.client.0.smithi089.stdout:4/270: mknod d0/d15/c53 0 2024-09-13T22:08:40.056 INFO:tasks.workunit.client.0.smithi089.stdout:4/271: fdatasync d0/d2c/d35/f49 0 2024-09-13T22:08:40.056 INFO:tasks.workunit.client.0.smithi089.stdout:4/272: write d0/f13 [1498149,76382] 0 2024-09-13T22:08:40.058 INFO:tasks.workunit.client.0.smithi089.stdout:4/273: creat d0/d2c/d52/f54 x:0 0 0 2024-09-13T22:08:40.058 INFO:tasks.workunit.client.0.smithi089.stdout:4/274: truncate d0/d11/d16/d24/f43 884820 0 2024-09-13T22:08:40.059 INFO:tasks.workunit.client.0.smithi089.stdout:7/274: sync 2024-09-13T22:08:40.059 INFO:tasks.workunit.client.0.smithi089.stdout:4/275: creat d0/d11/f55 x:0 0 0 2024-09-13T22:08:40.064 INFO:tasks.workunit.client.0.smithi089.stdout:9/347: dwrite d6/ff [0,4194304] 0 2024-09-13T22:08:40.064 INFO:tasks.workunit.client.0.smithi089.stdout:9/348: write d6/d18/d21/f44 [2554984,88172] 0 2024-09-13T22:08:40.065 INFO:tasks.workunit.client.0.smithi089.stdout:9/349: mknod d6/d18/d1b/d3e/c80 0 2024-09-13T22:08:40.066 INFO:tasks.workunit.client.0.smithi089.stdout:9/350: creat d6/f81 x:0 0 0 2024-09-13T22:08:40.069 INFO:tasks.workunit.client.0.smithi089.stdout:7/275: write d0/ff [1920689,7039] 0 2024-09-13T22:08:40.069 INFO:tasks.workunit.client.0.smithi089.stdout:7/276: chown d0/d19/d28/d1d 18 1 2024-09-13T22:08:40.070 INFO:tasks.workunit.client.0.smithi089.stdout:7/277: creat d0/d19/d28/d1d/d30/f59 x:0 0 0 2024-09-13T22:08:40.070 INFO:tasks.workunit.client.0.smithi089.stdout:0/419: dwrite d1/f4 [4194304,4194304] 0 2024-09-13T22:08:40.070 INFO:tasks.workunit.client.0.smithi089.stdout:7/278: write d0/fd [591415,120845] 0 2024-09-13T22:08:40.071 INFO:tasks.workunit.client.0.smithi089.stdout:8/318: dwrite d0/dd/d12/d20/d36/d57/f60 [0,4194304] 0 2024-09-13T22:08:40.071 INFO:tasks.workunit.client.0.smithi089.stdout:8/319: truncate d0/dd/d12/d42/f39 4830305 0 2024-09-13T22:08:40.071 INFO:tasks.workunit.client.0.smithi089.stdout:8/320: stat d0/dd/d12/d20/d32/f41 0 2024-09-13T22:08:40.071 INFO:tasks.workunit.client.0.smithi089.stdout:0/420: link d1/de/d10/d36/f66 d1/de/d1f/f88 0 2024-09-13T22:08:40.073 INFO:tasks.workunit.client.0.smithi089.stdout:4/276: getdents d0/d2c/d52 0 2024-09-13T22:08:40.073 INFO:tasks.workunit.client.0.smithi089.stdout:4/277: dread - d0/f3e zero size 2024-09-13T22:08:40.075 INFO:tasks.workunit.client.0.smithi089.stdout:0/421: creat d1/de/d15/f89 x:0 0 0 2024-09-13T22:08:40.075 INFO:tasks.workunit.client.0.smithi089.stdout:0/422: chown d1/de/d10/d36/d38/d4e/d62/f74 105 1 2024-09-13T22:08:40.075 INFO:tasks.workunit.client.0.smithi089.stdout:8/321: dread d0/dd/d12/d20/d36/f26 [0,4194304] 0 2024-09-13T22:08:40.075 INFO:tasks.workunit.client.0.smithi089.stdout:4/278: symlink d0/d2c/l56 0 2024-09-13T22:08:40.078 INFO:tasks.workunit.client.0.smithi089.stdout:4/279: symlink d0/d11/d16/d24/l57 0 2024-09-13T22:08:40.080 INFO:tasks.workunit.client.0.smithi089.stdout:4/280: link d0/d11/c28 d0/c58 0 2024-09-13T22:08:40.081 INFO:tasks.workunit.client.0.smithi089.stdout:4/281: symlink d0/d15/l59 0 2024-09-13T22:08:40.083 INFO:tasks.workunit.client.0.smithi089.stdout:4/282: creat d0/d2c/d52/f5a x:0 0 0 2024-09-13T22:08:40.085 INFO:tasks.workunit.client.0.smithi089.stdout:4/283: link d0/d15/c34 d0/d2c/d35/c5b 0 2024-09-13T22:08:40.090 INFO:tasks.workunit.client.0.smithi089.stdout:0/423: dread d1/de/d15/d41/f82 [0,4194304] 0 2024-09-13T22:08:40.091 INFO:tasks.workunit.client.0.smithi089.stdout:8/322: read d0/dd/d12/f1a [1585063,50106] 0 2024-09-13T22:08:40.091 INFO:tasks.workunit.client.0.smithi089.stdout:0/424: rmdir d1/de/d10/d36/d38/d4e/d62/d5f 39 2024-09-13T22:08:40.093 INFO:tasks.workunit.client.0.smithi089.stdout:8/323: mknod d0/dd/d12/d20/d36/d59/c6d 0 2024-09-13T22:08:40.095 INFO:tasks.workunit.client.0.smithi089.stdout:8/324: symlink d0/dd/d12/d20/d1c/d5a/d63/l6e 0 2024-09-13T22:08:40.096 INFO:tasks.workunit.client.0.smithi089.stdout:7/279: dwrite d0/d19/f2b [0,4194304] 0 2024-09-13T22:08:40.096 INFO:tasks.workunit.client.0.smithi089.stdout:9/351: dwrite d6/d18/d21/f77 [0,4194304] 0 2024-09-13T22:08:40.096 INFO:tasks.workunit.client.0.smithi089.stdout:9/352: chown d6/d55/f6a 254127425 1 2024-09-13T22:08:40.096 INFO:tasks.workunit.client.0.smithi089.stdout:9/353: stat d6/d18/f1d 0 2024-09-13T22:08:40.097 INFO:tasks.workunit.client.0.smithi089.stdout:8/325: truncate d0/dd/f49 8035950 0 2024-09-13T22:08:40.097 INFO:tasks.workunit.client.0.smithi089.stdout:8/326: stat d0/dd/d12/d20/d1c/d5a/d63/l6e 0 2024-09-13T22:08:40.101 INFO:tasks.workunit.client.0.smithi089.stdout:9/354: creat d6/d18/d1b/f82 x:0 0 0 2024-09-13T22:08:40.101 INFO:tasks.workunit.client.0.smithi089.stdout:9/355: chown d6/d18/d33/f49 414197 1 2024-09-13T22:08:40.101 INFO:tasks.workunit.client.0.smithi089.stdout:9/356: creat d6/d18/d21/f83 x:0 0 0 2024-09-13T22:08:40.102 INFO:tasks.workunit.client.0.smithi089.stdout:8/327: mkdir d0/d6a/d6f 0 2024-09-13T22:08:40.105 INFO:tasks.workunit.client.0.smithi089.stdout:9/357: truncate d6/d18/f36 798129 0 2024-09-13T22:08:40.105 INFO:tasks.workunit.client.0.smithi089.stdout:9/358: fsync d6/d18/d33/f42 0 2024-09-13T22:08:40.106 INFO:tasks.workunit.client.0.smithi089.stdout:8/328: stat d0/dd/d12/d20/d36/l28 0 2024-09-13T22:08:40.106 INFO:tasks.workunit.client.0.smithi089.stdout:4/284: dwrite d0/d11/d16/d24/f43 [0,4194304] 0 2024-09-13T22:08:40.107 INFO:tasks.workunit.client.0.smithi089.stdout:4/285: read d0/f13 [2736703,10391] 0 2024-09-13T22:08:40.108 INFO:tasks.workunit.client.0.smithi089.stdout:9/359: truncate d6/d18/d21/f34 821281 0 2024-09-13T22:08:40.109 INFO:tasks.workunit.client.0.smithi089.stdout:8/329: mkdir d0/dd/d12/d20/d32/d70 0 2024-09-13T22:08:40.109 INFO:tasks.workunit.client.0.smithi089.stdout:8/330: dread - d0/dd/d12/d42/f2c zero size 2024-09-13T22:08:40.109 INFO:tasks.workunit.client.0.smithi089.stdout:8/331: write d0/dd/d12/d20/d1c/f2f [2026450,76626] 0 2024-09-13T22:08:40.109 INFO:tasks.workunit.client.0.smithi089.stdout:8/332: chown d0/dd/d12/d20/d36/d57/c5f 217 1 2024-09-13T22:08:40.114 INFO:tasks.workunit.client.0.smithi089.stdout:3/315: sync 2024-09-13T22:08:40.114 INFO:tasks.workunit.client.0.smithi089.stdout:3/316: truncate d1/d2/d4/f9 783589 0 2024-09-13T22:08:40.116 INFO:tasks.workunit.client.0.smithi089.stdout:0/425: dwrite d1/de/d10/d36/d39/f47 [0,4194304] 0 2024-09-13T22:08:40.116 INFO:tasks.workunit.client.0.smithi089.stdout:8/333: link d0/dd/d12/d42/f5e d0/dd/d12/d20/d40/f71 0 2024-09-13T22:08:40.122 INFO:tasks.workunit.client.0.smithi089.stdout:9/360: write d6/d18/d1b/f2e [3056497,84872] 0 2024-09-13T22:08:40.122 INFO:tasks.workunit.client.0.smithi089.stdout:9/361: fdatasync d6/d31/d5e/f7d 0 2024-09-13T22:08:40.122 INFO:tasks.workunit.client.0.smithi089.stdout:0/426: symlink d1/de/d10/d36/d38/d4e/d62/d5f/d72/l8a 0 2024-09-13T22:08:40.123 INFO:tasks.workunit.client.0.smithi089.stdout:8/334: symlink d0/dd/d12/d20/l72 0 2024-09-13T22:08:40.123 INFO:tasks.workunit.client.0.smithi089.stdout:9/362: write d6/d18/d21/f34 [1133247,70864] 0 2024-09-13T22:08:40.124 INFO:tasks.workunit.client.0.smithi089.stdout:0/427: unlink d1/de/d15/d41/f82 0 2024-09-13T22:08:40.124 INFO:tasks.workunit.client.0.smithi089.stdout:0/428: readlink d1/de/d10/d36/d38/d4e/d62/d5f/d72/l8a 0 2024-09-13T22:08:40.124 INFO:tasks.workunit.client.0.smithi089.stdout:0/429: chown d1/de/d15/d2a/c2e 466 1 2024-09-13T22:08:40.124 INFO:tasks.workunit.client.0.smithi089.stdout:0/430: fsync d1/de/d10/d36/d3d/f43 0 2024-09-13T22:08:40.124 INFO:tasks.workunit.client.0.smithi089.stdout:0/431: chown d1/c2 114952155 1 2024-09-13T22:08:40.125 INFO:tasks.workunit.client.0.smithi089.stdout:0/432: fsync d1/de/d15/d2a/f81 0 2024-09-13T22:08:40.125 INFO:tasks.workunit.client.0.smithi089.stdout:8/335: getdents d0/dd/d12/d20/d1c 0 2024-09-13T22:08:40.126 INFO:tasks.workunit.client.0.smithi089.stdout:4/286: dwrite d0/d2c/d52/f5a [0,4194304] 0 2024-09-13T22:08:40.126 INFO:tasks.workunit.client.0.smithi089.stdout:4/287: write d0/f23 [1291069,89467] 0 2024-09-13T22:08:40.126 INFO:tasks.workunit.client.0.smithi089.stdout:4/288: dread - d0/d2c/d35/f51 zero size 2024-09-13T22:08:40.126 INFO:tasks.workunit.client.0.smithi089.stdout:9/363: getdents d6/d54 0 2024-09-13T22:08:40.127 INFO:tasks.workunit.client.0.smithi089.stdout:0/433: mkdir d1/de/d15/d41/d49/d76/d8b 0 2024-09-13T22:08:40.129 INFO:tasks.workunit.client.0.smithi089.stdout:8/336: mkdir d0/d6a/d73 0 2024-09-13T22:08:40.129 INFO:tasks.workunit.client.0.smithi089.stdout:8/337: dread - d0/dd/d12/d42/f2c zero size 2024-09-13T22:08:40.129 INFO:tasks.workunit.client.0.smithi089.stdout:8/338: write d0/dd/d11/f2d [1751985,27559] 0 2024-09-13T22:08:40.131 INFO:tasks.workunit.client.0.smithi089.stdout:4/289: rename d0/d15/l1e to d0/d15/l5c 0 2024-09-13T22:08:40.132 INFO:tasks.workunit.client.0.smithi089.stdout:0/434: symlink d1/de/d10/d36/d38/d4e/d62/d5f/l8c 0 2024-09-13T22:08:40.133 INFO:tasks.workunit.client.0.smithi089.stdout:8/339: creat d0/dd/d12/d20/d1c/d5a/f74 x:0 0 0 2024-09-13T22:08:40.135 INFO:tasks.workunit.client.0.smithi089.stdout:4/290: mkdir d0/d2c/d35/d5d 0 2024-09-13T22:08:40.135 INFO:tasks.workunit.client.0.smithi089.stdout:4/291: dread - d0/d2c/d52/f54 zero size 2024-09-13T22:08:40.135 INFO:tasks.workunit.client.0.smithi089.stdout:4/292: fsync d0/d11/d16/f2d 0 2024-09-13T22:08:40.135 INFO:tasks.workunit.client.0.smithi089.stdout:9/364: write d6/d31/d5e/f79 [1870887,92890] 0 2024-09-13T22:08:40.136 INFO:tasks.workunit.client.0.smithi089.stdout:3/317: dwrite d1/d2/f29 [0,4194304] 0 2024-09-13T22:08:40.136 INFO:tasks.workunit.client.0.smithi089.stdout:0/435: link d1/f4 d1/de/d15/f8d 0 2024-09-13T22:08:40.137 INFO:tasks.workunit.client.0.smithi089.stdout:9/365: symlink d6/d55/l84 0 2024-09-13T22:08:40.137 INFO:tasks.workunit.client.0.smithi089.stdout:9/366: write d6/d18/d21/f27 [2976543,89528] 0 2024-09-13T22:08:40.137 INFO:tasks.workunit.client.0.smithi089.stdout:9/367: stat d6/f51 0 2024-09-13T22:08:40.138 INFO:tasks.workunit.client.0.smithi089.stdout:3/318: creat d1/d2/d23/d3d/d46/f68 x:0 0 0 2024-09-13T22:08:40.138 INFO:tasks.workunit.client.0.smithi089.stdout:3/319: chown d1/d2/d18/d38/f53 1677108 1 2024-09-13T22:08:40.138 INFO:tasks.workunit.client.0.smithi089.stdout:3/320: chown d1/d3a 84 1 2024-09-13T22:08:40.141 INFO:tasks.workunit.client.0.smithi089.stdout:9/368: truncate d6/f14 366316 0 2024-09-13T22:08:40.143 INFO:tasks.workunit.client.0.smithi089.stdout:3/321: mkdir d1/d2/d18/d40/d69 0 2024-09-13T22:08:40.143 INFO:tasks.workunit.client.0.smithi089.stdout:3/322: write d1/d2/d23/d2b/f5b [55823,91775] 0 2024-09-13T22:08:40.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/340: read d0/dd/d12/d20/d32/f41 [100696,110859] 0 2024-09-13T22:08:40.146 INFO:tasks.workunit.client.0.smithi089.stdout:9/369: dread d6/d55/f75 [0,4194304] 0 2024-09-13T22:08:40.146 INFO:tasks.workunit.client.0.smithi089.stdout:9/370: chown d6/d54/l74 21865155 1 2024-09-13T22:08:40.147 INFO:tasks.workunit.client.0.smithi089.stdout:4/293: write d0/d11/d16/f2d [3770176,98639] 0 2024-09-13T22:08:40.147 INFO:tasks.workunit.client.0.smithi089.stdout:4/294: stat d0/d15/f4d 0 2024-09-13T22:08:40.147 INFO:tasks.workunit.client.0.smithi089.stdout:4/295: dread - d0/d11/d16/d24/f32 zero size 2024-09-13T22:08:40.148 INFO:tasks.workunit.client.0.smithi089.stdout:8/341: unlink d0/dd/d12/d20/d36/f26 0 2024-09-13T22:08:40.148 INFO:tasks.workunit.client.0.smithi089.stdout:8/342: read - d0/dd/f46 zero size 2024-09-13T22:08:40.148 INFO:tasks.workunit.client.0.smithi089.stdout:0/436: dread d1/de/d10/d36/d38/d4e/d62/d5f/d72/f83 [0,4194304] 0 2024-09-13T22:08:40.149 INFO:tasks.workunit.client.0.smithi089.stdout:4/296: mknod d0/d2c/d35/d5d/c5e 0 2024-09-13T22:08:40.150 INFO:tasks.workunit.client.0.smithi089.stdout:0/437: creat d1/de/d15/d41/d49/d76/f8e x:0 0 0 2024-09-13T22:08:40.151 INFO:tasks.workunit.client.0.smithi089.stdout:5/285: sync 2024-09-13T22:08:40.152 INFO:tasks.workunit.client.0.smithi089.stdout:5/286: dread - d4/d19/d1e/d28/d3d/f57 zero size 2024-09-13T22:08:40.152 INFO:tasks.workunit.client.0.smithi089.stdout:4/297: rename d0/d11/f18 to d0/d2c/f5f 0 2024-09-13T22:08:40.152 INFO:tasks.workunit.client.0.smithi089.stdout:4/298: write d0/d2c/d52/f54 [1010459,59762] 0 2024-09-13T22:08:40.157 INFO:tasks.workunit.client.0.smithi089.stdout:9/371: write d6/f2b [3964360,123723] 0 2024-09-13T22:08:40.157 INFO:tasks.workunit.client.0.smithi089.stdout:9/372: creat d6/d18/d21/d5d/d6c/f85 x:0 0 0 2024-09-13T22:08:40.157 INFO:tasks.workunit.client.0.smithi089.stdout:9/373: chown d6/d18/d21/d5d 1 1 2024-09-13T22:08:40.161 INFO:tasks.workunit.client.0.smithi089.stdout:9/374: mknod d6/d18/d21/d5d/c86 0 2024-09-13T22:08:40.161 INFO:tasks.workunit.client.0.smithi089.stdout:9/375: fdatasync d6/d55/f6a 0 2024-09-13T22:08:40.168 INFO:tasks.workunit.client.0.smithi089.stdout:9/376: symlink d6/l87 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:8/343: dwrite d0/dd/d12/d20/f18 [0,4194304] 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:0/438: dwrite d1/de/d15/d2a/f31 [0,4194304] 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:0/439: stat d1/de/d10/d36/d39 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:3/323: dwrite d1/d2/ff [0,4194304] 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:9/377: dwrite d6/d55/f6d [0,4194304] 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:4/299: dwrite d0/d2c/f5f [0,4194304] 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:5/287: dwrite d4/d19/f24 [4194304,4194304] 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:4/300: readlink d0/d11/d16/l4b 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:4/301: stat d0/d2c/d35/f51 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:4/302: truncate d0/d2c/d35/f49 1566127 0 2024-09-13T22:08:40.200 INFO:tasks.workunit.client.0.smithi089.stdout:5/288: write d4/d19/d1e/d28/d31/f40 [807494,40931] 0 2024-09-13T22:08:40.201 INFO:tasks.workunit.client.0.smithi089.stdout:4/303: write d0/d11/d16/d24/f32 [807752,41916] 0 2024-09-13T22:08:40.201 INFO:tasks.workunit.client.0.smithi089.stdout:8/344: unlink d0/dd/d12/d20/d1c/c62 0 2024-09-13T22:08:40.202 INFO:tasks.workunit.client.0.smithi089.stdout:0/440: unlink d1/f4 0 2024-09-13T22:08:40.208 INFO:tasks.workunit.client.0.smithi089.stdout:3/324: unlink d1/d2/d24/f4b 0 2024-09-13T22:08:40.208 INFO:tasks.workunit.client.0.smithi089.stdout:3/325: write d1/d7/d1b/f4e [561735,34551] 0 2024-09-13T22:08:40.209 INFO:tasks.workunit.client.0.smithi089.stdout:5/289: symlink d4/d19/d1e/d53/l6c 0 2024-09-13T22:08:40.210 INFO:tasks.workunit.client.0.smithi089.stdout:8/345: symlink d0/d6a/d73/l75 0 2024-09-13T22:08:40.211 INFO:tasks.workunit.client.0.smithi089.stdout:4/304: read d0/f6 [320715,104227] 0 2024-09-13T22:08:40.212 INFO:tasks.workunit.client.0.smithi089.stdout:5/290: unlink d4/c25 0 2024-09-13T22:08:40.212 INFO:tasks.workunit.client.0.smithi089.stdout:5/291: creat d4/d19/d1e/d28/d31/d55/f6d x:0 0 0 2024-09-13T22:08:40.212 INFO:tasks.workunit.client.0.smithi089.stdout:5/292: chown d4/d19/d1e/d28/d31/f40 2632 1 2024-09-13T22:08:40.212 INFO:tasks.workunit.client.0.smithi089.stdout:5/293: chown d4/d19/d1e/d28/l2c 10363 1 2024-09-13T22:08:40.217 INFO:tasks.workunit.client.0.smithi089.stdout:5/294: write d4/d19/d1e/d28/d31/d35/f47 [2164841,59422] 0 2024-09-13T22:08:40.220 INFO:tasks.workunit.client.0.smithi089.stdout:7/280: sync 2024-09-13T22:08:40.221 INFO:tasks.workunit.client.0.smithi089.stdout:2/309: sync 2024-09-13T22:08:40.221 INFO:tasks.workunit.client.0.smithi089.stdout:6/297: sync 2024-09-13T22:08:40.221 INFO:tasks.workunit.client.0.smithi089.stdout:2/310: chown df/l13 9385066 1 2024-09-13T22:08:40.221 INFO:tasks.workunit.client.0.smithi089.stdout:2/311: stat df/d14/f24 0 2024-09-13T22:08:40.221 INFO:tasks.workunit.client.0.smithi089.stdout:2/312: fdatasync df/f22 0 2024-09-13T22:08:40.221 INFO:tasks.workunit.client.0.smithi089.stdout:2/313: readlink df/l4d 0 2024-09-13T22:08:40.221 INFO:tasks.workunit.client.0.smithi089.stdout:1/327: sync 2024-09-13T22:08:40.225 INFO:tasks.workunit.client.0.smithi089.stdout:8/346: dread d0/dd/d12/d3a/f43 [0,4194304] 0 2024-09-13T22:08:40.227 INFO:tasks.workunit.client.0.smithi089.stdout:2/314: link df/c19 df/d5b/c6d 0 2024-09-13T22:08:40.227 INFO:tasks.workunit.client.0.smithi089.stdout:3/326: dread d1/f6 [0,4194304] 0 2024-09-13T22:08:40.227 INFO:tasks.workunit.client.0.smithi089.stdout:0/441: dwrite d1/de/f46 [0,4194304] 0 2024-09-13T22:08:40.227 INFO:tasks.workunit.client.0.smithi089.stdout:0/442: creat d1/f8f x:0 0 0 2024-09-13T22:08:40.228 INFO:tasks.workunit.client.0.smithi089.stdout:6/298: symlink d0/d5/d1d/d56/d4a/l5f 0 2024-09-13T22:08:40.228 INFO:tasks.workunit.client.0.smithi089.stdout:6/299: fsync d0/d5/d1d/d56/f34 0 2024-09-13T22:08:40.232 INFO:tasks.workunit.client.0.smithi089.stdout:8/347: rename d0/dd/d12/d20/d32/l45 to d0/d6a/d73/l76 0 2024-09-13T22:08:40.232 INFO:tasks.workunit.client.0.smithi089.stdout:3/327: rename d1 to d1/d2/d23/d2b/d6a 22 2024-09-13T22:08:40.233 INFO:tasks.workunit.client.0.smithi089.stdout:9/378: dwrite d6/f15 [0,4194304] 0 2024-09-13T22:08:40.234 INFO:tasks.workunit.client.0.smithi089.stdout:1/328: dread d7/de/d1b/d2b/f2e [0,4194304] 0 2024-09-13T22:08:40.235 INFO:tasks.workunit.client.0.smithi089.stdout:4/305: dwrite d0/d15/f4d [0,4194304] 0 2024-09-13T22:08:40.236 INFO:tasks.workunit.client.0.smithi089.stdout:4/306: chown d0/l10 2692 1 2024-09-13T22:08:40.237 INFO:tasks.workunit.client.0.smithi089.stdout:5/295: rmdir d4 39 2024-09-13T22:08:40.237 INFO:tasks.workunit.client.0.smithi089.stdout:5/296: readlink d4/d19/d1e/d28/l34 0 2024-09-13T22:08:40.239 INFO:tasks.workunit.client.0.smithi089.stdout:6/300: unlink d0/d5/d1d/d56/d28/l36 0 2024-09-13T22:08:40.240 INFO:tasks.workunit.client.0.smithi089.stdout:2/315: dread df/d14/d66/d69/f51 [4194304,4194304] 0 2024-09-13T22:08:40.248 INFO:tasks.workunit.client.0.smithi089.stdout:1/329: creat d7/de/d3a/d77/f7c x:0 0 0 2024-09-13T22:08:40.249 INFO:tasks.workunit.client.0.smithi089.stdout:1/330: truncate d7/de/d1b/f58 973001 0 2024-09-13T22:08:40.252 INFO:tasks.workunit.client.0.smithi089.stdout:4/307: rename d0/d11/d16/d24/f43 to d0/d2c/d35/d5d/f60 0 2024-09-13T22:08:40.255 INFO:tasks.workunit.client.0.smithi089.stdout:8/348: dwrite d0/dd/d12/d20/d32/f44 [0,4194304] 0 2024-09-13T22:08:40.255 INFO:tasks.workunit.client.0.smithi089.stdout:8/349: dread - d0/dd/d12/d3a/f5b zero size 2024-09-13T22:08:40.255 INFO:tasks.workunit.client.0.smithi089.stdout:8/350: creat d0/dd/d12/d42/f77 x:0 0 0 2024-09-13T22:08:40.256 INFO:tasks.workunit.client.0.smithi089.stdout:5/297: unlink d4/d19/f21 0 2024-09-13T22:08:40.256 INFO:tasks.workunit.client.0.smithi089.stdout:5/298: chown d4/d19/d1e/d28/d3d/d5e 157754 1 2024-09-13T22:08:40.256 INFO:tasks.workunit.client.0.smithi089.stdout:0/443: stat d1/de/d15/d2a/c35 0 2024-09-13T22:08:40.257 INFO:tasks.workunit.client.0.smithi089.stdout:6/301: mkdir d0/d5/d1d/d56/d60 0 2024-09-13T22:08:40.257 INFO:tasks.workunit.client.0.smithi089.stdout:6/302: write d0/d4/f5e [374236,22703] 0 2024-09-13T22:08:40.257 INFO:tasks.workunit.client.0.smithi089.stdout:2/316: truncate df/f26 1249466 0 2024-09-13T22:08:40.258 INFO:tasks.workunit.client.0.smithi089.stdout:1/331: rename d7/de/d1b/d2b/d39/c52 to d7/d1c/c7d 0 2024-09-13T22:08:40.262 INFO:tasks.workunit.client.0.smithi089.stdout:9/379: dwrite d6/d18/d1b/f2e [0,4194304] 0 2024-09-13T22:08:40.262 INFO:tasks.workunit.client.0.smithi089.stdout:8/351: mknod d0/dd/d12/d20/d36/d57/c78 0 2024-09-13T22:08:40.265 INFO:tasks.workunit.client.0.smithi089.stdout:6/303: symlink d0/d5/d1d/d2d/l61 0 2024-09-13T22:08:40.265 INFO:tasks.workunit.client.0.smithi089.stdout:5/299: dread d4/f8 [0,4194304] 0 2024-09-13T22:08:40.267 INFO:tasks.workunit.client.0.smithi089.stdout:2/317: link df/d14/d66/d69/d2e/f3c df/d14/d66/f6e 0 2024-09-13T22:08:40.267 INFO:tasks.workunit.client.0.smithi089.stdout:2/318: chown df/d14/d2b/c5a 4816610 1 2024-09-13T22:08:40.269 INFO:tasks.workunit.client.0.smithi089.stdout:8/352: mkdir d0/dd/d12/d20/d79 0 2024-09-13T22:08:40.270 INFO:tasks.workunit.client.0.smithi089.stdout:6/304: mkdir d0/d4/d12/d15/d3b/d62 0 2024-09-13T22:08:40.270 INFO:tasks.workunit.client.0.smithi089.stdout:6/305: write d0/d4/f5b [2173798,14066] 0 2024-09-13T22:08:40.270 INFO:tasks.workunit.client.0.smithi089.stdout:6/306: fsync d0/d5/f21 0 2024-09-13T22:08:40.272 INFO:tasks.workunit.client.0.smithi089.stdout:5/300: unlink d4/d19/d1e/d28/d3d/c59 0 2024-09-13T22:08:40.272 INFO:tasks.workunit.client.0.smithi089.stdout:1/332: write d7/de/d1b/d2b/d39/f4c [2581086,89925] 0 2024-09-13T22:08:40.272 INFO:tasks.workunit.client.0.smithi089.stdout:1/333: fsync d7/de/f11 0 2024-09-13T22:08:40.273 INFO:tasks.workunit.client.0.smithi089.stdout:8/353: creat d0/dd/d12/d20/d40/d4a/f7a x:0 0 0 2024-09-13T22:08:40.273 INFO:tasks.workunit.client.0.smithi089.stdout:8/354: rename d0/dd/d12/d20/d36 to d0/dd/d12/d20/d36/d68/d7b 22 2024-09-13T22:08:40.274 INFO:tasks.workunit.client.0.smithi089.stdout:0/444: write d1/de/f3e [7116009,41314] 0 2024-09-13T22:08:40.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/307: stat d0/d5/d1d/c45 0 2024-09-13T22:08:40.277 INFO:tasks.workunit.client.0.smithi089.stdout:5/301: creat d4/d19/d1e/d28/d31/d35/d46/f6e x:0 0 0 2024-09-13T22:08:40.279 INFO:tasks.workunit.client.0.smithi089.stdout:4/308: dwrite d0/fd [0,4194304] 0 2024-09-13T22:08:40.280 INFO:tasks.workunit.client.0.smithi089.stdout:1/334: creat d7/d34/f7e x:0 0 0 2024-09-13T22:08:40.280 INFO:tasks.workunit.client.0.smithi089.stdout:1/335: write d7/de/d1b/d2b/d59/f67 [222049,36431] 0 2024-09-13T22:08:40.280 INFO:tasks.workunit.client.0.smithi089.stdout:1/336: dread - d7/de/d3a/f7b zero size 2024-09-13T22:08:40.280 INFO:tasks.workunit.client.0.smithi089.stdout:3/328: dwrite d1/d2/d23/d3d/f4d [0,4194304] 0 2024-09-13T22:08:40.282 INFO:tasks.workunit.client.0.smithi089.stdout:8/355: mknod d0/dd/d12/d20/d1c/d5a/c7c 0 2024-09-13T22:08:40.283 INFO:tasks.workunit.client.0.smithi089.stdout:0/445: stat d1/de/d10/d36/d39/f4f 0 2024-09-13T22:08:40.284 INFO:tasks.workunit.client.0.smithi089.stdout:6/308: symlink d0/d5/d1d/d2d/d55/l63 0 2024-09-13T22:08:40.285 INFO:tasks.workunit.client.0.smithi089.stdout:5/302: creat d4/d19/f6f x:0 0 0 2024-09-13T22:08:40.285 INFO:tasks.workunit.client.0.smithi089.stdout:1/337: dread d7/de/d1b/d2b/f2e [0,4194304] 0 2024-09-13T22:08:40.290 INFO:tasks.workunit.client.0.smithi089.stdout:8/356: creat d0/dd/f7d x:0 0 0 2024-09-13T22:08:40.290 INFO:tasks.workunit.client.0.smithi089.stdout:8/357: write d0/dd/d12/d20/d36/f21 [2867578,59079] 0 2024-09-13T22:08:40.291 INFO:tasks.workunit.client.0.smithi089.stdout:2/319: dwrite df/d14/f25 [0,4194304] 0 2024-09-13T22:08:40.291 INFO:tasks.workunit.client.0.smithi089.stdout:6/309: mkdir d0/d5/d64 0 2024-09-13T22:08:40.293 INFO:tasks.workunit.client.0.smithi089.stdout:5/303: rename c1 to d4/d19/c70 0 2024-09-13T22:08:40.293 INFO:tasks.workunit.client.0.smithi089.stdout:1/338: mknod d7/d1c/c7f 0 2024-09-13T22:08:40.293 INFO:tasks.workunit.client.0.smithi089.stdout:0/446: dread d1/de/d10/d36/d3d/f43 [0,4194304] 0 2024-09-13T22:08:40.295 INFO:tasks.workunit.client.0.smithi089.stdout:4/309: getdents d0 0 2024-09-13T22:08:40.295 INFO:tasks.workunit.client.0.smithi089.stdout:4/310: fdatasync d0/d11/d16/f26 0 2024-09-13T22:08:40.295 INFO:tasks.workunit.client.0.smithi089.stdout:4/311: read d0/d11/d16/d24/f36 [1312870,35072] 0 2024-09-13T22:08:40.295 INFO:tasks.workunit.client.0.smithi089.stdout:4/312: chown d0/d2c/l33 27 1 2024-09-13T22:08:40.296 INFO:tasks.workunit.client.0.smithi089.stdout:3/329: mknod d1/d2/d18/d40/c6b 0 2024-09-13T22:08:40.297 INFO:tasks.workunit.client.0.smithi089.stdout:0/447: dread d1/de/d10/f13 [0,4194304] 0 2024-09-13T22:08:40.299 INFO:tasks.workunit.client.0.smithi089.stdout:8/358: creat d0/dd/d12/d20/d32/d70/f7e x:0 0 0 2024-09-13T22:08:40.300 INFO:tasks.workunit.client.0.smithi089.stdout:6/310: unlink d0/d5/d1d/d56/d4a/l5f 0 2024-09-13T22:08:40.302 INFO:tasks.workunit.client.0.smithi089.stdout:2/320: rename df/d14/d2b/f46 to df/d5b/f6f 0 2024-09-13T22:08:40.303 INFO:tasks.workunit.client.0.smithi089.stdout:5/304: stat d4/c22 0 2024-09-13T22:08:40.306 INFO:tasks.workunit.client.0.smithi089.stdout:3/330: symlink d1/l6c 0 2024-09-13T22:08:40.306 INFO:tasks.workunit.client.0.smithi089.stdout:3/331: chown d1/d7/d1b/d28/d63 3 1 2024-09-13T22:08:40.306 INFO:tasks.workunit.client.0.smithi089.stdout:3/332: readlink d1/d7/d1b/l58 0 2024-09-13T22:08:40.309 INFO:tasks.workunit.client.0.smithi089.stdout:6/311: symlink d0/d5/d43/l65 0 2024-09-13T22:08:40.309 INFO:tasks.workunit.client.0.smithi089.stdout:6/312: dread d0/d5/d1d/f33 [0,4194304] 0 2024-09-13T22:08:40.310 INFO:tasks.workunit.client.0.smithi089.stdout:2/321: creat df/d14/d66/f70 x:0 0 0 2024-09-13T22:08:40.310 INFO:tasks.workunit.client.0.smithi089.stdout:6/313: dread d0/d5/d1d/f33 [0,4194304] 0 2024-09-13T22:08:40.310 INFO:tasks.workunit.client.0.smithi089.stdout:6/314: creat d0/d5/d1d/d2d/f66 x:0 0 0 2024-09-13T22:08:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:5/305: rename d4/ce to d4/d19/d1e/c71 0 2024-09-13T22:08:40.314 INFO:tasks.workunit.client.0.smithi089.stdout:2/322: getdents df/d1a 0 2024-09-13T22:08:40.317 INFO:tasks.workunit.client.0.smithi089.stdout:3/333: write d1/d2/d4/f12 [1773070,127175] 0 2024-09-13T22:08:40.319 INFO:tasks.workunit.client.0.smithi089.stdout:6/315: link d0/l26 d0/d4/d12/d15/l67 0 2024-09-13T22:08:40.321 INFO:tasks.workunit.client.0.smithi089.stdout:5/306: rename c3 to d4/d19/d1e/d28/d31/d61/d69/c72 0 2024-09-13T22:08:40.322 INFO:tasks.workunit.client.0.smithi089.stdout:5/307: readlink d4/d19/d1e/d28/d31/d35/d46/l4a 0 2024-09-13T22:08:40.323 INFO:tasks.workunit.client.0.smithi089.stdout:1/339: dwrite d7/de/f5f [4194304,4194304] 0 2024-09-13T22:08:40.323 INFO:tasks.workunit.client.0.smithi089.stdout:2/323: creat df/d1a/d57/d68/f71 x:0 0 0 2024-09-13T22:08:40.328 INFO:tasks.workunit.client.0.smithi089.stdout:1/340: mkdir d7/de/d1b/d80 0 2024-09-13T22:08:40.328 INFO:tasks.workunit.client.0.smithi089.stdout:1/341: chown d7/d1c/d3c/f65 438545085 1 2024-09-13T22:08:40.328 INFO:tasks.workunit.client.0.smithi089.stdout:1/342: creat d7/d1c/d3c/f81 x:0 0 0 2024-09-13T22:08:40.328 INFO:tasks.workunit.client.0.smithi089.stdout:1/343: fsync d7/de/d1b/d2b/f2d 0 2024-09-13T22:08:40.328 INFO:tasks.workunit.client.0.smithi089.stdout:4/313: dwrite d0/d2c/f45 [0,4194304] 0 2024-09-13T22:08:40.328 INFO:tasks.workunit.client.0.smithi089.stdout:4/314: readlink d0/d11/d16/d24/l25 0 2024-09-13T22:08:40.328 INFO:tasks.workunit.client.0.smithi089.stdout:4/315: dread - d0/d2c/d35/f4f zero size 2024-09-13T22:08:40.328 INFO:tasks.workunit.client.0.smithi089.stdout:4/316: chown d0/d15/c53 478 1 2024-09-13T22:08:40.329 INFO:tasks.workunit.client.0.smithi089.stdout:2/324: mknod df/d14/c72 0 2024-09-13T22:08:40.330 INFO:tasks.workunit.client.0.smithi089.stdout:5/308: dread d4/d19/f24 [0,4194304] 0 2024-09-13T22:08:40.331 INFO:tasks.workunit.client.0.smithi089.stdout:0/448: dwrite d1/de/d15/d41/d49/d76/f8e [0,4194304] 0 2024-09-13T22:08:40.331 INFO:tasks.workunit.client.0.smithi089.stdout:7/281: sync 2024-09-13T22:08:40.332 INFO:tasks.workunit.client.0.smithi089.stdout:7/282: stat d0/d19/d28/d1d/d3d/l46 0 2024-09-13T22:08:40.332 INFO:tasks.workunit.client.0.smithi089.stdout:7/283: dread - d0/d19/d28/d1d/d2d/d3c/f37 zero size 2024-09-13T22:08:40.332 INFO:tasks.workunit.client.0.smithi089.stdout:2/325: creat df/d5b/f73 x:0 0 0 2024-09-13T22:08:40.334 INFO:tasks.workunit.client.0.smithi089.stdout:4/317: dread d0/d11/f30 [0,4194304] 0 2024-09-13T22:08:40.334 INFO:tasks.workunit.client.0.smithi089.stdout:4/318: creat d0/d11/d16/d24/f61 x:0 0 0 2024-09-13T22:08:40.334 INFO:tasks.workunit.client.0.smithi089.stdout:0/449: dread d1/de/d10/d36/d38/d4e/d62/d5b/f63 [0,4194304] 0 2024-09-13T22:08:40.338 INFO:tasks.workunit.client.0.smithi089.stdout:3/334: dread d1/d2/ff [0,4194304] 0 2024-09-13T22:08:40.338 INFO:tasks.workunit.client.0.smithi089.stdout:3/335: read d1/d7/d1b/f4e [237159,112000] 0 2024-09-13T22:08:40.339 INFO:tasks.workunit.client.0.smithi089.stdout:5/309: mknod d4/d19/d1e/d28/d31/d35/c73 0 2024-09-13T22:08:40.340 INFO:tasks.workunit.client.0.smithi089.stdout:7/284: symlink d0/d19/d45/l5a 0 2024-09-13T22:08:40.340 INFO:tasks.workunit.client.0.smithi089.stdout:7/285: write d0/d19/d28/d1d/d2d/d3c/f37 [682138,62955] 0 2024-09-13T22:08:40.342 INFO:tasks.workunit.client.0.smithi089.stdout:0/450: symlink d1/de/d10/d36/d57/l90 0 2024-09-13T22:08:40.342 INFO:tasks.workunit.client.0.smithi089.stdout:0/451: write d1/f1e [1661004,52808] 0 2024-09-13T22:08:40.345 INFO:tasks.workunit.client.0.smithi089.stdout:5/310: rename d4/d19/d1e/c3a to d4/d19/d1e/d28/d31/d55/c74 0 2024-09-13T22:08:40.345 INFO:tasks.workunit.client.0.smithi089.stdout:4/319: write d0/d11/f21 [3419409,96720] 0 2024-09-13T22:08:40.345 INFO:tasks.workunit.client.0.smithi089.stdout:4/320: chown d0/d11/d16/d24/l25 5743753 1 2024-09-13T22:08:40.346 INFO:tasks.workunit.client.0.smithi089.stdout:7/286: mkdir d0/d19/d28/d1d/d30/d5b 0 2024-09-13T22:08:40.346 INFO:tasks.workunit.client.0.smithi089.stdout:7/287: fdatasync d0/d19/d28/d1d/d30/f59 0 2024-09-13T22:08:40.348 INFO:tasks.workunit.client.0.smithi089.stdout:4/321: mkdir d0/d11/d16/d24/d62 0 2024-09-13T22:08:40.349 INFO:tasks.workunit.client.0.smithi089.stdout:4/322: readlink d0/d11/d16/l4b 0 2024-09-13T22:08:40.351 INFO:tasks.workunit.client.0.smithi089.stdout:6/316: dwrite d0/d4/f40 [0,4194304] 0 2024-09-13T22:08:40.352 INFO:tasks.workunit.client.0.smithi089.stdout:0/452: mknod d1/de/c91 0 2024-09-13T22:08:40.353 INFO:tasks.workunit.client.0.smithi089.stdout:0/453: creat d1/de/d15/d41/d49/f92 x:0 0 0 2024-09-13T22:08:40.353 INFO:tasks.workunit.client.0.smithi089.stdout:4/323: symlink d0/d11/d16/l63 0 2024-09-13T22:08:40.359 INFO:tasks.workunit.client.0.smithi089.stdout:1/344: dwrite d7/de/d1b/f58 [0,4194304] 0 2024-09-13T22:08:40.360 INFO:tasks.workunit.client.0.smithi089.stdout:5/311: dread d4/d19/d1e/d28/d31/d35/f47 [0,4194304] 0 2024-09-13T22:08:40.360 INFO:tasks.workunit.client.0.smithi089.stdout:8/359: dwrite d0/dd/d12/d20/d32/f41 [0,4194304] 0 2024-09-13T22:08:40.363 INFO:tasks.workunit.client.0.smithi089.stdout:0/454: creat d1/de/d10/d36/d38/d4e/d62/d5f/d72/f93 x:0 0 0 2024-09-13T22:08:40.368 INFO:tasks.workunit.client.0.smithi089.stdout:8/360: mkdir d0/dd/d12/d20/d40/d4a/d7f 0 2024-09-13T22:08:40.374 INFO:tasks.workunit.client.0.smithi089.stdout:0/455: dread d1/de/d10/d36/d57/f78 [0,4194304] 0 2024-09-13T22:08:40.377 INFO:tasks.workunit.client.0.smithi089.stdout:0/456: rename d1/f32 to d1/de/d10/d36/d39/f94 0 2024-09-13T22:08:40.378 INFO:tasks.workunit.client.0.smithi089.stdout:8/361: dread d0/dd/d11/f29 [0,4194304] 0 2024-09-13T22:08:40.378 INFO:tasks.workunit.client.0.smithi089.stdout:8/362: chown d0/dd/d12/d20/l24 243334 1 2024-09-13T22:08:40.379 INFO:tasks.workunit.client.0.smithi089.stdout:0/457: symlink d1/l95 0 2024-09-13T22:08:40.379 INFO:tasks.workunit.client.0.smithi089.stdout:0/458: fdatasync d1/de/d15/d41/d49/f92 0 2024-09-13T22:08:40.380 INFO:tasks.workunit.client.0.smithi089.stdout:9/380: sync 2024-09-13T22:08:40.381 INFO:tasks.workunit.client.0.smithi089.stdout:3/336: dwrite d1/d2/d24/f3b [0,4194304] 0 2024-09-13T22:08:40.382 INFO:tasks.workunit.client.0.smithi089.stdout:6/317: dwrite d0/d4/f38 [0,4194304] 0 2024-09-13T22:08:40.383 INFO:tasks.workunit.client.0.smithi089.stdout:8/363: rename d0/dd/d12/d20/d32 to d0/dd/d12/d20/d36/d80 0 2024-09-13T22:08:40.383 INFO:tasks.workunit.client.0.smithi089.stdout:8/364: chown d0/dd/c52 37247 1 2024-09-13T22:08:40.383 INFO:tasks.workunit.client.0.smithi089.stdout:7/288: dwrite d0/d19/d28/d1d/d23/f56 [0,4194304] 0 2024-09-13T22:08:40.393 INFO:tasks.workunit.client.0.smithi089.stdout:7/289: truncate d0/d19/d28/d1d/f2c 4117858 0 2024-09-13T22:08:40.393 INFO:tasks.workunit.client.0.smithi089.stdout:7/290: write d0/d19/d45/d38/f3a [1294295,4466] 0 2024-09-13T22:08:40.397 INFO:tasks.workunit.client.0.smithi089.stdout:3/337: rename d1/d2/f3 to d1/d7/d1b/d28/d63/f6d 0 2024-09-13T22:08:40.401 INFO:tasks.workunit.client.0.smithi089.stdout:7/291: link d0/d19/d28/d1d/d3d/l4f d0/d19/d28/d1d/d23/d2e/l5c 0 2024-09-13T22:08:40.402 INFO:tasks.workunit.client.0.smithi089.stdout:9/381: dread d6/f15 [0,4194304] 0 2024-09-13T22:08:40.402 INFO:tasks.workunit.client.0.smithi089.stdout:6/318: rmdir d0/d5/d1d/d56/d4a/d4f 0 2024-09-13T22:08:40.404 INFO:tasks.workunit.client.0.smithi089.stdout:7/292: rename d0/d19/d28/d1d/d4a to d0/d19/d28/d1d/d23/d24/d5d 0 2024-09-13T22:08:40.405 INFO:tasks.workunit.client.0.smithi089.stdout:9/382: symlink d6/d18/l88 0 2024-09-13T22:08:40.405 INFO:tasks.workunit.client.0.smithi089.stdout:9/383: stat l4 0 2024-09-13T22:08:40.405 INFO:tasks.workunit.client.0.smithi089.stdout:9/384: chown d6/d55/l7b 16584310 1 2024-09-13T22:08:40.406 INFO:tasks.workunit.client.0.smithi089.stdout:6/319: symlink d0/d5/d1d/d2d/l68 0 2024-09-13T22:08:40.406 INFO:tasks.workunit.client.0.smithi089.stdout:6/320: write d0/d5/d1d/d56/f34 [923894,34088] 0 2024-09-13T22:08:40.406 INFO:tasks.workunit.client.0.smithi089.stdout:6/321: read - d0/d5/d43/f53 zero size 2024-09-13T22:08:40.406 INFO:tasks.workunit.client.0.smithi089.stdout:6/322: chown d0/d5/d1d/d56/d4b/f4e 404728280 1 2024-09-13T22:08:40.406 INFO:tasks.workunit.client.0.smithi089.stdout:6/323: fsync d0/d4/d12/f20 0 2024-09-13T22:08:40.407 INFO:tasks.workunit.client.0.smithi089.stdout:3/338: creat d1/d2/d31/f6e x:0 0 0 2024-09-13T22:08:40.408 INFO:tasks.workunit.client.0.smithi089.stdout:7/293: rename d0/f7 to d0/d19/d28/d1d/d23/d24/d5d/f5e 0 2024-09-13T22:08:40.409 INFO:tasks.workunit.client.0.smithi089.stdout:9/385: mkdir d6/d18/d1b/d89 0 2024-09-13T22:08:40.409 INFO:tasks.workunit.client.0.smithi089.stdout:9/386: fdatasync d6/d31/d5e/f7d 0 2024-09-13T22:08:40.409 INFO:tasks.workunit.client.0.smithi089.stdout:9/387: write d6/d18/d1b/f26 [3807273,35912] 0 2024-09-13T22:08:40.409 INFO:tasks.workunit.client.0.smithi089.stdout:9/388: chown d6/d18/d1b/c71 18557331 1 2024-09-13T22:08:40.412 INFO:tasks.workunit.client.0.smithi089.stdout:7/294: rename d0/d19/d28/d1d/f34 to d0/d19/d28/d1d/f5f 0 2024-09-13T22:08:40.412 INFO:tasks.workunit.client.0.smithi089.stdout:7/295: fdatasync d0/d19/d28/d1d/d23/d24/f29 0 2024-09-13T22:08:40.412 INFO:tasks.workunit.client.0.smithi089.stdout:3/339: rmdir d1/d2/d23/d3d/d46 39 2024-09-13T22:08:40.412 INFO:tasks.workunit.client.0.smithi089.stdout:3/340: dread - d1/d2/d31/f6e zero size 2024-09-13T22:08:40.412 INFO:tasks.workunit.client.0.smithi089.stdout:5/312: dwrite d4/d19/d1e/f62 [0,4194304] 0 2024-09-13T22:08:40.413 INFO:tasks.workunit.client.0.smithi089.stdout:4/324: dwrite d0/d2c/f45 [4194304,4194304] 0 2024-09-13T22:08:40.414 INFO:tasks.workunit.client.0.smithi089.stdout:6/324: write d0/f2e [1102470,11150] 0 2024-09-13T22:08:40.414 INFO:tasks.workunit.client.0.smithi089.stdout:1/345: dwrite d7/f33 [4194304,4194304] 0 2024-09-13T22:08:40.414 INFO:tasks.workunit.client.0.smithi089.stdout:0/459: dwrite d1/de/d15/d2a/f81 [0,4194304] 0 2024-09-13T22:08:40.414 INFO:tasks.workunit.client.0.smithi089.stdout:3/341: mknod d1/d2/d23/d3d/d54/c6f 0 2024-09-13T22:08:40.415 INFO:tasks.workunit.client.0.smithi089.stdout:8/365: dwrite d0/dd/d12/d20/d1c/d5a/d63/f66 [0,4194304] 0 2024-09-13T22:08:40.418 INFO:tasks.workunit.client.0.smithi089.stdout:5/313: rmdir d4/d19/d1e/d28/d3d/d5e 39 2024-09-13T22:08:40.423 INFO:tasks.workunit.client.0.smithi089.stdout:9/389: dread d6/d18/d1b/f2e [0,4194304] 0 2024-09-13T22:08:40.423 INFO:tasks.workunit.client.0.smithi089.stdout:9/390: chown d6/f14 14620 1 2024-09-13T22:08:40.426 INFO:tasks.workunit.client.0.smithi089.stdout:6/325: symlink d0/d5/d1d/d2d/l69 0 2024-09-13T22:08:40.426 INFO:tasks.workunit.client.0.smithi089.stdout:6/326: chown d0/d4/d12/d15/d3b/c52 620 1 2024-09-13T22:08:40.426 INFO:tasks.workunit.client.0.smithi089.stdout:1/346: dread - d7/f25 zero size 2024-09-13T22:08:40.430 INFO:tasks.workunit.client.0.smithi089.stdout:9/391: dread d6/d18/f47 [0,4194304] 0 2024-09-13T22:08:40.430 INFO:tasks.workunit.client.0.smithi089.stdout:0/460: symlink d1/de/d10/d36/d38/d4e/d62/d5b/d5e/l96 0 2024-09-13T22:08:40.432 INFO:tasks.workunit.client.0.smithi089.stdout:3/342: fdatasync d1/d2/f29 0 2024-09-13T22:08:40.437 INFO:tasks.workunit.client.0.smithi089.stdout:6/327: symlink d0/d4/d12/d15/l6a 0 2024-09-13T22:08:40.439 INFO:tasks.workunit.client.0.smithi089.stdout:3/343: dread f0 [0,4194304] 0 2024-09-13T22:08:40.439 INFO:tasks.workunit.client.0.smithi089.stdout:1/347: creat d7/de/d1b/d80/f82 x:0 0 0 2024-09-13T22:08:40.440 INFO:tasks.workunit.client.0.smithi089.stdout:1/348: creat d7/de/d1b/d2b/d59/f83 x:0 0 0 2024-09-13T22:08:40.441 INFO:tasks.workunit.client.0.smithi089.stdout:9/392: mknod d6/d18/d21/d5d/d6c/c8a 0 2024-09-13T22:08:40.443 INFO:tasks.workunit.client.0.smithi089.stdout:6/328: mknod d0/d5/d1d/d2d/d55/c6b 0 2024-09-13T22:08:40.445 INFO:tasks.workunit.client.0.smithi089.stdout:1/349: symlink d7/de/l84 0 2024-09-13T22:08:40.446 INFO:tasks.workunit.client.0.smithi089.stdout:1/350: readlink d7/de/l84 0 2024-09-13T22:08:40.446 INFO:tasks.workunit.client.0.smithi089.stdout:1/351: write d7/d34/f37 [51119,47543] 0 2024-09-13T22:08:40.446 INFO:tasks.workunit.client.0.smithi089.stdout:4/325: dwrite d0/f1a [0,4194304] 0 2024-09-13T22:08:40.446 INFO:tasks.workunit.client.0.smithi089.stdout:4/326: chown d0/c58 15 1 2024-09-13T22:08:40.446 INFO:tasks.workunit.client.0.smithi089.stdout:4/327: chown d0/fd 286 1 2024-09-13T22:08:40.447 INFO:tasks.workunit.client.0.smithi089.stdout:1/352: link d7/de/d68/f6f d7/de/d1b/d2b/d59/f85 0 2024-09-13T22:08:40.448 INFO:tasks.workunit.client.0.smithi089.stdout:4/328: mkdir d0/d2c/d35/d64 0 2024-09-13T22:08:40.451 INFO:tasks.workunit.client.0.smithi089.stdout:1/353: unlink d7/de/f11 0 2024-09-13T22:08:40.451 INFO:tasks.workunit.client.0.smithi089.stdout:3/344: write d1/d2/d18/d38/f53 [1002996,40910] 0 2024-09-13T22:08:40.451 INFO:tasks.workunit.client.0.smithi089.stdout:3/345: truncate d1/d7/d1b/d28/d63/f6d 9244540 0 2024-09-13T22:08:40.452 INFO:tasks.workunit.client.0.smithi089.stdout:7/296: dread d0/d19/d28/d1d/f2c [0,4194304] 0 2024-09-13T22:08:40.452 INFO:tasks.workunit.client.0.smithi089.stdout:5/314: dwrite d4/d19/d1e/d28/d31/d55/f5a [4194304,4194304] 0 2024-09-13T22:08:40.453 INFO:tasks.workunit.client.0.smithi089.stdout:5/315: stat d4/d19/d1e/d28/d31/f40 0 2024-09-13T22:08:40.453 INFO:tasks.workunit.client.0.smithi089.stdout:4/329: link d0/d2c/d35/d5d/c5e d0/d2c/d35/d64/c65 0 2024-09-13T22:08:40.453 INFO:tasks.workunit.client.0.smithi089.stdout:8/366: dwrite d0/dd/d12/d20/d36/d80/f41 [0,4194304] 0 2024-09-13T22:08:40.453 INFO:tasks.workunit.client.0.smithi089.stdout:0/461: dwrite d1/de/d10/f5d [0,4194304] 0 2024-09-13T22:08:40.455 INFO:tasks.workunit.client.0.smithi089.stdout:7/297: link d0/f1e d0/d19/d45/d38/d54/f60 0 2024-09-13T22:08:40.455 INFO:tasks.workunit.client.0.smithi089.stdout:7/298: chown d0/l10 63372583 1 2024-09-13T22:08:40.458 INFO:tasks.workunit.client.0.smithi089.stdout:5/316: creat d4/d19/d1e/d28/d31/f75 x:0 0 0 2024-09-13T22:08:40.458 INFO:tasks.workunit.client.0.smithi089.stdout:5/317: write d4/ff [333498,25909] 0 2024-09-13T22:08:40.462 INFO:tasks.workunit.client.0.smithi089.stdout:4/330: symlink d0/l66 0 2024-09-13T22:08:40.462 INFO:tasks.workunit.client.0.smithi089.stdout:4/331: fdatasync d0/d2c/d35/f4f 0 2024-09-13T22:08:40.462 INFO:tasks.workunit.client.0.smithi089.stdout:4/332: creat d0/d2c/d35/f67 x:0 0 0 2024-09-13T22:08:40.462 INFO:tasks.workunit.client.0.smithi089.stdout:4/333: truncate d0/d15/d1f/f31 991358 0 2024-09-13T22:08:40.464 INFO:tasks.workunit.client.0.smithi089.stdout:5/318: dread d4/f5 [0,4194304] 0 2024-09-13T22:08:40.466 INFO:tasks.workunit.client.0.smithi089.stdout:1/354: dread d7/de/ff [0,4194304] 0 2024-09-13T22:08:40.467 INFO:tasks.workunit.client.0.smithi089.stdout:6/329: dwrite d0/d4/f5b [0,4194304] 0 2024-09-13T22:08:40.470 INFO:tasks.workunit.client.0.smithi089.stdout:0/462: link d1/de/d10/d36/d3d/c73 d1/de/d15/d41/d87/c97 0 2024-09-13T22:08:40.470 INFO:tasks.workunit.client.0.smithi089.stdout:0/463: dread - d1/de/d10/d36/d38/d4e/d62/d5f/d72/f93 zero size 2024-09-13T22:08:40.471 INFO:tasks.workunit.client.0.smithi089.stdout:7/299: truncate d0/f1e 395119 0 2024-09-13T22:08:40.471 INFO:tasks.workunit.client.0.smithi089.stdout:7/300: dread - d0/d19/d28/d1d/d23/d2e/d41/f4d zero size 2024-09-13T22:08:40.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/346: dwrite d1/d2/ff [0,4194304] 0 2024-09-13T22:08:40.475 INFO:tasks.workunit.client.0.smithi089.stdout:4/334: mknod d0/d2c/d35/c68 0 2024-09-13T22:08:40.475 INFO:tasks.workunit.client.0.smithi089.stdout:4/335: readlink d0/d11/d16/d24/l57 0 2024-09-13T22:08:40.477 INFO:tasks.workunit.client.0.smithi089.stdout:1/355: creat d7/de/d1b/d2b/d39/d73/f86 x:0 0 0 2024-09-13T22:08:40.481 INFO:tasks.workunit.client.0.smithi089.stdout:4/336: creat d0/d2c/d35/d5d/f69 x:0 0 0 2024-09-13T22:08:40.482 INFO:tasks.workunit.client.0.smithi089.stdout:4/337: dread d0/d2c/d35/f49 [0,4194304] 0 2024-09-13T22:08:40.482 INFO:tasks.workunit.client.0.smithi089.stdout:4/338: fdatasync d0/d2c/d35/f4c 0 2024-09-13T22:08:40.482 INFO:tasks.workunit.client.0.smithi089.stdout:4/339: dread - d0/d2c/d35/f67 zero size 2024-09-13T22:08:40.483 INFO:tasks.workunit.client.0.smithi089.stdout:1/356: read d7/d1c/d3c/f3f [661490,15449] 0 2024-09-13T22:08:40.484 INFO:tasks.workunit.client.0.smithi089.stdout:8/367: dwrite d0/dd/d12/d20/d36/d80/d3b/f6b [0,4194304] 0 2024-09-13T22:08:40.484 INFO:tasks.workunit.client.0.smithi089.stdout:1/357: fsync d7/de/ff 0 2024-09-13T22:08:40.485 INFO:tasks.workunit.client.0.smithi089.stdout:4/340: truncate d0/d2c/f45 3475076 0 2024-09-13T22:08:40.485 INFO:tasks.workunit.client.0.smithi089.stdout:4/341: readlink d0/l66 0 2024-09-13T22:08:40.487 INFO:tasks.workunit.client.0.smithi089.stdout:8/368: unlink d0/dd/f49 0 2024-09-13T22:08:40.487 INFO:tasks.workunit.client.0.smithi089.stdout:8/369: chown d0/dd/d12/d20/d36/l30 4123209 1 2024-09-13T22:08:40.487 INFO:tasks.workunit.client.0.smithi089.stdout:2/326: sync 2024-09-13T22:08:40.487 INFO:tasks.workunit.client.0.smithi089.stdout:2/327: stat df/d14/c72 0 2024-09-13T22:08:40.489 INFO:tasks.workunit.client.0.smithi089.stdout:1/358: symlink d7/de/d3a/d77/l87 0 2024-09-13T22:08:40.490 INFO:tasks.workunit.client.0.smithi089.stdout:4/342: mknod d0/d11/d16/c6a 0 2024-09-13T22:08:40.490 INFO:tasks.workunit.client.0.smithi089.stdout:4/343: write d0/d2c/d35/f4f [270954,66098] 0 2024-09-13T22:08:40.492 INFO:tasks.workunit.client.0.smithi089.stdout:8/370: rename d0/f4d to d0/dd/f81 0 2024-09-13T22:08:40.492 INFO:tasks.workunit.client.0.smithi089.stdout:8/371: chown d0/d6a/d73 27 1 2024-09-13T22:08:40.493 INFO:tasks.workunit.client.0.smithi089.stdout:1/359: write d7/f33 [8541431,12706] 0 2024-09-13T22:08:40.493 INFO:tasks.workunit.client.0.smithi089.stdout:1/360: truncate d7/de/d3a/f6a 39689 0 2024-09-13T22:08:40.493 INFO:tasks.workunit.client.0.smithi089.stdout:4/344: symlink d0/d15/d1f/l6b 0 2024-09-13T22:08:40.493 INFO:tasks.workunit.client.0.smithi089.stdout:4/345: chown d0/d11/c3b 2646862 1 2024-09-13T22:08:40.494 INFO:tasks.workunit.client.0.smithi089.stdout:2/328: rename df/d14/d66/d69/d2e/f2f to df/f74 0 2024-09-13T22:08:40.498 INFO:tasks.workunit.client.0.smithi089.stdout:4/346: symlink d0/d2c/d52/l6c 0 2024-09-13T22:08:40.500 INFO:tasks.workunit.client.0.smithi089.stdout:2/329: rename df/d14/d66/d69/l52 to df/d1a/l75 0 2024-09-13T22:08:40.507 INFO:tasks.workunit.client.0.smithi089.stdout:8/372: dread d0/dd/d12/d20/d1c/d5a/d63/f66 [0,4194304] 0 2024-09-13T22:08:40.509 INFO:tasks.workunit.client.0.smithi089.stdout:8/373: creat d0/dd/d12/d20/d36/d57/f82 x:0 0 0 2024-09-13T22:08:40.509 INFO:tasks.workunit.client.0.smithi089.stdout:5/319: dwrite d4/ff [0,4194304] 0 2024-09-13T22:08:40.511 INFO:tasks.workunit.client.0.smithi089.stdout:3/347: dwrite d1/d2/d23/f35 [0,4194304] 0 2024-09-13T22:08:40.511 INFO:tasks.workunit.client.0.smithi089.stdout:8/374: rmdir d0/dd/d12/d20/d36/d80/d3b 39 2024-09-13T22:08:40.512 INFO:tasks.workunit.client.0.smithi089.stdout:5/320: unlink d4/d19/d1e/d28/d31/f4d 0 2024-09-13T22:08:40.512 INFO:tasks.workunit.client.0.smithi089.stdout:5/321: chown d4/d19/d1e/d28/d31/f52 567 1 2024-09-13T22:08:40.515 INFO:tasks.workunit.client.0.smithi089.stdout:3/348: creat d1/d2/d18/d40/d69/f70 x:0 0 0 2024-09-13T22:08:40.515 INFO:tasks.workunit.client.0.smithi089.stdout:6/330: dwrite d0/d5/d1d/d56/f34 [0,4194304] 0 2024-09-13T22:08:40.515 INFO:tasks.workunit.client.0.smithi089.stdout:7/301: dwrite d0/d19/d45/d38/f3a [0,4194304] 0 2024-09-13T22:08:40.516 INFO:tasks.workunit.client.0.smithi089.stdout:5/322: symlink d4/d19/d1e/d28/d31/d35/l76 0 2024-09-13T22:08:40.516 INFO:tasks.workunit.client.0.smithi089.stdout:5/323: write d4/d19/d1e/d28/d31/d61/f6b [275617,38867] 0 2024-09-13T22:08:40.518 INFO:tasks.workunit.client.0.smithi089.stdout:6/331: mknod d0/d5/c6c 0 2024-09-13T22:08:40.519 INFO:tasks.workunit.client.0.smithi089.stdout:6/332: fdatasync d0/d5/f7 0 2024-09-13T22:08:40.519 INFO:tasks.workunit.client.0.smithi089.stdout:7/302: mkdir d0/d19/d28/d61 0 2024-09-13T22:08:40.520 INFO:tasks.workunit.client.0.smithi089.stdout:5/324: creat d4/f77 x:0 0 0 2024-09-13T22:08:40.521 INFO:tasks.workunit.client.0.smithi089.stdout:7/303: rename d0/d19/d28/d1d/d3d/l46 to d0/d19/d28/d1d/d23/d2e/d41/l62 0 2024-09-13T22:08:40.522 INFO:tasks.workunit.client.0.smithi089.stdout:8/375: dread d0/dd/d11/f2d [0,4194304] 0 2024-09-13T22:08:40.523 INFO:tasks.workunit.client.0.smithi089.stdout:5/325: link d4/d19/f2b d4/d19/d1e/d28/d3d/d5e/f78 0 2024-09-13T22:08:40.523 INFO:tasks.workunit.client.0.smithi089.stdout:2/330: dread df/d14/f21 [0,4194304] 0 2024-09-13T22:08:40.523 INFO:tasks.workunit.client.0.smithi089.stdout:8/376: mkdir d0/dd/d12/d3a/d83 0 2024-09-13T22:08:40.525 INFO:tasks.workunit.client.0.smithi089.stdout:5/326: getdents d4/d19 0 2024-09-13T22:08:40.527 INFO:tasks.workunit.client.0.smithi089.stdout:4/347: dwrite d0/f1a [0,4194304] 0 2024-09-13T22:08:40.527 INFO:tasks.workunit.client.0.smithi089.stdout:5/327: creat d4/d19/f79 x:0 0 0 2024-09-13T22:08:40.531 INFO:tasks.workunit.client.0.smithi089.stdout:1/361: dwrite d7/f26 [4194304,4194304] 0 2024-09-13T22:08:40.531 INFO:tasks.workunit.client.0.smithi089.stdout:1/362: chown d7/de/d3a/d77 23734 1 2024-09-13T22:08:40.534 INFO:tasks.workunit.client.0.smithi089.stdout:3/349: dwrite d1/d2/d4/f5e [0,4194304] 0 2024-09-13T22:08:40.542 INFO:tasks.workunit.client.0.smithi089.stdout:4/348: symlink d0/d2c/d35/d64/l6d 0 2024-09-13T22:08:40.542 INFO:tasks.workunit.client.0.smithi089.stdout:1/363: readlink d7/l21 0 2024-09-13T22:08:40.543 INFO:tasks.workunit.client.0.smithi089.stdout:1/364: creat d7/d34/d5c/f88 x:0 0 0 2024-09-13T22:08:40.546 INFO:tasks.workunit.client.0.smithi089.stdout:1/365: symlink d7/d34/l89 0 2024-09-13T22:08:40.546 INFO:tasks.workunit.client.0.smithi089.stdout:1/366: creat d7/d1c/d3c/f8a x:0 0 0 2024-09-13T22:08:40.546 INFO:tasks.workunit.client.0.smithi089.stdout:1/367: fsync d7/d1c/d3c/f5e 0 2024-09-13T22:08:40.546 INFO:tasks.workunit.client.0.smithi089.stdout:1/368: write d7/de/d1b/d80/f82 [620113,45296] 0 2024-09-13T22:08:40.547 INFO:tasks.workunit.client.0.smithi089.stdout:1/369: chown d7/d34/d5c 4674 1 2024-09-13T22:08:40.551 INFO:tasks.workunit.client.0.smithi089.stdout:1/370: dread d7/f19 [0,4194304] 0 2024-09-13T22:08:40.553 INFO:tasks.workunit.client.0.smithi089.stdout:1/371: mknod d7/de/d1b/d2b/d59/c8b 0 2024-09-13T22:08:40.554 INFO:tasks.workunit.client.0.smithi089.stdout:1/372: symlink d7/de/l8c 0 2024-09-13T22:08:40.554 INFO:tasks.workunit.client.0.smithi089.stdout:1/373: creat d7/de/d3a/f8d x:0 0 0 2024-09-13T22:08:40.556 INFO:tasks.workunit.client.0.smithi089.stdout:1/374: mknod d7/d1c/c8e 0 2024-09-13T22:08:40.569 INFO:tasks.workunit.client.0.smithi089.stdout:1/375: write d7/de/d1b/d2b/d59/f85 [634955,122248] 0 2024-09-13T22:08:40.569 INFO:tasks.workunit.client.0.smithi089.stdout:1/376: write d7/de/d3a/f7b [247165,20428] 0 2024-09-13T22:08:40.578 INFO:tasks.workunit.client.0.smithi089.stdout:7/304: dwrite d0/d19/d28/d1d/d23/d24/f42 [0,4194304] 0 2024-09-13T22:08:40.579 INFO:tasks.workunit.client.0.smithi089.stdout:6/333: dwrite d0/d5/d1d/d56/f2a [0,4194304] 0 2024-09-13T22:08:40.579 INFO:tasks.workunit.client.0.smithi089.stdout:1/377: dread d7/de/d1b/d2b/f2d [0,4194304] 0 2024-09-13T22:08:40.579 INFO:tasks.workunit.client.0.smithi089.stdout:6/334: creat d0/d5/d1d/d2d/f6d x:0 0 0 2024-09-13T22:08:40.579 INFO:tasks.workunit.client.0.smithi089.stdout:6/335: chown d0/f11 1021 1 2024-09-13T22:08:40.579 INFO:tasks.workunit.client.0.smithi089.stdout:6/336: stat d0/d5/d1d/d56/f2a 0 2024-09-13T22:08:40.580 INFO:tasks.workunit.client.0.smithi089.stdout:3/350: dwrite d1/d2/d18/d38/f53 [0,4194304] 0 2024-09-13T22:08:40.580 INFO:tasks.workunit.client.0.smithi089.stdout:3/351: fsync d1/d2/d4/f16 0 2024-09-13T22:08:40.580 INFO:tasks.workunit.client.0.smithi089.stdout:5/328: dwrite d4/d19/d1e/d28/d31/d55/f5a [8388608,4194304] 0 2024-09-13T22:08:40.580 INFO:tasks.workunit.client.0.smithi089.stdout:4/349: dwrite d0/d11/f21 [0,4194304] 0 2024-09-13T22:08:40.580 INFO:tasks.workunit.client.0.smithi089.stdout:1/378: dread d7/de/d1b/d2b/d59/f67 [0,4194304] 0 2024-09-13T22:08:40.581 INFO:tasks.workunit.client.0.smithi089.stdout:1/379: dread - d7/de/d3a/f6e zero size 2024-09-13T22:08:40.584 INFO:tasks.workunit.client.0.smithi089.stdout:5/329: creat d4/d19/d1e/d28/d3d/f7a x:0 0 0 2024-09-13T22:08:40.585 INFO:tasks.workunit.client.0.smithi089.stdout:3/352: write d1/d2/d31/f3f [2834728,122127] 0 2024-09-13T22:08:40.589 INFO:tasks.workunit.client.0.smithi089.stdout:7/305: dread d0/fd [0,4194304] 0 2024-09-13T22:08:40.590 INFO:tasks.workunit.client.0.smithi089.stdout:7/306: getdents d0/d19/d28/d61 0 2024-09-13T22:08:40.590 INFO:tasks.workunit.client.0.smithi089.stdout:7/307: dread - d0/d19/d28/d1d/d30/f59 zero size 2024-09-13T22:08:40.594 INFO:tasks.workunit.client.0.smithi089.stdout:4/350: mkdir d0/d2c/d35/d64/d6e 0 2024-09-13T22:08:40.594 INFO:tasks.workunit.client.0.smithi089.stdout:4/351: fsync d0/d2c/f5f 0 2024-09-13T22:08:40.595 INFO:tasks.workunit.client.0.smithi089.stdout:1/380: symlink d7/de/d1b/l8f 0 2024-09-13T22:08:40.595 INFO:tasks.workunit.client.0.smithi089.stdout:1/381: truncate d7/d1c/f35 57774 0 2024-09-13T22:08:40.599 INFO:tasks.workunit.client.0.smithi089.stdout:5/330: link d4/d19/d1e/d28/d3d/d5e/f78 d4/d19/d1e/d28/d31/d35/f7b 0 2024-09-13T22:08:40.601 INFO:tasks.workunit.client.0.smithi089.stdout:7/308: mkdir d0/d19/d28/d1d/d2d/d55/d63 0 2024-09-13T22:08:40.601 INFO:tasks.workunit.client.0.smithi089.stdout:7/309: chown d0/d19/d45/d38/f39 56 1 2024-09-13T22:08:40.603 INFO:tasks.workunit.client.0.smithi089.stdout:4/352: creat d0/d2c/d35/d64/f6f x:0 0 0 2024-09-13T22:08:40.603 INFO:tasks.workunit.client.0.smithi089.stdout:4/353: stat d0/f3e 0 2024-09-13T22:08:40.603 INFO:tasks.workunit.client.0.smithi089.stdout:4/354: fsync d0/d2c/d52/f54 0 2024-09-13T22:08:40.603 INFO:tasks.workunit.client.0.smithi089.stdout:3/353: getdents d1/d2/d23 0 2024-09-13T22:08:40.605 INFO:tasks.workunit.client.0.smithi089.stdout:4/355: mknod d0/d11/d16/c70 0 2024-09-13T22:08:40.606 INFO:tasks.workunit.client.0.smithi089.stdout:3/354: symlink d1/d7/d1b/d28/l71 0 2024-09-13T22:08:40.607 INFO:tasks.workunit.client.0.smithi089.stdout:4/356: truncate d0/f13 3719022 0 2024-09-13T22:08:40.608 INFO:tasks.workunit.client.0.smithi089.stdout:0/464: sync 2024-09-13T22:08:40.609 INFO:tasks.workunit.client.0.smithi089.stdout:9/393: sync 2024-09-13T22:08:40.609 INFO:tasks.workunit.client.0.smithi089.stdout:9/394: chown d6/d18/d33/d39/f4c 1518 1 2024-09-13T22:08:40.609 INFO:tasks.workunit.client.0.smithi089.stdout:9/395: truncate d6/d18/d33/f49 1189995 0 2024-09-13T22:08:40.609 INFO:tasks.workunit.client.0.smithi089.stdout:3/355: dread d1/d2/d23/d2b/f5b [0,4194304] 0 2024-09-13T22:08:40.610 INFO:tasks.workunit.client.0.smithi089.stdout:5/331: dread d4/d19/d1e/d28/d31/d55/f5a [8388608,4194304] 0 2024-09-13T22:08:40.611 INFO:tasks.workunit.client.0.smithi089.stdout:0/465: rename d1/ca to d1/de/d10/d36/d57/c98 0 2024-09-13T22:08:40.611 INFO:tasks.workunit.client.0.smithi089.stdout:0/466: chown d1/l26 0 1 2024-09-13T22:08:40.612 INFO:tasks.workunit.client.0.smithi089.stdout:0/467: creat d1/de/d15/d41/d49/d76/f99 x:0 0 0 2024-09-13T22:08:40.614 INFO:tasks.workunit.client.0.smithi089.stdout:9/396: mknod d6/d31/d5e/c8b 0 2024-09-13T22:08:40.614 INFO:tasks.workunit.client.0.smithi089.stdout:9/397: write d6/d18/d1b/f82 [932398,73740] 0 2024-09-13T22:08:40.614 INFO:tasks.workunit.client.0.smithi089.stdout:1/382: dwrite d7/de/d1b/d2b/f54 [0,4194304] 0 2024-09-13T22:08:40.614 INFO:tasks.workunit.client.0.smithi089.stdout:1/383: fdatasync d7/d1c/d3c/f60 0 2024-09-13T22:08:40.614 INFO:tasks.workunit.client.0.smithi089.stdout:1/384: write d7/d34/f7e [463909,429] 0 2024-09-13T22:08:40.614 INFO:tasks.workunit.client.0.smithi089.stdout:3/356: creat d1/d2/d18/d40/d50/f72 x:0 0 0 2024-09-13T22:08:40.614 INFO:tasks.workunit.client.0.smithi089.stdout:2/331: sync 2024-09-13T22:08:40.615 INFO:tasks.workunit.client.0.smithi089.stdout:2/332: chown df/d5b/f5f 3822115 1 2024-09-13T22:08:40.615 INFO:tasks.workunit.client.0.smithi089.stdout:5/332: mknod d4/c7c 0 2024-09-13T22:08:40.615 INFO:tasks.workunit.client.0.smithi089.stdout:7/310: dread d0/d19/d28/f44 [0,4194304] 0 2024-09-13T22:08:40.615 INFO:tasks.workunit.client.0.smithi089.stdout:7/311: dread - d0/d19/d28/d1d/d2d/d3c/f4e zero size 2024-09-13T22:08:40.615 INFO:tasks.workunit.client.0.smithi089.stdout:7/312: readlink d0/l10 0 2024-09-13T22:08:40.615 INFO:tasks.workunit.client.0.smithi089.stdout:7/313: creat d0/d19/d28/d1d/f64 x:0 0 0 2024-09-13T22:08:40.615 INFO:tasks.workunit.client.0.smithi089.stdout:7/314: write d0/f1e [1200352,31373] 0 2024-09-13T22:08:40.615 INFO:tasks.workunit.client.0.smithi089.stdout:0/468: dread d1/de/d10/d36/d39/f94 [0,4194304] 0 2024-09-13T22:08:40.615 INFO:tasks.workunit.client.0.smithi089.stdout:0/469: creat d1/de/d10/f9a x:0 0 0 2024-09-13T22:08:40.616 INFO:tasks.workunit.client.0.smithi089.stdout:9/398: link d6/d18/d33/l40 d6/d18/d33/d52/l8c 0 2024-09-13T22:08:40.617 INFO:tasks.workunit.client.0.smithi089.stdout:4/357: fsync d0/f13 0 2024-09-13T22:08:40.617 INFO:tasks.workunit.client.0.smithi089.stdout:4/358: write d0/d2c/d35/f4c [3189132,72209] 0 2024-09-13T22:08:40.618 INFO:tasks.workunit.client.0.smithi089.stdout:1/385: truncate d7/d40/f75 390022 0 2024-09-13T22:08:40.620 INFO:tasks.workunit.client.0.smithi089.stdout:3/357: mknod d1/d2/d23/d3d/d54/d5d/c73 0 2024-09-13T22:08:40.621 INFO:tasks.workunit.client.0.smithi089.stdout:5/333: symlink d4/d19/d1e/d28/d31/l7d 0 2024-09-13T22:08:40.625 INFO:tasks.workunit.client.0.smithi089.stdout:7/315: unlink d0/d19/d28/d1d/d23/d2e/d41/l62 0 2024-09-13T22:08:40.625 INFO:tasks.workunit.client.0.smithi089.stdout:7/316: chown d0/le 10055 1 2024-09-13T22:08:40.625 INFO:tasks.workunit.client.0.smithi089.stdout:7/317: fsync d0/ff 0 2024-09-13T22:08:40.627 INFO:tasks.workunit.client.0.smithi089.stdout:0/470: mknod d1/c9b 0 2024-09-13T22:08:40.628 INFO:tasks.workunit.client.0.smithi089.stdout:9/399: mkdir d6/d18/d21/d5d/d6c/d8d 0 2024-09-13T22:08:40.628 INFO:tasks.workunit.client.0.smithi089.stdout:9/400: fdatasync d6/d18/d21/f34 0 2024-09-13T22:08:40.629 INFO:tasks.workunit.client.0.smithi089.stdout:4/359: read d0/d2c/f5f [3197401,40568] 0 2024-09-13T22:08:40.630 INFO:tasks.workunit.client.0.smithi089.stdout:0/471: dread d1/de/d15/f24 [0,4194304] 0 2024-09-13T22:08:40.632 INFO:tasks.workunit.client.0.smithi089.stdout:9/401: creat d6/d18/d33/d52/f8e x:0 0 0 2024-09-13T22:08:40.633 INFO:tasks.workunit.client.0.smithi089.stdout:9/402: readlink d6/d18/l88 0 2024-09-13T22:08:40.633 INFO:tasks.workunit.client.0.smithi089.stdout:9/403: fsync d6/d18/d21/f27 0 2024-09-13T22:08:40.634 INFO:tasks.workunit.client.0.smithi089.stdout:4/360: rename d0/d11/d16/l20 to d0/d11/d16/l71 0 2024-09-13T22:08:40.634 INFO:tasks.workunit.client.0.smithi089.stdout:4/361: truncate d0/d2c/d35/d5d/f69 925989 0 2024-09-13T22:08:40.634 INFO:tasks.workunit.client.0.smithi089.stdout:1/386: getdents d7/d1c 0 2024-09-13T22:08:40.638 INFO:tasks.workunit.client.0.smithi089.stdout:0/472: mkdir d1/de/d1f/d9c 0 2024-09-13T22:08:40.641 INFO:tasks.workunit.client.0.smithi089.stdout:0/473: rename d1/de/d10/d36/d3d/c73 to d1/de/d10/d36/d57/c9d 0 2024-09-13T22:08:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.640+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/3531051935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40ffc80 msgr2=0x7f2db4100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.640+0000 7f2dbaf4d640 1 --2- 172.21.15.89:0/3531051935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40ffc80 0x7f2db4100100 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009880 tx=0x7f2da002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:08:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.640+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/3531051935 shutdown_connections 2024-09-13T22:08:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.640+0000 7f2dbaf4d640 1 --2- 172.21.15.89:0/3531051935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40ffc80 0x7f2db4100100 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.640+0000 7f2dbaf4d640 1 --2- 172.21.15.89:0/3531051935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db40fea80 0x7f2db40fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.640+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/3531051935 >> 172.21.15.89:0/3531051935 conn(0x7f2db40fa230 msgr2=0x7f2db40fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.640+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/3531051935 shutdown_connections 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.640+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/3531051935 wait complete. 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.641+0000 7f2dbaf4d640 1 Processor -- start 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.641+0000 7f2dbaf4d640 1 -- start start 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.641+0000 7f2dbaf4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40fea80 0x7f2db4195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.641+0000 7f2dbaf4d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db40ffc80 0x7f2db4195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2dbaf4d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db4196270 con 0x7f2db40fea80 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2dbaf4d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db41963e0 con 0x7f2db40ffc80 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2db8ce9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40fea80 0x7f2db4195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2db8ce9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40fea80 0x7f2db4195760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56662/0 (socket says 172.21.15.89:56662) 2024-09-13T22:08:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2db8ce9640 1 -- 172.21.15.89:0/2122203365 learned_addr learned my addr 172.21.15.89:0/2122203365 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:40.645 INFO:tasks.workunit.client.0.smithi089.stdout:0/474: rmdir d1/de/d1f/d9c 0 2024-09-13T22:08:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2db8ce9640 1 -- 172.21.15.89:0/2122203365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db40ffc80 msgr2=0x7f2db4195ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T22:08:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2db8ce9640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db40ffc80 0x7f2db4195ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2db8ce9640 1 -- 172.21.15.89:0/2122203365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0009560 con 0x7f2db40fea80 2024-09-13T22:08:40.646 INFO:tasks.workunit.client.0.smithi089.stdout:0/475: chown d1/de/d10/d36/d38/d4e/d62/d5b/f67 4 1 2024-09-13T22:08:40.646 INFO:tasks.workunit.client.0.smithi089.stdout:0/476: creat d1/f9e x:0 0 0 2024-09-13T22:08:40.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2db8ce9640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40fea80 0x7f2db4195760 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2da800b9f0 tx=0x7f2da800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:40.646 INFO:tasks.workunit.client.0.smithi089.stdout:5/334: dread d4/d19/f2b [0,4194304] 0 2024-09-13T22:08:40.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2db1ffb640 1 -- 172.21.15.89:0/2122203365 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da800cb20 con 0x7f2db40fea80 2024-09-13T22:08:40.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2db1ffb640 1 -- 172.21.15.89:0/2122203365 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2da800cc80 con 0x7f2db40fea80 2024-09-13T22:08:40.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.642+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db419ae10 con 0x7f2db40fea80 2024-09-13T22:08:40.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.643+0000 7f2db1ffb640 1 -- 172.21.15.89:0/2122203365 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da8012710 con 0x7f2db40fea80 2024-09-13T22:08:40.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.643+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db419b380 con 0x7f2db40fea80 2024-09-13T22:08:40.649 INFO:tasks.workunit.client.0.smithi089.stdout:2/333: dwrite df/f26 [0,4194304] 0 2024-09-13T22:08:40.649 INFO:tasks.workunit.client.0.smithi089.stdout:0/477: symlink d1/de/d10/d36/d57/d3a/l9f 0 2024-09-13T22:08:40.649 INFO:tasks.workunit.client.0.smithi089.stdout:2/334: truncate df/d5b/f6f 433369 0 2024-09-13T22:08:40.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.644+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db4107710 con 0x7f2db40fea80 2024-09-13T22:08:40.649 INFO:tasks.workunit.client.0.smithi089.stdout:0/478: write d1/de/d10/f64 [958776,51166] 0 2024-09-13T22:08:40.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.644+0000 7f2db1ffb640 1 -- 172.21.15.89:0/2122203365 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 20) v1 ==== 91631+0+0 (secure 0 0 0) 0x7f2da8014b90 con 0x7f2db40fea80 2024-09-13T22:08:40.650 INFO:tasks.workunit.client.0.smithi089.stdout:5/335: rename d4/d19/d1e/d28/d31/f37 to d4/d19/d1e/d53/f7e 0 2024-09-13T22:08:40.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.645+0000 7f2db1ffb640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2da406d770 0x7f2da406fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:40.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.645+0000 7f2db1ffb640 1 -- 172.21.15.89:0/2122203365 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2da808c990 con 0x7f2db40fea80 2024-09-13T22:08:40.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.645+0000 7f2db3fff640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2da406d770 0x7f2da406fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:40.651 INFO:tasks.workunit.client.0.smithi089.stdout:2/335: mkdir df/d76 0 2024-09-13T22:08:40.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.646+0000 7f2db3fff640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2da406d770 0x7f2da406fc30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2da002a9c0 tx=0x7f2da0000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:40.653 INFO:tasks.workunit.client.0.smithi089.stdout:2/336: write df/d5b/f73 [607718,73495] 0 2024-09-13T22:08:40.653 INFO:tasks.workunit.client.0.smithi089.stdout:2/337: readlink df/d14/d2b/d61/l5e 0 2024-09-13T22:08:40.653 INFO:tasks.workunit.client.0.smithi089.stdout:0/479: mknod d1/de/d10/d36/d38/d4e/ca0 0 2024-09-13T22:08:40.653 INFO:tasks.workunit.client.0.smithi089.stdout:5/336: unlink d4/d19/d1e/c20 0 2024-09-13T22:08:40.654 INFO:tasks.workunit.client.0.smithi089.stdout:5/337: rename d4/d19/d1e/d53/l6c to d4/d19/d1e/d28/d31/d61/l7f 0 2024-09-13T22:08:40.654 INFO:tasks.workunit.client.0.smithi089.stdout:9/404: dread d6/d18/d21/f44 [0,4194304] 0 2024-09-13T22:08:40.654 INFO:tasks.workunit.client.0.smithi089.stdout:9/405: mknod d6/d18/d21/d5d/c8f 0 2024-09-13T22:08:40.654 INFO:tasks.workunit.client.0.smithi089.stdout:4/362: dread d0/d11/f30 [0,4194304] 0 2024-09-13T22:08:40.654 INFO:tasks.workunit.client.0.smithi089.stdout:4/363: write d0/f23 [2012020,77197] 0 2024-09-13T22:08:40.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.653+0000 7f2db1ffb640 1 -- 172.21.15.89:0/2122203365 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2da805a8c0 con 0x7f2db40fea80 2024-09-13T22:08:40.657 INFO:tasks.workunit.client.0.smithi089.stdout:5/338: write d4/f1c [3776780,53307] 0 2024-09-13T22:08:40.659 INFO:tasks.workunit.client.0.smithi089.stdout:3/358: dwrite d1/d2/d24/f3b [4194304,4194304] 0 2024-09-13T22:08:40.659 INFO:tasks.workunit.client.0.smithi089.stdout:7/318: dwrite d0/d19/d28/d1d/d2d/d3c/f4e [0,4194304] 0 2024-09-13T22:08:40.659 INFO:tasks.workunit.client.0.smithi089.stdout:3/359: creat d1/d2/d18/d38/f74 x:0 0 0 2024-09-13T22:08:40.659 INFO:tasks.workunit.client.0.smithi089.stdout:5/339: mknod d4/d19/d1e/c80 0 2024-09-13T22:08:40.660 INFO:tasks.workunit.client.0.smithi089.stdout:7/319: read d0/d19/d45/d38/d54/f60 [758113,69823] 0 2024-09-13T22:08:40.661 INFO:tasks.workunit.client.0.smithi089.stdout:7/320: creat d0/d19/d28/d1d/d23/d2e/d41/f65 x:0 0 0 2024-09-13T22:08:40.661 INFO:tasks.workunit.client.0.smithi089.stdout:7/321: dread - d0/d19/d28/d1d/d30/f59 zero size 2024-09-13T22:08:40.661 INFO:tasks.workunit.client.0.smithi089.stdout:0/480: write d1/de/d10/f1b [1908260,72070] 0 2024-09-13T22:08:40.661 INFO:tasks.workunit.client.0.smithi089.stdout:1/387: dwrite d7/de/d1b/f4e [0,4194304] 0 2024-09-13T22:08:40.661 INFO:tasks.workunit.client.0.smithi089.stdout:1/388: chown d7/d1c/c7d 275 1 2024-09-13T22:08:40.661 INFO:tasks.workunit.client.0.smithi089.stdout:1/389: write d7/de/d1b/d2b/d59/f85 [4218412,28722] 0 2024-09-13T22:08:40.662 INFO:tasks.workunit.client.0.smithi089.stdout:3/360: rmdir d1/d2/d18/d40 39 2024-09-13T22:08:40.662 INFO:tasks.workunit.client.0.smithi089.stdout:3/361: write d1/d7/f15 [1186880,4566] 0 2024-09-13T22:08:40.663 INFO:tasks.workunit.client.0.smithi089.stdout:3/362: dread f0 [8388608,4194304] 0 2024-09-13T22:08:40.669 INFO:tasks.workunit.client.0.smithi089.stdout:5/340: stat d4/d19/c70 0 2024-09-13T22:08:40.669 INFO:tasks.workunit.client.0.smithi089.stdout:5/341: chown d4/c22 622 1 2024-09-13T22:08:40.669 INFO:tasks.workunit.client.0.smithi089.stdout:5/342: read - d4/d19/d1e/d28/d3d/d5e/f66 zero size 2024-09-13T22:08:40.669 INFO:tasks.workunit.client.0.smithi089.stdout:5/343: readlink d4/d19/d1e/d28/d3d/l44 0 2024-09-13T22:08:40.671 INFO:tasks.workunit.client.0.smithi089.stdout:7/322: rmdir d0/d19/d28/d1d/d23/d24/d5d 39 2024-09-13T22:08:40.674 INFO:tasks.workunit.client.0.smithi089.stdout:4/364: dwrite d0/d2c/d35/f51 [0,4194304] 0 2024-09-13T22:08:40.679 INFO:tasks.workunit.client.0.smithi089.stdout:0/481: mknod d1/de/d10/d85/ca1 0 2024-09-13T22:08:40.682 INFO:tasks.workunit.client.0.smithi089.stdout:5/344: truncate d4/d19/d1e/d28/d31/d35/f47 361641 0 2024-09-13T22:08:40.684 INFO:tasks.workunit.client.0.smithi089.stdout:7/323: mknod d0/d19/d45/c66 0 2024-09-13T22:08:40.685 INFO:tasks.workunit.client.0.smithi089.stdout:9/406: dwrite d6/d18/d1b/f26 [0,4194304] 0 2024-09-13T22:08:40.687 INFO:tasks.workunit.client.0.smithi089.stdout:4/365: symlink d0/d2c/d35/d64/d6e/l72 0 2024-09-13T22:08:40.688 INFO:tasks.workunit.client.0.smithi089.stdout:0/482: mknod d1/de/d10/d36/d57/d3a/ca2 0 2024-09-13T22:08:40.688 INFO:tasks.workunit.client.0.smithi089.stdout:0/483: chown d1/de/d15/d2a/f81 1174 1 2024-09-13T22:08:40.689 INFO:tasks.workunit.client.0.smithi089.stdout:1/390: rmdir d7/d34 39 2024-09-13T22:08:40.689 INFO:tasks.workunit.client.0.smithi089.stdout:4/366: dread d0/d2c/f41 [0,4194304] 0 2024-09-13T22:08:40.690 INFO:tasks.workunit.client.0.smithi089.stdout:4/367: creat d0/d2c/d52/f73 x:0 0 0 2024-09-13T22:08:40.690 INFO:tasks.workunit.client.0.smithi089.stdout:1/391: creat d7/de/d68/f90 x:0 0 0 2024-09-13T22:08:40.690 INFO:tasks.workunit.client.0.smithi089.stdout:1/392: truncate d7/d1c/d3c/f5e 450838 0 2024-09-13T22:08:40.691 INFO:tasks.workunit.client.0.smithi089.stdout:9/407: write d6/d18/d1b/f2e [2642347,33903] 0 2024-09-13T22:08:40.692 INFO:tasks.workunit.client.0.smithi089.stdout:9/408: write d6/d31/d5e/f7d [786642,97836] 0 2024-09-13T22:08:40.692 INFO:tasks.workunit.client.0.smithi089.stdout:1/393: symlink d7/d34/d5c/l91 0 2024-09-13T22:08:40.693 INFO:tasks.workunit.client.0.smithi089.stdout:9/409: creat d6/d18/d33/f90 x:0 0 0 2024-09-13T22:08:40.694 INFO:tasks.workunit.client.0.smithi089.stdout:8/377: sync 2024-09-13T22:08:40.694 INFO:tasks.workunit.client.0.smithi089.stdout:8/378: dread - d0/dd/d12/d42/f2c zero size 2024-09-13T22:08:40.694 INFO:tasks.workunit.client.0.smithi089.stdout:8/379: readlink d0/d6a/d73/l76 0 2024-09-13T22:08:40.694 INFO:tasks.workunit.client.0.smithi089.stdout:8/380: write d0/dd/d12/d20/d1c/d5a/f74 [969827,39501] 0 2024-09-13T22:08:40.694 INFO:tasks.workunit.client.0.smithi089.stdout:8/381: fdatasync d0/dd/d12/d20/d36/d80/d70/f7e 0 2024-09-13T22:08:40.694 INFO:tasks.workunit.client.0.smithi089.stdout:4/368: dread d0/d2c/d52/f54 [0,4194304] 0 2024-09-13T22:08:40.694 INFO:tasks.workunit.client.0.smithi089.stdout:8/382: mknod d0/d6a/d6f/c84 0 2024-09-13T22:08:40.694 INFO:tasks.workunit.client.0.smithi089.stdout:8/383: read d0/dd/d12/d20/d1c/f2f [722827,37733] 0 2024-09-13T22:08:40.695 INFO:tasks.workunit.client.0.smithi089.stdout:8/384: write d0/dd/d12/d20/d36/f58 [1397507,40276] 0 2024-09-13T22:08:40.696 INFO:tasks.workunit.client.0.smithi089.stdout:4/369: mkdir d0/d2c/d35/d74 0 2024-09-13T22:08:40.696 INFO:tasks.workunit.client.0.smithi089.stdout:4/370: read d0/d11/d16/f2d [2309761,112358] 0 2024-09-13T22:08:40.696 INFO:tasks.workunit.client.0.smithi089.stdout:8/385: symlink d0/dd/d12/d20/d40/d4a/l85 0 2024-09-13T22:08:40.696 INFO:tasks.workunit.client.0.smithi089.stdout:8/386: chown d0/dd/d12/d20/f2e 42546618 1 2024-09-13T22:08:40.697 INFO:tasks.workunit.client.0.smithi089.stdout:5/345: dread d4/d19/d1e/d28/f51 [0,4194304] 0 2024-09-13T22:08:40.697 INFO:tasks.workunit.client.0.smithi089.stdout:8/387: getdents d0/dd/d12/d42 0 2024-09-13T22:08:40.703 INFO:tasks.workunit.client.0.smithi089.stdout:8/388: truncate d0/dd/d12/d20/d36/f21 218361 0 2024-09-13T22:08:40.705 INFO:tasks.workunit.client.0.smithi089.stdout:8/389: link d0/dd/d12/d3a/l47 d0/dd/d12/d20/d36/d80/l86 0 2024-09-13T22:08:40.707 INFO:tasks.workunit.client.0.smithi089.stdout:8/390: symlink d0/dd/d12/d3a/d83/l87 0 2024-09-13T22:08:40.736 INFO:tasks.workunit.client.0.smithi089.stdout:0/484: dwrite d1/de/d10/d36/d57/d3a/f3c [4194304,4194304] 0 2024-09-13T22:08:40.737 INFO:tasks.workunit.client.0.smithi089.stdout:1/394: dwrite d7/de/f30 [4194304,4194304] 0 2024-09-13T22:08:40.737 INFO:tasks.workunit.client.0.smithi089.stdout:4/371: dwrite d0/d2c/f45 [0,4194304] 0 2024-09-13T22:08:40.737 INFO:tasks.workunit.client.0.smithi089.stdout:5/346: dwrite d4/d19/f1b [4194304,4194304] 0 2024-09-13T22:08:40.737 INFO:tasks.workunit.client.0.smithi089.stdout:4/372: write d0/d2c/d35/f49 [1780320,65885] 0 2024-09-13T22:08:40.738 INFO:tasks.workunit.client.0.smithi089.stdout:8/391: dwrite d0/dd/d12/d20/d40/d4a/f7a [0,4194304] 0 2024-09-13T22:08:40.742 INFO:tasks.workunit.client.0.smithi089.stdout:0/485: creat d1/de/d15/d41/d49/d76/d8b/fa3 x:0 0 0 2024-09-13T22:08:40.746 INFO:tasks.workunit.client.0.smithi089.stdout:8/392: mkdir d0/dd/d12/d20/d36/d80/d3b/d88 0 2024-09-13T22:08:40.746 INFO:tasks.workunit.client.0.smithi089.stdout:6/337: sync 2024-09-13T22:08:40.747 INFO:tasks.workunit.client.0.smithi089.stdout:1/395: getdents d7/d40 0 2024-09-13T22:08:40.748 INFO:tasks.workunit.client.0.smithi089.stdout:1/396: chown d7/de/d1b 358 1 2024-09-13T22:08:40.748 INFO:tasks.workunit.client.0.smithi089.stdout:0/486: mkdir d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4 0 2024-09-13T22:08:40.749 INFO:tasks.workunit.client.0.smithi089.stdout:8/393: write d0/dd/d11/f25 [674108,103542] 0 2024-09-13T22:08:40.749 INFO:tasks.workunit.client.0.smithi089.stdout:8/394: dread - d0/dd/f7d zero size 2024-09-13T22:08:40.750 INFO:tasks.workunit.client.0.smithi089.stdout:1/397: creat d7/d34/d5c/f92 x:0 0 0 2024-09-13T22:08:40.750 INFO:tasks.workunit.client.0.smithi089.stdout:1/398: fsync d7/d1c/f72 0 2024-09-13T22:08:40.750 INFO:tasks.workunit.client.0.smithi089.stdout:0/487: rename d1/l79 to d1/de/d10/d36/d38/la5 0 2024-09-13T22:08:40.751 INFO:tasks.workunit.client.0.smithi089.stdout:1/399: rmdir d7/d34 39 2024-09-13T22:08:40.751 INFO:tasks.workunit.client.0.smithi089.stdout:1/400: write d7/de/d1b/d80/f82 [1204134,85424] 0 2024-09-13T22:08:40.753 INFO:tasks.workunit.client.0.smithi089.stdout:1/401: rename d7/d1c/d3c/c42 to d7/de/d3a/d77/c93 0 2024-09-13T22:08:40.755 INFO:tasks.workunit.client.0.smithi089.stdout:1/402: mknod d7/de/d3a/d77/c94 0 2024-09-13T22:08:40.756 INFO:tasks.workunit.client.0.smithi089.stdout:6/338: read d0/d4/f5b [2871801,44506] 0 2024-09-13T22:08:40.761 INFO:tasks.workunit.client.0.smithi089.stdout:0/488: write d1/de/d10/f45 [1779461,33836] 0 2024-09-13T22:08:40.761 INFO:tasks.workunit.client.0.smithi089.stdout:0/489: truncate d1/de/d10/d36/d38/d4e/d62/d5f/d72/f93 111715 0 2024-09-13T22:08:40.761 INFO:tasks.workunit.client.0.smithi089.stdout:0/490: chown d1/de/d10/d36/d57/d3a/l80 18056 1 2024-09-13T22:08:40.761 INFO:tasks.workunit.client.0.smithi089.stdout:0/491: mknod d1/de/d10/d36/d57/d3a/ca6 0 2024-09-13T22:08:40.763 INFO:tasks.workunit.client.0.smithi089.stdout:0/492: getdents d1/de/d1f 0 2024-09-13T22:08:40.766 INFO:tasks.workunit.client.0.smithi089.stdout:5/347: dwrite d4/d19/f24 [4194304,4194304] 0 2024-09-13T22:08:40.768 INFO:tasks.workunit.client.0.smithi089.stdout:8/395: dwrite d0/dd/f7d [0,4194304] 0 2024-09-13T22:08:40.768 INFO:tasks.workunit.client.0.smithi089.stdout:8/396: stat d0/dd/d12/d20/d40/c65 0 2024-09-13T22:08:40.768 INFO:tasks.workunit.client.0.smithi089.stdout:8/397: fdatasync d0/dd/d12/d20/d1c/f2f 0 2024-09-13T22:08:40.768 INFO:tasks.workunit.client.0.smithi089.stdout:8/398: write d0/dd/d12/d20/d36/f58 [1918662,31150] 0 2024-09-13T22:08:40.768 INFO:tasks.workunit.client.0.smithi089.stdout:5/348: mknod d4/d19/d1e/d28/d31/d61/c81 0 2024-09-13T22:08:40.777 INFO:tasks.workunit.client.0.smithi089.stdout:5/349: symlink d4/d19/d1e/d28/d31/l82 0 2024-09-13T22:08:40.777 INFO:tasks.workunit.client.0.smithi089.stdout:8/399: getdents d0/dd/d12 0 2024-09-13T22:08:40.777 INFO:tasks.workunit.client.0.smithi089.stdout:8/400: chown d0/dd/d12/d20/f17 1136 1 2024-09-13T22:08:40.778 INFO:tasks.workunit.client.0.smithi089.stdout:8/401: rename d0/dd/d11 to d0/dd/d12/d20/d36/d59/d89 0 2024-09-13T22:08:40.778 INFO:tasks.workunit.client.0.smithi089.stdout:8/402: write d0/dd/f46 [255098,40211] 0 2024-09-13T22:08:40.779 INFO:tasks.workunit.client.0.smithi089.stdout:1/403: dwrite d7/de/d1b/d2b/d59/f85 [4194304,4194304] 0 2024-09-13T22:08:40.780 INFO:tasks.workunit.client.0.smithi089.stdout:1/404: chown d7/f43 70054 1 2024-09-13T22:08:40.787 INFO:tasks.workunit.client.0.smithi089.stdout:0/493: dwrite d1/de/d10/d36/d38/f86 [0,4194304] 0 2024-09-13T22:08:40.789 INFO:tasks.workunit.client.0.smithi089.stdout:0/494: symlink d1/de/d15/la7 0 2024-09-13T22:08:40.790 INFO:tasks.workunit.client.0.smithi089.stdout:0/495: symlink d1/de/d10/d36/d38/d4e/d62/d5f/la8 0 2024-09-13T22:08:40.791 INFO:tasks.workunit.client.0.smithi089.stdout:0/496: fsync d1/de/d10/d36/d38/d4e/d62/d5b/f67 0 2024-09-13T22:08:40.791 INFO:tasks.workunit.client.0.smithi089.stdout:7/324: sync 2024-09-13T22:08:40.791 INFO:tasks.workunit.client.0.smithi089.stdout:0/497: chown d1/de/d10/d36/d57/c2b 12871482 1 2024-09-13T22:08:40.791 INFO:tasks.workunit.client.0.smithi089.stdout:3/363: sync 2024-09-13T22:08:40.791 INFO:tasks.workunit.client.0.smithi089.stdout:9/410: sync 2024-09-13T22:08:40.791 INFO:tasks.workunit.client.0.smithi089.stdout:2/338: sync 2024-09-13T22:08:40.791 INFO:tasks.workunit.client.0.smithi089.stdout:2/339: write df/d5b/f73 [1692740,78599] 0 2024-09-13T22:08:40.791 INFO:tasks.workunit.client.0.smithi089.stdout:2/340: chown df/d14/d2b/d61/l40 1505161 1 2024-09-13T22:08:40.792 INFO:tasks.workunit.client.0.smithi089.stdout:7/325: rename d0/d19/c26 to d0/d19/c67 0 2024-09-13T22:08:40.794 INFO:tasks.workunit.client.0.smithi089.stdout:3/364: truncate f0 6937070 0 2024-09-13T22:08:40.794 INFO:tasks.workunit.client.0.smithi089.stdout:1/405: dread d7/de/d1b/f58 [0,4194304] 0 2024-09-13T22:08:40.795 INFO:tasks.workunit.client.0.smithi089.stdout:1/406: mknod d7/de/d68/c95 0 2024-09-13T22:08:40.805 INFO:tasks.workunit.client.0.smithi089.stdout:0/498: dread d1/de/f3e [4194304,4194304] 0 2024-09-13T22:08:40.806 INFO:tasks.workunit.client.0.smithi089.stdout:3/365: dread d1/f6 [0,4194304] 0 2024-09-13T22:08:40.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/366: symlink d1/d2/d18/d40/l75 0 2024-09-13T22:08:40.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/367: readlink d1/d2/d18/d40/l75 0 2024-09-13T22:08:40.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/368: chown d1/d2/d4/cd 30561 1 2024-09-13T22:08:40.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/369: truncate d1/d7/d1b/f4e 17526 0 2024-09-13T22:08:40.811 INFO:tasks.workunit.client.0.smithi089.stdout:3/370: unlink d1/d7/d1b/d28/l71 0 2024-09-13T22:08:40.811 INFO:tasks.workunit.client.0.smithi089.stdout:3/371: write d1/d2/d18/d38/f74 [603442,9009] 0 2024-09-13T22:08:40.811 INFO:tasks.workunit.client.0.smithi089.stdout:3/372: readlink d1/l32 0 2024-09-13T22:08:40.811 INFO:tasks.workunit.client.0.smithi089.stdout:3/373: stat d1/d2/l2f 0 2024-09-13T22:08:40.811 INFO:tasks.workunit.client.0.smithi089.stdout:3/374: chown d1/d2/d4/cd 0 1 2024-09-13T22:08:40.812 INFO:tasks.workunit.client.0.smithi089.stdout:3/375: creat d1/d2/d23/f76 x:0 0 0 2024-09-13T22:08:40.814 INFO:tasks.workunit.client.0.smithi089.stdout:0/499: write d1/de/d10/d36/d38/d4e/d62/d5f/d72/f83 [3483921,80364] 0 2024-09-13T22:08:40.814 INFO:tasks.workunit.client.0.smithi089.stdout:0/500: chown d1/de/d10/d36/d38/d4e/d62/d5f/d72/f93 75605 1 2024-09-13T22:08:40.814 INFO:tasks.workunit.client.0.smithi089.stdout:0/501: readlink d1/de/d10/l75 0 2024-09-13T22:08:40.815 INFO:tasks.workunit.client.0.smithi089.stdout:3/376: rmdir d1/d2/d18/d40/d50 39 2024-09-13T22:08:40.816 INFO:tasks.workunit.client.0.smithi089.stdout:0/502: mknod d1/de/d10/d36/d38/d4e/d62/d5f/d72/ca9 0 2024-09-13T22:08:40.816 INFO:tasks.workunit.client.0.smithi089.stdout:9/411: dwrite d6/d18/d33/f90 [0,4194304] 0 2024-09-13T22:08:40.817 INFO:tasks.workunit.client.0.smithi089.stdout:0/503: creat d1/de/d10/d36/d38/d4e/d62/d5f/faa x:0 0 0 2024-09-13T22:08:40.817 INFO:tasks.workunit.client.0.smithi089.stdout:0/504: write d1/de/d15/d41/d49/d76/d8b/fa3 [103860,1112] 0 2024-09-13T22:08:40.821 INFO:tasks.workunit.client.0.smithi089.stdout:9/412: rename d6/d55/f75 to d6/d31/d64/f91 0 2024-09-13T22:08:40.823 INFO:tasks.workunit.client.0.smithi089.stdout:9/413: rename d6/d31/l5b to d6/d31/l92 0 2024-09-13T22:08:40.826 INFO:tasks.workunit.client.0.smithi089.stdout:7/326: dwrite d0/d19/d28/f1c [0,4194304] 0 2024-09-13T22:08:40.826 INFO:tasks.workunit.client.0.smithi089.stdout:7/327: fdatasync d0/ff 0 2024-09-13T22:08:40.828 INFO:tasks.workunit.client.0.smithi089.stdout:2/341: dwrite df/d14/f65 [0,4194304] 0 2024-09-13T22:08:40.829 INFO:tasks.workunit.client.0.smithi089.stdout:1/407: dwrite d7/d34/d5c/f88 [0,4194304] 0 2024-09-13T22:08:40.829 INFO:tasks.workunit.client.0.smithi089.stdout:1/408: truncate d7/d40/f79 846479 0 2024-09-13T22:08:40.829 INFO:tasks.workunit.client.0.smithi089.stdout:0/505: dread d1/de/d10/f45 [0,4194304] 0 2024-09-13T22:08:40.829 INFO:tasks.workunit.client.0.smithi089.stdout:7/328: rmdir d0/d19/d28/d1d/d23/d24/d5d 39 2024-09-13T22:08:40.831 INFO:tasks.workunit.client.0.smithi089.stdout:2/342: mknod df/d1a/d57/c77 0 2024-09-13T22:08:40.832 INFO:tasks.workunit.client.0.smithi089.stdout:1/409: mknod d7/d40/c96 0 2024-09-13T22:08:40.832 INFO:tasks.workunit.client.0.smithi089.stdout:1/410: chown c6 0 1 2024-09-13T22:08:40.834 INFO:tasks.workunit.client.0.smithi089.stdout:3/377: dwrite d1/d2/d4/f16 [4194304,4194304] 0 2024-09-13T22:08:40.837 INFO:tasks.workunit.client.0.smithi089.stdout:0/506: mknod d1/de/d10/d36/d38/d4e/d62/d5f/cab 0 2024-09-13T22:08:40.837 INFO:tasks.workunit.client.0.smithi089.stdout:0/507: creat d1/de/d10/d36/d38/d4e/d62/d5f/d72/fac x:0 0 0 2024-09-13T22:08:40.839 INFO:tasks.workunit.client.0.smithi089.stdout:2/343: creat df/d76/f78 x:0 0 0 2024-09-13T22:08:40.839 INFO:tasks.workunit.client.0.smithi089.stdout:2/344: fsync df/d14/d2b/f63 0 2024-09-13T22:08:40.839 INFO:tasks.workunit.client.0.smithi089.stdout:2/345: fdatasync df/d14/d66/d69/f51 0 2024-09-13T22:08:40.841 INFO:tasks.workunit.client.0.smithi089.stdout:1/411: creat d7/d40/f97 x:0 0 0 2024-09-13T22:08:40.841 INFO:tasks.workunit.client.0.smithi089.stdout:1/412: truncate d7/de/d1b/d2b/f2d 4740523 0 2024-09-13T22:08:40.842 INFO:tasks.workunit.client.0.smithi089.stdout:3/378: stat d1/d2/d24/l45 0 2024-09-13T22:08:40.844 INFO:tasks.workunit.client.0.smithi089.stdout:2/346: mkdir df/d5b/d79 0 2024-09-13T22:08:40.844 INFO:tasks.workunit.client.0.smithi089.stdout:2/347: fsync df/d5b/f6f 0 2024-09-13T22:08:40.845 INFO:tasks.workunit.client.0.smithi089.stdout:0/508: dread d1/de/d15/d2a/f81 [0,4194304] 0 2024-09-13T22:08:40.845 INFO:tasks.workunit.client.0.smithi089.stdout:1/413: unlink d7/de/d1b/f4e 0 2024-09-13T22:08:40.846 INFO:tasks.workunit.client.0.smithi089.stdout:3/379: rename d1/d2/f29 to d1/d2/d23/d3d/d54/d5d/f77 0 2024-09-13T22:08:40.847 INFO:tasks.workunit.client.0.smithi089.stdout:2/348: getdents df/d14/d2b/d4b 0 2024-09-13T22:08:40.847 INFO:tasks.workunit.client.0.smithi089.stdout:9/414: dwrite d6/d18/d33/f42 [0,4194304] 0 2024-09-13T22:08:40.850 INFO:tasks.workunit.client.0.smithi089.stdout:2/349: dread df/f22 [0,4194304] 0 2024-09-13T22:08:40.854 INFO:tasks.workunit.client.0.smithi089.stdout:7/329: dwrite d0/d19/d28/d1d/d23/f35 [0,4194304] 0 2024-09-13T22:08:40.856 INFO:tasks.workunit.client.0.smithi089.stdout:0/509: dread d1/de/d10/d36/d57/d3a/f3c [4194304,4194304] 0 2024-09-13T22:08:40.857 INFO:tasks.workunit.client.0.smithi089.stdout:1/414: rmdir d7/de/d1b 39 2024-09-13T22:08:40.859 INFO:tasks.workunit.client.0.smithi089.stdout:2/350: read df/d14/d66/d69/d2e/f37 [201194,33178] 0 2024-09-13T22:08:40.859 INFO:tasks.workunit.client.0.smithi089.stdout:3/380: dread d1/d2/d23/d3d/d46/f67 [0,4194304] 0 2024-09-13T22:08:40.859 INFO:tasks.workunit.client.0.smithi089.stdout:3/381: stat d1/d2/d31 0 2024-09-13T22:08:40.859 INFO:tasks.workunit.client.0.smithi089.stdout:3/382: dread - d1/d2/d18/d40/d50/f72 zero size 2024-09-13T22:08:40.860 INFO:tasks.workunit.client.0.smithi089.stdout:7/330: dread d0/f3f [0,4194304] 0 2024-09-13T22:08:40.861 INFO:tasks.workunit.client.0.smithi089.stdout:0/510: creat d1/de/d10/d36/d38/d4e/fad x:0 0 0 2024-09-13T22:08:40.861 INFO:tasks.workunit.client.0.smithi089.stdout:0/511: write d1/de/d1f/f88 [564390,84755] 0 2024-09-13T22:08:40.861 INFO:tasks.workunit.client.0.smithi089.stdout:0/512: fdatasync d1/de/d10/f64 0 2024-09-13T22:08:40.861 INFO:tasks.workunit.client.0.smithi089.stdout:1/415: creat d7/de/d1b/d2b/d39/f98 x:0 0 0 2024-09-13T22:08:40.861 INFO:tasks.workunit.client.0.smithi089.stdout:1/416: chown d7/d34/f37 14599 1 2024-09-13T22:08:40.862 INFO:tasks.workunit.client.1.smithi159.stderr:++ readlink -f fsstress 2024-09-13T22:08:40.863 INFO:tasks.workunit.client.0.smithi089.stdout:2/351: unlink df/d14/d2b/c45 0 2024-09-13T22:08:40.863 INFO:tasks.workunit.client.1.smithi159.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T22:08:40.863 INFO:tasks.workunit.client.1.smithi159.stderr:+ popd 2024-09-13T22:08:40.864 INFO:tasks.workunit.client.1.smithi159.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T22:08:40.864 INFO:tasks.workunit.client.1.smithi159.stderr:+ popd 2024-09-13T22:08:40.864 INFO:tasks.workunit.client.1.smithi159.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T22:08:40.864 INFO:tasks.workunit.client.1.smithi159.stderr:++ mktemp -d -p . 2024-09-13T22:08:40.865 INFO:tasks.workunit.client.0.smithi089.stdout:3/383: rename d1/d2/d23/c47 to d1/d2/d24/c78 0 2024-09-13T22:08:40.866 INFO:tasks.workunit.client.0.smithi089.stdout:0/513: mknod d1/de/d10/cae 0 2024-09-13T22:08:40.868 INFO:tasks.workunit.client.1.smithi159.stderr:+ T=./tmp.8iGUkoBjqV 2024-09-13T22:08:40.868 INFO:tasks.workunit.client.1.smithi159.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.8iGUkoBjqV -l 1 -n 1000 -p 10 -v 2024-09-13T22:08:40.869 INFO:tasks.workunit.client.0.smithi089.stdout:3/384: creat d1/d7/d1b/d28/d63/f79 x:0 0 0 2024-09-13T22:08:40.870 INFO:tasks.workunit.client.0.smithi089.stdout:4/373: sync 2024-09-13T22:08:40.870 INFO:tasks.workunit.client.0.smithi089.stdout:4/374: chown d0/d15/d1f/f31 10 1 2024-09-13T22:08:40.870 INFO:tasks.workunit.client.0.smithi089.stdout:4/375: fdatasync d0/d2c/f45 0 2024-09-13T22:08:40.877 INFO:tasks.workunit.client.1.smithi159.stdout:seed = 1726604621 2024-09-13T22:08:40.878 INFO:tasks.workunit.client.0.smithi089.stdout:2/352: getdents df/d76 0 2024-09-13T22:08:40.878 INFO:tasks.workunit.client.0.smithi089.stdout:4/376: mkdir d0/d15/d1f/d75 0 2024-09-13T22:08:40.878 INFO:tasks.workunit.client.0.smithi089.stdout:4/377: read - d0/d2c/d35/f67 zero size 2024-09-13T22:08:40.878 INFO:tasks.workunit.client.0.smithi089.stdout:4/378: read d0/f23 [1753805,17835] 0 2024-09-13T22:08:40.878 INFO:tasks.workunit.client.0.smithi089.stdout:4/379: fdatasync d0/d11/d16/d24/f32 0 2024-09-13T22:08:40.878 INFO:tasks.workunit.client.0.smithi089.stdout:4/380: mkdir d0/d15/d76 0 2024-09-13T22:08:40.879 INFO:tasks.workunit.client.1.smithi159.stdout:0/0: rename - no filename 2024-09-13T22:08:40.879 INFO:tasks.workunit.client.0.smithi089.stdout:0/514: write d1/de/d10/d36/d38/f86 [2968305,79953] 0 2024-09-13T22:08:40.880 INFO:tasks.workunit.client.0.smithi089.stdout:4/381: creat d0/d2c/d35/d64/d6e/f77 x:0 0 0 2024-09-13T22:08:40.880 INFO:tasks.workunit.client.0.smithi089.stdout:4/382: chown d0/d11/d16/c39 2062084 1 2024-09-13T22:08:40.880 INFO:tasks.workunit.client.0.smithi089.stdout:4/383: creat d0/d2c/d35/d64/f78 x:0 0 0 2024-09-13T22:08:40.881 INFO:tasks.workunit.client.1.smithi159.stdout:1/0: write - no filename 2024-09-13T22:08:40.882 INFO:tasks.workunit.client.1.smithi159.stdout:0/1: mkdir d0 0 2024-09-13T22:08:40.882 INFO:tasks.workunit.client.1.smithi159.stdout:0/2: rename d0 to d0/d1 22 2024-09-13T22:08:40.882 INFO:tasks.workunit.client.1.smithi159.stdout:0/3: dread - no filename 2024-09-13T22:08:40.883 INFO:tasks.workunit.client.1.smithi159.stdout:0/4: rename d0 to d0/d2 22 2024-09-13T22:08:40.883 INFO:tasks.workunit.client.1.smithi159.stdout:0/5: dwrite - no filename 2024-09-13T22:08:40.883 INFO:tasks.workunit.client.1.smithi159.stdout:0/6: chown d0 563973052 1 2024-09-13T22:08:40.883 INFO:tasks.workunit.client.1.smithi159.stdout:0/7: getdents d0 0 2024-09-13T22:08:40.884 INFO:tasks.workunit.client.0.smithi089.stdout:0/515: rename d1/de/d10/f13 to d1/de/d10/d36/d3d/faf 0 2024-09-13T22:08:40.885 INFO:tasks.workunit.client.0.smithi089.stdout:7/331: dwrite d0/f22 [0,4194304] 0 2024-09-13T22:08:40.885 INFO:tasks.workunit.client.0.smithi089.stdout:1/417: dwrite d7/f26 [4194304,4194304] 0 2024-09-13T22:08:40.885 INFO:tasks.workunit.client.0.smithi089.stdout:1/418: chown d7/de/d3a/c41 143 1 2024-09-13T22:08:40.885 INFO:tasks.workunit.client.0.smithi089.stdout:1/419: chown d7/d34/c31 18320165 1 2024-09-13T22:08:40.885 INFO:tasks.workunit.client.0.smithi089.stdout:1/420: chown d7/de/d3a/d77/c94 915 1 2024-09-13T22:08:40.886 INFO:tasks.workunit.client.1.smithi159.stdout:2/0: chown . 192 1 2024-09-13T22:08:40.886 INFO:tasks.workunit.client.1.smithi159.stdout:2/1: dwrite - no filename 2024-09-13T22:08:40.886 INFO:tasks.workunit.client.1.smithi159.stdout:2/2: read - no filename 2024-09-13T22:08:40.886 INFO:tasks.workunit.client.1.smithi159.stdout:2/3: chown . 2 1 2024-09-13T22:08:40.886 INFO:tasks.workunit.client.1.smithi159.stdout:2/4: dwrite - no filename 2024-09-13T22:08:40.888 INFO:tasks.workunit.client.1.smithi159.stdout:1/1: creat f0 x:0 0 0 2024-09-13T22:08:40.889 INFO:tasks.workunit.client.1.smithi159.stdout:1/2: rmdir - no directory 2024-09-13T22:08:40.889 INFO:tasks.workunit.client.1.smithi159.stdout:1/3: truncate f0 724670 0 2024-09-13T22:08:40.889 INFO:tasks.workunit.client.1.smithi159.stdout:1/4: rmdir - no directory 2024-09-13T22:08:40.889 INFO:tasks.workunit.client.0.smithi089.stdout:0/516: stat d1/de/f14 0 2024-09-13T22:08:40.890 INFO:tasks.workunit.client.1.smithi159.stdout:1/5: dread f0 [0,4194304] 0 2024-09-13T22:08:40.890 INFO:tasks.workunit.client.1.smithi159.stdout:1/6: creat f1 x:0 0 0 2024-09-13T22:08:40.890 INFO:tasks.workunit.client.1.smithi159.stdout:1/7: write f0 [1064578,66729] 0 2024-09-13T22:08:40.891 INFO:tasks.workunit.client.1.smithi159.stdout:1/8: readlink - no filename 2024-09-13T22:08:40.891 INFO:tasks.workunit.client.1.smithi159.stdout:0/8: mkdir d0/d3 0 2024-09-13T22:08:40.891 INFO:tasks.workunit.client.1.smithi159.stdout:0/9: write - no filename 2024-09-13T22:08:40.891 INFO:tasks.workunit.client.1.smithi159.stdout:0/10: chown d0/d3 1925586 1 2024-09-13T22:08:40.891 INFO:tasks.workunit.client.1.smithi159.stdout:0/11: dread - no filename 2024-09-13T22:08:40.891 INFO:tasks.workunit.client.1.smithi159.stdout:0/12: write - no filename 2024-09-13T22:08:40.893 INFO:tasks.workunit.client.1.smithi159.stdout:3/0: rmdir - no directory 2024-09-13T22:08:40.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/5: creat f0 x:0 0 0 2024-09-13T22:08:40.895 INFO:tasks.workunit.client.1.smithi159.stdout:2/6: rmdir - no directory 2024-09-13T22:08:40.895 INFO:tasks.workunit.client.1.smithi159.stdout:2/7: chown f0 67185 1 2024-09-13T22:08:40.895 INFO:tasks.workunit.client.1.smithi159.stdout:2/8: chown f0 88 1 2024-09-13T22:08:40.896 INFO:tasks.workunit.client.0.smithi089.stdout:7/332: rename d0/c18 to d0/d19/d28/d1d/d2d/d55/d63/c68 0 2024-09-13T22:08:40.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.896+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2db419b650 con 0x7f2da406d770 2024-09-13T22:08:40.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.897+0000 7f2db1ffb640 1 -- 172.21.15.89:0/2122203365 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f2db419b650 con 0x7f2da406d770 2024-09-13T22:08:40.899 INFO:tasks.workunit.client.1.smithi159.stdout:3/1: mkdir d0 0 2024-09-13T22:08:40.899 INFO:tasks.workunit.client.1.smithi159.stdout:3/2: dwrite - no filename 2024-09-13T22:08:40.899 INFO:tasks.workunit.client.1.smithi159.stdout:3/3: stat d0 0 2024-09-13T22:08:40.899 INFO:tasks.workunit.client.1.smithi159.stdout:3/4: dread - no filename 2024-09-13T22:08:40.899 INFO:tasks.workunit.client.1.smithi159.stdout:3/5: fsync - no filename 2024-09-13T22:08:40.900 INFO:tasks.workunit.client.1.smithi159.stdout:4/0: unlink - no file 2024-09-13T22:08:40.901 INFO:tasks.workunit.client.1.smithi159.stdout:3/6: mkdir d0/d1 0 2024-09-13T22:08:40.901 INFO:tasks.workunit.client.0.smithi089.stdout:0/517: mkdir d1/de/d10/db0 0 2024-09-13T22:08:40.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2da406d770 msgr2=0x7f2da406fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:40.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2da406d770 0x7f2da406fc30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2da002a9c0 tx=0x7f2da0000bc0 comp rx=0 tx=0).stop 2024-09-13T22:08:40.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40fea80 msgr2=0x7f2db4195760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:40.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40fea80 0x7f2db4195760 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2da800b9f0 tx=0x7f2da800beb0 comp rx=0 tx=0).stop 2024-09-13T22:08:40.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 shutdown_connections 2024-09-13T22:08:40.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7f2da406d770 0x7f2da406fc30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:40.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db40ffc80 0x7f2db4195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:40.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 --2- 172.21.15.89:0/2122203365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db40fea80 0x7f2db4195760 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:40.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 >> 172.21.15.89:0/2122203365 conn(0x7f2db40fa230 msgr2=0x7f2db40fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:40.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.900+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 shutdown_connections 2024-09-13T22:08:40.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:40.901+0000 7f2dbaf4d640 1 -- 172.21.15.89:0/2122203365 wait complete. 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:5/0: dwrite - no filename 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:5/1: write - no filename 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:4/1: mknod c0 0 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:4/2: rmdir - no directory 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:4/3: dread - no filename 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:4/4: read - no filename 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:4/5: dwrite - no filename 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:4/6: dwrite - no filename 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:4/7: write - no filename 2024-09-13T22:08:40.904 INFO:tasks.workunit.client.1.smithi159.stdout:4/8: dwrite - no filename 2024-09-13T22:08:40.905 INFO:tasks.workunit.client.1.smithi159.stdout:3/7: creat d0/d1/f2 x:0 0 0 2024-09-13T22:08:40.905 INFO:tasks.workunit.client.0.smithi089.stdout:2/353: dwrite df/f12 [4194304,4194304] 0 2024-09-13T22:08:40.905 INFO:tasks.workunit.client.0.smithi089.stdout:2/354: readlink df/d14/d2b/l4a 0 2024-09-13T22:08:40.906 INFO:tasks.workunit.client.1.smithi159.stdout:6/0: write - no filename 2024-09-13T22:08:40.906 INFO:tasks.workunit.client.1.smithi159.stdout:5/2: symlink l0 0 2024-09-13T22:08:40.906 INFO:tasks.workunit.client.1.smithi159.stdout:5/3: dwrite - no filename 2024-09-13T22:08:40.906 INFO:tasks.workunit.client.1.smithi159.stdout:4/9: link c0 c1 0 2024-09-13T22:08:40.906 INFO:tasks.workunit.client.1.smithi159.stdout:4/10: truncate - no filename 2024-09-13T22:08:40.907 INFO:tasks.workunit.client.0.smithi089.stdout:4/384: dwrite d0/d2c/d35/d64/f78 [0,4194304] 0 2024-09-13T22:08:40.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/0: dread - no filename 2024-09-13T22:08:40.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/1: getdents . 0 2024-09-13T22:08:40.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/2: unlink - no file 2024-09-13T22:08:40.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/3: write - no filename 2024-09-13T22:08:40.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/4: fdatasync - no filename 2024-09-13T22:08:40.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/5: truncate - no filename 2024-09-13T22:08:40.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/6: dread - no filename 2024-09-13T22:08:40.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/7: stat - no entries 2024-09-13T22:08:40.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/8: write - no filename 2024-09-13T22:08:40.910 INFO:tasks.workunit.client.1.smithi159.stdout:7/9: truncate - no filename 2024-09-13T22:08:40.911 INFO:tasks.workunit.client.1.smithi159.stdout:6/1: mknod c0 0 2024-09-13T22:08:40.911 INFO:tasks.workunit.client.1.smithi159.stdout:6/2: dwrite - no filename 2024-09-13T22:08:40.911 INFO:tasks.workunit.client.1.smithi159.stdout:6/3: fsync - no filename 2024-09-13T22:08:40.912 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:08:40.915 INFO:tasks.workunit.client.1.smithi159.stdout:5/4: mkdir d1 0 2024-09-13T22:08:40.916 INFO:tasks.workunit.client.1.smithi159.stdout:5/5: stat d1 0 2024-09-13T22:08:40.921 INFO:tasks.workunit.client.1.smithi159.stdout:4/11: creat f2 x:0 0 0 2024-09-13T22:08:40.921 INFO:tasks.workunit.client.1.smithi159.stdout:4/12: readlink - no filename 2024-09-13T22:08:40.921 INFO:tasks.workunit.client.1.smithi159.stdout:4/13: readlink - no filename 2024-09-13T22:08:40.925 INFO:tasks.workunit.client.0.smithi089.stdout:0/518: write d1/de/d15/d41/f68 [1286074,49569] 0 2024-09-13T22:08:40.925 INFO:tasks.workunit.client.0.smithi089.stdout:0/519: write d1/de/d1f/f84 [1037562,47846] 0 2024-09-13T22:08:40.932 INFO:tasks.workunit.client.0.smithi089.stdout:2/355: dread df/d14/d2b/f59 [0,4194304] 0 2024-09-13T22:08:40.932 INFO:tasks.workunit.client.0.smithi089.stdout:2/356: readlink df/l56 0 2024-09-13T22:08:40.932 INFO:tasks.workunit.client.0.smithi089.stdout:2/357: dread - df/d1a/f42 zero size 2024-09-13T22:08:40.933 INFO:tasks.workunit.client.1.smithi159.stdout:6/4: mknod c1 0 2024-09-13T22:08:40.933 INFO:tasks.workunit.client.1.smithi159.stdout:6/5: write - no filename 2024-09-13T22:08:40.936 INFO:tasks.workunit.client.1.smithi159.stdout:5/6: creat d1/f2 x:0 0 0 2024-09-13T22:08:40.936 INFO:tasks.workunit.client.1.smithi159.stdout:5/7: rename d1 to d1/d3 22 2024-09-13T22:08:40.936 INFO:tasks.workunit.client.1.smithi159.stdout:5/8: dread - d1/f2 zero size 2024-09-13T22:08:40.936 INFO:tasks.workunit.client.1.smithi159.stdout:5/9: creat d1/f4 x:0 0 0 2024-09-13T22:08:40.937 INFO:tasks.workunit.client.1.smithi159.stdout:5/10: write d1/f2 [699284,34093] 0 2024-09-13T22:08:40.937 INFO:tasks.workunit.client.1.smithi159.stdout:5/11: readlink l0 0 2024-09-13T22:08:40.937 INFO:tasks.workunit.client.1.smithi159.stdout:5/12: creat d1/f5 x:0 0 0 2024-09-13T22:08:40.937 INFO:tasks.workunit.client.1.smithi159.stdout:5/13: readlink l0 0 2024-09-13T22:08:40.937 INFO:tasks.workunit.client.1.smithi159.stdout:5/14: chown d1/f5 63705879 1 2024-09-13T22:08:40.937 INFO:tasks.workunit.client.0.smithi089.stdout:4/385: creat d0/d11/d16/d24/d62/f79 x:0 0 0 2024-09-13T22:08:40.937 INFO:tasks.workunit.client.1.smithi159.stdout:0/13: getdents d0 0 2024-09-13T22:08:40.938 INFO:tasks.workunit.client.1.smithi159.stdout:0/14: getdents d0/d3 0 2024-09-13T22:08:40.938 INFO:tasks.workunit.client.1.smithi159.stdout:0/15: dwrite - no filename 2024-09-13T22:08:40.938 INFO:tasks.workunit.client.1.smithi159.stdout:0/16: chown d0 210 1 2024-09-13T22:08:40.938 INFO:tasks.workunit.client.1.smithi159.stdout:0/17: dread - no filename 2024-09-13T22:08:40.939 INFO:tasks.workunit.client.1.smithi159.stdout:4/14: symlink l3 0 2024-09-13T22:08:40.939 INFO:tasks.workunit.client.1.smithi159.stdout:4/15: dread - f2 zero size 2024-09-13T22:08:40.939 INFO:tasks.workunit.client.1.smithi159.stdout:4/16: read - f2 zero size 2024-09-13T22:08:40.944 INFO:tasks.workunit.client.1.smithi159.stdout:2/9: getdents . 0 2024-09-13T22:08:40.944 INFO:tasks.workunit.client.0.smithi089.stdout:0/520: mknod d1/de/d10/d36/d57/d3a/cb1 0 2024-09-13T22:08:40.952 INFO:tasks.workunit.client.0.smithi089.stdout:2/358: unlink df/d76/f78 0 2024-09-13T22:08:40.952 INFO:tasks.workunit.client.0.smithi089.stdout:2/359: chown df 84237604 1 2024-09-13T22:08:40.953 INFO:tasks.workunit.client.0.smithi089.stdout:2/360: readlink df/l4d 0 2024-09-13T22:08:40.953 INFO:tasks.workunit.client.0.smithi089.stdout:4/386: mknod d0/d2c/d35/d74/c7a 0 2024-09-13T22:08:40.955 INFO:tasks.workunit.client.0.smithi089.stdout:0/521: rename d1/de/d10/d36/l77 to d1/lb2 0 2024-09-13T22:08:40.955 INFO:tasks.workunit.client.0.smithi089.stdout:0/522: chown d1/de/d10/f45 8 1 2024-09-13T22:08:40.956 INFO:tasks.workunit.client.0.smithi089.stdout:0/523: creat d1/de/d10/d36/d38/d4e/d62/d5f/d72/fb3 x:0 0 0 2024-09-13T22:08:40.956 INFO:tasks.workunit.client.0.smithi089.stdout:0/524: fsync d1/de/f3e 0 2024-09-13T22:08:40.956 INFO:tasks.workunit.client.0.smithi089.stdout:0/525: creat d1/de/d10/fb4 x:0 0 0 2024-09-13T22:08:40.956 INFO:tasks.workunit.client.1.smithi159.stdout:0/18: symlink d0/d3/l4 0 2024-09-13T22:08:40.956 INFO:tasks.workunit.client.1.smithi159.stdout:0/19: read - no filename 2024-09-13T22:08:40.959 INFO:tasks.workunit.client.0.smithi089.stdout:4/387: symlink d0/d2c/d52/l7b 0 2024-09-13T22:08:40.959 INFO:tasks.workunit.client.0.smithi089.stdout:4/388: chown d0/d15/c40 378715 1 2024-09-13T22:08:40.959 INFO:tasks.workunit.client.0.smithi089.stdout:4/389: truncate d0/d15/d1f/f42 641720 0 2024-09-13T22:08:40.959 INFO:tasks.workunit.client.0.smithi089.stdout:4/390: chown d0/d15/d1f 1 1 2024-09-13T22:08:40.960 INFO:tasks.workunit.client.0.smithi089.stdout:4/391: fdatasync d0/d11/d16/d24/f2f 0 2024-09-13T22:08:40.960 INFO:tasks.workunit.client.0.smithi089.stdout:4/392: chown d0/d2c/d52/f5a 168867705 1 2024-09-13T22:08:40.960 INFO:tasks.workunit.client.1.smithi159.stdout:2/10: mkdir d1 0 2024-09-13T22:08:40.962 INFO:tasks.workunit.client.1.smithi159.stdout:0/20: mknod d0/c5 0 2024-09-13T22:08:40.962 INFO:tasks.workunit.client.1.smithi159.stdout:0/21: dread - no filename 2024-09-13T22:08:40.962 INFO:tasks.workunit.client.1.smithi159.stdout:0/22: rename d0 to d0/d6 22 2024-09-13T22:08:40.962 INFO:tasks.workunit.client.1.smithi159.stdout:0/23: write - no filename 2024-09-13T22:08:40.962 INFO:tasks.workunit.client.1.smithi159.stdout:0/24: dwrite - no filename 2024-09-13T22:08:40.965 INFO:tasks.workunit.client.0.smithi089.stdout:0/526: getdents d1/de 0 2024-09-13T22:08:40.967 INFO:tasks.workunit.client.1.smithi159.stdout:0/25: unlink d0/c5 0 2024-09-13T22:08:40.967 INFO:tasks.workunit.client.1.smithi159.stdout:0/26: dwrite - no filename 2024-09-13T22:08:40.970 INFO:tasks.workunit.client.0.smithi089.stdout:0/527: mkdir d1/de/d15/d41/d49/db5 0 2024-09-13T22:08:40.973 INFO:tasks.workunit.client.1.smithi159.stdout:0/27: mkdir d0/d7 0 2024-09-13T22:08:40.975 INFO:tasks.workunit.client.0.smithi089.stdout:0/528: truncate d1/de/f3e 5189566 0 2024-09-13T22:08:40.975 INFO:tasks.workunit.client.0.smithi089.stdout:0/529: fdatasync d1/de/d10/f64 0 2024-09-13T22:08:40.979 INFO:tasks.workunit.client.0.smithi089.stdout:0/530: mkdir d1/de/d10/d36/d38/d4e/d62/d5f/db6 0 2024-09-13T22:08:40.980 INFO:tasks.workunit.client.1.smithi159.stdout:0/28: creat d0/f8 x:0 0 0 2024-09-13T22:08:40.980 INFO:tasks.workunit.client.1.smithi159.stdout:0/29: chown d0/d3 31876335 1 2024-09-13T22:08:40.983 INFO:tasks.workunit.client.0.smithi089.stdout:0/531: mkdir d1/de/d10/d36/d57/d3a/db7 0 2024-09-13T22:08:40.984 INFO:tasks.workunit.client.0.smithi089.stdout:0/532: write d1/de/d10/d36/d38/d4e/d62/f74 [1282420,36792] 0 2024-09-13T22:08:40.984 INFO:tasks.workunit.client.0.smithi089.stdout:0/533: dread - d1/de/d10/fb4 zero size 2024-09-13T22:08:40.984 INFO:tasks.workunit.client.0.smithi089.stdout:0/534: write d1/de/d15/d41/d49/f92 [349130,71635] 0 2024-09-13T22:08:40.987 INFO:tasks.workunit.client.1.smithi159.stdout:0/30: creat d0/d7/f9 x:0 0 0 2024-09-13T22:08:40.987 INFO:tasks.workunit.client.1.smithi159.stdout:0/31: write d0/f8 [336374,71424] 0 2024-09-13T22:08:40.988 INFO:tasks.workunit.client.1.smithi159.stdout:0/32: write d0/d7/f9 [14327,25262] 0 2024-09-13T22:08:40.988 INFO:tasks.workunit.client.0.smithi089.stdout:0/535: symlink d1/de/d1f/lb8 0 2024-09-13T22:08:40.988 INFO:tasks.workunit.client.0.smithi089.stdout:0/536: readlink d1/de/d10/d36/d38/d4e/d62/d5f/l7e 0 2024-09-13T22:08:40.990 INFO:tasks.workunit.client.0.smithi089.stdout:0/537: mknod d1/cb9 0 2024-09-13T22:08:40.990 INFO:tasks.workunit.client.0.smithi089.stdout:0/538: write d1/de/d10/d36/d3d/faf [3054107,110767] 0 2024-09-13T22:08:40.992 INFO:tasks.workunit.client.0.smithi089.stdout:1/421: dwrite d7/f9 [0,4194304] 0 2024-09-13T22:08:41.000 INFO:tasks.workunit.client.0.smithi089.stdout:7/333: dwrite d0/d19/d28/d1d/d23/d24/f29 [4194304,4194304] 0 2024-09-13T22:08:41.000 INFO:tasks.workunit.client.0.smithi089.stdout:7/334: chown d0/d19/d28/d1d/d2d/d3c/f37 96260527 1 2024-09-13T22:08:41.031 INFO:tasks.workunit.client.1.smithi159.stdout:1/9: dwrite f0 [0,4194304] 0 2024-09-13T22:08:41.031 INFO:tasks.workunit.client.1.smithi159.stdout:1/10: chown f1 127177199 1 2024-09-13T22:08:41.031 INFO:tasks.workunit.client.1.smithi159.stdout:1/11: write f1 [1027083,39306] 0 2024-09-13T22:08:41.035 INFO:tasks.workunit.client.1.smithi159.stdout:3/8: getdents d0 0 2024-09-13T22:08:41.035 INFO:tasks.workunit.client.1.smithi159.stdout:3/9: stat d0/d1 0 2024-09-13T22:08:41.035 INFO:tasks.workunit.client.1.smithi159.stdout:3/10: truncate d0/d1/f2 712683 0 2024-09-13T22:08:41.035 INFO:tasks.workunit.client.1.smithi159.stdout:3/11: write d0/d1/f2 [1375262,8696] 0 2024-09-13T22:08:41.049 INFO:tasks.workunit.client.1.smithi159.stdout:1/12: symlink l2 0 2024-09-13T22:08:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.051+0000 7fd6637fe640 1 -- 172.21.15.89:0/2927190463 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6540373b0 con 0x7fd6641074b0 2024-09-13T22:08:41.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.052+0000 7fd66b1ba640 1 -- 172.21.15.89:0/2927190463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6641074b0 msgr2=0x7fd664107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.052+0000 7fd66b1ba640 1 --2- 172.21.15.89:0/2927190463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6641074b0 0x7fd664107930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd654009c20 tx=0x7fd65402a9a0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.053+0000 7fd66b1ba640 1 -- 172.21.15.89:0/2927190463 shutdown_connections 2024-09-13T22:08:41.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.053+0000 7fd66b1ba640 1 --2- 172.21.15.89:0/2927190463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6641074b0 0x7fd664107930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.053+0000 7fd66b1ba640 1 --2- 172.21.15.89:0/2927190463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd664071430 0x7fd664071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.053+0000 7fd66b1ba640 1 -- 172.21.15.89:0/2927190463 >> 172.21.15.89:0/2927190463 conn(0x7fd66406cc10 msgr2=0x7fd66406f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:41.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.054+0000 7fd66b1ba640 1 -- 172.21.15.89:0/2927190463 shutdown_connections 2024-09-13T22:08:41.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.054+0000 7fd66b1ba640 1 -- 172.21.15.89:0/2927190463 wait complete. 2024-09-13T22:08:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.055+0000 7fd66b1ba640 1 Processor -- start 2024-09-13T22:08:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.055+0000 7fd66b1ba640 1 -- start start 2024-09-13T22:08:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.055+0000 7fd66b1ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd664071430 0x7fd6641a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.055+0000 7fd66b1ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6641074b0 0x7fd6641a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:41.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.055+0000 7fd66b1ba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6641a5030 con 0x7fd6641074b0 2024-09-13T22:08:41.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.055+0000 7fd66b1ba640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6641a51a0 con 0x7fd664071430 2024-09-13T22:08:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.060+0000 7fd668f56640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd664071430 0x7fd6641a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.060+0000 7fd668f56640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd664071430 0x7fd6641a4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.89:43702/0 (socket says 172.21.15.89:43702) 2024-09-13T22:08:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.060+0000 7fd668f56640 1 -- 172.21.15.89:0/880753579 learned_addr learned my addr 172.21.15.89:0/880753579 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:41.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.060+0000 7fd663fff640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6641074b0 0x7fd6641a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:41.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.061+0000 7fd668f56640 1 -- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6641074b0 msgr2=0x7fd6641a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.061+0000 7fd668f56640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6641074b0 0x7fd6641a4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.061+0000 7fd668f56640 1 -- 172.21.15.89:0/880753579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654009900 con 0x7fd664071430 2024-09-13T22:08:41.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.062+0000 7fd668f56640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd664071430 0x7fd6641a4520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd65800b3d0 tx=0x7fd65800b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:41.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.062+0000 7fd661ffb640 1 -- 172.21.15.89:0/880753579 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd658011800 con 0x7fd664071430 2024-09-13T22:08:41.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.062+0000 7fd661ffb640 1 -- 172.21.15.89:0/880753579 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd658011e20 con 0x7fd664071430 2024-09-13T22:08:41.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.062+0000 7fd661ffb640 1 -- 172.21.15.89:0/880753579 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd658011800 con 0x7fd664071430 2024-09-13T22:08:41.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.063+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6641a9c40 con 0x7fd664071430 2024-09-13T22:08:41.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.063+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6641aa140 con 0x7fd664071430 2024-09-13T22:08:41.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.066+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd664117640 con 0x7fd664071430 2024-09-13T22:08:41.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.066+0000 7fd661ffb640 1 -- 172.21.15.89:0/880753579 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 20) v1 ==== 91631+0+0 (secure 0 0 0) 0x7fd658010380 con 0x7fd664071430 2024-09-13T22:08:41.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.067+0000 7fd661ffb640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd64c06d820 0x7fd64c06fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:41.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.067+0000 7fd661ffb640 1 -- 172.21.15.89:0/880753579 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd65805e5a0 con 0x7fd664071430 2024-09-13T22:08:41.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.071+0000 7fd663fff640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd64c06d820 0x7fd64c06fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:41.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.073+0000 7fd663fff640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd64c06d820 0x7fd64c06fce0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd65402ec40 tx=0x7fd65403b040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:41.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.079+0000 7fd661ffb640 1 -- 172.21.15.89:0/880753579 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd658057240 con 0x7fd664071430 2024-09-13T22:08:41.081 INFO:tasks.workunit.client.0.smithi089.stdout:6/339: sync 2024-09-13T22:08:41.084 INFO:tasks.workunit.client.0.smithi089.stdout:6/340: link d0/d4/d12/f20 d0/d5/d1d/d56/d60/f6e 0 2024-09-13T22:08:41.084 INFO:tasks.workunit.client.0.smithi089.stdout:6/341: read d0/d4/d12/d15/f32 [2000401,92952] 0 2024-09-13T22:08:41.085 INFO:tasks.workunit.client.0.smithi089.stdout:6/342: creat d0/d4/f6f x:0 0 0 2024-09-13T22:08:41.085 INFO:tasks.workunit.client.0.smithi089.stdout:6/343: stat d0/d4/d12/c1b 0 2024-09-13T22:08:41.085 INFO:tasks.workunit.client.0.smithi089.stdout:6/344: stat d0/d4/d12/d15/d3b 0 2024-09-13T22:08:41.094 INFO:tasks.workunit.client.0.smithi089.stdout:6/345: creat d0/d4/d12/f70 x:0 0 0 2024-09-13T22:08:41.094 INFO:tasks.workunit.client.0.smithi089.stdout:6/346: write d0/d5/d1d/d56/f47 [495283,48938] 0 2024-09-13T22:08:41.113 INFO:tasks.workunit.client.0.smithi089.stdout:4/393: dwrite d0/d11/d16/d24/f61 [0,4194304] 0 2024-09-13T22:08:41.116 INFO:tasks.workunit.client.1.smithi159.stdout:4/17: dwrite f2 [0,4194304] 0 2024-09-13T22:08:41.118 INFO:tasks.workunit.client.1.smithi159.stdout:6/6: getdents . 0 2024-09-13T22:08:41.118 INFO:tasks.workunit.client.1.smithi159.stdout:6/7: truncate - no filename 2024-09-13T22:08:41.118 INFO:tasks.workunit.client.1.smithi159.stdout:6/8: dwrite - no filename 2024-09-13T22:08:41.120 INFO:tasks.workunit.client.0.smithi089.stdout:7/335: dwrite d0/d19/d28/d1d/f2c [0,4194304] 0 2024-09-13T22:08:41.145 INFO:tasks.workunit.client.1.smithi159.stdout:3/12: dwrite d0/d1/f2 [0,4194304] 0 2024-09-13T22:08:41.149 INFO:tasks.workunit.client.1.smithi159.stdout:6/9: link c1 c2 0 2024-09-13T22:08:41.150 INFO:tasks.workunit.client.0.smithi089.stdout:1/422: dwrite d7/d1c/f72 [0,4194304] 0 2024-09-13T22:08:41.159 INFO:tasks.workunit.client.0.smithi089.stdout:7/336: dwrite d0/f14 [4194304,4194304] 0 2024-09-13T22:08:41.160 INFO:tasks.workunit.client.1.smithi159.stdout:8/0: dwrite - no filename 2024-09-13T22:08:41.160 INFO:tasks.workunit.client.1.smithi159.stdout:9/0: chown . 2 1 2024-09-13T22:08:41.161 INFO:tasks.workunit.client.1.smithi159.stdout:4/18: dwrite f2 [0,4194304] 0 2024-09-13T22:08:41.165 INFO:tasks.workunit.client.0.smithi089.stdout:7/337: mkdir d0/d19/d28/d1d/d3d/d69 0 2024-09-13T22:08:41.165 INFO:tasks.workunit.client.0.smithi089.stdout:7/338: creat d0/d19/d45/d38/f6a x:0 0 0 2024-09-13T22:08:41.165 INFO:tasks.workunit.client.0.smithi089.stdout:7/339: write d0/d19/d45/d38/f39 [992269,89471] 0 2024-09-13T22:08:41.165 INFO:tasks.workunit.client.0.smithi089.stdout:7/340: chown d0/d19/d28/d1d/d23/d2e/d41 303681 1 2024-09-13T22:08:41.166 INFO:tasks.workunit.client.0.smithi089.stdout:0/539: write d1/f5 [4819618,108161] 0 2024-09-13T22:08:41.170 INFO:tasks.workunit.client.0.smithi089.stdout:7/341: getdents d0/d19/d28/d1d/d2d/d55/d63 0 2024-09-13T22:08:41.179 INFO:tasks.workunit.client.0.smithi089.stdout:4/394: read d0/d15/d1f/f31 [643165,126182] 0 2024-09-13T22:08:41.182 INFO:tasks.workunit.client.1.smithi159.stdout:1/13: write f0 [1550771,16048] 0 2024-09-13T22:08:41.182 INFO:tasks.workunit.client.1.smithi159.stdout:1/14: readlink l2 0 2024-09-13T22:08:41.186 INFO:tasks.workunit.client.1.smithi159.stdout:5/15: dread d1/f2 [0,4194304] 0 2024-09-13T22:08:41.189 INFO:tasks.workunit.client.0.smithi089.stdout:8/403: sync 2024-09-13T22:08:41.190 INFO:tasks.workunit.client.0.smithi089.stdout:8/404: write d0/dd/d12/f1a [3893855,91525] 0 2024-09-13T22:08:41.190 INFO:tasks.workunit.client.0.smithi089.stdout:8/405: readlink d0/dd/d12/d20/l72 0 2024-09-13T22:08:41.190 INFO:tasks.workunit.client.0.smithi089.stdout:8/406: stat d0/dd/d12/d20/d36/d80/f41 0 2024-09-13T22:08:41.190 INFO:tasks.workunit.client.0.smithi089.stdout:1/423: dwrite d7/de/d1b/d80/f82 [0,4194304] 0 2024-09-13T22:08:41.190 INFO:tasks.workunit.client.0.smithi089.stdout:1/424: dread - d7/de/d1b/d2b/d39/f98 zero size 2024-09-13T22:08:41.190 INFO:tasks.workunit.client.0.smithi089.stdout:1/425: readlink d7/d40/l57 0 2024-09-13T22:08:41.190 INFO:tasks.workunit.client.0.smithi089.stdout:3/385: sync 2024-09-13T22:08:41.191 INFO:tasks.workunit.client.0.smithi089.stdout:9/415: sync 2024-09-13T22:08:41.191 INFO:tasks.workunit.client.0.smithi089.stdout:5/350: sync 2024-09-13T22:08:41.192 INFO:tasks.workunit.client.0.smithi089.stdout:2/361: dwrite df/d14/d2b/f59 [0,4194304] 0 2024-09-13T22:08:41.192 INFO:tasks.workunit.client.0.smithi089.stdout:2/362: chown df/c19 28686609 1 2024-09-13T22:08:41.192 INFO:tasks.workunit.client.0.smithi089.stdout:0/540: dwrite d1/de/d1f/f88 [0,4194304] 0 2024-09-13T22:08:41.192 INFO:tasks.workunit.client.0.smithi089.stdout:0/541: creat d1/fba x:0 0 0 2024-09-13T22:08:41.193 INFO:tasks.workunit.client.0.smithi089.stdout:7/342: dwrite d0/d19/d28/d1d/d2d/d3c/f37 [0,4194304] 0 2024-09-13T22:08:41.200 INFO:tasks.workunit.client.0.smithi089.stdout:8/407: write d0/dd/f7d [2027629,54694] 0 2024-09-13T22:08:41.201 INFO:tasks.workunit.client.0.smithi089.stdout:3/386: link d1/d2/d23/d3d/d46/f67 d1/d2/d18/f7a 0 2024-09-13T22:08:41.201 INFO:tasks.workunit.client.0.smithi089.stdout:3/387: write d1/d2/d18/f7a [1178706,62788] 0 2024-09-13T22:08:41.202 INFO:tasks.workunit.client.0.smithi089.stdout:9/416: mknod d6/d18/d33/d52/c93 0 2024-09-13T22:08:41.202 INFO:tasks.workunit.client.0.smithi089.stdout:9/417: stat d6/d18/d33/d52 0 2024-09-13T22:08:41.206 INFO:tasks.workunit.client.0.smithi089.stdout:2/363: truncate df/d14/d2b/f63 1043323 0 2024-09-13T22:08:41.207 INFO:tasks.workunit.client.1.smithi159.stdout:0/33: dwrite d0/d7/f9 [0,4194304] 0 2024-09-13T22:08:41.215 INFO:tasks.workunit.client.1.smithi159.stdout:6/10: mkdir d3 0 2024-09-13T22:08:41.219 INFO:tasks.workunit.client.1.smithi159.stdout:8/1: symlink l0 0 2024-09-13T22:08:41.219 INFO:tasks.workunit.client.1.smithi159.stdout:8/2: dwrite - no filename 2024-09-13T22:08:41.220 INFO:tasks.workunit.client.1.smithi159.stdout:9/1: symlink l0 0 2024-09-13T22:08:41.221 INFO:tasks.workunit.client.1.smithi159.stdout:9/2: stat l0 0 2024-09-13T22:08:41.221 INFO:tasks.workunit.client.1.smithi159.stdout:9/3: write - no filename 2024-09-13T22:08:41.221 INFO:tasks.workunit.client.1.smithi159.stdout:9/4: write - no filename 2024-09-13T22:08:41.221 INFO:tasks.workunit.client.1.smithi159.stdout:9/5: chown l0 4 1 2024-09-13T22:08:41.221 INFO:tasks.workunit.client.0.smithi089.stdout:2/364: symlink df/d1a/l7a 0 2024-09-13T22:08:41.222 INFO:tasks.workunit.client.0.smithi089.stdout:9/418: getdents d6/d31/d5e 0 2024-09-13T22:08:41.228 INFO:tasks.workunit.client.1.smithi159.stdout:0/34: mknod d0/d7/ca 0 2024-09-13T22:08:41.231 INFO:tasks.workunit.client.1.smithi159.stdout:6/11: link c2 d3/c4 0 2024-09-13T22:08:41.231 INFO:tasks.workunit.client.1.smithi159.stdout:6/12: read - no filename 2024-09-13T22:08:41.231 INFO:tasks.workunit.client.1.smithi159.stdout:8/3: mknod c1 0 2024-09-13T22:08:41.231 INFO:tasks.workunit.client.1.smithi159.stdout:8/4: write - no filename 2024-09-13T22:08:41.231 INFO:tasks.workunit.client.1.smithi159.stdout:8/5: write - no filename 2024-09-13T22:08:41.231 INFO:tasks.workunit.client.1.smithi159.stdout:8/6: write - no filename 2024-09-13T22:08:41.232 INFO:tasks.workunit.client.1.smithi159.stdout:1/15: write f0 [5071717,113939] 0 2024-09-13T22:08:41.232 INFO:tasks.workunit.client.1.smithi159.stdout:9/6: mkdir d1 0 2024-09-13T22:08:41.233 INFO:tasks.workunit.client.0.smithi089.stdout:9/419: write d6/f10 [1960041,119796] 0 2024-09-13T22:08:41.233 INFO:tasks.workunit.client.0.smithi089.stdout:9/420: fdatasync d6/d18/d33/d52/f4b 0 2024-09-13T22:08:41.233 INFO:tasks.workunit.client.0.smithi089.stdout:8/408: dwrite d0/dd/d12/d20/d36/d57/f60 [4194304,4194304] 0 2024-09-13T22:08:41.233 INFO:tasks.workunit.client.0.smithi089.stdout:8/409: truncate d0/dd/d12/d42/f77 856719 0 2024-09-13T22:08:41.233 INFO:tasks.workunit.client.0.smithi089.stdout:8/410: truncate d0/dd/d12/d20/d36/d57/f82 454078 0 2024-09-13T22:08:41.233 INFO:tasks.workunit.client.0.smithi089.stdout:8/411: fsync d0/dd/d12/d42/f5e 0 2024-09-13T22:08:41.235 INFO:tasks.workunit.client.0.smithi089.stdout:9/421: symlink d6/d31/d64/l94 0 2024-09-13T22:08:41.235 INFO:tasks.workunit.client.0.smithi089.stdout:9/422: dread - d6/d18/d21/f83 zero size 2024-09-13T22:08:41.237 INFO:tasks.workunit.client.1.smithi159.stdout:9/7: mknod d1/c2 0 2024-09-13T22:08:41.238 INFO:tasks.workunit.client.0.smithi089.stdout:1/426: dwrite d7/de/d3a/f8d [0,4194304] 0 2024-09-13T22:08:41.238 INFO:tasks.workunit.client.0.smithi089.stdout:7/343: dwrite d0/d19/d28/f1c [4194304,4194304] 0 2024-09-13T22:08:41.239 INFO:tasks.workunit.client.0.smithi089.stdout:9/423: link d6/fc d6/d18/f95 0 2024-09-13T22:08:41.239 INFO:tasks.workunit.client.0.smithi089.stdout:9/424: truncate d6/f10 2988714 0 2024-09-13T22:08:41.240 INFO:tasks.workunit.client.1.smithi159.stdout:0/35: dread d0/d7/f9 [0,4194304] 0 2024-09-13T22:08:41.240 INFO:tasks.workunit.client.1.smithi159.stdout:0/36: read d0/f8 [386257,36383] 0 2024-09-13T22:08:41.240 INFO:tasks.workunit.client.1.smithi159.stdout:0/37: truncate d0/f8 1224870 0 2024-09-13T22:08:41.242 INFO:tasks.workunit.client.1.smithi159.stdout:9/8: rename l0 to d1/l3 0 2024-09-13T22:08:41.242 INFO:tasks.workunit.client.1.smithi159.stdout:9/9: chown d1/l3 983155971 1 2024-09-13T22:08:41.242 INFO:tasks.workunit.client.1.smithi159.stdout:9/10: stat d1 0 2024-09-13T22:08:41.242 INFO:tasks.workunit.client.1.smithi159.stdout:9/11: dwrite - no filename 2024-09-13T22:08:41.243 INFO:tasks.workunit.client.0.smithi089.stdout:3/388: dwrite d1/d2/d18/f7a [0,4194304] 0 2024-09-13T22:08:41.243 INFO:tasks.workunit.client.0.smithi089.stdout:3/389: chown d1/d2/d18/c2e 10104 1 2024-09-13T22:08:41.243 INFO:tasks.workunit.client.0.smithi089.stdout:3/390: read d1/d7/d1b/d28/d63/f6d [2918370,116019] 0 2024-09-13T22:08:41.244 INFO:tasks.workunit.client.1.smithi159.stdout:1/16: dread f0 [4194304,4194304] 0 2024-09-13T22:08:41.244 INFO:tasks.workunit.client.0.smithi089.stdout:2/365: dwrite df/d14/d66/d69/d2e/f37 [0,4194304] 0 2024-09-13T22:08:41.244 INFO:tasks.workunit.client.0.smithi089.stdout:2/366: creat df/d14/d2b/f7b x:0 0 0 2024-09-13T22:08:41.245 INFO:tasks.workunit.client.0.smithi089.stdout:8/412: write d0/dd/d12/d42/f39 [3269192,85331] 0 2024-09-13T22:08:41.246 INFO:tasks.workunit.client.1.smithi159.stdout:9/12: mkdir d1/d4 0 2024-09-13T22:08:41.248 INFO:tasks.workunit.client.0.smithi089.stdout:3/391: dread d1/d7/d1b/d28/d63/f6d [0,4194304] 0 2024-09-13T22:08:41.248 INFO:tasks.workunit.client.0.smithi089.stdout:3/392: fsync d1/d2/d23/d3d/d54/d5d/f77 0 2024-09-13T22:08:41.248 INFO:tasks.workunit.client.0.smithi089.stdout:1/427: unlink d7/d1c/c7d 0 2024-09-13T22:08:41.249 INFO:tasks.workunit.client.0.smithi089.stdout:3/393: dread d1/d2/d4/f9 [0,4194304] 0 2024-09-13T22:08:41.250 INFO:tasks.workunit.client.1.smithi159.stdout:1/17: rename f1 to f3 0 2024-09-13T22:08:41.254 INFO:tasks.workunit.client.0.smithi089.stdout:7/344: unlink d0/d19/d28/d1d/d23/d2e/l5c 0 2024-09-13T22:08:41.254 INFO:tasks.workunit.client.0.smithi089.stdout:7/345: creat d0/d19/d45/f6b x:0 0 0 2024-09-13T22:08:41.256 INFO:tasks.workunit.client.1.smithi159.stdout:1/18: unlink l2 0 2024-09-13T22:08:41.256 INFO:tasks.workunit.client.1.smithi159.stdout:1/19: chown f3 2063 1 2024-09-13T22:08:41.257 INFO:tasks.workunit.client.0.smithi089.stdout:1/428: write d7/de/d1b/d2b/f54 [719482,86488] 0 2024-09-13T22:08:41.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/425: mknod d6/d31/d64/c96 0 2024-09-13T22:08:41.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/426: dread - d6/f81 zero size 2024-09-13T22:08:41.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/427: creat d6/d18/d33/d52/f97 x:0 0 0 2024-09-13T22:08:41.259 INFO:tasks.workunit.client.0.smithi089.stdout:8/413: creat d0/d6a/f8a x:0 0 0 2024-09-13T22:08:41.259 INFO:tasks.workunit.client.0.smithi089.stdout:8/414: read - d0/dd/d12/d42/f2c zero size 2024-09-13T22:08:41.259 INFO:tasks.workunit.client.0.smithi089.stdout:3/394: stat d1/d7/le 0 2024-09-13T22:08:41.262 INFO:tasks.workunit.client.0.smithi089.stdout:9/428: rename d6/f12 to d6/d54/f98 0 2024-09-13T22:08:41.262 INFO:tasks.workunit.client.0.smithi089.stdout:9/429: fdatasync d6/d55/f6d 0 2024-09-13T22:08:41.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/429: dread d7/d1c/d3c/f3f [0,4194304] 0 2024-09-13T22:08:41.262 INFO:tasks.workunit.client.0.smithi089.stdout:8/415: truncate d0/dd/f14 147778 0 2024-09-13T22:08:41.263 INFO:tasks.workunit.client.0.smithi089.stdout:3/395: symlink d1/d2/d4/l7b 0 2024-09-13T22:08:41.264 INFO:tasks.workunit.client.0.smithi089.stdout:9/430: read d6/d18/f32 [649907,69320] 0 2024-09-13T22:08:41.264 INFO:tasks.workunit.client.0.smithi089.stdout:8/416: creat d0/dd/d12/d20/d36/d59/d89/f8b x:0 0 0 2024-09-13T22:08:41.273 INFO:tasks.workunit.client.1.smithi159.stdout:0/38: dwrite d0/d7/f9 [0,4194304] 0 2024-09-13T22:08:41.275 INFO:tasks.workunit.client.0.smithi089.stdout:2/367: dwrite f3 [0,4194304] 0 2024-09-13T22:08:41.275 INFO:tasks.workunit.client.0.smithi089.stdout:1/430: dread d7/de/f30 [4194304,4194304] 0 2024-09-13T22:08:41.275 INFO:tasks.workunit.client.0.smithi089.stdout:1/431: dread - d7/de/d1b/d2b/d39/d73/f86 zero size 2024-09-13T22:08:41.291 INFO:tasks.workunit.client.0.smithi089.stdout:7/346: dwrite d0/f22 [0,4194304] 0 2024-09-13T22:08:41.291 INFO:tasks.workunit.client.0.smithi089.stdout:2/368: write df/d14/f25 [2584310,30262] 0 2024-09-13T22:08:41.291 INFO:tasks.workunit.client.0.smithi089.stdout:2/369: dread - df/d14/d2b/f7b zero size 2024-09-13T22:08:41.293 INFO:tasks.workunit.client.0.smithi089.stdout:7/347: symlink d0/d19/d28/d1d/d2d/d55/d63/l6c 0 2024-09-13T22:08:41.295 INFO:tasks.workunit.client.0.smithi089.stdout:7/348: creat d0/d19/d28/d1d/d2d/f6d x:0 0 0 2024-09-13T22:08:41.299 INFO:tasks.workunit.client.0.smithi089.stdout:9/431: dwrite d6/d18/d1b/f26 [4194304,4194304] 0 2024-09-13T22:08:41.299 INFO:tasks.workunit.client.0.smithi089.stdout:9/432: chown d6/d18/l88 10 1 2024-09-13T22:08:41.300 INFO:tasks.workunit.client.1.smithi159.stdout:1/20: dwrite f0 [4194304,4194304] 0 2024-09-13T22:08:41.303 INFO:tasks.workunit.client.0.smithi089.stdout:9/433: getdents d6/d18/d21/d5d 0 2024-09-13T22:08:41.304 INFO:tasks.workunit.client.1.smithi159.stdout:1/21: rename f0 to f4 0 2024-09-13T22:08:41.305 INFO:tasks.workunit.client.0.smithi089.stdout:9/434: creat d6/d31/d64/f99 x:0 0 0 2024-09-13T22:08:41.310 INFO:tasks.workunit.client.0.smithi089.stdout:9/435: rename d6/d18/d33/d39 to d6/d55/d9a 0 2024-09-13T22:08:41.310 INFO:tasks.workunit.client.0.smithi089.stdout:9/436: chown d6/d31/d5e/f79 19123 1 2024-09-13T22:08:41.311 INFO:tasks.workunit.client.0.smithi089.stdout:1/432: dwrite d7/d40/f79 [0,4194304] 0 2024-09-13T22:08:41.312 INFO:tasks.workunit.client.0.smithi089.stdout:1/433: fdatasync d7/de/d3a/f6a 0 2024-09-13T22:08:41.316 INFO:tasks.workunit.client.0.smithi089.stdout:1/434: rename d7/l1f to d7/d1c/d7a/l99 0 2024-09-13T22:08:41.317 INFO:tasks.workunit.client.0.smithi089.stdout:1/435: symlink d7/d34/d5c/l9a 0 2024-09-13T22:08:41.317 INFO:tasks.workunit.client.0.smithi089.stdout:1/436: readlink d7/l23 0 2024-09-13T22:08:41.319 INFO:tasks.workunit.client.0.smithi089.stdout:1/437: rename d7/l17 to d7/de/d3a/d77/l9b 0 2024-09-13T22:08:41.319 INFO:tasks.workunit.client.0.smithi089.stdout:1/438: chown d7/de/d3a/c48 5034 1 2024-09-13T22:08:41.323 INFO:tasks.workunit.client.0.smithi089.stdout:9/437: write d6/f59 [3347666,75039] 0 2024-09-13T22:08:41.326 INFO:tasks.workunit.client.0.smithi089.stdout:7/349: dwrite d0/d19/d28/d1d/d23/d2e/d41/f65 [0,4194304] 0 2024-09-13T22:08:41.326 INFO:tasks.workunit.client.0.smithi089.stdout:9/438: creat d6/d18/d33/d5a/f9b x:0 0 0 2024-09-13T22:08:41.326 INFO:tasks.workunit.client.0.smithi089.stdout:9/439: dread - d6/d18/d21/f83 zero size 2024-09-13T22:08:41.327 INFO:tasks.workunit.client.1.smithi159.stdout:3/13: truncate d0/d1/f2 3217465 0 2024-09-13T22:08:41.328 INFO:tasks.workunit.client.0.smithi089.stdout:1/439: write d7/f26 [6743260,97396] 0 2024-09-13T22:08:41.329 INFO:tasks.workunit.client.1.smithi159.stdout:6/13: getdents d3 0 2024-09-13T22:08:41.329 INFO:tasks.workunit.client.1.smithi159.stdout:3/14: mkdir d0/d1/d3 0 2024-09-13T22:08:41.331 INFO:tasks.workunit.client.0.smithi089.stdout:2/370: dwrite df/f74 [0,4194304] 0 2024-09-13T22:08:41.331 INFO:tasks.workunit.client.1.smithi159.stdout:8/7: getdents . 0 2024-09-13T22:08:41.331 INFO:tasks.workunit.client.1.smithi159.stdout:8/8: readlink l0 0 2024-09-13T22:08:41.331 INFO:tasks.workunit.client.1.smithi159.stdout:8/9: dwrite - no filename 2024-09-13T22:08:41.331 INFO:tasks.workunit.client.0.smithi089.stdout:7/350: truncate d0/ff 1758604 0 2024-09-13T22:08:41.332 INFO:tasks.workunit.client.1.smithi159.stdout:6/14: symlink d3/l5 0 2024-09-13T22:08:41.332 INFO:tasks.workunit.client.1.smithi159.stdout:6/15: chown c1 3 1 2024-09-13T22:08:41.332 INFO:tasks.workunit.client.1.smithi159.stdout:6/16: dwrite - no filename 2024-09-13T22:08:41.333 INFO:tasks.workunit.client.1.smithi159.stdout:1/22: dwrite f4 [4194304,4194304] 0 2024-09-13T22:08:41.335 INFO:tasks.workunit.client.0.smithi089.stdout:9/440: creat d6/d54/f9c x:0 0 0 2024-09-13T22:08:41.335 INFO:tasks.workunit.client.0.smithi089.stdout:9/441: truncate d6/d31/d5e/f7d 1068655 0 2024-09-13T22:08:41.335 INFO:tasks.workunit.client.0.smithi089.stdout:9/442: write d6/d18/d21/f62 [731108,89029] 0 2024-09-13T22:08:41.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/10: rename c1 to c2 0 2024-09-13T22:08:41.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/11: dread - no filename 2024-09-13T22:08:41.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/12: truncate - no filename 2024-09-13T22:08:41.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/13: truncate - no filename 2024-09-13T22:08:41.337 INFO:tasks.workunit.client.1.smithi159.stdout:8/14: truncate - no filename 2024-09-13T22:08:41.337 INFO:tasks.workunit.client.1.smithi159.stdout:8/15: write - no filename 2024-09-13T22:08:41.337 INFO:tasks.workunit.client.1.smithi159.stdout:8/16: fsync - no filename 2024-09-13T22:08:41.337 INFO:tasks.workunit.client.1.smithi159.stdout:8/17: dwrite - no filename 2024-09-13T22:08:41.337 INFO:tasks.workunit.client.1.smithi159.stdout:8/18: dwrite - no filename 2024-09-13T22:08:41.341 INFO:tasks.workunit.client.1.smithi159.stdout:9/13: link d1/l3 d1/d4/l5 0 2024-09-13T22:08:41.342 INFO:tasks.workunit.client.0.smithi089.stdout:2/371: read df/d14/d2b/f59 [2284115,109101] 0 2024-09-13T22:08:41.344 INFO:tasks.workunit.client.0.smithi089.stdout:1/440: dwrite d7/d34/f38 [0,4194304] 0 2024-09-13T22:08:41.344 INFO:tasks.workunit.client.1.smithi159.stdout:8/19: readlink l0 0 2024-09-13T22:08:41.345 INFO:tasks.workunit.client.0.smithi089.stdout:9/443: rmdir d6/d31 39 2024-09-13T22:08:41.345 INFO:tasks.workunit.client.0.smithi089.stdout:9/444: creat d6/d54/f9d x:0 0 0 2024-09-13T22:08:41.346 INFO:tasks.workunit.client.1.smithi159.stdout:6/17: mkdir d3/d6 0 2024-09-13T22:08:41.346 INFO:tasks.workunit.client.1.smithi159.stdout:6/18: dread - no filename 2024-09-13T22:08:41.348 INFO:tasks.workunit.client.0.smithi089.stdout:2/372: unlink df/d1a/d57/c77 0 2024-09-13T22:08:41.348 INFO:tasks.workunit.client.0.smithi089.stdout:2/373: chown df/d14/d66/f6e 0 1 2024-09-13T22:08:41.348 INFO:tasks.workunit.client.1.smithi159.stdout:9/14: mknod d1/d4/c6 0 2024-09-13T22:08:41.349 INFO:tasks.workunit.client.0.smithi089.stdout:9/445: dread d6/d31/d5e/f7d [0,4194304] 0 2024-09-13T22:08:41.349 INFO:tasks.workunit.client.0.smithi089.stdout:9/446: chown d6 26476998 1 2024-09-13T22:08:41.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.350+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6641aa3f0 con 0x7fd64c06d820 2024-09-13T22:08:41.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.352+0000 7fd661ffb640 1 -- 172.21.15.89:0/880753579 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fd6641aa3f0 con 0x7fd64c06d820 2024-09-13T22:08:41.353 INFO:tasks.workunit.client.1.smithi159.stdout:6/19: rmdir d3 39 2024-09-13T22:08:41.354 INFO:tasks.workunit.client.0.smithi089.stdout:1/441: mknod d7/de/d1b/d2b/d39/d73/c9c 0 2024-09-13T22:08:41.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd64c06d820 msgr2=0x7fd64c06fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd64c06d820 0x7fd64c06fce0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd65402ec40 tx=0x7fd65403b040 comp rx=0 tx=0).stop 2024-09-13T22:08:41.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd664071430 msgr2=0x7fd6641a4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd664071430 0x7fd6641a4520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd65800b3d0 tx=0x7fd65800b890 comp rx=0 tx=0).stop 2024-09-13T22:08:41.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 shutdown_connections 2024-09-13T22:08:41.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fd64c06d820 0x7fd64c06fce0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6641074b0 0x7fd6641a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 --2- 172.21.15.89:0/880753579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd664071430 0x7fd6641a4520 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 >> 172.21.15.89:0/880753579 conn(0x7fd66406cc10 msgr2=0x7fd66410a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:41.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 shutdown_connections 2024-09-13T22:08:41.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.354+0000 7fd66b1ba640 1 -- 172.21.15.89:0/880753579 wait complete. 2024-09-13T22:08:41.356 INFO:tasks.workunit.client.1.smithi159.stdout:9/15: rename d1/c2 to d1/c7 0 2024-09-13T22:08:41.356 INFO:tasks.workunit.client.1.smithi159.stdout:9/16: readlink d1/l3 0 2024-09-13T22:08:41.356 INFO:tasks.workunit.client.1.smithi159.stdout:9/17: read - no filename 2024-09-13T22:08:41.358 INFO:tasks.workunit.client.0.smithi089.stdout:2/374: rename df/d14/d66/f6e to df/d1a/d57/d68/f7c 0 2024-09-13T22:08:41.359 INFO:tasks.workunit.client.1.smithi159.stdout:6/20: rmdir d3/d6 0 2024-09-13T22:08:41.363 INFO:tasks.workunit.client.0.smithi089.stdout:2/375: write df/d14/d2b/f63 [342333,36608] 0 2024-09-13T22:08:41.363 INFO:tasks.workunit.client.0.smithi089.stdout:2/376: read - df/d1a/f42 zero size 2024-09-13T22:08:41.363 INFO:tasks.workunit.client.0.smithi089.stdout:9/447: getdents d6/d18/d21/d5d/d6c 0 2024-09-13T22:08:41.363 INFO:tasks.workunit.client.1.smithi159.stdout:1/23: dwrite f3 [0,4194304] 0 2024-09-13T22:08:41.364 INFO:tasks.workunit.client.1.smithi159.stdout:0/39: truncate d0/f8 1174550 0 2024-09-13T22:08:41.369 INFO:tasks.workunit.client.0.smithi089.stdout:9/448: link d6/d18/c4f d6/d18/d21/d5d/d6c/d8d/c9e 0 2024-09-13T22:08:41.369 INFO:tasks.workunit.client.0.smithi089.stdout:1/442: dread d7/de/f5f [4194304,4194304] 0 2024-09-13T22:08:41.369 INFO:tasks.workunit.client.0.smithi089.stdout:1/443: dread - d7/d1c/d3c/f65 zero size 2024-09-13T22:08:41.369 INFO:tasks.workunit.client.0.smithi089.stdout:1/444: chown d7/d1c/d3c/f8a 18228321 1 2024-09-13T22:08:41.371 INFO:tasks.workunit.client.1.smithi159.stdout:0/40: creat d0/d3/fb x:0 0 0 2024-09-13T22:08:41.371 INFO:tasks.workunit.client.1.smithi159.stdout:0/41: readlink d0/d3/l4 0 2024-09-13T22:08:41.373 INFO:tasks.workunit.client.1.smithi159.stdout:1/24: dread f3 [0,4194304] 0 2024-09-13T22:08:41.375 INFO:tasks.workunit.client.0.smithi089.stdout:2/377: truncate df/d14/f25 26663 0 2024-09-13T22:08:41.376 INFO:tasks.workunit.client.0.smithi089.stdout:2/378: write df/d5b/f73 [16147,63451] 0 2024-09-13T22:08:41.377 INFO:tasks.workunit.client.1.smithi159.stdout:1/25: unlink f4 0 2024-09-13T22:08:41.382 INFO:tasks.workunit.client.1.smithi159.stdout:1/26: dread f3 [0,4194304] 0 2024-09-13T22:08:41.383 INFO:tasks.workunit.client.1.smithi159.stdout:1/27: mknod c5 0 2024-09-13T22:08:41.386 INFO:tasks.workunit.client.0.smithi089.stdout:1/445: dwrite d7/de/d1b/f58 [0,4194304] 0 2024-09-13T22:08:41.386 INFO:tasks.workunit.client.0.smithi089.stdout:1/446: chown d7/d1c/f72 29 1 2024-09-13T22:08:41.386 INFO:tasks.workunit.client.0.smithi089.stdout:1/447: creat d7/de/d68/f9d x:0 0 0 2024-09-13T22:08:41.386 INFO:tasks.workunit.client.0.smithi089.stdout:1/448: fsync d7/d1c/d3c/f49 0 2024-09-13T22:08:41.387 INFO:tasks.workunit.client.1.smithi159.stdout:8/20: link c2 c3 0 2024-09-13T22:08:41.387 INFO:tasks.workunit.client.1.smithi159.stdout:8/21: dwrite - no filename 2024-09-13T22:08:41.389 INFO:tasks.workunit.client.1.smithi159.stdout:8/22: creat f4 x:0 0 0 2024-09-13T22:08:41.389 INFO:tasks.workunit.client.1.smithi159.stdout:8/23: dread - f4 zero size 2024-09-13T22:08:41.393 INFO:tasks.workunit.client.0.smithi089.stdout:1/449: mkdir d7/de/d1b/d2b/d59/d9e 0 2024-09-13T22:08:41.393 INFO:tasks.workunit.client.0.smithi089.stdout:1/450: write d7/d1c/d3c/f65 [617715,96333] 0 2024-09-13T22:08:41.393 INFO:tasks.workunit.client.1.smithi159.stdout:8/24: symlink l5 0 2024-09-13T22:08:41.394 INFO:tasks.workunit.client.1.smithi159.stdout:8/25: dread - f4 zero size 2024-09-13T22:08:41.395 INFO:tasks.workunit.client.0.smithi089.stdout:1/451: rename d7/d34/c2f to d7/d34/d5c/d74/c9f 0 2024-09-13T22:08:41.397 INFO:tasks.workunit.client.1.smithi159.stdout:8/26: creat f6 x:0 0 0 2024-09-13T22:08:41.400 INFO:tasks.workunit.client.1.smithi159.stdout:8/27: link f6 f7 0 2024-09-13T22:08:41.402 INFO:tasks.workunit.client.1.smithi159.stdout:6/21: getdents d3 0 2024-09-13T22:08:41.402 INFO:tasks.workunit.client.1.smithi159.stdout:6/22: dwrite - no filename 2024-09-13T22:08:41.403 INFO:tasks.workunit.client.1.smithi159.stdout:6/23: rename c2 to d3/c7 0 2024-09-13T22:08:41.403 INFO:tasks.workunit.client.1.smithi159.stdout:6/24: truncate - no filename 2024-09-13T22:08:41.404 INFO:tasks.workunit.client.1.smithi159.stdout:6/25: truncate - no filename 2024-09-13T22:08:41.404 INFO:tasks.workunit.client.1.smithi159.stdout:6/26: dread - no filename 2024-09-13T22:08:41.404 INFO:tasks.workunit.client.1.smithi159.stdout:3/15: dwrite d0/d1/f2 [0,4194304] 0 2024-09-13T22:08:41.405 INFO:tasks.workunit.client.0.smithi089.stdout:2/379: dwrite df/d5b/f73 [0,4194304] 0 2024-09-13T22:08:41.405 INFO:tasks.workunit.client.0.smithi089.stdout:2/380: write df/d14/f21 [2881527,2148] 0 2024-09-13T22:08:41.405 INFO:tasks.workunit.client.0.smithi089.stdout:2/381: fsync df/d1a/d57/d68/f7c 0 2024-09-13T22:08:41.406 INFO:tasks.workunit.client.1.smithi159.stdout:3/16: mknod d0/d1/c4 0 2024-09-13T22:08:41.406 INFO:tasks.workunit.client.1.smithi159.stdout:3/17: chown d0 751 1 2024-09-13T22:08:41.408 INFO:tasks.workunit.client.1.smithi159.stdout:0/42: read d0/f8 [264298,118252] 0 2024-09-13T22:08:41.408 INFO:tasks.workunit.client.1.smithi159.stdout:0/43: truncate d0/d3/fb 853676 0 2024-09-13T22:08:41.411 INFO:tasks.workunit.client.0.smithi089.stdout:9/449: getdents d6/d18/d21/d5d/d6c/d8d 0 2024-09-13T22:08:41.412 INFO:tasks.workunit.client.0.smithi089.stdout:1/452: write d7/fb [2942745,105112] 0 2024-09-13T22:08:41.412 INFO:tasks.workunit.client.0.smithi089.stdout:1/453: fdatasync d7/de/d3a/f7b 0 2024-09-13T22:08:41.412 INFO:tasks.workunit.client.0.smithi089.stdout:1/454: readlink d7/d34/d5c/l91 0 2024-09-13T22:08:41.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/44: symlink d0/d7/lc 0 2024-09-13T22:08:41.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/45: creat d0/d3/fd x:0 0 0 2024-09-13T22:08:41.419 INFO:tasks.workunit.client.1.smithi159.stdout:0/46: truncate d0/f8 821029 0 2024-09-13T22:08:41.419 INFO:tasks.workunit.client.1.smithi159.stdout:8/28: dwrite f7 [0,4194304] 0 2024-09-13T22:08:41.419 INFO:tasks.workunit.client.1.smithi159.stdout:1/28: getdents . 0 2024-09-13T22:08:41.421 INFO:tasks.workunit.client.1.smithi159.stdout:0/47: mknod d0/ce 0 2024-09-13T22:08:41.421 INFO:tasks.workunit.client.1.smithi159.stdout:0/48: fdatasync d0/f8 0 2024-09-13T22:08:41.423 INFO:tasks.workunit.client.0.smithi089.stdout:6/347: sync 2024-09-13T22:08:41.424 INFO:tasks.workunit.client.0.smithi089.stdout:6/348: truncate d0/d5/d1d/d56/f3f 131477 0 2024-09-13T22:08:41.424 INFO:tasks.workunit.client.0.smithi089.stdout:2/382: symlink df/d5b/l7d 0 2024-09-13T22:08:41.424 INFO:tasks.workunit.client.1.smithi159.stdout:1/29: write f3 [3982443,34144] 0 2024-09-13T22:08:41.425 INFO:tasks.workunit.client.0.smithi089.stdout:9/450: dwrite d6/d18/d33/d5a/f9b [0,4194304] 0 2024-09-13T22:08:41.427 INFO:tasks.workunit.client.1.smithi159.stdout:8/29: creat f8 x:0 0 0 2024-09-13T22:08:41.429 INFO:tasks.workunit.client.0.smithi089.stdout:1/455: unlink d7/l21 0 2024-09-13T22:08:41.430 INFO:tasks.workunit.client.1.smithi159.stdout:6/27: rename d3/c7 to d3/c8 0 2024-09-13T22:08:41.431 INFO:tasks.workunit.client.1.smithi159.stdout:6/28: read - no filename 2024-09-13T22:08:41.431 INFO:tasks.workunit.client.1.smithi159.stdout:6/29: dread - no filename 2024-09-13T22:08:41.431 INFO:tasks.workunit.client.1.smithi159.stdout:6/30: fsync - no filename 2024-09-13T22:08:41.432 INFO:tasks.workunit.client.1.smithi159.stdout:0/49: mknod d0/cf 0 2024-09-13T22:08:41.434 INFO:tasks.workunit.client.0.smithi089.stdout:6/349: unlink d0/f42 0 2024-09-13T22:08:41.434 INFO:tasks.workunit.client.0.smithi089.stdout:6/350: stat d0/d5/d1d/d2d/d55 0 2024-09-13T22:08:41.434 INFO:tasks.workunit.client.0.smithi089.stdout:6/351: fsync d0/d4/d12/d15/f32 0 2024-09-13T22:08:41.434 INFO:tasks.workunit.client.0.smithi089.stdout:6/352: write d0/d5/d1d/d56/d4a/f58 [125062,27769] 0 2024-09-13T22:08:41.434 INFO:tasks.workunit.client.0.smithi089.stdout:6/353: stat d0/d5/d1d/d56/d4a/f58 0 2024-09-13T22:08:41.435 INFO:tasks.workunit.client.1.smithi159.stdout:1/30: dread f3 [0,4194304] 0 2024-09-13T22:08:41.435 INFO:tasks.workunit.client.0.smithi089.stdout:7/351: sync 2024-09-13T22:08:41.435 INFO:tasks.workunit.client.0.smithi089.stdout:8/417: sync 2024-09-13T22:08:41.435 INFO:tasks.workunit.client.0.smithi089.stdout:7/352: write d0/d19/d28/d1d/d2d/f6d [848608,10647] 0 2024-09-13T22:08:41.439 INFO:tasks.workunit.client.0.smithi089.stdout:0/542: sync 2024-09-13T22:08:41.439 INFO:tasks.workunit.client.0.smithi089.stdout:5/351: sync 2024-09-13T22:08:41.439 INFO:tasks.workunit.client.0.smithi089.stdout:4/395: sync 2024-09-13T22:08:41.440 INFO:tasks.workunit.client.0.smithi089.stdout:3/396: sync 2024-09-13T22:08:41.440 INFO:tasks.workunit.client.0.smithi089.stdout:5/352: truncate d4/d19/d1e/d28/d31/d55/f68 4297991 0 2024-09-13T22:08:41.440 INFO:tasks.workunit.client.0.smithi089.stdout:5/353: write d4/d19/d1e/d28/d31/d35/f47 [325933,73088] 0 2024-09-13T22:08:41.440 INFO:tasks.workunit.client.0.smithi089.stdout:5/354: readlink d4/d19/d1e/d28/l34 0 2024-09-13T22:08:41.440 INFO:tasks.workunit.client.0.smithi089.stdout:5/355: write d4/d19/d1e/d28/d3d/f5d [1090570,121804] 0 2024-09-13T22:08:41.440 INFO:tasks.workunit.client.0.smithi089.stdout:5/356: creat d4/d19/d1e/d28/d3d/f83 x:0 0 0 2024-09-13T22:08:41.440 INFO:tasks.workunit.client.0.smithi089.stdout:5/357: write d4/d19/f2b [2499685,48192] 0 2024-09-13T22:08:41.440 INFO:tasks.workunit.client.0.smithi089.stdout:5/358: fdatasync d4/d19/d1e/f62 0 2024-09-13T22:08:41.440 INFO:tasks.workunit.client.1.smithi159.stdout:3/18: truncate d0/d1/f2 216821 0 2024-09-13T22:08:41.441 INFO:tasks.workunit.client.0.smithi089.stdout:4/396: write d0/d2c/d52/f54 [80677,48257] 0 2024-09-13T22:08:41.443 INFO:tasks.workunit.client.0.smithi089.stdout:1/456: mkdir d7/de/da0 0 2024-09-13T22:08:41.443 INFO:tasks.workunit.client.0.smithi089.stdout:1/457: write d7/de/d68/f6f [2342867,36978] 0 2024-09-13T22:08:41.445 INFO:tasks.workunit.client.1.smithi159.stdout:3/19: mkdir d0/d1/d3/d5 0 2024-09-13T22:08:41.445 INFO:tasks.workunit.client.1.smithi159.stdout:3/20: fdatasync d0/d1/f2 0 2024-09-13T22:08:41.445 INFO:tasks.workunit.client.1.smithi159.stdout:3/21: creat d0/d1/f6 x:0 0 0 2024-09-13T22:08:41.445 INFO:tasks.workunit.client.1.smithi159.stdout:3/22: getdents d0/d1/d3/d5 0 2024-09-13T22:08:41.445 INFO:tasks.workunit.client.0.smithi089.stdout:6/354: creat d0/d4/d12/d15/f71 x:0 0 0 2024-09-13T22:08:41.446 INFO:tasks.workunit.client.0.smithi089.stdout:6/355: fdatasync d0/d4/f6f 0 2024-09-13T22:08:41.447 INFO:tasks.workunit.client.0.smithi089.stdout:7/353: link d0/d19/d45/d38/l47 d0/d19/d28/d1d/d30/d5b/l6e 0 2024-09-13T22:08:41.449 INFO:tasks.workunit.client.0.smithi089.stdout:2/383: getdents df 0 2024-09-13T22:08:41.450 INFO:tasks.workunit.client.1.smithi159.stdout:3/23: mknod d0/d1/d3/c7 0 2024-09-13T22:08:41.450 INFO:tasks.workunit.client.1.smithi159.stdout:3/24: dread - d0/d1/f6 zero size 2024-09-13T22:08:41.450 INFO:tasks.workunit.client.1.smithi159.stdout:3/25: fdatasync d0/d1/f6 0 2024-09-13T22:08:41.452 INFO:tasks.workunit.client.1.smithi159.stdout:0/50: dwrite d0/d7/f9 [0,4194304] 0 2024-09-13T22:08:41.452 INFO:tasks.workunit.client.1.smithi159.stdout:0/51: write d0/d3/fb [1143376,97367] 0 2024-09-13T22:08:41.452 INFO:tasks.workunit.client.1.smithi159.stdout:0/52: creat d0/f10 x:0 0 0 2024-09-13T22:08:41.452 INFO:tasks.workunit.client.1.smithi159.stdout:0/53: chown d0/cf 8 1 2024-09-13T22:08:41.452 INFO:tasks.workunit.client.0.smithi089.stdout:0/543: rename d1/de/d10/d36/d38/d4e/d62/d5f/f7c to d1/de/d1f/fbb 0 2024-09-13T22:08:41.452 INFO:tasks.workunit.client.0.smithi089.stdout:0/544: creat d1/de/d10/d36/d38/d4e/d62/fbc x:0 0 0 2024-09-13T22:08:41.454 INFO:tasks.workunit.client.0.smithi089.stdout:3/397: mknod d1/d2/d23/d3d/d54/d5d/c7c 0 2024-09-13T22:08:41.455 INFO:tasks.workunit.client.1.smithi159.stdout:8/30: getdents . 0 2024-09-13T22:08:41.455 INFO:tasks.workunit.client.1.smithi159.stdout:8/31: dread - f8 zero size 2024-09-13T22:08:41.462 INFO:tasks.workunit.client.0.smithi089.stdout:8/418: dwrite d0/d6a/f8a [0,4194304] 0 2024-09-13T22:08:41.462 INFO:tasks.workunit.client.0.smithi089.stdout:8/419: chown d0/dd/d12/d20/d36/d80/d3b 110086394 1 2024-09-13T22:08:41.464 INFO:tasks.workunit.client.1.smithi159.stdout:1/31: truncate f3 3731295 0 2024-09-13T22:08:41.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.464+0000 7fab71f2d640 1 -- 172.21.15.89:0/3914557472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0ffc80 msgr2=0x7fab6c100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.464+0000 7fab71f2d640 1 --2- 172.21.15.89:0/3914557472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0ffc80 0x7fab6c100100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fab60009880 tx=0x7fab6002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.464+0000 7fab71f2d640 1 -- 172.21.15.89:0/3914557472 shutdown_connections 2024-09-13T22:08:41.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.464+0000 7fab71f2d640 1 --2- 172.21.15.89:0/3914557472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0ffc80 0x7fab6c100100 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.464+0000 7fab71f2d640 1 --2- 172.21.15.89:0/3914557472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab6c0fea80 0x7fab6c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.464+0000 7fab71f2d640 1 -- 172.21.15.89:0/3914557472 >> 172.21.15.89:0/3914557472 conn(0x7fab6c0fa230 msgr2=0x7fab6c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:41.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.464+0000 7fab71f2d640 1 -- 172.21.15.89:0/3914557472 shutdown_connections 2024-09-13T22:08:41.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.464+0000 7fab71f2d640 1 -- 172.21.15.89:0/3914557472 wait complete. 2024-09-13T22:08:41.466 INFO:tasks.workunit.client.0.smithi089.stdout:5/359: mkdir d4/d19/d1e/d28/d31/d55/d58/d84 0 2024-09-13T22:08:41.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.465+0000 7fab71f2d640 1 Processor -- start 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.465+0000 7fab71f2d640 1 -- start start 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.465+0000 7fab71f2d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0fea80 0x7fab6c195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.465+0000 7fab71f2d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab6c0ffc80 0x7fab6c195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.465+0000 7fab71f2d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c196220 con 0x7fab6c0fea80 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.465+0000 7fab71f2d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c196390 con 0x7fab6c0ffc80 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.465+0000 7fab6b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0fea80 0x7fab6c195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.465+0000 7fab6b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0fea80 0x7fab6c195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56692/0 (socket says 172.21.15.89:56692) 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.465+0000 7fab6b7fe640 1 -- 172.21.15.89:0/1844932146 learned_addr learned my addr 172.21.15.89:0/1844932146 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab6affd640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab6c0ffc80 0x7fab6c195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab6b7fe640 1 -- 172.21.15.89:0/1844932146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab6c0ffc80 msgr2=0x7fab6c195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab6b7fe640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab6c0ffc80 0x7fab6c195c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab6b7fe640 1 -- 172.21.15.89:0/1844932146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60009560 con 0x7fab6c0fea80 2024-09-13T22:08:41.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab6b7fe640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0fea80 0x7fab6c195710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00b400 tx=0x7fab5c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:41.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab68ff9640 1 -- 172.21.15.89:0/1844932146 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5c011800 con 0x7fab6c0fea80 2024-09-13T22:08:41.469 INFO:tasks.workunit.client.0.smithi089.stdout:9/451: symlink d6/l9f 0 2024-09-13T22:08:41.469 INFO:tasks.workunit.client.0.smithi089.stdout:9/452: chown d6/d31/d64/c96 94751 1 2024-09-13T22:08:41.469 INFO:tasks.workunit.client.0.smithi089.stdout:9/453: fdatasync d6/d18/d33/f90 0 2024-09-13T22:08:41.469 INFO:tasks.workunit.client.0.smithi089.stdout:9/454: readlink d6/d31/l6b 0 2024-09-13T22:08:41.470 INFO:tasks.workunit.client.1.smithi159.stdout:0/54: symlink d0/d3/l11 0 2024-09-13T22:08:41.470 INFO:tasks.workunit.client.1.smithi159.stdout:0/55: write d0/d3/fb [2111284,98237] 0 2024-09-13T22:08:41.470 INFO:tasks.workunit.client.1.smithi159.stdout:1/32: creat f6 x:0 0 0 2024-09-13T22:08:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c19ae30 con 0x7fab6c0fea80 2024-09-13T22:08:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab68ff9640 1 -- 172.21.15.89:0/1844932146 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab5c011e20 con 0x7fab6c0fea80 2024-09-13T22:08:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab68ff9640 1 -- 172.21.15.89:0/1844932146 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5c00f2e0 con 0x7fab6c0fea80 2024-09-13T22:08:41.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.466+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c100ea0 con 0x7fab6c0fea80 2024-09-13T22:08:41.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.468+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c0fef00 con 0x7fab6c0fea80 2024-09-13T22:08:41.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.469+0000 7fab68ff9640 1 -- 172.21.15.89:0/1844932146 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 20) v1 ==== 91631+0+0 (secure 0 0 0) 0x7fab5c00f550 con 0x7fab6c0fea80 2024-09-13T22:08:41.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.469+0000 7fab68ff9640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fab5406d7b0 0x7fab5406fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:41.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.469+0000 7fab68ff9640 1 -- 172.21.15.89:0/1844932146 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fab5c08ccd0 con 0x7fab6c0fea80 2024-09-13T22:08:41.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.469+0000 7fab6affd640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fab5406d7b0 0x7fab5406fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:41.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.470+0000 7fab6affd640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fab5406d7b0 0x7fab5406fc70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c00 tx=0x7fab600314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:41.472 INFO:tasks.workunit.client.0.smithi089.stdout:4/397: mknod d0/d2c/d35/d64/c7c 0 2024-09-13T22:08:41.472 INFO:tasks.workunit.client.0.smithi089.stdout:4/398: creat d0/d15/f7d x:0 0 0 2024-09-13T22:08:41.474 INFO:tasks.workunit.client.0.smithi089.stdout:2/384: truncate df/f12 5682572 0 2024-09-13T22:08:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.473+0000 7fab68ff9640 1 -- 172.21.15.89:0/1844932146 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fab5c092020 con 0x7fab6c0fea80 2024-09-13T22:08:41.475 INFO:tasks.workunit.client.1.smithi159.stdout:0/56: rmdir d0/d7 39 2024-09-13T22:08:41.475 INFO:tasks.workunit.client.1.smithi159.stdout:0/57: chown d0 22917 1 2024-09-13T22:08:41.478 INFO:tasks.workunit.client.1.smithi159.stdout:0/58: symlink d0/d7/l12 0 2024-09-13T22:08:41.479 INFO:tasks.workunit.client.0.smithi089.stdout:1/458: rename d7/de/d1b/d2b/d59/c8b to d7/de/d1b/d80/ca1 0 2024-09-13T22:08:41.480 INFO:tasks.workunit.client.0.smithi089.stdout:1/459: write d7/d34/f28 [195290,6047] 0 2024-09-13T22:08:41.480 INFO:tasks.workunit.client.0.smithi089.stdout:1/460: fsync d7/d1c/d3c/f5e 0 2024-09-13T22:08:41.480 INFO:tasks.workunit.client.0.smithi089.stdout:8/420: read d0/dd/d12/d20/d36/d80/f44 [3942162,111482] 0 2024-09-13T22:08:41.480 INFO:tasks.workunit.client.0.smithi089.stdout:0/545: mkdir d1/de/d10/d85/dbd 0 2024-09-13T22:08:41.483 INFO:tasks.workunit.client.0.smithi089.stdout:7/354: dwrite d0/d19/d28/d1d/d2d/d3c/f4e [0,4194304] 0 2024-09-13T22:08:41.484 INFO:tasks.workunit.client.0.smithi089.stdout:9/455: mkdir d6/d18/d1b/da0 0 2024-09-13T22:08:41.484 INFO:tasks.workunit.client.0.smithi089.stdout:9/456: read - d6/f81 zero size 2024-09-13T22:08:41.489 INFO:tasks.workunit.client.0.smithi089.stdout:1/461: getdents d7/de/d1b/d2b/d39/d73 0 2024-09-13T22:08:41.489 INFO:tasks.workunit.client.0.smithi089.stdout:4/399: getdents d0/d2c 0 2024-09-13T22:08:41.491 INFO:tasks.workunit.client.0.smithi089.stdout:1/462: rename d7/de/d3a/f7b to d7/de/d3a/d77/fa2 0 2024-09-13T22:08:41.491 INFO:tasks.workunit.client.0.smithi089.stdout:1/463: write d7/f19 [1344615,28331] 0 2024-09-13T22:08:41.492 INFO:tasks.workunit.client.0.smithi089.stdout:1/464: truncate d7/de/d3a/d77/f7c 972224 0 2024-09-13T22:08:41.492 INFO:tasks.workunit.client.0.smithi089.stdout:1/465: write d7/d40/f97 [585180,114209] 0 2024-09-13T22:08:41.492 INFO:tasks.workunit.client.0.smithi089.stdout:1/466: write d7/d1c/f35 [407613,47084] 0 2024-09-13T22:08:41.493 INFO:tasks.workunit.client.1.smithi159.stdout:3/26: dwrite d0/d1/f6 [0,4194304] 0 2024-09-13T22:08:41.493 INFO:tasks.workunit.client.1.smithi159.stdout:3/27: chown d0/d1/c4 1736 1 2024-09-13T22:08:41.495 INFO:tasks.workunit.client.0.smithi089.stdout:4/400: creat d0/d2c/d35/d74/f7e x:0 0 0 2024-09-13T22:08:41.496 INFO:tasks.workunit.client.0.smithi089.stdout:9/457: dread d6/d18/d21/f77 [0,4194304] 0 2024-09-13T22:08:41.496 INFO:tasks.workunit.client.0.smithi089.stdout:9/458: read d6/d55/d9a/f50 [1690875,45271] 0 2024-09-13T22:08:41.497 INFO:tasks.workunit.client.0.smithi089.stdout:9/459: getdents d6/d18/d21/d5d 0 2024-09-13T22:08:41.498 INFO:tasks.workunit.client.0.smithi089.stdout:6/356: dwrite d0/d5/f27 [4194304,4194304] 0 2024-09-13T22:08:41.498 INFO:tasks.workunit.client.0.smithi089.stdout:3/398: dwrite d1/d2/d23/d3d/f4d [0,4194304] 0 2024-09-13T22:08:41.498 INFO:tasks.workunit.client.0.smithi089.stdout:6/357: truncate d0/f48 397443 0 2024-09-13T22:08:41.498 INFO:tasks.workunit.client.0.smithi089.stdout:3/399: write d1/d2/d4/f1a [4971108,71587] 0 2024-09-13T22:08:41.502 INFO:tasks.workunit.client.0.smithi089.stdout:1/467: unlink d7/de/d1b/f58 0 2024-09-13T22:08:41.507 INFO:tasks.workunit.client.0.smithi089.stdout:4/401: creat d0/d15/d76/f7f x:0 0 0 2024-09-13T22:08:41.507 INFO:tasks.workunit.client.0.smithi089.stdout:0/546: dwrite d1/de/d10/d36/d38/d4e/d62/d5f/d72/f93 [0,4194304] 0 2024-09-13T22:08:41.508 INFO:tasks.workunit.client.1.smithi159.stdout:3/28: mknod d0/d1/d3/d5/c8 0 2024-09-13T22:08:41.510 INFO:tasks.workunit.client.1.smithi159.stdout:8/32: dwrite f8 [0,4194304] 0 2024-09-13T22:08:41.511 INFO:tasks.workunit.client.1.smithi159.stdout:0/59: fsync d0/d3/fb 0 2024-09-13T22:08:41.511 INFO:tasks.workunit.client.1.smithi159.stdout:0/60: chown d0/d3/l11 178956091 1 2024-09-13T22:08:41.512 INFO:tasks.workunit.client.0.smithi089.stdout:6/358: rename d0/d5/f7 to d0/d5/d64/f72 0 2024-09-13T22:08:41.513 INFO:tasks.workunit.client.1.smithi159.stdout:3/29: mkdir d0/d1/d9 0 2024-09-13T22:08:41.519 INFO:tasks.workunit.client.0.smithi089.stdout:2/385: dread df/d14/f21 [0,4194304] 0 2024-09-13T22:08:41.519 INFO:tasks.workunit.client.0.smithi089.stdout:2/386: fdatasync df/d14/f25 0 2024-09-13T22:08:41.519 INFO:tasks.workunit.client.0.smithi089.stdout:2/387: creat df/d14/d66/f7e x:0 0 0 2024-09-13T22:08:41.519 INFO:tasks.workunit.client.0.smithi089.stdout:4/402: creat d0/d11/d16/f80 x:0 0 0 2024-09-13T22:08:41.521 INFO:tasks.workunit.client.1.smithi159.stdout:0/61: symlink d0/d7/l13 0 2024-09-13T22:08:41.522 INFO:tasks.workunit.client.0.smithi089.stdout:4/403: write d0/d2c/d35/f4c [2742761,37263] 0 2024-09-13T22:08:41.522 INFO:tasks.workunit.client.1.smithi159.stdout:3/30: rename d0/d1/f6 to d0/d1/d9/fa 0 2024-09-13T22:08:41.524 INFO:tasks.workunit.client.1.smithi159.stdout:3/31: mkdir d0/d1/d3/d5/db 0 2024-09-13T22:08:41.524 INFO:tasks.workunit.client.1.smithi159.stdout:3/32: rename d0/d1 to d0/d1/dc 22 2024-09-13T22:08:41.525 INFO:tasks.workunit.client.0.smithi089.stdout:6/359: dread d0/d4/d12/d15/f32 [0,4194304] 0 2024-09-13T22:08:41.525 INFO:tasks.workunit.client.0.smithi089.stdout:7/355: dwrite d0/d19/d45/d38/f39 [0,4194304] 0 2024-09-13T22:08:41.525 INFO:tasks.workunit.client.0.smithi089.stdout:0/547: symlink d1/de/d10/d36/d38/d4e/lbe 0 2024-09-13T22:08:41.525 INFO:tasks.workunit.client.0.smithi089.stdout:0/548: write d1/f7 [5598881,73115] 0 2024-09-13T22:08:41.525 INFO:tasks.workunit.client.0.smithi089.stdout:0/549: truncate d1/de/d10/d36/d38/d4e/d62/d5f/d72/fac 14723 0 2024-09-13T22:08:41.525 INFO:tasks.workunit.client.1.smithi159.stdout:3/33: mkdir d0/d1/d3/dd 0 2024-09-13T22:08:41.526 INFO:tasks.workunit.client.1.smithi159.stdout:3/34: rmdir d0/d1/d3/d5 39 2024-09-13T22:08:41.530 INFO:tasks.workunit.client.0.smithi089.stdout:2/388: creat df/d14/d66/d69/d2e/f7f x:0 0 0 2024-09-13T22:08:41.534 INFO:tasks.workunit.client.0.smithi089.stdout:0/550: mkdir d1/de/d15/d41/d87/dbf 0 2024-09-13T22:08:41.535 INFO:tasks.workunit.client.0.smithi089.stdout:2/389: creat df/d14/d66/d69/f80 x:0 0 0 2024-09-13T22:08:41.537 INFO:tasks.workunit.client.0.smithi089.stdout:0/551: rename d1/de/d10/d36/d38/d4e/d62/d5b/l61 to d1/de/d1f/lc0 0 2024-09-13T22:08:41.537 INFO:tasks.workunit.client.0.smithi089.stdout:0/552: creat d1/de/d10/d36/d38/fc1 x:0 0 0 2024-09-13T22:08:41.537 INFO:tasks.workunit.client.0.smithi089.stdout:0/553: chown d1/de/d15/d41/d49 16789395 1 2024-09-13T22:08:41.538 INFO:tasks.workunit.client.0.smithi089.stdout:0/554: chown d1/de/d10/d36/d57/d3a 426649 1 2024-09-13T22:08:41.540 INFO:tasks.workunit.client.0.smithi089.stdout:7/356: write d0/d19/d45/d38/f39 [2072902,89513] 0 2024-09-13T22:08:41.540 INFO:tasks.workunit.client.1.smithi159.stdout:0/62: write d0/d7/f9 [3116968,67439] 0 2024-09-13T22:08:41.542 INFO:tasks.workunit.client.1.smithi159.stdout:0/63: creat d0/d7/f14 x:0 0 0 2024-09-13T22:08:41.542 INFO:tasks.workunit.client.1.smithi159.stdout:0/64: fsync d0/f10 0 2024-09-13T22:08:41.542 INFO:tasks.workunit.client.1.smithi159.stdout:0/65: write d0/f8 [1097780,82574] 0 2024-09-13T22:08:41.542 INFO:tasks.workunit.client.0.smithi089.stdout:4/404: dread d0/d2c/f45 [0,4194304] 0 2024-09-13T22:08:41.542 INFO:tasks.workunit.client.0.smithi089.stdout:4/405: creat d0/d11/d16/d24/d62/f81 x:0 0 0 2024-09-13T22:08:41.543 INFO:tasks.workunit.client.0.smithi089.stdout:8/421: dwrite d0/dd/f46 [0,4194304] 0 2024-09-13T22:08:41.544 INFO:tasks.workunit.client.0.smithi089.stdout:0/555: read d1/de/d10/f64 [842464,119993] 0 2024-09-13T22:08:41.547 INFO:tasks.workunit.client.1.smithi159.stdout:0/66: rename d0/d3 to d0/d15 0 2024-09-13T22:08:41.547 INFO:tasks.workunit.client.1.smithi159.stdout:0/67: creat d0/f16 x:0 0 0 2024-09-13T22:08:41.547 INFO:tasks.workunit.client.1.smithi159.stdout:0/68: readlink d0/d15/l4 0 2024-09-13T22:08:41.549 INFO:tasks.workunit.client.0.smithi089.stdout:2/390: link df/d14/f25 df/d1a/f81 0 2024-09-13T22:08:41.550 INFO:tasks.workunit.client.0.smithi089.stdout:0/556: read d1/de/d10/d36/d3d/f43 [2186041,43271] 0 2024-09-13T22:08:41.551 INFO:tasks.workunit.client.0.smithi089.stdout:5/360: dwrite d4/d19/d1e/d28/d3d/f5d [0,4194304] 0 2024-09-13T22:08:41.551 INFO:tasks.workunit.client.0.smithi089.stdout:1/468: dwrite d7/d40/f71 [0,4194304] 0 2024-09-13T22:08:41.552 INFO:tasks.workunit.client.0.smithi089.stdout:3/400: dwrite d1/d2/f66 [0,4194304] 0 2024-09-13T22:08:41.552 INFO:tasks.workunit.client.1.smithi159.stdout:3/35: dwrite d0/d1/f2 [0,4194304] 0 2024-09-13T22:08:41.552 INFO:tasks.workunit.client.1.smithi159.stdout:0/69: fdatasync d0/f8 0 2024-09-13T22:08:41.552 INFO:tasks.workunit.client.1.smithi159.stdout:0/70: write d0/f16 [986183,61460] 0 2024-09-13T22:08:41.552 INFO:tasks.workunit.client.1.smithi159.stdout:0/71: read - d0/d7/f14 zero size 2024-09-13T22:08:41.552 INFO:tasks.workunit.client.1.smithi159.stdout:0/72: chown d0/d15/fb 2 1 2024-09-13T22:08:41.553 INFO:tasks.workunit.client.0.smithi089.stdout:6/360: dwrite d0/d5/d1d/d2d/f66 [0,4194304] 0 2024-09-13T22:08:41.556 INFO:tasks.workunit.client.0.smithi089.stdout:4/406: unlink d0/d2c/d35/d64/c7c 0 2024-09-13T22:08:41.556 INFO:tasks.workunit.client.0.smithi089.stdout:4/407: fdatasync d0/d11/d16/d24/f32 0 2024-09-13T22:08:41.561 INFO:tasks.workunit.client.0.smithi089.stdout:8/422: creat d0/dd/d12/d20/d36/d80/d3b/f8c x:0 0 0 2024-09-13T22:08:41.562 INFO:tasks.workunit.client.0.smithi089.stdout:0/557: rename d1/de/d10/d36/d38/d4e/d62/d5f/d72/ca9 to d1/de/d10/d85/cc2 0 2024-09-13T22:08:41.562 INFO:tasks.workunit.client.0.smithi089.stdout:0/558: write d1/de/d10/d36/d38/d4e/d62/d5f/d72/fac [120104,66120] 0 2024-09-13T22:08:41.565 INFO:tasks.workunit.client.0.smithi089.stdout:5/361: symlink d4/l85 0 2024-09-13T22:08:41.565 INFO:tasks.workunit.client.0.smithi089.stdout:5/362: stat d4/d19/d1e/d28/f49 0 2024-09-13T22:08:41.565 INFO:tasks.workunit.client.0.smithi089.stdout:5/363: chown d4/c7c 28 1 2024-09-13T22:08:41.566 INFO:tasks.workunit.client.1.smithi159.stdout:1/33: truncate f3 419999 0 2024-09-13T22:08:41.566 INFO:tasks.workunit.client.1.smithi159.stdout:1/34: rmdir - no directory 2024-09-13T22:08:41.566 INFO:tasks.workunit.client.1.smithi159.stdout:1/35: creat f7 x:0 0 0 2024-09-13T22:08:41.573 INFO:tasks.workunit.client.1.smithi159.stdout:1/36: link c5 c8 0 2024-09-13T22:08:41.573 INFO:tasks.workunit.client.1.smithi159.stdout:1/37: chown f3 3058477 1 2024-09-13T22:08:41.573 INFO:tasks.workunit.client.1.smithi159.stdout:1/38: dread - f6 zero size 2024-09-13T22:08:41.574 INFO:tasks.workunit.client.1.smithi159.stdout:1/39: creat f9 x:0 0 0 2024-09-13T22:08:41.574 INFO:tasks.workunit.client.0.smithi089.stdout:0/559: dread d1/de/d15/d41/d49/d76/f8e [0,4194304] 0 2024-09-13T22:08:41.577 INFO:tasks.workunit.client.0.smithi089.stdout:6/361: getdents d0/d5/d1d 0 2024-09-13T22:08:41.578 INFO:tasks.workunit.client.0.smithi089.stdout:3/401: dwrite d1/d2/d18/d38/f53 [0,4194304] 0 2024-09-13T22:08:41.580 INFO:tasks.workunit.client.0.smithi089.stdout:2/391: dwrite df/d5b/f6f [0,4194304] 0 2024-09-13T22:08:41.581 INFO:tasks.workunit.client.1.smithi159.stdout:3/36: dwrite d0/d1/f2 [4194304,4194304] 0 2024-09-13T22:08:41.583 INFO:tasks.workunit.client.0.smithi089.stdout:7/357: rmdir d0/d19/d28/d1d 39 2024-09-13T22:08:41.583 INFO:tasks.workunit.client.0.smithi089.stdout:7/358: fsync d0/d19/d28/d1d/f5f 0 2024-09-13T22:08:41.583 INFO:tasks.workunit.client.0.smithi089.stdout:7/359: write d0/d19/d28/d1d/d30/f59 [737190,45054] 0 2024-09-13T22:08:41.585 INFO:tasks.workunit.client.0.smithi089.stdout:4/408: link d0/d11/f21 d0/d2c/d35/d64/f82 0 2024-09-13T22:08:41.585 INFO:tasks.workunit.client.0.smithi089.stdout:4/409: stat d0/d11/d16/d24/f36 0 2024-09-13T22:08:41.588 INFO:tasks.workunit.client.1.smithi159.stdout:3/37: unlink d0/d1/d3/c7 0 2024-09-13T22:08:41.590 INFO:tasks.workunit.client.0.smithi089.stdout:5/364: rename d4/d19/d1e/d28/d3d/f83 to d4/d19/d1e/d28/d31/d35/d46/f86 0 2024-09-13T22:08:41.590 INFO:tasks.workunit.client.0.smithi089.stdout:5/365: readlink d4/d19/d1e/d28/d31/d35/d46/l4a 0 2024-09-13T22:08:41.590 INFO:tasks.workunit.client.0.smithi089.stdout:5/366: dread - d4/d19/d1e/d28/f49 zero size 2024-09-13T22:08:41.590 INFO:tasks.workunit.client.0.smithi089.stdout:5/367: readlink d4/d19/d1e/d28/l34 0 2024-09-13T22:08:41.591 INFO:tasks.workunit.client.0.smithi089.stdout:1/469: rmdir d7/d1c/d3c 39 2024-09-13T22:08:41.591 INFO:tasks.workunit.client.0.smithi089.stdout:0/560: mknod d1/de/d10/d36/d39/cc3 0 2024-09-13T22:08:41.592 INFO:tasks.workunit.client.0.smithi089.stdout:6/362: mknod d0/c73 0 2024-09-13T22:08:41.594 INFO:tasks.workunit.client.1.smithi159.stdout:0/73: fsync d0/d7/f14 0 2024-09-13T22:08:41.595 INFO:tasks.workunit.client.0.smithi089.stdout:3/402: symlink d1/l7d 0 2024-09-13T22:08:41.601 INFO:tasks.workunit.client.1.smithi159.stdout:0/74: dread d0/d15/fb [0,4194304] 0 2024-09-13T22:08:41.603 INFO:tasks.workunit.client.0.smithi089.stdout:2/392: mknod df/d14/d66/d69/d2e/c82 0 2024-09-13T22:08:41.604 INFO:tasks.workunit.client.1.smithi159.stdout:0/75: mknod d0/c17 0 2024-09-13T22:08:41.605 INFO:tasks.workunit.client.0.smithi089.stdout:0/561: write d1/de/f14 [879408,91308] 0 2024-09-13T22:08:41.605 INFO:tasks.workunit.client.0.smithi089.stdout:0/562: creat d1/de/d10/d36/d38/d4e/fc4 x:0 0 0 2024-09-13T22:08:41.606 INFO:tasks.workunit.client.0.smithi089.stdout:7/360: link d0/d19/d28/d1d/d23/d2e/d41/f4d d0/d19/d28/d1d/d23/d2e/d41/f6f 0 2024-09-13T22:08:41.606 INFO:tasks.workunit.client.0.smithi089.stdout:7/361: chown d0/ff 3478120 1 2024-09-13T22:08:41.606 INFO:tasks.workunit.client.0.smithi089.stdout:7/362: read - d0/d19/d45/f51 zero size 2024-09-13T22:08:41.607 INFO:tasks.workunit.client.0.smithi089.stdout:4/410: mkdir d0/d15/d83 0 2024-09-13T22:08:41.607 INFO:tasks.workunit.client.0.smithi089.stdout:4/411: chown d0/d2c/l33 429 1 2024-09-13T22:08:41.607 INFO:tasks.workunit.client.0.smithi089.stdout:4/412: chown d0/d2c/d35/d64/c65 208 1 2024-09-13T22:08:41.607 INFO:tasks.workunit.client.1.smithi159.stdout:0/76: symlink d0/d15/l18 0 2024-09-13T22:08:41.609 INFO:tasks.workunit.client.0.smithi089.stdout:8/423: mkdir d0/dd/d12/d20/d36/d59/d89/d8d 0 2024-09-13T22:08:41.611 INFO:tasks.workunit.client.0.smithi089.stdout:5/368: mknod d4/d19/d1e/d28/d31/d55/d58/d84/c87 0 2024-09-13T22:08:41.611 INFO:tasks.workunit.client.0.smithi089.stdout:5/369: dread - d4/d19/f79 zero size 2024-09-13T22:08:41.613 INFO:tasks.workunit.client.0.smithi089.stdout:6/363: link d0/d5/d1d/l5a d0/d4/d12/l74 0 2024-09-13T22:08:41.614 INFO:tasks.workunit.client.1.smithi159.stdout:3/38: dwrite d0/d1/f2 [0,4194304] 0 2024-09-13T22:08:41.617 INFO:tasks.workunit.client.0.smithi089.stdout:1/470: dwrite d7/d34/d5c/d5d/f62 [0,4194304] 0 2024-09-13T22:08:41.617 INFO:tasks.workunit.client.0.smithi089.stdout:1/471: fdatasync d7/f9 0 2024-09-13T22:08:41.622 INFO:tasks.workunit.client.0.smithi089.stdout:2/393: creat df/d1a/d57/f83 x:0 0 0 2024-09-13T22:08:41.624 INFO:tasks.workunit.client.0.smithi089.stdout:7/363: symlink d0/l70 0 2024-09-13T22:08:41.624 INFO:tasks.workunit.client.0.smithi089.stdout:7/364: creat d0/d19/d45/d38/f71 x:0 0 0 2024-09-13T22:08:41.624 INFO:tasks.workunit.client.0.smithi089.stdout:7/365: write d0/d19/d28/d1d/d2d/f6d [1423138,24678] 0 2024-09-13T22:08:41.625 INFO:tasks.workunit.client.0.smithi089.stdout:8/424: symlink d0/dd/d12/d20/d36/d59/l8e 0 2024-09-13T22:08:41.626 INFO:tasks.workunit.client.0.smithi089.stdout:8/425: chown d0/dd/d12/d20/d1c/f2f 45 1 2024-09-13T22:08:41.627 INFO:tasks.workunit.client.0.smithi089.stdout:5/370: mkdir d4/d19/d1e/d53/d88 0 2024-09-13T22:08:41.628 INFO:tasks.workunit.client.0.smithi089.stdout:6/364: mknod d0/d4/c75 0 2024-09-13T22:08:41.633 INFO:tasks.workunit.client.0.smithi089.stdout:3/403: rename d1/d2/d18 to d1/d2/d4/d1c/d7e 0 2024-09-13T22:08:41.637 INFO:tasks.workunit.client.0.smithi089.stdout:7/366: creat d0/d19/d28/d1d/d23/d24/f72 x:0 0 0 2024-09-13T22:08:41.638 INFO:tasks.workunit.client.0.smithi089.stdout:8/426: rmdir d0/dd/d12/d20/d36/d80 39 2024-09-13T22:08:41.638 INFO:tasks.workunit.client.1.smithi159.stdout:0/77: dwrite d0/f16 [0,4194304] 0 2024-09-13T22:08:41.639 INFO:tasks.workunit.client.0.smithi089.stdout:5/371: mkdir d4/d19/d1e/d89 0 2024-09-13T22:08:41.641 INFO:tasks.workunit.client.0.smithi089.stdout:0/563: rename d1/de/d10/d36/d57/l90 to d1/de/d15/d2a/lc5 0 2024-09-13T22:08:41.641 INFO:tasks.workunit.client.0.smithi089.stdout:0/564: getdents d1/de/d15/d41/d87/dbf 0 2024-09-13T22:08:41.642 INFO:tasks.workunit.client.0.smithi089.stdout:3/404: mkdir d1/d2/d4/d1c/d7f 0 2024-09-13T22:08:41.644 INFO:tasks.workunit.client.0.smithi089.stdout:8/427: symlink d0/dd/d12/d20/d40/d4a/d7f/l8f 0 2024-09-13T22:08:41.644 INFO:tasks.workunit.client.0.smithi089.stdout:8/428: read d0/dd/d12/d20/d36/d80/f44 [2371559,95553] 0 2024-09-13T22:08:41.646 INFO:tasks.workunit.client.0.smithi089.stdout:5/372: rename d4/d19/d1e/d28/d3d/d5e to d4/d19/d1e/d89/d8a 0 2024-09-13T22:08:41.650 INFO:tasks.workunit.client.0.smithi089.stdout:7/367: dread d0/d19/d28/d1d/f2c [0,4194304] 0 2024-09-13T22:08:41.652 INFO:tasks.workunit.client.0.smithi089.stdout:5/373: symlink d4/d19/d1e/d89/d8a/l8b 0 2024-09-13T22:08:41.652 INFO:tasks.workunit.client.0.smithi089.stdout:0/565: getdents d1/de/d10/d36/d38 0 2024-09-13T22:08:41.652 INFO:tasks.workunit.client.0.smithi089.stdout:4/413: dwrite d0/d2c/d35/d74/f7e [0,4194304] 0 2024-09-13T22:08:41.652 INFO:tasks.workunit.client.0.smithi089.stdout:4/414: chown d0/d2c/d35/f4f 1694566 1 2024-09-13T22:08:41.653 INFO:tasks.workunit.client.0.smithi089.stdout:4/415: read - d0/d11/d16/f80 zero size 2024-09-13T22:08:41.653 INFO:tasks.workunit.client.0.smithi089.stdout:3/405: symlink d1/d2/l80 0 2024-09-13T22:08:41.653 INFO:tasks.workunit.client.0.smithi089.stdout:3/406: truncate d1/d7/d1b/f4e 272176 0 2024-09-13T22:08:41.654 INFO:tasks.workunit.client.0.smithi089.stdout:9/460: sync 2024-09-13T22:08:41.655 INFO:tasks.workunit.client.0.smithi089.stdout:8/429: rename d0/dd/d12/d20/d36/d59/d89/c53 to d0/dd/d12/d20/d36/c90 0 2024-09-13T22:08:41.655 INFO:tasks.workunit.client.0.smithi089.stdout:8/430: fdatasync d0/dd/d12/d20/d36/d59/d89/f25 0 2024-09-13T22:08:41.655 INFO:tasks.workunit.client.0.smithi089.stdout:8/431: readlink d0/dd/d12/d20/d36/d59/l8e 0 2024-09-13T22:08:41.655 INFO:tasks.workunit.client.0.smithi089.stdout:7/368: symlink d0/d19/d28/d1d/d3d/l73 0 2024-09-13T22:08:41.657 INFO:tasks.workunit.client.0.smithi089.stdout:4/416: dread d0/f23 [0,4194304] 0 2024-09-13T22:08:41.658 INFO:tasks.workunit.client.0.smithi089.stdout:4/417: dread - d0/f3e zero size 2024-09-13T22:08:41.658 INFO:tasks.workunit.client.0.smithi089.stdout:5/374: rename d4/d19/d1e/d28/d3d/l3e to d4/d19/l8c 0 2024-09-13T22:08:41.658 INFO:tasks.workunit.client.0.smithi089.stdout:4/418: creat d0/d2c/f84 x:0 0 0 2024-09-13T22:08:41.661 INFO:tasks.workunit.client.0.smithi089.stdout:4/419: symlink d0/d15/d76/l85 0 2024-09-13T22:08:41.661 INFO:tasks.workunit.client.1.smithi159.stdout:3/39: dwrite d0/d1/f2 [8388608,4194304] 0 2024-09-13T22:08:41.663 INFO:tasks.workunit.client.0.smithi089.stdout:1/472: dwrite d7/de/d1b/d2b/d39/f98 [0,4194304] 0 2024-09-13T22:08:41.664 INFO:tasks.workunit.client.0.smithi089.stdout:3/407: dread d1/d2/d4/d1c/d7e/d38/f53 [0,4194304] 0 2024-09-13T22:08:41.664 INFO:tasks.workunit.client.0.smithi089.stdout:3/408: dread - d1/d7/f61 zero size 2024-09-13T22:08:41.665 INFO:tasks.workunit.client.1.smithi159.stdout:0/78: dwrite d0/d15/fd [0,4194304] 0 2024-09-13T22:08:41.665 INFO:tasks.workunit.client.1.smithi159.stdout:0/79: creat d0/d7/f19 x:0 0 0 2024-09-13T22:08:41.665 INFO:tasks.workunit.client.1.smithi159.stdout:0/80: creat d0/d7/f1a x:0 0 0 2024-09-13T22:08:41.665 INFO:tasks.workunit.client.0.smithi089.stdout:6/365: dwrite d0/d5/d1d/d56/f3a [0,4194304] 0 2024-09-13T22:08:41.665 INFO:tasks.workunit.client.0.smithi089.stdout:6/366: truncate d0/d5/d1d/f33 967706 0 2024-09-13T22:08:41.665 INFO:tasks.workunit.client.0.smithi089.stdout:6/367: chown d0/d4/d12/l30 1 1 2024-09-13T22:08:41.669 INFO:tasks.workunit.client.0.smithi089.stdout:1/473: link d7/de/d1b/l8f d7/d34/d5c/d5d/la3 0 2024-09-13T22:08:41.670 INFO:tasks.workunit.client.0.smithi089.stdout:0/566: write d1/de/d10/d36/d38/d4e/d62/d5b/f67 [375843,43958] 0 2024-09-13T22:08:41.670 INFO:tasks.workunit.client.0.smithi089.stdout:0/567: fsync d1/de/d10/d36/d38/d4e/d62/d5f/faa 0 2024-09-13T22:08:41.677 INFO:tasks.workunit.client.0.smithi089.stdout:1/474: creat d7/fa4 x:0 0 0 2024-09-13T22:08:41.677 INFO:tasks.workunit.client.0.smithi089.stdout:6/368: dread d0/d4/f2b [0,4194304] 0 2024-09-13T22:08:41.677 INFO:tasks.workunit.client.0.smithi089.stdout:6/369: dread - d0/d4/f6f zero size 2024-09-13T22:08:41.679 INFO:tasks.workunit.client.0.smithi089.stdout:0/568: creat d1/de/fc6 x:0 0 0 2024-09-13T22:08:41.679 INFO:tasks.workunit.client.0.smithi089.stdout:2/394: dwrite df/d14/f65 [0,4194304] 0 2024-09-13T22:08:41.680 INFO:tasks.workunit.client.0.smithi089.stdout:1/475: rename d7/d1c/f35 to d7/de/d1b/d80/fa5 0 2024-09-13T22:08:41.681 INFO:tasks.workunit.client.0.smithi089.stdout:1/476: creat d7/de/d3a/fa6 x:0 0 0 2024-09-13T22:08:41.681 INFO:tasks.workunit.client.1.smithi159.stdout:3/40: dread d0/d1/d9/fa [0,4194304] 0 2024-09-13T22:08:41.681 INFO:tasks.workunit.client.0.smithi089.stdout:6/370: unlink d0/d4/d12/d15/l16 0 2024-09-13T22:08:41.683 INFO:tasks.workunit.client.0.smithi089.stdout:0/569: creat d1/de/d15/d41/d87/fc7 x:0 0 0 2024-09-13T22:08:41.683 INFO:tasks.workunit.client.0.smithi089.stdout:0/570: fdatasync d1/fd 0 2024-09-13T22:08:41.683 INFO:tasks.workunit.client.0.smithi089.stdout:0/571: creat d1/de/d10/d36/d38/d4e/fc8 x:0 0 0 2024-09-13T22:08:41.684 INFO:tasks.workunit.client.0.smithi089.stdout:2/395: creat df/d14/d48/f84 x:0 0 0 2024-09-13T22:08:41.687 INFO:tasks.workunit.client.0.smithi089.stdout:6/371: link d0/d4/d12/c1b d0/d5/d1d/d2d/c76 0 2024-09-13T22:08:41.692 INFO:tasks.workunit.client.0.smithi089.stdout:2/396: mkdir df/d76/d85 0 2024-09-13T22:08:41.693 INFO:tasks.workunit.client.0.smithi089.stdout:1/477: read d7/d34/f38 [3893362,108399] 0 2024-09-13T22:08:41.693 INFO:tasks.workunit.client.0.smithi089.stdout:1/478: fsync d7/f19 0 2024-09-13T22:08:41.693 INFO:tasks.workunit.client.0.smithi089.stdout:0/572: dread d1/de/d10/f1b [0,4194304] 0 2024-09-13T22:08:41.695 INFO:tasks.workunit.client.0.smithi089.stdout:3/409: dwrite d1/d2/d24/f3b [0,4194304] 0 2024-09-13T22:08:41.695 INFO:tasks.workunit.client.0.smithi089.stdout:3/410: truncate d1/d7/f61 518430 0 2024-09-13T22:08:41.695 INFO:tasks.workunit.client.0.smithi089.stdout:3/411: readlink d1/d2/d24/l45 0 2024-09-13T22:08:41.695 INFO:tasks.workunit.client.0.smithi089.stdout:9/461: dwrite d6/d54/f9c [0,4194304] 0 2024-09-13T22:08:41.695 INFO:tasks.workunit.client.0.smithi089.stdout:9/462: chown d6/d54/f98 197 1 2024-09-13T22:08:41.696 INFO:tasks.workunit.client.0.smithi089.stdout:0/573: truncate d1/f5 252122 0 2024-09-13T22:08:41.698 INFO:tasks.workunit.client.0.smithi089.stdout:7/369: dwrite d0/d19/d28/d1d/d23/d24/d5d/f5e [0,4194304] 0 2024-09-13T22:08:41.698 INFO:tasks.workunit.client.0.smithi089.stdout:7/370: creat d0/d19/d28/d1d/d23/d24/f74 x:0 0 0 2024-09-13T22:08:41.698 INFO:tasks.workunit.client.0.smithi089.stdout:7/371: write d0/d19/d28/d1d/d23/d24/f72 [786823,93038] 0 2024-09-13T22:08:41.701 INFO:tasks.workunit.client.0.smithi089.stdout:9/463: rename d6/d31/d5e/c8b to d6/d18/d21/d5d/d6c/ca1 0 2024-09-13T22:08:41.701 INFO:tasks.workunit.client.0.smithi089.stdout:9/464: chown d6/d31/l6b 298 1 2024-09-13T22:08:41.702 INFO:tasks.workunit.client.0.smithi089.stdout:9/465: fdatasync d6/f5c 0 2024-09-13T22:08:41.703 INFO:tasks.workunit.client.1.smithi159.stdout:3/41: dwrite d0/d1/d9/fa [4194304,4194304] 0 2024-09-13T22:08:41.709 INFO:tasks.workunit.client.0.smithi089.stdout:3/412: write d1/d2/d24/f3b [4079491,16324] 0 2024-09-13T22:08:41.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.727+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab6c0fc400 con 0x7fab5406d7b0 2024-09-13T22:08:41.729 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:41 smithi089 ceph-mon[27921]: pgmap v252: 65 pgs: 65 active+clean; 526 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 40 MiB/s rd, 55 MiB/s wr, 633 op/s 2024-09-13T22:08:41.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.737+0000 7fab68ff9640 1 -- 172.21.15.89:0/1844932146 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3768 (secure 0 0 0) 0x7fab6c0fc400 con 0x7fab5406d7b0 2024-09-13T22:08:41.738 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:08:41.738 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (6m) 114s ago 7m 25.0M - 0.25.0 c8568f914cd2 6ef74b73ca3e 2024-09-13T22:08:41.738 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (8m) 114s ago 8m 7528k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:08:41.738 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (7m) 2m ago 7m 7356k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (7m) 114s ago 7m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (7m) 2m ago 7m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (6m) 114s ago 7m 88.2M - 9.4.7 954c08fa6188 59724cff87bd 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (2m) 114s ago 2m 13.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (2m) 114s ago 2m 11.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (2m) 2m ago 2m 16.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (2m) 2m ago 2m 13.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:9283,8765,8443 running (9m) 114s ago 9m 487M - 18.2.4-845-ge4e227b3 67ddd33fa72f deeaa986e2d7 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 starting - - - - 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (9m) 114s ago 9m 47.7M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (6m) 2m ago 6m 35.3M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 114s ago 7m 15.9M - 1.5.0 0da6a335fe13 eeaf1dd44f97 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (6m) 2m ago 6m 15.6M - 1.5.0 0da6a335fe13 c76544fc91f3 2024-09-13T22:08:41.739 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (6m) 114s ago 6m 55.6M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:08:41.740 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (5m) 114s ago 5m 50.2M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:08:41.740 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (5m) 114s ago 5m 55.9M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:08:41.740 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (4m) 2m ago 4m 52.6M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:08:41.740 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (4m) 2m ago 4m 50.9M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:08:41.740 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (3m) 2m ago 3m 51.2M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:08:41.740 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (6m) 114s ago 7m 58.3M - 2.43.0 a07b618ecd1d 4bb2a482e0e5 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fab5406d7b0 msgr2=0x7fab5406fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fab5406d7b0 0x7fab5406fc70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c00 tx=0x7fab600314e0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0fea80 msgr2=0x7fab6c195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0fea80 0x7fab6c195710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00b400 tx=0x7fab5c00b8c0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 shutdown_connections 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fab5406d7b0 0x7fab5406fc70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab6c0ffc80 0x7fab6c195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 --2- 172.21.15.89:0/1844932146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6c0fea80 0x7fab6c195710 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 >> 172.21.15.89:0/1844932146 conn(0x7fab6c0fa230 msgr2=0x7fab6c0fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:41.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 shutdown_connections 2024-09-13T22:08:41.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.739+0000 7fab71f2d640 1 -- 172.21.15.89:0/1844932146 wait complete. 2024-09-13T22:08:41.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:41 smithi159 ceph-mon[35348]: pgmap v252: 65 pgs: 65 active+clean; 526 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 40 MiB/s rd, 55 MiB/s wr, 633 op/s 2024-09-13T22:08:41.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.820+0000 7ffb25d31640 1 -- 172.21.15.89:0/1466487019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 msgr2=0x7ffb200feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.820+0000 7ffb25d31640 1 --2- 172.21.15.89:0/1466487019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 0x7ffb200feea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009880 tx=0x7ffb1002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.820+0000 7ffb25d31640 1 -- 172.21.15.89:0/1466487019 shutdown_connections 2024-09-13T22:08:41.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.820+0000 7ffb25d31640 1 --2- 172.21.15.89:0/1466487019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb200ffca0 0x7ffb20100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.820+0000 7ffb25d31640 1 --2- 172.21.15.89:0/1466487019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 0x7ffb200feea0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.820+0000 7ffb25d31640 1 -- 172.21.15.89:0/1466487019 >> 172.21.15.89:0/1466487019 conn(0x7ffb200fa250 msgr2=0x7ffb200fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.820+0000 7ffb25d31640 1 -- 172.21.15.89:0/1466487019 shutdown_connections 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.820+0000 7ffb25d31640 1 -- 172.21.15.89:0/1466487019 wait complete. 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb25d31640 1 Processor -- start 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb25d31640 1 -- start start 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb25d31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 0x7ffb20102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb25d31640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb200ffca0 0x7ffb20101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb25d31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb201015c0 con 0x7ffb200feaa0 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb25d31640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20101730 con 0x7ffb200ffca0 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb1f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 0x7ffb20102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb1f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 0x7ffb20102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56698/0 (socket says 172.21.15.89:56698) 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb1f7fe640 1 -- 172.21.15.89:0/2474435855 learned_addr learned my addr 172.21.15.89:0/2474435855 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb1effd640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb200ffca0 0x7ffb20101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:41.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb1f7fe640 1 -- 172.21.15.89:0/2474435855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb200ffca0 msgr2=0x7ffb20101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:41.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb1f7fe640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb200ffca0 0x7ffb20101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:41.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.821+0000 7ffb1f7fe640 1 -- 172.21.15.89:0/2474435855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10009560 con 0x7ffb200feaa0 2024-09-13T22:08:41.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.822+0000 7ffb1f7fe640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 0x7ffb20102a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffb1002a9c0 tx=0x7ffb100054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:41.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.822+0000 7ffb1cff9640 1 -- 172.21.15.89:0/2474435855 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb10004aa0 con 0x7ffb200feaa0 2024-09-13T22:08:41.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.822+0000 7ffb1cff9640 1 -- 172.21.15.89:0/2474435855 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb10004c00 con 0x7ffb200feaa0 2024-09-13T22:08:41.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.822+0000 7ffb1cff9640 1 -- 172.21.15.89:0/2474435855 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb10003a80 con 0x7ffb200feaa0 2024-09-13T22:08:41.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.822+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb201019b0 con 0x7ffb200feaa0 2024-09-13T22:08:41.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.822+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb20101ed0 con 0x7ffb200feaa0 2024-09-13T22:08:41.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.823+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb201076b0 con 0x7ffb200feaa0 2024-09-13T22:08:41.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.823+0000 7ffb1cff9640 1 -- 172.21.15.89:0/2474435855 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 20) v1 ==== 91631+0+0 (secure 0 0 0) 0x7ffb10003d40 con 0x7ffb200feaa0 2024-09-13T22:08:41.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.824+0000 7ffb1cff9640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffb0806d760 0x7ffb0806fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:41.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.824+0000 7ffb1cff9640 1 -- 172.21.15.89:0/2474435855 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ffb100ae2b0 con 0x7ffb200feaa0 2024-09-13T22:08:41.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.824+0000 7ffb1effd640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffb0806d760 0x7ffb0806fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:41.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.824+0000 7ffb1effd640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffb0806d760 0x7ffb0806fc20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffb14005fd0 tx=0x7ffb14005850 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:41.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:41.828+0000 7ffb1cff9640 1 -- 172.21.15.89:0/2474435855 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffb10078620 con 0x7ffb200feaa0 2024-09-13T22:08:41.921 INFO:tasks.workunit.client.0.smithi089.stdout:0/574: creat d1/de/d10/d36/d38/d4e/d62/d5f/db6/fc9 x:0 0 0 2024-09-13T22:08:41.921 INFO:tasks.workunit.client.0.smithi089.stdout:0/575: creat d1/de/d10/d36/fca x:0 0 0 2024-09-13T22:08:41.922 INFO:tasks.workunit.client.0.smithi089.stdout:0/576: write d1/de/f3e [6102322,89675] 0 2024-09-13T22:08:41.923 INFO:tasks.workunit.client.1.smithi159.stdout:3/42: write d0/d1/f2 [11935617,31276] 0 2024-09-13T22:08:41.924 INFO:tasks.workunit.client.0.smithi089.stdout:9/466: truncate d6/d18/d33/f49 813365 0 2024-09-13T22:08:41.924 INFO:tasks.workunit.client.0.smithi089.stdout:9/467: truncate d6/d18/d21/f62 1228158 0 2024-09-13T22:08:41.927 INFO:tasks.workunit.client.0.smithi089.stdout:3/413: truncate d1/d2/d31/f3f 1213069 0 2024-09-13T22:08:41.930 INFO:tasks.workunit.client.0.smithi089.stdout:3/414: getdents d1/d2/d4/d1c/d7e/d40/d69 0 2024-09-13T22:08:41.930 INFO:tasks.workunit.client.0.smithi089.stdout:3/415: creat d1/d2/d24/f81 x:0 0 0 2024-09-13T22:08:41.931 INFO:tasks.workunit.client.0.smithi089.stdout:9/468: getdents d6/d18/d1b 0 2024-09-13T22:08:41.931 INFO:tasks.workunit.client.0.smithi089.stdout:9/469: creat d6/d18/fa2 x:0 0 0 2024-09-13T22:08:41.932 INFO:tasks.workunit.client.0.smithi089.stdout:0/577: write d1/de/d10/d36/d57/d3a/f3c [3450724,70935] 0 2024-09-13T22:08:41.932 INFO:tasks.workunit.client.0.smithi089.stdout:0/578: fdatasync d1/de/d10/f64 0 2024-09-13T22:08:41.932 INFO:tasks.workunit.client.0.smithi089.stdout:0/579: truncate d1/de/d15/d41/d49/f7b 333742 0 2024-09-13T22:08:41.933 INFO:tasks.workunit.client.0.smithi089.stdout:3/416: chown d1/d2/d43 37840 1 2024-09-13T22:08:41.933 INFO:tasks.workunit.client.0.smithi089.stdout:3/417: fsync d1/d2/d4/d1c/d7e/f7a 0 2024-09-13T22:08:41.934 INFO:tasks.workunit.client.0.smithi089.stdout:2/397: dwrite df/d1a/f42 [0,4194304] 0 2024-09-13T22:08:41.937 INFO:tasks.workunit.client.0.smithi089.stdout:6/372: dwrite d0/d4/d12/f13 [4194304,4194304] 0 2024-09-13T22:08:41.937 INFO:tasks.workunit.client.0.smithi089.stdout:6/373: dread - d0/d5/d43/f53 zero size 2024-09-13T22:08:41.938 INFO:tasks.workunit.client.0.smithi089.stdout:7/372: dwrite d0/d19/d28/d1d/f2c [4194304,4194304] 0 2024-09-13T22:08:41.938 INFO:tasks.workunit.client.1.smithi159.stdout:0/81: rmdir d0 39 2024-09-13T22:08:41.943 INFO:tasks.workunit.client.1.smithi159.stdout:3/43: dread d0/d1/f2 [8388608,4194304] 0 2024-09-13T22:08:41.943 INFO:tasks.workunit.client.1.smithi159.stdout:0/82: rename d0/ce to d0/d7/c1b 0 2024-09-13T22:08:41.947 INFO:tasks.workunit.client.0.smithi089.stdout:6/374: link d0/d5/d43/f53 d0/d5/d43/f77 0 2024-09-13T22:08:41.947 INFO:tasks.workunit.client.0.smithi089.stdout:6/375: write d0/d5/d1d/d2d/f39 [929318,93502] 0 2024-09-13T22:08:41.947 INFO:tasks.workunit.client.0.smithi089.stdout:6/376: creat d0/d4/d12/f78 x:0 0 0 2024-09-13T22:08:41.947 INFO:tasks.workunit.client.0.smithi089.stdout:2/398: dread df/d14/f24 [0,4194304] 0 2024-09-13T22:08:41.948 INFO:tasks.workunit.client.1.smithi159.stdout:0/83: symlink d0/l1c 0 2024-09-13T22:08:41.949 INFO:tasks.workunit.client.1.smithi159.stdout:0/84: write d0/f8 [5197,124129] 0 2024-09-13T22:08:41.949 INFO:tasks.workunit.client.1.smithi159.stdout:0/85: readlink d0/d15/l18 0 2024-09-13T22:08:41.951 INFO:tasks.workunit.client.1.smithi159.stdout:3/44: getdents d0/d1 0 2024-09-13T22:08:41.954 INFO:tasks.workunit.client.1.smithi159.stdout:3/45: creat d0/d1/d3/d5/fe x:0 0 0 2024-09-13T22:08:41.957 INFO:tasks.workunit.client.1.smithi159.stdout:3/46: mknod d0/d1/d9/cf 0 2024-09-13T22:08:41.959 INFO:tasks.workunit.client.0.smithi089.stdout:2/399: write df/d14/d66/d69/d2e/f37 [3910408,116192] 0 2024-09-13T22:08:41.959 INFO:tasks.workunit.client.0.smithi089.stdout:2/400: creat df/d5b/f86 x:0 0 0 2024-09-13T22:08:41.959 INFO:tasks.workunit.client.0.smithi089.stdout:2/401: truncate df/d1a/d57/d68/f71 294588 0 2024-09-13T22:08:41.960 INFO:tasks.workunit.client.0.smithi089.stdout:2/402: truncate df/d5b/f86 447508 0 2024-09-13T22:08:41.960 INFO:tasks.workunit.client.0.smithi089.stdout:6/377: write d0/d4/d12/f13 [7636791,19012] 0 2024-09-13T22:08:41.960 INFO:tasks.workunit.client.1.smithi159.stdout:3/47: unlink d0/d1/d9/fa 0 2024-09-13T22:08:41.961 INFO:tasks.workunit.client.0.smithi089.stdout:2/403: dread df/f22 [0,4194304] 0 2024-09-13T22:08:41.961 INFO:tasks.workunit.client.1.smithi159.stdout:0/86: dread d0/f16 [0,4194304] 0 2024-09-13T22:08:41.961 INFO:tasks.workunit.client.1.smithi159.stdout:0/87: readlink d0/d7/lc 0 2024-09-13T22:08:41.961 INFO:tasks.workunit.client.1.smithi159.stdout:0/88: chown d0/d7/f14 2133338 1 2024-09-13T22:08:41.964 INFO:tasks.workunit.client.1.smithi159.stdout:3/48: unlink d0/d1/d9/cf 0 2024-09-13T22:08:41.965 INFO:tasks.workunit.client.0.smithi089.stdout:0/580: dwrite d1/de/d15/d41/d49/d76/f8e [0,4194304] 0 2024-09-13T22:08:41.965 INFO:tasks.workunit.client.0.smithi089.stdout:7/373: dwrite d0/d19/d45/f6b [0,4194304] 0 2024-09-13T22:08:41.968 INFO:tasks.workunit.client.0.smithi089.stdout:6/378: dread d0/d4/d12/f20 [0,4194304] 0 2024-09-13T22:08:41.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/89: symlink d0/d7/l1d 0 2024-09-13T22:08:41.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/90: write d0/d7/f14 [470251,71690] 0 2024-09-13T22:08:41.971 INFO:tasks.workunit.client.1.smithi159.stdout:3/49: creat d0/d1/d3/dd/f10 x:0 0 0 2024-09-13T22:08:41.971 INFO:tasks.workunit.client.0.smithi089.stdout:2/404: read df/f26 [3913020,128002] 0 2024-09-13T22:08:41.971 INFO:tasks.workunit.client.0.smithi089.stdout:2/405: chown df/d14/d2b/d4b/l67 4171 1 2024-09-13T22:08:41.973 INFO:tasks.workunit.client.1.smithi159.stdout:0/91: dread d0/d7/f9 [0,4194304] 0 2024-09-13T22:08:41.974 INFO:tasks.workunit.client.0.smithi089.stdout:0/581: link d1/de/d10/d36/d3d/l6a d1/de/d1f/lcb 0 2024-09-13T22:08:41.974 INFO:tasks.workunit.client.0.smithi089.stdout:0/582: write d1/de/d10/d36/d57/f78 [2451529,2093] 0 2024-09-13T22:08:41.974 INFO:tasks.workunit.client.0.smithi089.stdout:0/583: readlink d1/de/d10/d36/d38/d4e/d62/d5f/l8c 0 2024-09-13T22:08:41.977 INFO:tasks.workunit.client.1.smithi159.stdout:0/92: creat d0/d7/f1e x:0 0 0 2024-09-13T22:08:41.977 INFO:tasks.workunit.client.1.smithi159.stdout:0/93: dread - d0/d7/f1e zero size 2024-09-13T22:08:41.977 INFO:tasks.workunit.client.1.smithi159.stdout:0/94: chown d0/f10 18990 1 2024-09-13T22:08:41.978 INFO:tasks.workunit.client.1.smithi159.stdout:0/95: truncate d0/d7/f1e 571558 0 2024-09-13T22:08:41.979 INFO:tasks.workunit.client.0.smithi089.stdout:7/374: creat d0/d19/f75 x:0 0 0 2024-09-13T22:08:41.980 INFO:tasks.workunit.client.0.smithi089.stdout:2/406: dread df/f74 [0,4194304] 0 2024-09-13T22:08:41.980 INFO:tasks.workunit.client.0.smithi089.stdout:2/407: chown df/d14/c72 18197 1 2024-09-13T22:08:41.980 INFO:tasks.workunit.client.0.smithi089.stdout:2/408: chown df/d14/d2b/l3e 3 1 2024-09-13T22:08:41.981 INFO:tasks.workunit.client.0.smithi089.stdout:2/409: chown cd 0 1 2024-09-13T22:08:41.981 INFO:tasks.workunit.client.1.smithi159.stdout:0/96: rename d0/c17 to d0/d15/c1f 0 2024-09-13T22:08:41.981 INFO:tasks.workunit.client.1.smithi159.stdout:0/97: chown d0/d7/lc 834 1 2024-09-13T22:08:41.983 INFO:tasks.workunit.client.0.smithi089.stdout:3/418: unlink d1/d2/d31/f3f 0 2024-09-13T22:08:41.984 INFO:tasks.workunit.client.1.smithi159.stdout:0/98: rename d0/d7/ca to d0/d7/c20 0 2024-09-13T22:08:41.985 INFO:tasks.workunit.client.1.smithi159.stdout:3/50: dwrite d0/d1/d3/dd/f10 [0,4194304] 0 2024-09-13T22:08:41.985 INFO:tasks.workunit.client.1.smithi159.stdout:3/51: dread - d0/d1/d3/d5/fe zero size 2024-09-13T22:08:41.986 INFO:tasks.workunit.client.0.smithi089.stdout:0/584: rename d1/de/d10/d85/cc2 to d1/de/d10/d36/d38/d4e/d62/ccc 0 2024-09-13T22:08:41.988 INFO:tasks.workunit.client.0.smithi089.stdout:7/375: creat d0/d19/d28/d1d/f76 x:0 0 0 2024-09-13T22:08:41.988 INFO:tasks.workunit.client.0.smithi089.stdout:7/376: chown d0/d19/d45/f51 142005 1 2024-09-13T22:08:41.988 INFO:tasks.workunit.client.1.smithi159.stdout:0/99: rmdir d0/d15 39 2024-09-13T22:08:41.990 INFO:tasks.workunit.client.0.smithi089.stdout:2/410: link df/d14/d2b/c58 df/d14/d2b/d4b/c87 0 2024-09-13T22:08:41.991 INFO:tasks.workunit.client.0.smithi089.stdout:6/379: rmdir d0/d5/d1d/d54 39 2024-09-13T22:08:41.997 INFO:tasks.workunit.client.0.smithi089.stdout:3/419: creat d1/d2/f82 x:0 0 0 2024-09-13T22:08:41.997 INFO:tasks.workunit.client.0.smithi089.stdout:3/420: fsync d1/d2/d4/f9 0 2024-09-13T22:08:41.997 INFO:tasks.workunit.client.1.smithi159.stdout:3/52: write d0/d1/f2 [2042775,1300] 0 2024-09-13T22:08:41.998 INFO:tasks.workunit.client.0.smithi089.stdout:2/411: dread df/d14/d2b/f33 [0,4194304] 0 2024-09-13T22:08:41.999 INFO:tasks.workunit.client.0.smithi089.stdout:7/377: mknod d0/d19/d28/d1d/d3d/c77 0 2024-09-13T22:08:41.999 INFO:tasks.workunit.client.0.smithi089.stdout:7/378: truncate d0/d19/d45/d38/f71 405498 0 2024-09-13T22:08:42.000 INFO:tasks.workunit.client.0.smithi089.stdout:3/421: mkdir d1/d2/d4/d1c/d7e/d83 0 2024-09-13T22:08:42.000 INFO:tasks.workunit.client.0.smithi089.stdout:3/422: fsync d1/d2/d31/f6e 0 2024-09-13T22:08:42.000 INFO:tasks.workunit.client.0.smithi089.stdout:3/423: write d1/d7/d1b/d28/d63/f6d [7688568,5715] 0 2024-09-13T22:08:42.001 INFO:tasks.workunit.client.0.smithi089.stdout:3/424: chown d1/d2/d31/l57 124 1 2024-09-13T22:08:42.001 INFO:tasks.workunit.client.0.smithi089.stdout:2/412: unlink df/d14/d2b/l35 0 2024-09-13T22:08:42.001 INFO:tasks.workunit.client.0.smithi089.stdout:2/413: truncate df/d14/d66/d69/d2e/f7f 116146 0 2024-09-13T22:08:42.001 INFO:tasks.workunit.client.0.smithi089.stdout:2/414: chown df/d1a/d57/l64 1034406365 1 2024-09-13T22:08:42.006 INFO:tasks.workunit.client.0.smithi089.stdout:3/425: creat d1/f84 x:0 0 0 2024-09-13T22:08:42.009 INFO:tasks.workunit.client.0.smithi089.stdout:3/426: symlink d1/d2/d23/d3d/d46/l85 0 2024-09-13T22:08:42.009 INFO:tasks.workunit.client.0.smithi089.stdout:3/427: stat d1/d7/l56 0 2024-09-13T22:08:42.009 INFO:tasks.workunit.client.0.smithi089.stdout:3/428: fsync d1/d2/d23/d3d/d46/f67 0 2024-09-13T22:08:42.010 INFO:tasks.workunit.client.0.smithi089.stdout:3/429: truncate d1/d2/d4/d1c/d7e/d38/f53 4844442 0 2024-09-13T22:08:42.012 INFO:tasks.workunit.client.1.smithi159.stdout:3/53: dread d0/d1/d3/dd/f10 [0,4194304] 0 2024-09-13T22:08:42.012 INFO:tasks.workunit.client.1.smithi159.stdout:3/54: chown d0/d1/d3 637 1 2024-09-13T22:08:42.012 INFO:tasks.workunit.client.1.smithi159.stdout:3/55: dread - d0/d1/d3/d5/fe zero size 2024-09-13T22:08:42.013 INFO:tasks.workunit.client.1.smithi159.stdout:3/56: readlink - no filename 2024-09-13T22:08:42.019 INFO:tasks.workunit.client.0.smithi089.stdout:8/432: sync 2024-09-13T22:08:42.019 INFO:tasks.workunit.client.0.smithi089.stdout:5/375: sync 2024-09-13T22:08:42.019 INFO:tasks.workunit.client.0.smithi089.stdout:1/479: sync 2024-09-13T22:08:42.019 INFO:tasks.workunit.client.0.smithi089.stdout:5/376: fdatasync d4/d19/d1e/d28/d3d/f3f 0 2024-09-13T22:08:42.019 INFO:tasks.workunit.client.0.smithi089.stdout:5/377: chown d4/d19/f79 0 1 2024-09-13T22:08:42.019 INFO:tasks.workunit.client.0.smithi089.stdout:4/420: sync 2024-09-13T22:08:42.020 INFO:tasks.workunit.client.1.smithi159.stdout:3/57: rmdir d0/d1/d9 0 2024-09-13T22:08:42.020 INFO:tasks.workunit.client.0.smithi089.stdout:7/379: write d0/d19/d28/d1d/d23/f35 [2539950,41585] 0 2024-09-13T22:08:42.020 INFO:tasks.workunit.client.0.smithi089.stdout:0/585: dwrite d1/de/d10/f1b [0,4194304] 0 2024-09-13T22:08:42.021 INFO:tasks.workunit.client.0.smithi089.stdout:7/380: write d0/d19/d28/d1d/d23/f35 [2007108,126936] 0 2024-09-13T22:08:42.021 INFO:tasks.workunit.client.0.smithi089.stdout:0/586: write d1/de/d15/f89 [114417,71750] 0 2024-09-13T22:08:42.021 INFO:tasks.workunit.client.0.smithi089.stdout:7/381: readlink d0/d19/d28/d1d/d23/d2e/d41/l4b 0 2024-09-13T22:08:42.022 INFO:tasks.workunit.client.0.smithi089.stdout:1/480: mkdir d7/de/d1b/d2b/da7 0 2024-09-13T22:08:42.022 INFO:tasks.workunit.client.0.smithi089.stdout:1/481: write d7/d34/d5c/f78 [763672,110136] 0 2024-09-13T22:08:42.023 INFO:tasks.workunit.client.0.smithi089.stdout:5/378: creat d4/d19/d1e/d28/d31/d61/f8d x:0 0 0 2024-09-13T22:08:42.025 INFO:tasks.workunit.client.0.smithi089.stdout:4/421: link d0/d2c/l33 d0/d15/l86 0 2024-09-13T22:08:42.027 INFO:tasks.workunit.client.0.smithi089.stdout:7/382: rename d0/d19/d28/d1d/d23/d2e/d41/l4b to d0/d19/l78 0 2024-09-13T22:08:42.027 INFO:tasks.workunit.client.0.smithi089.stdout:1/482: getdents d7/d34 0 2024-09-13T22:08:42.028 INFO:tasks.workunit.client.0.smithi089.stdout:5/379: chown d4/d19/l4b 14310 1 2024-09-13T22:08:42.029 INFO:tasks.workunit.client.0.smithi089.stdout:4/422: truncate d0/d2c/d35/f4c 1549138 0 2024-09-13T22:08:42.029 INFO:tasks.workunit.client.0.smithi089.stdout:4/423: fdatasync d0/d2c/d52/f54 0 2024-09-13T22:08:42.032 INFO:tasks.workunit.client.0.smithi089.stdout:0/587: write d1/de/d15/d41/d49/d76/f8e [1317723,20165] 0 2024-09-13T22:08:42.032 INFO:tasks.workunit.client.0.smithi089.stdout:0/588: chown d1/de/d10 10734027 1 2024-09-13T22:08:42.032 INFO:tasks.workunit.client.0.smithi089.stdout:0/589: fdatasync d1/de/f3e 0 2024-09-13T22:08:42.032 INFO:tasks.workunit.client.0.smithi089.stdout:4/424: rename d0/d2c/d52/f54 to d0/d2c/d35/f87 0 2024-09-13T22:08:42.033 INFO:tasks.workunit.client.0.smithi089.stdout:4/425: creat d0/d2c/d35/d74/f88 x:0 0 0 2024-09-13T22:08:42.033 INFO:tasks.workunit.client.0.smithi089.stdout:4/426: write d0/d2c/d52/f73 [125924,49372] 0 2024-09-13T22:08:42.033 INFO:tasks.workunit.client.0.smithi089.stdout:4/427: fsync d0/d2c/d35/f51 0 2024-09-13T22:08:42.035 INFO:tasks.workunit.client.0.smithi089.stdout:0/590: creat d1/de/d10/d85/fcd x:0 0 0 2024-09-13T22:08:42.036 INFO:tasks.workunit.client.0.smithi089.stdout:0/591: write d1/de/d10/d36/d3d/faf [18967,26397] 0 2024-09-13T22:08:42.036 INFO:tasks.workunit.client.0.smithi089.stdout:0/592: chown d1/de/d15/d41/d49/d76/d8b 2763 1 2024-09-13T22:08:42.036 INFO:tasks.workunit.client.0.smithi089.stdout:8/433: dread d0/dd/d12/d20/d1c/f2f [0,4194304] 0 2024-09-13T22:08:42.036 INFO:tasks.workunit.client.0.smithi089.stdout:8/434: getdents d0/dd/d12/d20/d36/d80/d3b/d88 0 2024-09-13T22:08:42.039 INFO:tasks.workunit.client.0.smithi089.stdout:2/415: dwrite df/d14/d66/d69/f80 [0,4194304] 0 2024-09-13T22:08:42.039 INFO:tasks.workunit.client.0.smithi089.stdout:2/416: fsync df/d14/d2b/f59 0 2024-09-13T22:08:42.039 INFO:tasks.workunit.client.0.smithi089.stdout:3/430: dwrite d1/f84 [0,4194304] 0 2024-09-13T22:08:42.040 INFO:tasks.workunit.client.1.smithi159.stdout:0/100: dwrite d0/d7/f14 [0,4194304] 0 2024-09-13T22:08:42.040 INFO:tasks.workunit.client.1.smithi159.stdout:0/101: chown d0/d15 5339625 1 2024-09-13T22:08:42.040 INFO:tasks.workunit.client.1.smithi159.stdout:0/102: chown d0/f16 15 1 2024-09-13T22:08:42.040 INFO:tasks.workunit.client.1.smithi159.stdout:0/103: chown d0/d7 469368 1 2024-09-13T22:08:42.041 INFO:tasks.workunit.client.0.smithi089.stdout:8/435: dread d0/dd/d12/d20/d36/d59/d89/f25 [0,4194304] 0 2024-09-13T22:08:42.044 INFO:tasks.workunit.client.0.smithi089.stdout:2/417: mkdir df/d14/d48/d88 0 2024-09-13T22:08:42.046 INFO:tasks.workunit.client.1.smithi159.stdout:0/104: symlink d0/l21 0 2024-09-13T22:08:42.058 INFO:tasks.workunit.client.0.smithi089.stdout:3/431: rename d1/d2/d23/d2b/f5b to d1/d2/d4/d1c/d7f/f86 0 2024-09-13T22:08:42.058 INFO:tasks.workunit.client.1.smithi159.stdout:0/105: write d0/d15/fd [3277120,88264] 0 2024-09-13T22:08:42.061 INFO:tasks.workunit.client.0.smithi089.stdout:3/432: mknod d1/d2/d43/c87 0 2024-09-13T22:08:42.062 INFO:tasks.workunit.client.0.smithi089.stdout:2/418: rmdir df/d14/d2b 39 2024-09-13T22:08:42.063 INFO:tasks.workunit.client.0.smithi089.stdout:2/419: mknod df/d14/d66/d69/d2e/c89 0 2024-09-13T22:08:42.064 INFO:tasks.workunit.client.0.smithi089.stdout:1/483: dwrite d7/de/d1b/d2b/d39/d73/f86 [0,4194304] 0 2024-09-13T22:08:42.064 INFO:tasks.workunit.client.0.smithi089.stdout:8/436: dread d0/dd/d12/d42/f39 [0,4194304] 0 2024-09-13T22:08:42.064 INFO:tasks.workunit.client.0.smithi089.stdout:3/433: rmdir d1/d7 39 2024-09-13T22:08:42.065 INFO:tasks.workunit.client.0.smithi089.stdout:3/434: dread - d1/d2/d31/f6e zero size 2024-09-13T22:08:42.065 INFO:tasks.workunit.client.0.smithi089.stdout:2/420: mkdir df/d14/d66/d8a 0 2024-09-13T22:08:42.067 INFO:tasks.workunit.client.0.smithi089.stdout:1/484: creat d7/d34/d5c/d74/fa8 x:0 0 0 2024-09-13T22:08:42.067 INFO:tasks.workunit.client.0.smithi089.stdout:1/485: write d7/de/d68/f6f [8857327,17661] 0 2024-09-13T22:08:42.068 INFO:tasks.workunit.client.0.smithi089.stdout:3/435: link d1/d2/d23/d3d/d46/l85 d1/d2/d23/d3d/d54/l88 0 2024-09-13T22:08:42.070 INFO:tasks.workunit.client.0.smithi089.stdout:1/486: mkdir d7/de/d1b/d2b/d39/d73/da9 0 2024-09-13T22:08:42.070 INFO:tasks.workunit.client.0.smithi089.stdout:1/487: fdatasync d7/de/d68/f9d 0 2024-09-13T22:08:42.071 INFO:tasks.workunit.client.0.smithi089.stdout:8/437: symlink d0/dd/d12/d20/d36/d59/d89/l91 0 2024-09-13T22:08:42.071 INFO:tasks.workunit.client.0.smithi089.stdout:5/380: fsync d4/d19/d1e/d28/d31/d61/f8d 0 2024-09-13T22:08:42.073 INFO:tasks.workunit.client.0.smithi089.stdout:4/428: dwrite d0/d2c/d35/f4f [0,4194304] 0 2024-09-13T22:08:42.074 INFO:tasks.workunit.client.0.smithi089.stdout:4/429: fsync d0/f3e 0 2024-09-13T22:08:42.074 INFO:tasks.workunit.client.0.smithi089.stdout:8/438: creat d0/dd/d12/d20/d36/d59/f92 x:0 0 0 2024-09-13T22:08:42.075 INFO:tasks.workunit.client.0.smithi089.stdout:2/421: dread df/d14/f24 [0,4194304] 0 2024-09-13T22:08:42.075 INFO:tasks.workunit.client.0.smithi089.stdout:0/593: dwrite d1/de/d10/f45 [0,4194304] 0 2024-09-13T22:08:42.075 INFO:tasks.workunit.client.0.smithi089.stdout:0/594: fsync d1/de/d10/d36/f66 0 2024-09-13T22:08:42.075 INFO:tasks.workunit.client.0.smithi089.stdout:5/381: creat d4/d19/d1e/d89/f8e x:0 0 0 2024-09-13T22:08:42.075 INFO:tasks.workunit.client.0.smithi089.stdout:7/383: dwrite d0/d19/d28/d1d/d2d/d3c/f4e [0,4194304] 0 2024-09-13T22:08:42.075 INFO:tasks.workunit.client.0.smithi089.stdout:7/384: chown d0/d19/d28/f44 2432 1 2024-09-13T22:08:42.075 INFO:tasks.workunit.client.0.smithi089.stdout:7/385: fsync d0/d19/d28/d1d/d23/d24/f42 0 2024-09-13T22:08:42.076 INFO:tasks.workunit.client.1.smithi159.stdout:3/58: dwrite d0/d1/f2 [0,4194304] 0 2024-09-13T22:08:42.078 INFO:tasks.workunit.client.0.smithi089.stdout:1/488: link d7/f25 d7/d34/faa 0 2024-09-13T22:08:42.078 INFO:tasks.workunit.client.0.smithi089.stdout:1/489: fdatasync d7/d40/f79 0 2024-09-13T22:08:42.078 INFO:tasks.workunit.client.0.smithi089.stdout:1/490: fsync d7/d1c/d3c/f8a 0 2024-09-13T22:08:42.081 INFO:tasks.workunit.client.0.smithi089.stdout:2/422: dread df/f26 [0,4194304] 0 2024-09-13T22:08:42.082 INFO:tasks.workunit.client.0.smithi089.stdout:4/430: mkdir d0/d11/d16/d89 0 2024-09-13T22:08:42.082 INFO:tasks.workunit.client.0.smithi089.stdout:4/431: write d0/f23 [2641452,18769] 0 2024-09-13T22:08:42.082 INFO:tasks.workunit.client.0.smithi089.stdout:4/432: dread - d0/d2c/d35/d64/f6f zero size 2024-09-13T22:08:42.083 INFO:tasks.workunit.client.0.smithi089.stdout:4/433: creat d0/d2c/d35/d5d/f8a x:0 0 0 2024-09-13T22:08:42.084 INFO:tasks.workunit.client.0.smithi089.stdout:8/439: mknod d0/dd/d12/c93 0 2024-09-13T22:08:42.084 INFO:tasks.workunit.client.0.smithi089.stdout:8/440: stat d0/dd/d12/d20/f2e 0 2024-09-13T22:08:42.087 INFO:tasks.workunit.client.0.smithi089.stdout:0/595: unlink d1/de/d10/d36/d39/f47 0 2024-09-13T22:08:42.087 INFO:tasks.workunit.client.0.smithi089.stdout:0/596: chown d1/de/d15/d41/d49/d76/d8b 59 1 2024-09-13T22:08:42.087 INFO:tasks.workunit.client.1.smithi159.stdout:0/106: dwrite d0/d15/fb [0,4194304] 0 2024-09-13T22:08:42.089 INFO:tasks.workunit.client.0.smithi089.stdout:5/382: creat d4/d19/d1e/d28/d31/d55/d58/d84/f8f x:0 0 0 2024-09-13T22:08:42.089 INFO:tasks.workunit.client.0.smithi089.stdout:5/383: read - d4/f54 zero size 2024-09-13T22:08:42.089 INFO:tasks.workunit.client.0.smithi089.stdout:5/384: creat d4/d19/d1e/d28/d31/d61/f90 x:0 0 0 2024-09-13T22:08:42.089 INFO:tasks.workunit.client.0.smithi089.stdout:5/385: chown d4/d19/d1e/d28/d31/d61/f6b 0 1 2024-09-13T22:08:42.091 INFO:tasks.workunit.client.1.smithi159.stdout:0/107: rename d0/d15 to d0/d7/d22 0 2024-09-13T22:08:42.091 INFO:tasks.workunit.client.1.smithi159.stdout:0/108: write d0/d7/d22/fd [511994,71908] 0 2024-09-13T22:08:42.093 INFO:tasks.workunit.client.0.smithi089.stdout:4/434: write d0/d2c/f45 [1242153,83962] 0 2024-09-13T22:08:42.093 INFO:tasks.workunit.client.0.smithi089.stdout:7/386: getdents d0/d19/d28/d1d/d23 0 2024-09-13T22:08:42.094 INFO:tasks.workunit.client.0.smithi089.stdout:2/423: truncate df/d14/d66/d69/f44 1274246 0 2024-09-13T22:08:42.095 INFO:tasks.workunit.client.1.smithi159.stdout:0/109: dread d0/d7/f9 [0,4194304] 0 2024-09-13T22:08:42.095 INFO:tasks.workunit.client.1.smithi159.stdout:0/110: chown d0/f10 278080 1 2024-09-13T22:08:42.095 INFO:tasks.workunit.client.1.smithi159.stdout:0/111: chown d0/d7/f9 183862 1 2024-09-13T22:08:42.097 INFO:tasks.workunit.client.0.smithi089.stdout:1/491: dwrite d7/d40/f71 [0,4194304] 0 2024-09-13T22:08:42.098 INFO:tasks.workunit.client.0.smithi089.stdout:1/492: fsync d7/de/d1b/d2b/d59/f67 0 2024-09-13T22:08:42.098 INFO:tasks.workunit.client.0.smithi089.stdout:8/441: rmdir d0/dd/d12/d20/d40 39 2024-09-13T22:08:42.098 INFO:tasks.workunit.client.0.smithi089.stdout:8/442: chown d0/dd/d12/d20/d36/d80/d70/f7e 581622 1 2024-09-13T22:08:42.098 INFO:tasks.workunit.client.1.smithi159.stdout:0/112: symlink d0/d7/l23 0 2024-09-13T22:08:42.099 INFO:tasks.workunit.client.0.smithi089.stdout:0/597: mknod d1/de/d10/d36/d38/d4e/d62/d5b/d5e/cce 0 2024-09-13T22:08:42.100 INFO:tasks.workunit.client.1.smithi159.stdout:0/113: symlink d0/l24 0 2024-09-13T22:08:42.105 INFO:tasks.workunit.client.0.smithi089.stdout:7/387: creat d0/d19/d28/d1d/d2d/d55/f79 x:0 0 0 2024-09-13T22:08:42.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.103+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffb20107840 con 0x7ffb200feaa0 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.104+0000 7ffb1cff9640 1 -- 172.21.15.89:0/2474435855 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7ffb1007bc40 con 0x7ffb200feaa0 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:08:42.106 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 13, 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:08:42.107 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:08:42.108 INFO:tasks.workunit.client.0.smithi089.stdout:1/493: truncate d7/de/d1b/d2b/f2e 1453586 0 2024-09-13T22:08:42.109 INFO:tasks.workunit.client.1.smithi159.stdout:0/114: creat d0/d7/d22/f25 x:0 0 0 2024-09-13T22:08:42.109 INFO:tasks.workunit.client.1.smithi159.stdout:0/115: readlink d0/l21 0 2024-09-13T22:08:42.109 INFO:tasks.workunit.client.1.smithi159.stdout:0/116: chown d0/f16 75035 1 2024-09-13T22:08:42.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffb0806d760 msgr2=0x7ffb0806fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:42.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffb0806d760 0x7ffb0806fc20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffb14005fd0 tx=0x7ffb14005850 comp rx=0 tx=0).stop 2024-09-13T22:08:42.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 msgr2=0x7ffb20102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:42.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 0x7ffb20102a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffb1002a9c0 tx=0x7ffb100054f0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 shutdown_connections 2024-09-13T22:08:42.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7ffb0806d760 0x7ffb0806fc20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb200ffca0 0x7ffb20101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 --2- 172.21.15.89:0/2474435855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb200feaa0 0x7ffb20102a30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 >> 172.21.15.89:0/2474435855 conn(0x7ffb200fa250 msgr2=0x7ffb200684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:42.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 shutdown_connections 2024-09-13T22:08:42.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.107+0000 7ffb25d31640 1 -- 172.21.15.89:0/2474435855 wait complete. 2024-09-13T22:08:42.112 INFO:tasks.workunit.client.0.smithi089.stdout:8/443: unlink d0/dd/ff 0 2024-09-13T22:08:42.112 INFO:tasks.workunit.client.0.smithi089.stdout:8/444: chown d0/dd/d12/d20/d36/f21 0 1 2024-09-13T22:08:42.112 INFO:tasks.workunit.client.0.smithi089.stdout:8/445: creat d0/dd/d12/d3a/f94 x:0 0 0 2024-09-13T22:08:42.112 INFO:tasks.workunit.client.0.smithi089.stdout:7/388: rename d0/d19/d28/d1d/d2d/d3c/f4e to d0/f7a 0 2024-09-13T22:08:42.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/424: rmdir df/d1a/d57 39 2024-09-13T22:08:42.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/425: creat df/d14/d66/f8b x:0 0 0 2024-09-13T22:08:42.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/426: read - df/d14/d66/f7e zero size 2024-09-13T22:08:42.116 INFO:tasks.workunit.client.0.smithi089.stdout:7/389: write d0/d19/d28/d1d/d23/d24/f72 [707674,90776] 0 2024-09-13T22:08:42.117 INFO:tasks.workunit.client.0.smithi089.stdout:4/435: dwrite d0/d2c/d35/d5d/f69 [0,4194304] 0 2024-09-13T22:08:42.117 INFO:tasks.workunit.client.0.smithi089.stdout:2/427: rename cd to df/d14/d66/d8a/c8c 0 2024-09-13T22:08:42.118 INFO:tasks.workunit.client.0.smithi089.stdout:2/428: dread - df/d14/d66/f70 zero size 2024-09-13T22:08:42.118 INFO:tasks.workunit.client.0.smithi089.stdout:2/429: chown df/d5b/c6d 195488112 1 2024-09-13T22:08:42.118 INFO:tasks.workunit.client.0.smithi089.stdout:5/386: dwrite d4/d19/d1e/d89/d8a/f78 [4194304,4194304] 0 2024-09-13T22:08:42.119 INFO:tasks.workunit.client.0.smithi089.stdout:2/430: dread df/d14/d66/d69/d2e/f7f [0,4194304] 0 2024-09-13T22:08:42.120 INFO:tasks.workunit.client.0.smithi089.stdout:7/390: unlink d0/d19/l27 0 2024-09-13T22:08:42.123 INFO:tasks.workunit.client.1.smithi159.stdout:3/59: truncate d0/d1/f2 307799 0 2024-09-13T22:08:42.125 INFO:tasks.workunit.client.0.smithi089.stdout:4/436: mknod d0/d2c/d35/d64/d6e/c8b 0 2024-09-13T22:08:42.126 INFO:tasks.workunit.client.1.smithi159.stdout:3/60: symlink d0/d1/d3/d5/l11 0 2024-09-13T22:08:42.126 INFO:tasks.workunit.client.1.smithi159.stdout:3/61: write d0/d1/d3/d5/fe [831277,51980] 0 2024-09-13T22:08:42.128 INFO:tasks.workunit.client.0.smithi089.stdout:2/431: creat df/f8d x:0 0 0 2024-09-13T22:08:42.129 INFO:tasks.workunit.client.1.smithi159.stdout:3/62: mknod d0/d1/d3/c12 0 2024-09-13T22:08:42.130 INFO:tasks.workunit.client.0.smithi089.stdout:7/391: mkdir d0/d19/d28/d7b 0 2024-09-13T22:08:42.131 INFO:tasks.workunit.client.0.smithi089.stdout:4/437: mkdir d0/d11/d16/d24/d62/d8c 0 2024-09-13T22:08:42.133 INFO:tasks.workunit.client.0.smithi089.stdout:9/470: sync 2024-09-13T22:08:42.133 INFO:tasks.workunit.client.1.smithi159.stdout:3/63: rmdir d0/d1 39 2024-09-13T22:08:42.133 INFO:tasks.workunit.client.1.smithi159.stdout:3/64: creat d0/d1/d3/dd/f13 x:0 0 0 2024-09-13T22:08:42.134 INFO:tasks.workunit.client.1.smithi159.stdout:0/117: dwrite d0/d7/d22/fb [0,4194304] 0 2024-09-13T22:08:42.135 INFO:tasks.workunit.client.0.smithi089.stdout:2/432: creat df/d76/d85/f8e x:0 0 0 2024-09-13T22:08:42.135 INFO:tasks.workunit.client.0.smithi089.stdout:2/433: chown df/d14/d2b/d61/l54 79650 1 2024-09-13T22:08:42.136 INFO:tasks.workunit.client.0.smithi089.stdout:7/392: creat d0/d19/d28/d1d/d2d/d55/d63/f7c x:0 0 0 2024-09-13T22:08:42.137 INFO:tasks.workunit.client.0.smithi089.stdout:8/446: dwrite d0/dd/d12/d20/d36/d80/d3b/f6b [0,4194304] 0 2024-09-13T22:08:42.137 INFO:tasks.workunit.client.0.smithi089.stdout:1/494: dwrite d7/d34/d5c/f78 [0,4194304] 0 2024-09-13T22:08:42.139 INFO:tasks.workunit.client.0.smithi089.stdout:4/438: mkdir d0/d2c/d8d 0 2024-09-13T22:08:42.139 INFO:tasks.workunit.client.0.smithi089.stdout:4/439: chown d0/d11/d16/f26 0 1 2024-09-13T22:08:42.139 INFO:tasks.workunit.client.0.smithi089.stdout:4/440: truncate d0/d11/f55 626284 0 2024-09-13T22:08:42.140 INFO:tasks.workunit.client.0.smithi089.stdout:4/441: fdatasync d0/d2c/d35/f4f 0 2024-09-13T22:08:42.140 INFO:tasks.workunit.client.1.smithi159.stdout:3/65: mkdir d0/d1/d3/d5/d14 0 2024-09-13T22:08:42.142 INFO:tasks.workunit.client.0.smithi089.stdout:9/471: rmdir d6/d55/d9a 39 2024-09-13T22:08:42.142 INFO:tasks.workunit.client.0.smithi089.stdout:9/472: write d6/f14 [1040780,118466] 0 2024-09-13T22:08:42.142 INFO:tasks.workunit.client.0.smithi089.stdout:9/473: creat d6/d31/d64/fa3 x:0 0 0 2024-09-13T22:08:42.142 INFO:tasks.workunit.client.0.smithi089.stdout:9/474: creat d6/d54/fa4 x:0 0 0 2024-09-13T22:08:42.143 INFO:tasks.workunit.client.1.smithi159.stdout:0/118: creat d0/f26 x:0 0 0 2024-09-13T22:08:42.147 INFO:tasks.workunit.client.0.smithi089.stdout:7/393: creat d0/d19/d28/d1d/d23/d24/d5d/f7d x:0 0 0 2024-09-13T22:08:42.149 INFO:tasks.workunit.client.0.smithi089.stdout:1/495: dread d7/de/d1b/d2b/d39/f4c [0,4194304] 0 2024-09-13T22:08:42.149 INFO:tasks.workunit.client.0.smithi089.stdout:5/387: dwrite d4/d19/f48 [0,4194304] 0 2024-09-13T22:08:42.151 INFO:tasks.workunit.client.0.smithi089.stdout:8/447: rename d0/dd/d12/d20/d36/d80/d3b/f55 to d0/dd/d12/d20/d36/f95 0 2024-09-13T22:08:42.152 INFO:tasks.workunit.client.0.smithi089.stdout:4/442: mkdir d0/d11/d16/d24/d8e 0 2024-09-13T22:08:42.153 INFO:tasks.workunit.client.0.smithi089.stdout:4/443: stat d0/d11/d16/d24/l2a 0 2024-09-13T22:08:42.155 INFO:tasks.workunit.client.1.smithi159.stdout:0/119: dread d0/d7/f14 [0,4194304] 0 2024-09-13T22:08:42.155 INFO:tasks.workunit.client.1.smithi159.stdout:0/120: creat d0/d7/f27 x:0 0 0 2024-09-13T22:08:42.155 INFO:tasks.workunit.client.1.smithi159.stdout:0/121: dread - d0/f10 zero size 2024-09-13T22:08:42.155 INFO:tasks.workunit.client.0.smithi089.stdout:7/394: dread d0/f1e [0,4194304] 0 2024-09-13T22:08:42.156 INFO:tasks.workunit.client.0.smithi089.stdout:1/496: creat d7/de/d1b/d2b/d39/d73/da9/fab x:0 0 0 2024-09-13T22:08:42.159 INFO:tasks.workunit.client.1.smithi159.stdout:0/122: rename d0/d7/d22/l4 to d0/d7/d22/l28 0 2024-09-13T22:08:42.161 INFO:tasks.workunit.client.0.smithi089.stdout:5/388: truncate d4/ff 1689879 0 2024-09-13T22:08:42.164 INFO:tasks.workunit.client.1.smithi159.stdout:0/123: link d0/d7/lc d0/l29 0 2024-09-13T22:08:42.164 INFO:tasks.workunit.client.1.smithi159.stdout:0/124: chown d0/d7/f19 119461046 1 2024-09-13T22:08:42.165 INFO:tasks.workunit.client.0.smithi089.stdout:8/448: getdents d0/dd/d12/d20/d36/d80/d70 0 2024-09-13T22:08:42.165 INFO:tasks.workunit.client.0.smithi089.stdout:9/475: dwrite d6/d18/d21/f83 [0,4194304] 0 2024-09-13T22:08:42.166 INFO:tasks.workunit.client.0.smithi089.stdout:4/444: symlink d0/d15/d83/l8f 0 2024-09-13T22:08:42.167 INFO:tasks.workunit.client.0.smithi089.stdout:2/434: dwrite df/f12 [0,4194304] 0 2024-09-13T22:08:42.167 INFO:tasks.workunit.client.0.smithi089.stdout:1/497: write d7/d40/f71 [1273718,123619] 0 2024-09-13T22:08:42.167 INFO:tasks.workunit.client.1.smithi159.stdout:0/125: link d0/l24 d0/d7/l2a 0 2024-09-13T22:08:42.168 INFO:tasks.workunit.client.0.smithi089.stdout:7/395: link d0/d19/d45/d38/d54/f60 d0/d19/d28/d1d/d23/d2e/d41/f7e 0 2024-09-13T22:08:42.169 INFO:tasks.workunit.client.0.smithi089.stdout:5/389: symlink d4/d19/d1e/d89/d8a/l91 0 2024-09-13T22:08:42.170 INFO:tasks.workunit.client.1.smithi159.stdout:0/126: mkdir d0/d7/d22/d2b 0 2024-09-13T22:08:42.173 INFO:tasks.workunit.client.1.smithi159.stdout:3/66: fsync d0/d1/d3/dd/f13 0 2024-09-13T22:08:42.175 INFO:tasks.workunit.client.0.smithi089.stdout:8/449: truncate d0/dd/d12/d20/d36/d59/d89/f25 596271 0 2024-09-13T22:08:42.177 INFO:tasks.workunit.client.0.smithi089.stdout:7/396: write d0/f7a [2985398,83933] 0 2024-09-13T22:08:42.177 INFO:tasks.workunit.client.1.smithi159.stdout:3/67: mkdir d0/d1/d15 0 2024-09-13T22:08:42.178 INFO:tasks.workunit.client.1.smithi159.stdout:3/68: chown d0/d1/d3/d5/d14 3 1 2024-09-13T22:08:42.178 INFO:tasks.workunit.client.0.smithi089.stdout:5/390: write d4/d19/d1e/d89/d8a/f78 [8371927,130337] 0 2024-09-13T22:08:42.181 INFO:tasks.workunit.client.0.smithi089.stdout:9/476: rename d6/d18/d33/l40 to d6/d18/d33/d52/la5 0 2024-09-13T22:08:42.182 INFO:tasks.workunit.client.0.smithi089.stdout:4/445: mknod d0/d2c/d35/d64/c90 0 2024-09-13T22:08:42.183 INFO:tasks.workunit.client.0.smithi089.stdout:4/446: truncate d0/d2c/d52/f73 360254 0 2024-09-13T22:08:42.184 INFO:tasks.workunit.client.0.smithi089.stdout:8/450: dread d0/dd/d12/d20/d1c/d5a/d63/f66 [0,4194304] 0 2024-09-13T22:08:42.185 INFO:tasks.workunit.client.0.smithi089.stdout:7/397: write d0/d19/d28/d1d/d2d/d3c/f37 [739464,110434] 0 2024-09-13T22:08:42.187 INFO:tasks.workunit.client.0.smithi089.stdout:2/435: creat df/d1a/d57/f8f x:0 0 0 2024-09-13T22:08:42.187 INFO:tasks.workunit.client.0.smithi089.stdout:1/498: creat d7/de/d1b/d2b/d59/fac x:0 0 0 2024-09-13T22:08:42.187 INFO:tasks.workunit.client.0.smithi089.stdout:1/499: chown d7/d34/d5c/f88 5110614 1 2024-09-13T22:08:42.188 INFO:tasks.workunit.client.0.smithi089.stdout:5/391: creat d4/d19/d1e/d28/d31/d61/d69/f92 x:0 0 0 2024-09-13T22:08:42.189 INFO:tasks.workunit.client.0.smithi089.stdout:5/392: readlink d4/d19/d1e/d28/l5c 0 2024-09-13T22:08:42.189 INFO:tasks.workunit.client.0.smithi089.stdout:9/477: symlink d6/d18/d1b/da0/la6 0 2024-09-13T22:08:42.192 INFO:tasks.workunit.client.1.smithi159.stdout:0/127: dwrite d0/d7/f9 [0,4194304] 0 2024-09-13T22:08:42.192 INFO:tasks.workunit.client.1.smithi159.stdout:0/128: write d0/f26 [369474,40575] 0 2024-09-13T22:08:42.193 INFO:tasks.workunit.client.1.smithi159.stdout:3/69: dwrite d0/d1/d3/dd/f13 [0,4194304] 0 2024-09-13T22:08:42.194 INFO:tasks.workunit.client.1.smithi159.stdout:3/70: chown d0 47926 1 2024-09-13T22:08:42.194 INFO:tasks.workunit.client.0.smithi089.stdout:1/500: readlink d7/l29 0 2024-09-13T22:08:42.197 INFO:tasks.workunit.client.1.smithi159.stdout:0/129: mkdir d0/d2c 0 2024-09-13T22:08:42.199 INFO:tasks.workunit.client.0.smithi089.stdout:5/393: rename d4/d19/d1e/c80 to d4/d19/d1e/d89/c93 0 2024-09-13T22:08:42.205 INFO:tasks.workunit.client.1.smithi159.stdout:0/130: stat d0/d7/c20 0 2024-09-13T22:08:42.206 INFO:tasks.workunit.client.1.smithi159.stdout:0/131: truncate d0/d7/f1a 602504 0 2024-09-13T22:08:42.206 INFO:tasks.workunit.client.1.smithi159.stdout:0/132: chown d0/d7/l1d 34155299 1 2024-09-13T22:08:42.209 INFO:tasks.workunit.client.0.smithi089.stdout:5/394: mkdir d4/d19/d1e/d28/d31/d94 0 2024-09-13T22:08:42.210 INFO:tasks.workunit.client.0.smithi089.stdout:8/451: truncate d0/dd/d12/d20/d36/d80/d3b/f6b 667844 0 2024-09-13T22:08:42.213 INFO:tasks.workunit.client.0.smithi089.stdout:8/452: creat d0/dd/d12/d20/d36/d80/d3b/d88/f96 x:0 0 0 2024-09-13T22:08:42.213 INFO:tasks.workunit.client.0.smithi089.stdout:8/453: truncate d0/dd/d12/d20/d36/d80/d70/f7e 178263 0 2024-09-13T22:08:42.214 INFO:tasks.workunit.client.0.smithi089.stdout:8/454: creat d0/dd/d12/d20/d36/d80/f97 x:0 0 0 2024-09-13T22:08:42.215 INFO:tasks.workunit.client.0.smithi089.stdout:5/395: dread d4/d19/f56 [0,4194304] 0 2024-09-13T22:08:42.216 INFO:tasks.workunit.client.0.smithi089.stdout:5/396: chown d4/d19/d1e/c71 47209 1 2024-09-13T22:08:42.217 INFO:tasks.workunit.client.1.smithi159.stdout:0/133: dread d0/d7/f14 [0,4194304] 0 2024-09-13T22:08:42.218 INFO:tasks.workunit.client.0.smithi089.stdout:5/397: unlink d4/d19/l4b 0 2024-09-13T22:08:42.219 INFO:tasks.workunit.client.1.smithi159.stdout:0/134: truncate d0/f8 233237 0 2024-09-13T22:08:42.220 INFO:tasks.workunit.client.1.smithi159.stdout:0/135: symlink d0/d2c/l2d 0 2024-09-13T22:08:42.220 INFO:tasks.workunit.client.0.smithi089.stdout:2/436: rmdir df/d1a/d57 39 2024-09-13T22:08:42.220 INFO:tasks.workunit.client.0.smithi089.stdout:2/437: write df/d14/f25 [397903,79549] 0 2024-09-13T22:08:42.221 INFO:tasks.workunit.client.1.smithi159.stdout:0/136: mknod d0/c2e 0 2024-09-13T22:08:42.224 INFO:tasks.workunit.client.0.smithi089.stdout:2/438: rmdir df/d76 39 2024-09-13T22:08:42.226 INFO:tasks.workunit.client.0.smithi089.stdout:6/380: sync 2024-09-13T22:08:42.227 INFO:tasks.workunit.client.0.smithi089.stdout:6/381: mkdir d0/d5/d43/d79 0 2024-09-13T22:08:42.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.226+0000 7fc0b131f640 1 -- 172.21.15.89:0/1752898732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fe4d0 msgr2=0x7fc0ac0fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:42.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.226+0000 7fc0b131f640 1 --2- 172.21.15.89:0/1752898732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fe4d0 0x7fc0ac0fe8d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009880 tx=0x7fc09c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.226+0000 7fc0b131f640 1 -- 172.21.15.89:0/1752898732 shutdown_connections 2024-09-13T22:08:42.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.226+0000 7fc0b131f640 1 --2- 172.21.15.89:0/1752898732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0ac0fee10 0x7fc0ac0ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.226+0000 7fc0b131f640 1 --2- 172.21.15.89:0/1752898732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fe4d0 0x7fc0ac0fe8d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.226+0000 7fc0b131f640 1 -- 172.21.15.89:0/1752898732 >> 172.21.15.89:0/1752898732 conn(0x7fc0ac0fa280 msgr2=0x7fc0ac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:42.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.226+0000 7fc0b131f640 1 -- 172.21.15.89:0/1752898732 shutdown_connections 2024-09-13T22:08:42.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.226+0000 7fc0b131f640 1 -- 172.21.15.89:0/1752898732 wait complete. 2024-09-13T22:08:42.229 INFO:tasks.workunit.client.0.smithi089.stdout:6/382: truncate d0/d4/d12/d15/f32 495109 0 2024-09-13T22:08:42.229 INFO:tasks.workunit.client.0.smithi089.stdout:7/398: dwrite d0/d19/d28/d1d/d23/f56 [0,4194304] 0 2024-09-13T22:08:42.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.226+0000 7fc0b131f640 1 Processor -- start 2024-09-13T22:08:42.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0b131f640 1 -- start start 2024-09-13T22:08:42.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0b131f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0ac0fe4d0 0x7fc0ac197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:42.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0b131f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fee10 0x7fc0ac197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:42.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0b131f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac198350 con 0x7fc0ac0fee10 2024-09-13T22:08:42.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0b131f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac1984c0 con 0x7fc0ac0fe4d0 2024-09-13T22:08:42.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0aa7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fee10 0x7fc0ac197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:42.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0aa7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fee10 0x7fc0ac197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56708/0 (socket says 172.21.15.89:56708) 2024-09-13T22:08:42.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0aa7fc640 1 -- 172.21.15.89:0/3118560869 learned_addr learned my addr 172.21.15.89:0/3118560869 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:08:42.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0aaffd640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0ac0fe4d0 0x7fc0ac197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:42.231 INFO:tasks.workunit.client.0.smithi089.stdout:6/383: rmdir d0/d5/d1d/d56 39 2024-09-13T22:08:42.231 INFO:tasks.workunit.client.0.smithi089.stdout:6/384: chown d0/d4 6 1 2024-09-13T22:08:42.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0aa7fc640 1 -- 172.21.15.89:0/3118560869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0ac0fe4d0 msgr2=0x7fc0ac197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:42.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0aa7fc640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0ac0fe4d0 0x7fc0ac197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.227+0000 7fc0aa7fc640 1 -- 172.21.15.89:0/3118560869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009560 con 0x7fc0ac0fee10 2024-09-13T22:08:42.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.228+0000 7fc0aa7fc640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fee10 0x7fc0ac197d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000e9a0 tx=0x7fc0a000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:42.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.228+0000 7fc093fff640 1 -- 172.21.15.89:0/3118560869 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a000cc90 con 0x7fc0ac0fee10 2024-09-13T22:08:42.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.228+0000 7fc093fff640 1 -- 172.21.15.89:0/3118560869 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0a000cdf0 con 0x7fc0ac0fee10 2024-09-13T22:08:42.233 INFO:tasks.workunit.client.0.smithi089.stdout:7/399: creat d0/d19/d28/d1d/d23/f7f x:0 0 0 2024-09-13T22:08:42.233 INFO:tasks.workunit.client.0.smithi089.stdout:7/400: chown d0/d19/d28/d1d/d3d/d69 0 1 2024-09-13T22:08:42.233 INFO:tasks.workunit.client.0.smithi089.stdout:7/401: dread - d0/d19/d28/d1d/d2d/d55/f79 zero size 2024-09-13T22:08:42.234 INFO:tasks.workunit.client.0.smithi089.stdout:7/402: truncate d0/d19/d28/d1d/d23/d2e/d41/f6f 804146 0 2024-09-13T22:08:42.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.229+0000 7fc093fff640 1 -- 172.21.15.89:0/3118560869 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a00187f0 con 0x7fc0ac0fee10 2024-09-13T22:08:42.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.229+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ac19cf60 con 0x7fc0ac0fee10 2024-09-13T22:08:42.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.229+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac19d420 con 0x7fc0ac0fee10 2024-09-13T22:08:42.235 INFO:tasks.workunit.client.0.smithi089.stdout:6/385: mkdir d0/d5/d1d/d56/d4b/d7a 0 2024-09-13T22:08:42.235 INFO:tasks.workunit.client.0.smithi089.stdout:4/447: dwrite d0/d2c/f45 [0,4194304] 0 2024-09-13T22:08:42.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.231+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ac0fe8d0 con 0x7fc0ac0fee10 2024-09-13T22:08:42.235 INFO:tasks.workunit.client.0.smithi089.stdout:2/439: dread df/d1a/f42 [0,4194304] 0 2024-09-13T22:08:42.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.232+0000 7fc093fff640 1 -- 172.21.15.89:0/3118560869 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 20) v1 ==== 91631+0+0 (secure 0 0 0) 0x7fc0a0010c10 con 0x7fc0ac0fee10 2024-09-13T22:08:42.236 INFO:tasks.workunit.client.0.smithi089.stdout:1/501: dwrite d7/d40/f75 [0,4194304] 0 2024-09-13T22:08:42.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.232+0000 7fc093fff640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc09406d770 0x7fc09406fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:08:42.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.232+0000 7fc093fff640 1 -- 172.21.15.89:0/3118560869 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc0a0014070 con 0x7fc0ac0fee10 2024-09-13T22:08:42.236 INFO:tasks.workunit.client.0.smithi089.stdout:9/478: dwrite d6/d18/f32 [0,4194304] 0 2024-09-13T22:08:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.232+0000 7fc0aaffd640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc09406d770 0x7fc09406fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:08:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.233+0000 7fc0aaffd640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc09406d770 0x7fc09406fc30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000c00 tx=0x7fc09c0314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:08:42.237 INFO:tasks.workunit.client.0.smithi089.stdout:4/448: mknod d0/d15/d83/c91 0 2024-09-13T22:08:42.237 INFO:tasks.workunit.client.0.smithi089.stdout:2/440: creat df/d76/d85/f90 x:0 0 0 2024-09-13T22:08:42.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.237+0000 7fc093fff640 1 -- 172.21.15.89:0/3118560869 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc0a0052e20 con 0x7fc0ac0fee10 2024-09-13T22:08:42.243 INFO:tasks.workunit.client.0.smithi089.stdout:1/502: mkdir d7/d1c/d7a/dad 0 2024-09-13T22:08:42.243 INFO:tasks.workunit.client.0.smithi089.stdout:4/449: write d0/d2c/d35/d64/f82 [1876085,12499] 0 2024-09-13T22:08:42.250 INFO:tasks.workunit.client.1.smithi159.stdout:0/137: getdents d0/d2c 0 2024-09-13T22:08:42.251 INFO:tasks.workunit.client.1.smithi159.stdout:0/138: dread - d0/d7/d22/f25 zero size 2024-09-13T22:08:42.253 INFO:tasks.workunit.client.1.smithi159.stdout:0/139: creat d0/d7/d22/d2b/f2f x:0 0 0 2024-09-13T22:08:42.255 INFO:tasks.workunit.client.1.smithi159.stdout:0/140: mknod d0/d2c/c30 0 2024-09-13T22:08:42.258 INFO:tasks.workunit.client.0.smithi089.stdout:2/441: creat df/d14/d48/d88/f91 x:0 0 0 2024-09-13T22:08:42.258 INFO:tasks.workunit.client.0.smithi089.stdout:2/442: creat df/f92 x:0 0 0 2024-09-13T22:08:42.258 INFO:tasks.workunit.client.0.smithi089.stdout:1/503: dread d7/d40/f79 [0,4194304] 0 2024-09-13T22:08:42.258 INFO:tasks.workunit.client.0.smithi089.stdout:1/504: read d7/f43 [3564650,61827] 0 2024-09-13T22:08:42.259 INFO:tasks.workunit.client.1.smithi159.stdout:0/141: symlink d0/d2c/l31 0 2024-09-13T22:08:42.261 INFO:tasks.workunit.client.0.smithi089.stdout:2/443: rmdir df/d5b/d79 0 2024-09-13T22:08:42.262 INFO:tasks.workunit.client.0.smithi089.stdout:4/450: dread d0/d11/d16/f26 [0,4194304] 0 2024-09-13T22:08:42.262 INFO:tasks.workunit.client.1.smithi159.stdout:0/142: symlink d0/l32 0 2024-09-13T22:08:42.262 INFO:tasks.workunit.client.1.smithi159.stdout:0/143: chown d0/d7/d22/f25 166300427 1 2024-09-13T22:08:42.262 INFO:tasks.workunit.client.1.smithi159.stdout:0/144: fdatasync d0/d7/f19 0 2024-09-13T22:08:42.263 INFO:tasks.workunit.client.0.smithi089.stdout:1/505: symlink d7/de/d1b/d2b/d39/d73/da9/lae 0 2024-09-13T22:08:42.263 INFO:tasks.workunit.client.0.smithi089.stdout:1/506: truncate d7/d1c/d3c/f8a 844742 0 2024-09-13T22:08:42.264 INFO:tasks.workunit.client.0.smithi089.stdout:9/479: dwrite d6/d18/f1d [0,4194304] 0 2024-09-13T22:08:42.265 INFO:tasks.workunit.client.1.smithi159.stdout:0/145: unlink d0/d7/d22/l11 0 2024-09-13T22:08:42.265 INFO:tasks.workunit.client.0.smithi089.stdout:6/386: dwrite d0/f3e [0,4194304] 0 2024-09-13T22:08:42.266 INFO:tasks.workunit.client.0.smithi089.stdout:6/387: creat d0/d4/d12/f7b x:0 0 0 2024-09-13T22:08:42.266 INFO:tasks.workunit.client.0.smithi089.stdout:6/388: truncate d0/d5/d1d/d2d/f6d 864476 0 2024-09-13T22:08:42.266 INFO:tasks.workunit.client.0.smithi089.stdout:6/389: chown d0/d5/d1d/l5a 45 1 2024-09-13T22:08:42.266 INFO:tasks.workunit.client.0.smithi089.stdout:7/403: dwrite d0/d19/d45/d38/f3a [0,4194304] 0 2024-09-13T22:08:42.266 INFO:tasks.workunit.client.0.smithi089.stdout:7/404: chown d0/d19/d45/d38/d54/l58 87248921 1 2024-09-13T22:08:42.266 INFO:tasks.workunit.client.0.smithi089.stdout:1/507: symlink d7/d34/d5c/d5d/laf 0 2024-09-13T22:08:42.268 INFO:tasks.workunit.client.1.smithi159.stdout:0/146: creat d0/d2c/f33 x:0 0 0 2024-09-13T22:08:42.269 INFO:tasks.workunit.client.0.smithi089.stdout:2/444: rmdir df/d14/d66/d69 39 2024-09-13T22:08:42.273 INFO:tasks.workunit.client.0.smithi089.stdout:9/480: symlink d6/d55/d9a/la7 0 2024-09-13T22:08:42.277 INFO:tasks.workunit.client.0.smithi089.stdout:7/405: write d0/d19/d28/f44 [3946170,61994] 0 2024-09-13T22:08:42.279 INFO:tasks.workunit.client.0.smithi089.stdout:6/390: creat d0/d5/d1d/d54/f7c x:0 0 0 2024-09-13T22:08:42.279 INFO:tasks.workunit.client.0.smithi089.stdout:6/391: stat d0/d5/f23 0 2024-09-13T22:08:42.279 INFO:tasks.workunit.client.0.smithi089.stdout:6/392: getdents d0/d5/d1d 0 2024-09-13T22:08:42.279 INFO:tasks.workunit.client.0.smithi089.stdout:6/393: read d0/d5/f4d [2928473,96294] 0 2024-09-13T22:08:42.279 INFO:tasks.workunit.client.1.smithi159.stdout:0/147: read d0/d7/f9 [70456,95736] 0 2024-09-13T22:08:42.281 INFO:tasks.workunit.client.0.smithi089.stdout:7/406: rename d0/f14 to d0/f80 0 2024-09-13T22:08:42.284 INFO:tasks.workunit.client.1.smithi159.stdout:0/148: mknod d0/d7/d22/d2b/c34 0 2024-09-13T22:08:42.284 INFO:tasks.workunit.client.0.smithi089.stdout:0/598: sync 2024-09-13T22:08:42.285 INFO:tasks.workunit.client.0.smithi089.stdout:3/436: sync 2024-09-13T22:08:42.287 INFO:tasks.workunit.client.0.smithi089.stdout:0/599: unlink d1/de/d10/d36/d57/l25 0 2024-09-13T22:08:42.295 INFO:tasks.workunit.client.0.smithi089.stdout:6/394: dread d0/d4/f40 [0,4194304] 0 2024-09-13T22:08:42.298 INFO:tasks.workunit.client.0.smithi089.stdout:6/395: unlink d0/cd 0 2024-09-13T22:08:42.298 INFO:tasks.workunit.client.0.smithi089.stdout:6/396: write d0/d5/d1d/d56/d4a/f58 [461346,112043] 0 2024-09-13T22:08:42.298 INFO:tasks.workunit.client.0.smithi089.stdout:1/508: dwrite d7/de/d3a/d77/f7c [0,4194304] 0 2024-09-13T22:08:42.298 INFO:tasks.workunit.client.0.smithi089.stdout:9/481: dwrite d6/d18/f36 [0,4194304] 0 2024-09-13T22:08:42.300 INFO:tasks.workunit.client.0.smithi089.stdout:9/482: rmdir d6/d18/d1b 39 2024-09-13T22:08:42.300 INFO:tasks.workunit.client.0.smithi089.stdout:9/483: chown d6/d55/d9a/f50 1 1 2024-09-13T22:08:42.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/600: dwrite d1/de/d15/f8d [4194304,4194304] 0 2024-09-13T22:08:42.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/601: creat d1/de/d15/d41/d87/fcf x:0 0 0 2024-09-13T22:08:42.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/602: truncate d1/de/d10/d36/d57/f78 4323112 0 2024-09-13T22:08:42.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/603: readlink d1/de/d15/la7 0 2024-09-13T22:08:42.316 INFO:tasks.workunit.client.0.smithi089.stdout:3/437: dwrite d1/d2/d24/f3b [4194304,4194304] 0 2024-09-13T22:08:42.317 INFO:tasks.workunit.client.0.smithi089.stdout:3/438: readlink d1/d2/d23/d2b/l55 0 2024-09-13T22:08:42.317 INFO:tasks.workunit.client.0.smithi089.stdout:3/439: creat d1/d2/d24/f89 x:0 0 0 2024-09-13T22:08:42.317 INFO:tasks.workunit.client.0.smithi089.stdout:7/407: dread d0/d19/d28/f44 [0,4194304] 0 2024-09-13T22:08:42.318 INFO:tasks.workunit.client.0.smithi089.stdout:0/604: symlink d1/de/d15/d41/d49/d76/d8b/ld0 0 2024-09-13T22:08:42.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/605: write d1/de/d10/d36/d38/d4e/d62/d5f/d72/f93 [4452405,43442] 0 2024-09-13T22:08:42.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/606: truncate d1/de/d15/d41/d49/d76/f99 617169 0 2024-09-13T22:08:42.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/607: stat d1/de/d10/cae 0 2024-09-13T22:08:42.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/608: readlink d1/de/d1f/lb8 0 2024-09-13T22:08:42.320 INFO:tasks.workunit.client.0.smithi089.stdout:0/609: symlink d1/de/d10/d36/ld1 0 2024-09-13T22:08:42.320 INFO:tasks.workunit.client.0.smithi089.stdout:0/610: mkdir d1/de/d10/d36/d39/dd2 0 2024-09-13T22:08:42.322 INFO:tasks.workunit.client.0.smithi089.stdout:0/611: symlink d1/de/d15/d41/d49/db5/ld3 0 2024-09-13T22:08:42.322 INFO:tasks.workunit.client.0.smithi089.stdout:0/612: write d1/de/d10/d36/d39/f94 [220070,47745] 0 2024-09-13T22:08:42.325 INFO:tasks.workunit.client.0.smithi089.stdout:0/613: symlink d1/de/d15/d2a/ld4 0 2024-09-13T22:08:42.325 INFO:tasks.workunit.client.0.smithi089.stdout:0/614: creat d1/de/d15/fd5 x:0 0 0 2024-09-13T22:08:42.326 INFO:tasks.workunit.client.0.smithi089.stdout:6/397: getdents d0 0 2024-09-13T22:08:42.326 INFO:tasks.workunit.client.0.smithi089.stdout:6/398: creat d0/d5/d1d/d56/d4a/f7d x:0 0 0 2024-09-13T22:08:42.328 INFO:tasks.workunit.client.0.smithi089.stdout:0/615: unlink d1/de/d10/d36/d57/d3a/ca6 0 2024-09-13T22:08:42.329 INFO:tasks.workunit.client.0.smithi089.stdout:6/399: truncate d0/d4/d12/d15/f32 451626 0 2024-09-13T22:08:42.330 INFO:tasks.workunit.client.0.smithi089.stdout:1/509: dwrite d7/de/d3a/fa6 [0,4194304] 0 2024-09-13T22:08:42.330 INFO:tasks.workunit.client.0.smithi089.stdout:7/408: write d0/d19/d28/d1d/d23/d24/f42 [1203153,95615] 0 2024-09-13T22:08:42.331 INFO:tasks.workunit.client.0.smithi089.stdout:1/510: chown d7/f26 241211 1 2024-09-13T22:08:42.333 INFO:tasks.workunit.client.0.smithi089.stdout:7/409: mknod d0/d19/c81 0 2024-09-13T22:08:42.333 INFO:tasks.workunit.client.0.smithi089.stdout:7/410: write d0/f3f [1018644,84296] 0 2024-09-13T22:08:42.334 INFO:tasks.workunit.client.0.smithi089.stdout:0/616: symlink d1/de/d15/d41/ld6 0 2024-09-13T22:08:42.335 INFO:tasks.workunit.client.0.smithi089.stdout:7/411: mknod d0/d19/d28/d1d/c82 0 2024-09-13T22:08:42.335 INFO:tasks.workunit.client.0.smithi089.stdout:7/412: chown d0/d19/d28/d1d/f5f 0 1 2024-09-13T22:08:42.336 INFO:tasks.workunit.client.0.smithi089.stdout:7/413: chown d0/d19/d45/d38/f39 298 1 2024-09-13T22:08:42.336 INFO:tasks.workunit.client.0.smithi089.stdout:7/414: read d0/d19/d45/d38/f39 [3153134,95212] 0 2024-09-13T22:08:42.336 INFO:tasks.workunit.client.0.smithi089.stdout:0/617: read d1/f11 [3271083,103112] 0 2024-09-13T22:08:42.336 INFO:tasks.workunit.client.0.smithi089.stdout:0/618: dread - d1/de/d10/d36/fca zero size 2024-09-13T22:08:42.336 INFO:tasks.workunit.client.0.smithi089.stdout:0/619: read d1/de/d10/d36/d39/f94 [116110,91884] 0 2024-09-13T22:08:42.336 INFO:tasks.workunit.client.0.smithi089.stdout:7/415: getdents d0/d19/d28/d1d/d3d 0 2024-09-13T22:08:42.337 INFO:tasks.workunit.client.0.smithi089.stdout:0/620: rename d1/de/d10/d36/d38/d4e/d62/fbc to d1/de/d1f/fd7 0 2024-09-13T22:08:42.337 INFO:tasks.workunit.client.0.smithi089.stdout:7/416: dread d0/d19/d45/d38/d54/f60 [0,4194304] 0 2024-09-13T22:08:42.338 INFO:tasks.workunit.client.0.smithi089.stdout:3/440: dwrite d1/d2/d4/d1c/d7e/d40/d50/f72 [0,4194304] 0 2024-09-13T22:08:42.338 INFO:tasks.workunit.client.0.smithi089.stdout:9/484: dwrite f0 [4194304,4194304] 0 2024-09-13T22:08:42.339 INFO:tasks.workunit.client.0.smithi089.stdout:7/417: symlink d0/d19/d28/d7b/l83 0 2024-09-13T22:08:42.339 INFO:tasks.workunit.client.0.smithi089.stdout:7/418: stat d0/f80 0 2024-09-13T22:08:42.341 INFO:tasks.workunit.client.0.smithi089.stdout:0/621: dread d1/de/d15/d41/d49/f92 [0,4194304] 0 2024-09-13T22:08:42.342 INFO:tasks.workunit.client.0.smithi089.stdout:3/441: rmdir d1/d2/d43 39 2024-09-13T22:08:42.342 INFO:tasks.workunit.client.0.smithi089.stdout:3/442: dread - d1/d2/d31/f6e zero size 2024-09-13T22:08:42.343 INFO:tasks.workunit.client.0.smithi089.stdout:1/511: dread d7/de/ff [0,4194304] 0 2024-09-13T22:08:42.345 INFO:tasks.workunit.client.0.smithi089.stdout:1/512: getdents d7/de/d1b/d2b/d39 0 2024-09-13T22:08:42.351 INFO:tasks.workunit.client.0.smithi089.stdout:6/400: dwrite d0/f2e [0,4194304] 0 2024-09-13T22:08:42.356 INFO:tasks.workunit.client.0.smithi089.stdout:6/401: creat d0/d5/d1d/d56/d60/f7e x:0 0 0 2024-09-13T22:08:42.359 INFO:tasks.workunit.client.0.smithi089.stdout:6/402: mknod d0/d5/d1d/d56/d60/c7f 0 2024-09-13T22:08:42.359 INFO:tasks.workunit.client.0.smithi089.stdout:6/403: fdatasync d0/d4/d12/f7b 0 2024-09-13T22:08:42.362 INFO:tasks.workunit.client.0.smithi089.stdout:6/404: creat d0/d4/d12/d15/d3b/d62/f80 x:0 0 0 2024-09-13T22:08:42.363 INFO:tasks.workunit.client.0.smithi089.stdout:7/419: write d0/d19/d28/d1d/d23/d2e/d41/f65 [2561720,115958] 0 2024-09-13T22:08:42.363 INFO:tasks.workunit.client.0.smithi089.stdout:7/420: fdatasync d0/d19/d28/d1d/d23/f7f 0 2024-09-13T22:08:42.363 INFO:tasks.workunit.client.0.smithi089.stdout:3/443: dread d1/d2/d4/d1c/d7e/d40/d50/f72 [0,4194304] 0 2024-09-13T22:08:42.365 INFO:tasks.workunit.client.0.smithi089.stdout:7/421: rmdir d0/d19/d28/d1d/d23/d2e/d41 39 2024-09-13T22:08:42.366 INFO:tasks.workunit.client.0.smithi089.stdout:3/444: creat d1/d2/d4/d1c/d7e/d40/d50/f8a x:0 0 0 2024-09-13T22:08:42.366 INFO:tasks.workunit.client.0.smithi089.stdout:3/445: fdatasync d1/d2/d4/d1c/d7e/d40/d50/f72 0 2024-09-13T22:08:42.366 INFO:tasks.workunit.client.0.smithi089.stdout:3/446: dread - d1/d2/d24/f89 zero size 2024-09-13T22:08:42.377 INFO:tasks.workunit.client.0.smithi089.stdout:7/422: dread d0/d19/d45/d38/f3a [0,4194304] 0 2024-09-13T22:08:42.382 INFO:tasks.workunit.client.0.smithi089.stdout:9/485: dwrite d6/d18/d1b/f2e [0,4194304] 0 2024-09-13T22:08:42.382 INFO:tasks.workunit.client.0.smithi089.stdout:9/486: creat d6/d18/d33/d5a/fa8 x:0 0 0 2024-09-13T22:08:42.382 INFO:tasks.workunit.client.0.smithi089.stdout:9/487: write d6/fc [1642513,22810] 0 2024-09-13T22:08:42.385 INFO:tasks.workunit.client.0.smithi089.stdout:1/513: dwrite d7/d34/d5c/f88 [0,4194304] 0 2024-09-13T22:08:42.386 INFO:tasks.workunit.client.0.smithi089.stdout:6/405: dwrite d0/d5/d1d/d2d/f39 [0,4194304] 0 2024-09-13T22:08:42.386 INFO:tasks.workunit.client.0.smithi089.stdout:6/406: dread - d0/d5/f3d zero size 2024-09-13T22:08:42.386 INFO:tasks.workunit.client.0.smithi089.stdout:6/407: write d0/d4/d12/f4c [270403,109492] 0 2024-09-13T22:08:42.388 INFO:tasks.workunit.client.0.smithi089.stdout:1/514: truncate d7/de/d1b/d2b/f54 1119861 0 2024-09-13T22:08:42.388 INFO:tasks.workunit.client.0.smithi089.stdout:1/515: chown d7/de/d3a/f6e 55787 1 2024-09-13T22:08:42.388 INFO:tasks.workunit.client.0.smithi089.stdout:1/516: creat d7/d40/fb0 x:0 0 0 2024-09-13T22:08:42.388 INFO:tasks.workunit.client.0.smithi089.stdout:7/423: dread d0/d19/d28/d1d/d23/d24/d5d/f5e [0,4194304] 0 2024-09-13T22:08:42.388 INFO:tasks.workunit.client.0.smithi089.stdout:7/424: fdatasync d0/d19/d28/d1d/d30/f59 0 2024-09-13T22:08:42.389 INFO:tasks.workunit.client.0.smithi089.stdout:7/425: write d0/d19/d28/d1d/d23/d2e/d41/f7e [1004000,126946] 0 2024-09-13T22:08:42.400 INFO:tasks.workunit.client.0.smithi089.stdout:7/426: rename d0/d19/d28/d1d/d30/f59 to d0/d19/d28/d1d/d23/d2e/d41/f84 0 2024-09-13T22:08:42.400 INFO:tasks.workunit.client.0.smithi089.stdout:7/427: fdatasync d0/d19/d45/d38/f6a 0 2024-09-13T22:08:42.401 INFO:tasks.workunit.client.0.smithi089.stdout:7/428: readlink d0/l16 0 2024-09-13T22:08:42.401 INFO:tasks.workunit.client.0.smithi089.stdout:1/517: dread d7/d34/d5c/f88 [0,4194304] 0 2024-09-13T22:08:42.401 INFO:tasks.workunit.client.0.smithi089.stdout:7/429: symlink d0/d19/d28/d1d/d23/d24/d5d/l85 0 2024-09-13T22:08:42.401 INFO:tasks.workunit.client.0.smithi089.stdout:1/518: mknod d7/de/cb1 0 2024-09-13T22:08:42.402 INFO:tasks.workunit.client.0.smithi089.stdout:7/430: truncate d0/d19/d28/d1d/d23/d2e/d41/f84 202125 0 2024-09-13T22:08:42.403 INFO:tasks.workunit.client.0.smithi089.stdout:9/488: dwrite d6/d18/d33/f49 [0,4194304] 0 2024-09-13T22:08:42.403 INFO:tasks.workunit.client.0.smithi089.stdout:9/489: chown d6/d18/c4f 1 1 2024-09-13T22:08:42.405 INFO:tasks.workunit.client.0.smithi089.stdout:6/408: dwrite d0/d5/d1d/d54/f7c [0,4194304] 0 2024-09-13T22:08:42.408 INFO:tasks.workunit.client.0.smithi089.stdout:9/490: rename d6/d18/d33/d52/l7c to d6/d18/d1b/d89/la9 0 2024-09-13T22:08:42.430 INFO:tasks.workunit.client.0.smithi089.stdout:8/455: sync 2024-09-13T22:08:42.430 INFO:tasks.workunit.client.0.smithi089.stdout:5/398: sync 2024-09-13T22:08:42.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.464+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 --> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0ac02c520 con 0x7fc09406d770 2024-09-13T22:08:42.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.465+0000 7fc093fff640 1 -- 172.21.15.89:0/3118560869 <== mgr.14209 v2:172.21.15.89:6800/3305276684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fc0ac02c520 con 0x7fc09406d770 2024-09-13T22:08:42.466 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:08:42.466 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:08:42.466 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:08:42.466 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:08:42.467 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T22:08:42.467 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "", 2024-09-13T22:08:42.467 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T22:08:42.467 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:08:42.467 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc09406d770 msgr2=0x7fc09406fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc09406d770 0x7fc09406fc30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000c00 tx=0x7fc09c0314e0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fee10 msgr2=0x7fc0ac197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fee10 0x7fc0ac197d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000e9a0 tx=0x7fc0a000ee60 comp rx=0 tx=0).stop 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 shutdown_connections 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:6800/3305276684,v1:172.21.15.89:6801/3305276684] conn(0x7fc09406d770 0x7fc09406fc30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ac0fee10 0x7fc0ac197d80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 --2- 172.21.15.89:0/3118560869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0ac0fe4d0 0x7fc0ac197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 >> 172.21.15.89:0/3118560869 conn(0x7fc0ac0fa280 msgr2=0x7fc0ac107010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 shutdown_connections 2024-09-13T22:08:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:08:42.467+0000 7fc0b131f640 1 -- 172.21.15.89:0/3118560869 wait complete. 2024-09-13T22:08:42.476 INFO:tasks.workunit.client.0.smithi089.stdout:1/519: rmdir d7/de 39 2024-09-13T22:08:42.477 INFO:tasks.workunit.client.0.smithi089.stdout:6/409: mknod d0/d5/d64/c81 0 2024-09-13T22:08:42.478 INFO:tasks.workunit.client.0.smithi089.stdout:6/410: dread d0/d5/d1d/f33 [0,4194304] 0 2024-09-13T22:08:42.479 INFO:tasks.workunit.client.0.smithi089.stdout:6/411: readlink d0/d4/d12/l30 0 2024-09-13T22:08:42.482 INFO:tasks.workunit.client.0.smithi089.stdout:5/399: rename d4/f29 to d4/f95 0 2024-09-13T22:08:42.482 INFO:tasks.workunit.client.0.smithi089.stdout:5/400: dread - d4/d19/d1e/d28/d31/d55/d58/f5f zero size 2024-09-13T22:08:42.483 INFO:tasks.workunit.client.0.smithi089.stdout:8/456: link d0/dd/d12/d20/d1c/d5a/c7c d0/dd/d12/d20/d36/d80/d3b/d88/c98 0 2024-09-13T22:08:42.486 INFO:tasks.workunit.client.0.smithi089.stdout:8/457: truncate d0/dd/d12/d20/d36/d80/d3b/f6b 124329 0 2024-09-13T22:08:42.488 INFO:tasks.workunit.client.0.smithi089.stdout:1/520: rename d7/de/d1b to d7/d34/db2 0 2024-09-13T22:08:42.488 INFO:tasks.workunit.client.0.smithi089.stdout:6/412: rmdir d0/d5/d1d/d56/d60 39 2024-09-13T22:08:42.488 INFO:tasks.workunit.client.0.smithi089.stdout:6/413: readlink d0/d4/d12/l25 0 2024-09-13T22:08:42.490 INFO:tasks.workunit.client.0.smithi089.stdout:8/458: truncate d0/dd/d12/d20/d36/d59/d89/f29 2382646 0 2024-09-13T22:08:42.490 INFO:tasks.workunit.client.0.smithi089.stdout:8/459: fdatasync d0/dd/d12/d20/d36/f58 0 2024-09-13T22:08:42.490 INFO:tasks.workunit.client.0.smithi089.stdout:1/521: chown d7/cc 7506 1 2024-09-13T22:08:42.492 INFO:tasks.workunit.client.0.smithi089.stdout:6/414: unlink d0/d4/d12/d15/f50 0 2024-09-13T22:08:42.493 INFO:tasks.workunit.client.0.smithi089.stdout:8/460: creat d0/dd/d12/d20/d36/d59/d89/d8d/f99 x:0 0 0 2024-09-13T22:08:42.495 INFO:tasks.workunit.client.0.smithi089.stdout:1/522: rename d7/d34/db2/d80/ca1 to d7/d34/db2/d2b/d39/d73/cb3 0 2024-09-13T22:08:42.495 INFO:tasks.workunit.client.0.smithi089.stdout:1/523: read - d7/d40/fb0 zero size 2024-09-13T22:08:42.497 INFO:tasks.workunit.client.0.smithi089.stdout:8/461: mknod d0/dd/d12/c9a 0 2024-09-13T22:08:42.497 INFO:tasks.workunit.client.0.smithi089.stdout:8/462: stat d0/dd/d12/d20/d36/d59 0 2024-09-13T22:08:42.498 INFO:tasks.workunit.client.0.smithi089.stdout:1/524: creat d7/de/da0/fb4 x:0 0 0 2024-09-13T22:08:42.500 INFO:tasks.workunit.client.0.smithi089.stdout:8/463: mknod d0/dd/d12/d3a/c9b 0 2024-09-13T22:08:42.500 INFO:tasks.workunit.client.0.smithi089.stdout:8/464: write d0/dd/d12/d42/f77 [423419,56988] 0 2024-09-13T22:08:42.501 INFO:tasks.workunit.client.0.smithi089.stdout:4/451: sync 2024-09-13T22:08:42.501 INFO:tasks.workunit.client.0.smithi089.stdout:2/445: sync 2024-09-13T22:08:42.501 INFO:tasks.workunit.client.0.smithi089.stdout:0/622: sync 2024-09-13T22:08:42.501 INFO:tasks.workunit.client.0.smithi089.stdout:3/447: sync 2024-09-13T22:08:42.501 INFO:tasks.workunit.client.0.smithi089.stdout:2/446: fdatasync df/f92 0 2024-09-13T22:08:42.501 INFO:tasks.workunit.client.0.smithi089.stdout:4/452: chown d0/d2c/f45 1216 1 2024-09-13T22:08:42.502 INFO:tasks.workunit.client.0.smithi089.stdout:3/448: write d1/d2/d24/f3b [3970452,107694] 0 2024-09-13T22:08:42.502 INFO:tasks.workunit.client.0.smithi089.stdout:8/465: mknod d0/dd/d12/d20/d36/d59/d5d/c9c 0 2024-09-13T22:08:42.502 INFO:tasks.workunit.client.0.smithi089.stdout:8/466: chown d0/dd/d12/d20/f18 1631077 1 2024-09-13T22:08:42.504 INFO:tasks.workunit.client.0.smithi089.stdout:4/453: mknod d0/d11/d16/d24/d62/d8c/c92 0 2024-09-13T22:08:42.504 INFO:tasks.workunit.client.0.smithi089.stdout:4/454: creat d0/d2c/d35/d64/f93 x:0 0 0 2024-09-13T22:08:42.510 INFO:tasks.workunit.client.0.smithi089.stdout:8/467: unlink d0/dd/d12/d42/c27 0 2024-09-13T22:08:42.510 INFO:tasks.workunit.client.0.smithi089.stdout:0/623: symlink d1/de/ld8 0 2024-09-13T22:08:42.510 INFO:tasks.workunit.client.0.smithi089.stdout:2/447: getdents df/d14/d66 0 2024-09-13T22:08:42.510 INFO:tasks.workunit.client.0.smithi089.stdout:3/449: dread d1/d2/d4/f16 [4194304,4194304] 0 2024-09-13T22:08:42.510 INFO:tasks.workunit.client.0.smithi089.stdout:3/450: dread - d1/d2/d4/d1c/d7e/d40/d50/f8a zero size 2024-09-13T22:08:42.512 INFO:tasks.workunit.client.0.smithi089.stdout:8/468: creat d0/dd/d12/d20/d36/d68/f9d x:0 0 0 2024-09-13T22:08:42.514 INFO:tasks.workunit.client.0.smithi089.stdout:0/624: mkdir d1/de/d10/db0/dd9 0 2024-09-13T22:08:42.515 INFO:tasks.workunit.client.0.smithi089.stdout:6/415: dwrite d0/d5/d43/f53 [0,4194304] 0 2024-09-13T22:08:42.515 INFO:tasks.workunit.client.0.smithi089.stdout:2/448: mkdir df/d76/d93 0 2024-09-13T22:08:42.515 INFO:tasks.workunit.client.0.smithi089.stdout:3/451: getdents d1/d2/d23/d3d/d54/d5d 0 2024-09-13T22:08:42.518 INFO:tasks.workunit.client.0.smithi089.stdout:4/455: rmdir d0/d2c/d35/d64 39 2024-09-13T22:08:42.518 INFO:tasks.workunit.client.0.smithi089.stdout:0/625: truncate d1/f9e 114656 0 2024-09-13T22:08:42.520 INFO:tasks.workunit.client.0.smithi089.stdout:6/416: truncate d0/d5/d1d/d56/f2a 457827 0 2024-09-13T22:08:42.523 INFO:tasks.workunit.client.0.smithi089.stdout:2/449: rename c1 to df/d14/d66/d69/c94 0 2024-09-13T22:08:42.524 INFO:tasks.workunit.client.0.smithi089.stdout:3/452: creat d1/d2/d23/d3d/d46/f8b x:0 0 0 2024-09-13T22:08:42.524 INFO:tasks.workunit.client.0.smithi089.stdout:4/456: getdents d0/d11/d16/d24/d62/d8c 0 2024-09-13T22:08:42.526 INFO:tasks.workunit.client.0.smithi089.stdout:8/469: write d0/dd/d12/d20/d36/d57/f60 [2858417,85538] 0 2024-09-13T22:08:42.526 INFO:tasks.workunit.client.0.smithi089.stdout:8/470: creat d0/dd/d12/d20/d40/d4a/f9e x:0 0 0 2024-09-13T22:08:42.527 INFO:tasks.workunit.client.0.smithi089.stdout:4/457: creat d0/d2c/d8d/f94 x:0 0 0 2024-09-13T22:08:42.527 INFO:tasks.workunit.client.0.smithi089.stdout:4/458: chown d0/d15/d83/c91 427887355 1 2024-09-13T22:08:42.530 INFO:tasks.workunit.client.0.smithi089.stdout:6/417: read d0/f2e [1069196,126360] 0 2024-09-13T22:08:42.530 INFO:tasks.workunit.client.0.smithi089.stdout:6/418: readlink d0/d5/d1d/d2d/l68 0 2024-09-13T22:08:42.531 INFO:tasks.workunit.client.0.smithi089.stdout:6/419: link d0/d5/d1d/d2d/f57 d0/d5/d1d/f82 0 2024-09-13T22:08:42.539 INFO:tasks.workunit.client.0.smithi089.stdout:0/626: dwrite d1/de/d1f/fd7 [0,4194304] 0 2024-09-13T22:08:42.543 INFO:tasks.workunit.client.0.smithi089.stdout:6/420: dread d0/d4/f40 [0,4194304] 0 2024-09-13T22:08:42.550 INFO:tasks.workunit.client.0.smithi089.stdout:0/627: dread d1/de/f3e [0,4194304] 0 2024-09-13T22:08:42.551 INFO:tasks.workunit.client.0.smithi089.stdout:0/628: creat d1/de/fda x:0 0 0 2024-09-13T22:08:42.552 INFO:tasks.workunit.client.0.smithi089.stdout:0/629: rmdir d1/de/d10/d36/d57 39 2024-09-13T22:08:42.553 INFO:tasks.workunit.client.0.smithi089.stdout:0/630: read - d1/de/d10/d36/d38/d4e/d62/d5f/faa zero size 2024-09-13T22:08:42.553 INFO:tasks.workunit.client.0.smithi089.stdout:0/631: creat d1/de/d15/d41/d49/d76/d8b/fdb x:0 0 0 2024-09-13T22:08:42.554 INFO:tasks.workunit.client.0.smithi089.stdout:0/632: rename d1/de/d10/d36/d57/c23 to d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4/cdc 0 2024-09-13T22:08:42.555 INFO:tasks.workunit.client.0.smithi089.stdout:0/633: mkdir d1/de/d1f/ddd 0 2024-09-13T22:08:42.556 INFO:tasks.workunit.client.0.smithi089.stdout:0/634: unlink d1/de/d10/d36/d38/d4e/d62/d5b/d5e/l96 0 2024-09-13T22:08:42.562 INFO:tasks.workunit.client.0.smithi089.stdout:6/421: dread d0/f3e [0,4194304] 0 2024-09-13T22:08:42.564 INFO:tasks.workunit.client.0.smithi089.stdout:0/635: dread d1/de/d1f/fd7 [0,4194304] 0 2024-09-13T22:08:42.564 INFO:tasks.workunit.client.0.smithi089.stdout:6/422: rename d0/d4/d12/d15/l6a to d0/d5/d1d/d2d/d55/l83 0 2024-09-13T22:08:42.564 INFO:tasks.workunit.client.0.smithi089.stdout:8/471: dwrite d0/dd/d12/d20/d36/d80/f44 [4194304,4194304] 0 2024-09-13T22:08:42.564 INFO:tasks.workunit.client.0.smithi089.stdout:2/450: dwrite df/d1a/d57/f83 [0,4194304] 0 2024-09-13T22:08:42.564 INFO:tasks.workunit.client.0.smithi089.stdout:4/459: dwrite d0/d2c/f84 [0,4194304] 0 2024-09-13T22:08:42.565 INFO:tasks.workunit.client.0.smithi089.stdout:0/636: unlink d1/de/d10/d36/f66 0 2024-09-13T22:08:42.565 INFO:tasks.workunit.client.0.smithi089.stdout:0/637: write d1/de/d10/f1b [5133241,570] 0 2024-09-13T22:08:42.565 INFO:tasks.workunit.client.0.smithi089.stdout:0/638: creat d1/de/d15/d41/d49/d76/d8b/fde x:0 0 0 2024-09-13T22:08:42.572 INFO:tasks.workunit.client.0.smithi089.stdout:2/451: write f3 [5326390,125569] 0 2024-09-13T22:08:42.578 INFO:tasks.workunit.client.0.smithi089.stdout:4/460: creat d0/d11/d16/d89/f95 x:0 0 0 2024-09-13T22:08:42.578 INFO:tasks.workunit.client.0.smithi089.stdout:4/461: fsync d0/d2c/d35/d5d/f60 0 2024-09-13T22:08:42.583 INFO:tasks.workunit.client.0.smithi089.stdout:8/472: rename d0/dd/d12/d20/d36/d59/d89/l3e to d0/l9f 0 2024-09-13T22:08:42.586 INFO:tasks.workunit.client.0.smithi089.stdout:4/462: symlink d0/d2c/l96 0 2024-09-13T22:08:42.586 INFO:tasks.workunit.client.0.smithi089.stdout:4/463: fdatasync d0/d11/d16/f2d 0 2024-09-13T22:08:42.586 INFO:tasks.workunit.client.0.smithi089.stdout:4/464: chown d0/d2c/d35/d64/f82 6486742 1 2024-09-13T22:08:42.587 INFO:tasks.workunit.client.0.smithi089.stdout:4/465: mknod d0/d15/d83/c97 0 2024-09-13T22:08:42.587 INFO:tasks.workunit.client.0.smithi089.stdout:4/466: write d0/d2c/f41 [1404604,71390] 0 2024-09-13T22:08:42.587 INFO:tasks.workunit.client.0.smithi089.stdout:4/467: dread - d0/d11/d16/d89/f95 zero size 2024-09-13T22:08:42.587 INFO:tasks.workunit.client.0.smithi089.stdout:4/468: chown d0/d2c/l33 1429 1 2024-09-13T22:08:42.588 INFO:tasks.workunit.client.0.smithi089.stdout:4/469: link d0/l10 d0/d15/d76/l98 0 2024-09-13T22:08:42.588 INFO:tasks.workunit.client.0.smithi089.stdout:4/470: truncate d0/d11/d16/f80 558855 0 2024-09-13T22:08:42.589 INFO:tasks.workunit.client.0.smithi089.stdout:8/473: dread d0/dd/d12/d20/d36/d80/d3b/f6b [0,4194304] 0 2024-09-13T22:08:42.599 INFO:tasks.workunit.client.0.smithi089.stdout:0/639: dwrite d1/de/d10/d36/d38/d4e/d62/d5f/d72/f93 [0,4194304] 0 2024-09-13T22:08:42.601 INFO:tasks.workunit.client.0.smithi089.stdout:2/452: dwrite df/d76/d85/f8e [0,4194304] 0 2024-09-13T22:08:42.603 INFO:tasks.workunit.client.0.smithi089.stdout:4/471: dwrite d0/d2c/d35/d64/f82 [0,4194304] 0 2024-09-13T22:08:42.608 INFO:tasks.workunit.client.0.smithi089.stdout:2/453: symlink df/d1a/d57/d68/l95 0 2024-09-13T22:08:42.611 INFO:tasks.workunit.client.0.smithi089.stdout:2/454: link df/d14/d48/d88/f91 df/d14/d2b/d61/f96 0 2024-09-13T22:08:42.613 INFO:tasks.workunit.client.0.smithi089.stdout:2/455: mknod df/d5b/c97 0 2024-09-13T22:08:42.613 INFO:tasks.workunit.client.0.smithi089.stdout:2/456: readlink df/l27 0 2024-09-13T22:08:42.626 INFO:tasks.workunit.client.0.smithi089.stdout:0/640: dwrite d1/de/d15/d41/d49/d76/f8e [4194304,4194304] 0 2024-09-13T22:08:42.626 INFO:tasks.workunit.client.0.smithi089.stdout:0/641: creat d1/de/d10/d36/d38/d4e/fdf x:0 0 0 2024-09-13T22:08:42.626 INFO:tasks.workunit.client.0.smithi089.stdout:4/472: dwrite d0/d2c/d35/d64/f78 [4194304,4194304] 0 2024-09-13T22:08:42.630 INFO:tasks.workunit.client.0.smithi089.stdout:0/642: dread d1/de/d1f/f84 [0,4194304] 0 2024-09-13T22:08:42.630 INFO:tasks.workunit.client.0.smithi089.stdout:0/643: stat d1/de/d10/d36/d38/d4e/d62/d5b/f67 0 2024-09-13T22:08:42.630 INFO:tasks.workunit.client.0.smithi089.stdout:4/473: unlink d0/d11/d16/f26 0 2024-09-13T22:08:42.632 INFO:tasks.workunit.client.0.smithi089.stdout:0/644: mkdir d1/de/d15/d41/d87/dbf/de0 0 2024-09-13T22:08:42.632 INFO:tasks.workunit.client.0.smithi089.stdout:0/645: truncate d1/de/d10/d36/d38/d4e/d62/d5b/f63 940442 0 2024-09-13T22:08:42.632 INFO:tasks.workunit.client.0.smithi089.stdout:0/646: write d1/de/d10/d36/d3d/faf [385632,41354] 0 2024-09-13T22:08:42.633 INFO:tasks.workunit.client.0.smithi089.stdout:4/474: mknod d0/d11/c99 0 2024-09-13T22:08:42.634 INFO:tasks.workunit.client.0.smithi089.stdout:0/647: symlink d1/de/d10/d36/d38/d4e/d62/le1 0 2024-09-13T22:08:42.635 INFO:tasks.workunit.client.0.smithi089.stdout:7/431: sync 2024-09-13T22:08:42.635 INFO:tasks.workunit.client.0.smithi089.stdout:7/432: fdatasync d0/d19/d28/d1d/f2c 0 2024-09-13T22:08:42.636 INFO:tasks.workunit.client.0.smithi089.stdout:4/475: unlink d0/f6 0 2024-09-13T22:08:42.639 INFO:tasks.workunit.client.0.smithi089.stdout:0/648: link d1/de/f20 d1/de/fe2 0 2024-09-13T22:08:42.640 INFO:tasks.workunit.client.0.smithi089.stdout:0/649: mknod d1/de/d15/d2a/ce3 0 2024-09-13T22:08:42.640 INFO:tasks.workunit.client.0.smithi089.stdout:0/650: creat d1/de/d15/d41/d49/d76/d8b/fe4 x:0 0 0 2024-09-13T22:08:42.642 INFO:tasks.workunit.client.0.smithi089.stdout:0/651: fsync d1/de/d1f/f88 0 2024-09-13T22:08:42.642 INFO:tasks.workunit.client.0.smithi089.stdout:0/652: readlink d1/de/d10/d36/ld1 0 2024-09-13T22:08:42.643 INFO:tasks.workunit.client.0.smithi089.stdout:0/653: mknod d1/de/d10/d36/d57/d3a/ce5 0 2024-09-13T22:08:42.643 INFO:tasks.workunit.client.0.smithi089.stdout:0/654: creat d1/de/d10/d36/d39/fe6 x:0 0 0 2024-09-13T22:08:42.645 INFO:tasks.workunit.client.0.smithi089.stdout:7/433: dread d0/d19/d28/f1c [4194304,4194304] 0 2024-09-13T22:08:42.645 INFO:tasks.workunit.client.0.smithi089.stdout:0/655: creat d1/de/fe7 x:0 0 0 2024-09-13T22:08:42.645 INFO:tasks.workunit.client.0.smithi089.stdout:4/476: write d0/d2c/d35/d64/f82 [2724864,120144] 0 2024-09-13T22:08:42.646 INFO:tasks.workunit.client.0.smithi089.stdout:0/656: unlink d1/de/d10/d36/d57/d3a/f3c 0 2024-09-13T22:08:42.646 INFO:tasks.workunit.client.0.smithi089.stdout:0/657: write d1/de/fda [142574,116058] 0 2024-09-13T22:08:42.648 INFO:tasks.workunit.client.0.smithi089.stdout:7/434: rename d0/d19/d28/d1d/d23/d24/d5d/f7d to d0/d19/d28/d61/f86 0 2024-09-13T22:08:42.648 INFO:tasks.workunit.client.0.smithi089.stdout:4/477: dread d0/d2c/d35/f87 [0,4194304] 0 2024-09-13T22:08:42.648 INFO:tasks.workunit.client.0.smithi089.stdout:7/435: readlink d0/d19/d28/d1d/d23/d24/d5d/l52 0 2024-09-13T22:08:42.648 INFO:tasks.workunit.client.0.smithi089.stdout:0/658: stat d1/fba 0 2024-09-13T22:08:42.649 INFO:tasks.workunit.client.0.smithi089.stdout:4/478: mkdir d0/d2c/d35/d74/d9a 0 2024-09-13T22:08:42.650 INFO:tasks.workunit.client.0.smithi089.stdout:7/436: creat d0/d19/d28/d61/f87 x:0 0 0 2024-09-13T22:08:42.651 INFO:tasks.workunit.client.0.smithi089.stdout:0/659: mkdir d1/de/d10/d36/d3d/de8 0 2024-09-13T22:08:42.653 INFO:tasks.workunit.client.0.smithi089.stdout:7/437: symlink d0/d19/d28/l88 0 2024-09-13T22:08:42.654 INFO:tasks.workunit.client.0.smithi089.stdout:4/479: rmdir d0/d15 39 2024-09-13T22:08:42.656 INFO:tasks.workunit.client.0.smithi089.stdout:7/438: mkdir d0/d19/d28/d1d/d23/d89 0 2024-09-13T22:08:42.659 INFO:tasks.workunit.client.0.smithi089.stdout:4/480: rmdir d0/d2c/d35/d74/d9a 0 2024-09-13T22:08:42.678 INFO:tasks.workunit.client.0.smithi089.stdout:7/439: dwrite d0/d19/d28/d1d/d2d/f6d [0,4194304] 0 2024-09-13T22:08:42.678 INFO:tasks.workunit.client.0.smithi089.stdout:4/481: dread d0/d2c/d35/f4f [0,4194304] 0 2024-09-13T22:08:42.679 INFO:tasks.workunit.client.0.smithi089.stdout:4/482: creat d0/d2c/d35/d74/f9b x:0 0 0 2024-09-13T22:08:42.679 INFO:tasks.workunit.client.0.smithi089.stdout:4/483: read d0/d15/d1f/f31 [866519,106704] 0 2024-09-13T22:08:42.679 INFO:tasks.workunit.client.0.smithi089.stdout:4/484: creat d0/d2c/d8d/f9c x:0 0 0 2024-09-13T22:08:42.680 INFO:tasks.workunit.client.0.smithi089.stdout:7/440: mknod d0/d19/c8a 0 2024-09-13T22:08:42.680 INFO:tasks.workunit.client.0.smithi089.stdout:4/485: write d0/d2c/d35/f4c [926646,57665] 0 2024-09-13T22:08:42.680 INFO:tasks.workunit.client.0.smithi089.stdout:4/486: chown d0/d15/c34 528710358 1 2024-09-13T22:08:42.680 INFO:tasks.workunit.client.0.smithi089.stdout:4/487: read d0/d2c/d35/d64/f82 [2983454,224] 0 2024-09-13T22:08:42.683 INFO:tasks.workunit.client.0.smithi089.stdout:4/488: mkdir d0/d11/d16/d24/d9d 0 2024-09-13T22:08:42.692 INFO:tasks.workunit.client.0.smithi089.stdout:4/489: dread d0/d11/d16/d24/f61 [0,4194304] 0 2024-09-13T22:08:42.693 INFO:tasks.workunit.client.0.smithi089.stdout:4/490: mkdir d0/d11/d16/d24/d62/d8c/d9e 0 2024-09-13T22:08:42.694 INFO:tasks.workunit.client.0.smithi089.stdout:4/491: truncate d0/d2c/f45 2503618 0 2024-09-13T22:08:42.695 INFO:tasks.workunit.client.0.smithi089.stdout:4/492: creat d0/d15/d1f/d75/f9f x:0 0 0 2024-09-13T22:08:42.695 INFO:tasks.workunit.client.0.smithi089.stdout:4/493: dread - d0/d15/d76/f7f zero size 2024-09-13T22:08:42.702 INFO:tasks.workunit.client.0.smithi089.stdout:4/494: dread d0/d2c/d35/f51 [0,4194304] 0 2024-09-13T22:08:42.702 INFO:tasks.workunit.client.0.smithi089.stdout:7/441: dwrite d0/d19/d28/d1d/d2d/d55/f79 [0,4194304] 0 2024-09-13T22:08:42.704 INFO:tasks.workunit.client.0.smithi089.stdout:7/442: mkdir d0/d19/d28/d7b/d8b 0 2024-09-13T22:08:42.705 INFO:tasks.workunit.client.0.smithi089.stdout:7/443: truncate d0/f80 5719720 0 2024-09-13T22:08:42.708 INFO:tasks.workunit.client.0.smithi089.stdout:7/444: dread d0/d19/d45/d38/d54/f60 [0,4194304] 0 2024-09-13T22:08:42.708 INFO:tasks.workunit.client.0.smithi089.stdout:7/445: dread - d0/d19/d28/d1d/d2d/d55/d63/f7c zero size 2024-09-13T22:08:42.708 INFO:tasks.workunit.client.0.smithi089.stdout:7/446: creat d0/f8c x:0 0 0 2024-09-13T22:08:42.708 INFO:tasks.workunit.client.0.smithi089.stdout:7/447: creat d0/d19/d28/d1d/d23/d24/f8d x:0 0 0 2024-09-13T22:08:42.708 INFO:tasks.workunit.client.0.smithi089.stdout:7/448: write d0/d19/d28/d1d/d23/d2e/d41/f7e [589622,81625] 0 2024-09-13T22:08:42.711 INFO:tasks.workunit.client.0.smithi089.stdout:1/525: sync 2024-09-13T22:08:42.711 INFO:tasks.workunit.client.0.smithi089.stdout:5/401: sync 2024-09-13T22:08:42.711 INFO:tasks.workunit.client.0.smithi089.stdout:9/491: sync 2024-09-13T22:08:42.711 INFO:tasks.workunit.client.0.smithi089.stdout:9/492: fdatasync d6/d18/d33/d52/f8e 0 2024-09-13T22:08:42.711 INFO:tasks.workunit.client.0.smithi089.stdout:7/449: rename d0/d19/f75 to d0/d19/d28/d1d/d3d/f8e 0 2024-09-13T22:08:42.711 INFO:tasks.workunit.client.0.smithi089.stdout:5/402: write d4/d19/d1e/d28/d31/d61/f6b [649822,16653] 0 2024-09-13T22:08:42.711 INFO:tasks.workunit.client.0.smithi089.stdout:1/526: write d7/f33 [483489,83333] 0 2024-09-13T22:08:42.712 INFO:tasks.workunit.client.0.smithi089.stdout:9/493: creat d6/faa x:0 0 0 2024-09-13T22:08:42.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/494: truncate d6/d55/f6d 2083427 0 2024-09-13T22:08:42.716 INFO:tasks.workunit.client.0.smithi089.stdout:9/495: rename d6/d55/d9a to d6/d18/dab 0 2024-09-13T22:08:42.716 INFO:tasks.workunit.client.0.smithi089.stdout:9/496: chown d6/d31/d64/c73 4901120 1 2024-09-13T22:08:42.717 INFO:tasks.workunit.client.0.smithi089.stdout:9/497: creat d6/d18/fac x:0 0 0 2024-09-13T22:08:42.717 INFO:tasks.workunit.client.0.smithi089.stdout:9/498: read d6/f59 [2430261,102827] 0 2024-09-13T22:08:42.721 INFO:tasks.workunit.client.0.smithi089.stdout:4/495: dwrite d0/d2c/d35/d5d/f60 [4194304,4194304] 0 2024-09-13T22:08:42.721 INFO:tasks.workunit.client.0.smithi089.stdout:4/496: chown d0/d15/l59 237925322 1 2024-09-13T22:08:42.731 INFO:tasks.workunit.client.0.smithi089.stdout:4/497: mkdir d0/d2c/da0 0 2024-09-13T22:08:42.733 INFO:tasks.workunit.client.0.smithi089.stdout:4/498: mkdir d0/d2c/da1 0 2024-09-13T22:08:42.733 INFO:tasks.workunit.client.0.smithi089.stdout:4/499: dread - d0/d2c/d35/d74/f88 zero size 2024-09-13T22:08:42.734 INFO:tasks.workunit.client.0.smithi089.stdout:4/500: truncate d0/d2c/d35/f49 212866 0 2024-09-13T22:08:42.734 INFO:tasks.workunit.client.0.smithi089.stdout:4/501: dread - d0/d2c/d35/d64/d6e/f77 zero size 2024-09-13T22:08:42.735 INFO:tasks.workunit.client.0.smithi089.stdout:4/502: symlink d0/d2c/d35/la2 0 2024-09-13T22:08:42.736 INFO:tasks.workunit.client.0.smithi089.stdout:4/503: write d0/d2c/d35/d64/f93 [650112,103820] 0 2024-09-13T22:08:42.736 INFO:tasks.workunit.client.0.smithi089.stdout:4/504: creat d0/d11/d16/d24/d62/fa3 x:0 0 0 2024-09-13T22:08:42.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:42 smithi089 ceph-mon[27921]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:42.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:42 smithi089 ceph-mon[27921]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:42.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:42 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2474435855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:08:42.751 INFO:tasks.workunit.client.0.smithi089.stdout:5/403: dwrite d4/f27 [0,4194304] 0 2024-09-13T22:08:42.753 INFO:tasks.workunit.client.0.smithi089.stdout:5/404: mknod d4/d19/d1e/d28/d31/c96 0 2024-09-13T22:08:42.753 INFO:tasks.workunit.client.0.smithi089.stdout:5/405: write d4/d19/d1e/d28/d31/d35/d46/f6e [421544,6818] 0 2024-09-13T22:08:42.753 INFO:tasks.workunit.client.0.smithi089.stdout:5/406: fdatasync d4/d19/d1e/d28/d31/d55/f6a 0 2024-09-13T22:08:42.753 INFO:tasks.workunit.client.0.smithi089.stdout:5/407: readlink d4/d19/d1e/d28/l2c 0 2024-09-13T22:08:42.753 INFO:tasks.workunit.client.0.smithi089.stdout:5/408: readlink d4/d19/d1e/d53/l60 0 2024-09-13T22:08:42.757 INFO:tasks.workunit.client.0.smithi089.stdout:1/527: dwrite d7/d34/db2/d2b/f2d [0,4194304] 0 2024-09-13T22:08:42.757 INFO:tasks.workunit.client.0.smithi089.stdout:1/528: fdatasync d7/d40/f97 0 2024-09-13T22:08:42.757 INFO:tasks.workunit.client.0.smithi089.stdout:1/529: dread - d7/d1c/d3c/f81 zero size 2024-09-13T22:08:42.758 INFO:tasks.workunit.client.0.smithi089.stdout:7/450: dwrite d0/d19/d28/d1d/d2d/d55/f79 [0,4194304] 0 2024-09-13T22:08:42.758 INFO:tasks.workunit.client.0.smithi089.stdout:9/499: dwrite d6/d55/f6d [0,4194304] 0 2024-09-13T22:08:42.758 INFO:tasks.workunit.client.0.smithi089.stdout:5/409: fsync d4/d19/d1e/d28/d31/d35/d46/f6e 0 2024-09-13T22:08:42.759 INFO:tasks.workunit.client.0.smithi089.stdout:1/530: mknod d7/d34/d5c/cb5 0 2024-09-13T22:08:42.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:42 smithi159 ceph-mon[35348]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:42.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:42 smithi159 ceph-mon[35348]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:42.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:42 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2474435855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:08:42.761 INFO:tasks.workunit.client.0.smithi089.stdout:7/451: symlink d0/d19/d28/d61/l8f 0 2024-09-13T22:08:42.763 INFO:tasks.workunit.client.0.smithi089.stdout:9/500: mknod d6/d18/d1b/cad 0 2024-09-13T22:08:42.765 INFO:tasks.workunit.client.0.smithi089.stdout:9/501: dread d6/d31/d64/f91 [0,4194304] 0 2024-09-13T22:08:42.765 INFO:tasks.workunit.client.0.smithi089.stdout:9/502: chown d6/d18/d33/d5a/l7a 49725775 1 2024-09-13T22:08:42.766 INFO:tasks.workunit.client.0.smithi089.stdout:5/410: link d4/d19/d1e/d28/d3d/f3f d4/d19/d1e/d28/d31/f97 0 2024-09-13T22:08:42.766 INFO:tasks.workunit.client.0.smithi089.stdout:5/411: fdatasync d4/d19/f24 0 2024-09-13T22:08:42.766 INFO:tasks.workunit.client.0.smithi089.stdout:5/412: chown d4/d19/f48 113 1 2024-09-13T22:08:42.768 INFO:tasks.workunit.client.0.smithi089.stdout:9/503: unlink d6/d18/d21/d5d/d6c/f85 0 2024-09-13T22:08:42.770 INFO:tasks.workunit.client.0.smithi089.stdout:1/531: mkdir d7/db6 0 2024-09-13T22:08:42.771 INFO:tasks.workunit.client.0.smithi089.stdout:9/504: mkdir d6/d18/d1b/da0/dae 0 2024-09-13T22:08:42.773 INFO:tasks.workunit.client.0.smithi089.stdout:1/532: rename d7/de/f30 to d7/d34/db2/d2b/d59/fb7 0 2024-09-13T22:08:42.773 INFO:tasks.workunit.client.0.smithi089.stdout:1/533: write d7/d40/f97 [1566014,44717] 0 2024-09-13T22:08:42.774 INFO:tasks.workunit.client.0.smithi089.stdout:9/505: rmdir d6/d18/d21/d5d/d6c/d8d 39 2024-09-13T22:08:42.774 INFO:tasks.workunit.client.0.smithi089.stdout:9/506: chown d6/d18/d1b/da0/la6 342127 1 2024-09-13T22:08:42.775 INFO:tasks.workunit.client.0.smithi089.stdout:9/507: mknod d6/d31/d5e/caf 0 2024-09-13T22:08:42.776 INFO:tasks.workunit.client.0.smithi089.stdout:9/508: dread - d6/d18/dab/f41 zero size 2024-09-13T22:08:42.777 INFO:tasks.workunit.client.0.smithi089.stdout:9/509: creat d6/d31/fb0 x:0 0 0 2024-09-13T22:08:42.778 INFO:tasks.workunit.client.0.smithi089.stdout:1/534: write d7/d40/f79 [1934605,128606] 0 2024-09-13T22:08:42.780 INFO:tasks.workunit.client.0.smithi089.stdout:1/535: creat d7/d34/d5c/d5d/fb8 x:0 0 0 2024-09-13T22:08:42.780 INFO:tasks.workunit.client.0.smithi089.stdout:1/536: getdents d7/d34/db2 0 2024-09-13T22:08:42.784 INFO:tasks.workunit.client.0.smithi089.stdout:3/453: sync 2024-09-13T22:08:42.784 INFO:tasks.workunit.client.0.smithi089.stdout:6/423: sync 2024-09-13T22:08:42.784 INFO:tasks.workunit.client.0.smithi089.stdout:6/424: read d0/f2e [2207659,91801] 0 2024-09-13T22:08:42.785 INFO:tasks.workunit.client.0.smithi089.stdout:5/413: dwrite d4/d19/f24 [4194304,4194304] 0 2024-09-13T22:08:42.786 INFO:tasks.workunit.client.0.smithi089.stdout:3/454: creat d1/d2/d4/d1c/f8c x:0 0 0 2024-09-13T22:08:42.786 INFO:tasks.workunit.client.0.smithi089.stdout:3/455: truncate d1/d2/d31/f6e 1023045 0 2024-09-13T22:08:42.786 INFO:tasks.workunit.client.0.smithi089.stdout:3/456: write d1/d7/d1b/d28/d63/f6d [8619928,104129] 0 2024-09-13T22:08:42.786 INFO:tasks.workunit.client.0.smithi089.stdout:7/452: dwrite d0/d19/d28/d61/f86 [0,4194304] 0 2024-09-13T22:08:42.787 INFO:tasks.workunit.client.0.smithi089.stdout:6/425: creat d0/d5/d1d/d56/d60/f84 x:0 0 0 2024-09-13T22:08:42.787 INFO:tasks.workunit.client.0.smithi089.stdout:6/426: creat d0/d4/d12/f85 x:0 0 0 2024-09-13T22:08:42.787 INFO:tasks.workunit.client.0.smithi089.stdout:6/427: chown d0/d5/f27 117 1 2024-09-13T22:08:42.789 INFO:tasks.workunit.client.0.smithi089.stdout:5/414: creat d4/d19/d1e/d28/f98 x:0 0 0 2024-09-13T22:08:42.791 INFO:tasks.workunit.client.0.smithi089.stdout:3/457: symlink d1/d3a/l8d 0 2024-09-13T22:08:42.793 INFO:tasks.workunit.client.0.smithi089.stdout:7/453: mkdir d0/d19/d28/d1d/d2d/d3c/d90 0 2024-09-13T22:08:42.795 INFO:tasks.workunit.client.0.smithi089.stdout:6/428: mknod d0/d5/d1d/d56/d4b/c86 0 2024-09-13T22:08:42.795 INFO:tasks.workunit.client.0.smithi089.stdout:6/429: write d0/d5/d1d/d56/d60/f6e [1447677,129123] 0 2024-09-13T22:08:42.796 INFO:tasks.workunit.client.0.smithi089.stdout:5/415: rename d4/d19/d1e/d53/l60 to d4/d19/d1e/d28/d31/d61/l99 0 2024-09-13T22:08:42.796 INFO:tasks.workunit.client.0.smithi089.stdout:3/458: mknod d1/d2/d31/c8e 0 2024-09-13T22:08:42.797 INFO:tasks.workunit.client.0.smithi089.stdout:3/459: write d1/d2/ff [4546223,26852] 0 2024-09-13T22:08:42.797 INFO:tasks.workunit.client.0.smithi089.stdout:6/430: mknod d0/d5/d43/c87 0 2024-09-13T22:08:42.797 INFO:tasks.workunit.client.0.smithi089.stdout:6/431: readlink d0/d4/d12/d15/l1a 0 2024-09-13T22:08:42.798 INFO:tasks.workunit.client.0.smithi089.stdout:5/416: rename d4/d19/d1e/c32 to d4/d19/d1e/d28/d31/d35/d46/c9a 0 2024-09-13T22:08:42.798 INFO:tasks.workunit.client.0.smithi089.stdout:5/417: fsync d4/d19/d1e/d28/d3d/f57 0 2024-09-13T22:08:42.798 INFO:tasks.workunit.client.0.smithi089.stdout:5/418: chown d4/f8 665 1 2024-09-13T22:08:42.798 INFO:tasks.workunit.client.0.smithi089.stdout:5/419: write d4/d19/d1e/d28/f51 [4997795,68778] 0 2024-09-13T22:08:42.799 INFO:tasks.workunit.client.0.smithi089.stdout:5/420: truncate d4/d19/d1e/d28/d31/d61/f90 556510 0 2024-09-13T22:08:42.803 INFO:tasks.workunit.client.0.smithi089.stdout:9/510: dwrite d6/f5c [0,4194304] 0 2024-09-13T22:08:42.803 INFO:tasks.workunit.client.0.smithi089.stdout:9/511: chown d6/d18/c61 61337860 1 2024-09-13T22:08:42.803 INFO:tasks.workunit.client.0.smithi089.stdout:9/512: dread - d6/d31/d64/fa3 zero size 2024-09-13T22:08:42.804 INFO:tasks.workunit.client.0.smithi089.stdout:1/537: dwrite d7/d1c/d3c/f81 [0,4194304] 0 2024-09-13T22:08:42.806 INFO:tasks.workunit.client.0.smithi089.stdout:9/513: stat d6/d18/d33/d52/la5 0 2024-09-13T22:08:42.806 INFO:tasks.workunit.client.0.smithi089.stdout:9/514: dread - d6/d18/f70 zero size 2024-09-13T22:08:42.814 INFO:tasks.workunit.client.0.smithi089.stdout:1/538: mknod d7/d40/cb9 0 2024-09-13T22:08:42.814 INFO:tasks.workunit.client.0.smithi089.stdout:9/515: mkdir d6/d31/d5e/db1 0 2024-09-13T22:08:42.815 INFO:tasks.workunit.client.0.smithi089.stdout:9/516: fsync d6/d18/f1d 0 2024-09-13T22:08:42.817 INFO:tasks.workunit.client.0.smithi089.stdout:6/432: getdents d0/d4/d12 0 2024-09-13T22:08:42.817 INFO:tasks.workunit.client.0.smithi089.stdout:6/433: chown d0/d5/d1d/d2d/l68 125921 1 2024-09-13T22:08:42.817 INFO:tasks.workunit.client.0.smithi089.stdout:6/434: readlink d0/d4/d12/l25 0 2024-09-13T22:08:42.827 INFO:tasks.workunit.client.0.smithi089.stdout:3/460: dwrite d1/d7/d1b/f4e [0,4194304] 0 2024-09-13T22:08:42.834 INFO:tasks.workunit.client.0.smithi089.stdout:8/474: sync 2024-09-13T22:08:42.834 INFO:tasks.workunit.client.0.smithi089.stdout:0/660: sync 2024-09-13T22:08:42.834 INFO:tasks.workunit.client.0.smithi089.stdout:0/661: fdatasync d1/de/d10/f45 0 2024-09-13T22:08:42.834 INFO:tasks.workunit.client.0.smithi089.stdout:0/662: write d1/de/d10/d85/fcd [218749,10581] 0 2024-09-13T22:08:42.834 INFO:tasks.workunit.client.0.smithi089.stdout:0/663: chown d1/de/d15/d41/d49 0 1 2024-09-13T22:08:42.834 INFO:tasks.workunit.client.0.smithi089.stdout:0/664: creat d1/de/d10/d36/d38/d4e/fe9 x:0 0 0 2024-09-13T22:08:42.834 INFO:tasks.workunit.client.0.smithi089.stdout:0/665: chown d1/de/d10/d36/d57 3451962 1 2024-09-13T22:08:42.835 INFO:tasks.workunit.client.0.smithi089.stdout:2/457: sync 2024-09-13T22:08:42.835 INFO:tasks.workunit.client.0.smithi089.stdout:8/475: mkdir d0/dd/d12/d20/d36/da0 0 2024-09-13T22:08:42.835 INFO:tasks.workunit.client.0.smithi089.stdout:8/476: readlink d0/dd/d12/d20/d36/l28 0 2024-09-13T22:08:42.836 INFO:tasks.workunit.client.0.smithi089.stdout:2/458: mknod df/d14/d66/c98 0 2024-09-13T22:08:42.841 INFO:tasks.workunit.client.0.smithi089.stdout:5/421: dwrite d4/ff [0,4194304] 0 2024-09-13T22:08:42.841 INFO:tasks.workunit.client.0.smithi089.stdout:5/422: creat d4/d19/d1e/d28/f9b x:0 0 0 2024-09-13T22:08:42.841 INFO:tasks.workunit.client.0.smithi089.stdout:5/423: dread - d4/d19/d1e/d53/f7e zero size 2024-09-13T22:08:42.843 INFO:tasks.workunit.client.0.smithi089.stdout:5/424: symlink d4/d19/d1e/d53/l9c 0 2024-09-13T22:08:42.845 INFO:tasks.workunit.client.0.smithi089.stdout:1/539: dwrite d7/d34/d5c/f78 [4194304,4194304] 0 2024-09-13T22:08:42.846 INFO:tasks.workunit.client.0.smithi089.stdout:1/540: chown d7/d34/l89 10892 1 2024-09-13T22:08:42.849 INFO:tasks.workunit.client.0.smithi089.stdout:1/541: rename d7/d1c/d3c/f60 to d7/d34/fba 0 2024-09-13T22:08:42.849 INFO:tasks.workunit.client.0.smithi089.stdout:1/542: mkdir d7/d34/db2/d80/dbb 0 2024-09-13T22:08:42.851 INFO:tasks.workunit.client.0.smithi089.stdout:1/543: rename d7/d1c/d3c/f8a to d7/d34/fbc 0 2024-09-13T22:08:42.852 INFO:tasks.workunit.client.0.smithi089.stdout:1/544: mkdir d7/de/da0/dbd 0 2024-09-13T22:08:42.853 INFO:tasks.workunit.client.0.smithi089.stdout:1/545: truncate d7/d34/db2/d80/f82 1333752 0 2024-09-13T22:08:42.857 INFO:tasks.workunit.client.0.smithi089.stdout:5/425: read d4/d19/f48 [619094,64398] 0 2024-09-13T22:08:42.861 INFO:tasks.workunit.client.0.smithi089.stdout:5/426: dread d4/d19/d1e/d28/d31/d35/d46/f4e [0,4194304] 0 2024-09-13T22:08:42.862 INFO:tasks.workunit.client.0.smithi089.stdout:5/427: read d4/d19/d1e/f62 [4523691,20784] 0 2024-09-13T22:08:42.864 INFO:tasks.workunit.client.0.smithi089.stdout:5/428: unlink d4/d19/d1e/d28/d31/d55/f6a 0 2024-09-13T22:08:42.866 INFO:tasks.workunit.client.0.smithi089.stdout:5/429: mkdir d4/d19/d1e/d28/d31/d55/d58/d9d 0 2024-09-13T22:08:42.866 INFO:tasks.workunit.client.0.smithi089.stdout:5/430: write d4/d19/d1e/d28/d31/d35/f47 [1132370,70423] 0 2024-09-13T22:08:42.867 INFO:tasks.workunit.client.0.smithi089.stdout:1/546: dread d7/f43 [0,4194304] 0 2024-09-13T22:08:42.867 INFO:tasks.workunit.client.0.smithi089.stdout:5/431: symlink d4/d19/d1e/d89/l9e 0 2024-09-13T22:08:42.867 INFO:tasks.workunit.client.0.smithi089.stdout:5/432: stat d4/d19/d1e/d28/d31/d61/f8d 0 2024-09-13T22:08:42.867 INFO:tasks.workunit.client.0.smithi089.stdout:5/433: dread - d4/d19/d1e/d28/f98 zero size 2024-09-13T22:08:42.868 INFO:tasks.workunit.client.0.smithi089.stdout:1/547: rename d7/d34/db2 to d7/d40/dbe 0 2024-09-13T22:08:42.868 INFO:tasks.workunit.client.0.smithi089.stdout:1/548: chown d7/d40/c96 47 1 2024-09-13T22:08:42.869 INFO:tasks.workunit.client.0.smithi089.stdout:5/434: rename d4/d19/d1e/l2a to d4/d19/d1e/d28/d3d/l9f 0 2024-09-13T22:08:42.870 INFO:tasks.workunit.client.0.smithi089.stdout:1/549: creat d7/d1c/d7a/fbf x:0 0 0 2024-09-13T22:08:42.870 INFO:tasks.workunit.client.0.smithi089.stdout:1/550: chown d7/d40/dbe/l63 17799 1 2024-09-13T22:08:42.870 INFO:tasks.workunit.client.0.smithi089.stdout:1/551: chown d7/de/d68/f6f 88182458 1 2024-09-13T22:08:42.870 INFO:tasks.workunit.client.0.smithi089.stdout:1/552: fsync d7/f9 0 2024-09-13T22:08:42.870 INFO:tasks.workunit.client.0.smithi089.stdout:1/553: write d7/d34/f38 [3056008,77815] 0 2024-09-13T22:08:42.870 INFO:tasks.workunit.client.0.smithi089.stdout:5/435: creat d4/d19/d1e/fa0 x:0 0 0 2024-09-13T22:08:42.871 INFO:tasks.workunit.client.0.smithi089.stdout:1/554: symlink d7/d40/dbe/d2b/d39/d73/da9/lc0 0 2024-09-13T22:08:42.871 INFO:tasks.workunit.client.0.smithi089.stdout:1/555: readlink d7/d34/l89 0 2024-09-13T22:08:42.871 INFO:tasks.workunit.client.0.smithi089.stdout:1/556: chown d7/d40/dbe/d2b/d39/f4c 128 1 2024-09-13T22:08:42.872 INFO:tasks.workunit.client.0.smithi089.stdout:5/436: creat d4/d19/d1e/d28/d31/d35/fa1 x:0 0 0 2024-09-13T22:08:42.872 INFO:tasks.workunit.client.0.smithi089.stdout:5/437: fdatasync d4/f1c 0 2024-09-13T22:08:42.872 INFO:tasks.workunit.client.0.smithi089.stdout:1/557: creat d7/d40/dbe/d80/dbb/fc1 x:0 0 0 2024-09-13T22:08:42.873 INFO:tasks.workunit.client.0.smithi089.stdout:1/558: symlink d7/d1c/d3c/lc2 0 2024-09-13T22:08:42.874 INFO:tasks.workunit.client.0.smithi089.stdout:1/559: readlink d7/d34/d5c/d5d/l6b 0 2024-09-13T22:08:42.874 INFO:tasks.workunit.client.0.smithi089.stdout:1/560: write d7/f19 [1541288,80085] 0 2024-09-13T22:08:42.875 INFO:tasks.workunit.client.0.smithi089.stdout:1/561: creat d7/d1c/fc3 x:0 0 0 2024-09-13T22:08:42.883 INFO:tasks.workunit.client.0.smithi089.stdout:3/461: dwrite d1/d7/f15 [0,4194304] 0 2024-09-13T22:08:42.883 INFO:tasks.workunit.client.0.smithi089.stdout:9/517: dwrite d6/d18/d1b/f26 [0,4194304] 0 2024-09-13T22:08:42.883 INFO:tasks.workunit.client.0.smithi089.stdout:9/518: fdatasync d6/d18/d33/f90 0 2024-09-13T22:08:42.883 INFO:tasks.workunit.client.0.smithi089.stdout:3/462: chown d1/d7/f61 117711 1 2024-09-13T22:08:42.883 INFO:tasks.workunit.client.0.smithi089.stdout:6/435: dwrite d0/f3e [0,4194304] 0 2024-09-13T22:08:42.884 INFO:tasks.workunit.client.0.smithi089.stdout:2/459: dwrite df/d1a/d57/f8f [0,4194304] 0 2024-09-13T22:08:42.884 INFO:tasks.workunit.client.0.smithi089.stdout:0/666: dwrite d1/de/f3e [4194304,4194304] 0 2024-09-13T22:08:42.884 INFO:tasks.workunit.client.0.smithi089.stdout:2/460: write df/d5b/f5f [647957,92135] 0 2024-09-13T22:08:42.885 INFO:tasks.workunit.client.0.smithi089.stdout:3/463: mknod d1/d7/d1b/d28/d63/c8f 0 2024-09-13T22:08:42.886 INFO:tasks.workunit.client.0.smithi089.stdout:3/464: chown d1/d7/d1b/d28 5676798 1 2024-09-13T22:08:42.887 INFO:tasks.workunit.client.0.smithi089.stdout:1/562: dread d7/de/d3a/f8d [0,4194304] 0 2024-09-13T22:08:42.887 INFO:tasks.workunit.client.0.smithi089.stdout:1/563: write d7/de/d3a/f6a [355975,74254] 0 2024-09-13T22:08:42.889 INFO:tasks.workunit.client.0.smithi089.stdout:6/436: unlink d0/d5/d43/l59 0 2024-09-13T22:08:42.889 INFO:tasks.workunit.client.0.smithi089.stdout:5/438: dwrite d4/d19/d1e/d28/d31/d35/fa1 [0,4194304] 0 2024-09-13T22:08:42.892 INFO:tasks.workunit.client.0.smithi089.stdout:0/667: creat d1/de/d10/d36/d57/d3a/fea x:0 0 0 2024-09-13T22:08:42.893 INFO:tasks.workunit.client.0.smithi089.stdout:9/519: getdents d6/d54 0 2024-09-13T22:08:42.895 INFO:tasks.workunit.client.0.smithi089.stdout:3/465: creat d1/d2/d4/d1c/d7e/d40/f90 x:0 0 0 2024-09-13T22:08:42.896 INFO:tasks.workunit.client.0.smithi089.stdout:1/564: creat d7/d1c/d7a/dad/fc4 x:0 0 0 2024-09-13T22:08:42.896 INFO:tasks.workunit.client.0.smithi089.stdout:1/565: dread - d7/f25 zero size 2024-09-13T22:08:42.897 INFO:tasks.workunit.client.0.smithi089.stdout:6/437: mkdir d0/d4/d88 0 2024-09-13T22:08:42.900 INFO:tasks.workunit.client.0.smithi089.stdout:5/439: rename d4/d19/f2b to d4/d19/d1e/d53/fa2 0 2024-09-13T22:08:42.902 INFO:tasks.workunit.client.0.smithi089.stdout:0/668: unlink d1/de/d15/d2a/f31 0 2024-09-13T22:08:42.902 INFO:tasks.workunit.client.0.smithi089.stdout:5/440: dread d4/f5 [0,4194304] 0 2024-09-13T22:08:42.903 INFO:tasks.workunit.client.0.smithi089.stdout:9/520: mknod d6/d18/d33/d5a/cb2 0 2024-09-13T22:08:42.903 INFO:tasks.workunit.client.0.smithi089.stdout:3/466: creat d1/d2/d4/d1c/d7e/f91 x:0 0 0 2024-09-13T22:08:42.904 INFO:tasks.workunit.client.0.smithi089.stdout:6/438: symlink d0/d5/d1d/d2d/l89 0 2024-09-13T22:08:42.904 INFO:tasks.workunit.client.0.smithi089.stdout:6/439: chown d0/d5/d1d/d56/d4b 18 1 2024-09-13T22:08:42.904 INFO:tasks.workunit.client.0.smithi089.stdout:6/440: chown d0/d5/d1d/d2d/l61 115146 1 2024-09-13T22:08:42.906 INFO:tasks.workunit.client.0.smithi089.stdout:4/505: sync 2024-09-13T22:08:42.906 INFO:tasks.workunit.client.0.smithi089.stdout:4/506: chown d0/d2c/d35 211 1 2024-09-13T22:08:42.906 INFO:tasks.workunit.client.0.smithi089.stdout:4/507: write d0/d15/f7d [324176,130977] 0 2024-09-13T22:08:42.907 INFO:tasks.workunit.client.0.smithi089.stdout:3/467: link d1/d2/d23/l4f d1/d7/d1b/d28/d63/l92 0 2024-09-13T22:08:42.908 INFO:tasks.workunit.client.0.smithi089.stdout:0/669: link d1/cb9 d1/de/d10/db0/ceb 0 2024-09-13T22:08:42.909 INFO:tasks.workunit.client.0.smithi089.stdout:6/441: dread d0/d4/f40 [0,4194304] 0 2024-09-13T22:08:42.909 INFO:tasks.workunit.client.0.smithi089.stdout:6/442: readlink d0/d5/d1d/l5a 0 2024-09-13T22:08:42.909 INFO:tasks.workunit.client.0.smithi089.stdout:6/443: readlink d0/d5/d1d/l5a 0 2024-09-13T22:08:42.909 INFO:tasks.workunit.client.0.smithi089.stdout:6/444: creat d0/d5/d43/f8a x:0 0 0 2024-09-13T22:08:42.909 INFO:tasks.workunit.client.0.smithi089.stdout:5/441: rename d4/d19/c1d to d4/d19/d1e/d28/ca3 0 2024-09-13T22:08:42.910 INFO:tasks.workunit.client.0.smithi089.stdout:9/521: write d6/d18/f1d [7225740,15882] 0 2024-09-13T22:08:42.910 INFO:tasks.workunit.client.0.smithi089.stdout:9/522: getdents d6/d18/d21/d5d/d6c/d8d 0 2024-09-13T22:08:42.911 INFO:tasks.workunit.client.0.smithi089.stdout:9/523: stat d6/f51 0 2024-09-13T22:08:42.911 INFO:tasks.workunit.client.0.smithi089.stdout:9/524: chown d6/d18/d21/f4a 12 1 2024-09-13T22:08:42.911 INFO:tasks.workunit.client.0.smithi089.stdout:4/508: mkdir d0/d2c/d35/d5d/da4 0 2024-09-13T22:08:42.912 INFO:tasks.workunit.client.0.smithi089.stdout:6/445: link d0/d4/f5e d0/d5/d1d/d56/d28/f8b 0 2024-09-13T22:08:42.912 INFO:tasks.workunit.client.0.smithi089.stdout:6/446: chown d0/d5/d1d/d2d/l69 195706038 1 2024-09-13T22:08:42.912 INFO:tasks.workunit.client.0.smithi089.stdout:6/447: chown d0/d5/f4d 4100 1 2024-09-13T22:08:42.913 INFO:tasks.workunit.client.0.smithi089.stdout:0/670: write d1/de/d15/d2a/f81 [3583307,10251] 0 2024-09-13T22:08:42.913 INFO:tasks.workunit.client.0.smithi089.stdout:5/442: dread d4/d19/d1e/d28/d31/d61/f6b [0,4194304] 0 2024-09-13T22:08:42.914 INFO:tasks.workunit.client.0.smithi089.stdout:9/525: truncate d6/d18/f32 3517558 0 2024-09-13T22:08:42.915 INFO:tasks.workunit.client.0.smithi089.stdout:9/526: read d6/d18/dab/f4c [50736,58117] 0 2024-09-13T22:08:42.915 INFO:tasks.workunit.client.0.smithi089.stdout:9/527: chown d6/l87 611338 1 2024-09-13T22:08:42.917 INFO:tasks.workunit.client.0.smithi089.stdout:6/448: truncate d0/f2e 3262723 0 2024-09-13T22:08:42.920 INFO:tasks.workunit.client.0.smithi089.stdout:5/443: mkdir d4/d19/d1e/d28/d31/d55/da4 0 2024-09-13T22:08:42.924 INFO:tasks.workunit.client.0.smithi089.stdout:9/528: rmdir d6/d18/dab 39 2024-09-13T22:08:42.925 INFO:tasks.workunit.client.0.smithi089.stdout:3/468: dwrite d1/d2/d23/d3d/d54/d5d/f77 [0,4194304] 0 2024-09-13T22:08:42.925 INFO:tasks.workunit.client.0.smithi089.stdout:3/469: readlink d1/d2/d4/l1f 0 2024-09-13T22:08:42.926 INFO:tasks.workunit.client.0.smithi089.stdout:5/444: readlink d4/d19/l4c 0 2024-09-13T22:08:42.927 INFO:tasks.workunit.client.0.smithi089.stdout:5/445: write d4/d19/d1e/d28/d3d/f7a [560940,23964] 0 2024-09-13T22:08:42.927 INFO:tasks.workunit.client.0.smithi089.stdout:5/446: creat d4/d19/d1e/d28/d31/fa5 x:0 0 0 2024-09-13T22:08:42.927 INFO:tasks.workunit.client.0.smithi089.stdout:5/447: creat d4/d19/d1e/d28/d31/d55/d58/d84/fa6 x:0 0 0 2024-09-13T22:08:42.927 INFO:tasks.workunit.client.0.smithi089.stdout:9/529: symlink d6/d55/lb3 0 2024-09-13T22:08:42.929 INFO:tasks.workunit.client.0.smithi089.stdout:3/470: link d1/d2/d4/d1c/d7e/d38/l39 d1/d2/d23/d2b/l93 0 2024-09-13T22:08:42.930 INFO:tasks.workunit.client.0.smithi089.stdout:4/509: rename d0/d11/d16/d24 to d0/d2c/d52/da5 0 2024-09-13T22:08:42.933 INFO:tasks.workunit.client.0.smithi089.stdout:0/671: dwrite d1/de/d10/d36/d38/d4e/d62/d5b/f67 [0,4194304] 0 2024-09-13T22:08:42.933 INFO:tasks.workunit.client.0.smithi089.stdout:6/449: getdents d0/d5/d43 0 2024-09-13T22:08:42.936 INFO:tasks.workunit.client.0.smithi089.stdout:3/471: symlink d1/d2/d4/d5a/l94 0 2024-09-13T22:08:42.938 INFO:tasks.workunit.client.0.smithi089.stdout:9/530: rename d6/d18/d1b/l38 to d6/d18/d1b/da0/dae/lb4 0 2024-09-13T22:08:42.938 INFO:tasks.workunit.client.0.smithi089.stdout:9/531: write d6/d18/dab/f41 [863403,2543] 0 2024-09-13T22:08:42.938 INFO:tasks.workunit.client.0.smithi089.stdout:9/532: write d6/d18/d21/f4a [773044,78370] 0 2024-09-13T22:08:42.939 INFO:tasks.workunit.client.0.smithi089.stdout:0/672: mkdir d1/de/d10/d85/dec 0 2024-09-13T22:08:42.943 INFO:tasks.workunit.client.0.smithi089.stdout:5/448: rmdir d4/d19/d1e/d28/d31/d55/d58/d84 39 2024-09-13T22:08:42.943 INFO:tasks.workunit.client.0.smithi089.stdout:3/472: write d1/d2/ff [3709214,57477] 0 2024-09-13T22:08:42.944 INFO:tasks.workunit.client.0.smithi089.stdout:9/533: creat d6/d54/fb5 x:0 0 0 2024-09-13T22:08:42.946 INFO:tasks.workunit.client.0.smithi089.stdout:0/673: truncate d1/de/d10/d36/d38/f86 3654684 0 2024-09-13T22:08:42.946 INFO:tasks.workunit.client.0.smithi089.stdout:0/674: read d1/de/f14 [210398,6938] 0 2024-09-13T22:08:42.946 INFO:tasks.workunit.client.0.smithi089.stdout:6/450: rmdir d0/d5/d1d/d56/d4a 39 2024-09-13T22:08:42.947 INFO:tasks.workunit.client.0.smithi089.stdout:6/451: chown d0/d5/d1d/d56/ce 804 1 2024-09-13T22:08:42.947 INFO:tasks.workunit.client.0.smithi089.stdout:6/452: chown d0/d5/d1d/f82 20 1 2024-09-13T22:08:42.949 INFO:tasks.workunit.client.0.smithi089.stdout:3/473: mkdir d1/d2/d23/d3d/d54/d95 0 2024-09-13T22:08:42.951 INFO:tasks.workunit.client.0.smithi089.stdout:9/534: creat d6/d31/d5e/db1/fb6 x:0 0 0 2024-09-13T22:08:42.951 INFO:tasks.workunit.client.0.smithi089.stdout:0/675: rename d1/de/d15/d2a/c2e to d1/de/d10/d36/d3d/de8/ced 0 2024-09-13T22:08:42.953 INFO:tasks.workunit.client.0.smithi089.stdout:6/453: mknod d0/d5/d1d/d56/d4a/c8c 0 2024-09-13T22:08:42.954 INFO:tasks.workunit.client.0.smithi089.stdout:0/676: mknod d1/de/d10/d36/cee 0 2024-09-13T22:08:42.955 INFO:tasks.workunit.client.0.smithi089.stdout:0/677: symlink d1/de/d10/d36/d3d/de8/lef 0 2024-09-13T22:08:42.966 INFO:tasks.workunit.client.0.smithi089.stdout:5/449: dwrite d4/d19/d1e/f62 [4194304,4194304] 0 2024-09-13T22:08:42.966 INFO:tasks.workunit.client.0.smithi089.stdout:5/450: getdents d4/d19/d1e/d53/d88 0 2024-09-13T22:08:42.966 INFO:tasks.workunit.client.0.smithi089.stdout:5/451: chown d4/d19/d1e/d28/d31/f40 1398898 1 2024-09-13T22:08:42.969 INFO:tasks.workunit.client.0.smithi089.stdout:0/678: read d1/f1e [1335552,20093] 0 2024-09-13T22:08:42.970 INFO:tasks.workunit.client.0.smithi089.stdout:5/452: creat d4/d19/d1e/d89/d8a/fa7 x:0 0 0 2024-09-13T22:08:42.970 INFO:tasks.workunit.client.0.smithi089.stdout:9/535: dread d6/f15 [0,4194304] 0 2024-09-13T22:08:42.970 INFO:tasks.workunit.client.0.smithi089.stdout:9/536: fdatasync d6/d18/fac 0 2024-09-13T22:08:42.970 INFO:tasks.workunit.client.0.smithi089.stdout:9/537: dread - d6/d18/d33/d52/f8e zero size 2024-09-13T22:08:42.971 INFO:tasks.workunit.client.0.smithi089.stdout:5/453: link d4/d19/d1e/d28/d31/fa5 d4/d19/d1e/d28/d31/d35/d46/fa8 0 2024-09-13T22:08:42.971 INFO:tasks.workunit.client.0.smithi089.stdout:0/679: mkdir d1/de/d10/d36/d38/d4e/d62/d5f/d72/df0 0 2024-09-13T22:08:42.973 INFO:tasks.workunit.client.0.smithi089.stdout:9/538: rename d6/d55/l7b to d6/d31/lb7 0 2024-09-13T22:08:42.974 INFO:tasks.workunit.client.0.smithi089.stdout:0/680: symlink d1/de/d15/d41/d87/dbf/de0/lf1 0 2024-09-13T22:08:42.974 INFO:tasks.workunit.client.0.smithi089.stdout:0/681: chown d1/de/d15/la7 2583937 1 2024-09-13T22:08:42.975 INFO:tasks.workunit.client.0.smithi089.stdout:0/682: symlink d1/de/d15/d41/d49/d76/lf2 0 2024-09-13T22:08:42.976 INFO:tasks.workunit.client.0.smithi089.stdout:0/683: creat d1/de/d10/d36/d57/d3a/db7/ff3 x:0 0 0 2024-09-13T22:08:42.977 INFO:tasks.workunit.client.0.smithi089.stdout:0/684: creat d1/de/d10/d36/d57/ff4 x:0 0 0 2024-09-13T22:08:42.977 INFO:tasks.workunit.client.0.smithi089.stdout:0/685: chown d1/de/d10/d36/d3d/de8/ced 3 1 2024-09-13T22:08:42.978 INFO:tasks.workunit.client.0.smithi089.stdout:0/686: creat d1/de/d10/d36/ff5 x:0 0 0 2024-09-13T22:08:42.978 INFO:tasks.workunit.client.0.smithi089.stdout:9/539: write d6/f15 [491982,85902] 0 2024-09-13T22:08:42.979 INFO:tasks.workunit.client.0.smithi089.stdout:9/540: read d6/f15 [1913615,12095] 0 2024-09-13T22:08:42.979 INFO:tasks.workunit.client.0.smithi089.stdout:9/541: dread - d6/d18/d33/d52/f4e zero size 2024-09-13T22:08:42.979 INFO:tasks.workunit.client.0.smithi089.stdout:3/474: dwrite d1/d2/d4/d1c/d7e/d40/d50/f8a [0,4194304] 0 2024-09-13T22:08:42.980 INFO:tasks.workunit.client.0.smithi089.stdout:0/687: link d1/de/d15/l69 d1/de/d1f/lf6 0 2024-09-13T22:08:42.984 INFO:tasks.workunit.client.0.smithi089.stdout:0/688: symlink d1/de/d10/d85/lf7 0 2024-09-13T22:08:42.985 INFO:tasks.workunit.client.0.smithi089.stdout:3/475: mkdir d1/d2/d96 0 2024-09-13T22:08:42.985 INFO:tasks.workunit.client.0.smithi089.stdout:9/542: dread d6/d18/d21/f34 [0,4194304] 0 2024-09-13T22:08:42.985 INFO:tasks.workunit.client.0.smithi089.stdout:5/454: write d4/d19/d1e/d28/f51 [5586252,9463] 0 2024-09-13T22:08:42.985 INFO:tasks.workunit.client.0.smithi089.stdout:6/454: dwrite d0/d5/d1d/f82 [0,4194304] 0 2024-09-13T22:08:42.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/455: write d4/d19/d1e/d28/d31/f40 [540783,70772] 0 2024-09-13T22:08:42.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/456: dread - d4/d19/d1e/d28/d31/d55/d58/d84/f8f zero size 2024-09-13T22:08:42.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/457: stat d4/d19/d1e/f62 0 2024-09-13T22:08:42.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/458: creat d4/d19/d1e/d28/d31/fa9 x:0 0 0 2024-09-13T22:08:42.988 INFO:tasks.workunit.client.0.smithi089.stdout:6/455: mknod d0/d5/d1d/d56/d28/c8d 0 2024-09-13T22:08:42.991 INFO:tasks.workunit.client.0.smithi089.stdout:6/456: dread d0/d5/d1d/d56/d28/f8b [0,4194304] 0 2024-09-13T22:08:42.993 INFO:tasks.workunit.client.0.smithi089.stdout:6/457: mknod d0/d4/c8e 0 2024-09-13T22:08:42.993 INFO:tasks.workunit.client.0.smithi089.stdout:6/458: creat d0/d5/d1d/d54/f8f x:0 0 0 2024-09-13T22:08:42.995 INFO:tasks.workunit.client.0.smithi089.stdout:8/477: sync 2024-09-13T22:08:42.995 INFO:tasks.workunit.client.0.smithi089.stdout:7/454: sync 2024-09-13T22:08:42.995 INFO:tasks.workunit.client.0.smithi089.stdout:7/455: write d0/ff [2463955,104979] 0 2024-09-13T22:08:42.998 INFO:tasks.workunit.client.0.smithi089.stdout:6/459: creat d0/d5/d1d/d56/d4a/f90 x:0 0 0 2024-09-13T22:08:42.998 INFO:tasks.workunit.client.0.smithi089.stdout:7/456: dread d0/d19/d28/d1d/d23/d2e/d41/f4d [0,4194304] 0 2024-09-13T22:08:42.998 INFO:tasks.workunit.client.0.smithi089.stdout:7/457: stat d0/d19/d28/d1d/d3d/l50 0 2024-09-13T22:08:42.998 INFO:tasks.workunit.client.0.smithi089.stdout:7/458: write d0/fd [321327,28475] 0 2024-09-13T22:08:42.998 INFO:tasks.workunit.client.0.smithi089.stdout:7/459: chown d0/d19/d28/d1d/d2d 9860926 1 2024-09-13T22:08:42.998 INFO:tasks.workunit.client.0.smithi089.stdout:5/459: dread d4/f27 [0,4194304] 0 2024-09-13T22:08:42.999 INFO:tasks.workunit.client.0.smithi089.stdout:6/460: getdents d0/d4/d12/d15/d3b 0 2024-09-13T22:08:43.000 INFO:tasks.workunit.client.0.smithi089.stdout:5/460: symlink d4/d19/d1e/laa 0 2024-09-13T22:08:43.008 INFO:tasks.workunit.client.0.smithi089.stdout:0/689: dwrite d1/f9e [0,4194304] 0 2024-09-13T22:08:43.011 INFO:tasks.workunit.client.0.smithi089.stdout:9/543: dwrite d6/d18/d33/d5a/f9b [0,4194304] 0 2024-09-13T22:08:43.013 INFO:tasks.workunit.client.0.smithi089.stdout:0/690: unlink d1/fba 0 2024-09-13T22:08:43.013 INFO:tasks.workunit.client.0.smithi089.stdout:0/691: write d1/de/d10/d36/d3d/f43 [3256235,78028] 0 2024-09-13T22:08:43.014 INFO:tasks.workunit.client.0.smithi089.stdout:0/692: fsync d1/de/d15/d41/d49/f92 0 2024-09-13T22:08:43.021 INFO:tasks.workunit.client.0.smithi089.stdout:9/544: getdents d6/d18/d33/d52 0 2024-09-13T22:08:43.023 INFO:tasks.workunit.client.0.smithi089.stdout:0/693: unlink d1/de/d1f/lcb 0 2024-09-13T22:08:43.025 INFO:tasks.workunit.client.0.smithi089.stdout:8/478: dwrite d0/dd/d12/d20/d40/d4a/f9e [0,4194304] 0 2024-09-13T22:08:43.030 INFO:tasks.workunit.client.0.smithi089.stdout:8/479: mknod d0/dd/d12/d20/d36/d59/ca1 0 2024-09-13T22:08:43.032 INFO:tasks.workunit.client.0.smithi089.stdout:9/545: rename d6/d18/d33 to d6/d18/d1b/d89/db8 0 2024-09-13T22:08:43.033 INFO:tasks.workunit.client.0.smithi089.stdout:8/480: creat d0/dd/d12/fa2 x:0 0 0 2024-09-13T22:08:43.033 INFO:tasks.workunit.client.0.smithi089.stdout:8/481: readlink d0/d6a/d73/l75 0 2024-09-13T22:08:43.034 INFO:tasks.workunit.client.0.smithi089.stdout:8/482: fsync d0/dd/f46 0 2024-09-13T22:08:43.034 INFO:tasks.workunit.client.0.smithi089.stdout:8/483: chown d0/d6a/d73 112757851 1 2024-09-13T22:08:43.034 INFO:tasks.workunit.client.0.smithi089.stdout:9/546: creat d6/d18/d1b/da0/fb9 x:0 0 0 2024-09-13T22:08:43.035 INFO:tasks.workunit.client.0.smithi089.stdout:8/484: truncate d0/dd/d12/d20/d36/d59/d89/f25 74020 0 2024-09-13T22:08:43.043 INFO:tasks.workunit.client.0.smithi089.stdout:8/485: dread d0/dd/d12/d20/d1c/d5a/f74 [0,4194304] 0 2024-09-13T22:08:43.043 INFO:tasks.workunit.client.0.smithi089.stdout:8/486: dread - d0/dd/d12/d3a/f5b zero size 2024-09-13T22:08:43.044 INFO:tasks.workunit.client.0.smithi089.stdout:8/487: symlink d0/dd/d12/d20/d36/d59/d5d/la3 0 2024-09-13T22:08:43.045 INFO:tasks.workunit.client.0.smithi089.stdout:8/488: symlink d0/dd/d12/d20/d40/d4a/la4 0 2024-09-13T22:08:43.045 INFO:tasks.workunit.client.0.smithi089.stdout:8/489: stat d0/dd/d12/d42 0 2024-09-13T22:08:43.046 INFO:tasks.workunit.client.0.smithi089.stdout:8/490: mkdir d0/dd/d12/d20/d36/d80/d3b/da5 0 2024-09-13T22:08:43.050 INFO:tasks.workunit.client.0.smithi089.stdout:8/491: dread d0/dd/d12/d20/d1c/f2f [0,4194304] 0 2024-09-13T22:08:43.055 INFO:tasks.workunit.client.0.smithi089.stdout:7/460: dwrite d0/d19/d45/d38/f39 [0,4194304] 0 2024-09-13T22:08:43.055 INFO:tasks.workunit.client.0.smithi089.stdout:5/461: dwrite d4/d19/d1e/d28/d3d/f57 [0,4194304] 0 2024-09-13T22:08:43.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/461: dwrite d0/d4/d12/d15/f71 [0,4194304] 0 2024-09-13T22:08:43.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/462: write d0/d5/d1d/d56/f34 [4401037,47304] 0 2024-09-13T22:08:43.055 INFO:tasks.workunit.client.0.smithi089.stdout:0/694: dwrite d1/de/fe7 [0,4194304] 0 2024-09-13T22:08:43.057 INFO:tasks.workunit.client.0.smithi089.stdout:9/547: dwrite d6/faa [0,4194304] 0 2024-09-13T22:08:43.057 INFO:tasks.workunit.client.0.smithi089.stdout:8/492: write d0/dd/f35 [583522,62882] 0 2024-09-13T22:08:43.059 INFO:tasks.workunit.client.0.smithi089.stdout:7/461: unlink d0/d19/l78 0 2024-09-13T22:08:43.059 INFO:tasks.workunit.client.0.smithi089.stdout:7/462: write d0/d19/d45/d38/f6a [164374,37868] 0 2024-09-13T22:08:43.062 INFO:tasks.workunit.client.0.smithi089.stdout:6/463: creat d0/d4/d12/f91 x:0 0 0 2024-09-13T22:08:43.072 INFO:tasks.workunit.client.0.smithi089.stdout:9/548: creat d6/d18/d1b/d89/fba x:0 0 0 2024-09-13T22:08:43.072 INFO:tasks.workunit.client.0.smithi089.stdout:9/549: readlink d6/d18/d1b/da0/dae/lb4 0 2024-09-13T22:08:43.072 INFO:tasks.workunit.client.0.smithi089.stdout:9/550: write d6/d18/d1b/d89/db8/d5a/fa8 [518475,88768] 0 2024-09-13T22:08:43.072 INFO:tasks.workunit.client.0.smithi089.stdout:9/551: chown d6/d31/d5e/db1/fb6 920781 1 2024-09-13T22:08:43.073 INFO:tasks.workunit.client.0.smithi089.stdout:1/566: sync 2024-09-13T22:08:43.073 INFO:tasks.workunit.client.0.smithi089.stdout:2/461: sync 2024-09-13T22:08:43.073 INFO:tasks.workunit.client.0.smithi089.stdout:4/510: sync 2024-09-13T22:08:43.073 INFO:tasks.workunit.client.0.smithi089.stdout:2/462: truncate df/d1a/d57/d68/f7c 8895621 0 2024-09-13T22:08:43.073 INFO:tasks.workunit.client.0.smithi089.stdout:3/476: sync 2024-09-13T22:08:43.073 INFO:tasks.workunit.client.0.smithi089.stdout:4/511: dread d0/d15/d1f/f42 [0,4194304] 0 2024-09-13T22:08:43.073 INFO:tasks.workunit.client.0.smithi089.stdout:4/512: fsync d0/d2c/d35/d64/f78 0 2024-09-13T22:08:43.074 INFO:tasks.workunit.client.0.smithi089.stdout:8/493: mkdir d0/dd/d12/d20/d40/d4a/d7f/da6 0 2024-09-13T22:08:43.075 INFO:tasks.workunit.client.0.smithi089.stdout:7/463: rmdir d0/d19/d28/d1d/d2d 39 2024-09-13T22:08:43.075 INFO:tasks.workunit.client.0.smithi089.stdout:7/464: write d0/d19/d28/d1d/f5f [100631,51148] 0 2024-09-13T22:08:43.075 INFO:tasks.workunit.client.0.smithi089.stdout:7/465: fsync d0/d19/f2b 0 2024-09-13T22:08:43.076 INFO:tasks.workunit.client.0.smithi089.stdout:6/464: mkdir d0/d5/d43/d79/d92 0 2024-09-13T22:08:43.076 INFO:tasks.workunit.client.0.smithi089.stdout:6/465: readlink d0/d5/d1d/d2d/d55/l63 0 2024-09-13T22:08:43.076 INFO:tasks.workunit.client.0.smithi089.stdout:6/466: write d0/d4/d12/d15/d3b/d62/f80 [130775,97297] 0 2024-09-13T22:08:43.076 INFO:tasks.workunit.client.0.smithi089.stdout:6/467: readlink d0/d5/d1d/d2d/d55/l83 0 2024-09-13T22:08:43.078 INFO:tasks.workunit.client.0.smithi089.stdout:9/552: link d6/d54/f9d d6/d18/fbb 0 2024-09-13T22:08:43.078 INFO:tasks.workunit.client.0.smithi089.stdout:9/553: creat d6/d31/fbc x:0 0 0 2024-09-13T22:08:43.079 INFO:tasks.workunit.client.0.smithi089.stdout:1/567: truncate d7/d40/f71 3243529 0 2024-09-13T22:08:43.080 INFO:tasks.workunit.client.0.smithi089.stdout:2/463: link df/d14/f65 df/d14/d66/f99 0 2024-09-13T22:08:43.082 INFO:tasks.workunit.client.0.smithi089.stdout:3/477: mkdir d1/d7/d1b/d28/d97 0 2024-09-13T22:08:43.082 INFO:tasks.workunit.client.0.smithi089.stdout:3/478: chown d1/d7/d1b/d28/d63/c8f 8375128 1 2024-09-13T22:08:43.082 INFO:tasks.workunit.client.0.smithi089.stdout:3/479: creat d1/d2/d23/f98 x:0 0 0 2024-09-13T22:08:43.083 INFO:tasks.workunit.client.0.smithi089.stdout:5/462: dwrite d4/d19/d1e/d28/d31/d61/f90 [0,4194304] 0 2024-09-13T22:08:43.083 INFO:tasks.workunit.client.0.smithi089.stdout:1/568: creat d7/de/d3a/d77/fc5 x:0 0 0 2024-09-13T22:08:43.085 INFO:tasks.workunit.client.0.smithi089.stdout:8/494: rmdir d0/dd/d12/d20/d36/d59/d89/d8d 39 2024-09-13T22:08:43.086 INFO:tasks.workunit.client.0.smithi089.stdout:8/495: write d0/dd/d12/d42/f39 [1334921,123645] 0 2024-09-13T22:08:43.088 INFO:tasks.workunit.client.0.smithi089.stdout:9/554: dread d6/f15 [0,4194304] 0 2024-09-13T22:08:43.090 INFO:tasks.workunit.client.0.smithi089.stdout:0/695: dwrite d1/de/d10/d36/d57/f78 [0,4194304] 0 2024-09-13T22:08:43.090 INFO:tasks.workunit.client.0.smithi089.stdout:0/696: write d1/de/d15/f5c [1037674,8266] 0 2024-09-13T22:08:43.090 INFO:tasks.workunit.client.0.smithi089.stdout:0/697: stat d1/de/d10/d36/d38/fc1 0 2024-09-13T22:08:43.091 INFO:tasks.workunit.client.0.smithi089.stdout:7/466: dread d0/d19/d28/d1d/d23/d2e/d41/f65 [0,4194304] 0 2024-09-13T22:08:43.091 INFO:tasks.workunit.client.0.smithi089.stdout:7/467: chown d0/d19/d28/d61/f87 653552 1 2024-09-13T22:08:43.092 INFO:tasks.workunit.client.0.smithi089.stdout:3/480: dread d1/d2/d23/f35 [0,4194304] 0 2024-09-13T22:08:43.092 INFO:tasks.workunit.client.0.smithi089.stdout:3/481: fsync d1/d2/d4/d1c/d7e/f7a 0 2024-09-13T22:08:43.092 INFO:tasks.workunit.client.0.smithi089.stdout:3/482: chown d1/d2/d24/c78 274 1 2024-09-13T22:08:43.092 INFO:tasks.workunit.client.0.smithi089.stdout:3/483: fsync d1/d2/d4/d1c/f2a 0 2024-09-13T22:08:43.092 INFO:tasks.workunit.client.0.smithi089.stdout:3/484: chown d1/d7/l11 196411965 1 2024-09-13T22:08:43.092 INFO:tasks.workunit.client.0.smithi089.stdout:1/569: rename d7/d40/dbe/d2b/f2d to d7/d1c/fc6 0 2024-09-13T22:08:43.092 INFO:tasks.workunit.client.0.smithi089.stdout:1/570: write d7/de/d68/f90 [464778,67638] 0 2024-09-13T22:08:43.092 INFO:tasks.workunit.client.0.smithi089.stdout:8/496: symlink d0/dd/d12/d20/d1c/d5a/d63/la7 0 2024-09-13T22:08:43.094 INFO:tasks.workunit.client.0.smithi089.stdout:9/555: mkdir d6/d18/d1b/d3e/dbd 0 2024-09-13T22:08:43.098 INFO:tasks.workunit.client.0.smithi089.stdout:4/513: dwrite d0/d2c/f45 [0,4194304] 0 2024-09-13T22:08:43.099 INFO:tasks.workunit.client.0.smithi089.stdout:2/464: dwrite df/d14/f24 [0,4194304] 0 2024-09-13T22:08:43.099 INFO:tasks.workunit.client.0.smithi089.stdout:2/465: creat df/d14/d48/d88/f9a x:0 0 0 2024-09-13T22:08:43.101 INFO:tasks.workunit.client.0.smithi089.stdout:0/698: rmdir d1/de/d10/d36/d39/dd2 0 2024-09-13T22:08:43.101 INFO:tasks.workunit.client.0.smithi089.stdout:0/699: chown d1/de/d15/d41 29465 1 2024-09-13T22:08:43.101 INFO:tasks.workunit.client.0.smithi089.stdout:0/700: dread - d1/de/d15/d41/d87/fc7 zero size 2024-09-13T22:08:43.105 INFO:tasks.workunit.client.0.smithi089.stdout:7/468: creat d0/d19/d28/d1d/d3d/d69/f91 x:0 0 0 2024-09-13T22:08:43.107 INFO:tasks.workunit.client.0.smithi089.stdout:5/463: rmdir d4 39 2024-09-13T22:08:43.109 INFO:tasks.workunit.client.0.smithi089.stdout:1/571: symlink d7/d34/d5c/d5d/lc7 0 2024-09-13T22:08:43.110 INFO:tasks.workunit.client.0.smithi089.stdout:8/497: mknod d0/dd/d12/d20/d36/d80/ca8 0 2024-09-13T22:08:43.112 INFO:tasks.workunit.client.0.smithi089.stdout:4/514: creat d0/d15/fa6 x:0 0 0 2024-09-13T22:08:43.112 INFO:tasks.workunit.client.0.smithi089.stdout:4/515: write d0/d2c/d52/da5/f36 [580459,58808] 0 2024-09-13T22:08:43.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/466: symlink df/l9b 0 2024-09-13T22:08:43.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/467: chown df/d1a/c29 286 1 2024-09-13T22:08:43.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/468: read - df/d76/d85/f90 zero size 2024-09-13T22:08:43.119 INFO:tasks.workunit.client.0.smithi089.stdout:0/701: mknod d1/de/d10/d36/d3d/cf8 0 2024-09-13T22:08:43.121 INFO:tasks.workunit.client.0.smithi089.stdout:4/516: dread d0/f8 [0,4194304] 0 2024-09-13T22:08:43.121 INFO:tasks.workunit.client.0.smithi089.stdout:4/517: dread - d0/d2c/d35/d64/f6f zero size 2024-09-13T22:08:43.121 INFO:tasks.workunit.client.0.smithi089.stdout:3/485: link d1/d2/d4/d1c/d7e/d40/l75 d1/d2/l99 0 2024-09-13T22:08:43.121 INFO:tasks.workunit.client.0.smithi089.stdout:1/572: getdents d7/de/d68 0 2024-09-13T22:08:43.122 INFO:tasks.workunit.client.0.smithi089.stdout:4/518: read d0/d15/f2e [347069,36495] 0 2024-09-13T22:08:43.122 INFO:tasks.workunit.client.0.smithi089.stdout:9/556: rmdir d6/d54 39 2024-09-13T22:08:43.124 INFO:tasks.workunit.client.0.smithi089.stdout:2/469: mknod df/d76/c9c 0 2024-09-13T22:08:43.124 INFO:tasks.workunit.client.0.smithi089.stdout:2/470: creat df/d14/d48/d88/f9d x:0 0 0 2024-09-13T22:08:43.128 INFO:tasks.workunit.client.0.smithi089.stdout:0/702: rename d1/de/d10/d36/d38/f60 to d1/de/d15/d41/d87/ff9 0 2024-09-13T22:08:43.129 INFO:tasks.workunit.client.0.smithi089.stdout:3/486: mknod d1/d2/d4/d1c/d7e/d38/c9a 0 2024-09-13T22:08:43.131 INFO:tasks.workunit.client.0.smithi089.stdout:9/557: truncate d6/d18/d1b/d89/db8/f49 302710 0 2024-09-13T22:08:43.131 INFO:tasks.workunit.client.0.smithi089.stdout:2/471: symlink df/d1a/d57/l9e 0 2024-09-13T22:08:43.131 INFO:tasks.workunit.client.0.smithi089.stdout:0/703: write d1/de/d15/f8d [1550288,91192] 0 2024-09-13T22:08:43.133 INFO:tasks.workunit.client.0.smithi089.stdout:4/519: rename d0/d2c/d35/f4f to d0/fa7 0 2024-09-13T22:08:43.133 INFO:tasks.workunit.client.0.smithi089.stdout:3/487: mknod d1/d2/d23/d3d/c9b 0 2024-09-13T22:08:43.135 INFO:tasks.workunit.client.0.smithi089.stdout:2/472: unlink df/d14/d66/c98 0 2024-09-13T22:08:43.136 INFO:tasks.workunit.client.0.smithi089.stdout:9/558: mkdir d6/d18/d1b/d89/db8/dbe 0 2024-09-13T22:08:43.138 INFO:tasks.workunit.client.0.smithi089.stdout:7/469: dwrite d0/d19/d28/d1d/f64 [0,4194304] 0 2024-09-13T22:08:43.138 INFO:tasks.workunit.client.0.smithi089.stdout:0/704: rename d1/de/d10/d36/d38/l54 to d1/de/d10/d36/d38/d4e/d62/d5f/lfa 0 2024-09-13T22:08:43.138 INFO:tasks.workunit.client.0.smithi089.stdout:0/705: stat d1/de/d1f 0 2024-09-13T22:08:43.139 INFO:tasks.workunit.client.0.smithi089.stdout:4/520: creat d0/d2c/d52/da5/d62/fa8 x:0 0 0 2024-09-13T22:08:43.141 INFO:tasks.workunit.client.0.smithi089.stdout:3/488: symlink d1/d2/d43/l9c 0 2024-09-13T22:08:43.141 INFO:tasks.workunit.client.0.smithi089.stdout:3/489: chown d1/d2/d31 24890811 1 2024-09-13T22:08:43.141 INFO:tasks.workunit.client.0.smithi089.stdout:3/490: readlink d1/d2/d43/l49 0 2024-09-13T22:08:43.141 INFO:tasks.workunit.client.0.smithi089.stdout:3/491: write d1/d2/d24/f3b [3700374,82607] 0 2024-09-13T22:08:43.141 INFO:tasks.workunit.client.0.smithi089.stdout:9/559: dread d6/d18/d21/f62 [0,4194304] 0 2024-09-13T22:08:43.141 INFO:tasks.workunit.client.0.smithi089.stdout:9/560: readlink d6/d18/d1b/l65 0 2024-09-13T22:08:43.142 INFO:tasks.workunit.client.0.smithi089.stdout:5/464: dwrite d4/f5 [0,4194304] 0 2024-09-13T22:08:43.145 INFO:tasks.workunit.client.0.smithi089.stdout:1/573: dwrite d7/de/d3a/fa6 [0,4194304] 0 2024-09-13T22:08:43.145 INFO:tasks.workunit.client.0.smithi089.stdout:1/574: fdatasync d7/de/d3a/d77/f7c 0 2024-09-13T22:08:43.146 INFO:tasks.workunit.client.0.smithi089.stdout:7/470: mkdir d0/d19/d45/d92 0 2024-09-13T22:08:43.146 INFO:tasks.workunit.client.0.smithi089.stdout:7/471: readlink d0/l10 0 2024-09-13T22:08:43.146 INFO:tasks.workunit.client.0.smithi089.stdout:9/561: readlink d6/l13 0 2024-09-13T22:08:43.149 INFO:tasks.workunit.client.0.smithi089.stdout:5/465: creat d4/d19/d1e/d28/d31/d55/d58/fab x:0 0 0 2024-09-13T22:08:43.153 INFO:tasks.workunit.client.0.smithi089.stdout:9/562: stat d6/d18/d21/l37 0 2024-09-13T22:08:43.158 INFO:tasks.workunit.client.0.smithi089.stdout:7/472: mkdir d0/d19/d28/d1d/d23/d89/d93 0 2024-09-13T22:08:43.159 INFO:tasks.workunit.client.0.smithi089.stdout:5/466: mknod d4/d19/d1e/d28/d31/d55/d58/d9d/cac 0 2024-09-13T22:08:43.159 INFO:tasks.workunit.client.0.smithi089.stdout:5/467: getdents d4/d19/d1e/d28/d31/d55/da4 0 2024-09-13T22:08:43.159 INFO:tasks.workunit.client.0.smithi089.stdout:5/468: readlink d4/d19/d1e/d53/l9c 0 2024-09-13T22:08:43.159 INFO:tasks.workunit.client.0.smithi089.stdout:5/469: write d4/d19/d1e/d28/d31/fa9 [987375,4963] 0 2024-09-13T22:08:43.159 INFO:tasks.workunit.client.0.smithi089.stdout:5/470: creat d4/d19/d1e/d28/d31/d55/d58/fad x:0 0 0 2024-09-13T22:08:43.159 INFO:tasks.workunit.client.0.smithi089.stdout:9/563: mknod d6/d18/d1b/d89/db8/d52/cbf 0 2024-09-13T22:08:43.159 INFO:tasks.workunit.client.0.smithi089.stdout:7/473: truncate d0/f22 1636779 0 2024-09-13T22:08:43.163 INFO:tasks.workunit.client.0.smithi089.stdout:9/564: rename d6/d18/d1b/d89/db8/f49 to d6/d18/d1b/d3e/dbd/fc0 0 2024-09-13T22:08:43.163 INFO:tasks.workunit.client.0.smithi089.stdout:5/471: write d4/f27 [1955513,113764] 0 2024-09-13T22:08:43.165 INFO:tasks.workunit.client.0.smithi089.stdout:5/472: mkdir d4/d19/d1e/d53/dae 0 2024-09-13T22:08:43.165 INFO:tasks.workunit.client.0.smithi089.stdout:5/473: write d4/d19/d1e/d28/d31/f75 [641213,94569] 0 2024-09-13T22:08:43.165 INFO:tasks.workunit.client.0.smithi089.stdout:5/474: write d4/d19/d1e/d28/d31/d55/f6d [136467,94586] 0 2024-09-13T22:08:43.168 INFO:tasks.workunit.client.0.smithi089.stdout:2/473: dwrite df/d76/d85/f90 [0,4194304] 0 2024-09-13T22:08:43.168 INFO:tasks.workunit.client.0.smithi089.stdout:2/474: stat df/f74 0 2024-09-13T22:08:43.171 INFO:tasks.workunit.client.0.smithi089.stdout:2/475: unlink df/d76/d85/f90 0 2024-09-13T22:08:43.172 INFO:tasks.workunit.client.0.smithi089.stdout:2/476: rename df/d1a/c39 to df/d14/d66/d69/c9f 0 2024-09-13T22:08:43.173 INFO:tasks.workunit.client.0.smithi089.stdout:2/477: symlink df/d14/d2b/la0 0 2024-09-13T22:08:43.174 INFO:tasks.workunit.client.0.smithi089.stdout:2/478: symlink df/d14/d2b/d4b/la1 0 2024-09-13T22:08:43.175 INFO:tasks.workunit.client.0.smithi089.stdout:2/479: creat df/d14/d48/d88/fa2 x:0 0 0 2024-09-13T22:08:43.175 INFO:tasks.workunit.client.0.smithi089.stdout:2/480: stat df/d1a/d57/f83 0 2024-09-13T22:08:43.176 INFO:tasks.workunit.client.0.smithi089.stdout:0/706: dwrite d1/de/d15/d41/d49/d76/d8b/fa3 [0,4194304] 0 2024-09-13T22:08:43.176 INFO:tasks.workunit.client.0.smithi089.stdout:7/474: write d0/d19/d28/d1d/d23/d24/f29 [6407756,61928] 0 2024-09-13T22:08:43.176 INFO:tasks.workunit.client.0.smithi089.stdout:3/492: dwrite d1/d2/d23/d3d/f4d [4194304,4194304] 0 2024-09-13T22:08:43.181 INFO:tasks.workunit.client.0.smithi089.stdout:9/565: read d6/d18/f1f [733190,119794] 0 2024-09-13T22:08:43.181 INFO:tasks.workunit.client.0.smithi089.stdout:9/566: fsync d6/d18/d21/f27 0 2024-09-13T22:08:43.181 INFO:tasks.workunit.client.0.smithi089.stdout:1/575: dwrite d7/d40/dbe/d80/fa5 [0,4194304] 0 2024-09-13T22:08:43.181 INFO:tasks.workunit.client.0.smithi089.stdout:1/576: truncate d7/f26 8672991 0 2024-09-13T22:08:43.188 INFO:tasks.workunit.client.0.smithi089.stdout:7/475: dread d0/fd [0,4194304] 0 2024-09-13T22:08:43.188 INFO:tasks.workunit.client.0.smithi089.stdout:1/577: mknod d7/de/d3a/cc8 0 2024-09-13T22:08:43.189 INFO:tasks.workunit.client.0.smithi089.stdout:3/493: write d1/d2/d4/f5e [1154699,130363] 0 2024-09-13T22:08:43.191 INFO:tasks.workunit.client.0.smithi089.stdout:1/578: mknod d7/d40/dbe/d2b/d39/d73/da9/cc9 0 2024-09-13T22:08:43.191 INFO:tasks.workunit.client.0.smithi089.stdout:1/579: write d7/d1c/fc3 [38814,20424] 0 2024-09-13T22:08:43.192 INFO:tasks.workunit.client.0.smithi089.stdout:3/494: dread d1/d2/d4/d1c/f2a [8388608,4194304] 0 2024-09-13T22:08:43.192 INFO:tasks.workunit.client.0.smithi089.stdout:7/476: getdents d0/d19/d28/d1d/d23 0 2024-09-13T22:08:43.194 INFO:tasks.workunit.client.0.smithi089.stdout:7/477: symlink d0/d19/d28/d1d/d23/d89/l94 0 2024-09-13T22:08:43.195 INFO:tasks.workunit.client.0.smithi089.stdout:7/478: write d0/f8c [170688,28103] 0 2024-09-13T22:08:43.195 INFO:tasks.workunit.client.0.smithi089.stdout:7/479: truncate d0/d19/d28/d1d/d23/f56 4965890 0 2024-09-13T22:08:43.199 INFO:tasks.workunit.client.0.smithi089.stdout:1/580: dread d7/d40/dbe/d80/f82 [0,4194304] 0 2024-09-13T22:08:43.199 INFO:tasks.workunit.client.0.smithi089.stdout:1/581: truncate d7/d34/fba 810670 0 2024-09-13T22:08:43.199 INFO:tasks.workunit.client.0.smithi089.stdout:1/582: symlink d7/d40/lca 0 2024-09-13T22:08:43.205 INFO:tasks.workunit.client.0.smithi089.stdout:3/495: dread d1/d2/d4/f16 [0,4194304] 0 2024-09-13T22:08:43.208 INFO:tasks.workunit.client.0.smithi089.stdout:2/481: dwrite df/d14/d66/d69/d2e/f3c [0,4194304] 0 2024-09-13T22:08:43.208 INFO:tasks.workunit.client.0.smithi089.stdout:0/707: dwrite d1/de/d15/d41/d49/d76/d8b/fdb [0,4194304] 0 2024-09-13T22:08:43.209 INFO:tasks.workunit.client.0.smithi089.stdout:0/708: creat d1/de/d10/d85/ffb x:0 0 0 2024-09-13T22:08:43.209 INFO:tasks.workunit.client.0.smithi089.stdout:3/496: write d1/d2/d23/f35 [3019433,25857] 0 2024-09-13T22:08:43.209 INFO:tasks.workunit.client.0.smithi089.stdout:2/482: mkdir df/d1a/d57/da3 0 2024-09-13T22:08:43.212 INFO:tasks.workunit.client.0.smithi089.stdout:9/567: dwrite d6/faa [4194304,4194304] 0 2024-09-13T22:08:43.213 INFO:tasks.workunit.client.0.smithi089.stdout:2/483: creat df/d1a/fa4 x:0 0 0 2024-09-13T22:08:43.213 INFO:tasks.workunit.client.0.smithi089.stdout:2/484: write df/d14/d66/d69/d2e/f7f [592186,30575] 0 2024-09-13T22:08:43.217 INFO:tasks.workunit.client.0.smithi089.stdout:1/583: write d7/d40/f75 [3584721,40444] 0 2024-09-13T22:08:43.217 INFO:tasks.workunit.client.0.smithi089.stdout:1/584: truncate d7/d34/f7e 1225322 0 2024-09-13T22:08:43.217 INFO:tasks.workunit.client.0.smithi089.stdout:1/585: chown d7/d34/d5c/f92 32520 1 2024-09-13T22:08:43.218 INFO:tasks.workunit.client.0.smithi089.stdout:1/586: truncate d7/de/f27 780141 0 2024-09-13T22:08:43.221 INFO:tasks.workunit.client.0.smithi089.stdout:3/497: write d1/f6 [1319296,119499] 0 2024-09-13T22:08:43.223 INFO:tasks.workunit.client.0.smithi089.stdout:3/498: creat d1/d7/f9d x:0 0 0 2024-09-13T22:08:43.233 INFO:tasks.workunit.client.0.smithi089.stdout:0/709: dwrite d1/de/d10/d36/d38/d4e/d62/f74 [0,4194304] 0 2024-09-13T22:08:43.233 INFO:tasks.workunit.client.0.smithi089.stdout:9/568: dwrite d6/d54/fa4 [0,4194304] 0 2024-09-13T22:08:43.238 INFO:tasks.workunit.client.0.smithi089.stdout:9/569: mknod d6/d18/d21/d5d/d6c/d8d/cc1 0 2024-09-13T22:08:43.238 INFO:tasks.workunit.client.0.smithi089.stdout:9/570: dread - d6/d31/d5e/db1/fb6 zero size 2024-09-13T22:08:43.240 INFO:tasks.workunit.client.0.smithi089.stdout:3/499: dwrite d1/d7/d1b/f59 [0,4194304] 0 2024-09-13T22:08:43.240 INFO:tasks.workunit.client.0.smithi089.stdout:9/571: symlink d6/d31/lc2 0 2024-09-13T22:08:43.242 INFO:tasks.workunit.client.0.smithi089.stdout:9/572: dread d6/d18/d1b/d3e/dbd/fc0 [0,4194304] 0 2024-09-13T22:08:43.242 INFO:tasks.workunit.client.0.smithi089.stdout:3/500: mknod d1/d2/d4/d1c/d7e/d40/c9e 0 2024-09-13T22:08:43.244 INFO:tasks.workunit.client.0.smithi089.stdout:3/501: creat d1/d2/d23/d3d/d54/d95/f9f x:0 0 0 2024-09-13T22:08:43.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/468: sync 2024-09-13T22:08:43.245 INFO:tasks.workunit.client.0.smithi089.stdout:8/498: sync 2024-09-13T22:08:43.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/469: truncate d0/d4/d12/f70 791570 0 2024-09-13T22:08:43.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/470: dread - d0/d4/d12/f41 zero size 2024-09-13T22:08:43.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/471: creat d0/d4/d12/d15/f93 x:0 0 0 2024-09-13T22:08:43.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/472: chown d0/d5/d1d/f82 121842649 1 2024-09-13T22:08:43.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/473: chown d0/d4/c75 226889 1 2024-09-13T22:08:43.246 INFO:tasks.workunit.client.0.smithi089.stdout:8/499: mknod d0/dd/d12/d20/d36/d59/d5d/ca9 0 2024-09-13T22:08:43.246 INFO:tasks.workunit.client.0.smithi089.stdout:8/500: readlink d0/dd/d12/l61 0 2024-09-13T22:08:43.246 INFO:tasks.workunit.client.0.smithi089.stdout:8/501: dread - d0/dd/d12/d20/d36/d80/f97 zero size 2024-09-13T22:08:43.246 INFO:tasks.workunit.client.0.smithi089.stdout:8/502: stat d0/dd/d12/d20/d36/c1f 0 2024-09-13T22:08:43.246 INFO:tasks.workunit.client.0.smithi089.stdout:6/474: mkdir d0/d5/d1d/d56/d60/d94 0 2024-09-13T22:08:43.247 INFO:tasks.workunit.client.0.smithi089.stdout:8/503: unlink d0/dd/d12/d20/d36/d57/c5f 0 2024-09-13T22:08:43.249 INFO:tasks.workunit.client.0.smithi089.stdout:6/475: rename d0/d5/d1d/c45 to d0/d5/d64/c95 0 2024-09-13T22:08:43.249 INFO:tasks.workunit.client.0.smithi089.stdout:6/476: readlink d0/d5/d1d/d2d/d55/l83 0 2024-09-13T22:08:43.254 INFO:tasks.workunit.client.0.smithi089.stdout:3/502: dread d1/d2/d4/f1a [0,4194304] 0 2024-09-13T22:08:43.254 INFO:tasks.workunit.client.0.smithi089.stdout:3/503: chown d1/d2/d4/d1c/d7e/d40/c9e 1016 1 2024-09-13T22:08:43.254 INFO:tasks.workunit.client.0.smithi089.stdout:3/504: chown d1/d7/d1b/d28/d63/f6d 9438695 1 2024-09-13T22:08:43.254 INFO:tasks.workunit.client.0.smithi089.stdout:3/505: readlink d1/d7/d1b/l58 0 2024-09-13T22:08:43.256 INFO:tasks.workunit.client.0.smithi089.stdout:3/506: truncate d1/d7/d1b/f4e 3299478 0 2024-09-13T22:08:43.256 INFO:tasks.workunit.client.0.smithi089.stdout:3/507: chown d1/d7/d1b/d28/d97 6020 1 2024-09-13T22:08:43.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/573: dread d6/f5c [0,4194304] 0 2024-09-13T22:08:43.257 INFO:tasks.workunit.client.0.smithi089.stdout:0/710: dwrite d1/de/d10/d36/ff5 [0,4194304] 0 2024-09-13T22:08:43.257 INFO:tasks.workunit.client.0.smithi089.stdout:0/711: chown d1/de/d10/d36/d38/d4e/d62/d5f/db6/fc9 28811 1 2024-09-13T22:08:43.262 INFO:tasks.workunit.client.0.smithi089.stdout:8/504: read d0/dd/d12/d3a/f43 [104092,105197] 0 2024-09-13T22:08:43.262 INFO:tasks.workunit.client.0.smithi089.stdout:8/505: dread - d0/dd/d12/d20/d36/d80/d3b/d88/f96 zero size 2024-09-13T22:08:43.262 INFO:tasks.workunit.client.0.smithi089.stdout:8/506: stat d0/dd/f81 0 2024-09-13T22:08:43.262 INFO:tasks.workunit.client.0.smithi089.stdout:3/508: unlink d1/d2/d4/f12 0 2024-09-13T22:08:43.262 INFO:tasks.workunit.client.0.smithi089.stdout:0/712: unlink d1/de/d10/d36/d57/d3a/ca2 0 2024-09-13T22:08:43.262 INFO:tasks.workunit.client.0.smithi089.stdout:3/509: write d1/d7/d1b/d28/d63/f79 [375108,27620] 0 2024-09-13T22:08:43.262 INFO:tasks.workunit.client.0.smithi089.stdout:0/713: stat d1/de/d10/fb4 0 2024-09-13T22:08:43.262 INFO:tasks.workunit.client.0.smithi089.stdout:8/507: write d0/dd/d12/f1a [3483741,99151] 0 2024-09-13T22:08:43.264 INFO:tasks.workunit.client.0.smithi089.stdout:0/714: rmdir d1/de/d10/db0 39 2024-09-13T22:08:43.264 INFO:tasks.workunit.client.0.smithi089.stdout:0/715: write d1/de/d10/d36/d38/fc1 [635901,112641] 0 2024-09-13T22:08:43.265 INFO:tasks.workunit.client.0.smithi089.stdout:6/477: dwrite d0/f2e [0,4194304] 0 2024-09-13T22:08:43.265 INFO:tasks.workunit.client.0.smithi089.stdout:3/510: unlink d1/d7/f15 0 2024-09-13T22:08:43.268 INFO:tasks.workunit.client.0.smithi089.stdout:8/508: dread d0/dd/d12/d42/f77 [0,4194304] 0 2024-09-13T22:08:43.268 INFO:tasks.workunit.client.0.smithi089.stdout:8/509: stat d0/dd/d12/d20/d40/c65 0 2024-09-13T22:08:43.268 INFO:tasks.workunit.client.0.smithi089.stdout:8/510: truncate d0/dd/d12/d20/d36/f21 605990 0 2024-09-13T22:08:43.268 INFO:tasks.workunit.client.0.smithi089.stdout:8/511: rename d0/dd/d12/d20 to d0/dd/d12/d20/d1c/d5a/d63/daa 22 2024-09-13T22:08:43.278 INFO:tasks.workunit.client.0.smithi089.stdout:9/574: dwrite d6/d54/fb5 [0,4194304] 0 2024-09-13T22:08:43.281 INFO:tasks.workunit.client.0.smithi089.stdout:0/716: dread d1/de/d10/d36/d38/d4e/d62/f74 [0,4194304] 0 2024-09-13T22:08:43.282 INFO:tasks.workunit.client.0.smithi089.stdout:6/478: write d0/d4/d12/d15/f71 [2422301,14639] 0 2024-09-13T22:08:43.283 INFO:tasks.workunit.client.0.smithi089.stdout:9/575: mknod d6/d18/d1b/d89/db8/cc3 0 2024-09-13T22:08:43.284 INFO:tasks.workunit.client.0.smithi089.stdout:9/576: truncate d6/f81 429502 0 2024-09-13T22:08:43.284 INFO:tasks.workunit.client.0.smithi089.stdout:0/717: stat d1/de/d1f/lc0 0 2024-09-13T22:08:43.284 INFO:tasks.workunit.client.0.smithi089.stdout:0/718: fdatasync d1/de/d15/d41/d87/fcf 0 2024-09-13T22:08:43.285 INFO:tasks.workunit.client.0.smithi089.stdout:6/479: creat d0/f96 x:0 0 0 2024-09-13T22:08:43.286 INFO:tasks.workunit.client.0.smithi089.stdout:6/480: symlink d0/d4/d12/d15/d3b/l97 0 2024-09-13T22:08:43.286 INFO:tasks.workunit.client.0.smithi089.stdout:6/481: truncate d0/f11 2289316 0 2024-09-13T22:08:43.286 INFO:tasks.workunit.client.0.smithi089.stdout:6/482: chown d0/d5/f23 621932 1 2024-09-13T22:08:43.287 INFO:tasks.workunit.client.0.smithi089.stdout:6/483: symlink d0/d5/d1d/d2d/l98 0 2024-09-13T22:08:43.288 INFO:tasks.workunit.client.0.smithi089.stdout:6/484: link d0/d4/d12/d15/l1a d0/d5/d1d/l99 0 2024-09-13T22:08:43.298 INFO:tasks.workunit.client.0.smithi089.stdout:9/577: dread d6/ff [0,4194304] 0 2024-09-13T22:08:43.298 INFO:tasks.workunit.client.0.smithi089.stdout:9/578: chown d6/d18/d1b/da0/dae 435229921 1 2024-09-13T22:08:43.298 INFO:tasks.workunit.client.0.smithi089.stdout:9/579: write d6/d18/f32 [4167391,53001] 0 2024-09-13T22:08:43.300 INFO:tasks.workunit.client.0.smithi089.stdout:3/511: dwrite d1/d2/d24/f89 [0,4194304] 0 2024-09-13T22:08:43.309 INFO:tasks.workunit.client.0.smithi089.stdout:8/512: dwrite d0/d6a/f8a [4194304,4194304] 0 2024-09-13T22:08:43.311 INFO:tasks.workunit.client.0.smithi089.stdout:8/513: truncate d0/dd/f35 383647 0 2024-09-13T22:08:43.312 INFO:tasks.workunit.client.0.smithi089.stdout:8/514: creat d0/dd/d12/d20/d36/fab x:0 0 0 2024-09-13T22:08:43.312 INFO:tasks.workunit.client.0.smithi089.stdout:8/515: stat d0/dd/d12/d3a/f43 0 2024-09-13T22:08:43.312 INFO:tasks.workunit.client.0.smithi089.stdout:5/475: sync 2024-09-13T22:08:43.313 INFO:tasks.workunit.client.0.smithi089.stdout:8/516: link d0/dd/d12/d3a/c9b d0/dd/d12/cac 0 2024-09-13T22:08:43.314 INFO:tasks.workunit.client.0.smithi089.stdout:5/476: creat d4/d19/d1e/d28/d3d/faf x:0 0 0 2024-09-13T22:08:43.314 INFO:tasks.workunit.client.0.smithi089.stdout:4/521: sync 2024-09-13T22:08:43.314 INFO:tasks.workunit.client.0.smithi089.stdout:4/522: readlink d0/d2c/d35/d64/l6d 0 2024-09-13T22:08:43.315 INFO:tasks.workunit.client.0.smithi089.stdout:4/523: write d0/d2c/d35/d5d/f8a [386103,54626] 0 2024-09-13T22:08:43.315 INFO:tasks.workunit.client.0.smithi089.stdout:5/477: creat d4/d19/d1e/d28/d31/d55/fb0 x:0 0 0 2024-09-13T22:08:43.318 INFO:tasks.workunit.client.0.smithi089.stdout:4/524: mkdir d0/d2c/da0/da9 0 2024-09-13T22:08:43.318 INFO:tasks.workunit.client.0.smithi089.stdout:4/525: dread - d0/d2c/d52/da5/d62/fa3 zero size 2024-09-13T22:08:43.323 INFO:tasks.workunit.client.0.smithi089.stdout:4/526: dread d0/d11/f21 [0,4194304] 0 2024-09-13T22:08:43.323 INFO:tasks.workunit.client.0.smithi089.stdout:4/527: stat d0/d15/d83/c97 0 2024-09-13T22:08:43.324 INFO:tasks.workunit.client.0.smithi089.stdout:4/528: stat d0/f8 0 2024-09-13T22:08:43.325 INFO:tasks.workunit.client.0.smithi089.stdout:9/580: dwrite d6/d18/dab/f41 [0,4194304] 0 2024-09-13T22:08:43.325 INFO:tasks.workunit.client.0.smithi089.stdout:0/719: dwrite d1/de/d10/f9a [0,4194304] 0 2024-09-13T22:08:43.329 INFO:tasks.workunit.client.0.smithi089.stdout:9/581: mknod d6/d18/d21/cc4 0 2024-09-13T22:08:43.329 INFO:tasks.workunit.client.0.smithi089.stdout:9/582: creat d6/d18/dab/fc5 x:0 0 0 2024-09-13T22:08:43.330 INFO:tasks.workunit.client.0.smithi089.stdout:9/583: truncate d6/f10 1639956 0 2024-09-13T22:08:43.336 INFO:tasks.workunit.client.0.smithi089.stdout:9/584: link d6/d18/f1d d6/d18/d21/d5d/d6c/d8d/fc6 0 2024-09-13T22:08:43.337 INFO:tasks.workunit.client.0.smithi089.stdout:9/585: write d6/d18/f70 [190130,114495] 0 2024-09-13T22:08:43.337 INFO:tasks.workunit.client.0.smithi089.stdout:9/586: chown d6/d18/d1b/d89/db8/d52/f4e 21482 1 2024-09-13T22:08:43.337 INFO:tasks.workunit.client.0.smithi089.stdout:9/587: chown d6/d18/d1b/d89/db8/d52/l63 765336 1 2024-09-13T22:08:43.338 INFO:tasks.workunit.client.0.smithi089.stdout:9/588: rename d6/d18/d1b/d89/db8/d52/f8e to d6/d18/d1b/d3e/dbd/fc7 0 2024-09-13T22:08:43.339 INFO:tasks.workunit.client.0.smithi089.stdout:8/517: dwrite d0/dd/d12/d20/d40/f71 [0,4194304] 0 2024-09-13T22:08:43.340 INFO:tasks.workunit.client.0.smithi089.stdout:9/589: link d6/d31/l3a d6/d31/d5e/db1/lc8 0 2024-09-13T22:08:43.342 INFO:tasks.workunit.client.0.smithi089.stdout:9/590: creat d6/d18/d21/d5d/d6c/d8d/fc9 x:0 0 0 2024-09-13T22:08:43.344 INFO:tasks.workunit.client.0.smithi089.stdout:8/518: getdents d0/dd/d12/d3a 0 2024-09-13T22:08:43.344 INFO:tasks.workunit.client.0.smithi089.stdout:8/519: chown d0/dd/f35 0 1 2024-09-13T22:08:43.344 INFO:tasks.workunit.client.0.smithi089.stdout:8/520: write d0/dd/f7d [2469414,9862] 0 2024-09-13T22:08:43.344 INFO:tasks.workunit.client.0.smithi089.stdout:7/480: sync 2024-09-13T22:08:43.345 INFO:tasks.workunit.client.0.smithi089.stdout:8/521: dread d0/dd/f35 [0,4194304] 0 2024-09-13T22:08:43.346 INFO:tasks.workunit.client.0.smithi089.stdout:9/591: rename d6/c3b to d6/d18/cca 0 2024-09-13T22:08:43.347 INFO:tasks.workunit.client.0.smithi089.stdout:5/478: dwrite d4/d19/d1e/d28/d31/d35/d46/fa8 [0,4194304] 0 2024-09-13T22:08:43.348 INFO:tasks.workunit.client.0.smithi089.stdout:7/481: link d0/d19/d28/d1d/d23/d24/f8d d0/d19/d45/f95 0 2024-09-13T22:08:43.350 INFO:tasks.workunit.client.0.smithi089.stdout:8/522: rename d0/dd/d12/c9a to d0/dd/d12/d20/d36/d59/cad 0 2024-09-13T22:08:43.352 INFO:tasks.workunit.client.0.smithi089.stdout:9/592: mkdir d6/d54/dcb 0 2024-09-13T22:08:43.354 INFO:tasks.workunit.client.0.smithi089.stdout:5/479: write d4/d19/f3c [306971,122106] 0 2024-09-13T22:08:43.355 INFO:tasks.workunit.client.0.smithi089.stdout:5/480: chown d4/d19/d1e/d28/ca3 348 1 2024-09-13T22:08:43.355 INFO:tasks.workunit.client.0.smithi089.stdout:5/481: fdatasync d4/f5 0 2024-09-13T22:08:43.355 INFO:tasks.workunit.client.0.smithi089.stdout:5/482: truncate d4/f54 819819 0 2024-09-13T22:08:43.355 INFO:tasks.workunit.client.0.smithi089.stdout:5/483: dread - d4/d19/d1e/d28/d31/d55/d58/fab zero size 2024-09-13T22:08:43.355 INFO:tasks.workunit.client.0.smithi089.stdout:5/484: chown d4/d19/d1e/d28/d3d/c42 0 1 2024-09-13T22:08:43.356 INFO:tasks.workunit.client.0.smithi089.stdout:4/529: dwrite d0/d2c/d35/d74/f7e [0,4194304] 0 2024-09-13T22:08:43.356 INFO:tasks.workunit.client.0.smithi089.stdout:4/530: truncate d0/f1a 4655023 0 2024-09-13T22:08:43.356 INFO:tasks.workunit.client.0.smithi089.stdout:0/720: dwrite d1/de/d10/d36/d38/f86 [0,4194304] 0 2024-09-13T22:08:43.356 INFO:tasks.workunit.client.0.smithi089.stdout:7/482: rename d0/d19/d28/d1d/d23/d24/l36 to d0/d19/d28/d1d/d30/l96 0 2024-09-13T22:08:43.357 INFO:tasks.workunit.client.0.smithi089.stdout:8/523: symlink d0/dd/d12/d20/d36/d80/lae 0 2024-09-13T22:08:43.360 INFO:tasks.workunit.client.0.smithi089.stdout:4/531: link d0/d11/c50 d0/d2c/d35/d74/caa 0 2024-09-13T22:08:43.365 INFO:tasks.workunit.client.0.smithi089.stdout:0/721: unlink d1/de/d15/d2a/l51 0 2024-09-13T22:08:43.366 INFO:tasks.workunit.client.0.smithi089.stdout:9/593: rename d6/d18/d1b/d89/db8/d52/l63 to d6/d54/dcb/lcc 0 2024-09-13T22:08:43.368 INFO:tasks.workunit.client.0.smithi089.stdout:7/483: creat d0/d19/d28/d7b/f97 x:0 0 0 2024-09-13T22:08:43.368 INFO:tasks.workunit.client.0.smithi089.stdout:7/484: creat d0/d19/f98 x:0 0 0 2024-09-13T22:08:43.369 INFO:tasks.workunit.client.0.smithi089.stdout:8/524: truncate d0/f5 3999754 0 2024-09-13T22:08:43.371 INFO:tasks.workunit.client.0.smithi089.stdout:4/532: unlink d0/d11/d16/f2d 0 2024-09-13T22:08:43.371 INFO:tasks.workunit.client.0.smithi089.stdout:4/533: write d0/d2c/d35/f87 [783832,76160] 0 2024-09-13T22:08:43.371 INFO:tasks.workunit.client.0.smithi089.stdout:4/534: write d0/d11/f30 [572666,97848] 0 2024-09-13T22:08:43.375 INFO:tasks.workunit.client.0.smithi089.stdout:8/525: symlink d0/dd/d12/d42/laf 0 2024-09-13T22:08:43.375 INFO:tasks.workunit.client.0.smithi089.stdout:8/526: chown d0/dd/d12/d20/d36/d59/ca1 2879 1 2024-09-13T22:08:43.375 INFO:tasks.workunit.client.0.smithi089.stdout:8/527: dread - d0/dd/d12/d42/f2c zero size 2024-09-13T22:08:43.375 INFO:tasks.workunit.client.0.smithi089.stdout:7/485: dread d0/d19/f2b [0,4194304] 0 2024-09-13T22:08:43.375 INFO:tasks.workunit.client.0.smithi089.stdout:7/486: write d0/d19/d45/f95 [624598,28693] 0 2024-09-13T22:08:43.376 INFO:tasks.workunit.client.0.smithi089.stdout:7/487: fdatasync d0/d19/d28/d1d/d2d/d3c/f37 0 2024-09-13T22:08:43.378 INFO:tasks.workunit.client.0.smithi089.stdout:0/722: rename d1/de/d1f/fd7 to d1/de/d15/d2a/ffc 0 2024-09-13T22:08:43.378 INFO:tasks.workunit.client.0.smithi089.stdout:2/485: sync 2024-09-13T22:08:43.378 INFO:tasks.workunit.client.0.smithi089.stdout:2/486: dread - df/f92 zero size 2024-09-13T22:08:43.381 INFO:tasks.workunit.client.0.smithi089.stdout:2/487: rmdir df/d1a/d57 39 2024-09-13T22:08:43.381 INFO:tasks.workunit.client.0.smithi089.stdout:4/535: dread d0/d2c/d52/f5a [0,4194304] 0 2024-09-13T22:08:43.392 INFO:tasks.workunit.client.0.smithi089.stdout:9/594: dwrite d6/d18/d1b/d89/db8/d52/f4e [0,4194304] 0 2024-09-13T22:08:43.393 INFO:tasks.workunit.client.0.smithi089.stdout:2/488: mkdir df/d5b/da5 0 2024-09-13T22:08:43.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/536: write d0/d2c/f45 [1647192,124139] 0 2024-09-13T22:08:43.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/537: dread - d0/d2c/d35/d64/d6e/f77 zero size 2024-09-13T22:08:43.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/538: dread - d0/d15/d1f/d75/f9f zero size 2024-09-13T22:08:43.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/539: write d0/d2c/d52/da5/d62/fa3 [336710,41472] 0 2024-09-13T22:08:43.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/540: chown d0/d15/d76/l98 0 1 2024-09-13T22:08:43.395 INFO:tasks.workunit.client.0.smithi089.stdout:8/528: rename d0/dd/d12 to d0/dd/db0 0 2024-09-13T22:08:43.399 INFO:tasks.workunit.client.0.smithi089.stdout:2/489: mknod df/d5b/ca6 0 2024-09-13T22:08:43.399 INFO:tasks.workunit.client.0.smithi089.stdout:2/490: write df/d14/d66/d69/f44 [1497509,106228] 0 2024-09-13T22:08:43.400 INFO:tasks.workunit.client.0.smithi089.stdout:4/541: creat d0/d2c/d52/da5/d8e/fab x:0 0 0 2024-09-13T22:08:43.400 INFO:tasks.workunit.client.0.smithi089.stdout:4/542: truncate d0/d11/f30 2100098 0 2024-09-13T22:08:43.400 INFO:tasks.workunit.client.0.smithi089.stdout:4/543: readlink d0/d2c/l56 0 2024-09-13T22:08:43.400 INFO:tasks.workunit.client.0.smithi089.stdout:4/544: stat d0/d2c/d52/da5/d62/d8c/c92 0 2024-09-13T22:08:43.400 INFO:tasks.workunit.client.0.smithi089.stdout:4/545: creat d0/d2c/d35/d5d/fac x:0 0 0 2024-09-13T22:08:43.400 INFO:tasks.workunit.client.0.smithi089.stdout:4/546: creat d0/d15/d1f/d75/fad x:0 0 0 2024-09-13T22:08:43.401 INFO:tasks.workunit.client.0.smithi089.stdout:8/529: mkdir d0/dd/db0/d20/d40/d4a/d7f/da6/db1 0 2024-09-13T22:08:43.402 INFO:tasks.workunit.client.0.smithi089.stdout:0/723: dwrite d1/de/d10/d36/d38/fc1 [0,4194304] 0 2024-09-13T22:08:43.402 INFO:tasks.workunit.client.0.smithi089.stdout:2/491: rmdir df/d14/d2b/d4b 39 2024-09-13T22:08:43.404 INFO:tasks.workunit.client.0.smithi089.stdout:4/547: mknod d0/d2c/da1/cae 0 2024-09-13T22:08:43.404 INFO:tasks.workunit.client.0.smithi089.stdout:4/548: stat d0/d15/f2e 0 2024-09-13T22:08:43.407 INFO:tasks.workunit.client.0.smithi089.stdout:8/530: rename d0/dd/db0/d20/d36/f58 to d0/dd/db0/fb2 0 2024-09-13T22:08:43.409 INFO:tasks.workunit.client.0.smithi089.stdout:9/595: dread d6/d54/f9c [0,4194304] 0 2024-09-13T22:08:43.409 INFO:tasks.workunit.client.0.smithi089.stdout:8/531: creat d0/dd/db0/d20/d36/d80/d3b/da5/fb3 x:0 0 0 2024-09-13T22:08:43.409 INFO:tasks.workunit.client.0.smithi089.stdout:9/596: fdatasync d6/d18/d1b/d89/db8/d5a/fa8 0 2024-09-13T22:08:43.409 INFO:tasks.workunit.client.0.smithi089.stdout:8/532: fdatasync d0/dd/f14 0 2024-09-13T22:08:43.409 INFO:tasks.workunit.client.0.smithi089.stdout:9/597: chown d6/d31/c60 11108226 1 2024-09-13T22:08:43.409 INFO:tasks.workunit.client.0.smithi089.stdout:2/492: dread df/f22 [0,4194304] 0 2024-09-13T22:08:43.409 INFO:tasks.workunit.client.0.smithi089.stdout:2/493: read - df/d14/d66/f70 zero size 2024-09-13T22:08:43.409 INFO:tasks.workunit.client.0.smithi089.stdout:2/494: chown df/l27 260226 1 2024-09-13T22:08:43.409 INFO:tasks.workunit.client.0.smithi089.stdout:2/495: fdatasync df/d14/d2b/f36 0 2024-09-13T22:08:43.410 INFO:tasks.workunit.client.0.smithi089.stdout:0/724: dread d1/de/d10/d36/d38/d4e/d62/d5f/d72/f83 [0,4194304] 0 2024-09-13T22:08:43.410 INFO:tasks.workunit.client.0.smithi089.stdout:0/725: fsync d1/de/d10/d36/d57/d3a/db7/ff3 0 2024-09-13T22:08:43.410 INFO:tasks.workunit.client.0.smithi089.stdout:8/533: symlink d0/dd/db0/d20/d1c/lb4 0 2024-09-13T22:08:43.410 INFO:tasks.workunit.client.0.smithi089.stdout:0/726: truncate d1/f5 624039 0 2024-09-13T22:08:43.411 INFO:tasks.workunit.client.0.smithi089.stdout:0/727: dread - d1/de/d10/fb4 zero size 2024-09-13T22:08:43.411 INFO:tasks.workunit.client.0.smithi089.stdout:0/728: fdatasync d1/de/d15/d41/d87/fcf 0 2024-09-13T22:08:43.411 INFO:tasks.workunit.client.0.smithi089.stdout:8/534: mknod d0/dd/db0/d20/d40/d4a/d7f/da6/cb5 0 2024-09-13T22:08:43.413 INFO:tasks.workunit.client.0.smithi089.stdout:8/535: rmdir d0/dd/db0/d20/d40/d4a/d7f/da6/db1 0 2024-09-13T22:08:43.417 INFO:tasks.workunit.client.0.smithi089.stdout:2/496: dread df/d14/d66/d69/f44 [0,4194304] 0 2024-09-13T22:08:43.417 INFO:tasks.workunit.client.0.smithi089.stdout:2/497: chown df/d14/d2b/d4b/la1 658592473 1 2024-09-13T22:08:43.417 INFO:tasks.workunit.client.0.smithi089.stdout:2/498: truncate df/d14/f24 4579006 0 2024-09-13T22:08:43.417 INFO:tasks.workunit.client.0.smithi089.stdout:8/536: creat d0/dd/db0/d3a/d83/fb6 x:0 0 0 2024-09-13T22:08:43.420 INFO:tasks.workunit.client.0.smithi089.stdout:8/537: getdents d0/dd/db0/d20/d36/d59/d89 0 2024-09-13T22:08:43.422 INFO:tasks.workunit.client.0.smithi089.stdout:8/538: dread d0/dd/db0/d20/d36/d57/f82 [0,4194304] 0 2024-09-13T22:08:43.425 INFO:tasks.workunit.client.0.smithi089.stdout:8/539: creat d0/dd/db0/d20/d40/d4a/d7f/da6/fb7 x:0 0 0 2024-09-13T22:08:43.430 INFO:tasks.workunit.client.0.smithi089.stdout:0/729: dread d1/f55 [0,4194304] 0 2024-09-13T22:08:43.432 INFO:tasks.workunit.client.0.smithi089.stdout:4/549: dwrite d0/d2c/d35/d64/f82 [0,4194304] 0 2024-09-13T22:08:43.432 INFO:tasks.workunit.client.0.smithi089.stdout:4/550: fdatasync d0/d2c/d35/d74/f9b 0 2024-09-13T22:08:43.432 INFO:tasks.workunit.client.0.smithi089.stdout:4/551: chown d0/fa7 45358877 1 2024-09-13T22:08:43.445 INFO:tasks.workunit.client.0.smithi089.stdout:9/598: dwrite d6/d18/d21/f77 [0,4194304] 0 2024-09-13T22:08:43.446 INFO:tasks.workunit.client.0.smithi089.stdout:4/552: dread d0/d2c/d35/d64/f78 [0,4194304] 0 2024-09-13T22:08:43.446 INFO:tasks.workunit.client.0.smithi089.stdout:2/499: dwrite df/d14/d66/f7e [0,4194304] 0 2024-09-13T22:08:43.446 INFO:tasks.workunit.client.0.smithi089.stdout:4/553: chown d0/d2c/d52/da5/d62/f81 5 1 2024-09-13T22:08:43.446 INFO:tasks.workunit.client.0.smithi089.stdout:4/554: chown d0/d2c/d35/d74 1351 1 2024-09-13T22:08:43.462 INFO:tasks.workunit.client.0.smithi089.stdout:2/500: dwrite df/d14/d66/d69/d2e/f3c [0,4194304] 0 2024-09-13T22:08:43.462 INFO:tasks.workunit.client.0.smithi089.stdout:2/501: chown df/d14/d2b/la0 953198327 1 2024-09-13T22:08:43.476 INFO:tasks.workunit.client.0.smithi089.stdout:0/730: symlink d1/de/d10/d36/d38/d4e/d62/d5f/lfd 0 2024-09-13T22:08:43.477 INFO:tasks.workunit.client.0.smithi089.stdout:0/731: fsync d1/de/d15/d41/d49/d76/f99 0 2024-09-13T22:08:43.478 INFO:tasks.workunit.client.0.smithi089.stdout:0/732: write d1/de/d15/d41/d49/f92 [170139,73047] 0 2024-09-13T22:08:43.490 INFO:tasks.workunit.client.0.smithi089.stdout:9/599: symlink d6/d18/d1b/da0/dae/lcd 0 2024-09-13T22:08:43.492 INFO:tasks.workunit.client.0.smithi089.stdout:4/555: getdents d0/d2c/d35/d64/d6e 0 2024-09-13T22:08:43.492 INFO:tasks.workunit.client.0.smithi089.stdout:4/556: truncate d0/d2c/d35/f87 1395272 0 2024-09-13T22:08:43.502 INFO:tasks.workunit.client.0.smithi089.stdout:4/557: write d0/d2c/d35/d5d/f60 [4387290,25389] 0 2024-09-13T22:08:43.502 INFO:tasks.workunit.client.0.smithi089.stdout:4/558: fsync d0/d2c/d35/f87 0 2024-09-13T22:08:43.541 INFO:tasks.workunit.client.0.smithi089.stdout:9/600: symlink d6/d18/d1b/d3e/lce 0 2024-09-13T22:08:43.541 INFO:tasks.workunit.client.0.smithi089.stdout:9/601: fsync d6/d54/fa4 0 2024-09-13T22:08:43.543 INFO:tasks.workunit.client.0.smithi089.stdout:4/559: creat d0/d2c/d52/da5/d62/d8c/faf x:0 0 0 2024-09-13T22:08:43.544 INFO:tasks.workunit.client.0.smithi089.stdout:9/602: symlink d6/d54/lcf 0 2024-09-13T22:08:43.562 INFO:tasks.workunit.client.0.smithi089.stdout:9/603: dwrite d6/d18/fa2 [0,4194304] 0 2024-09-13T22:08:43.564 INFO:tasks.workunit.client.0.smithi089.stdout:9/604: symlink d6/d18/d1b/d89/ld0 0 2024-09-13T22:08:43.565 INFO:tasks.workunit.client.0.smithi089.stdout:9/605: rmdir d6/d18/d1b/d89/db8/d52 39 2024-09-13T22:08:43.566 INFO:tasks.workunit.client.0.smithi089.stdout:9/606: truncate d6/ff 3410640 0 2024-09-13T22:08:43.567 INFO:tasks.workunit.client.0.smithi089.stdout:9/607: truncate d6/d54/fa4 3268330 0 2024-09-13T22:08:43.568 INFO:tasks.workunit.client.0.smithi089.stdout:9/608: creat d6/d18/d21/d5d/d6c/fd1 x:0 0 0 2024-09-13T22:08:43.592 INFO:tasks.workunit.client.0.smithi089.stdout:8/540: rename d0/dd/db0/d20/d36/d59/d89/l91 to d0/dd/lb8 0 2024-09-13T22:08:43.597 INFO:tasks.workunit.client.0.smithi089.stdout:2/502: rename df/f92 to df/d14/d66/d69/fa7 0 2024-09-13T22:08:43.598 INFO:tasks.workunit.client.0.smithi089.stdout:2/503: rename df/d1a/d57/l9e to df/d14/d2b/d4b/la8 0 2024-09-13T22:08:43.598 INFO:tasks.workunit.client.0.smithi089.stdout:2/504: chown df/d1a/l28 20207 1 2024-09-13T22:08:43.599 INFO:tasks.workunit.client.0.smithi089.stdout:2/505: write df/f26 [2652741,95738] 0 2024-09-13T22:08:43.600 INFO:tasks.workunit.client.0.smithi089.stdout:2/506: mknod df/d14/d48/d88/ca9 0 2024-09-13T22:08:43.601 INFO:tasks.workunit.client.0.smithi089.stdout:4/560: rmdir d0/d15 39 2024-09-13T22:08:43.601 INFO:tasks.workunit.client.0.smithi089.stdout:2/507: mknod df/d14/d48/caa 0 2024-09-13T22:08:43.602 INFO:tasks.workunit.client.0.smithi089.stdout:8/541: write d0/d6a/f8a [6056183,28999] 0 2024-09-13T22:08:43.602 INFO:tasks.workunit.client.0.smithi089.stdout:8/542: dread - d0/dd/db0/d42/f2c zero size 2024-09-13T22:08:43.603 INFO:tasks.workunit.client.0.smithi089.stdout:4/561: rename d0/d2c/d35/d64/l6d to d0/d2c/da0/da9/lb0 0 2024-09-13T22:08:43.603 INFO:tasks.workunit.client.0.smithi089.stdout:2/508: mkdir df/d1a/d57/dab 0 2024-09-13T22:08:43.604 INFO:tasks.workunit.client.0.smithi089.stdout:4/562: write d0/d2c/d35/d64/f93 [144220,50803] 0 2024-09-13T22:08:43.604 INFO:tasks.workunit.client.0.smithi089.stdout:8/543: mkdir d0/d6a/db9 0 2024-09-13T22:08:43.605 INFO:tasks.workunit.client.0.smithi089.stdout:2/509: mknod df/cac 0 2024-09-13T22:08:43.605 INFO:tasks.workunit.client.0.smithi089.stdout:2/510: fsync df/d14/f65 0 2024-09-13T22:08:43.605 INFO:tasks.workunit.client.0.smithi089.stdout:4/563: creat d0/d15/d1f/fb1 x:0 0 0 2024-09-13T22:08:43.607 INFO:tasks.workunit.client.0.smithi089.stdout:4/564: rmdir d0/d2c/d35/d5d 39 2024-09-13T22:08:43.608 INFO:tasks.workunit.client.0.smithi089.stdout:4/565: link d0/d2c/d35/f49 d0/d2c/d52/fb2 0 2024-09-13T22:08:43.608 INFO:tasks.workunit.client.0.smithi089.stdout:4/566: fdatasync d0/d2c/d52/da5/d62/fa8 0 2024-09-13T22:08:43.608 INFO:tasks.workunit.client.0.smithi089.stdout:4/567: fsync d0/d2c/d52/da5/d62/d8c/faf 0 2024-09-13T22:08:43.611 INFO:tasks.workunit.client.0.smithi089.stdout:9/609: dread d6/d54/fa4 [0,4194304] 0 2024-09-13T22:08:43.612 INFO:tasks.workunit.client.0.smithi089.stdout:9/610: chown d6/d18/d1b/d89/la9 15889 1 2024-09-13T22:08:43.612 INFO:tasks.workunit.client.0.smithi089.stdout:9/611: chown d6/d54/f9d 2589 1 2024-09-13T22:08:43.612 INFO:tasks.workunit.client.0.smithi089.stdout:3/512: sync 2024-09-13T22:08:43.612 INFO:tasks.workunit.client.0.smithi089.stdout:7/488: sync 2024-09-13T22:08:43.613 INFO:tasks.workunit.client.0.smithi089.stdout:5/485: sync 2024-09-13T22:08:43.613 INFO:tasks.workunit.client.0.smithi089.stdout:1/587: sync 2024-09-13T22:08:43.613 INFO:tasks.workunit.client.0.smithi089.stdout:9/612: truncate d6/f14 324549 0 2024-09-13T22:08:43.614 INFO:tasks.workunit.client.0.smithi089.stdout:6/485: sync 2024-09-13T22:08:43.614 INFO:tasks.workunit.client.0.smithi089.stdout:2/511: read f3 [2800415,18260] 0 2024-09-13T22:08:43.614 INFO:tasks.workunit.client.0.smithi089.stdout:2/512: fsync df/f74 0 2024-09-13T22:08:43.616 INFO:tasks.workunit.client.0.smithi089.stdout:1/588: truncate d7/d34/d5c/f78 7435372 0 2024-09-13T22:08:43.616 INFO:tasks.workunit.client.0.smithi089.stdout:1/589: write d7/d40/fb0 [397323,9639] 0 2024-09-13T22:08:43.618 INFO:tasks.workunit.client.0.smithi089.stdout:6/486: symlink d0/d5/d64/l9a 0 2024-09-13T22:08:43.619 INFO:tasks.workunit.client.0.smithi089.stdout:2/513: mknod df/d14/d48/cad 0 2024-09-13T22:08:43.623 INFO:tasks.workunit.client.0.smithi089.stdout:4/568: write d0/d2c/d35/d64/f82 [3019284,71139] 0 2024-09-13T22:08:43.623 INFO:tasks.workunit.client.0.smithi089.stdout:8/544: dread d0/dd/db0/d20/d36/d57/f60 [4194304,4194304] 0 2024-09-13T22:08:43.623 INFO:tasks.workunit.client.0.smithi089.stdout:8/545: chown d0/dd/db0/d20/d1c/d5a/d63 612275 1 2024-09-13T22:08:43.627 INFO:tasks.workunit.client.0.smithi089.stdout:7/489: dread d0/fd [0,4194304] 0 2024-09-13T22:08:43.627 INFO:tasks.workunit.client.0.smithi089.stdout:7/490: fdatasync d0/d19/f98 0 2024-09-13T22:08:43.627 INFO:tasks.workunit.client.0.smithi089.stdout:7/491: chown d0/d19/d28/d1d/d30/d5b 158489 1 2024-09-13T22:08:43.627 INFO:tasks.workunit.client.0.smithi089.stdout:7/492: write d0/d19/d28/f44 [1503167,88322] 0 2024-09-13T22:08:43.629 INFO:tasks.workunit.client.0.smithi089.stdout:4/569: rename d0/d2c/d52/da5/d62/f79 to d0/d2c/d35/d5d/da4/fb3 0 2024-09-13T22:08:43.629 INFO:tasks.workunit.client.0.smithi089.stdout:4/570: truncate d0/d2c/d35/f67 215413 0 2024-09-13T22:08:43.632 INFO:tasks.workunit.client.0.smithi089.stdout:7/493: stat d0/cc 0 2024-09-13T22:08:43.634 INFO:tasks.workunit.client.0.smithi089.stdout:4/571: unlink d0/d15/l1c 0 2024-09-13T22:08:43.634 INFO:tasks.workunit.client.0.smithi089.stdout:4/572: dread - d0/d15/d76/f7f zero size 2024-09-13T22:08:43.634 INFO:tasks.workunit.client.0.smithi089.stdout:4/573: chown d0/d15/fa6 14 1 2024-09-13T22:08:43.635 INFO:tasks.workunit.client.0.smithi089.stdout:7/494: getdents d0/d19/d28/d1d 0 2024-09-13T22:08:43.635 INFO:tasks.workunit.client.0.smithi089.stdout:2/514: dread df/f26 [0,4194304] 0 2024-09-13T22:08:43.636 INFO:tasks.workunit.client.0.smithi089.stdout:4/574: symlink d0/d2c/d35/d64/lb4 0 2024-09-13T22:08:43.636 INFO:tasks.workunit.client.0.smithi089.stdout:4/575: stat d0/d11/f21 0 2024-09-13T22:08:43.638 INFO:tasks.workunit.client.0.smithi089.stdout:4/576: write d0/d2c/f41 [298031,113453] 0 2024-09-13T22:08:43.639 INFO:tasks.workunit.client.0.smithi089.stdout:4/577: read d0/d15/f2e [357046,130598] 0 2024-09-13T22:08:43.641 INFO:tasks.workunit.client.0.smithi089.stdout:2/515: mknod df/d5b/cae 0 2024-09-13T22:08:43.642 INFO:tasks.workunit.client.0.smithi089.stdout:9/613: dwrite d6/d54/f98 [8388608,4194304] 0 2024-09-13T22:08:43.643 INFO:tasks.workunit.client.0.smithi089.stdout:4/578: rename d0/d2c/d35/f49 to d0/d2c/d52/da5/d9d/fb5 0 2024-09-13T22:08:43.645 INFO:tasks.workunit.client.0.smithi089.stdout:9/614: getdents d6/d31/d5e 0 2024-09-13T22:08:43.647 INFO:tasks.workunit.client.0.smithi089.stdout:4/579: unlink d0/d2c/d52/da5/f36 0 2024-09-13T22:08:43.649 INFO:tasks.workunit.client.0.smithi089.stdout:4/580: getdents d0/d2c/d52 0 2024-09-13T22:08:43.652 INFO:tasks.workunit.client.0.smithi089.stdout:1/590: dwrite d7/de/da0/fb4 [0,4194304] 0 2024-09-13T22:08:43.658 INFO:tasks.workunit.client.0.smithi089.stdout:1/591: creat d7/db6/fcb x:0 0 0 2024-09-13T22:08:43.658 INFO:tasks.workunit.client.0.smithi089.stdout:2/516: dread df/d14/d66/d69/f80 [0,4194304] 0 2024-09-13T22:08:43.658 INFO:tasks.workunit.client.0.smithi089.stdout:2/517: readlink df/d14/d66/d69/l3b 0 2024-09-13T22:08:43.658 INFO:tasks.workunit.client.0.smithi089.stdout:2/518: dread - df/d14/d66/f70 zero size 2024-09-13T22:08:43.658 INFO:tasks.workunit.client.0.smithi089.stdout:1/592: mknod d7/d1c/d7a/ccc 0 2024-09-13T22:08:43.658 INFO:tasks.workunit.client.0.smithi089.stdout:1/593: chown d7/d34/d5c/d74/fa8 0 1 2024-09-13T22:08:43.659 INFO:tasks.workunit.client.0.smithi089.stdout:2/519: symlink df/d14/d2b/d61/laf 0 2024-09-13T22:08:43.659 INFO:tasks.workunit.client.0.smithi089.stdout:2/520: readlink df/d1a/d57/d68/l95 0 2024-09-13T22:08:43.659 INFO:tasks.workunit.client.0.smithi089.stdout:1/594: symlink d7/d40/dbe/d2b/d39/lcd 0 2024-09-13T22:08:43.659 INFO:tasks.workunit.client.0.smithi089.stdout:1/595: readlink d7/d34/d5c/l9a 0 2024-09-13T22:08:43.660 INFO:tasks.workunit.client.0.smithi089.stdout:2/521: truncate df/d5b/f6f 2713065 0 2024-09-13T22:08:43.661 INFO:tasks.workunit.client.0.smithi089.stdout:2/522: creat df/d76/d85/fb0 x:0 0 0 2024-09-13T22:08:43.661 INFO:tasks.workunit.client.0.smithi089.stdout:2/523: chown df/d1a/l75 9 1 2024-09-13T22:08:43.661 INFO:tasks.workunit.client.0.smithi089.stdout:2/524: readlink df/d14/d2b/d61/l40 0 2024-09-13T22:08:43.661 INFO:tasks.workunit.client.0.smithi089.stdout:2/525: chown df/d14/d2b/d61/l54 3768 1 2024-09-13T22:08:43.661 INFO:tasks.workunit.client.0.smithi089.stdout:1/596: truncate d7/de/d68/f6f 6576510 0 2024-09-13T22:08:43.661 INFO:tasks.workunit.client.0.smithi089.stdout:1/597: chown d7/de 40 1 2024-09-13T22:08:43.661 INFO:tasks.workunit.client.0.smithi089.stdout:1/598: truncate d7/de/d3a/f6e 1018696 0 2024-09-13T22:08:43.662 INFO:tasks.workunit.client.0.smithi089.stdout:1/599: truncate d7/d34/d5c/d5d/f62 1619157 0 2024-09-13T22:08:43.665 INFO:tasks.workunit.client.0.smithi089.stdout:2/526: dread df/d5b/f5f [0,4194304] 0 2024-09-13T22:08:43.665 INFO:tasks.workunit.client.0.smithi089.stdout:2/527: fdatasync df/d14/d66/d69/f44 0 2024-09-13T22:08:43.666 INFO:tasks.workunit.client.0.smithi089.stdout:2/528: stat df/d1a/d57/d68/f71 0 2024-09-13T22:08:43.666 INFO:tasks.workunit.client.0.smithi089.stdout:2/529: mkdir df/d14/d2b/d61/db1 0 2024-09-13T22:08:43.667 INFO:tasks.workunit.client.0.smithi089.stdout:9/615: dread d6/d18/d1b/f2e [0,4194304] 0 2024-09-13T22:08:43.667 INFO:tasks.workunit.client.0.smithi089.stdout:9/616: creat d6/d55/fd2 x:0 0 0 2024-09-13T22:08:43.667 INFO:tasks.workunit.client.0.smithi089.stdout:2/530: mkdir df/d76/d85/db2 0 2024-09-13T22:08:43.668 INFO:tasks.workunit.client.0.smithi089.stdout:2/531: truncate df/f8d 856626 0 2024-09-13T22:08:43.669 INFO:tasks.workunit.client.0.smithi089.stdout:2/532: dread df/d1a/d57/d68/f71 [0,4194304] 0 2024-09-13T22:08:43.669 INFO:tasks.workunit.client.0.smithi089.stdout:2/533: chown df/d14/d2b/l4a 7409974 1 2024-09-13T22:08:43.670 INFO:tasks.workunit.client.0.smithi089.stdout:9/617: rename d6/d18/d21/d5d/c86 to d6/d18/d21/cd3 0 2024-09-13T22:08:43.670 INFO:tasks.workunit.client.0.smithi089.stdout:2/534: creat df/d14/d2b/fb3 x:0 0 0 2024-09-13T22:08:43.676 INFO:tasks.workunit.client.0.smithi089.stdout:3/513: dwrite f0 [0,4194304] 0 2024-09-13T22:08:43.676 INFO:tasks.workunit.client.0.smithi089.stdout:6/487: dwrite d0/d4/f38 [0,4194304] 0 2024-09-13T22:08:43.678 INFO:tasks.workunit.client.0.smithi089.stdout:7/495: dwrite d0/d19/d28/d61/f87 [0,4194304] 0 2024-09-13T22:08:43.678 INFO:tasks.workunit.client.0.smithi089.stdout:3/514: unlink d1/d2/d4/d1c/d7e/d40/d50/f72 0 2024-09-13T22:08:43.679 INFO:tasks.workunit.client.0.smithi089.stdout:6/488: mkdir d0/d4/d12/d15/d9b 0 2024-09-13T22:08:43.681 INFO:tasks.workunit.client.0.smithi089.stdout:7/496: creat d0/d19/d28/d1d/d23/f99 x:0 0 0 2024-09-13T22:08:43.682 INFO:tasks.workunit.client.0.smithi089.stdout:6/489: rename d0/f96 to d0/d4/d12/d15/f9c 0 2024-09-13T22:08:43.683 INFO:tasks.workunit.client.0.smithi089.stdout:7/497: mkdir d0/d19/d28/d1d/d3d/d9a 0 2024-09-13T22:08:43.684 INFO:tasks.workunit.client.0.smithi089.stdout:4/581: dwrite d0/d2c/f5f [0,4194304] 0 2024-09-13T22:08:43.684 INFO:tasks.workunit.client.0.smithi089.stdout:4/582: truncate d0/f3e 447236 0 2024-09-13T22:08:43.685 INFO:tasks.workunit.client.0.smithi089.stdout:6/490: rmdir d0/d4/d88 0 2024-09-13T22:08:43.686 INFO:tasks.workunit.client.0.smithi089.stdout:6/491: write d0/d5/d1d/d2d/f6d [809729,10354] 0 2024-09-13T22:08:43.686 INFO:tasks.workunit.client.0.smithi089.stdout:6/492: dread - d0/d5/d1d/d54/f8f zero size 2024-09-13T22:08:43.686 INFO:tasks.workunit.client.0.smithi089.stdout:7/498: mkdir d0/d19/d45/d9b 0 2024-09-13T22:08:43.687 INFO:tasks.workunit.client.0.smithi089.stdout:2/535: dread df/d14/d66/f99 [0,4194304] 0 2024-09-13T22:08:43.687 INFO:tasks.workunit.client.0.smithi089.stdout:4/583: rename d0/d2c/d35/la2 to d0/d11/d16/lb6 0 2024-09-13T22:08:43.687 INFO:tasks.workunit.client.0.smithi089.stdout:4/584: creat d0/d2c/fb7 x:0 0 0 2024-09-13T22:08:43.689 INFO:tasks.workunit.client.0.smithi089.stdout:2/536: unlink df/d14/d66/d69/c6c 0 2024-09-13T22:08:43.689 INFO:tasks.workunit.client.0.smithi089.stdout:2/537: getdents df/d76/d85/db2 0 2024-09-13T22:08:43.689 INFO:tasks.workunit.client.0.smithi089.stdout:2/538: chown df/d14/d2b/l3e 2606004 1 2024-09-13T22:08:43.690 INFO:tasks.workunit.client.0.smithi089.stdout:1/600: dwrite d7/d1c/d3c/f3f [0,4194304] 0 2024-09-13T22:08:43.690 INFO:tasks.workunit.client.0.smithi089.stdout:1/601: stat d7/fa4 0 2024-09-13T22:08:43.690 INFO:tasks.workunit.client.0.smithi089.stdout:8/546: dwrite d0/dd/db0/d20/d40/f71 [0,4194304] 0 2024-09-13T22:08:43.690 INFO:tasks.workunit.client.0.smithi089.stdout:8/547: stat d0/dd/db0/d20/d40/d4a/d7f/l8f 0 2024-09-13T22:08:43.691 INFO:tasks.workunit.client.0.smithi089.stdout:6/493: rename d0/d5/d1d/d56/f3a to d0/d5/d43/f9d 0 2024-09-13T22:08:43.691 INFO:tasks.workunit.client.0.smithi089.stdout:6/494: fsync d0/d4/d12/f7b 0 2024-09-13T22:08:43.698 INFO:tasks.workunit.client.0.smithi089.stdout:8/548: link d0/dd/db0/d3a/f43 d0/dd/db0/d20/d1c/fba 0 2024-09-13T22:08:43.699 INFO:tasks.workunit.client.0.smithi089.stdout:7/499: write d0/d19/d28/d1d/d2d/d55/f79 [210061,66444] 0 2024-09-13T22:08:43.699 INFO:tasks.workunit.client.0.smithi089.stdout:9/618: dwrite d6/d18/fac [0,4194304] 0 2024-09-13T22:08:43.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/539: rename df/d14/d48/d88/f9d to df/d76/d85/fb4 0 2024-09-13T22:08:43.702 INFO:tasks.workunit.client.0.smithi089.stdout:3/515: dwrite d1/d2/d31/f6e [0,4194304] 0 2024-09-13T22:08:43.702 INFO:tasks.workunit.client.0.smithi089.stdout:6/495: rmdir d0/d4/d12/d15/d3b 39 2024-09-13T22:08:43.702 INFO:tasks.workunit.client.0.smithi089.stdout:6/496: write d0/d5/d1d/d56/f2a [759028,53027] 0 2024-09-13T22:08:43.703 INFO:tasks.workunit.client.0.smithi089.stdout:8/549: truncate d0/dd/f14 85395 0 2024-09-13T22:08:43.704 INFO:tasks.workunit.client.0.smithi089.stdout:4/585: dwrite d0/d15/f2e [0,4194304] 0 2024-09-13T22:08:43.704 INFO:tasks.workunit.client.0.smithi089.stdout:1/602: dread d7/d1c/fc6 [0,4194304] 0 2024-09-13T22:08:43.705 INFO:tasks.workunit.client.0.smithi089.stdout:4/586: dread - d0/d2c/d35/d64/f6f zero size 2024-09-13T22:08:43.706 INFO:tasks.workunit.client.0.smithi089.stdout:9/619: dread d6/d18/f95 [0,4194304] 0 2024-09-13T22:08:43.706 INFO:tasks.workunit.client.0.smithi089.stdout:9/620: creat d6/d18/dab/fd4 x:0 0 0 2024-09-13T22:08:43.706 INFO:tasks.workunit.client.0.smithi089.stdout:7/500: symlink d0/d19/d28/d1d/d2d/d55/d63/l9c 0 2024-09-13T22:08:43.707 INFO:tasks.workunit.client.0.smithi089.stdout:2/540: mkdir df/d14/d66/d69/db5 0 2024-09-13T22:08:43.709 INFO:tasks.workunit.client.0.smithi089.stdout:3/516: chown d1/d2/c60 448 1 2024-09-13T22:08:43.711 INFO:tasks.workunit.client.0.smithi089.stdout:6/497: rmdir d0/d5 39 2024-09-13T22:08:43.713 INFO:tasks.workunit.client.0.smithi089.stdout:8/550: creat d0/dd/db0/d20/d40/d4a/d7f/fbb x:0 0 0 2024-09-13T22:08:43.716 INFO:tasks.workunit.client.0.smithi089.stdout:1/603: creat d7/de/da0/dbd/fce x:0 0 0 2024-09-13T22:08:43.716 INFO:tasks.workunit.client.0.smithi089.stdout:1/604: creat d7/de/d3a/d77/fcf x:0 0 0 2024-09-13T22:08:43.719 INFO:tasks.workunit.client.0.smithi089.stdout:9/621: symlink d6/d54/dcb/ld5 0 2024-09-13T22:08:43.719 INFO:tasks.workunit.client.0.smithi089.stdout:9/622: write d6/d31/d64/f99 [507831,13891] 0 2024-09-13T22:08:43.719 INFO:tasks.workunit.client.0.smithi089.stdout:9/623: chown d6/fc 2039180 1 2024-09-13T22:08:43.721 INFO:tasks.workunit.client.0.smithi089.stdout:2/541: rmdir df/d1a/d57/da3 0 2024-09-13T22:08:43.721 INFO:tasks.workunit.client.0.smithi089.stdout:2/542: dread - df/d14/d2b/d61/f96 zero size 2024-09-13T22:08:43.721 INFO:tasks.workunit.client.0.smithi089.stdout:4/587: dwrite d0/d15/f7d [0,4194304] 0 2024-09-13T22:08:43.721 INFO:tasks.workunit.client.0.smithi089.stdout:3/517: mknod d1/ca0 0 2024-09-13T22:08:43.722 INFO:tasks.workunit.client.0.smithi089.stdout:2/543: read df/d14/d2b/f33 [591331,10456] 0 2024-09-13T22:08:43.723 INFO:tasks.workunit.client.0.smithi089.stdout:6/498: symlink d0/d5/d1d/d56/d4b/d7a/l9e 0 2024-09-13T22:08:43.723 INFO:tasks.workunit.client.0.smithi089.stdout:6/499: dread - d0/d5/d1d/d56/d4b/f4e zero size 2024-09-13T22:08:43.723 INFO:tasks.workunit.client.0.smithi089.stdout:6/500: chown d0/d4/d12/f78 37 1 2024-09-13T22:08:43.725 INFO:tasks.workunit.client.0.smithi089.stdout:8/551: creat d0/dd/db0/d20/d40/d4a/fbc x:0 0 0 2024-09-13T22:08:43.725 INFO:tasks.workunit.client.0.smithi089.stdout:8/552: fdatasync d0/dd/db0/d42/f2c 0 2024-09-13T22:08:43.726 INFO:tasks.workunit.client.0.smithi089.stdout:1/605: symlink d7/d40/dbe/d80/dbb/ld0 0 2024-09-13T22:08:43.728 INFO:tasks.workunit.client.0.smithi089.stdout:9/624: symlink d6/d18/d1b/d89/ld6 0 2024-09-13T22:08:43.731 INFO:tasks.workunit.client.0.smithi089.stdout:4/588: rename d0/d2c/d52/da5/d62/d8c/faf to d0/d2c/d35/d64/fb8 0 2024-09-13T22:08:43.732 INFO:tasks.workunit.client.0.smithi089.stdout:8/553: symlink d0/dd/db0/d20/d36/d68/lbd 0 2024-09-13T22:08:43.732 INFO:tasks.workunit.client.0.smithi089.stdout:8/554: chown d0/dd/db0/d20/f2e 4471 1 2024-09-13T22:08:43.733 INFO:tasks.workunit.client.0.smithi089.stdout:9/625: mknod d6/d18/d21/d5d/d6c/d8d/cd7 0 2024-09-13T22:08:43.736 INFO:tasks.workunit.client.0.smithi089.stdout:4/589: creat d0/fb9 x:0 0 0 2024-09-13T22:08:43.737 INFO:tasks.workunit.client.0.smithi089.stdout:2/544: dread df/f12 [0,4194304] 0 2024-09-13T22:08:43.737 INFO:tasks.workunit.client.0.smithi089.stdout:8/555: creat d0/fbe x:0 0 0 2024-09-13T22:08:43.737 INFO:tasks.workunit.client.0.smithi089.stdout:0/733: sync 2024-09-13T22:08:43.737 INFO:tasks.workunit.client.0.smithi089.stdout:0/734: write d1/de/fe7 [4396198,101558] 0 2024-09-13T22:08:43.738 INFO:tasks.workunit.client.0.smithi089.stdout:0/735: readlink d1/de/d15/d2a/l4a 0 2024-09-13T22:08:43.738 INFO:tasks.workunit.client.0.smithi089.stdout:1/606: mknod d7/cd1 0 2024-09-13T22:08:43.738 INFO:tasks.workunit.client.0.smithi089.stdout:1/607: creat d7/de/da0/fd2 x:0 0 0 2024-09-13T22:08:43.740 INFO:tasks.workunit.client.0.smithi089.stdout:4/590: mknod d0/d2c/d35/d5d/da4/cba 0 2024-09-13T22:08:43.741 INFO:tasks.workunit.client.0.smithi089.stdout:2/545: creat df/d76/d85/db2/fb6 x:0 0 0 2024-09-13T22:08:43.745 INFO:tasks.workunit.client.0.smithi089.stdout:0/736: mknod d1/de/d15/d41/d49/cfe 0 2024-09-13T22:08:43.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:43 smithi089 ceph-mon[27921]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:43.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:43 smithi089 ceph-mon[27921]: pgmap v253: 65 pgs: 65 active+clean; 964 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 92 MiB/s rd, 125 MiB/s wr, 781 op/s 2024-09-13T22:08:43.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:43 smithi089 ceph-mon[27921]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:43.749 INFO:tasks.workunit.client.0.smithi089.stdout:3/518: rename d1/d2/d24 to d1/d2/d4/d1c/d7e/d40/d69/da1 0 2024-09-13T22:08:43.750 INFO:tasks.workunit.client.0.smithi089.stdout:4/591: mknod d0/d15/d83/cbb 0 2024-09-13T22:08:43.750 INFO:tasks.workunit.client.0.smithi089.stdout:1/608: rename d7/d34/fbc to d7/d40/dbe/d2b/d59/d9e/fd3 0 2024-09-13T22:08:43.752 INFO:tasks.workunit.client.0.smithi089.stdout:6/501: dwrite d0/d5/d1d/d56/f34 [0,4194304] 0 2024-09-13T22:08:43.753 INFO:tasks.workunit.client.0.smithi089.stdout:6/502: write d0/d5/d1d/d56/d4a/f58 [806399,27367] 0 2024-09-13T22:08:43.753 INFO:tasks.workunit.client.0.smithi089.stdout:3/519: creat d1/d7/d1b/d28/d97/fa2 x:0 0 0 2024-09-13T22:08:43.754 INFO:tasks.workunit.client.0.smithi089.stdout:1/609: creat d7/d1c/d3c/fd4 x:0 0 0 2024-09-13T22:08:43.759 INFO:tasks.workunit.client.0.smithi089.stdout:3/520: mknod d1/d2/d23/d3d/d54/d95/ca3 0 2024-09-13T22:08:43.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:43 smithi159 ceph-mon[35348]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:43.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:43 smithi159 ceph-mon[35348]: pgmap v253: 65 pgs: 65 active+clean; 964 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 92 MiB/s rd, 125 MiB/s wr, 781 op/s 2024-09-13T22:08:43.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:43 smithi159 ceph-mon[35348]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:08:43.761 INFO:tasks.workunit.client.0.smithi089.stdout:3/521: mkdir d1/d7/d1b/d28/d63/da4 0 2024-09-13T22:08:43.762 INFO:tasks.workunit.client.0.smithi089.stdout:3/522: mkdir d1/da5 0 2024-09-13T22:08:43.764 INFO:tasks.workunit.client.0.smithi089.stdout:0/737: write d1/de/d10/d36/d38/f86 [3285393,127710] 0 2024-09-13T22:08:43.764 INFO:tasks.workunit.client.0.smithi089.stdout:3/523: creat d1/d2/d23/d3d/d54/d5d/fa6 x:0 0 0 2024-09-13T22:08:43.767 INFO:tasks.workunit.client.0.smithi089.stdout:0/738: creat d1/de/d15/d41/fff x:0 0 0 2024-09-13T22:08:43.767 INFO:tasks.workunit.client.0.smithi089.stdout:0/739: dread - d1/de/d15/d41/d87/fc7 zero size 2024-09-13T22:08:43.768 INFO:tasks.workunit.client.0.smithi089.stdout:6/503: dread d0/d4/f24 [0,4194304] 0 2024-09-13T22:08:43.768 INFO:tasks.workunit.client.0.smithi089.stdout:6/504: readlink d0/d5/d1d/l5a 0 2024-09-13T22:08:43.781 INFO:tasks.workunit.client.0.smithi089.stdout:8/556: dwrite d0/dd/db0/d20/d40/d4a/d7f/fbb [0,4194304] 0 2024-09-13T22:08:43.782 INFO:tasks.workunit.client.0.smithi089.stdout:4/592: dwrite d0/d2c/d52/da5/d8e/fab [0,4194304] 0 2024-09-13T22:08:43.782 INFO:tasks.workunit.client.0.smithi089.stdout:4/593: chown d0/d11/f21 76027 1 2024-09-13T22:08:43.783 INFO:tasks.workunit.client.0.smithi089.stdout:2/546: dwrite df/d5b/f6f [0,4194304] 0 2024-09-13T22:08:43.784 INFO:tasks.workunit.client.0.smithi089.stdout:8/557: dread d0/dd/db0/d20/d36/f21 [0,4194304] 0 2024-09-13T22:08:43.786 INFO:tasks.workunit.client.0.smithi089.stdout:4/594: creat d0/d15/fbc x:0 0 0 2024-09-13T22:08:43.787 INFO:tasks.workunit.client.0.smithi089.stdout:2/547: creat df/d5b/da5/fb7 x:0 0 0 2024-09-13T22:08:43.788 INFO:tasks.workunit.client.0.smithi089.stdout:2/548: rmdir df 39 2024-09-13T22:08:43.795 INFO:tasks.workunit.client.0.smithi089.stdout:1/610: dwrite d7/d40/f71 [0,4194304] 0 2024-09-13T22:08:43.797 INFO:tasks.workunit.client.0.smithi089.stdout:1/611: symlink d7/d40/dbe/d2b/d39/d73/ld5 0 2024-09-13T22:08:43.798 INFO:tasks.workunit.client.0.smithi089.stdout:2/549: write df/d1a/f81 [128396,127389] 0 2024-09-13T22:08:43.799 INFO:tasks.workunit.client.0.smithi089.stdout:2/550: mkdir df/d5b/da5/db8 0 2024-09-13T22:08:43.799 INFO:tasks.workunit.client.0.smithi089.stdout:2/551: readlink df/d14/d2b/l4a 0 2024-09-13T22:08:43.799 INFO:tasks.workunit.client.0.smithi089.stdout:2/552: chown df/d14/d2b/d61/f49 28078 1 2024-09-13T22:08:43.799 INFO:tasks.workunit.client.0.smithi089.stdout:2/553: dread - df/d14/d2b/f7b zero size 2024-09-13T22:08:43.805 INFO:tasks.workunit.client.0.smithi089.stdout:3/524: dwrite d1/d2/d4/f5e [4194304,4194304] 0 2024-09-13T22:08:43.808 INFO:tasks.workunit.client.0.smithi089.stdout:3/525: link d1/d2/d23/d3d/d46/f67 d1/d2/d23/d3d/d54/d5d/fa7 0 2024-09-13T22:08:43.808 INFO:tasks.workunit.client.0.smithi089.stdout:1/612: dread d7/d40/f79 [0,4194304] 0 2024-09-13T22:08:43.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/526: unlink d1/d2/d23/d2b/l55 0 2024-09-13T22:08:43.812 INFO:tasks.workunit.client.0.smithi089.stdout:0/740: dwrite d1/de/d10/d36/d38/d4e/d62/d5b/f67 [0,4194304] 0 2024-09-13T22:08:43.812 INFO:tasks.workunit.client.0.smithi089.stdout:0/741: creat d1/de/d10/d36/d3d/f100 x:0 0 0 2024-09-13T22:08:43.812 INFO:tasks.workunit.client.0.smithi089.stdout:0/742: read d1/de/d15/f8d [3840650,123774] 0 2024-09-13T22:08:43.812 INFO:tasks.workunit.client.0.smithi089.stdout:3/527: mknod d1/d2/d23/d3d/d54/d95/ca8 0 2024-09-13T22:08:43.812 INFO:tasks.workunit.client.0.smithi089.stdout:6/505: dwrite d0/d4/d12/f37 [0,4194304] 0 2024-09-13T22:08:43.813 INFO:tasks.workunit.client.0.smithi089.stdout:0/743: unlink d1/de/d15/d41/d87/c97 0 2024-09-13T22:08:43.814 INFO:tasks.workunit.client.0.smithi089.stdout:0/744: truncate d1/de/d10/d36/d3d/f100 440249 0 2024-09-13T22:08:43.814 INFO:tasks.workunit.client.0.smithi089.stdout:0/745: read d1/de/d10/d36/d39/f94 [177845,126145] 0 2024-09-13T22:08:43.814 INFO:tasks.workunit.client.0.smithi089.stdout:3/528: mknod d1/d7/d5c/ca9 0 2024-09-13T22:08:43.817 INFO:tasks.workunit.client.0.smithi089.stdout:0/746: rename d1/de/d10/d36/d38/d4e/d62/d5f/c7f to d1/de/d10/d36/d3d/de8/c101 0 2024-09-13T22:08:43.817 INFO:tasks.workunit.client.0.smithi089.stdout:8/558: dwrite d0/dd/db0/d42/f2c [0,4194304] 0 2024-09-13T22:08:43.817 INFO:tasks.workunit.client.0.smithi089.stdout:4/595: dwrite d0/d11/f30 [0,4194304] 0 2024-09-13T22:08:43.819 INFO:tasks.workunit.client.0.smithi089.stdout:0/747: unlink d1/de/d10/f45 0 2024-09-13T22:08:43.821 INFO:tasks.workunit.client.0.smithi089.stdout:4/596: mknod d0/d2c/d52/da5/d8e/cbd 0 2024-09-13T22:08:43.821 INFO:tasks.workunit.client.0.smithi089.stdout:4/597: chown d0/d2c/f45 1539718417 1 2024-09-13T22:08:43.822 INFO:tasks.workunit.client.0.smithi089.stdout:0/748: creat d1/de/d10/db0/f102 x:0 0 0 2024-09-13T22:08:43.822 INFO:tasks.workunit.client.0.smithi089.stdout:0/749: write d1/f8f [82602,19253] 0 2024-09-13T22:08:43.826 INFO:tasks.workunit.client.0.smithi089.stdout:3/529: read d1/d2/d4/d1c/d7e/d40/d50/f8a [2265378,27006] 0 2024-09-13T22:08:43.826 INFO:tasks.workunit.client.0.smithi089.stdout:3/530: write d1/d2/d4/d1c/d7e/d40/d69/da1/f3b [893344,21039] 0 2024-09-13T22:08:43.827 INFO:tasks.workunit.client.0.smithi089.stdout:3/531: creat d1/d2/d23/d3d/d54/d5d/faa x:0 0 0 2024-09-13T22:08:43.831 INFO:tasks.workunit.client.0.smithi089.stdout:8/559: dread d0/dd/db0/d20/d40/d4a/d7f/fbb [0,4194304] 0 2024-09-13T22:08:43.832 INFO:tasks.workunit.client.0.smithi089.stdout:8/560: write d0/dd/db0/d3a/f5b [434961,82260] 0 2024-09-13T22:08:43.832 INFO:tasks.workunit.client.0.smithi089.stdout:6/506: dwrite d0/d5/d1d/d54/f7c [0,4194304] 0 2024-09-13T22:08:43.832 INFO:tasks.workunit.client.0.smithi089.stdout:6/507: chown d0/d5/d1d/d56/d4a/f90 33907331 1 2024-09-13T22:08:43.832 INFO:tasks.workunit.client.0.smithi089.stdout:6/508: write d0/d5/f3d [505383,55109] 0 2024-09-13T22:08:43.833 INFO:tasks.workunit.client.0.smithi089.stdout:8/561: dread d0/dd/db0/d20/d1c/d5a/f74 [0,4194304] 0 2024-09-13T22:08:43.841 INFO:tasks.workunit.client.0.smithi089.stdout:6/509: read d0/d5/d1d/d54/f5d [2710343,72400] 0 2024-09-13T22:08:43.841 INFO:tasks.workunit.client.0.smithi089.stdout:3/532: write d1/d2/d4/d1c/d7e/d40/d69/da1/f89 [3797575,75457] 0 2024-09-13T22:08:43.842 INFO:tasks.workunit.client.0.smithi089.stdout:1/613: dwrite d7/d40/f79 [0,4194304] 0 2024-09-13T22:08:43.843 INFO:tasks.workunit.client.0.smithi089.stdout:1/614: creat d7/d34/d5c/d5d/fd6 x:0 0 0 2024-09-13T22:08:43.848 INFO:tasks.workunit.client.0.smithi089.stdout:1/615: rename d7/d1c/fc3 to d7/d40/dbe/d2b/d39/fd7 0 2024-09-13T22:08:43.848 INFO:tasks.workunit.client.0.smithi089.stdout:1/616: getdents d7/d40/dbe/d2b/da7 0 2024-09-13T22:08:43.848 INFO:tasks.workunit.client.0.smithi089.stdout:1/617: chown d7/d40/dbe/d2b/d39/lcd 1 1 2024-09-13T22:08:43.849 INFO:tasks.workunit.client.0.smithi089.stdout:1/618: write d7/f33 [1469536,123321] 0 2024-09-13T22:08:43.849 INFO:tasks.workunit.client.0.smithi089.stdout:1/619: symlink d7/d40/dbe/d2b/d59/d9e/ld8 0 2024-09-13T22:08:43.849 INFO:tasks.workunit.client.0.smithi089.stdout:1/620: getdents d7/d1c/d7a 0 2024-09-13T22:08:43.850 INFO:tasks.workunit.client.0.smithi089.stdout:1/621: fdatasync d7/fa4 0 2024-09-13T22:08:43.851 INFO:tasks.workunit.client.0.smithi089.stdout:6/510: dread d0/d4/d12/f20 [0,4194304] 0 2024-09-13T22:08:43.853 INFO:tasks.workunit.client.0.smithi089.stdout:6/511: symlink d0/d5/d1d/d54/l9f 0 2024-09-13T22:08:43.853 INFO:tasks.workunit.client.0.smithi089.stdout:6/512: fdatasync d0/d5/d1d/d56/d4a/f90 0 2024-09-13T22:08:43.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/598: dwrite d0/d15/f4d [0,4194304] 0 2024-09-13T22:08:43.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/599: truncate d0/d2c/d52/da5/f32 1034686 0 2024-09-13T22:08:43.854 INFO:tasks.workunit.client.0.smithi089.stdout:8/562: dwrite d0/dd/db0/d20/d36/d59/d89/f25 [0,4194304] 0 2024-09-13T22:08:43.854 INFO:tasks.workunit.client.0.smithi089.stdout:4/600: rmdir d0/d15/d83 39 2024-09-13T22:08:43.854 INFO:tasks.workunit.client.0.smithi089.stdout:4/601: chown d0/d2c/da0 117 1 2024-09-13T22:08:43.857 INFO:tasks.workunit.client.0.smithi089.stdout:8/563: link d0/dd/db0/d20/d36/d59/f92 d0/dd/db0/d3a/fbf 0 2024-09-13T22:08:43.857 INFO:tasks.workunit.client.0.smithi089.stdout:8/564: write d0/dd/db0/d20/d1c/fba [397396,120338] 0 2024-09-13T22:08:43.859 INFO:tasks.workunit.client.0.smithi089.stdout:4/602: write d0/fd [4388563,38439] 0 2024-09-13T22:08:43.859 INFO:tasks.workunit.client.0.smithi089.stdout:4/603: write d0/d11/d16/d89/f95 [243797,73343] 0 2024-09-13T22:08:43.863 INFO:tasks.workunit.client.0.smithi089.stdout:8/565: mkdir d0/dd/db0/d42/dc0 0 2024-09-13T22:08:43.902 INFO:tasks.workunit.client.0.smithi089.stdout:4/604: fsync d0/fd 0 2024-09-13T22:08:43.902 INFO:tasks.workunit.client.0.smithi089.stdout:4/605: fsync d0/fb9 0 2024-09-13T22:08:43.903 INFO:tasks.workunit.client.0.smithi089.stdout:1/622: dwrite d7/de/d3a/d77/fc5 [0,4194304] 0 2024-09-13T22:08:43.903 INFO:tasks.workunit.client.0.smithi089.stdout:1/623: chown d7/l23 4212 1 2024-09-13T22:08:43.906 INFO:tasks.workunit.client.0.smithi089.stdout:4/606: dread d0/d15/d1f/f31 [0,4194304] 0 2024-09-13T22:08:43.906 INFO:tasks.workunit.client.0.smithi089.stdout:1/624: unlink d7/d40/dbe/d2b/d39/lcd 0 2024-09-13T22:08:43.907 INFO:tasks.workunit.client.0.smithi089.stdout:4/607: rmdir d0/d15/d76 39 2024-09-13T22:08:43.908 INFO:tasks.workunit.client.0.smithi089.stdout:1/625: mkdir d7/de/d68/dd9 0 2024-09-13T22:08:43.909 INFO:tasks.workunit.client.0.smithi089.stdout:1/626: readlink d7/d40/dbe/d2b/d39/d73/ld5 0 2024-09-13T22:08:43.913 INFO:tasks.workunit.client.0.smithi089.stdout:6/513: dwrite d0/d4/d12/f4c [0,4194304] 0 2024-09-13T22:08:43.914 INFO:tasks.workunit.client.0.smithi089.stdout:6/514: chown d0/c73 5589 1 2024-09-13T22:08:43.914 INFO:tasks.workunit.client.0.smithi089.stdout:8/566: dwrite d0/dd/db0/d3a/d83/fb6 [0,4194304] 0 2024-09-13T22:08:43.914 INFO:tasks.workunit.client.0.smithi089.stdout:3/533: dwrite d1/d2/d4/d1c/d7e/d40/d69/da1/f3b [0,4194304] 0 2024-09-13T22:08:43.915 INFO:tasks.workunit.client.0.smithi089.stdout:6/515: write d0/d5/d1d/d56/f47 [224901,67992] 0 2024-09-13T22:08:43.918 INFO:tasks.workunit.client.0.smithi089.stdout:8/567: creat d0/dd/db0/d20/d36/d80/fc1 x:0 0 0 2024-09-13T22:08:43.918 INFO:tasks.workunit.client.0.smithi089.stdout:8/568: creat d0/fc2 x:0 0 0 2024-09-13T22:08:43.918 INFO:tasks.workunit.client.0.smithi089.stdout:8/569: creat d0/dd/db0/d20/d36/d80/d3b/da5/fc3 x:0 0 0 2024-09-13T22:08:43.919 INFO:tasks.workunit.client.0.smithi089.stdout:3/534: mkdir d1/d2/d23/d3d/d46/dab 0 2024-09-13T22:08:43.921 INFO:tasks.workunit.client.0.smithi089.stdout:6/516: rmdir d0/d5/d43/d79/d92 0 2024-09-13T22:08:43.921 INFO:tasks.workunit.client.0.smithi089.stdout:6/517: fsync d0/d5/d64/f72 0 2024-09-13T22:08:43.921 INFO:tasks.workunit.client.0.smithi089.stdout:3/535: dread d1/d2/d4/d1c/d7f/f86 [0,4194304] 0 2024-09-13T22:08:43.922 INFO:tasks.workunit.client.0.smithi089.stdout:3/536: write d1/d2/d4/d1c/d7e/d40/d69/da1/f89 [2090151,43014] 0 2024-09-13T22:08:43.922 INFO:tasks.workunit.client.0.smithi089.stdout:3/537: read - d1/d2/d23/d3d/d54/d5d/faa zero size 2024-09-13T22:08:43.922 INFO:tasks.workunit.client.0.smithi089.stdout:6/518: mkdir d0/d5/d1d/d2d/da0 0 2024-09-13T22:08:43.925 INFO:tasks.workunit.client.0.smithi089.stdout:3/538: rename d1/f13 to d1/d2/d4/d1c/d7e/d83/fac 0 2024-09-13T22:08:43.926 INFO:tasks.workunit.client.0.smithi089.stdout:3/539: creat d1/d2/d4/d1c/d7e/d40/fad x:0 0 0 2024-09-13T22:08:43.927 INFO:tasks.workunit.client.0.smithi089.stdout:6/519: unlink d0/d4/d12/d15/l67 0 2024-09-13T22:08:43.927 INFO:tasks.workunit.client.0.smithi089.stdout:6/520: readlink d0/d4/d12/d15/d3b/l97 0 2024-09-13T22:08:43.927 INFO:tasks.workunit.client.0.smithi089.stdout:6/521: fdatasync d0/d5/d1d/d56/d60/f6e 0 2024-09-13T22:08:43.929 INFO:tasks.workunit.client.0.smithi089.stdout:3/540: creat d1/d2/d4/d1c/d7e/fae x:0 0 0 2024-09-13T22:08:43.930 INFO:tasks.workunit.client.0.smithi089.stdout:1/627: read d7/de/da0/fb4 [3456113,14861] 0 2024-09-13T22:08:43.931 INFO:tasks.workunit.client.0.smithi089.stdout:1/628: fdatasync d7/d34/d5c/f78 0 2024-09-13T22:08:43.931 INFO:tasks.workunit.client.0.smithi089.stdout:4/608: dwrite d0/d2c/d35/f67 [0,4194304] 0 2024-09-13T22:08:43.931 INFO:tasks.workunit.client.0.smithi089.stdout:4/609: dread - d0/d15/d76/f7f zero size 2024-09-13T22:08:43.931 INFO:tasks.workunit.client.0.smithi089.stdout:7/501: sync 2024-09-13T22:08:43.931 INFO:tasks.workunit.client.0.smithi089.stdout:5/486: sync 2024-09-13T22:08:43.931 INFO:tasks.workunit.client.0.smithi089.stdout:7/502: chown d0/d19/d45/l4c 24757044 1 2024-09-13T22:08:43.932 INFO:tasks.workunit.client.0.smithi089.stdout:3/541: creat d1/d2/d4/d1c/d7e/d40/d69/da1/faf x:0 0 0 2024-09-13T22:08:43.933 INFO:tasks.workunit.client.0.smithi089.stdout:3/542: creat d1/d2/d4/d1c/d7e/d40/d50/fb0 x:0 0 0 2024-09-13T22:08:43.933 INFO:tasks.workunit.client.0.smithi089.stdout:3/543: write d1/d2/d23/f76 [631557,58700] 0 2024-09-13T22:08:43.933 INFO:tasks.workunit.client.0.smithi089.stdout:1/629: creat d7/de/d3a/fda x:0 0 0 2024-09-13T22:08:43.938 INFO:tasks.workunit.client.0.smithi089.stdout:4/610: rename d0/fa7 to d0/d2c/d8d/fbe 0 2024-09-13T22:08:43.938 INFO:tasks.workunit.client.0.smithi089.stdout:7/503: creat d0/d19/d28/d1d/d30/f9d x:0 0 0 2024-09-13T22:08:43.938 INFO:tasks.workunit.client.0.smithi089.stdout:8/570: dwrite d0/f5 [0,4194304] 0 2024-09-13T22:08:43.938 INFO:tasks.workunit.client.0.smithi089.stdout:5/487: symlink d4/d19/d1e/d53/d88/lb1 0 2024-09-13T22:08:43.939 INFO:tasks.workunit.client.0.smithi089.stdout:4/611: mknod d0/d2c/d52/da5/d9d/cbf 0 2024-09-13T22:08:43.940 INFO:tasks.workunit.client.0.smithi089.stdout:7/504: creat d0/d19/d28/d1d/d3d/d9a/f9e x:0 0 0 2024-09-13T22:08:43.940 INFO:tasks.workunit.client.0.smithi089.stdout:7/505: readlink d0/d19/d28/d1d/d3d/l48 0 2024-09-13T22:08:43.941 INFO:tasks.workunit.client.0.smithi089.stdout:7/506: chown d0/d19/d45/d38/f49 1978 1 2024-09-13T22:08:43.941 INFO:tasks.workunit.client.0.smithi089.stdout:7/507: readlink d0/d19/d28/d1d/d2d/d55/d63/l6c 0 2024-09-13T22:08:43.941 INFO:tasks.workunit.client.0.smithi089.stdout:7/508: write d0/d19/d28/d1d/f76 [782023,21684] 0 2024-09-13T22:08:43.942 INFO:tasks.workunit.client.0.smithi089.stdout:8/571: creat d0/dd/db0/d42/dc0/fc4 x:0 0 0 2024-09-13T22:08:43.942 INFO:tasks.workunit.client.0.smithi089.stdout:8/572: fdatasync d0/dd/db0/d42/dc0/fc4 0 2024-09-13T22:08:43.943 INFO:tasks.workunit.client.0.smithi089.stdout:5/488: symlink d4/d19/d1e/d28/d31/d61/d69/lb2 0 2024-09-13T22:08:43.944 INFO:tasks.workunit.client.0.smithi089.stdout:3/544: getdents d1/d2/d31 0 2024-09-13T22:08:43.945 INFO:tasks.workunit.client.0.smithi089.stdout:3/545: write d1/d2/d4/d1c/d7e/d40/d69/da1/f81 [207457,95517] 0 2024-09-13T22:08:43.945 INFO:tasks.workunit.client.0.smithi089.stdout:8/573: dread d0/dd/db0/d3a/f5b [0,4194304] 0 2024-09-13T22:08:43.946 INFO:tasks.workunit.client.0.smithi089.stdout:4/612: truncate d0/d15/d1f/f42 44458 0 2024-09-13T22:08:43.946 INFO:tasks.workunit.client.0.smithi089.stdout:7/509: rename d0/d19/c8a to d0/d19/d28/d1d/d23/d2e/d41/c9f 0 2024-09-13T22:08:43.948 INFO:tasks.workunit.client.0.smithi089.stdout:3/546: link d1/d7/d1b/l58 d1/d2/d23/d3d/d54/d95/lb1 0 2024-09-13T22:08:43.949 INFO:tasks.workunit.client.0.smithi089.stdout:4/613: mknod d0/d11/d16/d89/cc0 0 2024-09-13T22:08:43.950 INFO:tasks.workunit.client.0.smithi089.stdout:4/614: truncate d0/d15/fa6 609856 0 2024-09-13T22:08:43.950 INFO:tasks.workunit.client.0.smithi089.stdout:4/615: chown d0/d2c/d8d 376685234 1 2024-09-13T22:08:43.951 INFO:tasks.workunit.client.0.smithi089.stdout:3/547: dread d1/d2/d23/f76 [0,4194304] 0 2024-09-13T22:08:43.951 INFO:tasks.workunit.client.0.smithi089.stdout:7/510: mknod d0/d19/d28/d1d/d23/d89/d93/ca0 0 2024-09-13T22:08:43.951 INFO:tasks.workunit.client.0.smithi089.stdout:5/489: symlink d4/d19/lb3 0 2024-09-13T22:08:43.952 INFO:tasks.workunit.client.0.smithi089.stdout:8/574: dread d0/dd/db0/d20/d1c/f2f [0,4194304] 0 2024-09-13T22:08:43.952 INFO:tasks.workunit.client.0.smithi089.stdout:8/575: stat d0/dd/db0/d20/d40/d4a/f7a 0 2024-09-13T22:08:43.953 INFO:tasks.workunit.client.0.smithi089.stdout:4/616: rename d0/d2c/da0/da9/lb0 to d0/d2c/d35/lc1 0 2024-09-13T22:08:43.953 INFO:tasks.workunit.client.0.smithi089.stdout:5/490: getdents d4/d19/d1e 0 2024-09-13T22:08:43.953 INFO:tasks.workunit.client.0.smithi089.stdout:0/750: sync 2024-09-13T22:08:43.953 INFO:tasks.workunit.client.0.smithi089.stdout:2/554: sync 2024-09-13T22:08:43.953 INFO:tasks.workunit.client.0.smithi089.stdout:9/626: sync 2024-09-13T22:08:43.954 INFO:tasks.workunit.client.0.smithi089.stdout:8/576: creat d0/dd/db0/d20/d1c/d5a/d63/fc5 x:0 0 0 2024-09-13T22:08:43.955 INFO:tasks.workunit.client.0.smithi089.stdout:7/511: rename d0/d19/d28/d1d/f76 to d0/d19/d28/d1d/d23/d2e/d41/fa1 0 2024-09-13T22:08:43.956 INFO:tasks.workunit.client.0.smithi089.stdout:4/617: creat d0/d11/fc2 x:0 0 0 2024-09-13T22:08:43.957 INFO:tasks.workunit.client.0.smithi089.stdout:5/491: truncate d4/d19/f1b 8164007 0 2024-09-13T22:08:43.958 INFO:tasks.workunit.client.0.smithi089.stdout:0/751: mkdir d1/de/d10/d36/d38/d4e/d62/d5b/d5e/d103 0 2024-09-13T22:08:43.959 INFO:tasks.workunit.client.0.smithi089.stdout:2/555: mkdir df/d14/d48/d88/db9 0 2024-09-13T22:08:43.961 INFO:tasks.workunit.client.0.smithi089.stdout:8/577: symlink d0/d6a/d6f/lc6 0 2024-09-13T22:08:43.963 INFO:tasks.workunit.client.0.smithi089.stdout:7/512: link d0/f3f d0/d19/d28/fa2 0 2024-09-13T22:08:43.964 INFO:tasks.workunit.client.0.smithi089.stdout:0/752: dread d1/de/d15/d41/f68 [0,4194304] 0 2024-09-13T22:08:43.965 INFO:tasks.workunit.client.0.smithi089.stdout:4/618: creat d0/d2c/da1/fc3 x:0 0 0 2024-09-13T22:08:43.965 INFO:tasks.workunit.client.0.smithi089.stdout:3/548: dwrite d1/d2/d4/d1c/f2a [0,4194304] 0 2024-09-13T22:08:43.965 INFO:tasks.workunit.client.0.smithi089.stdout:8/578: dread d0/dd/db0/d20/d36/d59/d89/f2d [0,4194304] 0 2024-09-13T22:08:43.965 INFO:tasks.workunit.client.0.smithi089.stdout:5/492: creat d4/d19/d1e/d28/d31/fb4 x:0 0 0 2024-09-13T22:08:43.968 INFO:tasks.workunit.client.0.smithi089.stdout:4/619: dread d0/d2c/d52/da5/f32 [0,4194304] 0 2024-09-13T22:08:43.968 INFO:tasks.workunit.client.0.smithi089.stdout:9/627: getdents d6/d18/d21/d5d/d6c/d8d 0 2024-09-13T22:08:43.968 INFO:tasks.workunit.client.0.smithi089.stdout:9/628: write d6/d18/d21/f77 [5066623,72253] 0 2024-09-13T22:08:43.969 INFO:tasks.workunit.client.0.smithi089.stdout:9/629: chown d6/d18/dab/f50 3358 1 2024-09-13T22:08:43.970 INFO:tasks.workunit.client.0.smithi089.stdout:3/549: dread d1/d2/d4/d1c/d7e/d40/d69/da1/f81 [0,4194304] 0 2024-09-13T22:08:43.970 INFO:tasks.workunit.client.0.smithi089.stdout:3/550: chown d1/f6 0 1 2024-09-13T22:08:43.971 INFO:tasks.workunit.client.0.smithi089.stdout:9/630: dread d6/d18/d1b/f82 [0,4194304] 0 2024-09-13T22:08:43.971 INFO:tasks.workunit.client.0.smithi089.stdout:9/631: dread - d6/d18/dab/fc5 zero size 2024-09-13T22:08:43.971 INFO:tasks.workunit.client.0.smithi089.stdout:9/632: write d6/d55/fd2 [310030,84598] 0 2024-09-13T22:08:43.972 INFO:tasks.workunit.client.0.smithi089.stdout:7/513: rename d0/d19/d28/d61/f86 to d0/d19/d28/d1d/d23/d2e/d41/fa3 0 2024-09-13T22:08:43.974 INFO:tasks.workunit.client.0.smithi089.stdout:8/579: dread d0/dd/db0/d20/d36/d80/f44 [0,4194304] 0 2024-09-13T22:08:43.975 INFO:tasks.workunit.client.0.smithi089.stdout:8/580: write d0/dd/f7d [3968371,59208] 0 2024-09-13T22:08:43.979 INFO:tasks.workunit.client.0.smithi089.stdout:7/514: symlink d0/d19/d28/d1d/d23/d2e/d41/la4 0 2024-09-13T22:08:43.980 INFO:tasks.workunit.client.0.smithi089.stdout:3/551: dread d1/d2/d31/f6e [0,4194304] 0 2024-09-13T22:08:43.982 INFO:tasks.workunit.client.0.smithi089.stdout:8/581: mkdir d0/dd/db0/d42/dc7 0 2024-09-13T22:08:43.983 INFO:tasks.workunit.client.0.smithi089.stdout:3/552: write d1/d2/d31/f6e [2683195,27369] 0 2024-09-13T22:08:43.983 INFO:tasks.workunit.client.0.smithi089.stdout:0/753: rmdir d1/de/d15/d41/d49/d76 39 2024-09-13T22:08:43.985 INFO:tasks.workunit.client.0.smithi089.stdout:7/515: rename d0/d19/d28/d7b/l83 to d0/d19/d28/d1d/d3d/d9a/la5 0 2024-09-13T22:08:43.988 INFO:tasks.workunit.client.0.smithi089.stdout:3/553: creat d1/d7/fb2 x:0 0 0 2024-09-13T22:08:43.990 INFO:tasks.workunit.client.0.smithi089.stdout:5/493: dwrite d4/d19/d1e/d28/d31/d35/fa1 [0,4194304] 0 2024-09-13T22:08:43.990 INFO:tasks.workunit.client.0.smithi089.stdout:5/494: fsync d4/d19/d1e/d28/d31/d61/f8d 0 2024-09-13T22:08:43.990 INFO:tasks.workunit.client.0.smithi089.stdout:0/754: rename d1/de/d10/d36/d39/c5a to d1/de/d15/d41/d49/c104 0 2024-09-13T22:08:43.991 INFO:tasks.workunit.client.0.smithi089.stdout:0/755: write d1/de/d15/d41/d87/ff9 [1218582,81331] 0 2024-09-13T22:08:43.991 INFO:tasks.workunit.client.0.smithi089.stdout:0/756: write d1/de/d10/d36/d38/d4e/fe9 [598078,126346] 0 2024-09-13T22:08:43.991 INFO:tasks.workunit.client.0.smithi089.stdout:0/757: creat d1/de/d10/db0/f105 x:0 0 0 2024-09-13T22:08:43.991 INFO:tasks.workunit.client.0.smithi089.stdout:4/620: dwrite d0/fb9 [0,4194304] 0 2024-09-13T22:08:43.992 INFO:tasks.workunit.client.0.smithi089.stdout:5/495: getdents d4/d19/d1e/d28/d31/d35/d46 0 2024-09-13T22:08:43.992 INFO:tasks.workunit.client.0.smithi089.stdout:5/496: write d4/d19/d1e/d28/d31/d35/d46/f6e [1139908,6769] 0 2024-09-13T22:08:43.994 INFO:tasks.workunit.client.0.smithi089.stdout:7/516: rename d0/d19/d45/f51 to d0/d19/d45/d9b/fa6 0 2024-09-13T22:08:43.994 INFO:tasks.workunit.client.0.smithi089.stdout:7/517: write d0/f3f [2933009,19424] 0 2024-09-13T22:08:43.994 INFO:tasks.workunit.client.0.smithi089.stdout:7/518: fsync d0/d19/d45/d38/f39 0 2024-09-13T22:08:43.995 INFO:tasks.workunit.client.0.smithi089.stdout:0/758: mknod d1/de/d10/d36/c106 0 2024-09-13T22:08:43.998 INFO:tasks.workunit.client.0.smithi089.stdout:4/621: mknod d0/d15/d1f/cc4 0 2024-09-13T22:08:43.999 INFO:tasks.workunit.client.0.smithi089.stdout:5/497: symlink d4/d19/d1e/d53/lb5 0 2024-09-13T22:08:43.999 INFO:tasks.workunit.client.0.smithi089.stdout:5/498: dread - d4/d19/d1e/d28/d31/f97 zero size 2024-09-13T22:08:44.001 INFO:tasks.workunit.client.0.smithi089.stdout:7/519: mkdir d0/d19/d28/d1d/d30/da7 0 2024-09-13T22:08:44.002 INFO:tasks.workunit.client.0.smithi089.stdout:0/759: symlink d1/de/d10/d36/d38/d4e/d62/d5f/l107 0 2024-09-13T22:08:44.005 INFO:tasks.workunit.client.0.smithi089.stdout:5/499: stat d4/d19/d1e/d89/c93 0 2024-09-13T22:08:44.007 INFO:tasks.workunit.client.0.smithi089.stdout:7/520: rename d0/d19/d28/d7b/d8b to d0/d19/d28/d1d/d23/d2e/da8 0 2024-09-13T22:08:44.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/521: fdatasync d0/d19/d45/d9b/fa6 0 2024-09-13T22:08:44.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/522: write d0/d19/d28/d1d/d23/d2e/d41/f84 [433691,120872] 0 2024-09-13T22:08:44.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/523: chown d0/d19/d28/d1d/d23/d24/f42 30 1 2024-09-13T22:08:44.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/524: write d0/f8c [1139109,4523] 0 2024-09-13T22:08:44.009 INFO:tasks.workunit.client.0.smithi089.stdout:0/760: mknod d1/de/d10/d36/d38/d4e/d62/d5b/c108 0 2024-09-13T22:08:44.010 INFO:tasks.workunit.client.0.smithi089.stdout:5/500: creat d4/d19/d1e/d28/d31/d55/da4/fb6 x:0 0 0 2024-09-13T22:08:44.011 INFO:tasks.workunit.client.0.smithi089.stdout:7/525: mkdir d0/d19/d28/d1d/d23/d2e/d41/da9 0 2024-09-13T22:08:44.013 INFO:tasks.workunit.client.0.smithi089.stdout:5/501: creat d4/d19/d1e/d28/fb7 x:0 0 0 2024-09-13T22:08:44.013 INFO:tasks.workunit.client.0.smithi089.stdout:5/502: creat d4/d19/d1e/d28/fb8 x:0 0 0 2024-09-13T22:08:44.015 INFO:tasks.workunit.client.0.smithi089.stdout:4/622: dwrite d0/d2c/d35/d64/f6f [0,4194304] 0 2024-09-13T22:08:44.015 INFO:tasks.workunit.client.0.smithi089.stdout:4/623: truncate d0/d2c/d35/d64/f93 987964 0 2024-09-13T22:08:44.015 INFO:tasks.workunit.client.0.smithi089.stdout:7/526: creat d0/d19/d28/faa x:0 0 0 2024-09-13T22:08:44.015 INFO:tasks.workunit.client.0.smithi089.stdout:7/527: fdatasync d0/d19/d28/d1d/d23/d2e/d41/f65 0 2024-09-13T22:08:44.015 INFO:tasks.workunit.client.0.smithi089.stdout:7/528: creat d0/d19/d45/fab x:0 0 0 2024-09-13T22:08:44.016 INFO:tasks.workunit.client.0.smithi089.stdout:5/503: dread d4/d19/d1e/d28/d31/d35/d46/f6e [0,4194304] 0 2024-09-13T22:08:44.016 INFO:tasks.workunit.client.0.smithi089.stdout:5/504: getdents d4/d19/d1e/d53/dae 0 2024-09-13T22:08:44.016 INFO:tasks.workunit.client.0.smithi089.stdout:5/505: readlink d4/d19/d1e/d28/d31/d61/l99 0 2024-09-13T22:08:44.018 INFO:tasks.workunit.client.0.smithi089.stdout:4/624: rename d0/d11/d16/c39 to d0/d11/d16/d89/cc5 0 2024-09-13T22:08:44.018 INFO:tasks.workunit.client.0.smithi089.stdout:4/625: chown d0/d2c/d35/d5d 104028369 1 2024-09-13T22:08:44.020 INFO:tasks.workunit.client.0.smithi089.stdout:5/506: truncate d4/d19/d1e/d28/d31/d35/d46/fa8 1606573 0 2024-09-13T22:08:44.020 INFO:tasks.workunit.client.0.smithi089.stdout:5/507: stat d4/d19/d1e/d28/d31/d55/d58/d84/c87 0 2024-09-13T22:08:44.020 INFO:tasks.workunit.client.0.smithi089.stdout:5/508: dread - d4/d19/d1e/d28/d31/f97 zero size 2024-09-13T22:08:44.020 INFO:tasks.workunit.client.0.smithi089.stdout:5/509: truncate d4/d19/d1e/d28/d31/f52 5042548 0 2024-09-13T22:08:44.020 INFO:tasks.workunit.client.0.smithi089.stdout:5/510: write d4/d19/d1e/d28/d31/d55/da4/fb6 [898842,92494] 0 2024-09-13T22:08:44.021 INFO:tasks.workunit.client.0.smithi089.stdout:5/511: symlink d4/d19/d1e/d28/d31/lb9 0 2024-09-13T22:08:44.023 INFO:tasks.workunit.client.0.smithi089.stdout:4/626: rmdir d0/d2c/d52/da5/d62/d8c 39 2024-09-13T22:08:44.023 INFO:tasks.workunit.client.0.smithi089.stdout:5/512: read - d4/d19/f6f zero size 2024-09-13T22:08:44.024 INFO:tasks.workunit.client.0.smithi089.stdout:7/529: rename d0/d19/d28/d1d/d2d/d55/d63 to d0/d19/d28/d1d/d23/d24/dac 0 2024-09-13T22:08:44.025 INFO:tasks.workunit.client.0.smithi089.stdout:5/513: truncate d4/d19/d1e/d28/f51 7970960 0 2024-09-13T22:08:44.026 INFO:tasks.workunit.client.0.smithi089.stdout:5/514: mkdir d4/d19/d1e/d28/d3d/dba 0 2024-09-13T22:08:44.028 INFO:tasks.workunit.client.0.smithi089.stdout:5/515: unlink d4/d19/l4c 0 2024-09-13T22:08:44.029 INFO:tasks.workunit.client.0.smithi089.stdout:5/516: mknod d4/d19/d1e/d28/d3d/dba/cbb 0 2024-09-13T22:08:44.031 INFO:tasks.workunit.client.0.smithi089.stdout:7/530: dread d0/d19/d28/d1d/d23/d24/f42 [0,4194304] 0 2024-09-13T22:08:44.032 INFO:tasks.workunit.client.0.smithi089.stdout:7/531: getdents d0/d19/d28/d1d/d30 0 2024-09-13T22:08:44.034 INFO:tasks.workunit.client.0.smithi089.stdout:7/532: symlink d0/d19/d28/d7b/lad 0 2024-09-13T22:08:44.046 INFO:tasks.workunit.client.0.smithi089.stdout:7/533: write d0/f80 [397118,127902] 0 2024-09-13T22:08:44.047 INFO:tasks.workunit.client.0.smithi089.stdout:7/534: symlink d0/d19/d28/d1d/d23/d89/lae 0 2024-09-13T22:08:44.048 INFO:tasks.workunit.client.0.smithi089.stdout:7/535: read d0/d19/d28/d1d/d23/d2e/d41/fa1 [45464,18968] 0 2024-09-13T22:08:44.048 INFO:tasks.workunit.client.0.smithi089.stdout:7/536: mknod d0/d19/d28/d1d/d23/caf 0 2024-09-13T22:08:44.055 INFO:tasks.workunit.client.0.smithi089.stdout:4/627: dwrite d0/d15/f4d [0,4194304] 0 2024-09-13T22:08:44.056 INFO:tasks.workunit.client.0.smithi089.stdout:5/517: dwrite d4/d19/d1e/d28/f9b [0,4194304] 0 2024-09-13T22:08:44.060 INFO:tasks.workunit.client.0.smithi089.stdout:7/537: dread d0/d19/d28/d1d/f2c [0,4194304] 0 2024-09-13T22:08:44.060 INFO:tasks.workunit.client.0.smithi089.stdout:7/538: stat d0/d19/d28/d1d/d23/d24/d5d 0 2024-09-13T22:08:44.061 INFO:tasks.workunit.client.0.smithi089.stdout:7/539: rename d0/d19/d28/d1d/d23/d24/f72 to d0/d19/fb0 0 2024-09-13T22:08:44.062 INFO:tasks.workunit.client.0.smithi089.stdout:7/540: rmdir d0/d19/d28/d1d/d30 39 2024-09-13T22:08:44.064 INFO:tasks.workunit.client.0.smithi089.stdout:7/541: rename d0/d19/d28/d1d/d3d/c77 to d0/d19/d45/d9b/cb1 0 2024-09-13T22:08:44.066 INFO:tasks.workunit.client.0.smithi089.stdout:7/542: mkdir d0/d19/d28/d1d/d2d/d3c/d90/db2 0 2024-09-13T22:08:44.068 INFO:tasks.workunit.client.0.smithi089.stdout:1/630: sync 2024-09-13T22:08:44.068 INFO:tasks.workunit.client.0.smithi089.stdout:6/522: sync 2024-09-13T22:08:44.069 INFO:tasks.workunit.client.0.smithi089.stdout:5/518: dread d4/d19/d1e/d89/d8a/f78 [0,4194304] 0 2024-09-13T22:08:44.069 INFO:tasks.workunit.client.0.smithi089.stdout:5/519: creat d4/d19/d1e/d28/d31/d55/d58/fbc x:0 0 0 2024-09-13T22:08:44.070 INFO:tasks.workunit.client.0.smithi089.stdout:1/631: rename d7/d40/dbe/l8f to d7/de/d68/dd9/ldb 0 2024-09-13T22:08:44.071 INFO:tasks.workunit.client.0.smithi089.stdout:6/523: creat d0/d5/d1d/d56/d28/fa1 x:0 0 0 2024-09-13T22:08:44.071 INFO:tasks.workunit.client.0.smithi089.stdout:6/524: write d0/d5/d1d/d56/f3f [253670,119774] 0 2024-09-13T22:08:44.072 INFO:tasks.workunit.client.0.smithi089.stdout:7/543: dread d0/d19/d28/d1d/d23/d2e/d41/f84 [0,4194304] 0 2024-09-13T22:08:44.073 INFO:tasks.workunit.client.0.smithi089.stdout:1/632: symlink d7/de/d3a/d77/ldc 0 2024-09-13T22:08:44.073 INFO:tasks.workunit.client.0.smithi089.stdout:1/633: chown d7/d1c/d3c/f5e 498748463 1 2024-09-13T22:08:44.073 INFO:tasks.workunit.client.0.smithi089.stdout:1/634: write d7/d40/dbe/d2b/d59/f83 [993382,67993] 0 2024-09-13T22:08:44.074 INFO:tasks.workunit.client.0.smithi089.stdout:6/525: link d0/d5/d1d/d56/d60/f84 d0/d5/d43/d79/fa2 0 2024-09-13T22:08:44.075 INFO:tasks.workunit.client.0.smithi089.stdout:7/544: mkdir d0/d19/d28/d1d/d23/d24/dac/db3 0 2024-09-13T22:08:44.076 INFO:tasks.workunit.client.0.smithi089.stdout:1/635: getdents d7/de/d68 0 2024-09-13T22:08:44.077 INFO:tasks.workunit.client.0.smithi089.stdout:4/628: dwrite d0/d15/f2e [0,4194304] 0 2024-09-13T22:08:44.078 INFO:tasks.workunit.client.0.smithi089.stdout:7/545: link d0/d19/d28/d1d/d23/d24/f29 d0/d19/d28/d1d/d30/fb4 0 2024-09-13T22:08:44.078 INFO:tasks.workunit.client.0.smithi089.stdout:6/526: dread d0/d5/d1d/d56/f47 [0,4194304] 0 2024-09-13T22:08:44.085 INFO:tasks.workunit.client.0.smithi089.stdout:5/520: dread d4/d19/d1e/d28/d3d/f57 [0,4194304] 0 2024-09-13T22:08:44.086 INFO:tasks.workunit.client.0.smithi089.stdout:4/629: dread d0/d2c/d52/da5/d62/fa3 [0,4194304] 0 2024-09-13T22:08:44.086 INFO:tasks.workunit.client.0.smithi089.stdout:4/630: creat d0/d2c/da1/fc6 x:0 0 0 2024-09-13T22:08:44.087 INFO:tasks.workunit.client.0.smithi089.stdout:5/521: symlink d4/d19/d1e/d28/lbd 0 2024-09-13T22:08:44.087 INFO:tasks.workunit.client.0.smithi089.stdout:5/522: chown d4/d19/d1e/d28/d31/d35/d46/f6e 15632080 1 2024-09-13T22:08:44.088 INFO:tasks.workunit.client.0.smithi089.stdout:6/527: dread d0/d5/d43/f53 [0,4194304] 0 2024-09-13T22:08:44.090 INFO:tasks.workunit.client.0.smithi089.stdout:5/523: mknod d4/d19/d1e/cbe 0 2024-09-13T22:08:44.091 INFO:tasks.workunit.client.0.smithi089.stdout:6/528: symlink d0/d4/d12/d15/d3b/la3 0 2024-09-13T22:08:44.094 INFO:tasks.workunit.client.0.smithi089.stdout:5/524: rename d4/f77 to d4/d19/d1e/fbf 0 2024-09-13T22:08:44.098 INFO:tasks.workunit.client.0.smithi089.stdout:2/556: sync 2024-09-13T22:08:44.100 INFO:tasks.workunit.client.0.smithi089.stdout:2/557: creat df/d1a/d57/fba x:0 0 0 2024-09-13T22:08:44.100 INFO:tasks.workunit.client.0.smithi089.stdout:2/558: fsync df/d1a/d57/f8f 0 2024-09-13T22:08:44.100 INFO:tasks.workunit.client.0.smithi089.stdout:7/546: dwrite d0/ff [0,4194304] 0 2024-09-13T22:08:44.101 INFO:tasks.workunit.client.0.smithi089.stdout:7/547: write d0/d19/d28/d1d/d23/d2e/d41/f65 [2786836,100212] 0 2024-09-13T22:08:44.101 INFO:tasks.workunit.client.0.smithi089.stdout:7/548: write d0/d19/d28/d7b/f97 [802356,3126] 0 2024-09-13T22:08:44.101 INFO:tasks.workunit.client.0.smithi089.stdout:7/549: write d0/d19/d28/d1d/d2d/d3c/f37 [4607844,56148] 0 2024-09-13T22:08:44.101 INFO:tasks.workunit.client.0.smithi089.stdout:7/550: fdatasync d0/f7a 0 2024-09-13T22:08:44.101 INFO:tasks.workunit.client.0.smithi089.stdout:2/559: symlink df/d14/lbb 0 2024-09-13T22:08:44.102 INFO:tasks.workunit.client.0.smithi089.stdout:2/560: fsync df/d14/f65 0 2024-09-13T22:08:44.102 INFO:tasks.workunit.client.0.smithi089.stdout:2/561: getdents df/d14/d48/d88/db9 0 2024-09-13T22:08:44.102 INFO:tasks.workunit.client.0.smithi089.stdout:1/636: dwrite d7/d40/f79 [0,4194304] 0 2024-09-13T22:08:44.104 INFO:tasks.workunit.client.0.smithi089.stdout:7/551: rename d0/f1e to d0/d19/d28/d1d/d2d/fb5 0 2024-09-13T22:08:44.104 INFO:tasks.workunit.client.0.smithi089.stdout:2/562: symlink df/d14/d2b/d4b/lbc 0 2024-09-13T22:08:44.105 INFO:tasks.workunit.client.0.smithi089.stdout:1/637: creat d7/d40/dbe/d80/dbb/fdd x:0 0 0 2024-09-13T22:08:44.105 INFO:tasks.workunit.client.0.smithi089.stdout:1/638: write d7/de/d68/f90 [1214135,107620] 0 2024-09-13T22:08:44.106 INFO:tasks.workunit.client.0.smithi089.stdout:7/552: mkdir d0/d19/d28/d1d/d23/d89/d93/db6 0 2024-09-13T22:08:44.106 INFO:tasks.workunit.client.0.smithi089.stdout:7/553: readlink d0/le 0 2024-09-13T22:08:44.106 INFO:tasks.workunit.client.0.smithi089.stdout:5/525: dread d4/d19/f1b [4194304,4194304] 0 2024-09-13T22:08:44.107 INFO:tasks.workunit.client.0.smithi089.stdout:1/639: getdents d7/d34 0 2024-09-13T22:08:44.107 INFO:tasks.workunit.client.0.smithi089.stdout:7/554: read d0/d19/d45/d38/f6a [21792,42650] 0 2024-09-13T22:08:44.111 INFO:tasks.workunit.client.0.smithi089.stdout:6/529: dwrite d0/d5/f23 [0,4194304] 0 2024-09-13T22:08:44.111 INFO:tasks.workunit.client.0.smithi089.stdout:6/530: fsync d0/d4/f40 0 2024-09-13T22:08:44.113 INFO:tasks.workunit.client.0.smithi089.stdout:1/640: write d7/d34/d5c/d5d/f62 [1453468,67284] 0 2024-09-13T22:08:44.119 INFO:tasks.workunit.client.0.smithi089.stdout:7/555: write d0/d19/f2b [3966286,23964] 0 2024-09-13T22:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:7/556: creat d0/d19/d28/d1d/d2d/d3c/fb7 x:0 0 0 2024-09-13T22:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:7/557: rmdir d0/d19/d28/d1d/d23/d89/d93/db6 0 2024-09-13T22:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:7/558: write d0/d19/f98 [607487,33903] 0 2024-09-13T22:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:7/559: write d0/d19/d45/d9b/fa6 [449418,20905] 0 2024-09-13T22:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:7/560: stat d0/c2f 0 2024-09-13T22:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:7/561: truncate d0/d19/d45/d38/f71 620328 0 2024-09-13T22:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:7/562: write d0/d19/d28/d1d/d23/d2e/d41/f6f [932301,93025] 0 2024-09-13T22:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:7/563: write d0/d19/d28/d1d/d3d/f43 [876400,95514] 0 2024-09-13T22:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:7/564: creat d0/d19/d28/d61/fb8 x:0 0 0 2024-09-13T22:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:1/641: write d7/d40/dbe/d2b/d39/d73/f86 [81481,64737] 0 2024-09-13T22:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:7/565: creat d0/d19/d28/d1d/d3d/fb9 x:0 0 0 2024-09-13T22:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:1/642: mkdir d7/de/da0/dbd/dde 0 2024-09-13T22:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:1/643: unlink d7/d34/d5c/f78 0 2024-09-13T22:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:1/644: rename d7/cd1 to d7/de/d3a/cdf 0 2024-09-13T22:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:1/645: stat d7/d40/dbe/d2b/f54 0 2024-09-13T22:08:44.136 INFO:tasks.workunit.client.0.smithi089.stdout:1/646: mkdir d7/d34/d5c/de0 0 2024-09-13T22:08:44.136 INFO:tasks.workunit.client.0.smithi089.stdout:1/647: stat d7/d1c/d7a/dad 0 2024-09-13T22:08:44.138 INFO:tasks.workunit.client.0.smithi089.stdout:1/648: write d7/d40/dbe/d2b/d59/d9e/fd3 [743130,23403] 0 2024-09-13T22:08:44.138 INFO:tasks.workunit.client.0.smithi089.stdout:1/649: write d7/de/d68/f6f [183283,119359] 0 2024-09-13T22:08:44.138 INFO:tasks.workunit.client.0.smithi089.stdout:1/650: write d7/d40/dbe/d2b/d39/d73/f86 [4232222,62108] 0 2024-09-13T22:08:44.138 INFO:tasks.workunit.client.0.smithi089.stdout:0/761: sync 2024-09-13T22:08:44.138 INFO:tasks.workunit.client.0.smithi089.stdout:9/633: sync 2024-09-13T22:08:44.138 INFO:tasks.workunit.client.0.smithi089.stdout:8/582: sync 2024-09-13T22:08:44.139 INFO:tasks.workunit.client.0.smithi089.stdout:3/554: sync 2024-09-13T22:08:44.140 INFO:tasks.workunit.client.0.smithi089.stdout:9/634: link d6/d18/d21/f27 d6/d18/d1b/da0/fd8 0 2024-09-13T22:08:44.141 INFO:tasks.workunit.client.0.smithi089.stdout:8/583: rename d0/dd/db0/d20/d36/d59/d89/f8b to d0/fc8 0 2024-09-13T22:08:44.142 INFO:tasks.workunit.client.0.smithi089.stdout:3/555: creat d1/d2/d4/d1c/fb3 x:0 0 0 2024-09-13T22:08:44.143 INFO:tasks.workunit.client.0.smithi089.stdout:0/762: symlink d1/de/d10/d36/d38/d4e/l109 0 2024-09-13T22:08:44.144 INFO:tasks.workunit.client.0.smithi089.stdout:8/584: mknod d0/dd/db0/d20/d36/d80/cc9 0 2024-09-13T22:08:44.144 INFO:tasks.workunit.client.0.smithi089.stdout:3/556: symlink d1/d2/d4/d1c/d7e/d40/lb4 0 2024-09-13T22:08:44.145 INFO:tasks.workunit.client.0.smithi089.stdout:8/585: mkdir d0/dd/db0/d20/d36/d59/d89/dca 0 2024-09-13T22:08:44.146 INFO:tasks.workunit.client.0.smithi089.stdout:3/557: write d1/d2/d4/f9 [447386,77498] 0 2024-09-13T22:08:44.146 INFO:tasks.workunit.client.0.smithi089.stdout:2/563: dwrite df/d14/d2b/f63 [0,4194304] 0 2024-09-13T22:08:44.148 INFO:tasks.workunit.client.0.smithi089.stdout:3/558: mknod d1/d7/d1b/d28/d63/da4/cb5 0 2024-09-13T22:08:44.148 INFO:tasks.workunit.client.0.smithi089.stdout:3/559: write d1/d2/d4/d1c/d7f/f86 [735026,124007] 0 2024-09-13T22:08:44.153 INFO:tasks.workunit.client.0.smithi089.stdout:6/531: dwrite d0/d4/d12/f41 [0,4194304] 0 2024-09-13T22:08:44.154 INFO:tasks.workunit.client.0.smithi089.stdout:7/566: dwrite d0/d19/d28/d1d/d23/d24/f29 [4194304,4194304] 0 2024-09-13T22:08:44.155 INFO:tasks.workunit.client.0.smithi089.stdout:3/560: symlink d1/d2/d4/d1c/lb6 0 2024-09-13T22:08:44.158 INFO:tasks.workunit.client.0.smithi089.stdout:6/532: mkdir d0/d4/d12/d15/d3b/d62/da4 0 2024-09-13T22:08:44.158 INFO:tasks.workunit.client.0.smithi089.stdout:6/533: dread - d0/d4/d12/f91 zero size 2024-09-13T22:08:44.160 INFO:tasks.workunit.client.0.smithi089.stdout:7/567: unlink d0/d19/d28/d1d/d23/d24/d5d/l52 0 2024-09-13T22:08:44.160 INFO:tasks.workunit.client.0.smithi089.stdout:5/526: dwrite d4/d19/d1e/d28/d31/f40 [0,4194304] 0 2024-09-13T22:08:44.162 INFO:tasks.workunit.client.0.smithi089.stdout:3/561: unlink d1/d2/d31/l57 0 2024-09-13T22:08:44.162 INFO:tasks.workunit.client.0.smithi089.stdout:3/562: fdatasync d1/d2/d23/f35 0 2024-09-13T22:08:44.163 INFO:tasks.workunit.client.0.smithi089.stdout:6/534: mknod d0/d5/d1d/d2d/d55/ca5 0 2024-09-13T22:08:44.163 INFO:tasks.workunit.client.0.smithi089.stdout:6/535: write d0/d4/d12/f91 [34834,31321] 0 2024-09-13T22:08:44.163 INFO:tasks.workunit.client.0.smithi089.stdout:6/536: fdatasync d0/d5/d1d/d56/d4b/f4e 0 2024-09-13T22:08:44.164 INFO:tasks.workunit.client.0.smithi089.stdout:6/537: chown d0/d5/d1d/d54/f8f 2542 1 2024-09-13T22:08:44.165 INFO:tasks.workunit.client.0.smithi089.stdout:5/527: unlink f2 0 2024-09-13T22:08:44.166 INFO:tasks.workunit.client.0.smithi089.stdout:3/563: mknod d1/d2/d4/d1c/cb7 0 2024-09-13T22:08:44.166 INFO:tasks.workunit.client.0.smithi089.stdout:3/564: read - d1/d2/d4/d1c/d7e/f91 zero size 2024-09-13T22:08:44.167 INFO:tasks.workunit.client.0.smithi089.stdout:6/538: getdents d0/d5/d64 0 2024-09-13T22:08:44.167 INFO:tasks.workunit.client.0.smithi089.stdout:8/586: dread d0/dd/db0/d20/d40/d4a/f9e [0,4194304] 0 2024-09-13T22:08:44.169 INFO:tasks.workunit.client.0.smithi089.stdout:3/565: link d1/d3a/l8d d1/d2/d23/d3d/d54/d5d/lb8 0 2024-09-13T22:08:44.169 INFO:tasks.workunit.client.0.smithi089.stdout:3/566: read d1/d2/d31/f6e [2468871,29883] 0 2024-09-13T22:08:44.169 INFO:tasks.workunit.client.0.smithi089.stdout:3/567: creat d1/d2/d23/d3d/d46/fb9 x:0 0 0 2024-09-13T22:08:44.170 INFO:tasks.workunit.client.0.smithi089.stdout:5/528: getdents d4/d19/d1e/d28/d31/d55 0 2024-09-13T22:08:44.171 INFO:tasks.workunit.client.0.smithi089.stdout:8/587: mkdir d0/d6a/d73/dcb 0 2024-09-13T22:08:44.171 INFO:tasks.workunit.client.0.smithi089.stdout:8/588: dread - d0/dd/db0/d3a/fbf zero size 2024-09-13T22:08:44.171 INFO:tasks.workunit.client.0.smithi089.stdout:8/589: write d0/dd/db0/d20/d40/d4a/f9e [4413831,121787] 0 2024-09-13T22:08:44.172 INFO:tasks.workunit.client.0.smithi089.stdout:3/568: symlink d1/d2/d23/lba 0 2024-09-13T22:08:44.173 INFO:tasks.workunit.client.0.smithi089.stdout:3/569: chown d1/d2/d23/l41 2070037 1 2024-09-13T22:08:44.173 INFO:tasks.workunit.client.0.smithi089.stdout:3/570: fdatasync d1/d7/f61 0 2024-09-13T22:08:44.175 INFO:tasks.workunit.client.0.smithi089.stdout:5/529: link d4/d19/l1a d4/d19/d1e/d28/d3d/lc0 0 2024-09-13T22:08:44.177 INFO:tasks.workunit.client.0.smithi089.stdout:5/530: creat d4/d19/d1e/d28/d31/d94/fc1 x:0 0 0 2024-09-13T22:08:44.177 INFO:tasks.workunit.client.0.smithi089.stdout:1/651: dwrite d7/f26 [0,4194304] 0 2024-09-13T22:08:44.178 INFO:tasks.workunit.client.0.smithi089.stdout:6/539: read d0/d4/d12/f37 [2778712,36311] 0 2024-09-13T22:08:44.178 INFO:tasks.workunit.client.0.smithi089.stdout:9/635: dwrite d6/d18/d1b/d89/db8/d52/f4b [0,4194304] 0 2024-09-13T22:08:44.178 INFO:tasks.workunit.client.0.smithi089.stdout:0/763: dwrite d1/de/d15/d41/f68 [0,4194304] 0 2024-09-13T22:08:44.179 INFO:tasks.workunit.client.0.smithi089.stdout:5/531: getdents d4/d19/d1e/d53 0 2024-09-13T22:08:44.184 INFO:tasks.workunit.client.0.smithi089.stdout:3/571: dread d1/d2/d4/d1c/d7e/f7a [0,4194304] 0 2024-09-13T22:08:44.184 INFO:tasks.workunit.client.0.smithi089.stdout:3/572: chown d1/d2/d23/d3d/d54/d5d/fa6 119088 1 2024-09-13T22:08:44.184 INFO:tasks.workunit.client.0.smithi089.stdout:9/636: mknod d6/d18/d1b/da0/dae/cd9 0 2024-09-13T22:08:44.192 INFO:tasks.workunit.client.0.smithi089.stdout:3/573: symlink d1/d2/d23/d3d/d46/dab/lbb 0 2024-09-13T22:08:44.192 INFO:tasks.workunit.client.0.smithi089.stdout:3/574: write d1/d2/f82 [748496,48605] 0 2024-09-13T22:08:44.194 INFO:tasks.workunit.client.0.smithi089.stdout:3/575: rename f0 to d1/d2/d4/d1c/d7e/d83/fbc 0 2024-09-13T22:08:44.195 INFO:tasks.workunit.client.0.smithi089.stdout:6/540: dread d0/f2e [0,4194304] 0 2024-09-13T22:08:44.195 INFO:tasks.workunit.client.0.smithi089.stdout:3/576: symlink d1/d2/d4/d1c/d7e/lbd 0 2024-09-13T22:08:44.196 INFO:tasks.workunit.client.0.smithi089.stdout:6/541: creat d0/d5/d43/d79/fa6 x:0 0 0 2024-09-13T22:08:44.196 INFO:tasks.workunit.client.0.smithi089.stdout:6/542: write d0/d5/d43/d79/fa6 [310653,64868] 0 2024-09-13T22:08:44.197 INFO:tasks.workunit.client.0.smithi089.stdout:6/543: dread - d0/d5/d43/f46 zero size 2024-09-13T22:08:44.197 INFO:tasks.workunit.client.0.smithi089.stdout:6/544: dread - d0/d4/d12/f78 zero size 2024-09-13T22:08:44.198 INFO:tasks.workunit.client.0.smithi089.stdout:0/764: dread d1/de/d15/d41/d49/d76/d8b/fa3 [0,4194304] 0 2024-09-13T22:08:44.207 INFO:tasks.workunit.client.0.smithi089.stdout:0/765: dread d1/f1e [0,4194304] 0 2024-09-13T22:08:44.207 INFO:tasks.workunit.client.0.smithi089.stdout:0/766: getdents d1/de/d10/d36/d57 0 2024-09-13T22:08:44.208 INFO:tasks.workunit.client.0.smithi089.stdout:0/767: mkdir d1/de/d10/d36/d57/d3a/db7/d10a 0 2024-09-13T22:08:44.216 INFO:tasks.workunit.client.0.smithi089.stdout:9/637: dwrite d6/d18/f47 [4194304,4194304] 0 2024-09-13T22:08:44.216 INFO:tasks.workunit.client.0.smithi089.stdout:8/590: dwrite d0/dd/f81 [0,4194304] 0 2024-09-13T22:08:44.216 INFO:tasks.workunit.client.0.smithi089.stdout:9/638: dread - d6/d31/d5e/db1/fb6 zero size 2024-09-13T22:08:44.216 INFO:tasks.workunit.client.0.smithi089.stdout:9/639: truncate d6/d18/d21/f4a 1876709 0 2024-09-13T22:08:44.216 INFO:tasks.workunit.client.0.smithi089.stdout:9/640: readlink d6/d31/lb7 0 2024-09-13T22:08:44.216 INFO:tasks.workunit.client.0.smithi089.stdout:3/577: getdents d1/d2/d23/d3d/d46 0 2024-09-13T22:08:44.218 INFO:tasks.workunit.client.0.smithi089.stdout:8/591: unlink d0/dd/db0/d3a/f5b 0 2024-09-13T22:08:44.219 INFO:tasks.workunit.client.0.smithi089.stdout:9/641: unlink d6/d18/dab/f50 0 2024-09-13T22:08:44.222 INFO:tasks.workunit.client.0.smithi089.stdout:8/592: rename d0/dd/db0/d3a/fbf to d0/dd/db0/d20/d40/d4a/d7f/fcc 0 2024-09-13T22:08:44.222 INFO:tasks.workunit.client.0.smithi089.stdout:8/593: chown d0/dd/db0/d20/d36/d80/d3b/da5/fc3 156 1 2024-09-13T22:08:44.222 INFO:tasks.workunit.client.0.smithi089.stdout:8/594: truncate d0/fc2 109926 0 2024-09-13T22:08:44.223 INFO:tasks.workunit.client.0.smithi089.stdout:3/578: link d1/d2/c20 d1/d2/d4/d1c/d7e/d40/d50/cbe 0 2024-09-13T22:08:44.224 INFO:tasks.workunit.client.0.smithi089.stdout:3/579: symlink d1/d2/d4/d1c/d7e/d38/lbf 0 2024-09-13T22:08:44.224 INFO:tasks.workunit.client.0.smithi089.stdout:3/580: chown d1/d2/d4/d1c/d7e/d40/c9e 3983 1 2024-09-13T22:08:44.226 INFO:tasks.workunit.client.0.smithi089.stdout:6/545: dwrite d0/d4/d12/f85 [0,4194304] 0 2024-09-13T22:08:44.226 INFO:tasks.workunit.client.0.smithi089.stdout:6/546: write d0/d5/d1d/d56/d28/fa1 [273362,37719] 0 2024-09-13T22:08:44.226 INFO:tasks.workunit.client.0.smithi089.stdout:6/547: fdatasync d0/d5/d1d/d56/f47 0 2024-09-13T22:08:44.226 INFO:tasks.workunit.client.0.smithi089.stdout:5/532: dwrite d4/d19/d1e/d28/d31/d35/f47 [0,4194304] 0 2024-09-13T22:08:44.229 INFO:tasks.workunit.client.0.smithi089.stdout:0/768: dwrite d1/de/d10/fb4 [0,4194304] 0 2024-09-13T22:08:44.230 INFO:tasks.workunit.client.0.smithi089.stdout:6/548: symlink d0/d5/d64/la7 0 2024-09-13T22:08:44.231 INFO:tasks.workunit.client.0.smithi089.stdout:9/642: dread d6/d18/f32 [0,4194304] 0 2024-09-13T22:08:44.234 INFO:tasks.workunit.client.0.smithi089.stdout:0/769: symlink d1/de/d10/d36/d38/d4e/d62/d5b/l10b 0 2024-09-13T22:08:44.235 INFO:tasks.workunit.client.0.smithi089.stdout:6/549: rmdir d0 39 2024-09-13T22:08:44.236 INFO:tasks.workunit.client.0.smithi089.stdout:9/643: rmdir d6/d18/d1b/d89/db8 39 2024-09-13T22:08:44.237 INFO:tasks.workunit.client.0.smithi089.stdout:9/644: creat d6/d18/d21/d5d/d6c/fda x:0 0 0 2024-09-13T22:08:44.237 INFO:tasks.workunit.client.0.smithi089.stdout:9/645: stat d6/fc 0 2024-09-13T22:08:44.237 INFO:tasks.workunit.client.0.smithi089.stdout:4/631: sync 2024-09-13T22:08:44.237 INFO:tasks.workunit.client.0.smithi089.stdout:4/632: write d0/d11/d16/f80 [990202,68184] 0 2024-09-13T22:08:44.237 INFO:tasks.workunit.client.0.smithi089.stdout:4/633: chown d0/d15/f7d 40480 1 2024-09-13T22:08:44.238 INFO:tasks.workunit.client.0.smithi089.stdout:5/533: dread d4/d19/f1b [4194304,4194304] 0 2024-09-13T22:08:44.238 INFO:tasks.workunit.client.0.smithi089.stdout:5/534: chown d4/d19/d1e/d28/d31/d55/d58 2542 1 2024-09-13T22:08:44.240 INFO:tasks.workunit.client.0.smithi089.stdout:0/770: dread d1/f5 [0,4194304] 0 2024-09-13T22:08:44.240 INFO:tasks.workunit.client.0.smithi089.stdout:4/634: symlink d0/d2c/d52/da5/d8e/lc7 0 2024-09-13T22:08:44.243 INFO:tasks.workunit.client.0.smithi089.stdout:3/581: dwrite d1/d2/d4/d1c/d7e/d40/d50/fb0 [0,4194304] 0 2024-09-13T22:08:44.250 INFO:tasks.workunit.client.0.smithi089.stdout:9/646: rmdir d6/d31 39 2024-09-13T22:08:44.252 INFO:tasks.workunit.client.0.smithi089.stdout:9/647: dread d6/d18/d1b/f82 [0,4194304] 0 2024-09-13T22:08:44.252 INFO:tasks.workunit.client.0.smithi089.stdout:9/648: getdents d6/d18/d21/d5d/d6c/d8d 0 2024-09-13T22:08:44.252 INFO:tasks.workunit.client.0.smithi089.stdout:0/771: mknod d1/de/d10/d36/d57/d3a/c10c 0 2024-09-13T22:08:44.253 INFO:tasks.workunit.client.0.smithi089.stdout:4/635: symlink d0/d2c/d52/da5/d8e/lc8 0 2024-09-13T22:08:44.253 INFO:tasks.workunit.client.0.smithi089.stdout:4/636: fsync d0/d2c/d35/f67 0 2024-09-13T22:08:44.254 INFO:tasks.workunit.client.0.smithi089.stdout:4/637: chown d0/c3a 77052 1 2024-09-13T22:08:44.265 INFO:tasks.workunit.client.0.smithi089.stdout:4/638: write d0/d2c/d35/d64/f78 [2782282,108577] 0 2024-09-13T22:08:44.266 INFO:tasks.workunit.client.0.smithi089.stdout:6/550: dwrite d0/d4/d12/d15/d3b/d62/f80 [0,4194304] 0 2024-09-13T22:08:44.266 INFO:tasks.workunit.client.0.smithi089.stdout:0/772: read d1/de/d10/fb4 [225017,83892] 0 2024-09-13T22:08:44.266 INFO:tasks.workunit.client.0.smithi089.stdout:5/535: dwrite d4/d19/d1e/d89/d8a/fa7 [0,4194304] 0 2024-09-13T22:08:44.266 INFO:tasks.workunit.client.0.smithi089.stdout:3/582: dwrite d1/d2/d4/d1c/d7f/f86 [0,4194304] 0 2024-09-13T22:08:44.266 INFO:tasks.workunit.client.0.smithi089.stdout:5/536: truncate d4/d19/d1e/d28/d31/d35/d46/f86 1025647 0 2024-09-13T22:08:44.266 INFO:tasks.workunit.client.0.smithi089.stdout:0/773: creat d1/de/d10/d36/d38/d4e/f10d x:0 0 0 2024-09-13T22:08:44.267 INFO:tasks.workunit.client.0.smithi089.stdout:4/639: symlink d0/d2c/d35/d5d/lc9 0 2024-09-13T22:08:44.280 INFO:tasks.workunit.client.0.smithi089.stdout:0/774: read d1/fd [2103072,28323] 0 2024-09-13T22:08:44.282 INFO:tasks.workunit.client.0.smithi089.stdout:0/775: symlink d1/de/d10/d36/d38/d4e/d62/d5f/d72/df0/l10e 0 2024-09-13T22:08:44.282 INFO:tasks.workunit.client.0.smithi089.stdout:4/640: dread d0/fb9 [0,4194304] 0 2024-09-13T22:08:44.283 INFO:tasks.workunit.client.0.smithi089.stdout:0/776: mkdir d1/de/d10/db0/dd9/d10f 0 2024-09-13T22:08:44.283 INFO:tasks.workunit.client.0.smithi089.stdout:0/777: symlink d1/de/d10/d36/d38/d4e/d62/l110 0 2024-09-13T22:08:44.285 INFO:tasks.workunit.client.0.smithi089.stdout:0/778: mkdir d1/de/d10/d36/d38/d4e/d62/d5b/d111 0 2024-09-13T22:08:44.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/641: dread d0/d2c/d52/da5/f61 [0,4194304] 0 2024-09-13T22:08:44.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/642: creat d0/d2c/d8d/fca x:0 0 0 2024-09-13T22:08:44.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/643: write d0/d2c/d35/d64/fb8 [980338,91548] 0 2024-09-13T22:08:44.290 INFO:tasks.workunit.client.0.smithi089.stdout:4/644: dread d0/d2c/d52/da5/f32 [0,4194304] 0 2024-09-13T22:08:44.290 INFO:tasks.workunit.client.0.smithi089.stdout:4/645: chown d0/d2c/d52/da5/d8e/lc7 1149 1 2024-09-13T22:08:44.291 INFO:tasks.workunit.client.0.smithi089.stdout:4/646: truncate d0/d2c/d52/da5/f61 141244 0 2024-09-13T22:08:44.291 INFO:tasks.workunit.client.0.smithi089.stdout:4/647: chown d0/l10 20 1 2024-09-13T22:08:44.291 INFO:tasks.workunit.client.0.smithi089.stdout:4/648: chown d0/d2c/d8d/f9c 113983773 1 2024-09-13T22:08:44.291 INFO:tasks.workunit.client.0.smithi089.stdout:5/537: dwrite d4/d19/d1e/d28/d31/d61/f90 [0,4194304] 0 2024-09-13T22:08:44.291 INFO:tasks.workunit.client.0.smithi089.stdout:3/583: dread d1/d2/d4/d1c/f2a [4194304,4194304] 0 2024-09-13T22:08:44.291 INFO:tasks.workunit.client.0.smithi089.stdout:3/584: chown d1/c30 10629 1 2024-09-13T22:08:44.291 INFO:tasks.workunit.client.0.smithi089.stdout:5/538: stat d4/d19/d1e/d28/d3d/lc0 0 2024-09-13T22:08:44.292 INFO:tasks.workunit.client.0.smithi089.stdout:3/585: truncate d1/d2/d4/d1c/d7e/d40/d50/fb0 2576912 0 2024-09-13T22:08:44.292 INFO:tasks.workunit.client.0.smithi089.stdout:3/586: fdatasync d1/d2/ff 0 2024-09-13T22:08:44.296 INFO:tasks.workunit.client.0.smithi089.stdout:0/779: write d1/de/d15/f8d [5405992,1710] 0 2024-09-13T22:08:44.296 INFO:tasks.workunit.client.0.smithi089.stdout:6/551: dwrite d0/f2e [0,4194304] 0 2024-09-13T22:08:44.296 INFO:tasks.workunit.client.0.smithi089.stdout:0/780: fdatasync d1/de/d1f/f84 0 2024-09-13T22:08:44.296 INFO:tasks.workunit.client.0.smithi089.stdout:6/552: fsync d0/d5/f4d 0 2024-09-13T22:08:44.297 INFO:tasks.workunit.client.0.smithi089.stdout:6/553: rmdir d0/d4/d12/d15/d3b 39 2024-09-13T22:08:44.297 INFO:tasks.workunit.client.0.smithi089.stdout:6/554: creat d0/d4/d12/d15/d3b/d62/fa8 x:0 0 0 2024-09-13T22:08:44.299 INFO:tasks.workunit.client.0.smithi089.stdout:0/781: rename d1/de/d10/d36/d3d/de8/ced to d1/de/d10/c112 0 2024-09-13T22:08:44.299 INFO:tasks.workunit.client.0.smithi089.stdout:6/555: rename d0 to d0/d4/d12/d15/d9b/da9 22 2024-09-13T22:08:44.299 INFO:tasks.workunit.client.0.smithi089.stdout:6/556: readlink d0/d5/d1d/d2d/d55/l5c 0 2024-09-13T22:08:44.299 INFO:tasks.workunit.client.0.smithi089.stdout:0/782: chown d1/de/d10/d36/d38/d4e/d62/d5f/lfa 1909 1 2024-09-13T22:08:44.299 INFO:tasks.workunit.client.0.smithi089.stdout:6/557: fsync d0/d5/d1d/d56/f2a 0 2024-09-13T22:08:44.299 INFO:tasks.workunit.client.0.smithi089.stdout:6/558: chown d0/d4/d12/d15/d3b/l97 2084 1 2024-09-13T22:08:44.300 INFO:tasks.workunit.client.0.smithi089.stdout:4/649: write d0/d2c/f84 [1945088,84215] 0 2024-09-13T22:08:44.303 INFO:tasks.workunit.client.0.smithi089.stdout:0/783: symlink d1/de/d10/d36/d38/d4e/d62/d5b/d5e/d103/l113 0 2024-09-13T22:08:44.303 INFO:tasks.workunit.client.0.smithi089.stdout:3/587: write d1/d7/d1b/f48 [4067017,9757] 0 2024-09-13T22:08:44.303 INFO:tasks.workunit.client.0.smithi089.stdout:5/539: write d4/d19/d1e/d28/d31/f40 [685690,105355] 0 2024-09-13T22:08:44.304 INFO:tasks.workunit.client.0.smithi089.stdout:0/784: rename d1/de/d10/d85/lf7 to d1/de/d10/d36/d57/d3a/db7/l114 0 2024-09-13T22:08:44.307 INFO:tasks.workunit.client.0.smithi089.stdout:5/540: symlink d4/d19/d1e/d28/d31/d55/d58/d84/lc2 0 2024-09-13T22:08:44.307 INFO:tasks.workunit.client.0.smithi089.stdout:5/541: readlink d4/d19/d1e/d28/d31/d61/l7f 0 2024-09-13T22:08:44.310 INFO:tasks.workunit.client.0.smithi089.stdout:0/785: dread d1/de/d15/d41/d87/ff9 [0,4194304] 0 2024-09-13T22:08:44.314 INFO:tasks.workunit.client.0.smithi089.stdout:5/542: rename d4/c26 to d4/d19/d1e/d28/d31/d55/cc3 0 2024-09-13T22:08:44.314 INFO:tasks.workunit.client.0.smithi089.stdout:0/786: getdents d1/de/d15/d41/d49/d76 0 2024-09-13T22:08:44.314 INFO:tasks.workunit.client.0.smithi089.stdout:5/543: rmdir d4/d19/d1e 39 2024-09-13T22:08:44.315 INFO:tasks.workunit.client.0.smithi089.stdout:0/787: mkdir d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4/d115 0 2024-09-13T22:08:44.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/788: dread d1/de/d15/d41/d49/f7b [0,4194304] 0 2024-09-13T22:08:44.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/789: creat d1/de/d10/d85/f116 x:0 0 0 2024-09-13T22:08:44.318 INFO:tasks.workunit.client.0.smithi089.stdout:0/790: link d1/de/d10/d36/d38/d4e/d62/d5f/cab d1/de/d10/d36/d38/d4e/d62/d5b/d111/c117 0 2024-09-13T22:08:44.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/791: creat d1/de/d10/d36/d57/d3a/db7/f118 x:0 0 0 2024-09-13T22:08:44.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/792: creat d1/de/d10/d36/d38/d4e/d62/d5f/f119 x:0 0 0 2024-09-13T22:08:44.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/793: write d1/de/d10/d36/d57/d3a/db7/ff3 [715353,52739] 0 2024-09-13T22:08:44.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/794: write d1/de/fc6 [480546,34921] 0 2024-09-13T22:08:44.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/795: stat d1/de/d15/fd5 0 2024-09-13T22:08:44.334 INFO:tasks.workunit.client.0.smithi089.stdout:3/588: dwrite d1/d2/ff [0,4194304] 0 2024-09-13T22:08:44.334 INFO:tasks.workunit.client.0.smithi089.stdout:0/796: dread d1/de/d10/d36/d38/fc1 [0,4194304] 0 2024-09-13T22:08:44.334 INFO:tasks.workunit.client.0.smithi089.stdout:0/797: chown d1/de/d10/d36/d38/d4e/d62 108756208 1 2024-09-13T22:08:44.335 INFO:tasks.workunit.client.0.smithi089.stdout:0/798: getdents d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4/d115 0 2024-09-13T22:08:44.336 INFO:tasks.workunit.client.0.smithi089.stdout:3/589: rename d1/d2/d23/d3d/d54/d5d/fa7 to d1/d2/d4/d1c/d7f/fc0 0 2024-09-13T22:08:44.336 INFO:tasks.workunit.client.0.smithi089.stdout:3/590: stat d1/d2/d4/d1c/d7e/d38/c9a 0 2024-09-13T22:08:44.336 INFO:tasks.workunit.client.0.smithi089.stdout:3/591: dread - d1/d2/d23/d3d/d46/fb9 zero size 2024-09-13T22:08:44.338 INFO:tasks.workunit.client.0.smithi089.stdout:4/650: dwrite d0/fb9 [4194304,4194304] 0 2024-09-13T22:08:44.338 INFO:tasks.workunit.client.0.smithi089.stdout:6/559: dwrite d0/d5/d1d/f82 [0,4194304] 0 2024-09-13T22:08:44.338 INFO:tasks.workunit.client.0.smithi089.stdout:5/544: dwrite d4/d19/d1e/d28/fb8 [0,4194304] 0 2024-09-13T22:08:44.346 INFO:tasks.workunit.client.0.smithi089.stdout:0/799: dread d1/de/f3e [4194304,4194304] 0 2024-09-13T22:08:44.346 INFO:tasks.workunit.client.0.smithi089.stdout:0/800: fsync d1/de/d15/d2a/ffc 0 2024-09-13T22:08:44.348 INFO:tasks.workunit.client.0.smithi089.stdout:0/801: dread d1/de/d10/d36/d39/f94 [0,4194304] 0 2024-09-13T22:08:44.349 INFO:tasks.workunit.client.0.smithi089.stdout:0/802: chown d1/de 32 1 2024-09-13T22:08:44.349 INFO:tasks.workunit.client.0.smithi089.stdout:0/803: truncate d1/de/d10/d36/d38/d4e/d62/d5b/f63 1066763 0 2024-09-13T22:08:44.349 INFO:tasks.workunit.client.0.smithi089.stdout:0/804: chown d1/de/d10/d36/d3d/de8/c101 1223882 1 2024-09-13T22:08:44.349 INFO:tasks.workunit.client.0.smithi089.stdout:0/805: symlink d1/de/d15/d41/d49/d76/d8b/l11a 0 2024-09-13T22:08:44.349 INFO:tasks.workunit.client.0.smithi089.stdout:0/806: chown d1/de/d10/d36/d57/c6c 1302873932 1 2024-09-13T22:08:44.350 INFO:tasks.workunit.client.0.smithi089.stdout:2/564: sync 2024-09-13T22:08:44.350 INFO:tasks.workunit.client.0.smithi089.stdout:7/568: sync 2024-09-13T22:08:44.351 INFO:tasks.workunit.client.0.smithi089.stdout:1/652: sync 2024-09-13T22:08:44.352 INFO:tasks.workunit.client.0.smithi089.stdout:2/565: mkdir df/d14/d2b/d61/dbd 0 2024-09-13T22:08:44.352 INFO:tasks.workunit.client.0.smithi089.stdout:8/595: sync 2024-09-13T22:08:44.352 INFO:tasks.workunit.client.0.smithi089.stdout:8/596: chown d0/dd/db0/d42/f77 9234566 1 2024-09-13T22:08:44.352 INFO:tasks.workunit.client.0.smithi089.stdout:8/597: chown d0/dd/db0/d20/d1c/d5a/c7c 6016104 1 2024-09-13T22:08:44.353 INFO:tasks.workunit.client.0.smithi089.stdout:7/569: rename d0/d19/d28/d1d/d23/f99 to d0/d19/d45/d38/d54/fba 0 2024-09-13T22:08:44.353 INFO:tasks.workunit.client.0.smithi089.stdout:7/570: fdatasync d0/d19/d28/d7b/f97 0 2024-09-13T22:08:44.353 INFO:tasks.workunit.client.0.smithi089.stdout:7/571: creat d0/d19/d28/d1d/d23/d24/fbb x:0 0 0 2024-09-13T22:08:44.353 INFO:tasks.workunit.client.0.smithi089.stdout:9/649: sync 2024-09-13T22:08:44.354 INFO:tasks.workunit.client.0.smithi089.stdout:2/566: unlink df/d14/d66/d69/d2e/c89 0 2024-09-13T22:08:44.355 INFO:tasks.workunit.client.0.smithi089.stdout:2/567: dread - df/d76/d85/fb0 zero size 2024-09-13T22:08:44.355 INFO:tasks.workunit.client.0.smithi089.stdout:2/568: chown df/d14/d66/d69/d2e/l5d 17160 1 2024-09-13T22:08:44.355 INFO:tasks.workunit.client.0.smithi089.stdout:4/651: dwrite d0/d2c/d35/d5d/fac [0,4194304] 0 2024-09-13T22:08:44.355 INFO:tasks.workunit.client.0.smithi089.stdout:7/572: mkdir d0/d19/d28/dbc 0 2024-09-13T22:08:44.357 INFO:tasks.workunit.client.0.smithi089.stdout:9/650: creat d6/d18/d1b/d3e/dbd/fdb x:0 0 0 2024-09-13T22:08:44.361 INFO:tasks.workunit.client.0.smithi089.stdout:2/569: unlink df/d76/d85/fb4 0 2024-09-13T22:08:44.361 INFO:tasks.workunit.client.0.smithi089.stdout:7/573: truncate d0/ff 3099422 0 2024-09-13T22:08:44.363 INFO:tasks.workunit.client.0.smithi089.stdout:9/651: creat d6/d31/d64/fdc x:0 0 0 2024-09-13T22:08:44.363 INFO:tasks.workunit.client.0.smithi089.stdout:2/570: link df/d1a/d57/fba df/d14/d2b/d61/fbe 0 2024-09-13T22:08:44.363 INFO:tasks.workunit.client.0.smithi089.stdout:2/571: fsync df/f74 0 2024-09-13T22:08:44.363 INFO:tasks.workunit.client.0.smithi089.stdout:2/572: chown df/d14/d66/d69/d2e/c82 57 1 2024-09-13T22:08:44.364 INFO:tasks.workunit.client.0.smithi089.stdout:7/574: creat d0/d19/d28/d1d/d23/d2e/fbd x:0 0 0 2024-09-13T22:08:44.364 INFO:tasks.workunit.client.0.smithi089.stdout:7/575: fsync d0/f8c 0 2024-09-13T22:08:44.365 INFO:tasks.workunit.client.0.smithi089.stdout:2/573: mkdir df/d5b/da5/db8/dbf 0 2024-09-13T22:08:44.365 INFO:tasks.workunit.client.0.smithi089.stdout:4/652: dread d0/d2c/d52/da5/d8e/fab [0,4194304] 0 2024-09-13T22:08:44.365 INFO:tasks.workunit.client.0.smithi089.stdout:4/653: stat d0/d15/d83/c91 0 2024-09-13T22:08:44.365 INFO:tasks.workunit.client.0.smithi089.stdout:7/576: link d0/d19/d28/f44 d0/d19/d28/d1d/d23/d2e/d41/da9/fbe 0 2024-09-13T22:08:44.365 INFO:tasks.workunit.client.0.smithi089.stdout:2/574: rmdir df/d5b/da5/db8 39 2024-09-13T22:08:44.366 INFO:tasks.workunit.client.0.smithi089.stdout:4/654: symlink d0/d11/d16/d89/lcb 0 2024-09-13T22:08:44.367 INFO:tasks.workunit.client.0.smithi089.stdout:2/575: creat df/d5b/da5/db8/dbf/fc0 x:0 0 0 2024-09-13T22:08:44.368 INFO:tasks.workunit.client.0.smithi089.stdout:4/655: mknod d0/d2c/d35/d5d/ccc 0 2024-09-13T22:08:44.377 INFO:tasks.workunit.client.0.smithi089.stdout:9/652: dread d6/d55/f6d [0,4194304] 0 2024-09-13T22:08:44.378 INFO:tasks.workunit.client.0.smithi089.stdout:8/598: dwrite d0/dd/db0/d20/d36/d57/f60 [4194304,4194304] 0 2024-09-13T22:08:44.379 INFO:tasks.workunit.client.0.smithi089.stdout:8/599: unlink d0/dd/db0/d20/d36/d68/f9d 0 2024-09-13T22:08:44.385 INFO:tasks.workunit.client.0.smithi089.stdout:2/576: dwrite df/d14/f65 [4194304,4194304] 0 2024-09-13T22:08:44.385 INFO:tasks.workunit.client.0.smithi089.stdout:2/577: chown df/d14/c72 114862 1 2024-09-13T22:08:44.387 INFO:tasks.workunit.client.0.smithi089.stdout:2/578: symlink df/d14/d66/d8a/lc1 0 2024-09-13T22:08:44.387 INFO:tasks.workunit.client.0.smithi089.stdout:2/579: creat df/d76/d85/db2/fc2 x:0 0 0 2024-09-13T22:08:44.387 INFO:tasks.workunit.client.0.smithi089.stdout:2/580: fdatasync df/d1a/d57/d68/f71 0 2024-09-13T22:08:44.387 INFO:tasks.workunit.client.0.smithi089.stdout:2/581: dread - df/d1a/d57/fba zero size 2024-09-13T22:08:44.387 INFO:tasks.workunit.client.0.smithi089.stdout:2/582: write df/d14/d66/d69/f80 [5242516,110141] 0 2024-09-13T22:08:44.387 INFO:tasks.workunit.client.0.smithi089.stdout:2/583: fdatasync df/d14/d48/d88/f9a 0 2024-09-13T22:08:44.387 INFO:tasks.workunit.client.0.smithi089.stdout:2/584: fdatasync df/d14/d2b/d61/f49 0 2024-09-13T22:08:44.391 INFO:tasks.workunit.client.0.smithi089.stdout:2/585: mkdir df/dc3 0 2024-09-13T22:08:44.393 INFO:tasks.workunit.client.0.smithi089.stdout:7/577: rename d0/d19/d28/d1d/d23/d2e/d41/da9 to d0/d19/d28/d1d/d23/d2e/d41/dbf 0 2024-09-13T22:08:44.393 INFO:tasks.workunit.client.0.smithi089.stdout:1/653: dwrite d7/d1c/f72 [0,4194304] 0 2024-09-13T22:08:44.393 INFO:tasks.workunit.client.0.smithi089.stdout:9/653: write d6/d31/d64/f91 [421184,118500] 0 2024-09-13T22:08:44.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/656: dwrite d0/f13 [0,4194304] 0 2024-09-13T22:08:44.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/657: fdatasync d0/d2c/da1/fc6 0 2024-09-13T22:08:44.394 INFO:tasks.workunit.client.0.smithi089.stdout:2/586: unlink df/d14/d66/d69/f80 0 2024-09-13T22:08:44.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/658: write d0/d2c/d35/d64/fb8 [1337435,85258] 0 2024-09-13T22:08:44.395 INFO:tasks.workunit.client.0.smithi089.stdout:1/654: rename c6 to d7/d40/dbe/d2b/d39/d73/ce1 0 2024-09-13T22:08:44.396 INFO:tasks.workunit.client.0.smithi089.stdout:9/654: symlink d6/d18/d1b/d3e/dbd/ldd 0 2024-09-13T22:08:44.397 INFO:tasks.workunit.client.0.smithi089.stdout:4/659: unlink d0/d2c/d35/d64/f6f 0 2024-09-13T22:08:44.397 INFO:tasks.workunit.client.0.smithi089.stdout:1/655: symlink d7/d34/d5c/de0/le2 0 2024-09-13T22:08:44.397 INFO:tasks.workunit.client.0.smithi089.stdout:1/656: fdatasync d7/d40/dbe/d80/f82 0 2024-09-13T22:08:44.398 INFO:tasks.workunit.client.0.smithi089.stdout:9/655: truncate d6/d54/fa4 2953191 0 2024-09-13T22:08:44.398 INFO:tasks.workunit.client.0.smithi089.stdout:9/656: stat d6/d18/d1b/da0/fd8 0 2024-09-13T22:08:44.400 INFO:tasks.workunit.client.0.smithi089.stdout:4/660: mkdir d0/d15/d83/dcd 0 2024-09-13T22:08:44.400 INFO:tasks.workunit.client.0.smithi089.stdout:9/657: mkdir d6/d18/dde 0 2024-09-13T22:08:44.400 INFO:tasks.workunit.client.0.smithi089.stdout:9/658: truncate d6/d31/d5e/db1/fb6 373653 0 2024-09-13T22:08:44.400 INFO:tasks.workunit.client.0.smithi089.stdout:8/600: dwrite d0/dd/db0/d20/f2e [0,4194304] 0 2024-09-13T22:08:44.400 INFO:tasks.workunit.client.0.smithi089.stdout:8/601: write d0/dd/db0/d20/d36/fab [213025,14403] 0 2024-09-13T22:08:44.401 INFO:tasks.workunit.client.0.smithi089.stdout:4/661: symlink d0/d2c/d52/da5/d62/d8c/lce 0 2024-09-13T22:08:44.403 INFO:tasks.workunit.client.0.smithi089.stdout:8/602: symlink d0/lcd 0 2024-09-13T22:08:44.403 INFO:tasks.workunit.client.0.smithi089.stdout:8/603: read - d0/dd/db0/d3a/f94 zero size 2024-09-13T22:08:44.404 INFO:tasks.workunit.client.0.smithi089.stdout:9/659: getdents d6/d31/d64 0 2024-09-13T22:08:44.404 INFO:tasks.workunit.client.0.smithi089.stdout:7/578: dread d0/d19/d28/f1c [0,4194304] 0 2024-09-13T22:08:44.405 INFO:tasks.workunit.client.0.smithi089.stdout:8/604: mkdir d0/dd/db0/d20/d1c/d5a/d63/dce 0 2024-09-13T22:08:44.407 INFO:tasks.workunit.client.0.smithi089.stdout:9/660: creat d6/d18/d21/d5d/d6c/d8d/fdf x:0 0 0 2024-09-13T22:08:44.409 INFO:tasks.workunit.client.0.smithi089.stdout:2/587: rmdir df/d14/d66 39 2024-09-13T22:08:44.409 INFO:tasks.workunit.client.0.smithi089.stdout:2/588: write df/d14/d66/d69/f44 [2143141,78147] 0 2024-09-13T22:08:44.412 INFO:tasks.workunit.client.0.smithi089.stdout:8/605: mknod d0/dd/db0/d20/d36/d59/ccf 0 2024-09-13T22:08:44.412 INFO:tasks.workunit.client.0.smithi089.stdout:8/606: fdatasync d0/dd/db0/d20/d1c/fba 0 2024-09-13T22:08:44.413 INFO:tasks.workunit.client.0.smithi089.stdout:7/579: rmdir d0/d19/d28/d1d/d3d 39 2024-09-13T22:08:44.416 INFO:tasks.workunit.client.0.smithi089.stdout:4/662: rmdir d0/d2c/d35/d64 39 2024-09-13T22:08:44.418 INFO:tasks.workunit.client.0.smithi089.stdout:4/663: creat d0/d2c/da0/fcf x:0 0 0 2024-09-13T22:08:44.419 INFO:tasks.workunit.client.0.smithi089.stdout:8/607: write d0/dd/db0/d20/d40/d4a/f9e [984777,40938] 0 2024-09-13T22:08:44.420 INFO:tasks.workunit.client.0.smithi089.stdout:4/664: mknod d0/d2c/da0/da9/cd0 0 2024-09-13T22:08:44.420 INFO:tasks.workunit.client.0.smithi089.stdout:4/665: fsync d0/d2c/da1/fc3 0 2024-09-13T22:08:44.420 INFO:tasks.workunit.client.0.smithi089.stdout:4/666: chown d0/d2c/d35/d74 45603152 1 2024-09-13T22:08:44.420 INFO:tasks.workunit.client.0.smithi089.stdout:4/667: write d0/d2c/f45 [2702438,119149] 0 2024-09-13T22:08:44.422 INFO:tasks.workunit.client.0.smithi089.stdout:8/608: rename d0/dd/db0/d20/d36/d80/d3b/f6b to d0/dd/db0/d3a/d83/fd0 0 2024-09-13T22:08:44.425 INFO:tasks.workunit.client.0.smithi089.stdout:7/580: write d0/d19/d28/d1d/f64 [1724465,122770] 0 2024-09-13T22:08:44.425 INFO:tasks.workunit.client.0.smithi089.stdout:7/581: chown d0/d19/d28/d1d/d30 2015238 1 2024-09-13T22:08:44.425 INFO:tasks.workunit.client.0.smithi089.stdout:4/668: read d0/d2c/d52/fb2 [37805,63062] 0 2024-09-13T22:08:44.425 INFO:tasks.workunit.client.0.smithi089.stdout:4/669: write d0/d11/d16/d89/f95 [763986,56226] 0 2024-09-13T22:08:44.425 INFO:tasks.workunit.client.0.smithi089.stdout:4/670: chown d0/d2c/d35/d74/caa 3 1 2024-09-13T22:08:44.425 INFO:tasks.workunit.client.0.smithi089.stdout:8/609: mkdir d0/dd/db0/d20/d36/dd1 0 2024-09-13T22:08:44.425 INFO:tasks.workunit.client.0.smithi089.stdout:8/610: stat d0/dd/db0/d20/d36/d59/d89/d8d/f99 0 2024-09-13T22:08:44.426 INFO:tasks.workunit.client.0.smithi089.stdout:8/611: chown d0/dd/db0/d42/dc7 27 1 2024-09-13T22:08:44.426 INFO:tasks.workunit.client.0.smithi089.stdout:8/612: creat d0/dd/db0/d20/d36/d80/d3b/da5/fd2 x:0 0 0 2024-09-13T22:08:44.426 INFO:tasks.workunit.client.0.smithi089.stdout:8/613: fdatasync d0/dd/f14 0 2024-09-13T22:08:44.426 INFO:tasks.workunit.client.0.smithi089.stdout:4/671: stat d0/d2c/d35/d5d/c5e 0 2024-09-13T22:08:44.427 INFO:tasks.workunit.client.0.smithi089.stdout:8/614: mknod d0/dd/db0/d42/cd3 0 2024-09-13T22:08:44.427 INFO:tasks.workunit.client.0.smithi089.stdout:8/615: read d0/dd/db0/fb2 [1851681,57165] 0 2024-09-13T22:08:44.427 INFO:tasks.workunit.client.0.smithi089.stdout:4/672: rename d0/d15/f4d to d0/d2c/da1/fd1 0 2024-09-13T22:08:44.427 INFO:tasks.workunit.client.0.smithi089.stdout:4/673: write d0/d2c/d8d/fbe [4417994,98693] 0 2024-09-13T22:08:44.428 INFO:tasks.workunit.client.0.smithi089.stdout:8/616: mkdir d0/dd/db0/d3a/dd4 0 2024-09-13T22:08:44.429 INFO:tasks.workunit.client.0.smithi089.stdout:4/674: creat d0/d2c/d52/da5/d9d/fd2 x:0 0 0 2024-09-13T22:08:44.429 INFO:tasks.workunit.client.0.smithi089.stdout:4/675: dread - d0/d11/fc2 zero size 2024-09-13T22:08:44.429 INFO:tasks.workunit.client.0.smithi089.stdout:8/617: truncate d0/dd/f14 2623192 0 2024-09-13T22:08:44.430 INFO:tasks.workunit.client.0.smithi089.stdout:4/676: symlink d0/ld3 0 2024-09-13T22:08:44.433 INFO:tasks.workunit.client.0.smithi089.stdout:1/657: dwrite d7/d1c/d7a/fbf [0,4194304] 0 2024-09-13T22:08:44.433 INFO:tasks.workunit.client.0.smithi089.stdout:1/658: write d7/de/d3a/fda [38203,3961] 0 2024-09-13T22:08:44.437 INFO:tasks.workunit.client.0.smithi089.stdout:9/661: dwrite d6/d18/d1b/d89/db8/d5a/f9b [0,4194304] 0 2024-09-13T22:08:44.438 INFO:tasks.workunit.client.0.smithi089.stdout:7/582: write d0/d19/d28/d1d/f2c [1534520,125668] 0 2024-09-13T22:08:44.439 INFO:tasks.workunit.client.0.smithi089.stdout:2/589: dwrite df/d14/d2b/fb3 [0,4194304] 0 2024-09-13T22:08:44.439 INFO:tasks.workunit.client.0.smithi089.stdout:2/590: fdatasync df/d14/d2b/d61/f49 0 2024-09-13T22:08:44.440 INFO:tasks.workunit.client.0.smithi089.stdout:1/659: mkdir d7/d40/dbe/d80/dbb/de3 0 2024-09-13T22:08:44.440 INFO:tasks.workunit.client.0.smithi089.stdout:1/660: fdatasync d7/d40/f79 0 2024-09-13T22:08:44.440 INFO:tasks.workunit.client.0.smithi089.stdout:1/661: write d7/d34/d5c/d5d/f62 [1549674,24235] 0 2024-09-13T22:08:44.440 INFO:tasks.workunit.client.0.smithi089.stdout:9/662: mkdir d6/d54/dcb/de0 0 2024-09-13T22:08:44.441 INFO:tasks.workunit.client.0.smithi089.stdout:9/663: write d6/d31/fbc [827698,43588] 0 2024-09-13T22:08:44.443 INFO:tasks.workunit.client.0.smithi089.stdout:7/583: symlink d0/d19/d28/d1d/d23/d89/lc0 0 2024-09-13T22:08:44.446 INFO:tasks.workunit.client.0.smithi089.stdout:2/591: truncate df/d1a/d57/d68/f71 150399 0 2024-09-13T22:08:44.446 INFO:tasks.workunit.client.0.smithi089.stdout:2/592: dread - df/d14/d66/d69/fa7 zero size 2024-09-13T22:08:44.447 INFO:tasks.workunit.client.0.smithi089.stdout:9/664: symlink d6/d18/d1b/d89/db8/d5a/le1 0 2024-09-13T22:08:44.450 INFO:tasks.workunit.client.0.smithi089.stdout:9/665: mknod d6/d18/d21/d5d/d6c/d8d/ce2 0 2024-09-13T22:08:44.452 INFO:tasks.workunit.client.0.smithi089.stdout:2/593: getdents df/d76/d85 0 2024-09-13T22:08:44.463 INFO:tasks.workunit.client.0.smithi089.stdout:2/594: dread df/f74 [0,4194304] 0 2024-09-13T22:08:44.463 INFO:tasks.workunit.client.0.smithi089.stdout:3/592: sync 2024-09-13T22:08:44.463 INFO:tasks.workunit.client.0.smithi089.stdout:3/593: write d1/d2/d23/d3d/d54/d5d/faa [216936,92002] 0 2024-09-13T22:08:44.464 INFO:tasks.workunit.client.0.smithi089.stdout:3/594: write d1/d2/d23/d3d/d54/d95/f9f [660495,95196] 0 2024-09-13T22:08:44.466 INFO:tasks.workunit.client.0.smithi089.stdout:2/595: mknod df/d1a/d57/d68/cc4 0 2024-09-13T22:08:44.466 INFO:tasks.workunit.client.0.smithi089.stdout:3/595: mkdir d1/d2/d23/d3d/d54/d5d/dc1 0 2024-09-13T22:08:44.467 INFO:tasks.workunit.client.0.smithi089.stdout:3/596: readlink d1/d2/d4/d1c/d7e/d40/d69/da1/l45 0 2024-09-13T22:08:44.467 INFO:tasks.workunit.client.0.smithi089.stdout:3/597: fdatasync d1/d2/ff 0 2024-09-13T22:08:44.467 INFO:tasks.workunit.client.0.smithi089.stdout:2/596: link df/d5b/c97 df/d14/d2b/cc5 0 2024-09-13T22:08:44.467 INFO:tasks.workunit.client.0.smithi089.stdout:2/597: creat df/d5b/fc6 x:0 0 0 2024-09-13T22:08:44.467 INFO:tasks.workunit.client.0.smithi089.stdout:2/598: truncate df/d76/d85/db2/fc2 627521 0 2024-09-13T22:08:44.467 INFO:tasks.workunit.client.0.smithi089.stdout:2/599: fdatasync df/d1a/d57/f83 0 2024-09-13T22:08:44.468 INFO:tasks.workunit.client.0.smithi089.stdout:2/600: fsync df/f26 0 2024-09-13T22:08:44.469 INFO:tasks.workunit.client.0.smithi089.stdout:3/598: mknod d1/d2/d4/d1c/d7e/d40/cc2 0 2024-09-13T22:08:44.469 INFO:tasks.workunit.client.0.smithi089.stdout:2/601: write df/f8d [842315,4159] 0 2024-09-13T22:08:44.470 INFO:tasks.workunit.client.0.smithi089.stdout:3/599: rename d1/d2/d4/d1c/d7e/d38 to d1/d2/d96/dc3 0 2024-09-13T22:08:44.470 INFO:tasks.workunit.client.0.smithi089.stdout:3/600: write d1/d2/d23/d3d/d54/d5d/faa [456721,122558] 0 2024-09-13T22:08:44.470 INFO:tasks.workunit.client.0.smithi089.stdout:3/601: fdatasync d1/d2/d4/d1c/f2a 0 2024-09-13T22:08:44.470 INFO:tasks.workunit.client.0.smithi089.stdout:3/602: write d1/d2/d23/d3d/d54/d5d/faa [1068470,129293] 0 2024-09-13T22:08:44.470 INFO:tasks.workunit.client.0.smithi089.stdout:3/603: fdatasync d1/d2/d23/d3d/d46/f8b 0 2024-09-13T22:08:44.471 INFO:tasks.workunit.client.0.smithi089.stdout:3/604: rmdir d1/d7/d1b/d28 39 2024-09-13T22:08:44.472 INFO:tasks.workunit.client.0.smithi089.stdout:3/605: link d1/d2/d4/l1f d1/d7/d1b/d28/d63/lc4 0 2024-09-13T22:08:44.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/606: creat d1/d2/fc5 x:0 0 0 2024-09-13T22:08:44.474 INFO:tasks.workunit.client.0.smithi089.stdout:3/607: mkdir d1/d2/d23/d3d/d54/dc6 0 2024-09-13T22:08:44.474 INFO:tasks.workunit.client.0.smithi089.stdout:3/608: write d1/d2/d23/d3d/d46/f8b [531607,26487] 0 2024-09-13T22:08:44.474 INFO:tasks.workunit.client.0.smithi089.stdout:3/609: dread - d1/d2/d4/d1c/d7e/d40/d69/f70 zero size 2024-09-13T22:08:44.475 INFO:tasks.workunit.client.0.smithi089.stdout:3/610: rmdir d1/d2/d4 39 2024-09-13T22:08:44.475 INFO:tasks.workunit.client.0.smithi089.stdout:3/611: dread - d1/d7/d1b/d28/d97/fa2 zero size 2024-09-13T22:08:44.475 INFO:tasks.workunit.client.0.smithi089.stdout:3/612: mknod d1/d2/d4/d1c/d7e/d40/cc7 0 2024-09-13T22:08:44.476 INFO:tasks.workunit.client.0.smithi089.stdout:3/613: symlink d1/d2/d96/dc3/lc8 0 2024-09-13T22:08:44.476 INFO:tasks.workunit.client.0.smithi089.stdout:3/614: write d1/d2/d4/d1c/d7e/d40/d69/da1/f89 [2813251,44688] 0 2024-09-13T22:08:44.479 INFO:tasks.workunit.client.0.smithi089.stdout:8/618: dwrite d0/dd/db0/d20/d36/d80/d70/f7e [0,4194304] 0 2024-09-13T22:08:44.479 INFO:tasks.workunit.client.0.smithi089.stdout:4/677: dwrite d0/d2c/d35/d64/f78 [0,4194304] 0 2024-09-13T22:08:44.480 INFO:tasks.workunit.client.0.smithi089.stdout:4/678: truncate d0/d15/fbc 466432 0 2024-09-13T22:08:44.480 INFO:tasks.workunit.client.0.smithi089.stdout:7/584: dwrite d0/d19/d28/d1d/d23/d2e/d41/f65 [0,4194304] 0 2024-09-13T22:08:44.481 INFO:tasks.workunit.client.0.smithi089.stdout:9/666: dwrite d6/d18/d1b/d89/db8/d52/f4b [0,4194304] 0 2024-09-13T22:08:44.483 INFO:tasks.workunit.client.0.smithi089.stdout:4/679: rename d0/d15/d83 to d0/d2c/d35/d64/dd4 0 2024-09-13T22:08:44.483 INFO:tasks.workunit.client.0.smithi089.stdout:4/680: dread d0/f3e [0,4194304] 0 2024-09-13T22:08:44.484 INFO:tasks.workunit.client.0.smithi089.stdout:4/681: readlink d0/d11/d16/d89/lcb 0 2024-09-13T22:08:44.486 INFO:tasks.workunit.client.0.smithi089.stdout:8/619: dread d0/dd/db0/d20/f2e [0,4194304] 0 2024-09-13T22:08:44.487 INFO:tasks.workunit.client.0.smithi089.stdout:8/620: dread d0/dd/db0/d20/d36/d57/f82 [0,4194304] 0 2024-09-13T22:08:44.488 INFO:tasks.workunit.client.0.smithi089.stdout:7/585: creat d0/d19/d28/d1d/d23/d24/dac/fc1 x:0 0 0 2024-09-13T22:08:44.490 INFO:tasks.workunit.client.0.smithi089.stdout:9/667: mknod d6/d18/d1b/d89/ce3 0 2024-09-13T22:08:44.490 INFO:tasks.workunit.client.0.smithi089.stdout:9/668: write d6/d18/d1b/d89/db8/d5a/fa8 [1374615,65230] 0 2024-09-13T22:08:44.491 INFO:tasks.workunit.client.0.smithi089.stdout:9/669: write d6/fc [1457641,4808] 0 2024-09-13T22:08:44.491 INFO:tasks.workunit.client.0.smithi089.stdout:4/682: mknod d0/d2c/d52/da5/d62/d8c/cd5 0 2024-09-13T22:08:44.491 INFO:tasks.workunit.client.0.smithi089.stdout:4/683: chown d0/d15/d1f/l6b 310087 1 2024-09-13T22:08:44.493 INFO:tasks.workunit.client.0.smithi089.stdout:8/621: getdents d0/dd/db0/d20/d36/d57 0 2024-09-13T22:08:44.493 INFO:tasks.workunit.client.0.smithi089.stdout:8/622: chown d0/dd/db0/d3a/l69 21166721 1 2024-09-13T22:08:44.495 INFO:tasks.workunit.client.0.smithi089.stdout:7/586: rename d0/f3f to d0/d19/d28/d1d/d23/d2e/d41/fc2 0 2024-09-13T22:08:44.495 INFO:tasks.workunit.client.0.smithi089.stdout:7/587: write d0/d19/d28/d1d/d23/d24/f8d [651912,54890] 0 2024-09-13T22:08:44.495 INFO:tasks.workunit.client.0.smithi089.stdout:7/588: creat d0/d19/d28/d1d/d23/d2e/fc3 x:0 0 0 2024-09-13T22:08:44.495 INFO:tasks.workunit.client.0.smithi089.stdout:9/670: symlink d6/d31/d64/le4 0 2024-09-13T22:08:44.497 INFO:tasks.workunit.client.0.smithi089.stdout:4/684: link d0/d2c/da0/fcf d0/d2c/d52/da5/d62/d8c/d9e/fd6 0 2024-09-13T22:08:44.499 INFO:tasks.workunit.client.0.smithi089.stdout:8/623: creat d0/d6a/d6f/fd5 x:0 0 0 2024-09-13T22:08:44.499 INFO:tasks.workunit.client.0.smithi089.stdout:4/685: dread d0/d2c/d52/da5/d62/fa3 [0,4194304] 0 2024-09-13T22:08:44.499 INFO:tasks.workunit.client.0.smithi089.stdout:8/624: fsync d0/fc8 0 2024-09-13T22:08:44.503 INFO:tasks.workunit.client.0.smithi089.stdout:7/589: rename d0/d19/d28/d1d/d3d/d9a/f9e to d0/d19/d28/d1d/d2d/d3c/fc4 0 2024-09-13T22:08:44.505 INFO:tasks.workunit.client.0.smithi089.stdout:9/671: getdents d6 0 2024-09-13T22:08:44.508 INFO:tasks.workunit.client.0.smithi089.stdout:8/625: stat d0/dd/db0/d20/d36/d59/cad 0 2024-09-13T22:08:44.510 INFO:tasks.workunit.client.0.smithi089.stdout:7/590: mknod d0/d19/d28/d1d/d23/d89/cc5 0 2024-09-13T22:08:44.512 INFO:tasks.workunit.client.0.smithi089.stdout:9/672: symlink d6/d18/d1b/da0/le5 0 2024-09-13T22:08:44.513 INFO:tasks.workunit.client.0.smithi089.stdout:8/626: creat d0/dd/db0/d20/d36/d80/d70/fd6 x:0 0 0 2024-09-13T22:08:44.513 INFO:tasks.workunit.client.0.smithi089.stdout:8/627: chown d0/dd/db0/d20/d36/d59/ccf 2 1 2024-09-13T22:08:44.513 INFO:tasks.workunit.client.0.smithi089.stdout:6/560: sync 2024-09-13T22:08:44.513 INFO:tasks.workunit.client.0.smithi089.stdout:5/545: sync 2024-09-13T22:08:44.514 INFO:tasks.workunit.client.0.smithi089.stdout:7/591: symlink d0/d19/lc6 0 2024-09-13T22:08:44.514 INFO:tasks.workunit.client.0.smithi089.stdout:5/546: stat d4/d19/d1e/d28/d31/d35/d46/l4a 0 2024-09-13T22:08:44.515 INFO:tasks.workunit.client.0.smithi089.stdout:5/547: write d4/d19/f3c [1008039,21983] 0 2024-09-13T22:08:44.515 INFO:tasks.workunit.client.0.smithi089.stdout:5/548: chown d4/d19/d1e/d28/fb8 44 1 2024-09-13T22:08:44.515 INFO:tasks.workunit.client.0.smithi089.stdout:6/561: creat d0/d5/d1d/d2d/da0/faa x:0 0 0 2024-09-13T22:08:44.516 INFO:tasks.workunit.client.0.smithi089.stdout:7/592: creat d0/d19/d45/d38/d54/fc7 x:0 0 0 2024-09-13T22:08:44.516 INFO:tasks.workunit.client.0.smithi089.stdout:4/686: dwrite d0/d2c/d35/d5d/f8a [0,4194304] 0 2024-09-13T22:08:44.517 INFO:tasks.workunit.client.0.smithi089.stdout:4/687: chown d0/d15/d1f/cc4 2021088 1 2024-09-13T22:08:44.517 INFO:tasks.workunit.client.0.smithi089.stdout:5/549: unlink d4/d19/d1e/d53/fa2 0 2024-09-13T22:08:44.517 INFO:tasks.workunit.client.0.smithi089.stdout:5/550: readlink d4/d19/d1e/d89/d8a/l8b 0 2024-09-13T22:08:44.518 INFO:tasks.workunit.client.0.smithi089.stdout:6/562: mknod d0/cab 0 2024-09-13T22:08:44.521 INFO:tasks.workunit.client.0.smithi089.stdout:5/551: mknod d4/d19/d1e/d28/cc4 0 2024-09-13T22:08:44.524 INFO:tasks.workunit.client.0.smithi089.stdout:4/688: write d0/d2c/d52/da5/f2f [4021312,41039] 0 2024-09-13T22:08:44.527 INFO:tasks.workunit.client.0.smithi089.stdout:6/563: symlink d0/d5/d1d/d56/d4b/lac 0 2024-09-13T22:08:44.527 INFO:tasks.workunit.client.0.smithi089.stdout:5/552: chown d4/f54 801032641 1 2024-09-13T22:08:44.532 INFO:tasks.workunit.client.0.smithi089.stdout:6/564: unlink d0/ca 0 2024-09-13T22:08:44.533 INFO:tasks.workunit.client.0.smithi089.stdout:4/689: truncate d0/f8 1878070 0 2024-09-13T22:08:44.534 INFO:tasks.workunit.client.0.smithi089.stdout:4/690: write d0/d2c/d35/d74/f88 [139281,31441] 0 2024-09-13T22:08:44.534 INFO:tasks.workunit.client.0.smithi089.stdout:4/691: chown d0/d2c 625830 1 2024-09-13T22:08:44.534 INFO:tasks.workunit.client.0.smithi089.stdout:4/692: dread - d0/d2c/d35/d5d/da4/fb3 zero size 2024-09-13T22:08:44.534 INFO:tasks.workunit.client.0.smithi089.stdout:4/693: chown d0/d2c/d35/d74/f9b 3747 1 2024-09-13T22:08:44.534 INFO:tasks.workunit.client.0.smithi089.stdout:7/593: dread d0/d19/d28/d1d/f64 [0,4194304] 0 2024-09-13T22:08:44.534 INFO:tasks.workunit.client.0.smithi089.stdout:7/594: write d0/d19/d45/d9b/fa6 [1192050,52905] 0 2024-09-13T22:08:44.536 INFO:tasks.workunit.client.0.smithi089.stdout:4/694: dread d0/d2c/d52/da5/f61 [0,4194304] 0 2024-09-13T22:08:44.539 INFO:tasks.workunit.client.0.smithi089.stdout:4/695: creat d0/d2c/d35/d64/fd7 x:0 0 0 2024-09-13T22:08:44.541 INFO:tasks.workunit.client.0.smithi089.stdout:7/595: dread d0/d19/d28/d1d/d23/d24/f42 [0,4194304] 0 2024-09-13T22:08:44.541 INFO:tasks.workunit.client.0.smithi089.stdout:4/696: rename d0/ld3 to d0/d2c/d35/d64/ld8 0 2024-09-13T22:08:44.543 INFO:tasks.workunit.client.0.smithi089.stdout:7/596: truncate d0/f8c 838980 0 2024-09-13T22:08:44.545 INFO:tasks.workunit.client.0.smithi089.stdout:7/597: symlink d0/d19/d45/d9b/lc8 0 2024-09-13T22:08:44.546 INFO:tasks.workunit.client.0.smithi089.stdout:6/565: write d0/d5/f27 [3608916,73819] 0 2024-09-13T22:08:44.546 INFO:tasks.workunit.client.0.smithi089.stdout:6/566: stat d0/d4/d12/f20 0 2024-09-13T22:08:44.547 INFO:tasks.workunit.client.0.smithi089.stdout:7/598: symlink d0/d19/d45/d38/lc9 0 2024-09-13T22:08:44.548 INFO:tasks.workunit.client.0.smithi089.stdout:9/673: dwrite d6/d18/d21/f44 [0,4194304] 0 2024-09-13T22:08:44.548 INFO:tasks.workunit.client.0.smithi089.stdout:9/674: fdatasync d6/d18/d1b/d3e/dbd/fdb 0 2024-09-13T22:08:44.549 INFO:tasks.workunit.client.0.smithi089.stdout:7/599: unlink d0/d19/d28/d1d/d3d/d9a/la5 0 2024-09-13T22:08:44.550 INFO:tasks.workunit.client.0.smithi089.stdout:8/628: dwrite d0/dd/db0/d20/d36/d80/f97 [0,4194304] 0 2024-09-13T22:08:44.552 INFO:tasks.workunit.client.0.smithi089.stdout:4/697: write d0/d2c/da1/fd1 [344896,91612] 0 2024-09-13T22:08:44.552 INFO:tasks.workunit.client.0.smithi089.stdout:4/698: fdatasync d0/d2c/f5f 0 2024-09-13T22:08:44.552 INFO:tasks.workunit.client.0.smithi089.stdout:5/553: dwrite d4/d19/d1e/d28/d31/d35/d46/f6e [0,4194304] 0 2024-09-13T22:08:44.552 INFO:tasks.workunit.client.0.smithi089.stdout:5/554: chown d4/d19/d1e/d28/d31/d61/l7f 42 1 2024-09-13T22:08:44.554 INFO:tasks.workunit.client.0.smithi089.stdout:7/600: mknod d0/d19/d28/d1d/d3d/d9a/cca 0 2024-09-13T22:08:44.554 INFO:tasks.workunit.client.0.smithi089.stdout:7/601: chown d0/d19/d45/d9b/fa6 6 1 2024-09-13T22:08:44.554 INFO:tasks.workunit.client.0.smithi089.stdout:7/602: readlink d0/l10 0 2024-09-13T22:08:44.560 INFO:tasks.workunit.client.0.smithi089.stdout:8/629: creat d0/dd/db0/d20/d36/dd1/fd7 x:0 0 0 2024-09-13T22:08:44.560 INFO:tasks.workunit.client.0.smithi089.stdout:8/630: dread - d0/fbe zero size 2024-09-13T22:08:44.565 INFO:tasks.workunit.client.0.smithi089.stdout:9/675: dread d6/d18/d1b/d89/db8/d52/f4e [0,4194304] 0 2024-09-13T22:08:44.567 INFO:tasks.workunit.client.0.smithi089.stdout:5/555: creat d4/fc5 x:0 0 0 2024-09-13T22:08:44.569 INFO:tasks.workunit.client.0.smithi089.stdout:6/567: dwrite d0/d5/f23 [0,4194304] 0 2024-09-13T22:08:44.570 INFO:tasks.workunit.client.0.smithi089.stdout:7/603: mknod d0/d19/d28/d1d/d30/d5b/ccb 0 2024-09-13T22:08:44.570 INFO:tasks.workunit.client.0.smithi089.stdout:7/604: write d0/d19/f2b [1101083,5858] 0 2024-09-13T22:08:44.570 INFO:tasks.workunit.client.0.smithi089.stdout:7/605: chown d0/l16 152 1 2024-09-13T22:08:44.570 INFO:tasks.workunit.client.0.smithi089.stdout:7/606: fsync d0/d19/d28/d1d/d2d/d3c/fc4 0 2024-09-13T22:08:44.571 INFO:tasks.workunit.client.0.smithi089.stdout:7/607: fsync d0/d19/d28/d1d/d2d/fb5 0 2024-09-13T22:08:44.571 INFO:tasks.workunit.client.0.smithi089.stdout:8/631: symlink d0/dd/db0/d20/d36/d80/ld8 0 2024-09-13T22:08:44.573 INFO:tasks.workunit.client.0.smithi089.stdout:7/608: truncate d0/f8c 569931 0 2024-09-13T22:08:44.574 INFO:tasks.workunit.client.0.smithi089.stdout:4/699: dwrite d0/d2c/d35/d5d/fac [0,4194304] 0 2024-09-13T22:08:44.575 INFO:tasks.workunit.client.0.smithi089.stdout:8/632: rename d0/dd/db0/d20/d36/l38 to d0/dd/db0/d20/d40/d4a/ld9 0 2024-09-13T22:08:44.575 INFO:tasks.workunit.client.0.smithi089.stdout:8/633: fdatasync d0/dd/db0/d20/d40/d4a/f9e 0 2024-09-13T22:08:44.575 INFO:tasks.workunit.client.0.smithi089.stdout:8/634: readlink d0/dd/db0/d3a/l48 0 2024-09-13T22:08:44.575 INFO:tasks.workunit.client.0.smithi089.stdout:8/635: read d0/d6a/f8a [4224223,103511] 0 2024-09-13T22:08:44.576 INFO:tasks.workunit.client.0.smithi089.stdout:6/568: dread d0/d5/d1d/d56/d28/fa1 [0,4194304] 0 2024-09-13T22:08:44.576 INFO:tasks.workunit.client.0.smithi089.stdout:0/807: sync 2024-09-13T22:08:44.577 INFO:tasks.workunit.client.0.smithi089.stdout:0/808: read - d1/de/d10/d85/ffb zero size 2024-09-13T22:08:44.579 INFO:tasks.workunit.client.0.smithi089.stdout:8/636: mknod d0/dd/db0/d20/d36/d59/d89/cda 0 2024-09-13T22:08:44.579 INFO:tasks.workunit.client.0.smithi089.stdout:6/569: getdents d0/d5/d1d/d2d/d55 0 2024-09-13T22:08:44.579 INFO:tasks.workunit.client.0.smithi089.stdout:6/570: fsync d0/d5/d1d/f82 0 2024-09-13T22:08:44.581 INFO:tasks.workunit.client.0.smithi089.stdout:8/637: truncate d0/dd/db0/d20/d40/f71 2140357 0 2024-09-13T22:08:44.585 INFO:tasks.workunit.client.0.smithi089.stdout:8/638: unlink d0/d6a/d73/l76 0 2024-09-13T22:08:44.587 INFO:tasks.workunit.client.0.smithi089.stdout:5/556: dwrite d4/d19/d1e/d28/f98 [0,4194304] 0 2024-09-13T22:08:44.589 INFO:tasks.workunit.client.0.smithi089.stdout:5/557: fsync d4/d19/d1e/d89/d8a/f64 0 2024-09-13T22:08:44.589 INFO:tasks.workunit.client.0.smithi089.stdout:7/609: write d0/d19/d28/d1d/d23/d24/d5d/f5e [3678431,19165] 0 2024-09-13T22:08:44.589 INFO:tasks.workunit.client.0.smithi089.stdout:7/610: read d0/d19/d28/d1d/d23/f35 [632457,42648] 0 2024-09-13T22:08:44.592 INFO:tasks.workunit.client.0.smithi089.stdout:7/611: rename d0/d19/d28/d1d/d2d/d3c/f37 to d0/d19/d28/d1d/d3d/d69/fcc 0 2024-09-13T22:08:44.603 INFO:tasks.workunit.client.0.smithi089.stdout:5/558: write d4/d19/d1e/d28/d3d/f5d [1361566,22342] 0 2024-09-13T22:08:44.603 INFO:tasks.workunit.client.0.smithi089.stdout:5/559: dread - d4/d19/d1e/d28/d31/fb4 zero size 2024-09-13T22:08:44.603 INFO:tasks.workunit.client.0.smithi089.stdout:7/612: read d0/ff [1193045,57107] 0 2024-09-13T22:08:44.603 INFO:tasks.workunit.client.0.smithi089.stdout:5/560: rmdir d4/d19/d1e/d28/d31/d55/d58/d84 39 2024-09-13T22:08:44.604 INFO:tasks.workunit.client.0.smithi089.stdout:7/613: symlink d0/d19/d45/d92/lcd 0 2024-09-13T22:08:44.604 INFO:tasks.workunit.client.0.smithi089.stdout:5/561: dread - d4/d19/d1e/d89/d8a/f66 zero size 2024-09-13T22:08:44.608 INFO:tasks.workunit.client.0.smithi089.stdout:9/676: dwrite d6/d18/d1b/f26 [0,4194304] 0 2024-09-13T22:08:44.608 INFO:tasks.workunit.client.0.smithi089.stdout:4/700: dwrite d0/d15/fa6 [0,4194304] 0 2024-09-13T22:08:44.609 INFO:tasks.workunit.client.0.smithi089.stdout:8/639: dwrite d0/dd/db0/d20/d36/d80/d3b/da5/fd2 [0,4194304] 0 2024-09-13T22:08:44.609 INFO:tasks.workunit.client.0.smithi089.stdout:7/614: dread d0/d19/d45/f95 [0,4194304] 0 2024-09-13T22:08:44.609 INFO:tasks.workunit.client.0.smithi089.stdout:8/640: fdatasync d0/dd/f46 0 2024-09-13T22:08:44.609 INFO:tasks.workunit.client.0.smithi089.stdout:4/701: dread d0/d15/fbc [0,4194304] 0 2024-09-13T22:08:44.610 INFO:tasks.workunit.client.0.smithi089.stdout:0/809: dwrite d1/de/fe2 [0,4194304] 0 2024-09-13T22:08:44.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/641: mknod d0/dd/db0/d20/d1c/cdb 0 2024-09-13T22:08:44.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/642: rename d0 to d0/dd/db0/d20/d36/d80/d70/ddc 22 2024-09-13T22:08:44.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/643: getdents d0/dd/db0/d20/d79 0 2024-09-13T22:08:44.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/644: write d0/dd/db0/d20/d36/dd1/fd7 [368424,5410] 0 2024-09-13T22:08:44.616 INFO:tasks.workunit.client.0.smithi089.stdout:0/810: creat d1/de/d15/d41/d49/d76/f11b x:0 0 0 2024-09-13T22:08:44.617 INFO:tasks.workunit.client.0.smithi089.stdout:8/645: creat d0/dd/db0/d3a/fdd x:0 0 0 2024-09-13T22:08:44.617 INFO:tasks.workunit.client.0.smithi089.stdout:8/646: fdatasync d0/dd/f35 0 2024-09-13T22:08:44.618 INFO:tasks.workunit.client.0.smithi089.stdout:9/677: write d6/faa [4633338,17433] 0 2024-09-13T22:08:44.618 INFO:tasks.workunit.client.0.smithi089.stdout:4/702: rmdir d0/d11/d16/d89 39 2024-09-13T22:08:44.618 INFO:tasks.workunit.client.0.smithi089.stdout:1/662: sync 2024-09-13T22:08:44.618 INFO:tasks.workunit.client.0.smithi089.stdout:2/602: sync 2024-09-13T22:08:44.619 INFO:tasks.workunit.client.0.smithi089.stdout:0/811: mkdir d1/de/d15/d2a/d11c 0 2024-09-13T22:08:44.620 INFO:tasks.workunit.client.0.smithi089.stdout:5/562: dwrite d4/d19/d1e/d28/f49 [0,4194304] 0 2024-09-13T22:08:44.620 INFO:tasks.workunit.client.0.smithi089.stdout:8/647: mkdir d0/d6a/db9/dde 0 2024-09-13T22:08:44.621 INFO:tasks.workunit.client.0.smithi089.stdout:4/703: mknod d0/d11/cd9 0 2024-09-13T22:08:44.623 INFO:tasks.workunit.client.0.smithi089.stdout:1/663: creat d7/d40/dbe/d2b/d59/d9e/fe4 x:0 0 0 2024-09-13T22:08:44.623 INFO:tasks.workunit.client.0.smithi089.stdout:9/678: dread d6/f10 [0,4194304] 0 2024-09-13T22:08:44.624 INFO:tasks.workunit.client.0.smithi089.stdout:0/812: mkdir d1/de/d15/d41/d49/d76/d11d 0 2024-09-13T22:08:44.624 INFO:tasks.workunit.client.0.smithi089.stdout:0/813: stat d1/de/f3e 0 2024-09-13T22:08:44.625 INFO:tasks.workunit.client.0.smithi089.stdout:3/615: sync 2024-09-13T22:08:44.626 INFO:tasks.workunit.client.0.smithi089.stdout:5/563: truncate d4/d19/f56 410208 0 2024-09-13T22:08:44.627 INFO:tasks.workunit.client.0.smithi089.stdout:9/679: mkdir d6/d18/d21/de6 0 2024-09-13T22:08:44.627 INFO:tasks.workunit.client.0.smithi089.stdout:8/648: dread d0/dd/db0/d20/f17 [0,4194304] 0 2024-09-13T22:08:44.630 INFO:tasks.workunit.client.0.smithi089.stdout:3/616: link d1/d2/d4/d1c/d7f/f86 d1/d2/d4/d1c/d7e/fc9 0 2024-09-13T22:08:44.633 INFO:tasks.workunit.client.0.smithi089.stdout:2/603: write df/d14/d2b/f63 [2160769,34715] 0 2024-09-13T22:08:44.633 INFO:tasks.workunit.client.0.smithi089.stdout:8/649: unlink d0/dd/lb8 0 2024-09-13T22:08:44.635 INFO:tasks.workunit.client.0.smithi089.stdout:2/604: creat df/d5b/da5/db8/fc7 x:0 0 0 2024-09-13T22:08:44.637 INFO:tasks.workunit.client.0.smithi089.stdout:8/650: unlink d0/d6a/f8a 0 2024-09-13T22:08:44.637 INFO:tasks.workunit.client.0.smithi089.stdout:3/617: mkdir d1/d2/dca 0 2024-09-13T22:08:44.639 INFO:tasks.workunit.client.0.smithi089.stdout:9/680: dread d6/d18/d1b/da0/fd8 [0,4194304] 0 2024-09-13T22:08:44.641 INFO:tasks.workunit.client.0.smithi089.stdout:2/605: link df/d14/d2b/c58 df/d14/d48/d88/cc8 0 2024-09-13T22:08:44.643 INFO:tasks.workunit.client.0.smithi089.stdout:8/651: symlink d0/d6a/d6f/ldf 0 2024-09-13T22:08:44.644 INFO:tasks.workunit.client.0.smithi089.stdout:3/618: link d1/d7/d1b/f59 d1/d3a/fcb 0 2024-09-13T22:08:44.645 INFO:tasks.workunit.client.0.smithi089.stdout:2/606: mknod df/d5b/da5/db8/dbf/cc9 0 2024-09-13T22:08:44.645 INFO:tasks.workunit.client.0.smithi089.stdout:2/607: chown df/d5b/da5/fb7 444680 1 2024-09-13T22:08:44.646 INFO:tasks.workunit.client.0.smithi089.stdout:8/652: creat d0/dd/db0/d20/d36/d59/d89/fe0 x:0 0 0 2024-09-13T22:08:44.646 INFO:tasks.workunit.client.0.smithi089.stdout:8/653: read d0/dd/db0/d20/f17 [655981,117240] 0 2024-09-13T22:08:44.647 INFO:tasks.workunit.client.0.smithi089.stdout:2/608: truncate df/d14/d66/d69/d2e/f37 3227384 0 2024-09-13T22:08:44.647 INFO:tasks.workunit.client.0.smithi089.stdout:2/609: mkdir df/d14/d66/d69/d2e/dca 0 2024-09-13T22:08:44.649 INFO:tasks.workunit.client.0.smithi089.stdout:2/610: creat df/d14/fcb x:0 0 0 2024-09-13T22:08:44.650 INFO:tasks.workunit.client.0.smithi089.stdout:8/654: dread d0/dd/db0/d20/d36/dd1/fd7 [0,4194304] 0 2024-09-13T22:08:44.650 INFO:tasks.workunit.client.0.smithi089.stdout:8/655: readlink d0/dd/db0/d20/d36/d68/lbd 0 2024-09-13T22:08:44.650 INFO:tasks.workunit.client.0.smithi089.stdout:2/611: creat df/fcc x:0 0 0 2024-09-13T22:08:44.650 INFO:tasks.workunit.client.0.smithi089.stdout:2/612: write df/d76/d85/fb0 [434149,10833] 0 2024-09-13T22:08:44.651 INFO:tasks.workunit.client.0.smithi089.stdout:8/656: rename d0/dd/db0/c3d to d0/dd/db0/d20/d36/d59/d89/ce1 0 2024-09-13T22:08:44.651 INFO:tasks.workunit.client.0.smithi089.stdout:8/657: write d0/dd/db0/d20/d36/d80/d3b/d88/f96 [724405,10109] 0 2024-09-13T22:08:44.651 INFO:tasks.workunit.client.0.smithi089.stdout:1/664: dwrite d7/d34/f7e [0,4194304] 0 2024-09-13T22:08:44.652 INFO:tasks.workunit.client.0.smithi089.stdout:2/613: unlink df/d5b/l7d 0 2024-09-13T22:08:44.653 INFO:tasks.workunit.client.0.smithi089.stdout:2/614: creat df/d1a/d57/fcd x:0 0 0 2024-09-13T22:08:44.657 INFO:tasks.workunit.client.0.smithi089.stdout:2/615: rmdir df/dc3 0 2024-09-13T22:08:44.669 INFO:tasks.workunit.client.0.smithi089.stdout:0/814: dwrite d1/de/d10/d36/d38/d4e/fe9 [0,4194304] 0 2024-09-13T22:08:44.669 INFO:tasks.workunit.client.0.smithi089.stdout:0/815: stat d1/de/d15/d41/d87 0 2024-09-13T22:08:44.669 INFO:tasks.workunit.client.0.smithi089.stdout:0/816: write d1/f1e [2468479,99104] 0 2024-09-13T22:08:44.669 INFO:tasks.workunit.client.0.smithi089.stdout:0/817: read - d1/de/d10/d36/d38/d4e/fc4 zero size 2024-09-13T22:08:44.670 INFO:tasks.workunit.client.0.smithi089.stdout:0/818: mknod d1/de/d15/c11e 0 2024-09-13T22:08:44.677 INFO:tasks.workunit.client.0.smithi089.stdout:5/564: dwrite d4/f8 [0,4194304] 0 2024-09-13T22:08:44.682 INFO:tasks.workunit.client.0.smithi089.stdout:0/819: write d1/de/d15/d41/d49/d76/d8b/fdb [2892816,59431] 0 2024-09-13T22:08:44.684 INFO:tasks.workunit.client.0.smithi089.stdout:9/681: dwrite d6/d18/dab/fc5 [0,4194304] 0 2024-09-13T22:08:44.684 INFO:tasks.workunit.client.0.smithi089.stdout:0/820: getdents d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4 0 2024-09-13T22:08:44.684 INFO:tasks.workunit.client.0.smithi089.stdout:3/619: dwrite d1/d2/d23/f98 [0,4194304] 0 2024-09-13T22:08:44.684 INFO:tasks.workunit.client.0.smithi089.stdout:3/620: dread - d1/d7/fb2 zero size 2024-09-13T22:08:44.685 INFO:tasks.workunit.client.0.smithi089.stdout:1/665: dwrite d7/de/d68/f6f [0,4194304] 0 2024-09-13T22:08:44.685 INFO:tasks.workunit.client.0.smithi089.stdout:2/616: dwrite df/d14/fcb [0,4194304] 0 2024-09-13T22:08:44.687 INFO:tasks.workunit.client.0.smithi089.stdout:9/682: symlink d6/d18/d21/d5d/d6c/d8d/le7 0 2024-09-13T22:08:44.687 INFO:tasks.workunit.client.0.smithi089.stdout:9/683: fdatasync d6/d18/fbb 0 2024-09-13T22:08:44.691 INFO:tasks.workunit.client.0.smithi089.stdout:3/621: symlink d1/d2/d23/d3d/d46/lcc 0 2024-09-13T22:08:44.691 INFO:tasks.workunit.client.0.smithi089.stdout:3/622: creat d1/d7/fcd x:0 0 0 2024-09-13T22:08:44.693 INFO:tasks.workunit.client.0.smithi089.stdout:1/666: symlink d7/d34/d5c/d5d/le5 0 2024-09-13T22:08:44.693 INFO:tasks.workunit.client.0.smithi089.stdout:1/667: fdatasync d7/d34/d5c/d5d/f62 0 2024-09-13T22:08:44.695 INFO:tasks.workunit.client.0.smithi089.stdout:9/684: symlink d6/d54/le8 0 2024-09-13T22:08:44.697 INFO:tasks.workunit.client.0.smithi089.stdout:0/821: read d1/f9e [3539193,50422] 0 2024-09-13T22:08:44.698 INFO:tasks.workunit.client.0.smithi089.stdout:3/623: link d1/d2/f82 d1/d7/d5c/fce 0 2024-09-13T22:08:44.699 INFO:tasks.workunit.client.0.smithi089.stdout:9/685: symlink d6/d55/le9 0 2024-09-13T22:08:44.699 INFO:tasks.workunit.client.0.smithi089.stdout:9/686: fsync d6/d18/d21/f4a 0 2024-09-13T22:08:44.699 INFO:tasks.workunit.client.0.smithi089.stdout:9/687: chown d6/d31/d5e/db1 54052 1 2024-09-13T22:08:44.699 INFO:tasks.workunit.client.0.smithi089.stdout:9/688: write d6/f10 [582859,90953] 0 2024-09-13T22:08:44.699 INFO:tasks.workunit.client.0.smithi089.stdout:9/689: symlink d6/d31/d5e/lea 0 2024-09-13T22:08:44.702 INFO:tasks.workunit.client.0.smithi089.stdout:9/690: creat d6/feb x:0 0 0 2024-09-13T22:08:44.702 INFO:tasks.workunit.client.0.smithi089.stdout:9/691: write d6/d18/d1b/d3e/dbd/fdb [4230,46446] 0 2024-09-13T22:08:44.702 INFO:tasks.workunit.client.0.smithi089.stdout:9/692: fsync d6/d18/d1b/d89/db8/d52/f97 0 2024-09-13T22:08:44.702 INFO:tasks.workunit.client.0.smithi089.stdout:9/693: stat d6/d18/d1b/d3e/f46 0 2024-09-13T22:08:44.704 INFO:tasks.workunit.client.0.smithi089.stdout:9/694: unlink d6/d18/d21/d5d/d6c/d8d/ce2 0 2024-09-13T22:08:44.708 INFO:tasks.workunit.client.0.smithi089.stdout:9/695: creat d6/d18/d1b/d89/db8/fec x:0 0 0 2024-09-13T22:08:44.708 INFO:tasks.workunit.client.0.smithi089.stdout:9/696: write d6/d18/d1b/d89/fba [314555,108556] 0 2024-09-13T22:08:44.708 INFO:tasks.workunit.client.0.smithi089.stdout:9/697: fsync d6/d31/d5e/f7d 0 2024-09-13T22:08:44.709 INFO:tasks.workunit.client.0.smithi089.stdout:9/698: write d6/d18/f32 [4757883,41283] 0 2024-09-13T22:08:44.709 INFO:tasks.workunit.client.0.smithi089.stdout:9/699: read d6/d18/d21/f4a [1161097,66095] 0 2024-09-13T22:08:44.709 INFO:tasks.workunit.client.0.smithi089.stdout:9/700: rmdir d6/d31/d64 39 2024-09-13T22:08:44.709 INFO:tasks.workunit.client.0.smithi089.stdout:9/701: creat d6/d18/d21/d5d/d6c/d8d/fed x:0 0 0 2024-09-13T22:08:44.710 INFO:tasks.workunit.client.0.smithi089.stdout:9/702: symlink d6/d55/lee 0 2024-09-13T22:08:44.712 INFO:tasks.workunit.client.0.smithi089.stdout:9/703: unlink d6/d18/d1b/d89/db8/f42 0 2024-09-13T22:08:44.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/704: write d6/d18/d21/d5d/d6c/fd1 [292271,85299] 0 2024-09-13T22:08:44.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/705: chown d6/d18/d1b/d89 196577524 1 2024-09-13T22:08:44.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/706: stat d6/l9f 0 2024-09-13T22:08:44.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/707: write d6/d18/d21/d5d/d6c/d8d/fdf [132448,77135] 0 2024-09-13T22:08:44.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/708: symlink d6/d31/d5e/db1/lef 0 2024-09-13T22:08:44.716 INFO:tasks.workunit.client.0.smithi089.stdout:0/822: dread d1/de/d10/d36/d38/d4e/fe9 [0,4194304] 0 2024-09-13T22:08:44.722 INFO:tasks.workunit.client.0.smithi089.stdout:5/565: dwrite d4/d19/d1e/d28/fb8 [0,4194304] 0 2024-09-13T22:08:44.722 INFO:tasks.workunit.client.0.smithi089.stdout:5/566: write d4/d19/d1e/d28/d31/d55/da4/fb6 [1926225,15253] 0 2024-09-13T22:08:44.724 INFO:tasks.workunit.client.0.smithi089.stdout:9/709: dread d6/faa [4194304,4194304] 0 2024-09-13T22:08:44.724 INFO:tasks.workunit.client.0.smithi089.stdout:8/658: dwrite d0/dd/db0/d20/d36/d80/d3b/d88/f96 [0,4194304] 0 2024-09-13T22:08:44.725 INFO:tasks.workunit.client.0.smithi089.stdout:8/659: creat d0/dd/db0/d20/d36/d59/d89/fe2 x:0 0 0 2024-09-13T22:08:44.727 INFO:tasks.workunit.client.0.smithi089.stdout:2/617: dwrite df/d14/f65 [4194304,4194304] 0 2024-09-13T22:08:44.736 INFO:tasks.workunit.client.0.smithi089.stdout:0/823: dwrite d1/de/d10/db0/f102 [0,4194304] 0 2024-09-13T22:08:44.737 INFO:tasks.workunit.client.0.smithi089.stdout:3/624: dwrite d1/d2/d4/d1c/d7e/f7a [0,4194304] 0 2024-09-13T22:08:44.741 INFO:tasks.workunit.client.0.smithi089.stdout:9/710: truncate d6/d18/f47 3823025 0 2024-09-13T22:08:44.741 INFO:tasks.workunit.client.0.smithi089.stdout:9/711: write d6/f10 [756957,77438] 0 2024-09-13T22:08:44.746 INFO:tasks.workunit.client.0.smithi089.stdout:5/567: rename d4/l85 to d4/d19/d1e/d28/lc6 0 2024-09-13T22:08:44.746 INFO:tasks.workunit.client.0.smithi089.stdout:0/824: rename d1/de/d10/db0/dd9 to d1/de/d10/db0/dd9/d10f/d11f 22 2024-09-13T22:08:44.750 INFO:tasks.workunit.client.0.smithi089.stdout:3/625: creat d1/d7/d1b/d28/fcf x:0 0 0 2024-09-13T22:08:44.750 INFO:tasks.workunit.client.0.smithi089.stdout:3/626: creat d1/d7/d1b/d28/fd0 x:0 0 0 2024-09-13T22:08:44.750 INFO:tasks.workunit.client.0.smithi089.stdout:3/627: chown d1/d2/d4/d1c/d7e/d40/l5f 208624 1 2024-09-13T22:08:44.750 INFO:tasks.workunit.client.0.smithi089.stdout:2/618: dwrite df/d14/d66/d69/d2e/f37 [0,4194304] 0 2024-09-13T22:08:44.752 INFO:tasks.workunit.client.0.smithi089.stdout:9/712: unlink d6/d18/d21/d5d/d6c/ca1 0 2024-09-13T22:08:44.753 INFO:tasks.workunit.client.0.smithi089.stdout:0/825: rename d1/de/d10/d36/d57/d3a/db7/ff3 to d1/de/d15/f120 0 2024-09-13T22:08:44.755 INFO:tasks.workunit.client.0.smithi089.stdout:0/826: stat d1/de/d10/d36/d38/d4e/d62/d5f/cab 0 2024-09-13T22:08:44.757 INFO:tasks.workunit.client.0.smithi089.stdout:0/827: getdents d1/de/d15/d41/d49/db5 0 2024-09-13T22:08:44.760 INFO:tasks.workunit.client.0.smithi089.stdout:0/828: rmdir d1/de/d10/db0 39 2024-09-13T22:08:44.764 INFO:tasks.workunit.client.0.smithi089.stdout:0/829: creat d1/de/d1f/ddd/f121 x:0 0 0 2024-09-13T22:08:44.764 INFO:tasks.workunit.client.0.smithi089.stdout:8/660: dwrite d0/dd/db0/d20/d36/d80/d70/f7e [4194304,4194304] 0 2024-09-13T22:08:44.769 INFO:tasks.workunit.client.0.smithi089.stdout:5/568: dwrite d4/d19/d1e/d28/d31/f97 [0,4194304] 0 2024-09-13T22:08:44.769 INFO:tasks.workunit.client.0.smithi089.stdout:0/830: symlink d1/de/d10/l122 0 2024-09-13T22:08:44.769 INFO:tasks.workunit.client.0.smithi089.stdout:8/661: symlink d0/dd/db0/d20/d36/d59/d89/dca/le3 0 2024-09-13T22:08:44.770 INFO:tasks.workunit.client.0.smithi089.stdout:8/662: write d0/dd/f35 [1370554,15642] 0 2024-09-13T22:08:44.771 INFO:tasks.workunit.client.0.smithi089.stdout:5/569: readlink d4/d19/d1e/d89/d8a/l91 0 2024-09-13T22:08:44.771 INFO:tasks.workunit.client.0.smithi089.stdout:5/570: truncate d4/d19/d1e/fbf 560494 0 2024-09-13T22:08:44.771 INFO:tasks.workunit.client.0.smithi089.stdout:5/571: write d4/fc5 [791601,108565] 0 2024-09-13T22:08:44.772 INFO:tasks.workunit.client.0.smithi089.stdout:0/831: mkdir d1/de/d10/d36/d38/d123 0 2024-09-13T22:08:44.773 INFO:tasks.workunit.client.0.smithi089.stdout:5/572: rename d4/d19/d1e/c71 to d4/d19/d1e/d28/d31/d55/da4/cc7 0 2024-09-13T22:08:44.774 INFO:tasks.workunit.client.0.smithi089.stdout:5/573: creat d4/d19/d1e/d53/d88/fc8 x:0 0 0 2024-09-13T22:08:44.775 INFO:tasks.workunit.client.0.smithi089.stdout:0/832: mkdir d1/de/d1f/d124 0 2024-09-13T22:08:44.776 INFO:tasks.workunit.client.0.smithi089.stdout:5/574: rename d4/d19/d1e/d89/d8a to d4/d19/d1e/d28/d3d/dc9 0 2024-09-13T22:08:44.777 INFO:tasks.workunit.client.0.smithi089.stdout:0/833: mkdir d1/de/d15/d41/d87/d125 0 2024-09-13T22:08:44.777 INFO:tasks.workunit.client.0.smithi089.stdout:0/834: chown d1/de/d15/d41/d49/d76/d8b/fa3 784876 1 2024-09-13T22:08:44.777 INFO:tasks.workunit.client.0.smithi089.stdout:5/575: chown d4/f9 335777 1 2024-09-13T22:08:44.779 INFO:tasks.workunit.client.0.smithi089.stdout:0/835: rename d1/de/d15/d41/fff to d1/de/d15/d41/d87/d125/f126 0 2024-09-13T22:08:44.779 INFO:tasks.workunit.client.0.smithi089.stdout:0/836: chown d1/de/d15/d41/d87/dbf 14872139 1 2024-09-13T22:08:44.781 INFO:tasks.workunit.client.0.smithi089.stdout:5/576: mknod d4/d19/d1e/d28/d31/d55/da4/cca 0 2024-09-13T22:08:44.781 INFO:tasks.workunit.client.0.smithi089.stdout:5/577: chown d4/fc5 111 1 2024-09-13T22:08:44.781 INFO:tasks.workunit.client.0.smithi089.stdout:0/837: symlink d1/de/d10/d36/d38/d4e/d62/l127 0 2024-09-13T22:08:44.782 INFO:tasks.workunit.client.0.smithi089.stdout:3/628: dwrite d1/d2/d23/d3d/d46/f8b [0,4194304] 0 2024-09-13T22:08:44.782 INFO:tasks.workunit.client.0.smithi089.stdout:3/629: chown d1/d7/l56 30980623 1 2024-09-13T22:08:44.783 INFO:tasks.workunit.client.0.smithi089.stdout:8/663: read d0/f5 [3107807,10594] 0 2024-09-13T22:08:44.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/578: chown d4/d19/d1e/d28/d3d/dc9/fa7 24087 1 2024-09-13T22:08:44.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/579: creat d4/d19/d1e/d28/fcb x:0 0 0 2024-09-13T22:08:44.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/580: chown d4/d19/d1e/d28/d3d/f5d 2 1 2024-09-13T22:08:44.784 INFO:tasks.workunit.client.0.smithi089.stdout:2/619: dwrite df/d1a/d57/f8f [0,4194304] 0 2024-09-13T22:08:44.787 INFO:tasks.workunit.client.0.smithi089.stdout:0/838: mkdir d1/de/d10/d36/d38/d4e/d62/d128 0 2024-09-13T22:08:44.788 INFO:tasks.workunit.client.0.smithi089.stdout:9/713: dread d6/d18/f32 [0,4194304] 0 2024-09-13T22:08:44.788 INFO:tasks.workunit.client.0.smithi089.stdout:3/630: link d1/d7/d1b/l58 d1/d7/d1b/d28/ld1 0 2024-09-13T22:08:44.789 INFO:tasks.workunit.client.0.smithi089.stdout:3/631: chown d1 607658701 1 2024-09-13T22:08:44.790 INFO:tasks.workunit.client.0.smithi089.stdout:8/664: mkdir d0/dd/db0/d20/d36/d80/d3b/de4 0 2024-09-13T22:08:44.790 INFO:tasks.workunit.client.0.smithi089.stdout:8/665: chown d0/dd/db0/d20/d36/d80/fc1 4561631 1 2024-09-13T22:08:44.803 INFO:tasks.workunit.client.0.smithi089.stdout:5/581: rename d4/d19/d1e/d28/d31/d35 to d4/d19/d1e/d28/d31/d55/dcc 0 2024-09-13T22:08:44.805 INFO:tasks.workunit.client.0.smithi089.stdout:0/839: mkdir d1/de/d10/d36/d57/d129 0 2024-09-13T22:08:44.805 INFO:tasks.workunit.client.0.smithi089.stdout:0/840: creat d1/de/d10/d36/d38/d4e/d62/d5f/db6/f12a x:0 0 0 2024-09-13T22:08:44.806 INFO:tasks.workunit.client.0.smithi089.stdout:0/841: write d1/de/d10/d36/d39/f94 [328558,94256] 0 2024-09-13T22:08:44.807 INFO:tasks.workunit.client.0.smithi089.stdout:9/714: mknod d6/d18/d1b/d89/db8/dbe/cf0 0 2024-09-13T22:08:44.808 INFO:tasks.workunit.client.0.smithi089.stdout:3/632: mkdir d1/d2/d23/d3d/dd2 0 2024-09-13T22:08:44.809 INFO:tasks.workunit.client.0.smithi089.stdout:8/666: mknod d0/dd/db0/d20/d36/d59/d5d/ce5 0 2024-09-13T22:08:44.811 INFO:tasks.workunit.client.0.smithi089.stdout:5/582: creat d4/d19/d1e/d53/dae/fcd x:0 0 0 2024-09-13T22:08:44.813 INFO:tasks.workunit.client.0.smithi089.stdout:0/842: mknod d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4/d115/c12b 0 2024-09-13T22:08:44.814 INFO:tasks.workunit.client.0.smithi089.stdout:9/715: creat d6/d18/d1b/d89/db8/dbe/ff1 x:0 0 0 2024-09-13T22:08:44.815 INFO:tasks.workunit.client.0.smithi089.stdout:9/716: truncate d6/d18/d21/f44 4593030 0 2024-09-13T22:08:44.815 INFO:tasks.workunit.client.0.smithi089.stdout:6/571: sync 2024-09-13T22:08:44.816 INFO:tasks.workunit.client.0.smithi089.stdout:9/717: read d6/d18/d1b/d89/db8/d5a/fa8 [184066,10779] 0 2024-09-13T22:08:44.816 INFO:tasks.workunit.client.0.smithi089.stdout:3/633: mknod d1/d2/d31/cd3 0 2024-09-13T22:08:44.816 INFO:tasks.workunit.client.0.smithi089.stdout:3/634: write d1/d2/d4/d1c/d7e/fae [782780,113551] 0 2024-09-13T22:08:44.816 INFO:tasks.workunit.client.0.smithi089.stdout:8/667: mkdir d0/dd/db0/d20/d36/d68/de6 0 2024-09-13T22:08:44.816 INFO:tasks.workunit.client.0.smithi089.stdout:8/668: stat d0/dd/db0/d20/d1c/d5a/d63/f66 0 2024-09-13T22:08:44.817 INFO:tasks.workunit.client.0.smithi089.stdout:5/583: rename d4/d19/d1e/d28/d31/d55/dcc/d46 to d4/d19/d1e/d89/dce 0 2024-09-13T22:08:44.820 INFO:tasks.workunit.client.0.smithi089.stdout:9/718: mknod d6/d18/cf2 0 2024-09-13T22:08:44.820 INFO:tasks.workunit.client.0.smithi089.stdout:9/719: creat d6/d18/d21/d5d/d6c/ff3 x:0 0 0 2024-09-13T22:08:44.822 INFO:tasks.workunit.client.0.smithi089.stdout:3/635: creat d1/d2/d23/d3d/d54/fd4 x:0 0 0 2024-09-13T22:08:44.823 INFO:tasks.workunit.client.0.smithi089.stdout:6/572: getdents d0/d5/d1d/d56/d60 0 2024-09-13T22:08:44.823 INFO:tasks.workunit.client.0.smithi089.stdout:6/573: chown d0/d5/d43/d79 0 1 2024-09-13T22:08:44.824 INFO:tasks.workunit.client.0.smithi089.stdout:8/669: dread d0/dd/db0/d42/f39 [0,4194304] 0 2024-09-13T22:08:44.825 INFO:tasks.workunit.client.0.smithi089.stdout:8/670: write d0/dd/db0/d20/d36/f95 [1489716,96688] 0 2024-09-13T22:08:44.825 INFO:tasks.workunit.client.0.smithi089.stdout:8/671: readlink d0/dd/db0/d20/d36/d59/d5d/la3 0 2024-09-13T22:08:44.826 INFO:tasks.workunit.client.0.smithi089.stdout:9/720: mknod d6/d54/dcb/cf4 0 2024-09-13T22:08:44.827 INFO:tasks.workunit.client.0.smithi089.stdout:3/636: truncate d1/d2/d4/d1c/d7e/d40/d50/f8a 4095948 0 2024-09-13T22:08:44.828 INFO:tasks.workunit.client.0.smithi089.stdout:3/637: write d1/d2/d4/d1c/d7e/d40/d69/da1/f81 [740778,10225] 0 2024-09-13T22:08:44.830 INFO:tasks.workunit.client.0.smithi089.stdout:9/721: truncate d6/d54/f9c 100738 0 2024-09-13T22:08:44.830 INFO:tasks.workunit.client.0.smithi089.stdout:0/843: read d1/de/d10/d36/d38/d4e/d62/d5b/f67 [3215086,121687] 0 2024-09-13T22:08:44.831 INFO:tasks.workunit.client.0.smithi089.stdout:0/844: truncate d1/de/fc6 1195495 0 2024-09-13T22:08:44.831 INFO:tasks.workunit.client.0.smithi089.stdout:0/845: chown d1/de/d10/cae 250629 1 2024-09-13T22:08:44.831 INFO:tasks.workunit.client.0.smithi089.stdout:3/638: creat d1/d2/d23/fd5 x:0 0 0 2024-09-13T22:08:44.832 INFO:tasks.workunit.client.0.smithi089.stdout:0/846: getdents d1/de/d10/d36/d38/d4e/d62/d5b/d111 0 2024-09-13T22:08:44.832 INFO:tasks.workunit.client.0.smithi089.stdout:0/847: creat d1/de/d1f/ddd/f12c x:0 0 0 2024-09-13T22:08:44.833 INFO:tasks.workunit.client.0.smithi089.stdout:3/639: dread d1/d7/d1b/d28/d63/f79 [0,4194304] 0 2024-09-13T22:08:44.833 INFO:tasks.workunit.client.0.smithi089.stdout:3/640: truncate d1/d2/d4/d1c/d7e/f91 137642 0 2024-09-13T22:08:44.836 INFO:tasks.workunit.client.0.smithi089.stdout:3/641: mkdir d1/d2/d23/d3d/d46/dd6 0 2024-09-13T22:08:44.836 INFO:tasks.workunit.client.0.smithi089.stdout:3/642: readlink d1/l6c 0 2024-09-13T22:08:44.842 INFO:tasks.workunit.client.0.smithi089.stdout:5/584: dwrite d4/d19/d1e/d28/d31/d55/dcc/fa1 [0,4194304] 0 2024-09-13T22:08:44.846 INFO:tasks.workunit.client.0.smithi089.stdout:5/585: mkdir d4/d19/d1e/d28/d31/d55/da4/dcf 0 2024-09-13T22:08:44.848 INFO:tasks.workunit.client.0.smithi089.stdout:5/586: symlink d4/d19/d1e/d28/d31/d61/d69/ld0 0 2024-09-13T22:08:44.848 INFO:tasks.workunit.client.0.smithi089.stdout:1/668: sync 2024-09-13T22:08:44.848 INFO:tasks.workunit.client.0.smithi089.stdout:4/704: sync 2024-09-13T22:08:44.848 INFO:tasks.workunit.client.0.smithi089.stdout:1/669: chown d7/d40/dbe/d2b/d59/d9e/fe4 1908 1 2024-09-13T22:08:44.849 INFO:tasks.workunit.client.0.smithi089.stdout:4/705: truncate d0/d2c/d35/d5d/f8a 2272014 0 2024-09-13T22:08:44.850 INFO:tasks.workunit.client.0.smithi089.stdout:1/670: link d7/de/d3a/c41 d7/db6/ce6 0 2024-09-13T22:08:44.850 INFO:tasks.workunit.client.0.smithi089.stdout:1/671: fsync d7/d40/dbe/d80/f82 0 2024-09-13T22:08:44.851 INFO:tasks.workunit.client.0.smithi089.stdout:4/706: symlink d0/d2c/lda 0 2024-09-13T22:08:44.852 INFO:tasks.workunit.client.0.smithi089.stdout:1/672: dread d7/d34/fba [0,4194304] 0 2024-09-13T22:08:44.852 INFO:tasks.workunit.client.0.smithi089.stdout:7/615: sync 2024-09-13T22:08:44.852 INFO:tasks.workunit.client.0.smithi089.stdout:7/616: fsync d0/d19/d28/d1d/d23/d2e/d41/dbf/fbe 0 2024-09-13T22:08:44.853 INFO:tasks.workunit.client.0.smithi089.stdout:7/617: fdatasync d0/d19/d45/d38/d54/f60 0 2024-09-13T22:08:44.853 INFO:tasks.workunit.client.0.smithi089.stdout:7/618: read - d0/d19/d28/d1d/d2d/d3c/fb7 zero size 2024-09-13T22:08:44.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/707: mkdir d0/d2c/d52/da5/d9d/ddb 0 2024-09-13T22:08:44.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/708: chown d0/d2c/d35/d5d/lc9 332492 1 2024-09-13T22:08:44.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/709: write d0/d2c/d35/d5d/f69 [4832144,31783] 0 2024-09-13T22:08:44.853 INFO:tasks.workunit.client.0.smithi089.stdout:7/619: read d0/f8c [560412,10094] 0 2024-09-13T22:08:44.855 INFO:tasks.workunit.client.0.smithi089.stdout:1/673: truncate d7/fb 1597352 0 2024-09-13T22:08:44.856 INFO:tasks.workunit.client.0.smithi089.stdout:4/710: symlink d0/d11/d16/d89/ldc 0 2024-09-13T22:08:44.856 INFO:tasks.workunit.client.0.smithi089.stdout:4/711: getdents d0/d2c/d52 0 2024-09-13T22:08:44.856 INFO:tasks.workunit.client.0.smithi089.stdout:4/712: readlink d0/d2c/d35/d64/d6e/l72 0 2024-09-13T22:08:44.858 INFO:tasks.workunit.client.0.smithi089.stdout:4/713: creat d0/d11/d16/d89/fdd x:0 0 0 2024-09-13T22:08:44.862 INFO:tasks.workunit.client.0.smithi089.stdout:1/674: rename d7/d34/d5c/d74 to d7/de/de7 0 2024-09-13T22:08:44.862 INFO:tasks.workunit.client.0.smithi089.stdout:1/675: fsync d7/d1c/d3c/f5e 0 2024-09-13T22:08:44.862 INFO:tasks.workunit.client.0.smithi089.stdout:1/676: creat d7/db6/fe8 x:0 0 0 2024-09-13T22:08:44.862 INFO:tasks.workunit.client.0.smithi089.stdout:1/677: truncate d7/d34/f28 659350 0 2024-09-13T22:08:44.862 INFO:tasks.workunit.client.0.smithi089.stdout:8/672: dwrite d0/dd/db0/d3a/d83/fd0 [0,4194304] 0 2024-09-13T22:08:44.863 INFO:tasks.workunit.client.0.smithi089.stdout:3/643: getdents d1/d2/d31 0 2024-09-13T22:08:44.864 INFO:tasks.workunit.client.0.smithi089.stdout:3/644: dread d1/d2/d4/d1c/d7e/f91 [0,4194304] 0 2024-09-13T22:08:44.866 INFO:tasks.workunit.client.0.smithi089.stdout:8/673: rename d0/dd/db0/d20/d36/d57/f82 to d0/dd/db0/d20/d1c/d5a/d63/fe7 0 2024-09-13T22:08:44.867 INFO:tasks.workunit.client.0.smithi089.stdout:9/722: dwrite d6/fc [0,4194304] 0 2024-09-13T22:08:44.867 INFO:tasks.workunit.client.0.smithi089.stdout:8/674: read d0/dd/db0/d20/d1c/d5a/d63/fe7 [10888,125860] 0 2024-09-13T22:08:44.868 INFO:tasks.workunit.client.0.smithi089.stdout:9/723: dread d6/d18/dab/f4c [0,4194304] 0 2024-09-13T22:08:44.868 INFO:tasks.workunit.client.0.smithi089.stdout:9/724: creat d6/d18/d21/d5d/d6c/ff5 x:0 0 0 2024-09-13T22:08:44.869 INFO:tasks.workunit.client.0.smithi089.stdout:3/645: mknod d1/d2/d23/cd7 0 2024-09-13T22:08:44.872 INFO:tasks.workunit.client.0.smithi089.stdout:8/675: rename d0/dd/db0/d20/d36/d80/d3b/l4f to d0/d6a/d6f/le8 0 2024-09-13T22:08:44.876 INFO:tasks.workunit.client.0.smithi089.stdout:3/646: mknod d1/d2/d4/d1c/cd8 0 2024-09-13T22:08:44.881 INFO:tasks.workunit.client.0.smithi089.stdout:8/676: rename d0/dd/db0/d3a/f43 to d0/dd/db0/d20/d36/da0/fe9 0 2024-09-13T22:08:44.881 INFO:tasks.workunit.client.0.smithi089.stdout:5/587: dwrite d4/d19/d1e/d28/d31/d55/d58/d84/f8f [0,4194304] 0 2024-09-13T22:08:44.882 INFO:tasks.workunit.client.0.smithi089.stdout:0/848: dwrite d1/de/d10/d36/d38/d4e/d62/d5b/d5e/f6b [0,4194304] 0 2024-09-13T22:08:44.882 INFO:tasks.workunit.client.0.smithi089.stdout:4/714: dwrite d0/d2c/d52/fb2 [0,4194304] 0 2024-09-13T22:08:44.882 INFO:tasks.workunit.client.0.smithi089.stdout:4/715: chown d0/d15/d1f/fb1 295 1 2024-09-13T22:08:44.882 INFO:tasks.workunit.client.0.smithi089.stdout:1/678: dread d7/d34/d5c/f88 [0,4194304] 0 2024-09-13T22:08:44.882 INFO:tasks.workunit.client.0.smithi089.stdout:4/716: chown d0/d2c/l96 115373 1 2024-09-13T22:08:44.883 INFO:tasks.workunit.client.0.smithi089.stdout:0/849: write d1/de/d10/d36/d38/d4e/fc8 [139780,61329] 0 2024-09-13T22:08:44.883 INFO:tasks.workunit.client.0.smithi089.stdout:0/850: fsync d1/de/d10/d36/d38/d4e/d62/f74 0 2024-09-13T22:08:44.883 INFO:tasks.workunit.client.0.smithi089.stdout:0/851: write d1/de/d10/d36/d38/d4e/fc8 [275191,78432] 0 2024-09-13T22:08:44.883 INFO:tasks.workunit.client.0.smithi089.stdout:0/852: stat d1/de/d15/d41/d49/db5 0 2024-09-13T22:08:44.883 INFO:tasks.workunit.client.0.smithi089.stdout:0/853: chown d1/de/d10/d36/d38/d4e/d62/d5b/d5e/d103/l113 87490712 1 2024-09-13T22:08:44.883 INFO:tasks.workunit.client.0.smithi089.stdout:0/854: stat d1/de/d1f/lc0 0 2024-09-13T22:08:44.884 INFO:tasks.workunit.client.0.smithi089.stdout:0/855: dread - d1/de/d15/fd5 zero size 2024-09-13T22:08:44.884 INFO:tasks.workunit.client.0.smithi089.stdout:0/856: stat d1/de/d15/d41/ld6 0 2024-09-13T22:08:44.884 INFO:tasks.workunit.client.0.smithi089.stdout:3/647: rename d1/d2/d96/dc3/c64 to d1/d2/d23/d3d/cd9 0 2024-09-13T22:08:44.884 INFO:tasks.workunit.client.0.smithi089.stdout:8/677: unlink d0/dd/db0/d20/d36/d80/cc9 0 2024-09-13T22:08:44.885 INFO:tasks.workunit.client.0.smithi089.stdout:9/725: read d6/ff [1387372,86186] 0 2024-09-13T22:08:44.885 INFO:tasks.workunit.client.0.smithi089.stdout:9/726: chown d6/d18/d21/f44 24615291 1 2024-09-13T22:08:44.887 INFO:tasks.workunit.client.0.smithi089.stdout:0/857: stat d1/de/d10/d36/d38/d4e/d62/ccc 0 2024-09-13T22:08:44.888 INFO:tasks.workunit.client.0.smithi089.stdout:5/588: dread d4/d19/d1e/d28/d31/d55/f5a [4194304,4194304] 0 2024-09-13T22:08:44.888 INFO:tasks.workunit.client.0.smithi089.stdout:5/589: chown d4/d19/d1e/d53/d88 17486866 1 2024-09-13T22:08:44.889 INFO:tasks.workunit.client.0.smithi089.stdout:8/678: mknod d0/d6a/cea 0 2024-09-13T22:08:44.892 INFO:tasks.workunit.client.0.smithi089.stdout:5/590: mkdir d4/d19/d1e/d28/d31/dd1 0 2024-09-13T22:08:44.892 INFO:tasks.workunit.client.0.smithi089.stdout:1/679: read d7/d40/dbe/d2b/d59/fb7 [6608289,75600] 0 2024-09-13T22:08:44.893 INFO:tasks.workunit.client.0.smithi089.stdout:4/717: dwrite d0/d2c/d8d/f9c [0,4194304] 0 2024-09-13T22:08:44.896 INFO:tasks.workunit.client.0.smithi089.stdout:0/858: dread d1/de/d15/d2a/ffc [0,4194304] 0 2024-09-13T22:08:44.896 INFO:tasks.workunit.client.0.smithi089.stdout:5/591: mkdir d4/d19/d1e/d28/d31/d55/da4/dd2 0 2024-09-13T22:08:44.896 INFO:tasks.workunit.client.0.smithi089.stdout:5/592: chown d4/d19/d1e/d28/d31/d61/l7f 132150488 1 2024-09-13T22:08:44.898 INFO:tasks.workunit.client.0.smithi089.stdout:1/680: dread d7/de/d68/f90 [0,4194304] 0 2024-09-13T22:08:44.898 INFO:tasks.workunit.client.0.smithi089.stdout:3/648: rename d1/d7 to d1/d2/d23/d3d/dda 0 2024-09-13T22:08:44.901 INFO:tasks.workunit.client.0.smithi089.stdout:4/718: mknod d0/d2c/d52/da5/d62/d8c/d9e/cde 0 2024-09-13T22:08:44.902 INFO:tasks.workunit.client.0.smithi089.stdout:0/859: unlink d1/de/d10/d36/d38/d4e/d62/d5b/f67 0 2024-09-13T22:08:44.906 INFO:tasks.workunit.client.0.smithi089.stdout:0/860: dread d1/f9e [0,4194304] 0 2024-09-13T22:08:44.906 INFO:tasks.workunit.client.0.smithi089.stdout:0/861: chown d1/de/d10/d36/d38/d4e/fdf 1847260 1 2024-09-13T22:08:44.906 INFO:tasks.workunit.client.0.smithi089.stdout:0/862: chown d1/de/d10/d36/d39/cc3 0 1 2024-09-13T22:08:44.908 INFO:tasks.workunit.client.0.smithi089.stdout:8/679: dwrite d0/dd/db0/d20/d36/f95 [0,4194304] 0 2024-09-13T22:08:44.908 INFO:tasks.workunit.client.0.smithi089.stdout:1/681: unlink d7/de/de7/c9f 0 2024-09-13T22:08:44.908 INFO:tasks.workunit.client.0.smithi089.stdout:1/682: fsync d7/db6/fe8 0 2024-09-13T22:08:44.910 INFO:tasks.workunit.client.0.smithi089.stdout:5/593: rename d4/d19/d1e/d28/d31/d55/dcc/c3b to d4/d19/d1e/d28/cd3 0 2024-09-13T22:08:44.910 INFO:tasks.workunit.client.0.smithi089.stdout:5/594: truncate d4/d19/d1e/d28/d31/d55/d58/fad 705243 0 2024-09-13T22:08:44.911 INFO:tasks.workunit.client.0.smithi089.stdout:4/719: mkdir d0/d2c/d52/da5/d9d/ddf 0 2024-09-13T22:08:44.912 INFO:tasks.workunit.client.0.smithi089.stdout:4/720: fdatasync d0/d2c/d35/d64/fd7 0 2024-09-13T22:08:44.915 INFO:tasks.workunit.client.0.smithi089.stdout:8/680: rename d0/dd/db0/d20/d1c/d5a/d63/fe7 to d0/dd/db0/d20/d36/d68/feb 0 2024-09-13T22:08:44.915 INFO:tasks.workunit.client.0.smithi089.stdout:8/681: chown d0/dd/db0/d20/d1c/d5a/d63/f66 37551 1 2024-09-13T22:08:44.915 INFO:tasks.workunit.client.0.smithi089.stdout:8/682: dread - d0/dd/db0/d20/d40/d4a/d7f/da6/fb7 zero size 2024-09-13T22:08:44.915 INFO:tasks.workunit.client.0.smithi089.stdout:8/683: dread - d0/dd/db0/d20/d36/d80/d3b/da5/fc3 zero size 2024-09-13T22:08:44.915 INFO:tasks.workunit.client.0.smithi089.stdout:8/684: dread - d0/dd/db0/d20/d36/d59/d89/fe2 zero size 2024-09-13T22:08:44.915 INFO:tasks.workunit.client.0.smithi089.stdout:0/863: dread d1/de/d10/d36/d38/f86 [0,4194304] 0 2024-09-13T22:08:44.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/595: truncate d4/d19/d1e/d89/dce/f4e 703974 0 2024-09-13T22:08:44.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/596: write d4/d19/d1e/d28/d31/d55/f6d [757408,18656] 0 2024-09-13T22:08:44.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/597: dread - d4/d19/d1e/d28/d31/d55/d58/f5f zero size 2024-09-13T22:08:44.917 INFO:tasks.workunit.client.0.smithi089.stdout:4/721: creat d0/d11/d16/fe0 x:0 0 0 2024-09-13T22:08:44.918 INFO:tasks.workunit.client.0.smithi089.stdout:3/649: dwrite d1/d2/d23/d3d/dda/fcd [0,4194304] 0 2024-09-13T22:08:44.918 INFO:tasks.workunit.client.0.smithi089.stdout:3/650: creat d1/d2/d4/d1c/d7e/d40/fdb x:0 0 0 2024-09-13T22:08:44.918 INFO:tasks.workunit.client.0.smithi089.stdout:8/685: mkdir d0/dd/db0/d20/d36/d80/d3b/da5/dec 0 2024-09-13T22:08:44.920 INFO:tasks.workunit.client.0.smithi089.stdout:4/722: creat d0/d2c/da0/da9/fe1 x:0 0 0 2024-09-13T22:08:44.920 INFO:tasks.workunit.client.0.smithi089.stdout:0/864: dread d1/de/d1f/f84 [0,4194304] 0 2024-09-13T22:08:44.921 INFO:tasks.workunit.client.0.smithi089.stdout:0/865: truncate d1/de/d10/d36/d3d/faf 5095705 0 2024-09-13T22:08:44.924 INFO:tasks.workunit.client.0.smithi089.stdout:8/686: creat d0/dd/db0/d20/d1c/d5a/fed x:0 0 0 2024-09-13T22:08:44.924 INFO:tasks.workunit.client.0.smithi089.stdout:1/683: dwrite d7/f33 [4194304,4194304] 0 2024-09-13T22:08:44.924 INFO:tasks.workunit.client.0.smithi089.stdout:1/684: stat d7/d34/d5c/l9a 0 2024-09-13T22:08:44.925 INFO:tasks.workunit.client.0.smithi089.stdout:5/598: rename d4/d19/c38 to d4/d19/d1e/d28/d3d/cd4 0 2024-09-13T22:08:44.927 INFO:tasks.workunit.client.0.smithi089.stdout:0/866: creat d1/de/d1f/d124/f12d x:0 0 0 2024-09-13T22:08:44.935 INFO:tasks.workunit.client.0.smithi089.stdout:2/620: sync 2024-09-13T22:08:44.936 INFO:tasks.workunit.client.0.smithi089.stdout:8/687: dread d0/dd/db0/d20/d36/d57/f60 [4194304,4194304] 0 2024-09-13T22:08:44.939 INFO:tasks.workunit.client.0.smithi089.stdout:2/621: rename df/d14/d2b/d4b/l4f to df/d14/d48/d88/lce 0 2024-09-13T22:08:44.939 INFO:tasks.workunit.client.0.smithi089.stdout:2/622: dread - df/d14/d48/d88/fa2 zero size 2024-09-13T22:08:44.939 INFO:tasks.workunit.client.0.smithi089.stdout:2/623: write df/f26 [3709279,90642] 0 2024-09-13T22:08:44.940 INFO:tasks.workunit.client.0.smithi089.stdout:8/688: creat d0/dd/db0/d20/d36/d80/d3b/fee x:0 0 0 2024-09-13T22:08:44.943 INFO:tasks.workunit.client.0.smithi089.stdout:2/624: rename df/d14/d48/caa to df/d14/d48/ccf 0 2024-09-13T22:08:44.943 INFO:tasks.workunit.client.0.smithi089.stdout:2/625: creat df/d5b/da5/db8/fd0 x:0 0 0 2024-09-13T22:08:44.944 INFO:tasks.workunit.client.0.smithi089.stdout:8/689: mknod d0/dd/db0/d20/d36/d59/d89/dca/cef 0 2024-09-13T22:08:44.945 INFO:tasks.workunit.client.0.smithi089.stdout:4/723: dwrite d0/d2c/d35/d5d/f60 [4194304,4194304] 0 2024-09-13T22:08:44.945 INFO:tasks.workunit.client.0.smithi089.stdout:0/867: dwrite d1/f11 [4194304,4194304] 0 2024-09-13T22:08:44.945 INFO:tasks.workunit.client.0.smithi089.stdout:0/868: write d1/de/d10/f1b [5725337,59622] 0 2024-09-13T22:08:44.945 INFO:tasks.workunit.client.0.smithi089.stdout:0/869: fdatasync d1/de/d10/d36/d38/f86 0 2024-09-13T22:08:44.945 INFO:tasks.workunit.client.0.smithi089.stdout:0/870: chown d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4/cdc 1 1 2024-09-13T22:08:44.947 INFO:tasks.workunit.client.0.smithi089.stdout:2/626: rename df/d14/l4c to df/d14/d2b/d61/ld1 0 2024-09-13T22:08:44.947 INFO:tasks.workunit.client.0.smithi089.stdout:2/627: creat df/d5b/fd2 x:0 0 0 2024-09-13T22:08:44.949 INFO:tasks.workunit.client.0.smithi089.stdout:8/690: mknod d0/dd/db0/cf0 0 2024-09-13T22:08:44.949 INFO:tasks.workunit.client.0.smithi089.stdout:8/691: chown d0/dd/db0/fb2 27627328 1 2024-09-13T22:08:44.950 INFO:tasks.workunit.client.0.smithi089.stdout:0/871: rename d1/de/d10/d36/c106 to d1/de/d10/d36/d57/c12e 0 2024-09-13T22:08:44.950 INFO:tasks.workunit.client.0.smithi089.stdout:0/872: stat d1/de/d15/d41/d49/db5 0 2024-09-13T22:08:44.954 INFO:tasks.workunit.client.0.smithi089.stdout:2/628: link df/d14/f65 df/d14/d2b/fd3 0 2024-09-13T22:08:44.955 INFO:tasks.workunit.client.0.smithi089.stdout:8/692: mkdir d0/d6a/d73/df1 0 2024-09-13T22:08:44.955 INFO:tasks.workunit.client.0.smithi089.stdout:8/693: getdents d0/dd/db0/d3a/dd4 0 2024-09-13T22:08:44.955 INFO:tasks.workunit.client.0.smithi089.stdout:8/694: fdatasync d0/dd/db0/d20/d1c/fba 0 2024-09-13T22:08:44.955 INFO:tasks.workunit.client.0.smithi089.stdout:8/695: dread - d0/dd/db0/d20/d36/d80/d3b/da5/fb3 zero size 2024-09-13T22:08:44.956 INFO:tasks.workunit.client.0.smithi089.stdout:1/685: truncate d7/f33 5112934 0 2024-09-13T22:08:44.956 INFO:tasks.workunit.client.0.smithi089.stdout:1/686: chown d7/de/l8c 0 1 2024-09-13T22:08:44.956 INFO:tasks.workunit.client.0.smithi089.stdout:8/696: mkdir d0/dd/db0/d20/d36/d59/d89/d8d/df2 0 2024-09-13T22:08:44.956 INFO:tasks.workunit.client.0.smithi089.stdout:8/697: write d0/dd/db0/d20/d36/d59/d89/fe0 [167906,117676] 0 2024-09-13T22:08:44.958 INFO:tasks.workunit.client.0.smithi089.stdout:1/687: unlink d7/de/ff 0 2024-09-13T22:08:44.959 INFO:tasks.workunit.client.0.smithi089.stdout:8/698: mkdir d0/d6a/db9/dde/df3 0 2024-09-13T22:08:44.961 INFO:tasks.workunit.client.0.smithi089.stdout:1/688: unlink d7/l23 0 2024-09-13T22:08:44.961 INFO:tasks.workunit.client.0.smithi089.stdout:1/689: chown d7/d34/faa 7 1 2024-09-13T22:08:44.963 INFO:tasks.workunit.client.0.smithi089.stdout:2/629: dread df/d5b/f73 [0,4194304] 0 2024-09-13T22:08:44.965 INFO:tasks.workunit.client.0.smithi089.stdout:1/690: mkdir d7/d40/dbe/de9 0 2024-09-13T22:08:44.965 INFO:tasks.workunit.client.0.smithi089.stdout:1/691: chown d7/d1c/d7a/ccc 164939514 1 2024-09-13T22:08:44.967 INFO:tasks.workunit.client.0.smithi089.stdout:2/630: rename df/d14/d2b/fb3 to df/d5b/da5/fd4 0 2024-09-13T22:08:44.967 INFO:tasks.workunit.client.0.smithi089.stdout:2/631: chown c7 0 1 2024-09-13T22:08:44.970 INFO:tasks.workunit.client.0.smithi089.stdout:2/632: rename df/d14/d2b/l4a to df/d5b/da5/ld5 0 2024-09-13T22:08:44.971 INFO:tasks.workunit.client.0.smithi089.stdout:2/633: unlink df/d14/d2b/d61/laf 0 2024-09-13T22:08:44.972 INFO:tasks.workunit.client.0.smithi089.stdout:2/634: readlink df/d14/d66/d69/d2e/l5d 0 2024-09-13T22:08:44.972 INFO:tasks.workunit.client.0.smithi089.stdout:2/635: fdatasync df/d1a/f42 0 2024-09-13T22:08:44.976 INFO:tasks.workunit.client.0.smithi089.stdout:1/692: dread d7/d40/dbe/d2b/f2e [0,4194304] 0 2024-09-13T22:08:44.983 INFO:tasks.workunit.client.0.smithi089.stdout:4/724: dwrite d0/f23 [0,4194304] 0 2024-09-13T22:08:44.995 INFO:tasks.workunit.client.0.smithi089.stdout:4/725: write d0/f23 [3905839,82292] 0 2024-09-13T22:08:44.998 INFO:tasks.workunit.client.0.smithi089.stdout:0/873: dwrite d1/de/d10/d36/d39/fe6 [0,4194304] 0 2024-09-13T22:08:44.999 INFO:tasks.workunit.client.0.smithi089.stdout:0/874: read - d1/de/d10/d36/d38/d4e/d62/d5f/db6/fc9 zero size 2024-09-13T22:08:45.003 INFO:tasks.workunit.client.0.smithi089.stdout:0/875: truncate d1/f11 1089270 0 2024-09-13T22:08:45.004 INFO:tasks.workunit.client.0.smithi089.stdout:2/636: dwrite df/d1a/f81 [0,4194304] 0 2024-09-13T22:08:45.005 INFO:tasks.workunit.client.0.smithi089.stdout:1/693: dwrite d7/db6/fe8 [0,4194304] 0 2024-09-13T22:08:45.005 INFO:tasks.workunit.client.0.smithi089.stdout:2/637: read - df/d76/d85/db2/fb6 zero size 2024-09-13T22:08:45.005 INFO:tasks.workunit.client.0.smithi089.stdout:2/638: truncate df/d14/d2b/f63 4269753 0 2024-09-13T22:08:45.005 INFO:tasks.workunit.client.0.smithi089.stdout:0/876: mknod d1/de/d15/d41/d87/d125/c12f 0 2024-09-13T22:08:45.006 INFO:tasks.workunit.client.0.smithi089.stdout:8/699: dwrite d0/dd/db0/d20/d40/d4a/fbc [0,4194304] 0 2024-09-13T22:08:45.006 INFO:tasks.workunit.client.0.smithi089.stdout:1/694: creat d7/de/fea x:0 0 0 2024-09-13T22:08:45.006 INFO:tasks.workunit.client.0.smithi089.stdout:1/695: fsync d7/d1c/d7a/dad/fc4 0 2024-09-13T22:08:45.007 INFO:tasks.workunit.client.0.smithi089.stdout:2/639: link df/d5b/f5f df/d76/fd6 0 2024-09-13T22:08:45.007 INFO:tasks.workunit.client.0.smithi089.stdout:2/640: write df/d76/fd6 [656435,104636] 0 2024-09-13T22:08:45.008 INFO:tasks.workunit.client.0.smithi089.stdout:6/574: sync 2024-09-13T22:08:45.011 INFO:tasks.workunit.client.0.smithi089.stdout:1/696: link d7/de/d3a/fda d7/d1c/feb 0 2024-09-13T22:08:45.012 INFO:tasks.workunit.client.0.smithi089.stdout:1/697: chown d7/db6/fcb 6 1 2024-09-13T22:08:45.013 INFO:tasks.workunit.client.0.smithi089.stdout:2/641: mkdir df/d5b/da5/dd7 0 2024-09-13T22:08:45.013 INFO:tasks.workunit.client.0.smithi089.stdout:0/877: getdents d1/de/d15/d41 0 2024-09-13T22:08:45.013 INFO:tasks.workunit.client.0.smithi089.stdout:0/878: chown d1/de/d10/d36/d57/d3a/l9f 399 1 2024-09-13T22:08:45.013 INFO:tasks.workunit.client.0.smithi089.stdout:0/879: chown d1/de/d10/d36/d38/d4e/ca0 168204 1 2024-09-13T22:08:45.013 INFO:tasks.workunit.client.0.smithi089.stdout:0/880: chown d1/de/d10/d36/d38/d4e/d62/d5f/d72/f93 20 1 2024-09-13T22:08:45.014 INFO:tasks.workunit.client.0.smithi089.stdout:8/700: getdents d0/dd/db0/d20/d1c/d5a/d63 0 2024-09-13T22:08:45.015 INFO:tasks.workunit.client.0.smithi089.stdout:1/698: symlink d7/d40/dbe/d2b/d59/lec 0 2024-09-13T22:08:45.016 INFO:tasks.workunit.client.0.smithi089.stdout:2/642: symlink df/d5b/da5/db8/ld8 0 2024-09-13T22:08:45.018 INFO:tasks.workunit.client.0.smithi089.stdout:9/727: sync 2024-09-13T22:08:45.019 INFO:tasks.workunit.client.0.smithi089.stdout:3/651: sync 2024-09-13T22:08:45.019 INFO:tasks.workunit.client.0.smithi089.stdout:7/620: sync 2024-09-13T22:08:45.019 INFO:tasks.workunit.client.0.smithi089.stdout:3/652: chown d1/l6c 129 1 2024-09-13T22:08:45.019 INFO:tasks.workunit.client.0.smithi089.stdout:9/728: dread - d6/d18/d21/d5d/d6c/d8d/fc9 zero size 2024-09-13T22:08:45.019 INFO:tasks.workunit.client.0.smithi089.stdout:9/729: chown d6/d18/d1b 1 1 2024-09-13T22:08:45.019 INFO:tasks.workunit.client.0.smithi089.stdout:9/730: chown d6/f2b 10961 1 2024-09-13T22:08:45.019 INFO:tasks.workunit.client.0.smithi089.stdout:7/621: creat d0/d19/d28/d1d/d23/d2e/fce x:0 0 0 2024-09-13T22:08:45.020 INFO:tasks.workunit.client.0.smithi089.stdout:7/622: chown d0/d19/d28/d1d/d23/d2e/d41/la4 1833823 1 2024-09-13T22:08:45.020 INFO:tasks.workunit.client.0.smithi089.stdout:0/881: mkdir d1/de/d15/d41/d49/d76/d11d/d130 0 2024-09-13T22:08:45.020 INFO:tasks.workunit.client.0.smithi089.stdout:0/882: fsync d1/fd 0 2024-09-13T22:08:45.020 INFO:tasks.workunit.client.0.smithi089.stdout:0/883: chown d1/de/d15/d41/d87/dbf/de0 368786651 1 2024-09-13T22:08:45.020 INFO:tasks.workunit.client.0.smithi089.stdout:0/884: chown d1/de/d15/d2a/f81 14197 1 2024-09-13T22:08:45.020 INFO:tasks.workunit.client.0.smithi089.stdout:0/885: fdatasync d1/de/d10/d36/d38/d4e/f10d 0 2024-09-13T22:08:45.021 INFO:tasks.workunit.client.0.smithi089.stdout:6/575: unlink d0/d4/d12/l30 0 2024-09-13T22:08:45.021 INFO:tasks.workunit.client.0.smithi089.stdout:4/726: dwrite d0/d2c/d35/d74/f7e [0,4194304] 0 2024-09-13T22:08:45.021 INFO:tasks.workunit.client.0.smithi089.stdout:4/727: chown d0/l66 2 1 2024-09-13T22:08:45.021 INFO:tasks.workunit.client.0.smithi089.stdout:8/701: truncate d0/dd/db0/d42/f5e 1365956 0 2024-09-13T22:08:45.021 INFO:tasks.workunit.client.0.smithi089.stdout:1/699: symlink d7/db6/led 0 2024-09-13T22:08:45.023 INFO:tasks.workunit.client.0.smithi089.stdout:0/886: symlink d1/de/d10/d36/d57/d3a/l131 0 2024-09-13T22:08:45.024 INFO:tasks.workunit.client.0.smithi089.stdout:1/700: mkdir d7/de/da0/dee 0 2024-09-13T22:08:45.024 INFO:tasks.workunit.client.0.smithi089.stdout:2/643: rmdir df/d14/d48 39 2024-09-13T22:08:45.026 INFO:tasks.workunit.client.0.smithi089.stdout:2/644: mkdir df/dd9 0 2024-09-13T22:08:45.026 INFO:tasks.workunit.client.0.smithi089.stdout:2/645: chown df/d76/d85/db2 25 1 2024-09-13T22:08:45.030 INFO:tasks.workunit.client.0.smithi089.stdout:3/653: dread d1/d2/d23/d3d/d54/d5d/f77 [0,4194304] 0 2024-09-13T22:08:45.032 INFO:tasks.workunit.client.0.smithi089.stdout:1/701: dread d7/d34/d5c/d5d/f62 [0,4194304] 0 2024-09-13T22:08:45.034 INFO:tasks.workunit.client.0.smithi089.stdout:1/702: mkdir d7/de/def 0 2024-09-13T22:08:45.034 INFO:tasks.workunit.client.0.smithi089.stdout:1/703: readlink d7/d1c/d3c/l6c 0 2024-09-13T22:08:45.034 INFO:tasks.workunit.client.0.smithi089.stdout:1/704: write d7/d1c/d3c/f65 [768203,103847] 0 2024-09-13T22:08:45.036 INFO:tasks.workunit.client.0.smithi089.stdout:1/705: mknod d7/d34/cf0 0 2024-09-13T22:08:45.037 INFO:tasks.workunit.client.0.smithi089.stdout:0/887: write d1/de/d10/d36/d38/d4e/d62/d5b/d5e/f6b [2306344,32891] 0 2024-09-13T22:08:45.037 INFO:tasks.workunit.client.0.smithi089.stdout:0/888: creat d1/de/d10/d85/f132 x:0 0 0 2024-09-13T22:08:45.045 INFO:tasks.workunit.client.0.smithi089.stdout:3/654: dread d1/d2/d4/d1c/d7e/d40/d69/da1/f3b [0,4194304] 0 2024-09-13T22:08:45.045 INFO:tasks.workunit.client.0.smithi089.stdout:0/889: dread d1/f11 [0,4194304] 0 2024-09-13T22:08:45.045 INFO:tasks.workunit.client.0.smithi089.stdout:3/655: rmdir d1/d2/d4/d1c/d7e/d83 39 2024-09-13T22:08:45.046 INFO:tasks.workunit.client.0.smithi089.stdout:0/890: mkdir d1/de/d10/d85/d133 0 2024-09-13T22:08:45.047 INFO:tasks.workunit.client.0.smithi089.stdout:0/891: getdents d1/de/d15/d2a 0 2024-09-13T22:08:45.047 INFO:tasks.workunit.client.0.smithi089.stdout:0/892: truncate d1/de/d10/d36/d38/d4e/fad 568517 0 2024-09-13T22:08:45.047 INFO:tasks.workunit.client.0.smithi089.stdout:0/893: creat d1/de/d15/d41/d49/d76/f134 x:0 0 0 2024-09-13T22:08:45.048 INFO:tasks.workunit.client.0.smithi089.stdout:0/894: mkdir d1/de/d10/d135 0 2024-09-13T22:08:45.052 INFO:tasks.workunit.client.0.smithi089.stdout:8/702: dwrite d0/dd/db0/d20/f2e [0,4194304] 0 2024-09-13T22:08:45.052 INFO:tasks.workunit.client.0.smithi089.stdout:8/703: dread - d0/dd/db0/d3a/fdd zero size 2024-09-13T22:08:45.052 INFO:tasks.workunit.client.0.smithi089.stdout:6/576: dwrite d0/d4/d12/f20 [0,4194304] 0 2024-09-13T22:08:45.053 INFO:tasks.workunit.client.0.smithi089.stdout:7/623: rename d0/d19/d28/d1d/d23/d2e to d0/d19/d28/d1d/d3d/d9a/dcf 0 2024-09-13T22:08:45.053 INFO:tasks.workunit.client.0.smithi089.stdout:2/646: dwrite df/d76/d85/db2/fc2 [0,4194304] 0 2024-09-13T22:08:45.053 INFO:tasks.workunit.client.0.smithi089.stdout:2/647: creat df/d1a/fda x:0 0 0 2024-09-13T22:08:45.054 INFO:tasks.workunit.client.0.smithi089.stdout:6/577: dread d0/d5/d1d/d56/d28/fa1 [0,4194304] 0 2024-09-13T22:08:45.056 INFO:tasks.workunit.client.0.smithi089.stdout:4/728: rename d0/d2c/d35/d64/dd4 to d0/d2c/d52/da5/d9d/ddb/de2 0 2024-09-13T22:08:45.059 INFO:tasks.workunit.client.0.smithi089.stdout:2/648: unlink df/d76/d85/db2/fc2 0 2024-09-13T22:08:45.061 INFO:tasks.workunit.client.0.smithi089.stdout:8/704: write d0/dd/db0/d20/d1c/d5a/d63/f66 [1535119,55610] 0 2024-09-13T22:08:45.062 INFO:tasks.workunit.client.0.smithi089.stdout:6/578: unlink d0/d5/d1d/d56/d60/f7e 0 2024-09-13T22:08:45.062 INFO:tasks.workunit.client.0.smithi089.stdout:6/579: fsync d0/d5/d1d/d56/f3f 0 2024-09-13T22:08:45.063 INFO:tasks.workunit.client.0.smithi089.stdout:1/706: rename d7/d1c/d7a/ccc to d7/d1c/d7a/dad/cf1 0 2024-09-13T22:08:45.064 INFO:tasks.workunit.client.0.smithi089.stdout:4/729: symlink d0/d2c/d35/le3 0 2024-09-13T22:08:45.064 INFO:tasks.workunit.client.0.smithi089.stdout:2/649: symlink df/dd9/ldb 0 2024-09-13T22:08:45.065 INFO:tasks.workunit.client.0.smithi089.stdout:6/580: symlink d0/d5/d1d/d56/d4b/lad 0 2024-09-13T22:08:45.066 INFO:tasks.workunit.client.0.smithi089.stdout:3/656: rename d1/d2/d4/d1c/c21 to d1/d2/d23/d3d/d46/dd6/cdc 0 2024-09-13T22:08:45.066 INFO:tasks.workunit.client.0.smithi089.stdout:3/657: chown d1/d2/d4/d1c/d7e/d40/d69/da1/c3e 11 1 2024-09-13T22:08:45.067 INFO:tasks.workunit.client.0.smithi089.stdout:2/650: symlink df/d76/ldc 0 2024-09-13T22:08:45.067 INFO:tasks.workunit.client.0.smithi089.stdout:3/658: stat d1/d2/d23/d3d/d54/d95/lb1 0 2024-09-13T22:08:45.068 INFO:tasks.workunit.client.0.smithi089.stdout:1/707: rmdir d7/de/d3a 39 2024-09-13T22:08:45.069 INFO:tasks.workunit.client.0.smithi089.stdout:2/651: creat df/d14/d2b/d4b/fdd x:0 0 0 2024-09-13T22:08:45.070 INFO:tasks.workunit.client.0.smithi089.stdout:1/708: unlink d7/d34/c36 0 2024-09-13T22:08:45.071 INFO:tasks.workunit.client.0.smithi089.stdout:2/652: link df/d14/d48/ccf df/d1a/d57/dab/cde 0 2024-09-13T22:08:45.072 INFO:tasks.workunit.client.0.smithi089.stdout:4/730: dread d0/d11/f21 [0,4194304] 0 2024-09-13T22:08:45.072 INFO:tasks.workunit.client.0.smithi089.stdout:3/659: getdents d1/d2/d23/d3d 0 2024-09-13T22:08:45.073 INFO:tasks.workunit.client.0.smithi089.stdout:0/895: dwrite d1/de/d10/d85/ffb [0,4194304] 0 2024-09-13T22:08:45.073 INFO:tasks.workunit.client.0.smithi089.stdout:0/896: creat d1/de/d15/d41/d87/f136 x:0 0 0 2024-09-13T22:08:45.074 INFO:tasks.workunit.client.0.smithi089.stdout:4/731: mknod d0/d2c/d52/da5/d9d/ddf/ce4 0 2024-09-13T22:08:45.074 INFO:tasks.workunit.client.0.smithi089.stdout:4/732: dread - d0/d2c/da0/da9/fe1 zero size 2024-09-13T22:08:45.074 INFO:tasks.workunit.client.0.smithi089.stdout:4/733: chown d0/d2c/f41 535640142 1 2024-09-13T22:08:45.075 INFO:tasks.workunit.client.0.smithi089.stdout:2/653: dread df/d76/d85/fb0 [0,4194304] 0 2024-09-13T22:08:45.076 INFO:tasks.workunit.client.0.smithi089.stdout:6/581: write d0/d4/d12/f41 [1785885,85169] 0 2024-09-13T22:08:45.077 INFO:tasks.workunit.client.0.smithi089.stdout:7/624: dwrite d0/d19/d28/f44 [0,4194304] 0 2024-09-13T22:08:45.078 INFO:tasks.workunit.client.0.smithi089.stdout:5/599: sync 2024-09-13T22:08:45.080 INFO:tasks.workunit.client.0.smithi089.stdout:4/734: symlink d0/d11/d16/le5 0 2024-09-13T22:08:45.080 INFO:tasks.workunit.client.0.smithi089.stdout:0/897: mknod d1/de/d1f/ddd/c137 0 2024-09-13T22:08:45.080 INFO:tasks.workunit.client.0.smithi089.stdout:0/898: truncate d1/de/f17 1005792 0 2024-09-13T22:08:45.081 INFO:tasks.workunit.client.0.smithi089.stdout:2/654: unlink df/d14/d2b/d4b/c87 0 2024-09-13T22:08:45.082 INFO:tasks.workunit.client.0.smithi089.stdout:1/709: dread d7/d40/dbe/d80/fa5 [0,4194304] 0 2024-09-13T22:08:45.083 INFO:tasks.workunit.client.0.smithi089.stdout:7/625: rename d0/d19/d28/d1d/d23/d24/d5d/l85 to d0/d19/d28/d1d/d3d/d9a/ld0 0 2024-09-13T22:08:45.085 INFO:tasks.workunit.client.0.smithi089.stdout:5/600: creat d4/d19/d1e/d28/d31/d55/dcc/fd5 x:0 0 0 2024-09-13T22:08:45.086 INFO:tasks.workunit.client.0.smithi089.stdout:4/735: truncate d0/d2c/d35/d64/f82 809119 0 2024-09-13T22:08:45.088 INFO:tasks.workunit.client.0.smithi089.stdout:0/899: mknod d1/de/d10/d36/d57/d3a/db7/d10a/c138 0 2024-09-13T22:08:45.089 INFO:tasks.workunit.client.0.smithi089.stdout:2/655: mkdir df/d1a/ddf 0 2024-09-13T22:08:45.091 INFO:tasks.workunit.client.0.smithi089.stdout:5/601: read d4/d19/d1e/d28/d3d/f57 [2009266,119802] 0 2024-09-13T22:08:45.093 INFO:tasks.workunit.client.0.smithi089.stdout:1/710: symlink d7/d40/dbe/d2b/da7/lf2 0 2024-09-13T22:08:45.093 INFO:tasks.workunit.client.0.smithi089.stdout:1/711: stat d7 0 2024-09-13T22:08:45.093 INFO:tasks.workunit.client.0.smithi089.stdout:1/712: stat d7/de/d68/c95 0 2024-09-13T22:08:45.095 INFO:tasks.workunit.client.0.smithi089.stdout:7/626: symlink d0/d19/d45/d92/ld1 0 2024-09-13T22:08:45.095 INFO:tasks.workunit.client.0.smithi089.stdout:7/627: truncate d0/d19/d45/fab 644113 0 2024-09-13T22:08:45.097 INFO:tasks.workunit.client.0.smithi089.stdout:4/736: unlink d0/d15/d76/l85 0 2024-09-13T22:08:45.097 INFO:tasks.workunit.client.0.smithi089.stdout:3/660: dwrite d1/d2/d31/f6e [0,4194304] 0 2024-09-13T22:08:45.098 INFO:tasks.workunit.client.0.smithi089.stdout:1/713: getdents d7/d40/dbe/d2b/d59/d9e 0 2024-09-13T22:08:45.098 INFO:tasks.workunit.client.0.smithi089.stdout:0/900: write d1/de/d10/d36/d38/fc1 [508252,3112] 0 2024-09-13T22:08:45.100 INFO:tasks.workunit.client.0.smithi089.stdout:6/582: dwrite d0/d4/d12/f13 [4194304,4194304] 0 2024-09-13T22:08:45.101 INFO:tasks.workunit.client.0.smithi089.stdout:6/583: fdatasync d0/d5/d1d/d54/f8f 0 2024-09-13T22:08:45.102 INFO:tasks.workunit.client.0.smithi089.stdout:4/737: rename d0/d15/l59 to d0/d2c/d35/d74/le6 0 2024-09-13T22:08:45.103 INFO:tasks.workunit.client.0.smithi089.stdout:3/661: symlink d1/d2/d23/ldd 0 2024-09-13T22:08:45.105 INFO:tasks.workunit.client.0.smithi089.stdout:6/584: mknod d0/d5/d1d/d2d/cae 0 2024-09-13T22:08:45.105 INFO:tasks.workunit.client.0.smithi089.stdout:3/662: symlink d1/d2/d23/d3d/dda/d1b/lde 0 2024-09-13T22:08:45.106 INFO:tasks.workunit.client.0.smithi089.stdout:5/602: dread d4/d19/d1e/f62 [4194304,4194304] 0 2024-09-13T22:08:45.106 INFO:tasks.workunit.client.0.smithi089.stdout:2/656: dread df/d14/d2b/f59 [0,4194304] 0 2024-09-13T22:08:45.107 INFO:tasks.workunit.client.0.smithi089.stdout:2/657: dread - df/d14/d48/d88/f91 zero size 2024-09-13T22:08:45.107 INFO:tasks.workunit.client.0.smithi089.stdout:5/603: write d4/d19/d1e/d28/fb7 [756025,105842] 0 2024-09-13T22:08:45.107 INFO:tasks.workunit.client.0.smithi089.stdout:7/628: dread d0/d19/d28/d1d/f5f [0,4194304] 0 2024-09-13T22:08:45.107 INFO:tasks.workunit.client.0.smithi089.stdout:3/663: rmdir d1/da5 0 2024-09-13T22:08:45.108 INFO:tasks.workunit.client.0.smithi089.stdout:3/664: stat d1/d2/d96/dc3/f74 0 2024-09-13T22:08:45.108 INFO:tasks.workunit.client.0.smithi089.stdout:3/665: stat d1/d2/d4/d1c/d7e/d40/d69/da1/f81 0 2024-09-13T22:08:45.108 INFO:tasks.workunit.client.0.smithi089.stdout:3/666: write d1/d2/d4/d1c/d7e/d40/fad [416976,99299] 0 2024-09-13T22:08:45.108 INFO:tasks.workunit.client.0.smithi089.stdout:3/667: chown d1/d2/d23/d3d/d54/l88 1236 1 2024-09-13T22:08:45.109 INFO:tasks.workunit.client.0.smithi089.stdout:2/658: creat df/d14/d66/d69/fe0 x:0 0 0 2024-09-13T22:08:45.111 INFO:tasks.workunit.client.0.smithi089.stdout:5/604: mknod d4/d19/d1e/d28/d31/cd6 0 2024-09-13T22:08:45.111 INFO:tasks.workunit.client.0.smithi089.stdout:5/605: readlink d4/d19/d1e/d28/l5c 0 2024-09-13T22:08:45.112 INFO:tasks.workunit.client.0.smithi089.stdout:1/714: write d7/d1c/f72 [2479902,47154] 0 2024-09-13T22:08:45.112 INFO:tasks.workunit.client.0.smithi089.stdout:1/715: chown d7/d40/dbe/d2b/c53 544215 1 2024-09-13T22:08:45.112 INFO:tasks.workunit.client.0.smithi089.stdout:1/716: read - d7/d40/dbe/d2b/d59/fac zero size 2024-09-13T22:08:45.113 INFO:tasks.workunit.client.0.smithi089.stdout:7/629: mknod d0/d19/d28/d1d/d2d/d3c/cd2 0 2024-09-13T22:08:45.113 INFO:tasks.workunit.client.0.smithi089.stdout:7/630: write d0/d19/d28/d1d/d3d/d9a/dcf/fce [503306,114199] 0 2024-09-13T22:08:45.115 INFO:tasks.workunit.client.0.smithi089.stdout:3/668: creat d1/d3a/fdf x:0 0 0 2024-09-13T22:08:45.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/659: mkdir df/d14/d66/d8a/de1 0 2024-09-13T22:08:45.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/660: stat df/f8d 0 2024-09-13T22:08:45.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/661: write df/d14/d66/d69/fa7 [115337,31473] 0 2024-09-13T22:08:45.118 INFO:tasks.workunit.client.0.smithi089.stdout:5/606: link d4/d19/d1e/d28/d3d/dc9/fa7 d4/d19/d1e/d28/d31/d55/da4/dd2/fd7 0 2024-09-13T22:08:45.119 INFO:tasks.workunit.client.0.smithi089.stdout:1/717: chown d7/d40/dbe/d2b/d39/d73/c9c 5848 1 2024-09-13T22:08:45.122 INFO:tasks.workunit.client.0.smithi089.stdout:7/631: truncate d0/d19/d28/d1d/d23/d24/f42 1438602 0 2024-09-13T22:08:45.123 INFO:tasks.workunit.client.0.smithi089.stdout:3/669: mknod d1/d2/d23/d3d/dda/d1b/d28/d97/ce0 0 2024-09-13T22:08:45.125 INFO:tasks.workunit.client.0.smithi089.stdout:0/901: dwrite d1/de/d15/d41/d49/d76/d8b/fe4 [0,4194304] 0 2024-09-13T22:08:45.126 INFO:tasks.workunit.client.0.smithi089.stdout:7/632: creat d0/d19/d28/d1d/d23/d24/dac/db3/fd3 x:0 0 0 2024-09-13T22:08:45.126 INFO:tasks.workunit.client.0.smithi089.stdout:3/670: truncate d1/d2/d23/d3d/dda/d1b/f4e 1838491 0 2024-09-13T22:08:45.129 INFO:tasks.workunit.client.0.smithi089.stdout:3/671: link d1/d2/d23/d3d/dda/d5c/ca9 d1/d2/d23/d3d/dd2/ce1 0 2024-09-13T22:08:45.130 INFO:tasks.workunit.client.0.smithi089.stdout:7/633: getdents d0/d19/d28/d1d/d23/d24/dac 0 2024-09-13T22:08:45.130 INFO:tasks.workunit.client.0.smithi089.stdout:7/634: creat d0/d19/d28/d61/fd4 x:0 0 0 2024-09-13T22:08:45.130 INFO:tasks.workunit.client.0.smithi089.stdout:7/635: fdatasync d0/d19/d28/d61/fb8 0 2024-09-13T22:08:45.132 INFO:tasks.workunit.client.0.smithi089.stdout:3/672: symlink d1/d2/d4/d1c/d7e/d83/le2 0 2024-09-13T22:08:45.133 INFO:tasks.workunit.client.0.smithi089.stdout:7/636: mknod d0/d19/d45/d38/d54/cd5 0 2024-09-13T22:08:45.135 INFO:tasks.workunit.client.0.smithi089.stdout:7/637: mkdir d0/d19/d45/d38/dd6 0 2024-09-13T22:08:45.138 INFO:tasks.workunit.client.0.smithi089.stdout:7/638: mknod d0/d19/d28/d1d/d2d/d3c/d90/cd7 0 2024-09-13T22:08:45.139 INFO:tasks.workunit.client.0.smithi089.stdout:9/731: sync 2024-09-13T22:08:45.139 INFO:tasks.workunit.client.0.smithi089.stdout:9/732: getdents d6/d18/d1b 0 2024-09-13T22:08:45.144 INFO:tasks.workunit.client.0.smithi089.stdout:0/902: dread d1/de/d10/d36/d3d/f43 [0,4194304] 0 2024-09-13T22:08:45.145 INFO:tasks.workunit.client.0.smithi089.stdout:0/903: chown d1/c19 0 1 2024-09-13T22:08:45.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/904: getdents d1/de 0 2024-09-13T22:08:45.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/905: write d1/de/d10/d36/d38/d4e/d62/d5f/faa [632090,106098] 0 2024-09-13T22:08:45.155 INFO:tasks.workunit.client.0.smithi089.stdout:0/906: dread d1/de/d15/d2a/f81 [0,4194304] 0 2024-09-13T22:08:45.155 INFO:tasks.workunit.client.0.smithi089.stdout:0/907: dread - d1/de/d10/d36/d38/d4e/d62/d5f/d72/fb3 zero size 2024-09-13T22:08:45.161 INFO:tasks.workunit.client.0.smithi089.stdout:7/639: dwrite d0/d19/d28/d1d/d23/f7f [0,4194304] 0 2024-09-13T22:08:45.161 INFO:tasks.workunit.client.0.smithi089.stdout:7/640: fsync d0/d19/d28/d1d/d3d/f43 0 2024-09-13T22:08:45.162 INFO:tasks.workunit.client.0.smithi089.stdout:7/641: stat d0/d19/d28/d1d/d2d 0 2024-09-13T22:08:45.162 INFO:tasks.workunit.client.0.smithi089.stdout:7/642: fdatasync d0/d19/d28/fa2 0 2024-09-13T22:08:45.163 INFO:tasks.workunit.client.0.smithi089.stdout:7/643: mkdir d0/d19/d28/d1d/d3d/d9a/dcf/da8/dd8 0 2024-09-13T22:08:45.164 INFO:tasks.workunit.client.0.smithi089.stdout:7/644: stat d0/d19/d28/d1d/d3d/d9a/dcf/d41/f7e 0 2024-09-13T22:08:45.166 INFO:tasks.workunit.client.0.smithi089.stdout:6/585: dwrite d0/d4/f38 [0,4194304] 0 2024-09-13T22:08:45.166 INFO:tasks.workunit.client.0.smithi089.stdout:4/738: dwrite d0/d2c/d35/f67 [0,4194304] 0 2024-09-13T22:08:45.167 INFO:tasks.workunit.client.0.smithi089.stdout:0/908: dread d1/de/d10/f1b [0,4194304] 0 2024-09-13T22:08:45.167 INFO:tasks.workunit.client.0.smithi089.stdout:0/909: chown d1/de/d10/d36/d57/d3a/db7/l114 1734 1 2024-09-13T22:08:45.169 INFO:tasks.workunit.client.0.smithi089.stdout:2/662: dwrite df/d14/d2b/d61/f49 [0,4194304] 0 2024-09-13T22:08:45.169 INFO:tasks.workunit.client.0.smithi089.stdout:5/607: dwrite d4/d19/d1e/d28/d31/d55/d58/fab [0,4194304] 0 2024-09-13T22:08:45.169 INFO:tasks.workunit.client.0.smithi089.stdout:5/608: stat d4/d19/d1e/d28/d31/d55/da4 0 2024-09-13T22:08:45.171 INFO:tasks.workunit.client.0.smithi089.stdout:9/733: dwrite d6/f59 [4194304,4194304] 0 2024-09-13T22:08:45.171 INFO:tasks.workunit.client.0.smithi089.stdout:9/734: dread - d6/d18/d1b/d3e/dbd/fc7 zero size 2024-09-13T22:08:45.182 INFO:tasks.workunit.client.0.smithi089.stdout:0/910: read d1/de/d10/f1b [3497965,59556] 0 2024-09-13T22:08:45.182 INFO:tasks.workunit.client.0.smithi089.stdout:1/718: dwrite d7/de/d68/f6f [4194304,4194304] 0 2024-09-13T22:08:45.182 INFO:tasks.workunit.client.0.smithi089.stdout:4/739: rename d0/f8 to d0/d2c/d52/da5/d62/d8c/fe7 0 2024-09-13T22:08:45.183 INFO:tasks.workunit.client.0.smithi089.stdout:4/740: write d0/d2c/d35/d64/fd7 [362208,121326] 0 2024-09-13T22:08:45.183 INFO:tasks.workunit.client.0.smithi089.stdout:5/609: dread d4/d19/f3c [0,4194304] 0 2024-09-13T22:08:45.183 INFO:tasks.workunit.client.0.smithi089.stdout:2/663: truncate df/d14/d2b/fd3 6714224 0 2024-09-13T22:08:45.183 INFO:tasks.workunit.client.0.smithi089.stdout:2/664: creat df/fe2 x:0 0 0 2024-09-13T22:08:45.185 INFO:tasks.workunit.client.0.smithi089.stdout:1/719: dread d7/d34/d5c/d5d/f62 [0,4194304] 0 2024-09-13T22:08:45.188 INFO:tasks.workunit.client.0.smithi089.stdout:9/735: creat d6/d54/ff6 x:0 0 0 2024-09-13T22:08:45.188 INFO:tasks.workunit.client.0.smithi089.stdout:0/911: link d1/de/d10/cae d1/de/d15/d41/d49/d76/d11d/d130/c139 0 2024-09-13T22:08:45.188 INFO:tasks.workunit.client.0.smithi089.stdout:0/912: readlink d1/de/d10/d36/d38/d4e/d62/d5f/la8 0 2024-09-13T22:08:45.190 INFO:tasks.workunit.client.0.smithi089.stdout:0/913: write d1/de/d10/d36/d38/f70 [160937,101615] 0 2024-09-13T22:08:45.190 INFO:tasks.workunit.client.0.smithi089.stdout:0/914: write d1/de/d15/f89 [773484,76700] 0 2024-09-13T22:08:45.190 INFO:tasks.workunit.client.0.smithi089.stdout:5/610: creat d4/d19/d1e/d89/fd8 x:0 0 0 2024-09-13T22:08:45.190 INFO:tasks.workunit.client.0.smithi089.stdout:5/611: write d4/d19/d1e/d28/d3d/f5d [1921181,116647] 0 2024-09-13T22:08:45.200 INFO:tasks.workunit.client.0.smithi089.stdout:0/915: mknod d1/de/d15/d41/d87/dbf/c13a 0 2024-09-13T22:08:45.202 INFO:tasks.workunit.client.0.smithi089.stdout:5/612: creat d4/d19/d1e/d28/d3d/dc9/fd9 x:0 0 0 2024-09-13T22:08:45.203 INFO:tasks.workunit.client.0.smithi089.stdout:5/613: creat d4/d19/d1e/d28/d31/d61/d69/fda x:0 0 0 2024-09-13T22:08:45.203 INFO:tasks.workunit.client.0.smithi089.stdout:5/614: readlink d4/d19/d1e/d28/d3d/l44 0 2024-09-13T22:08:45.203 INFO:tasks.workunit.client.0.smithi089.stdout:8/705: sync 2024-09-13T22:08:45.204 INFO:tasks.workunit.client.0.smithi089.stdout:0/916: write d1/de/d10/d36/d38/d4e/fe9 [3192729,7634] 0 2024-09-13T22:08:45.205 INFO:tasks.workunit.client.0.smithi089.stdout:5/615: symlink d4/d19/ldb 0 2024-09-13T22:08:45.206 INFO:tasks.workunit.client.0.smithi089.stdout:6/586: dwrite d0/d4/d12/f85 [4194304,4194304] 0 2024-09-13T22:08:45.206 INFO:tasks.workunit.client.0.smithi089.stdout:7/645: dwrite d0/d19/d45/d38/f3a [0,4194304] 0 2024-09-13T22:08:45.207 INFO:tasks.workunit.client.0.smithi089.stdout:0/917: truncate d1/de/d15/d41/d49/d76/d8b/fa3 2206786 0 2024-09-13T22:08:45.210 INFO:tasks.workunit.client.0.smithi089.stdout:7/646: creat d0/fd9 x:0 0 0 2024-09-13T22:08:45.212 INFO:tasks.workunit.client.0.smithi089.stdout:0/918: mknod d1/de/d10/db0/dd9/d10f/c13b 0 2024-09-13T22:08:45.214 INFO:tasks.workunit.client.0.smithi089.stdout:6/587: rmdir d0/d5/d1d/d2d/da0 39 2024-09-13T22:08:45.214 INFO:tasks.workunit.client.0.smithi089.stdout:6/588: fsync d0/d4/d12/d15/f93 0 2024-09-13T22:08:45.216 INFO:tasks.workunit.client.0.smithi089.stdout:4/741: dwrite d0/d15/f7d [0,4194304] 0 2024-09-13T22:08:45.219 INFO:tasks.workunit.client.0.smithi089.stdout:4/742: link d0/d2c/d35/f67 d0/d2c/d35/d5d/da4/fe8 0 2024-09-13T22:08:45.219 INFO:tasks.workunit.client.0.smithi089.stdout:4/743: chown d0/d2c/d52/da5/d9d/ddb/de2/c97 1 1 2024-09-13T22:08:45.220 INFO:tasks.workunit.client.0.smithi089.stdout:4/744: truncate d0/f13 2932610 0 2024-09-13T22:08:45.220 INFO:tasks.workunit.client.0.smithi089.stdout:4/745: chown d0/d15/d76/l98 3 1 2024-09-13T22:08:45.220 INFO:tasks.workunit.client.0.smithi089.stdout:0/919: dread d1/de/d10/fb4 [0,4194304] 0 2024-09-13T22:08:45.221 INFO:tasks.workunit.client.0.smithi089.stdout:4/746: unlink d0/d2c/l56 0 2024-09-13T22:08:45.222 INFO:tasks.workunit.client.0.smithi089.stdout:0/920: creat d1/de/d10/d135/f13c x:0 0 0 2024-09-13T22:08:45.223 INFO:tasks.workunit.client.0.smithi089.stdout:4/747: mknod d0/d11/d16/ce9 0 2024-09-13T22:08:45.224 INFO:tasks.workunit.client.0.smithi089.stdout:0/921: mknod d1/de/d10/c13d 0 2024-09-13T22:08:45.224 INFO:tasks.workunit.client.0.smithi089.stdout:0/922: stat d1/de/d1f/ddd/f12c 0 2024-09-13T22:08:45.224 INFO:tasks.workunit.client.0.smithi089.stdout:0/923: dread - d1/de/d10/d36/d38/d4e/d62/d5f/d72/fb3 zero size 2024-09-13T22:08:45.225 INFO:tasks.workunit.client.0.smithi089.stdout:5/616: write d4/d19/d1e/d28/d31/d55/d58/d84/f8f [2222817,47882] 0 2024-09-13T22:08:45.229 INFO:tasks.workunit.client.0.smithi089.stdout:0/924: unlink d1/l95 0 2024-09-13T22:08:45.229 INFO:tasks.workunit.client.0.smithi089.stdout:1/720: dwrite d7/de/d68/f90 [0,4194304] 0 2024-09-13T22:08:45.230 INFO:tasks.workunit.client.0.smithi089.stdout:6/589: write d0/d5/d1d/f82 [3483477,68266] 0 2024-09-13T22:08:45.233 INFO:tasks.workunit.client.0.smithi089.stdout:1/721: mknod d7/d40/dbe/cf3 0 2024-09-13T22:08:45.233 INFO:tasks.workunit.client.0.smithi089.stdout:1/722: stat d7/d40/dbe/d80/dbb/fc1 0 2024-09-13T22:08:45.234 INFO:tasks.workunit.client.0.smithi089.stdout:6/590: mkdir d0/d5/d43/daf 0 2024-09-13T22:08:45.234 INFO:tasks.workunit.client.0.smithi089.stdout:9/736: dwrite d6/d18/d21/d5d/d6c/d8d/fdf [0,4194304] 0 2024-09-13T22:08:45.237 INFO:tasks.workunit.client.0.smithi089.stdout:6/591: link d0/d5/d1d/d2d/cae d0/d5/d1d/d2d/d55/cb0 0 2024-09-13T22:08:45.237 INFO:tasks.workunit.client.0.smithi089.stdout:6/592: chown d0/d4/f24 67152405 1 2024-09-13T22:08:45.237 INFO:tasks.workunit.client.0.smithi089.stdout:6/593: chown d0/d5/d1d/d2d/d55/l63 6 1 2024-09-13T22:08:45.237 INFO:tasks.workunit.client.0.smithi089.stdout:6/594: write d0/d4/f5b [125709,124361] 0 2024-09-13T22:08:45.237 INFO:tasks.workunit.client.0.smithi089.stdout:6/595: write d0/d4/f6f [129761,4539] 0 2024-09-13T22:08:45.237 INFO:tasks.workunit.client.0.smithi089.stdout:6/596: chown d0/d5/d1d/d2d/l35 518 1 2024-09-13T22:08:45.237 INFO:tasks.workunit.client.0.smithi089.stdout:6/597: fdatasync d0/d5/d1d/d56/f34 0 2024-09-13T22:08:45.237 INFO:tasks.workunit.client.0.smithi089.stdout:7/647: dwrite d0/d19/fb0 [0,4194304] 0 2024-09-13T22:08:45.238 INFO:tasks.workunit.client.0.smithi089.stdout:1/723: dread d7/f19 [0,4194304] 0 2024-09-13T22:08:45.238 INFO:tasks.workunit.client.0.smithi089.stdout:1/724: chown d7/d40/dbe/d2b/d59 230014666 1 2024-09-13T22:08:45.239 INFO:tasks.workunit.client.0.smithi089.stdout:8/706: dwrite d0/dd/db0/d20/d40/d4a/f9e [0,4194304] 0 2024-09-13T22:08:45.239 INFO:tasks.workunit.client.0.smithi089.stdout:9/737: creat d6/d18/d1b/d89/db8/d52/ff7 x:0 0 0 2024-09-13T22:08:45.242 INFO:tasks.workunit.client.0.smithi089.stdout:7/648: dread d0/d19/d28/d1d/d3d/d9a/dcf/d41/f4d [0,4194304] 0 2024-09-13T22:08:45.242 INFO:tasks.workunit.client.0.smithi089.stdout:7/649: write d0/d19/d45/d38/f71 [984486,14514] 0 2024-09-13T22:08:45.242 INFO:tasks.workunit.client.0.smithi089.stdout:6/598: mkdir d0/d5/d43/daf/db1 0 2024-09-13T22:08:45.243 INFO:tasks.workunit.client.0.smithi089.stdout:6/599: readlink d0/d5/d1d/d2d/d55/l5c 0 2024-09-13T22:08:45.243 INFO:tasks.workunit.client.0.smithi089.stdout:6/600: creat d0/d4/d12/d15/fb2 x:0 0 0 2024-09-13T22:08:45.244 INFO:tasks.workunit.client.0.smithi089.stdout:8/707: truncate d0/dd/db0/d20/d40/d4a/fbc 3372255 0 2024-09-13T22:08:45.245 INFO:tasks.workunit.client.0.smithi089.stdout:7/650: symlink d0/d19/d28/d1d/d2d/d55/lda 0 2024-09-13T22:08:45.245 INFO:tasks.workunit.client.0.smithi089.stdout:7/651: creat d0/d19/d28/fdb x:0 0 0 2024-09-13T22:08:45.247 INFO:tasks.workunit.client.0.smithi089.stdout:4/748: dwrite d0/d2c/d52/fb2 [0,4194304] 0 2024-09-13T22:08:45.248 INFO:tasks.workunit.client.0.smithi089.stdout:5/617: dwrite d4/ff [0,4194304] 0 2024-09-13T22:08:45.250 INFO:tasks.workunit.client.0.smithi089.stdout:8/708: mknod d0/dd/db0/d42/cf4 0 2024-09-13T22:08:45.253 INFO:tasks.workunit.client.0.smithi089.stdout:7/652: mkdir d0/d19/d45/d92/ddc 0 2024-09-13T22:08:45.253 INFO:tasks.workunit.client.0.smithi089.stdout:7/653: chown d0/d19/d28/d1d/d3d/d9a/dcf/d41/fc2 123 1 2024-09-13T22:08:45.253 INFO:tasks.workunit.client.0.smithi089.stdout:7/654: write d0/f80 [6679631,99158] 0 2024-09-13T22:08:45.258 INFO:tasks.workunit.client.0.smithi089.stdout:4/749: symlink d0/d2c/d52/da5/d9d/ddb/de2/lea 0 2024-09-13T22:08:45.261 INFO:tasks.workunit.client.0.smithi089.stdout:4/750: write d0/d2c/f41 [1219905,81484] 0 2024-09-13T22:08:45.261 INFO:tasks.workunit.client.0.smithi089.stdout:6/601: rename d0/d5/d1d/d56 to d0/d4/d12/d15/db3 0 2024-09-13T22:08:45.261 INFO:tasks.workunit.client.0.smithi089.stdout:6/602: chown d0/d5/d1d/f82 68406448 1 2024-09-13T22:08:45.264 INFO:tasks.workunit.client.0.smithi089.stdout:8/709: dread d0/dd/db0/d3a/d83/fd0 [0,4194304] 0 2024-09-13T22:08:45.264 INFO:tasks.workunit.client.0.smithi089.stdout:8/710: stat d0/dd/db0/d20/d36/d59/d89/f2d 0 2024-09-13T22:08:45.264 INFO:tasks.workunit.client.0.smithi089.stdout:8/711: write d0/dd/db0/d20/d1c/d5a/d63/f66 [2999741,54881] 0 2024-09-13T22:08:45.264 INFO:tasks.workunit.client.0.smithi089.stdout:8/712: write d0/dd/db0/d20/d40/d4a/f7a [4668619,125871] 0 2024-09-13T22:08:45.265 INFO:tasks.workunit.client.0.smithi089.stdout:6/603: rmdir d0/d4/d12/d15/d9b 0 2024-09-13T22:08:45.267 INFO:tasks.workunit.client.0.smithi089.stdout:7/655: rmdir d0/d19/d28/d1d/d23 39 2024-09-13T22:08:45.268 INFO:tasks.workunit.client.0.smithi089.stdout:5/618: dwrite d4/d19/d1e/d28/d31/d61/d69/f92 [0,4194304] 0 2024-09-13T22:08:45.269 INFO:tasks.workunit.client.0.smithi089.stdout:5/619: write d4/d19/d1e/d28/f51 [5327031,126459] 0 2024-09-13T22:08:45.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/725: dwrite d7/f9 [0,4194304] 0 2024-09-13T22:08:45.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/726: getdents d7/de/da0/dbd/dde 0 2024-09-13T22:08:45.280 INFO:tasks.workunit.client.0.smithi089.stdout:8/713: creat d0/d6a/d73/ff5 x:0 0 0 2024-09-13T22:08:45.280 INFO:tasks.workunit.client.0.smithi089.stdout:8/714: truncate d0/dd/db0/d20/d40/f71 2321697 0 2024-09-13T22:08:45.280 INFO:tasks.workunit.client.0.smithi089.stdout:8/715: chown d0/dd/db0/d42/dc0/fc4 3406 1 2024-09-13T22:08:45.280 INFO:tasks.workunit.client.0.smithi089.stdout:8/716: creat d0/dd/db0/d20/d36/d80/ff6 x:0 0 0 2024-09-13T22:08:45.280 INFO:tasks.workunit.client.0.smithi089.stdout:8/717: truncate d0/dd/db0/d20/f18 4904243 0 2024-09-13T22:08:45.281 INFO:tasks.workunit.client.0.smithi089.stdout:6/604: mknod d0/d4/d12/d15/db3/d4a/cb4 0 2024-09-13T22:08:45.281 INFO:tasks.workunit.client.0.smithi089.stdout:6/605: chown d0/d5/d1d/d2d/da0 428 1 2024-09-13T22:08:45.281 INFO:tasks.workunit.client.0.smithi089.stdout:6/606: write d0/d4/d12/d15/f71 [2118332,49739] 0 2024-09-13T22:08:45.284 INFO:tasks.workunit.client.0.smithi089.stdout:5/620: mkdir d4/d19/d1e/d28/d31/dd1/ddc 0 2024-09-13T22:08:45.284 INFO:tasks.workunit.client.0.smithi089.stdout:5/621: chown d4/d19/d1e/d53/lb5 2 1 2024-09-13T22:08:45.286 INFO:tasks.workunit.client.0.smithi089.stdout:1/727: symlink d7/d1c/d7a/dad/lf4 0 2024-09-13T22:08:45.291 INFO:tasks.workunit.client.0.smithi089.stdout:8/718: mknod d0/dd/db0/d20/d36/d80/d3b/da5/dec/cf7 0 2024-09-13T22:08:45.291 INFO:tasks.workunit.client.0.smithi089.stdout:8/719: dread - d0/dd/db0/d20/d1c/d5a/fed zero size 2024-09-13T22:08:45.291 INFO:tasks.workunit.client.0.smithi089.stdout:8/720: write d0/dd/db0/d3a/f94 [881141,75156] 0 2024-09-13T22:08:45.291 INFO:tasks.workunit.client.0.smithi089.stdout:8/721: write d0/dd/db0/d20/d1c/d5a/fed [97920,54536] 0 2024-09-13T22:08:45.293 INFO:tasks.workunit.client.0.smithi089.stdout:6/607: creat d0/d5/d43/daf/db1/fb5 x:0 0 0 2024-09-13T22:08:45.294 INFO:tasks.workunit.client.0.smithi089.stdout:4/751: rmdir d0/d2c 39 2024-09-13T22:08:45.295 INFO:tasks.workunit.client.0.smithi089.stdout:5/622: symlink d4/d19/d1e/d28/d31/d94/ldd 0 2024-09-13T22:08:45.295 INFO:tasks.workunit.client.0.smithi089.stdout:5/623: chown d4/d19/d1e/d28/d31/dd1 358 1 2024-09-13T22:08:45.296 INFO:tasks.workunit.client.0.smithi089.stdout:7/656: dwrite d0/d19/d45/d38/d54/fc7 [0,4194304] 0 2024-09-13T22:08:45.296 INFO:tasks.workunit.client.0.smithi089.stdout:7/657: write d0/d19/d28/d1d/d3d/d9a/dcf/fc3 [334351,104104] 0 2024-09-13T22:08:45.296 INFO:tasks.workunit.client.0.smithi089.stdout:7/658: chown d0/d19/d28/d1d/d3d/f8e 0 1 2024-09-13T22:08:45.296 INFO:tasks.workunit.client.0.smithi089.stdout:0/925: dwrite d1/de/f17 [0,4194304] 0 2024-09-13T22:08:45.297 INFO:tasks.workunit.client.0.smithi089.stdout:6/608: mkdir d0/d5/d43/db6 0 2024-09-13T22:08:45.299 INFO:tasks.workunit.client.0.smithi089.stdout:4/752: creat d0/d2c/d52/da5/d9d/ddb/feb x:0 0 0 2024-09-13T22:08:45.299 INFO:tasks.workunit.client.0.smithi089.stdout:4/753: stat d0/d2c/d35/d64/fd7 0 2024-09-13T22:08:45.299 INFO:tasks.workunit.client.0.smithi089.stdout:4/754: fsync d0/d11/f21 0 2024-09-13T22:08:45.299 INFO:tasks.workunit.client.0.smithi089.stdout:8/722: write d0/dd/f46 [1842592,8380] 0 2024-09-13T22:08:45.301 INFO:tasks.workunit.client.0.smithi089.stdout:3/673: sync 2024-09-13T22:08:45.305 INFO:tasks.workunit.client.0.smithi089.stdout:0/926: symlink d1/de/d10/d36/d57/d129/l13e 0 2024-09-13T22:08:45.305 INFO:tasks.workunit.client.0.smithi089.stdout:6/609: mkdir d0/d5/d43/daf/db1/db7 0 2024-09-13T22:08:45.305 INFO:tasks.workunit.client.0.smithi089.stdout:5/624: dread d4/d19/f24 [0,4194304] 0 2024-09-13T22:08:45.306 INFO:tasks.workunit.client.0.smithi089.stdout:8/723: creat d0/dd/db0/d20/d36/da0/ff8 x:0 0 0 2024-09-13T22:08:45.306 INFO:tasks.workunit.client.0.smithi089.stdout:8/724: write d0/dd/db0/d20/d1c/f2f [3743059,36996] 0 2024-09-13T22:08:45.307 INFO:tasks.workunit.client.0.smithi089.stdout:0/927: mkdir d1/de/d10/d36/d57/d3a/db7/d10a/d13f 0 2024-09-13T22:08:45.308 INFO:tasks.workunit.client.0.smithi089.stdout:4/755: read d0/d2c/d8d/f9c [3701856,79936] 0 2024-09-13T22:08:45.308 INFO:tasks.workunit.client.0.smithi089.stdout:8/725: read d0/dd/db0/d20/d36/dd1/fd7 [159611,109073] 0 2024-09-13T22:08:45.309 INFO:tasks.workunit.client.0.smithi089.stdout:6/610: creat d0/d5/fb8 x:0 0 0 2024-09-13T22:08:45.310 INFO:tasks.workunit.client.0.smithi089.stdout:0/928: rename d1/de/d15/f24 to d1/de/d15/d41/d49/db5/f140 0 2024-09-13T22:08:45.312 INFO:tasks.workunit.client.0.smithi089.stdout:6/611: rmdir d0/d4/d12/d15/db3/d60 39 2024-09-13T22:08:45.312 INFO:tasks.workunit.client.0.smithi089.stdout:6/612: write d0/d5/d64/f72 [3928208,13638] 0 2024-09-13T22:08:45.313 INFO:tasks.workunit.client.0.smithi089.stdout:3/674: dread d1/d2/d96/dc3/f53 [0,4194304] 0 2024-09-13T22:08:45.315 INFO:tasks.workunit.client.0.smithi089.stdout:2/665: sync 2024-09-13T22:08:45.315 INFO:tasks.workunit.client.0.smithi089.stdout:0/929: mkdir d1/de/d1f/d141 0 2024-09-13T22:08:45.317 INFO:tasks.workunit.client.0.smithi089.stdout:3/675: symlink d1/d2/d4/d1c/d7e/d83/le3 0 2024-09-13T22:08:45.318 INFO:tasks.workunit.client.0.smithi089.stdout:2/666: rename df/d14/d2b/f7b to df/dd9/fe3 0 2024-09-13T22:08:45.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/930: mknod d1/de/d10/d36/d3d/de8/c142 0 2024-09-13T22:08:45.320 INFO:tasks.workunit.client.0.smithi089.stdout:8/726: dread d0/dd/db0/d20/d36/d80/d3b/d88/f96 [0,4194304] 0 2024-09-13T22:08:45.320 INFO:tasks.workunit.client.0.smithi089.stdout:8/727: readlink d0/dd/db0/d20/d36/l28 0 2024-09-13T22:08:45.320 INFO:tasks.workunit.client.0.smithi089.stdout:8/728: readlink d0/dd/db0/d20/d36/l28 0 2024-09-13T22:08:45.320 INFO:tasks.workunit.client.0.smithi089.stdout:8/729: chown d0/d6a/d73/dcb 6183 1 2024-09-13T22:08:45.322 INFO:tasks.workunit.client.0.smithi089.stdout:0/931: mkdir d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4/d115/d143 0 2024-09-13T22:08:45.322 INFO:tasks.workunit.client.0.smithi089.stdout:0/932: getdents d1/de/d10/d36/d57/d3a/db7/d10a/d13f 0 2024-09-13T22:08:45.323 INFO:tasks.workunit.client.0.smithi089.stdout:8/730: creat d0/dd/db0/d20/d36/d68/de6/ff9 x:0 0 0 2024-09-13T22:08:45.323 INFO:tasks.workunit.client.0.smithi089.stdout:8/731: write d0/dd/db0/d20/d36/da0/fe9 [5003564,54083] 0 2024-09-13T22:08:45.323 INFO:tasks.workunit.client.0.smithi089.stdout:3/676: mkdir d1/d2/de4 0 2024-09-13T22:08:45.324 INFO:tasks.workunit.client.0.smithi089.stdout:4/756: dread d0/d2c/d35/f67 [0,4194304] 0 2024-09-13T22:08:45.324 INFO:tasks.workunit.client.0.smithi089.stdout:0/933: symlink d1/de/d15/d41/l144 0 2024-09-13T22:08:45.324 INFO:tasks.workunit.client.0.smithi089.stdout:8/732: mkdir d0/dd/db0/d42/dc7/dfa 0 2024-09-13T22:08:45.325 INFO:tasks.workunit.client.0.smithi089.stdout:1/728: dwrite d7/d40/f79 [0,4194304] 0 2024-09-13T22:08:45.325 INFO:tasks.workunit.client.0.smithi089.stdout:3/677: creat d1/d2/d23/d3d/dd2/fe5 x:0 0 0 2024-09-13T22:08:45.326 INFO:tasks.workunit.client.0.smithi089.stdout:7/659: dwrite d0/d19/d28/d1d/d2d/d3c/fb7 [0,4194304] 0 2024-09-13T22:08:45.327 INFO:tasks.workunit.client.0.smithi089.stdout:2/667: write df/d14/d66/f99 [6565243,105607] 0 2024-09-13T22:08:45.327 INFO:tasks.workunit.client.0.smithi089.stdout:5/625: dwrite d4/d19/d1e/d89/dce/fa8 [0,4194304] 0 2024-09-13T22:08:45.327 INFO:tasks.workunit.client.0.smithi089.stdout:5/626: creat d4/d19/d1e/d28/d31/d61/d69/fde x:0 0 0 2024-09-13T22:08:45.328 INFO:tasks.workunit.client.0.smithi089.stdout:4/757: link d0/d2c/f5f d0/d2c/da0/fec 0 2024-09-13T22:08:45.328 INFO:tasks.workunit.client.0.smithi089.stdout:0/934: mkdir d1/de/d10/d36/d3d/d145 0 2024-09-13T22:08:45.329 INFO:tasks.workunit.client.0.smithi089.stdout:8/733: symlink d0/dd/db0/d20/d79/lfb 0 2024-09-13T22:08:45.329 INFO:tasks.workunit.client.0.smithi089.stdout:5/627: write d4/f9 [176957,114758] 0 2024-09-13T22:08:45.329 INFO:tasks.workunit.client.0.smithi089.stdout:5/628: truncate d4/f8 4868703 0 2024-09-13T22:08:45.330 INFO:tasks.workunit.client.0.smithi089.stdout:1/729: symlink d7/de/da0/dbd/dde/lf5 0 2024-09-13T22:08:45.330 INFO:tasks.workunit.client.0.smithi089.stdout:3/678: creat d1/d2/d23/d3d/dda/d1b/fe6 x:0 0 0 2024-09-13T22:08:45.332 INFO:tasks.workunit.client.0.smithi089.stdout:7/660: mknod d0/d19/d28/d1d/d3d/d9a/dcf/d41/cdd 0 2024-09-13T22:08:45.332 INFO:tasks.workunit.client.0.smithi089.stdout:7/661: readlink d0/le 0 2024-09-13T22:08:45.333 INFO:tasks.workunit.client.0.smithi089.stdout:8/734: write d0/dd/db0/d42/f5e [1976938,116431] 0 2024-09-13T22:08:45.337 INFO:tasks.workunit.client.0.smithi089.stdout:4/758: dread d0/fb9 [4194304,4194304] 0 2024-09-13T22:08:45.337 INFO:tasks.workunit.client.0.smithi089.stdout:4/759: write d0/d2c/d35/d64/f82 [1021347,34754] 0 2024-09-13T22:08:45.342 INFO:tasks.workunit.client.0.smithi089.stdout:3/679: rename d1/d2/d23/d3d/dda/d1b/fe6 to d1/d2/d23/d2b/fe7 0 2024-09-13T22:08:45.343 INFO:tasks.workunit.client.0.smithi089.stdout:5/629: dread d4/d19/d1e/d28/d31/f52 [0,4194304] 0 2024-09-13T22:08:45.344 INFO:tasks.workunit.client.0.smithi089.stdout:7/662: unlink d0/d19/d45/c66 0 2024-09-13T22:08:45.344 INFO:tasks.workunit.client.0.smithi089.stdout:2/668: dwrite df/d76/d85/db2/fb6 [0,4194304] 0 2024-09-13T22:08:45.346 INFO:tasks.workunit.client.0.smithi089.stdout:8/735: mknod d0/dd/db0/d20/d36/d80/d3b/da5/cfc 0 2024-09-13T22:08:45.348 INFO:tasks.workunit.client.0.smithi089.stdout:4/760: unlink d0/d2c/d35/d64/d6e/c8b 0 2024-09-13T22:08:45.348 INFO:tasks.workunit.client.0.smithi089.stdout:4/761: readlink d0/d11/d16/d89/lcb 0 2024-09-13T22:08:45.348 INFO:tasks.workunit.client.0.smithi089.stdout:4/762: stat d0/d2c/d52/da5/d62/d8c/fe7 0 2024-09-13T22:08:45.351 INFO:tasks.workunit.client.0.smithi089.stdout:3/680: dread d1/d2/d23/d3d/dda/d1b/f48 [0,4194304] 0 2024-09-13T22:08:45.351 INFO:tasks.workunit.client.0.smithi089.stdout:7/663: truncate d0/d19/d28/d1d/d23/d24/d5d/f5e 1567591 0 2024-09-13T22:08:45.352 INFO:tasks.workunit.client.0.smithi089.stdout:7/664: write d0/f7a [4789356,37242] 0 2024-09-13T22:08:45.352 INFO:tasks.workunit.client.0.smithi089.stdout:7/665: chown d0/d19/c67 133 1 2024-09-13T22:08:45.355 INFO:tasks.workunit.client.0.smithi089.stdout:4/763: read d0/fb9 [7037990,73882] 0 2024-09-13T22:08:45.355 INFO:tasks.workunit.client.0.smithi089.stdout:4/764: dread - d0/d2c/d52/da5/d9d/ddb/feb zero size 2024-09-13T22:08:45.358 INFO:tasks.workunit.client.0.smithi089.stdout:5/630: truncate d4/f5 1995325 0 2024-09-13T22:08:45.358 INFO:tasks.workunit.client.0.smithi089.stdout:5/631: read - d4/d19/d1e/d28/d3d/dc9/f66 zero size 2024-09-13T22:08:45.361 INFO:tasks.workunit.client.0.smithi089.stdout:3/681: creat d1/d2/d23/d3d/dda/d5c/fe8 x:0 0 0 2024-09-13T22:08:45.364 INFO:tasks.workunit.client.0.smithi089.stdout:7/666: write d0/d19/d28/d1d/d3d/d9a/dcf/d41/f65 [557405,101955] 0 2024-09-13T22:08:45.364 INFO:tasks.workunit.client.0.smithi089.stdout:1/730: dwrite d7/d34/d5c/f88 [0,4194304] 0 2024-09-13T22:08:45.365 INFO:tasks.workunit.client.0.smithi089.stdout:8/736: dwrite d0/dd/db0/d20/d36/f95 [0,4194304] 0 2024-09-13T22:08:45.370 INFO:tasks.workunit.client.0.smithi089.stdout:2/669: rmdir df/d14/d2b 39 2024-09-13T22:08:45.372 INFO:tasks.workunit.client.0.smithi089.stdout:5/632: link d4/d19/d1e/d28/l2c d4/d19/d1e/d28/d31/d55/ldf 0 2024-09-13T22:08:45.374 INFO:tasks.workunit.client.0.smithi089.stdout:7/667: mknod d0/d19/d45/d92/ddc/cde 0 2024-09-13T22:08:45.376 INFO:tasks.workunit.client.0.smithi089.stdout:8/737: link d0/dd/db0/d42/f5e d0/dd/db0/d20/d36/d68/de6/ffd 0 2024-09-13T22:08:45.378 INFO:tasks.workunit.client.0.smithi089.stdout:2/670: rename df/d14/d48/cad to df/d5b/da5/ce4 0 2024-09-13T22:08:45.378 INFO:tasks.workunit.client.0.smithi089.stdout:2/671: write df/d5b/f6f [4770872,52816] 0 2024-09-13T22:08:45.379 INFO:tasks.workunit.client.0.smithi089.stdout:7/668: link d0/le d0/d19/d28/d1d/d23/ldf 0 2024-09-13T22:08:45.379 INFO:tasks.workunit.client.0.smithi089.stdout:1/731: dread d7/de/da0/fb4 [0,4194304] 0 2024-09-13T22:08:45.379 INFO:tasks.workunit.client.0.smithi089.stdout:1/732: chown d7/fb 5113996 1 2024-09-13T22:08:45.380 INFO:tasks.workunit.client.0.smithi089.stdout:8/738: link d0/dd/db0/d20/d36/d59/d5d/c9c d0/dd/db0/d20/d36/d68/de6/cfe 0 2024-09-13T22:08:45.382 INFO:tasks.workunit.client.0.smithi089.stdout:8/739: mknod d0/dd/db0/d42/dc0/cff 0 2024-09-13T22:08:45.383 INFO:tasks.workunit.client.0.smithi089.stdout:1/733: mkdir d7/df6 0 2024-09-13T22:08:45.384 INFO:tasks.workunit.client.0.smithi089.stdout:5/633: read d4/d19/d1e/d28/d31/fa5 [823285,34457] 0 2024-09-13T22:08:45.385 INFO:tasks.workunit.client.0.smithi089.stdout:4/765: dwrite d0/d2c/d35/d64/f78 [0,4194304] 0 2024-09-13T22:08:45.388 INFO:tasks.workunit.client.0.smithi089.stdout:3/682: dwrite d1/d2/d4/f16 [4194304,4194304] 0 2024-09-13T22:08:45.388 INFO:tasks.workunit.client.0.smithi089.stdout:8/740: mkdir d0/dd/db0/d20/d36/d80/d3b/d88/d100 0 2024-09-13T22:08:45.389 INFO:tasks.workunit.client.0.smithi089.stdout:1/734: symlink d7/d40/dbe/de9/lf7 0 2024-09-13T22:08:45.389 INFO:tasks.workunit.client.0.smithi089.stdout:1/735: write d7/d40/f75 [1012319,65081] 0 2024-09-13T22:08:45.389 INFO:tasks.workunit.client.0.smithi089.stdout:5/634: dread d4/d19/d1e/d28/fb7 [0,4194304] 0 2024-09-13T22:08:45.390 INFO:tasks.workunit.client.0.smithi089.stdout:5/635: fsync d4/d19/d1e/d28/d31/d61/f6b 0 2024-09-13T22:08:45.390 INFO:tasks.workunit.client.0.smithi089.stdout:0/935: write d1/de/f46 [554891,82826] 0 2024-09-13T22:08:45.390 INFO:tasks.workunit.client.0.smithi089.stdout:4/766: creat d0/d2c/da1/fed x:0 0 0 2024-09-13T22:08:45.390 INFO:tasks.workunit.client.0.smithi089.stdout:4/767: chown d0/d2c/d52/da5/d62/d8c/d9e/fd6 24 1 2024-09-13T22:08:45.390 INFO:tasks.workunit.client.0.smithi089.stdout:3/683: link d1/d2/d4/d1c/d7e/d83/fbc d1/d2/d31/fe9 0 2024-09-13T22:08:45.392 INFO:tasks.workunit.client.0.smithi089.stdout:1/736: mknod d7/de/de7/cf8 0 2024-09-13T22:08:45.393 INFO:tasks.workunit.client.0.smithi089.stdout:4/768: getdents d0/d2c/d35 0 2024-09-13T22:08:45.395 INFO:tasks.workunit.client.0.smithi089.stdout:3/684: mknod d1/d2/d23/d3d/d54/d95/cea 0 2024-09-13T22:08:45.395 INFO:tasks.workunit.client.0.smithi089.stdout:3/685: write d1/d2/d23/fd5 [382595,64605] 0 2024-09-13T22:08:45.398 INFO:tasks.workunit.client.0.smithi089.stdout:4/769: rename d0/d2c/d52/da5/d62 to d0/d15/d1f/d75/dee 0 2024-09-13T22:08:45.398 INFO:tasks.workunit.client.0.smithi089.stdout:9/738: sync 2024-09-13T22:08:45.398 INFO:tasks.workunit.client.0.smithi089.stdout:9/739: chown d6/d18/l29 140174922 1 2024-09-13T22:08:45.400 INFO:tasks.workunit.client.0.smithi089.stdout:4/770: truncate d0/f1a 1207079 0 2024-09-13T22:08:45.421 INFO:tasks.workunit.client.0.smithi089.stdout:3/686: write d1/d2/d23/d3d/dda/d1b/f59 [1900807,88589] 0 2024-09-13T22:08:45.423 INFO:tasks.workunit.client.0.smithi089.stdout:3/687: rename d1/d2/d23/d3d/dda/d1b/d28 to d1/d2/d23/d3d/d54/d5d/deb 0 2024-09-13T22:08:45.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/740: dwrite f0 [4194304,4194304] 0 2024-09-13T22:08:45.445 INFO:tasks.workunit.client.0.smithi089.stdout:0/936: dwrite d1/de/d10/d85/f116 [0,4194304] 0 2024-09-13T22:08:45.445 INFO:tasks.workunit.client.0.smithi089.stdout:9/741: dread d6/d54/f98 [0,4194304] 0 2024-09-13T22:08:45.445 INFO:tasks.workunit.client.0.smithi089.stdout:9/742: truncate d6/d18/d21/d5d/d6c/ff5 172300 0 2024-09-13T22:08:45.445 INFO:tasks.workunit.client.0.smithi089.stdout:0/937: write d1/de/d1f/ddd/f12c [783256,122086] 0 2024-09-13T22:08:45.445 INFO:tasks.workunit.client.0.smithi089.stdout:0/938: rename d1 to d1/de/d15/d41/d49/d76/d11d/d146 22 2024-09-13T22:08:45.448 INFO:tasks.workunit.client.0.smithi089.stdout:1/737: dwrite d7/d40/dbe/d2b/d59/f67 [0,4194304] 0 2024-09-13T22:08:45.448 INFO:tasks.workunit.client.0.smithi089.stdout:8/741: dwrite d0/dd/db0/d20/d36/d80/d70/f7e [4194304,4194304] 0 2024-09-13T22:08:45.449 INFO:tasks.workunit.client.0.smithi089.stdout:3/688: dwrite d1/d2/d23/d3d/d54/d95/f9f [0,4194304] 0 2024-09-13T22:08:45.449 INFO:tasks.workunit.client.0.smithi089.stdout:8/742: fsync d0/dd/f35 0 2024-09-13T22:08:45.449 INFO:tasks.workunit.client.0.smithi089.stdout:3/689: dread - d1/d2/d23/d3d/dda/fb2 zero size 2024-09-13T22:08:45.449 INFO:tasks.workunit.client.0.smithi089.stdout:8/743: creat d0/dd/db0/d20/d1c/d5a/f101 x:0 0 0 2024-09-13T22:08:45.450 INFO:tasks.workunit.client.0.smithi089.stdout:3/690: write d1/d2/d4/d1c/d7e/f91 [54617,23057] 0 2024-09-13T22:08:45.450 INFO:tasks.workunit.client.0.smithi089.stdout:3/691: readlink d1/d2/d23/d3d/dda/l56 0 2024-09-13T22:08:45.450 INFO:tasks.workunit.client.0.smithi089.stdout:3/692: chown d1/d2/d23/d3d/d54/d5d/fa6 75388474 1 2024-09-13T22:08:45.450 INFO:tasks.workunit.client.0.smithi089.stdout:3/693: chown d1/d2/d23/d3d/dda/l56 1055923960 1 2024-09-13T22:08:45.450 INFO:tasks.workunit.client.0.smithi089.stdout:3/694: chown d1/d2/l99 254314 1 2024-09-13T22:08:45.450 INFO:tasks.workunit.client.0.smithi089.stdout:3/695: getdents d1/d2/d23/d3d/d54/d5d/dc1 0 2024-09-13T22:08:45.450 INFO:tasks.workunit.client.0.smithi089.stdout:9/743: mkdir d6/d18/d1b/d89/db8/dbe/df8 0 2024-09-13T22:08:45.450 INFO:tasks.workunit.client.0.smithi089.stdout:4/771: dwrite d0/d2c/f41 [0,4194304] 0 2024-09-13T22:08:45.450 INFO:tasks.workunit.client.0.smithi089.stdout:9/744: chown d6/d18/d1b/l20 0 1 2024-09-13T22:08:45.451 INFO:tasks.workunit.client.0.smithi089.stdout:4/772: fsync d0/d2c/d35/d5d/f60 0 2024-09-13T22:08:45.451 INFO:tasks.workunit.client.0.smithi089.stdout:9/745: write d6/d18/d21/f44 [4198324,75880] 0 2024-09-13T22:08:45.451 INFO:tasks.workunit.client.0.smithi089.stdout:0/939: dread d1/f1e [0,4194304] 0 2024-09-13T22:08:45.451 INFO:tasks.workunit.client.0.smithi089.stdout:0/940: read - d1/de/d10/d36/d38/d4e/fdf zero size 2024-09-13T22:08:45.455 INFO:tasks.workunit.client.0.smithi089.stdout:1/738: dread d7/d40/dbe/d2b/d39/fd7 [0,4194304] 0 2024-09-13T22:08:45.455 INFO:tasks.workunit.client.0.smithi089.stdout:1/739: fsync d7/d40/dbe/d2b/d59/fb7 0 2024-09-13T22:08:45.455 INFO:tasks.workunit.client.0.smithi089.stdout:1/740: stat d7/d40/dbe/l63 0 2024-09-13T22:08:45.458 INFO:tasks.workunit.client.0.smithi089.stdout:8/744: unlink d0/dd/db0/d20/d40/c65 0 2024-09-13T22:08:45.459 INFO:tasks.workunit.client.0.smithi089.stdout:3/696: symlink d1/d2/d23/d3d/d54/d5d/deb/d63/da4/lec 0 2024-09-13T22:08:45.459 INFO:tasks.workunit.client.0.smithi089.stdout:3/697: creat d1/d2/d23/fed x:0 0 0 2024-09-13T22:08:45.463 INFO:tasks.workunit.client.0.smithi089.stdout:4/773: symlink d0/d2c/d35/d74/lef 0 2024-09-13T22:08:45.465 INFO:tasks.workunit.client.0.smithi089.stdout:0/941: mkdir d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4/d115/d143/d147 0 2024-09-13T22:08:45.466 INFO:tasks.workunit.client.0.smithi089.stdout:1/741: mkdir d7/de/de7/df9 0 2024-09-13T22:08:45.466 INFO:tasks.workunit.client.0.smithi089.stdout:1/742: chown d7/f33 48670196 1 2024-09-13T22:08:45.466 INFO:tasks.workunit.client.0.smithi089.stdout:1/743: write d7/d34/fba [974152,29188] 0 2024-09-13T22:08:45.466 INFO:tasks.workunit.client.0.smithi089.stdout:1/744: chown d7/d34/f7e 98 1 2024-09-13T22:08:45.467 INFO:tasks.workunit.client.0.smithi089.stdout:1/745: getdents d7/d40/dbe/d80/dbb/de3 0 2024-09-13T22:08:45.467 INFO:tasks.workunit.client.0.smithi089.stdout:0/942: dread d1/de/d10/d36/d39/f94 [0,4194304] 0 2024-09-13T22:08:45.467 INFO:tasks.workunit.client.0.smithi089.stdout:0/943: chown d1/de/d10/f5d 948374089 1 2024-09-13T22:08:45.470 INFO:tasks.workunit.client.0.smithi089.stdout:3/698: mknod d1/d2/d23/d3d/d54/d5d/deb/cee 0 2024-09-13T22:08:45.470 INFO:tasks.workunit.client.0.smithi089.stdout:3/699: fdatasync d1/f6 0 2024-09-13T22:08:45.471 INFO:tasks.workunit.client.0.smithi089.stdout:4/774: mkdir d0/d2c/d52/df0 0 2024-09-13T22:08:45.473 INFO:tasks.workunit.client.0.smithi089.stdout:9/746: rmdir d6/d18/d21 39 2024-09-13T22:08:45.474 INFO:tasks.workunit.client.0.smithi089.stdout:1/746: truncate d7/de/da0/fb4 4128837 0 2024-09-13T22:08:45.476 INFO:tasks.workunit.client.0.smithi089.stdout:0/944: creat d1/de/d10/d36/d57/d3a/db7/d10a/f148 x:0 0 0 2024-09-13T22:08:45.477 INFO:tasks.workunit.client.0.smithi089.stdout:8/745: rmdir d0/d6a/d6f 39 2024-09-13T22:08:45.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/700: mknod d1/d2/d23/d3d/dda/d1b/cef 0 2024-09-13T22:08:45.480 INFO:tasks.workunit.client.0.smithi089.stdout:4/775: creat d0/d2c/d8d/ff1 x:0 0 0 2024-09-13T22:08:45.481 INFO:tasks.workunit.client.0.smithi089.stdout:9/747: mkdir d6/d18/dab/df9 0 2024-09-13T22:08:45.483 INFO:tasks.workunit.client.0.smithi089.stdout:0/945: unlink d1/de/d15/l69 0 2024-09-13T22:08:45.486 INFO:tasks.workunit.client.0.smithi089.stdout:8/746: unlink d0/dd/db0/d20/d36/d80/d3b/da5/dec/cf7 0 2024-09-13T22:08:45.488 INFO:tasks.workunit.client.0.smithi089.stdout:4/776: creat d0/d2c/d52/df0/ff2 x:0 0 0 2024-09-13T22:08:45.489 INFO:tasks.workunit.client.0.smithi089.stdout:6/613: sync 2024-09-13T22:08:45.489 INFO:tasks.workunit.client.0.smithi089.stdout:2/672: sync 2024-09-13T22:08:45.490 INFO:tasks.workunit.client.0.smithi089.stdout:0/946: mknod d1/de/d10/d36/d57/d3a/c149 0 2024-09-13T22:08:45.490 INFO:tasks.workunit.client.0.smithi089.stdout:2/673: creat df/d5b/fe5 x:0 0 0 2024-09-13T22:08:45.490 INFO:tasks.workunit.client.0.smithi089.stdout:0/947: truncate d1/de/d10/d36/d38/d4e/fad 1233280 0 2024-09-13T22:08:45.490 INFO:tasks.workunit.client.0.smithi089.stdout:8/747: rmdir d0/d6a/d73/dcb 0 2024-09-13T22:08:45.492 INFO:tasks.workunit.client.0.smithi089.stdout:6/614: rename d0/d5/d1d/d2d/f57 to d0/d4/d12/d15/fb9 0 2024-09-13T22:08:45.495 INFO:tasks.workunit.client.0.smithi089.stdout:2/674: mkdir df/d76/d85/db2/de6 0 2024-09-13T22:08:45.495 INFO:tasks.workunit.client.0.smithi089.stdout:2/675: readlink df/d14/d2b/l3e 0 2024-09-13T22:08:45.495 INFO:tasks.workunit.client.0.smithi089.stdout:2/676: write df/d14/d48/d88/f9a [1029690,101335] 0 2024-09-13T22:08:45.497 INFO:tasks.workunit.client.0.smithi089.stdout:0/948: unlink d1/de/d10/d36/d38/d4e/fc4 0 2024-09-13T22:08:45.497 INFO:tasks.workunit.client.0.smithi089.stdout:0/949: stat d1/de/d10/d36/d38/d4e/d62/d5f/l107 0 2024-09-13T22:08:45.498 INFO:tasks.workunit.client.0.smithi089.stdout:8/748: mknod d0/dd/db0/d20/d40/d4a/c102 0 2024-09-13T22:08:45.500 INFO:tasks.workunit.client.0.smithi089.stdout:0/950: rename d1/de/d10/db0 to d1/de/d1f/d124/d14a 0 2024-09-13T22:08:45.501 INFO:tasks.workunit.client.0.smithi089.stdout:8/749: symlink d0/dd/db0/d20/d36/d59/d89/d8d/l103 0 2024-09-13T22:08:45.504 INFO:tasks.workunit.client.0.smithi089.stdout:0/951: mkdir d1/de/d15/d14b 0 2024-09-13T22:08:45.506 INFO:tasks.workunit.client.0.smithi089.stdout:0/952: mkdir d1/de/d15/d41/d49/d14c 0 2024-09-13T22:08:45.506 INFO:tasks.workunit.client.0.smithi089.stdout:0/953: readlink d1/de/d15/d41/d49/db5/ld3 0 2024-09-13T22:08:45.507 INFO:tasks.workunit.client.0.smithi089.stdout:0/954: mknod d1/de/d15/d41/d87/d125/c14d 0 2024-09-13T22:08:45.507 INFO:tasks.workunit.client.0.smithi089.stdout:2/677: dread df/d5b/f6f [0,4194304] 0 2024-09-13T22:08:45.507 INFO:tasks.workunit.client.0.smithi089.stdout:0/955: write d1/de/d10/d36/d57/ff4 [463076,130502] 0 2024-09-13T22:08:45.508 INFO:tasks.workunit.client.0.smithi089.stdout:7/669: sync 2024-09-13T22:08:45.508 INFO:tasks.workunit.client.0.smithi089.stdout:5/636: sync 2024-09-13T22:08:45.508 INFO:tasks.workunit.client.0.smithi089.stdout:9/748: dwrite d6/d55/fd2 [0,4194304] 0 2024-09-13T22:08:45.509 INFO:tasks.workunit.client.0.smithi089.stdout:9/749: chown d6/d54/l74 970073 1 2024-09-13T22:08:45.509 INFO:tasks.workunit.client.0.smithi089.stdout:0/956: rename d1/cb9 to d1/de/d15/d41/d87/c14e 0 2024-09-13T22:08:45.510 INFO:tasks.workunit.client.0.smithi089.stdout:2/678: link df/d5b/da5/db8/dbf/fc0 df/d14/d48/d88/fe7 0 2024-09-13T22:08:45.513 INFO:tasks.workunit.client.0.smithi089.stdout:2/679: unlink df/d14/d2b/d4b/c6b 0 2024-09-13T22:08:45.514 INFO:tasks.workunit.client.0.smithi089.stdout:0/957: mknod d1/de/d1f/d124/d14a/dd9/d10f/c14f 0 2024-09-13T22:08:45.514 INFO:tasks.workunit.client.0.smithi089.stdout:0/958: truncate d1/de/d10/d85/f116 5157955 0 2024-09-13T22:08:45.516 INFO:tasks.workunit.client.0.smithi089.stdout:2/680: mkdir df/d76/de8 0 2024-09-13T22:08:45.520 INFO:tasks.workunit.client.0.smithi089.stdout:2/681: rename df/d14/d48/d88/f91 to df/d1a/ddf/fe9 0 2024-09-13T22:08:45.521 INFO:tasks.workunit.client.0.smithi089.stdout:8/750: dread d0/dd/db0/d20/d36/d59/d89/f25 [0,4194304] 0 2024-09-13T22:08:45.521 INFO:tasks.workunit.client.0.smithi089.stdout:4/777: dwrite d0/d15/d1f/d75/dee/d8c/fe7 [4194304,4194304] 0 2024-09-13T22:08:45.521 INFO:tasks.workunit.client.0.smithi089.stdout:8/751: chown d0/dd/db0/fa2 1 1 2024-09-13T22:08:45.521 INFO:tasks.workunit.client.0.smithi089.stdout:8/752: dread - d0/dd/db0/d20/d36/d80/d3b/fee zero size 2024-09-13T22:08:45.521 INFO:tasks.workunit.client.0.smithi089.stdout:8/753: stat d0/d6a/d73/ff5 0 2024-09-13T22:08:45.521 INFO:tasks.workunit.client.0.smithi089.stdout:8/754: fdatasync d0/dd/db0/d3a/d83/fb6 0 2024-09-13T22:08:45.522 INFO:tasks.workunit.client.0.smithi089.stdout:2/682: unlink df/d1a/d57/d68/f71 0 2024-09-13T22:08:45.524 INFO:tasks.workunit.client.0.smithi089.stdout:5/637: dread d4/d19/d1e/d28/d31/d61/f90 [0,4194304] 0 2024-09-13T22:08:45.524 INFO:tasks.workunit.client.0.smithi089.stdout:8/755: mknod d0/dd/db0/d20/d36/d68/de6/c104 0 2024-09-13T22:08:45.524 INFO:tasks.workunit.client.0.smithi089.stdout:8/756: truncate d0/dd/f81 3459367 0 2024-09-13T22:08:45.525 INFO:tasks.workunit.client.0.smithi089.stdout:8/757: rename d0/dd/db0 to d0/dd/db0/d20/d36/d80/d3b/de4/d105 22 2024-09-13T22:08:45.525 INFO:tasks.workunit.client.0.smithi089.stdout:7/670: dread d0/d19/d45/d38/f3a [0,4194304] 0 2024-09-13T22:08:45.525 INFO:tasks.workunit.client.0.smithi089.stdout:9/750: dwrite d6/d18/f1d [0,4194304] 0 2024-09-13T22:08:45.525 INFO:tasks.workunit.client.0.smithi089.stdout:4/778: getdents d0/d11/d16/d89 0 2024-09-13T22:08:45.529 INFO:tasks.workunit.client.0.smithi089.stdout:5/638: link d4/d19/d1e/d28/d31/d55/d58/d84/lc2 d4/d19/d1e/d89/dce/le0 0 2024-09-13T22:08:45.531 INFO:tasks.workunit.client.0.smithi089.stdout:8/758: creat d0/dd/db0/d20/d36/d80/d3b/d88/f106 x:0 0 0 2024-09-13T22:08:45.531 INFO:tasks.workunit.client.0.smithi089.stdout:8/759: creat d0/dd/db0/d42/dc0/f107 x:0 0 0 2024-09-13T22:08:45.531 INFO:tasks.workunit.client.0.smithi089.stdout:7/671: creat d0/d19/d28/dbc/fe0 x:0 0 0 2024-09-13T22:08:45.531 INFO:tasks.workunit.client.0.smithi089.stdout:6/615: write d0/f11 [1837748,35473] 0 2024-09-13T22:08:45.532 INFO:tasks.workunit.client.0.smithi089.stdout:6/616: write d0/d4/d12/f41 [4893759,49888] 0 2024-09-13T22:08:45.533 INFO:tasks.workunit.client.0.smithi089.stdout:9/751: rename d6/d18/d1b/d89/db8/d52/f4e to d6/d18/d21/de6/ffa 0 2024-09-13T22:08:45.534 INFO:tasks.workunit.client.0.smithi089.stdout:4/779: truncate d0/d2c/d52/da5/d8e/fab 2389644 0 2024-09-13T22:08:45.537 INFO:tasks.workunit.client.0.smithi089.stdout:8/760: symlink d0/dd/db0/d20/l108 0 2024-09-13T22:08:45.537 INFO:tasks.workunit.client.0.smithi089.stdout:8/761: stat d0/dd/db0/d20/d36/d80/d70 0 2024-09-13T22:08:45.540 INFO:tasks.workunit.client.0.smithi089.stdout:6/617: rename d0/d5/d1d/d54/l9f to d0/d5/d43/lba 0 2024-09-13T22:08:45.540 INFO:tasks.workunit.client.0.smithi089.stdout:9/752: dread d6/d18/d1b/d3e/dbd/fc0 [0,4194304] 0 2024-09-13T22:08:45.541 INFO:tasks.workunit.client.0.smithi089.stdout:9/753: chown d6/d54/lcf 498236383 1 2024-09-13T22:08:45.543 INFO:tasks.workunit.client.0.smithi089.stdout:4/780: rename d0/d15/d1f/d75/dee/fa3 to d0/d15/d1f/d75/dee/ff3 0 2024-09-13T22:08:45.543 INFO:tasks.workunit.client.0.smithi089.stdout:4/781: dread - d0/d2c/d35/d5d/da4/fb3 zero size 2024-09-13T22:08:45.543 INFO:tasks.workunit.client.0.smithi089.stdout:4/782: getdents d0/d2c/d35 0 2024-09-13T22:08:45.545 INFO:tasks.workunit.client.0.smithi089.stdout:4/783: write d0/d2c/d35/d5d/f69 [4456608,7757] 0 2024-09-13T22:08:45.545 INFO:tasks.workunit.client.0.smithi089.stdout:8/762: rename d0/dd/db0/d20/d36/d59/d89/dca/le3 to d0/dd/db0/d20/l109 0 2024-09-13T22:08:45.547 INFO:tasks.workunit.client.0.smithi089.stdout:6/618: unlink d0/d5/d1d/d2d/d55/cb0 0 2024-09-13T22:08:45.548 INFO:tasks.workunit.client.0.smithi089.stdout:9/754: creat d6/d31/d64/ffb x:0 0 0 2024-09-13T22:08:45.550 INFO:tasks.workunit.client.0.smithi089.stdout:4/784: truncate d0/d2c/d35/d5d/f8a 1059164 0 2024-09-13T22:08:45.551 INFO:tasks.workunit.client.0.smithi089.stdout:8/763: rename d0/dd/db0/d20/d36/d80/d3b/da5/fc3 to d0/dd/db0/d20/d36/d59/d89/dca/f10a 0 2024-09-13T22:08:45.551 INFO:tasks.workunit.client.0.smithi089.stdout:6/619: symlink d0/d5/d43/daf/db1/lbb 0 2024-09-13T22:08:45.552 INFO:tasks.workunit.client.0.smithi089.stdout:9/755: rmdir d6/d31/d5e 39 2024-09-13T22:08:45.552 INFO:tasks.workunit.client.0.smithi089.stdout:9/756: readlink d6/d31/d5e/db1/lef 0 2024-09-13T22:08:45.552 INFO:tasks.workunit.client.0.smithi089.stdout:9/757: creat d6/d31/d64/ffc x:0 0 0 2024-09-13T22:08:45.552 INFO:tasks.workunit.client.0.smithi089.stdout:9/758: creat d6/d18/d1b/d89/db8/dbe/ffd x:0 0 0 2024-09-13T22:08:45.553 INFO:tasks.workunit.client.0.smithi089.stdout:8/764: mknod d0/dd/db0/d20/d36/d59/d89/d8d/df2/c10b 0 2024-09-13T22:08:45.553 INFO:tasks.workunit.client.0.smithi089.stdout:8/765: chown d0/dd/db0/d20/d36/d80/ff6 1620 1 2024-09-13T22:08:45.553 INFO:tasks.workunit.client.0.smithi089.stdout:6/620: rename d0/d5/d43/f46 to d0/d4/d12/d15/db3/d4b/fbc 0 2024-09-13T22:08:45.553 INFO:tasks.workunit.client.0.smithi089.stdout:6/621: readlink d0/d5/d1d/d2d/d55/l5c 0 2024-09-13T22:08:45.556 INFO:tasks.workunit.client.0.smithi089.stdout:7/672: dwrite d0/d19/d28/d1d/d23/f35 [0,4194304] 0 2024-09-13T22:08:45.556 INFO:tasks.workunit.client.0.smithi089.stdout:8/766: unlink d0/dd/db0/d42/laf 0 2024-09-13T22:08:45.557 INFO:tasks.workunit.client.0.smithi089.stdout:6/622: mkdir d0/d5/dbd 0 2024-09-13T22:08:45.557 INFO:tasks.workunit.client.0.smithi089.stdout:0/959: dwrite d1/f55 [0,4194304] 0 2024-09-13T22:08:45.558 INFO:tasks.workunit.client.0.smithi089.stdout:0/960: chown d1/de/d10/d36/d38/d4e/d62/ccc 3077 1 2024-09-13T22:08:45.558 INFO:tasks.workunit.client.0.smithi089.stdout:5/639: dwrite d4/d19/d1e/fbf [0,4194304] 0 2024-09-13T22:08:45.558 INFO:tasks.workunit.client.0.smithi089.stdout:5/640: write d4/d19/d1e/d53/dae/fcd [584628,53297] 0 2024-09-13T22:08:45.558 INFO:tasks.workunit.client.0.smithi089.stdout:7/673: mkdir d0/d19/d28/d1d/d30/de1 0 2024-09-13T22:08:45.558 INFO:tasks.workunit.client.0.smithi089.stdout:6/623: creat d0/d4/d12/d15/db3/fbe x:0 0 0 2024-09-13T22:08:45.561 INFO:tasks.workunit.client.0.smithi089.stdout:0/961: rename d1/de/d10/d36/c4d to d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4/d115/d143/d147/c150 0 2024-09-13T22:08:45.565 INFO:tasks.workunit.client.0.smithi089.stdout:2/683: dwrite df/d14/d2b/f63 [4194304,4194304] 0 2024-09-13T22:08:45.565 INFO:tasks.workunit.client.0.smithi089.stdout:2/684: fsync df/d1a/f42 0 2024-09-13T22:08:45.565 INFO:tasks.workunit.client.0.smithi089.stdout:5/641: mknod d4/d19/d1e/d28/d31/ce1 0 2024-09-13T22:08:45.567 INFO:tasks.workunit.client.0.smithi089.stdout:9/759: read d6/d18/fac [3403490,28942] 0 2024-09-13T22:08:45.575 INFO:tasks.workunit.client.0.smithi089.stdout:7/674: dread d0/d19/f2b [0,4194304] 0 2024-09-13T22:08:45.576 INFO:tasks.workunit.client.0.smithi089.stdout:4/785: dwrite d0/d15/d76/f7f [0,4194304] 0 2024-09-13T22:08:45.577 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:45 smithi089 ceph-mon[27921]: pgmap v254: 65 pgs: 65 active+clean; 1.2 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 127 MiB/s rd, 164 MiB/s wr, 775 op/s 2024-09-13T22:08:45.579 INFO:tasks.workunit.client.0.smithi089.stdout:8/767: dwrite d0/dd/db0/d20/f2e [0,4194304] 0 2024-09-13T22:08:45.582 INFO:tasks.workunit.client.0.smithi089.stdout:2/685: creat df/d1a/ddf/fea x:0 0 0 2024-09-13T22:08:45.583 INFO:tasks.workunit.client.0.smithi089.stdout:2/686: dread - df/d1a/d57/fba zero size 2024-09-13T22:08:45.583 INFO:tasks.workunit.client.0.smithi089.stdout:2/687: chown df/d5b/da5/fb7 11516 1 2024-09-13T22:08:45.583 INFO:tasks.workunit.client.0.smithi089.stdout:2/688: fdatasync df/d5b/f86 0 2024-09-13T22:08:45.583 INFO:tasks.workunit.client.0.smithi089.stdout:2/689: creat df/d1a/ddf/feb x:0 0 0 2024-09-13T22:08:45.585 INFO:tasks.workunit.client.0.smithi089.stdout:6/624: rmdir d0/d5/d43/d79 39 2024-09-13T22:08:45.585 INFO:tasks.workunit.client.0.smithi089.stdout:4/786: dread d0/d15/d1f/d75/dee/d8c/fe7 [0,4194304] 0 2024-09-13T22:08:45.586 INFO:tasks.workunit.client.0.smithi089.stdout:7/675: mkdir d0/d19/d28/d1d/de2 0 2024-09-13T22:08:45.593 INFO:tasks.workunit.client.0.smithi089.stdout:0/962: dwrite d1/f1e [0,4194304] 0 2024-09-13T22:08:45.593 INFO:tasks.workunit.client.0.smithi089.stdout:6/625: mkdir d0/d4/d12/d15/db3/d28/dbf 0 2024-09-13T22:08:45.595 INFO:tasks.workunit.client.0.smithi089.stdout:7/676: symlink d0/d19/d28/dbc/le3 0 2024-09-13T22:08:45.595 INFO:tasks.workunit.client.0.smithi089.stdout:7/677: chown d0/d19/d28/dbc 155 1 2024-09-13T22:08:45.598 INFO:tasks.workunit.client.0.smithi089.stdout:6/626: link d0/d5/d1d/d54/f8f d0/d5/d43/daf/db1/db7/fc0 0 2024-09-13T22:08:45.603 INFO:tasks.workunit.client.0.smithi089.stdout:4/787: rmdir d0 39 2024-09-13T22:08:45.603 INFO:tasks.workunit.client.0.smithi089.stdout:4/788: fdatasync d0/d15/d1f/d75/dee/d8c/d9e/fd6 0 2024-09-13T22:08:45.605 INFO:tasks.workunit.client.0.smithi089.stdout:2/690: rename df/d14/d2b/d4b to df/d14/d48/d88/db9/dec 0 2024-09-13T22:08:45.605 INFO:tasks.workunit.client.0.smithi089.stdout:8/768: dwrite d0/dd/db0/fa2 [0,4194304] 0 2024-09-13T22:08:45.605 INFO:tasks.workunit.client.0.smithi089.stdout:8/769: chown d0/dd/db0/d20/d1c/f2f 22 1 2024-09-13T22:08:45.606 INFO:tasks.workunit.client.0.smithi089.stdout:9/760: dwrite d6/d18/dab/fc5 [0,4194304] 0 2024-09-13T22:08:45.606 INFO:tasks.workunit.client.0.smithi089.stdout:9/761: fdatasync d6/d18/d21/d5d/d6c/d8d/fc9 0 2024-09-13T22:08:45.606 INFO:tasks.workunit.client.0.smithi089.stdout:5/642: dwrite d4/d19/d1e/d28/f9b [0,4194304] 0 2024-09-13T22:08:45.606 INFO:tasks.workunit.client.0.smithi089.stdout:5/643: truncate d4/d19/f48 4197589 0 2024-09-13T22:08:45.606 INFO:tasks.workunit.client.0.smithi089.stdout:5/644: dread - d4/d19/d1e/d53/d88/fc8 zero size 2024-09-13T22:08:45.607 INFO:tasks.workunit.client.0.smithi089.stdout:0/963: rename d1/de/fe2 to d1/de/d10/d36/d38/d4e/d62/d5b/d5e/f151 0 2024-09-13T22:08:45.607 INFO:tasks.workunit.client.0.smithi089.stdout:0/964: dread - d1/de/d15/d41/d87/d125/f126 zero size 2024-09-13T22:08:45.608 INFO:tasks.workunit.client.0.smithi089.stdout:2/691: mknod df/d14/d48/d88/db9/ced 0 2024-09-13T22:08:45.610 INFO:tasks.workunit.client.0.smithi089.stdout:6/627: dread d0/d5/f27 [4194304,4194304] 0 2024-09-13T22:08:45.610 INFO:tasks.workunit.client.0.smithi089.stdout:6/628: creat d0/d4/d12/d15/fc1 x:0 0 0 2024-09-13T22:08:45.610 INFO:tasks.workunit.client.0.smithi089.stdout:6/629: chown d0/d4/d12/f78 36451526 1 2024-09-13T22:08:45.611 INFO:tasks.workunit.client.0.smithi089.stdout:9/762: symlink d6/d18/d21/d5d/lfe 0 2024-09-13T22:08:45.614 INFO:tasks.workunit.client.0.smithi089.stdout:0/965: link d1/de/d10/d36/d38/d4e/d62/d5f/lfd d1/de/d10/l152 0 2024-09-13T22:08:45.614 INFO:tasks.workunit.client.0.smithi089.stdout:0/966: stat d1/de/d10/d36/d38/d4e/d62/le1 0 2024-09-13T22:08:45.615 INFO:tasks.workunit.client.0.smithi089.stdout:1/747: sync 2024-09-13T22:08:45.615 INFO:tasks.workunit.client.0.smithi089.stdout:1/748: fsync d7/de/d68/f90 0 2024-09-13T22:08:45.617 INFO:tasks.workunit.client.0.smithi089.stdout:2/692: symlink df/d14/d2b/lee 0 2024-09-13T22:08:45.617 INFO:tasks.workunit.client.0.smithi089.stdout:2/693: write df/d5b/fc6 [724941,104229] 0 2024-09-13T22:08:45.617 INFO:tasks.workunit.client.0.smithi089.stdout:2/694: creat df/fef x:0 0 0 2024-09-13T22:08:45.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/630: truncate d0/d5/d1d/d2d/f39 1003170 0 2024-09-13T22:08:45.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/631: truncate d0/d4/d12/f91 805226 0 2024-09-13T22:08:45.619 INFO:tasks.workunit.client.0.smithi089.stdout:8/770: dread d0/dd/db0/d20/d36/d80/d70/f7e [0,4194304] 0 2024-09-13T22:08:45.619 INFO:tasks.workunit.client.0.smithi089.stdout:8/771: creat d0/dd/db0/d20/d40/d4a/d7f/f10c x:0 0 0 2024-09-13T22:08:45.619 INFO:tasks.workunit.client.0.smithi089.stdout:8/772: stat d0/dd/db0/d3a/d83 0 2024-09-13T22:08:45.620 INFO:tasks.workunit.client.0.smithi089.stdout:5/645: getdents d4/d19/d1e/d28/d31/d61/d69 0 2024-09-13T22:08:45.621 INFO:tasks.workunit.client.0.smithi089.stdout:3/701: sync 2024-09-13T22:08:45.622 INFO:tasks.workunit.client.0.smithi089.stdout:1/749: mknod d7/d34/d5c/d5d/cfa 0 2024-09-13T22:08:45.622 INFO:tasks.workunit.client.0.smithi089.stdout:1/750: fsync d7/de/d68/f6f 0 2024-09-13T22:08:45.623 INFO:tasks.workunit.client.0.smithi089.stdout:2/695: creat df/d5b/da5/dd7/ff0 x:0 0 0 2024-09-13T22:08:45.624 INFO:tasks.workunit.client.0.smithi089.stdout:8/773: mkdir d0/dd/db0/d42/dc7/d10d 0 2024-09-13T22:08:45.626 INFO:tasks.workunit.client.0.smithi089.stdout:5/646: rmdir d4/d19/d1e/d28/d31/d55/da4/dcf 0 2024-09-13T22:08:45.626 INFO:tasks.workunit.client.0.smithi089.stdout:1/751: stat d7/de/d3a/d77/c93 0 2024-09-13T22:08:45.628 INFO:tasks.workunit.client.0.smithi089.stdout:0/967: dread d1/de/d1f/ddd/f12c [0,4194304] 0 2024-09-13T22:08:45.629 INFO:tasks.workunit.client.0.smithi089.stdout:5/647: creat d4/d19/d1e/d28/d31/d61/fe2 x:0 0 0 2024-09-13T22:08:45.630 INFO:tasks.workunit.client.0.smithi089.stdout:7/678: dwrite d0/d19/d28/d1d/d30/f3b [0,4194304] 0 2024-09-13T22:08:45.630 INFO:tasks.workunit.client.0.smithi089.stdout:7/679: chown d0/ff 187346735 1 2024-09-13T22:08:45.630 INFO:tasks.workunit.client.0.smithi089.stdout:4/789: dwrite d0/d2c/da1/fd1 [0,4194304] 0 2024-09-13T22:08:45.631 INFO:tasks.workunit.client.0.smithi089.stdout:2/696: write df/f74 [1529204,7844] 0 2024-09-13T22:08:45.632 INFO:tasks.workunit.client.0.smithi089.stdout:2/697: chown df/d14/c31 1 1 2024-09-13T22:08:45.632 INFO:tasks.workunit.client.0.smithi089.stdout:2/698: readlink df/d14/d2b/d61/l40 0 2024-09-13T22:08:45.632 INFO:tasks.workunit.client.0.smithi089.stdout:2/699: chown df/d76/de8 203021 1 2024-09-13T22:08:45.632 INFO:tasks.workunit.client.0.smithi089.stdout:2/700: chown df/d1a/d57/f83 28418 1 2024-09-13T22:08:45.632 INFO:tasks.workunit.client.0.smithi089.stdout:0/968: link d1/de/d10/d85/f116 d1/de/d15/f153 0 2024-09-13T22:08:45.633 INFO:tasks.workunit.client.0.smithi089.stdout:6/632: write d0/d5/f23 [2497762,123859] 0 2024-09-13T22:08:45.633 INFO:tasks.workunit.client.0.smithi089.stdout:5/648: rename d4/d19/d1e/d28/d31/d61/d69/c72 to d4/d19/d1e/d28/d31/dd1/ce3 0 2024-09-13T22:08:45.640 INFO:tasks.workunit.client.0.smithi089.stdout:7/680: link d0/d19/d28/d1d/d3d/d9a/dcf/d41/f65 d0/d19/d28/fe4 0 2024-09-13T22:08:45.641 INFO:tasks.workunit.client.0.smithi089.stdout:8/774: read d0/dd/db0/d20/f18 [301295,68835] 0 2024-09-13T22:08:45.641 INFO:tasks.workunit.client.0.smithi089.stdout:7/681: creat d0/d19/d45/d38/d54/fe5 x:0 0 0 2024-09-13T22:08:45.642 INFO:tasks.workunit.client.0.smithi089.stdout:4/790: mknod d0/d2c/d52/da5/d9d/ddb/de2/dcd/cf4 0 2024-09-13T22:08:45.642 INFO:tasks.workunit.client.0.smithi089.stdout:4/791: fsync d0/d2c/d35/f4c 0 2024-09-13T22:08:45.644 INFO:tasks.workunit.client.0.smithi089.stdout:3/702: dwrite d1/d2/d23/d3d/dda/fb2 [0,4194304] 0 2024-09-13T22:08:45.644 INFO:tasks.workunit.client.0.smithi089.stdout:3/703: creat d1/d2/d23/d3d/dda/d5c/ff0 x:0 0 0 2024-09-13T22:08:45.644 INFO:tasks.workunit.client.0.smithi089.stdout:3/704: chown d1/d2/d31/c8e 196892695 1 2024-09-13T22:08:45.645 INFO:tasks.workunit.client.0.smithi089.stdout:3/705: read d1/d2/d23/d3d/dda/d1b/f48 [2474853,103263] 0 2024-09-13T22:08:45.645 INFO:tasks.workunit.client.0.smithi089.stdout:3/706: dread - d1/d2/d23/d3d/d54/d5d/deb/fcf zero size 2024-09-13T22:08:45.646 INFO:tasks.workunit.client.0.smithi089.stdout:2/701: symlink df/d14/d48/d88/db9/dec/lf1 0 2024-09-13T22:08:45.646 INFO:tasks.workunit.client.0.smithi089.stdout:2/702: stat df/d1a/ddf/fe9 0 2024-09-13T22:08:45.647 INFO:tasks.workunit.client.0.smithi089.stdout:0/969: unlink d1/de/d10/d36/d57/ff4 0 2024-09-13T22:08:45.647 INFO:tasks.workunit.client.0.smithi089.stdout:0/970: chown d1/de/fe7 781 1 2024-09-13T22:08:45.649 INFO:tasks.workunit.client.0.smithi089.stdout:8/775: symlink d0/dd/db0/d20/d36/d80/d3b/da5/dec/l10e 0 2024-09-13T22:08:45.650 INFO:tasks.workunit.client.0.smithi089.stdout:7/682: link d0/d19/d28/fe4 d0/d19/d28/d1d/d23/d24/d5d/fe6 0 2024-09-13T22:08:45.650 INFO:tasks.workunit.client.0.smithi089.stdout:7/683: fdatasync d0/d19/d28/d1d/d23/d24/f8d 0 2024-09-13T22:08:45.650 INFO:tasks.workunit.client.0.smithi089.stdout:5/649: dread d4/d19/d1e/d28/d3d/f57 [0,4194304] 0 2024-09-13T22:08:45.655 INFO:tasks.workunit.client.0.smithi089.stdout:4/792: rename d0/d2c/d35/d74/caa to d0/d2c/d52/da5/d8e/cf5 0 2024-09-13T22:08:45.659 INFO:tasks.workunit.client.0.smithi089.stdout:0/971: dread d1/de/d1f/d124/d14a/f102 [0,4194304] 0 2024-09-13T22:08:45.659 INFO:tasks.workunit.client.0.smithi089.stdout:0/972: creat d1/de/d15/d41/d49/f154 x:0 0 0 2024-09-13T22:08:45.659 INFO:tasks.workunit.client.0.smithi089.stdout:2/703: creat df/d76/d85/ff2 x:0 0 0 2024-09-13T22:08:45.660 INFO:tasks.workunit.client.0.smithi089.stdout:2/704: chown df/d14/d48/d88/db9/dec/l67 12852 1 2024-09-13T22:08:45.661 INFO:tasks.workunit.client.0.smithi089.stdout:6/633: dwrite d0/d4/d12/d15/f93 [0,4194304] 0 2024-09-13T22:08:45.661 INFO:tasks.workunit.client.0.smithi089.stdout:1/752: dwrite d7/d40/dbe/d2b/d59/f85 [0,4194304] 0 2024-09-13T22:08:45.661 INFO:tasks.workunit.client.0.smithi089.stdout:6/634: chown d0/d4/d12/f4c 25 1 2024-09-13T22:08:45.661 INFO:tasks.workunit.client.0.smithi089.stdout:1/753: chown d7/de/da0/fb4 1648769115 1 2024-09-13T22:08:45.661 INFO:tasks.workunit.client.0.smithi089.stdout:8/776: link d0/dd/db0/d20/d36/d80/d3b/d88/f106 d0/dd/db0/d20/d36/d80/d3b/da5/f10f 0 2024-09-13T22:08:45.663 INFO:tasks.workunit.client.0.smithi089.stdout:3/707: rename d1/d2/l99 to d1/d2/d4/d1c/d7e/d83/lf1 0 2024-09-13T22:08:45.664 INFO:tasks.workunit.client.0.smithi089.stdout:4/793: creat d0/d2c/d52/da5/d9d/ddb/de2/dcd/ff6 x:0 0 0 2024-09-13T22:08:45.665 INFO:tasks.workunit.client.0.smithi089.stdout:0/973: fdatasync d1/de/d1f/f84 0 2024-09-13T22:08:45.667 INFO:tasks.workunit.client.0.smithi089.stdout:6/635: truncate d0/d5/d1d/d2d/f66 2556775 0 2024-09-13T22:08:45.669 INFO:tasks.workunit.client.0.smithi089.stdout:6/636: dread d0/d4/f5e [0,4194304] 0 2024-09-13T22:08:45.674 INFO:tasks.workunit.client.0.smithi089.stdout:5/650: rmdir d4/d19/d1e/d28 39 2024-09-13T22:08:45.675 INFO:tasks.workunit.client.0.smithi089.stdout:3/708: mkdir d1/d2/d23/d3d/d46/dab/df2 0 2024-09-13T22:08:45.676 INFO:tasks.workunit.client.0.smithi089.stdout:4/794: creat d0/d2c/d35/ff7 x:0 0 0 2024-09-13T22:08:45.677 INFO:tasks.workunit.client.0.smithi089.stdout:4/795: fsync d0/d2c/fb7 0 2024-09-13T22:08:45.677 INFO:tasks.workunit.client.0.smithi089.stdout:4/796: read d0/d2c/d35/f87 [66226,50380] 0 2024-09-13T22:08:45.678 INFO:tasks.workunit.client.0.smithi089.stdout:0/974: truncate d1/de/d10/d36/d3d/faf 909978 0 2024-09-13T22:08:45.680 INFO:tasks.workunit.client.0.smithi089.stdout:0/975: symlink d1/de/d10/d36/d57/d3a/l155 0 2024-09-13T22:08:45.683 INFO:tasks.workunit.client.0.smithi089.stdout:7/684: rename d0/d19/d28/d1d/d2d/d3c to d0/d19/d45/de7 0 2024-09-13T22:08:45.683 INFO:tasks.workunit.client.0.smithi089.stdout:7/685: creat d0/d19/d28/d61/fe8 x:0 0 0 2024-09-13T22:08:45.683 INFO:tasks.workunit.client.0.smithi089.stdout:7/686: creat d0/d19/d45/d38/d54/fe9 x:0 0 0 2024-09-13T22:08:45.683 INFO:tasks.workunit.client.0.smithi089.stdout:7/687: dread - d0/d19/d28/dbc/fe0 zero size 2024-09-13T22:08:45.683 INFO:tasks.workunit.client.0.smithi089.stdout:7/688: creat d0/d19/d28/d7b/fea x:0 0 0 2024-09-13T22:08:45.683 INFO:tasks.workunit.client.0.smithi089.stdout:5/651: dread d4/d19/f48 [0,4194304] 0 2024-09-13T22:08:45.684 INFO:tasks.workunit.client.0.smithi089.stdout:2/705: rename df/d14/d66/d69/d2e/l5d to df/d76/d85/lf3 0 2024-09-13T22:08:45.688 INFO:tasks.workunit.client.0.smithi089.stdout:7/689: symlink d0/d19/d28/d61/leb 0 2024-09-13T22:08:45.688 INFO:tasks.workunit.client.0.smithi089.stdout:7/690: write d0/fd9 [175889,111745] 0 2024-09-13T22:08:45.688 INFO:tasks.workunit.client.0.smithi089.stdout:7/691: write d0/d19/d28/d1d/d3d/d9a/dcf/d41/f7e [943922,87785] 0 2024-09-13T22:08:45.688 INFO:tasks.workunit.client.0.smithi089.stdout:4/797: dread d0/d2c/d35/d74/f7e [0,4194304] 0 2024-09-13T22:08:45.689 INFO:tasks.workunit.client.0.smithi089.stdout:1/754: rename d7/d40/c96 to d7/d40/dbe/cfb 0 2024-09-13T22:08:45.690 INFO:tasks.workunit.client.0.smithi089.stdout:2/706: creat df/d14/d66/d8a/de1/ff4 x:0 0 0 2024-09-13T22:08:45.691 INFO:tasks.workunit.client.0.smithi089.stdout:6/637: dwrite d0/d4/f38 [4194304,4194304] 0 2024-09-13T22:08:45.691 INFO:tasks.workunit.client.0.smithi089.stdout:5/652: mkdir d4/d19/de4 0 2024-09-13T22:08:45.695 INFO:tasks.workunit.client.0.smithi089.stdout:3/709: rename d1/d2/d4/d1c/d7e/d83/fbc to d1/d2/d23/d2b/ff3 0 2024-09-13T22:08:45.698 INFO:tasks.workunit.client.0.smithi089.stdout:1/755: mknod d7/d1c/d3c/cfc 0 2024-09-13T22:08:45.698 INFO:tasks.workunit.client.0.smithi089.stdout:2/707: creat df/d76/d93/ff5 x:0 0 0 2024-09-13T22:08:45.698 INFO:tasks.workunit.client.0.smithi089.stdout:2/708: fsync df/d14/d66/f99 0 2024-09-13T22:08:45.699 INFO:tasks.workunit.client.0.smithi089.stdout:6/638: symlink d0/d4/d12/d15/lc2 0 2024-09-13T22:08:45.700 INFO:tasks.workunit.client.0.smithi089.stdout:5/653: creat d4/d19/d1e/d89/dce/fe5 x:0 0 0 2024-09-13T22:08:45.703 INFO:tasks.workunit.client.0.smithi089.stdout:3/710: creat d1/d2/d4/d1c/d7e/d83/ff4 x:0 0 0 2024-09-13T22:08:45.704 INFO:tasks.workunit.client.0.smithi089.stdout:1/756: rmdir d7/de/da0/dbd/dde 39 2024-09-13T22:08:45.704 INFO:tasks.workunit.client.0.smithi089.stdout:1/757: truncate d7/d40/dbe/d2b/d39/d73/da9/fab 84867 0 2024-09-13T22:08:45.704 INFO:tasks.workunit.client.0.smithi089.stdout:2/709: rmdir df/d14/d48/d88 39 2024-09-13T22:08:45.704 INFO:tasks.workunit.client.0.smithi089.stdout:2/710: dread - df/d1a/d57/fcd zero size 2024-09-13T22:08:45.704 INFO:tasks.workunit.client.0.smithi089.stdout:4/798: dread d0/d15/f7d [0,4194304] 0 2024-09-13T22:08:45.705 INFO:tasks.workunit.client.0.smithi089.stdout:4/799: write d0/d2c/d52/da5/f61 [264517,116740] 0 2024-09-13T22:08:45.705 INFO:tasks.workunit.client.0.smithi089.stdout:5/654: mkdir d4/d19/d1e/d28/d3d/dba/de6 0 2024-09-13T22:08:45.705 INFO:tasks.workunit.client.0.smithi089.stdout:1/758: unlink d7/f43 0 2024-09-13T22:08:45.706 INFO:tasks.workunit.client.0.smithi089.stdout:2/711: mknod df/d14/d66/d69/d2e/cf6 0 2024-09-13T22:08:45.707 INFO:tasks.workunit.client.0.smithi089.stdout:6/639: getdents d0/d5/d1d/d54 0 2024-09-13T22:08:45.708 INFO:tasks.workunit.client.0.smithi089.stdout:4/800: mkdir d0/d2c/d52/da5/d9d/ddf/df8 0 2024-09-13T22:08:45.709 INFO:tasks.workunit.client.0.smithi089.stdout:5/655: creat d4/d19/d1e/d28/d31/d55/d58/d84/fe7 x:0 0 0 2024-09-13T22:08:45.710 INFO:tasks.workunit.client.0.smithi089.stdout:0/976: rename d1/de/d10/d36/d39 to d1/de/d10/d85/d156 0 2024-09-13T22:08:45.710 INFO:tasks.workunit.client.0.smithi089.stdout:7/692: dwrite d0/d19/d28/d1d/d30/f3b [0,4194304] 0 2024-09-13T22:08:45.711 INFO:tasks.workunit.client.0.smithi089.stdout:2/712: creat df/d14/d48/d88/db9/dec/ff7 x:0 0 0 2024-09-13T22:08:45.711 INFO:tasks.workunit.client.0.smithi089.stdout:3/711: dread d1/f6 [0,4194304] 0 2024-09-13T22:08:45.712 INFO:tasks.workunit.client.0.smithi089.stdout:6/640: creat d0/d4/fc3 x:0 0 0 2024-09-13T22:08:45.717 INFO:tasks.workunit.client.0.smithi089.stdout:0/977: creat d1/de/d10/d36/d38/d4e/d62/d5f/d72/df0/f157 x:0 0 0 2024-09-13T22:08:45.720 INFO:tasks.workunit.client.0.smithi089.stdout:2/713: link df/d14/d48/d88/ca9 df/d14/d66/d69/d2e/dca/cf8 0 2024-09-13T22:08:45.720 INFO:tasks.workunit.client.0.smithi089.stdout:2/714: dread - df/d14/d2b/d61/f96 zero size 2024-09-13T22:08:45.721 INFO:tasks.workunit.client.0.smithi089.stdout:2/715: write df/d14/fcb [4462895,55655] 0 2024-09-13T22:08:45.721 INFO:tasks.workunit.client.0.smithi089.stdout:6/641: write d0/d5/d43/f53 [3951085,80971] 0 2024-09-13T22:08:45.721 INFO:tasks.workunit.client.0.smithi089.stdout:3/712: creat d1/d2/d23/d3d/d46/ff5 x:0 0 0 2024-09-13T22:08:45.723 INFO:tasks.workunit.client.0.smithi089.stdout:5/656: rename d4/c2e to d4/d19/d1e/d28/d31/d55/d58/d84/ce8 0 2024-09-13T22:08:45.723 INFO:tasks.workunit.client.0.smithi089.stdout:4/801: dread d0/f23 [4194304,4194304] 0 2024-09-13T22:08:45.724 INFO:tasks.workunit.client.0.smithi089.stdout:4/802: fdatasync d0/d2c/da0/fec 0 2024-09-13T22:08:45.724 INFO:tasks.workunit.client.0.smithi089.stdout:0/978: creat d1/de/d10/d36/d38/d4e/d62/d5b/d111/f158 x:0 0 0 2024-09-13T22:08:45.727 INFO:tasks.workunit.client.0.smithi089.stdout:2/716: creat df/d14/d66/ff9 x:0 0 0 2024-09-13T22:08:45.727 INFO:tasks.workunit.client.0.smithi089.stdout:2/717: write df/d14/d66/d69/fe0 [645040,80885] 0 2024-09-13T22:08:45.727 INFO:tasks.workunit.client.0.smithi089.stdout:2/718: write df/d14/d2b/d61/fbe [610153,41499] 0 2024-09-13T22:08:45.728 INFO:tasks.workunit.client.0.smithi089.stdout:2/719: chown df/d76/d85/db2/fb6 17217472 1 2024-09-13T22:08:45.728 INFO:tasks.workunit.client.0.smithi089.stdout:2/720: readlink df/d14/d2b/l3e 0 2024-09-13T22:08:45.730 INFO:tasks.workunit.client.0.smithi089.stdout:6/642: unlink d0/d4/d12/f78 0 2024-09-13T22:08:45.730 INFO:tasks.workunit.client.0.smithi089.stdout:6/643: creat d0/d5/d43/daf/db1/fc4 x:0 0 0 2024-09-13T22:08:45.730 INFO:tasks.workunit.client.0.smithi089.stdout:3/713: symlink d1/d2/d31/lf6 0 2024-09-13T22:08:45.730 INFO:tasks.workunit.client.0.smithi089.stdout:7/693: dwrite d0/d19/d28/d1d/d23/d24/f42 [0,4194304] 0 2024-09-13T22:08:45.731 INFO:tasks.workunit.client.0.smithi089.stdout:7/694: creat d0/fec x:0 0 0 2024-09-13T22:08:45.731 INFO:tasks.workunit.client.0.smithi089.stdout:7/695: creat d0/d19/d28/d61/fed x:0 0 0 2024-09-13T22:08:45.731 INFO:tasks.workunit.client.0.smithi089.stdout:5/657: rename d4/d19/d1e/d28/fb7 to d4/d19/d1e/d28/d31/fe9 0 2024-09-13T22:08:45.732 INFO:tasks.workunit.client.0.smithi089.stdout:0/979: symlink d1/de/d10/d36/d3d/d145/l159 0 2024-09-13T22:08:45.734 INFO:tasks.workunit.client.0.smithi089.stdout:6/644: mknod d0/d4/d12/d15/db3/d60/d94/cc5 0 2024-09-13T22:08:45.735 INFO:tasks.workunit.client.0.smithi089.stdout:4/803: write d0/d2c/d8d/fbe [3806640,544] 0 2024-09-13T22:08:45.735 INFO:tasks.workunit.client.0.smithi089.stdout:3/714: mkdir d1/d2/d23/df7 0 2024-09-13T22:08:45.736 INFO:tasks.workunit.client.0.smithi089.stdout:7/696: dread d0/d19/f2b [0,4194304] 0 2024-09-13T22:08:45.737 INFO:tasks.workunit.client.0.smithi089.stdout:5/658: mkdir d4/d19/d1e/d28/dea 0 2024-09-13T22:08:45.737 INFO:tasks.workunit.client.0.smithi089.stdout:0/980: symlink d1/de/d10/d85/dec/l15a 0 2024-09-13T22:08:45.739 INFO:tasks.workunit.client.0.smithi089.stdout:5/659: read d4/d19/d1e/d28/d31/f75 [381277,40750] 0 2024-09-13T22:08:45.739 INFO:tasks.workunit.client.0.smithi089.stdout:2/721: getdents df/d14 0 2024-09-13T22:08:45.739 INFO:tasks.workunit.client.0.smithi089.stdout:2/722: read - df/d14/d48/d88/fa2 zero size 2024-09-13T22:08:45.740 INFO:tasks.workunit.client.0.smithi089.stdout:5/660: write d4/d19/d1e/d89/dce/f4e [1346662,102016] 0 2024-09-13T22:08:45.740 INFO:tasks.workunit.client.0.smithi089.stdout:5/661: truncate d4/d19/d1e/d28/d31/d55/dcc/fd5 855142 0 2024-09-13T22:08:45.740 INFO:tasks.workunit.client.0.smithi089.stdout:5/662: write d4/d19/d1e/d28/d31/d55/f5a [13269392,13323] 0 2024-09-13T22:08:45.740 INFO:tasks.workunit.client.0.smithi089.stdout:5/663: fsync d4/d19/d1e/d28/d31/fa9 0 2024-09-13T22:08:45.741 INFO:tasks.workunit.client.0.smithi089.stdout:4/804: rename d0/d15/c53 to d0/d2c/d35/d64/cf9 0 2024-09-13T22:08:45.742 INFO:tasks.workunit.client.0.smithi089.stdout:6/645: creat d0/d5/d64/fc6 x:0 0 0 2024-09-13T22:08:45.742 INFO:tasks.workunit.client.0.smithi089.stdout:6/646: stat d0/d5/d1d/f82 0 2024-09-13T22:08:45.746 INFO:tasks.workunit.client.0.smithi089.stdout:7/697: mkdir d0/d19/d28/dee 0 2024-09-13T22:08:45.747 INFO:tasks.workunit.client.0.smithi089.stdout:0/981: creat d1/de/d10/d36/d3d/d145/f15b x:0 0 0 2024-09-13T22:08:45.749 INFO:tasks.workunit.client.0.smithi089.stdout:2/723: link df/d1a/d57/l64 df/d5b/da5/db8/lfa 0 2024-09-13T22:08:45.753 INFO:tasks.workunit.client.0.smithi089.stdout:3/715: rename d1/d2/d4/d1c/d7e/d40/cc7 to d1/d2/d4/d5a/cf8 0 2024-09-13T22:08:45.754 INFO:tasks.workunit.client.0.smithi089.stdout:6/647: symlink d0/d5/d1d/d2d/d55/lc7 0 2024-09-13T22:08:45.755 INFO:tasks.workunit.client.0.smithi089.stdout:0/982: creat d1/de/d10/d36/d38/d4e/d62/d5f/d72/da4/f15c x:0 0 0 2024-09-13T22:08:45.755 INFO:tasks.workunit.client.0.smithi089.stdout:0/983: fdatasync d1/f55 0 2024-09-13T22:08:45.756 INFO:tasks.workunit.client.0.smithi089.stdout:5/664: rmdir d4/d19/d1e/d89 39 2024-09-13T22:08:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:45 smithi159 ceph-mon[35348]: pgmap v254: 65 pgs: 65 active+clean; 1.2 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 127 MiB/s rd, 164 MiB/s wr, 775 op/s 2024-09-13T22:08:45.760 INFO:tasks.workunit.client.0.smithi089.stdout:3/716: creat d1/d2/de4/ff9 x:0 0 0 2024-09-13T22:08:45.760 INFO:tasks.workunit.client.0.smithi089.stdout:3/717: fsync d1/d2/d23/d3d/d54/d5d/deb/d63/f6d 0 2024-09-13T22:08:45.761 INFO:tasks.workunit.client.0.smithi089.stdout:6/648: fdatasync d0/f3e 0 2024-09-13T22:08:45.761 INFO:tasks.workunit.client.0.smithi089.stdout:6/649: dread - d0/d5/d43/daf/db1/fc4 zero size 2024-09-13T22:08:45.761 INFO:tasks.workunit.client.0.smithi089.stdout:6/650: fdatasync d0/d4/d12/f20 0 2024-09-13T22:08:45.761 INFO:tasks.workunit.client.0.smithi089.stdout:0/984: mkdir d1/de/d10/d36/d38/d4e/d62/d5b/d111/d15d 0 2024-09-13T22:08:45.762 INFO:tasks.workunit.client.0.smithi089.stdout:3/718: truncate d1/d2/d4/d1c/d7e/fc9 2263281 0 2024-09-13T22:08:45.763 INFO:tasks.workunit.client.0.smithi089.stdout:6/651: creat d0/d5/d43/daf/fc8 x:0 0 0 2024-09-13T22:08:45.763 INFO:tasks.workunit.client.0.smithi089.stdout:6/652: creat d0/d4/fc9 x:0 0 0 2024-09-13T22:08:45.764 INFO:tasks.workunit.client.0.smithi089.stdout:0/985: symlink d1/de/d10/d85/dbd/l15e 0 2024-09-13T22:08:45.764 INFO:tasks.workunit.client.0.smithi089.stdout:0/986: read - d1/de/d10/d36/d57/d3a/db7/f118 zero size 2024-09-13T22:08:45.764 INFO:tasks.workunit.client.0.smithi089.stdout:0/987: write d1/de/d10/d135/f13c [488091,57117] 0 2024-09-13T22:08:45.765 INFO:tasks.workunit.client.0.smithi089.stdout:7/698: rename d0/d19/d28/dbc to d0/d19/d45/d92/def 0 2024-09-13T22:08:45.766 INFO:tasks.workunit.client.0.smithi089.stdout:3/719: mkdir d1/d2/d4/d1c/d7e/d40/d69/da1/dfa 0 2024-09-13T22:08:45.767 INFO:tasks.workunit.client.0.smithi089.stdout:0/988: mknod d1/de/d10/d85/dbd/c15f 0 2024-09-13T22:08:45.768 INFO:tasks.workunit.client.0.smithi089.stdout:4/805: dwrite d0/d2c/d52/df0/ff2 [0,4194304] 0 2024-09-13T22:08:45.769 INFO:tasks.workunit.client.0.smithi089.stdout:6/653: rename d0/d4/d12/f20 to d0/d4/d12/d15/d3b/d62/da4/fca 0 2024-09-13T22:08:45.769 INFO:tasks.workunit.client.0.smithi089.stdout:6/654: read - d0/d4/d12/d15/f9c zero size 2024-09-13T22:08:45.769 INFO:tasks.workunit.client.0.smithi089.stdout:6/655: truncate d0/d5/d43/f9d 5097582 0 2024-09-13T22:08:45.769 INFO:tasks.workunit.client.0.smithi089.stdout:6/656: stat d0/d4/d12/f7b 0 2024-09-13T22:08:45.769 INFO:tasks.workunit.client.0.smithi089.stdout:6/657: chown d0/d4 17126 1 2024-09-13T22:08:45.770 INFO:tasks.workunit.client.0.smithi089.stdout:3/720: symlink d1/d2/d23/d3d/dda/lfb 0 2024-09-13T22:08:45.771 INFO:tasks.workunit.client.0.smithi089.stdout:2/724: dwrite df/d76/d85/ff2 [0,4194304] 0 2024-09-13T22:08:45.772 INFO:tasks.workunit.client.0.smithi089.stdout:4/806: getdents d0/d15/d1f/d75/dee 0 2024-09-13T22:08:45.772 INFO:tasks.workunit.client.0.smithi089.stdout:4/807: chown d0/f23 54 1 2024-09-13T22:08:45.774 INFO:tasks.workunit.client.0.smithi089.stdout:3/721: rmdir d1/d2/d96 39 2024-09-13T22:08:45.781 INFO:tasks.workunit.client.0.smithi089.stdout:4/808: rmdir d0/d2c/da0 39 2024-09-13T22:08:45.781 INFO:tasks.workunit.client.0.smithi089.stdout:4/809: fdatasync d0/d2c/d52/da5/d9d/ddb/de2/dcd/ff6 0 2024-09-13T22:08:45.781 INFO:tasks.workunit.client.0.smithi089.stdout:4/810: truncate d0/d2c/d35/d5d/fac 5173918 0 2024-09-13T22:08:45.782 INFO:tasks.workunit.client.0.smithi089.stdout:0/989: rename d1/de/d1f/fbb to d1/de/d10/d36/d38/d4e/d62/d5f/d72/df0/f160 0 2024-09-13T22:08:45.784 INFO:tasks.workunit.client.0.smithi089.stdout:6/658: mkdir d0/dcb 0 2024-09-13T22:08:45.784 INFO:tasks.workunit.client.0.smithi089.stdout:6/659: chown d0/d4/d12/f41 9860647 1 2024-09-13T22:08:45.784 INFO:tasks.workunit.client.0.smithi089.stdout:3/722: stat d1/d2/d23/d3d/dd2/ce1 0 2024-09-13T22:08:45.786 INFO:tasks.workunit.client.0.smithi089.stdout:0/990: symlink d1/de/d15/d41/d87/dbf/de0/l161 0 2024-09-13T22:08:45.787 INFO:tasks.workunit.client.0.smithi089.stdout:3/723: rmdir d1/d2/d4/d1c/d7e/d40/d69/da1/dfa 0 2024-09-13T22:08:45.789 INFO:tasks.workunit.client.0.smithi089.stdout:0/991: creat d1/de/d10/d85/dec/f162 x:0 0 0 2024-09-13T22:08:45.789 INFO:tasks.workunit.client.0.smithi089.stdout:0/992: write d1/f11 [1891967,62336] 0 2024-09-13T22:08:45.791 INFO:tasks.workunit.client.0.smithi089.stdout:3/724: dread d1/d2/d96/dc3/f74 [0,4194304] 0 2024-09-13T22:08:45.791 INFO:tasks.workunit.client.0.smithi089.stdout:3/725: fsync d1/d2/d23/fed 0 2024-09-13T22:08:45.791 INFO:tasks.workunit.client.0.smithi089.stdout:7/699: dwrite d0/f80 [4194304,4194304] 0 2024-09-13T22:08:45.792 INFO:tasks.workunit.client.0.smithi089.stdout:2/725: dwrite df/d14/fcb [0,4194304] 0 2024-09-13T22:08:45.793 INFO:tasks.workunit.client.0.smithi089.stdout:3/726: symlink d1/d2/de4/lfc 0 2024-09-13T22:08:45.793 INFO:tasks.workunit.client.0.smithi089.stdout:3/727: fdatasync d1/d3a/fcb 0 2024-09-13T22:08:45.793 INFO:tasks.workunit.client.0.smithi089.stdout:3/728: chown d1/d2/d23/d3d/c9b 13900047 1 2024-09-13T22:08:45.798 INFO:tasks.workunit.client.0.smithi089.stdout:2/726: getdents df/d5b/da5/db8 0 2024-09-13T22:08:45.798 INFO:tasks.workunit.client.0.smithi089.stdout:2/727: getdents df/d14/d2b/d61/dbd 0 2024-09-13T22:08:45.798 INFO:tasks.workunit.client.0.smithi089.stdout:2/728: rename df/d76/d85/db2/de6 to df/d5b/da5/dd7/dfb 0 2024-09-13T22:08:45.799 INFO:tasks.workunit.client.0.smithi089.stdout:2/729: rename df/d14/lbb to df/d5b/lfc 0 2024-09-13T22:08:45.799 INFO:tasks.workunit.client.0.smithi089.stdout:2/730: stat df/d14/d2b/d61/l54 0 2024-09-13T22:08:45.806 INFO:tasks.workunit.client.0.smithi089.stdout:3/729: read d1/d2/d23/f98 [1744514,24518] 0 2024-09-13T22:08:45.807 INFO:tasks.workunit.client.0.smithi089.stdout:3/730: creat d1/d2/d4/d5a/ffd x:0 0 0 2024-09-13T22:08:45.807 INFO:tasks.workunit.client.0.smithi089.stdout:3/731: creat d1/d2/d23/d3d/d54/d5d/ffe x:0 0 0 2024-09-13T22:08:45.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/732: symlink d1/d2/d23/d3d/dda/lff 0 2024-09-13T22:08:45.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/733: fdatasync d1/d2/d4/d1c/d7e/f91 0 2024-09-13T22:08:45.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/734: truncate d1/d2/fc5 472603 0 2024-09-13T22:08:45.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/735: mknod d1/d2/d23/d3d/d46/dab/df2/c100 0 2024-09-13T22:08:45.810 INFO:tasks.workunit.client.0.smithi089.stdout:3/736: fsync d1/d2/d96/dc3/f74 0 2024-09-13T22:08:45.810 INFO:tasks.workunit.client.0.smithi089.stdout:9/763: sync 2024-09-13T22:08:45.810 INFO:tasks.workunit.client.0.smithi089.stdout:7/700: dwrite d0/d19/d45/d38/f6a [0,4194304] 0 2024-09-13T22:08:45.810 INFO:tasks.workunit.client.0.smithi089.stdout:6/660: dwrite d0/d4/d12/d15/fc1 [0,4194304] 0 2024-09-13T22:08:45.811 INFO:tasks.workunit.client.0.smithi089.stdout:9/764: write d6/d31/d5e/f7d [886037,21454] 0 2024-09-13T22:08:45.811 INFO:tasks.workunit.client.0.smithi089.stdout:9/765: getdents d6/d18/d1b 0 2024-09-13T22:08:45.811 INFO:tasks.workunit.client.0.smithi089.stdout:7/701: unlink d0/f7a 0 2024-09-13T22:08:45.814 INFO:tasks.workunit.client.0.smithi089.stdout:6/661: symlink d0/d4/d12/d15/db3/d60/d94/lcc 0 2024-09-13T22:08:45.815 INFO:tasks.workunit.client.0.smithi089.stdout:6/662: truncate d0/d4/d12/f13 2383335 0 2024-09-13T22:08:45.827 INFO:tasks.workunit.client.0.smithi089.stdout:6/663: write d0/d4/d12/d15/fc1 [2802767,71133] 0 2024-09-13T22:08:45.841 INFO:tasks.workunit.client.0.smithi089.stdout:3/737: dwrite d1/d2/d23/d3d/d54/d5d/deb/d63/f79 [0,4194304] 0 2024-09-13T22:08:45.841 INFO:tasks.workunit.client.0.smithi089.stdout:6/664: dread d0/d5/d1d/d54/f7c [0,4194304] 0 2024-09-13T22:08:45.844 INFO:tasks.workunit.client.0.smithi089.stdout:3/738: rename d1/d2/d23/d3d/cd9 to d1/d2/d96/c101 0 2024-09-13T22:08:45.844 INFO:tasks.workunit.client.0.smithi089.stdout:9/766: dwrite d6/d18/d1b/d89/db8/d5a/f9b [0,4194304] 0 2024-09-13T22:08:45.844 INFO:tasks.workunit.client.0.smithi089.stdout:9/767: stat d6/d54/lcf 0 2024-09-13T22:08:45.844 INFO:tasks.workunit.client.0.smithi089.stdout:9/768: write d6/d18/d21/d5d/d6c/ff5 [491214,23263] 0 2024-09-13T22:08:45.844 INFO:tasks.workunit.client.0.smithi089.stdout:7/702: dwrite d0/d19/d28/d1d/d2d/f6d [4194304,4194304] 0 2024-09-13T22:08:45.844 INFO:tasks.workunit.client.0.smithi089.stdout:7/703: write d0/d19/d28/d1d/f64 [3339532,14151] 0 2024-09-13T22:08:45.845 INFO:tasks.workunit.client.0.smithi089.stdout:7/704: stat d0/d19/d28/d1d/d23/d24/f74 0 2024-09-13T22:08:45.845 INFO:tasks.workunit.client.0.smithi089.stdout:9/769: link d6/d18/d21/d5d/d6c/d8d/fed d6/d54/dcb/fff 0 2024-09-13T22:08:45.850 INFO:tasks.workunit.client.0.smithi089.stdout:7/705: rename d0/d19/d28/d1d/d3d/d9a/dcf/d41/f65 to d0/d19/d28/d1d/d23/d24/dac/db3/ff0 0 2024-09-13T22:08:45.851 INFO:tasks.workunit.client.0.smithi089.stdout:6/665: dread d0/d4/d12/d15/db3/f34 [0,4194304] 0 2024-09-13T22:08:45.851 INFO:tasks.workunit.client.0.smithi089.stdout:3/739: getdents d1/d2 0 2024-09-13T22:08:45.855 INFO:tasks.workunit.client.0.smithi089.stdout:3/740: unlink d1/d2/d4/d1c/d7e/d40/l5f 0 2024-09-13T22:08:45.856 INFO:tasks.workunit.client.0.smithi089.stdout:3/741: fsync d1/d2/d4/d1c/d7e/f91 0 2024-09-13T22:08:45.856 INFO:tasks.workunit.client.0.smithi089.stdout:3/742: dread d1/d2/d23/d3d/dda/f61 [0,4194304] 0 2024-09-13T22:08:45.859 INFO:tasks.workunit.client.0.smithi089.stdout:3/743: unlink d1/d2/d23/lba 0 2024-09-13T22:08:45.860 INFO:tasks.workunit.client.0.smithi089.stdout:3/744: truncate d1/d2/d23/d3d/d46/f67 702451 0 2024-09-13T22:08:45.868 INFO:tasks.workunit.client.0.smithi089.stdout:6/666: dwrite d0/f3e [0,4194304] 0 2024-09-13T22:08:45.869 INFO:tasks.workunit.client.0.smithi089.stdout:6/667: link d0/d4/d12/d15/f9c d0/d5/fcd 0 2024-09-13T22:08:45.871 INFO:tasks.workunit.client.0.smithi089.stdout:6/668: dread d0/d5/d1d/f33 [0,4194304] 0 2024-09-13T22:08:45.871 INFO:tasks.workunit.client.0.smithi089.stdout:6/669: fsync d0/d5/d43/f77 0 2024-09-13T22:08:45.872 INFO:tasks.workunit.client.0.smithi089.stdout:6/670: rmdir d0/d4/d12/d15/db3/d28 39 2024-09-13T22:08:45.872 INFO:tasks.workunit.client.0.smithi089.stdout:6/671: rmdir d0/d5/d1d 39 2024-09-13T22:08:45.873 INFO:tasks.workunit.client.0.smithi089.stdout:6/672: link d0/d5/d1d/d2d/cae d0/d4/d12/d15/cce 0 2024-09-13T22:08:45.873 INFO:tasks.workunit.client.0.smithi089.stdout:6/673: chown d0/d5/d64 3582801 1 2024-09-13T22:08:45.874 INFO:tasks.workunit.client.0.smithi089.stdout:6/674: creat d0/d4/d12/d15/d3b/d62/da4/fcf x:0 0 0 2024-09-13T22:08:45.874 INFO:tasks.workunit.client.0.smithi089.stdout:6/675: write d0/d4/d12/d15/db3/d4a/f90 [713286,123434] 0 2024-09-13T22:08:45.874 INFO:tasks.workunit.client.0.smithi089.stdout:6/676: truncate d0/d5/d1d/d54/f8f 628797 0 2024-09-13T22:08:45.875 INFO:tasks.workunit.client.0.smithi089.stdout:6/677: creat d0/d4/d12/d15/db3/d28/fd0 x:0 0 0 2024-09-13T22:08:45.875 INFO:tasks.workunit.client.0.smithi089.stdout:6/678: dread - d0/d5/d43/daf/fc8 zero size 2024-09-13T22:08:45.887 INFO:tasks.workunit.client.0.smithi089.stdout:6/679: dwrite d0/d4/f5b [0,4194304] 0 2024-09-13T22:08:45.888 INFO:tasks.workunit.client.0.smithi089.stdout:6/680: creat d0/d4/d12/d15/db3/fd1 x:0 0 0 2024-09-13T22:08:45.888 INFO:tasks.workunit.client.0.smithi089.stdout:6/681: truncate d0/d5/d1d/d2d/f39 1532229 0 2024-09-13T22:08:45.890 INFO:tasks.workunit.client.0.smithi089.stdout:6/682: rmdir d0/d5/dbd 0 2024-09-13T22:08:45.891 INFO:tasks.workunit.client.0.smithi089.stdout:6/683: dread d0/f48 [0,4194304] 0 2024-09-13T22:08:45.891 INFO:tasks.workunit.client.0.smithi089.stdout:6/684: fdatasync d0/d5/d43/f9d 0 2024-09-13T22:08:45.908 INFO:tasks.workunit.client.0.smithi089.stdout:8/777: sync 2024-09-13T22:08:45.908 INFO:tasks.workunit.client.0.smithi089.stdout:8/778: chown d0/dd/db0/d20/d36/d59/cad 234016 1 2024-09-13T22:08:45.910 INFO:tasks.workunit.client.0.smithi089.stdout:8/779: dread d0/dd/db0/d20/d36/d80/f41 [0,4194304] 0 2024-09-13T22:08:45.944 INFO:tasks.workunit.client.0.smithi089.stdout:1/759: sync 2024-09-13T22:08:45.945 INFO:tasks.workunit.client.0.smithi089.stdout:5/665: sync 2024-09-13T22:08:45.945 INFO:tasks.workunit.client.0.smithi089.stdout:5/666: link d4/d19/lb3 d4/d19/d1e/d28/d31/d55/d58/leb 0 2024-09-13T22:08:45.946 INFO:tasks.workunit.client.0.smithi089.stdout:5/667: fdatasync d4/d19/d1e/d89/dce/fe5 0 2024-09-13T22:08:45.946 INFO:tasks.workunit.client.0.smithi089.stdout:5/668: creat d4/d19/d1e/d28/d31/d55/fec x:0 0 0 2024-09-13T22:08:45.952 INFO:tasks.workunit.client.0.smithi089.stdout:5/669: dread d4/d19/d1e/d28/d31/d61/f90 [0,4194304] 0 2024-09-13T22:08:45.958 INFO:tasks.workunit.client.0.smithi089.stdout:5/670: truncate d4/d19/d1e/d28/d3d/f5d 3898511 0 2024-09-13T22:08:45.958 INFO:tasks.workunit.client.0.smithi089.stdout:5/671: fsync d4/d19/d1e/d28/fb8 0 2024-09-13T22:08:45.958 INFO:tasks.workunit.client.0.smithi089.stdout:5/672: rename d4/d19/d1e/d28 to d4/d19/d1e/d28/d31/d55/dcc/ded 22 2024-09-13T22:08:45.959 INFO:tasks.workunit.client.0.smithi089.stdout:1/760: dread d7/d40/f71 [0,4194304] 0 2024-09-13T22:08:45.959 INFO:tasks.workunit.client.0.smithi089.stdout:1/761: stat d7/de/d3a/cdf 0 2024-09-13T22:08:45.959 INFO:tasks.workunit.client.0.smithi089.stdout:1/762: dread - d7/de/da0/dbd/fce zero size 2024-09-13T22:08:45.960 INFO:tasks.workunit.client.0.smithi089.stdout:1/763: rename d7/f33 to d7/d40/dbe/de9/ffd 0 2024-09-13T22:08:45.960 INFO:tasks.workunit.client.0.smithi089.stdout:1/764: fdatasync d7/d1c/d3c/f65 0 2024-09-13T22:08:45.970 INFO:tasks.workunit.client.0.smithi089.stdout:5/673: dwrite d4/f54 [0,4194304] 0 2024-09-13T22:08:45.972 INFO:tasks.workunit.client.0.smithi089.stdout:5/674: getdents d4/d19/d1e/d53 0 2024-09-13T22:08:45.973 INFO:tasks.workunit.client.0.smithi089.stdout:5/675: read - d4/d19/d1e/d28/d31/d55/d58/f5f zero size 2024-09-13T22:08:45.973 INFO:tasks.workunit.client.0.smithi089.stdout:5/676: chown d4/d19/d1e/d28/d3d/dc9/l8b 685636968 1 2024-09-13T22:08:45.973 INFO:tasks.workunit.client.0.smithi089.stdout:5/677: getdents d4/d19/d1e 0 2024-09-13T22:08:45.974 INFO:tasks.workunit.client.0.smithi089.stdout:5/678: mknod d4/d19/d1e/d28/cee 0 2024-09-13T22:08:45.975 INFO:tasks.workunit.client.0.smithi089.stdout:5/679: rename d4/d19/d1e/d28/l34 to d4/d19/d1e/d28/d3d/dba/de6/lef 0 2024-09-13T22:08:45.978 INFO:tasks.workunit.client.0.smithi089.stdout:1/765: dwrite d7/d1c/d3c/f81 [0,4194304] 0 2024-09-13T22:08:45.985 INFO:tasks.workunit.client.0.smithi089.stdout:5/680: read d4/d19/d1e/d28/d31/d55/da4/dd2/fd7 [2986249,125632] 0 2024-09-13T22:08:45.985 INFO:tasks.workunit.client.0.smithi089.stdout:5/681: readlink d4/d19/d1e/d28/d31/d55/ldf 0 2024-09-13T22:08:45.986 INFO:tasks.workunit.client.0.smithi089.stdout:5/682: getdents d4/d19/d1e/d28/d31/d55/da4 0 2024-09-13T22:08:45.987 INFO:tasks.workunit.client.0.smithi089.stdout:4/811: sync 2024-09-13T22:08:45.987 INFO:tasks.workunit.client.0.smithi089.stdout:0/993: sync 2024-09-13T22:08:45.987 INFO:tasks.workunit.client.0.smithi089.stdout:2/731: sync 2024-09-13T22:08:45.998 INFO:tasks.workunit.client.0.smithi089.stdout:4/812: dread d0/d2c/d52/da5/f2f [0,4194304] 0 2024-09-13T22:08:45.998 INFO:tasks.workunit.client.0.smithi089.stdout:4/813: getdents d0/d15/d1f 0 2024-09-13T22:08:45.998 INFO:tasks.workunit.client.0.smithi089.stdout:4/814: write d0/d11/d16/d89/f95 [1614601,78473] 0 2024-09-13T22:08:46.000 INFO:tasks.workunit.client.0.smithi089.stdout:0/994: dread d1/de/d1f/f88 [0,4194304] 0 2024-09-13T22:08:46.000 INFO:tasks.workunit.client.0.smithi089.stdout:0/995: truncate d1/de/d10/d36/d38/d4e/d62/d5b/f63 2106878 0 2024-09-13T22:08:46.002 INFO:tasks.workunit.client.0.smithi089.stdout:0/996: mknod d1/de/d10/d85/d156/c163 0 2024-09-13T22:08:46.002 INFO:tasks.workunit.client.0.smithi089.stdout:0/997: write d1/de/d10/d36/d38/d4e/d62/d5f/db6/fc9 [481866,111139] 0 2024-09-13T22:08:46.003 INFO:tasks.workunit.client.0.smithi089.stdout:0/998: write d1/de/d10/d85/fcd [194505,70224] 0 2024-09-13T22:08:46.003 INFO:tasks.workunit.client.0.smithi089.stdout:0/999: write d1/de/d10/d36/d57/d3a/fea [898446,47061] 0 2024-09-13T22:08:46.019 INFO:tasks.workunit.client.0.smithi089.stdout:5/683: dwrite d4/d19/d1e/d53/f7e [0,4194304] 0 2024-09-13T22:08:46.019 INFO:tasks.workunit.client.0.smithi089.stdout:5/684: write d4/d19/d1e/d53/d88/fc8 [916152,22533] 0 2024-09-13T22:08:46.019 INFO:tasks.workunit.client.0.smithi089.stdout:2/732: dwrite df/f74 [0,4194304] 0 2024-09-13T22:08:46.020 INFO:tasks.workunit.client.0.smithi089.stdout:4/815: dwrite d0/d2c/d35/d5d/f69 [4194304,4194304] 0 2024-09-13T22:08:46.020 INFO:tasks.workunit.client.0.smithi089.stdout:4/816: truncate d0/d2c/d35/d5d/da4/fb3 3499 0 2024-09-13T22:08:46.021 INFO:tasks.workunit.client.0.smithi089.stdout:5/685: getdents d4/d19/d1e/d28/d3d/dba 0 2024-09-13T22:08:46.021 INFO:tasks.workunit.client.0.smithi089.stdout:5/686: chown d4/d19/d1e/d89/dce/l4a 1922 1 2024-09-13T22:08:46.022 INFO:tasks.workunit.client.0.smithi089.stdout:2/733: mkdir df/d14/d66/dfd 0 2024-09-13T22:08:46.023 INFO:tasks.workunit.client.0.smithi089.stdout:5/687: dread d4/fc5 [0,4194304] 0 2024-09-13T22:08:46.024 INFO:tasks.workunit.client.0.smithi089.stdout:4/817: link d0/d2c/fb7 d0/d2c/d52/da5/d9d/ffa 0 2024-09-13T22:08:46.024 INFO:tasks.workunit.client.0.smithi089.stdout:4/818: fsync d0/d2c/f84 0 2024-09-13T22:08:46.025 INFO:tasks.workunit.client.0.smithi089.stdout:5/688: rename d4/d19/d1e/d28/cd3 to d4/d19/d1e/d28/d31/d94/cf0 0 2024-09-13T22:08:46.027 INFO:tasks.workunit.client.0.smithi089.stdout:4/819: mkdir d0/d15/d1f/d75/dee/dfb 0 2024-09-13T22:08:46.027 INFO:tasks.workunit.client.0.smithi089.stdout:4/820: fdatasync d0/d15/d1f/f42 0 2024-09-13T22:08:46.028 INFO:tasks.workunit.client.0.smithi089.stdout:5/689: truncate d4/d19/d1e/d28/d31/d61/f6b 440819 0 2024-09-13T22:08:46.029 INFO:tasks.workunit.client.0.smithi089.stdout:4/821: symlink d0/d2c/d35/d74/lfc 0 2024-09-13T22:08:46.031 INFO:tasks.workunit.client.0.smithi089.stdout:5/690: symlink d4/d19/d1e/d28/d3d/dba/lf1 0 2024-09-13T22:08:46.032 INFO:tasks.workunit.client.0.smithi089.stdout:4/822: creat d0/d2c/d35/d5d/da4/ffd x:0 0 0 2024-09-13T22:08:46.032 INFO:tasks.workunit.client.0.smithi089.stdout:4/823: write d0/d15/d1f/f42 [1062708,6911] 0 2024-09-13T22:08:46.032 INFO:tasks.workunit.client.0.smithi089.stdout:4/824: truncate d0/f3e 1057252 0 2024-09-13T22:08:46.033 INFO:tasks.workunit.client.0.smithi089.stdout:5/691: symlink d4/d19/d1e/d53/d88/lf2 0 2024-09-13T22:08:46.033 INFO:tasks.workunit.client.0.smithi089.stdout:5/692: fdatasync d4/d19/d1e/d28/d31/d61/d69/f92 0 2024-09-13T22:08:46.035 INFO:tasks.workunit.client.0.smithi089.stdout:4/825: creat d0/d2c/da1/ffe x:0 0 0 2024-09-13T22:08:46.035 INFO:tasks.workunit.client.0.smithi089.stdout:4/826: chown d0/d2c/d35/le3 773 1 2024-09-13T22:08:46.035 INFO:tasks.workunit.client.0.smithi089.stdout:5/693: stat d4/d19/d1e/c2f 0 2024-09-13T22:08:46.042 INFO:tasks.workunit.client.0.smithi089.stdout:4/827: dread d0/d2c/da1/fd1 [0,4194304] 0 2024-09-13T22:08:46.042 INFO:tasks.workunit.client.0.smithi089.stdout:4/828: stat d0/d2c/d52/da5/d9d/ddb/de2/dcd 0 2024-09-13T22:08:46.057 INFO:tasks.workunit.client.0.smithi089.stdout:4/829: dwrite d0/d2c/d35/f67 [0,4194304] 0 2024-09-13T22:08:46.073 INFO:tasks.workunit.client.0.smithi089.stdout:4/830: dwrite d0/d2c/da0/da9/fe1 [0,4194304] 0 2024-09-13T22:08:46.075 INFO:tasks.workunit.client.0.smithi089.stdout:4/831: getdents d0/d2c/d35 0 2024-09-13T22:08:46.076 INFO:tasks.workunit.client.0.smithi089.stdout:4/832: creat d0/d2c/da1/fff x:0 0 0 2024-09-13T22:08:46.077 INFO:tasks.workunit.client.0.smithi089.stdout:4/833: symlink d0/d2c/da0/l100 0 2024-09-13T22:08:46.087 INFO:tasks.workunit.client.0.smithi089.stdout:9/770: sync 2024-09-13T22:08:46.087 INFO:tasks.workunit.client.0.smithi089.stdout:3/745: sync 2024-09-13T22:08:46.087 INFO:tasks.workunit.client.0.smithi089.stdout:6/685: sync 2024-09-13T22:08:46.087 INFO:tasks.workunit.client.0.smithi089.stdout:7/706: sync 2024-09-13T22:08:46.087 INFO:tasks.workunit.client.0.smithi089.stdout:8/780: sync 2024-09-13T22:08:46.088 INFO:tasks.workunit.client.0.smithi089.stdout:3/746: rename d1/d3a to d1/d2/d96/d102 0 2024-09-13T22:08:46.089 INFO:tasks.workunit.client.0.smithi089.stdout:9/771: mkdir d6/d18/d1b/da0/d100 0 2024-09-13T22:08:46.090 INFO:tasks.workunit.client.0.smithi089.stdout:7/707: mknod d0/d19/d28/d1d/d23/d24/dac/cf1 0 2024-09-13T22:08:46.091 INFO:tasks.workunit.client.0.smithi089.stdout:3/747: link d1/d2/d4/d1c/cb7 d1/d2/d23/d3d/d54/c103 0 2024-09-13T22:08:46.092 INFO:tasks.workunit.client.0.smithi089.stdout:9/772: rename d6/d18/c4d to d6/d18/dde/c101 0 2024-09-13T22:08:46.093 INFO:tasks.workunit.client.0.smithi089.stdout:7/708: unlink d0/d19/d45/d38/d54/l58 0 2024-09-13T22:08:46.094 INFO:tasks.workunit.client.0.smithi089.stdout:8/781: rmdir d0/dd/db0/d20/d36/d80/d3b/da5/dec 39 2024-09-13T22:08:46.094 INFO:tasks.workunit.client.0.smithi089.stdout:8/782: truncate d0/dd/db0/d20/f17 2167479 0 2024-09-13T22:08:46.095 INFO:tasks.workunit.client.0.smithi089.stdout:3/748: creat d1/d2/d23/d3d/d46/dab/df2/f104 x:0 0 0 2024-09-13T22:08:46.095 INFO:tasks.workunit.client.0.smithi089.stdout:3/749: fdatasync d1/d2/d23/d3d/dda/d1b/f59 0 2024-09-13T22:08:46.097 INFO:tasks.workunit.client.0.smithi089.stdout:7/709: unlink d0/d19/d28/d1d/d3d/d9a/dcf/d41/cdd 0 2024-09-13T22:08:46.097 INFO:tasks.workunit.client.0.smithi089.stdout:7/710: creat d0/d19/d28/ff2 x:0 0 0 2024-09-13T22:08:46.099 INFO:tasks.workunit.client.0.smithi089.stdout:3/750: dread d1/d2/d23/f76 [0,4194304] 0 2024-09-13T22:08:46.099 INFO:tasks.workunit.client.0.smithi089.stdout:3/751: chown d1/d2/d4/d1c/f8c 2325164 1 2024-09-13T22:08:46.099 INFO:tasks.workunit.client.0.smithi089.stdout:3/752: creat d1/d2/d23/f105 x:0 0 0 2024-09-13T22:08:46.099 INFO:tasks.workunit.client.0.smithi089.stdout:3/753: chown d1/d2/d4/d1c/d7e/d40/d69/da1 37611 1 2024-09-13T22:08:46.099 INFO:tasks.workunit.client.0.smithi089.stdout:8/783: link d0/dd/db0/d20/d40/d4a/d7f/da6/cb5 d0/d6a/d73/c110 0 2024-09-13T22:08:46.100 INFO:tasks.workunit.client.0.smithi089.stdout:8/784: stat d0/dd/db0/d20/d36/d59/d5d/la3 0 2024-09-13T22:08:46.100 INFO:tasks.workunit.client.0.smithi089.stdout:8/785: fdatasync d0/dd/db0/d20/d36/d59/d89/fe0 0 2024-09-13T22:08:46.100 INFO:tasks.workunit.client.0.smithi089.stdout:8/786: chown d0/dd/db0/d20/d36/d80/ld8 488337 1 2024-09-13T22:08:46.101 INFO:tasks.workunit.client.0.smithi089.stdout:3/754: rename d1/d2/d23/cd7 to d1/d2/d23/d3d/d54/d5d/dc1/c106 0 2024-09-13T22:08:46.101 INFO:tasks.workunit.client.0.smithi089.stdout:4/834: dwrite d0/d15/d1f/f42 [0,4194304] 0 2024-09-13T22:08:46.101 INFO:tasks.workunit.client.0.smithi089.stdout:8/787: creat d0/d6a/db9/f111 x:0 0 0 2024-09-13T22:08:46.102 INFO:tasks.workunit.client.0.smithi089.stdout:3/755: mkdir d1/d2/d23/d3d/d54/d5d/deb/d97/d107 0 2024-09-13T22:08:46.104 INFO:tasks.workunit.client.0.smithi089.stdout:4/835: mknod d0/d15/d1f/d75/dee/d8c/c101 0 2024-09-13T22:08:46.105 INFO:tasks.workunit.client.0.smithi089.stdout:8/788: rename d0/dd/db0/d20/d36/da0/fe9 to d0/dd/db0/d20/d36/d80/d3b/f112 0 2024-09-13T22:08:46.106 INFO:tasks.workunit.client.0.smithi089.stdout:4/836: dread d0/d2c/d35/d74/f88 [0,4194304] 0 2024-09-13T22:08:46.107 INFO:tasks.workunit.client.0.smithi089.stdout:9/773: dread d6/fc [0,4194304] 0 2024-09-13T22:08:46.107 INFO:tasks.workunit.client.0.smithi089.stdout:4/837: rename d0/d2c/da1/ffe to d0/d15/d1f/d75/dee/d8c/d9e/f102 0 2024-09-13T22:08:46.109 INFO:tasks.workunit.client.0.smithi089.stdout:9/774: rename d6/d18/d21/d5d/d6c/d8d to d6/d18/d1b/d89/db8/d52/d102 0 2024-09-13T22:08:46.110 INFO:tasks.workunit.client.0.smithi089.stdout:4/838: creat d0/d11/d16/f103 x:0 0 0 2024-09-13T22:08:46.110 INFO:tasks.workunit.client.0.smithi089.stdout:8/789: dread d0/dd/db0/d42/f5e [0,4194304] 0 2024-09-13T22:08:46.110 INFO:tasks.workunit.client.0.smithi089.stdout:4/839: fsync d0/d2c/d35/f51 0 2024-09-13T22:08:46.110 INFO:tasks.workunit.client.0.smithi089.stdout:9/775: mknod d6/d18/d1b/d89/db8/d52/c103 0 2024-09-13T22:08:46.110 INFO:tasks.workunit.client.0.smithi089.stdout:9/776: write d6/d31/d64/f91 [4586818,78080] 0 2024-09-13T22:08:46.111 INFO:tasks.workunit.client.0.smithi089.stdout:4/840: creat d0/d15/d1f/d75/dee/dfb/f104 x:0 0 0 2024-09-13T22:08:46.111 INFO:tasks.workunit.client.0.smithi089.stdout:8/790: symlink d0/d6a/l113 0 2024-09-13T22:08:46.112 INFO:tasks.workunit.client.0.smithi089.stdout:6/686: dwrite d0/d5/d43/f9d [0,4194304] 0 2024-09-13T22:08:46.113 INFO:tasks.workunit.client.0.smithi089.stdout:9/777: rename d6/d18/d1b/da0/dae/lcd to d6/d18/d1b/l104 0 2024-09-13T22:08:46.113 INFO:tasks.workunit.client.0.smithi089.stdout:3/756: dread d1/d2/d23/d3d/dda/d1b/f48 [0,4194304] 0 2024-09-13T22:08:46.113 INFO:tasks.workunit.client.0.smithi089.stdout:4/841: mknod d0/d2c/d52/da5/d9d/ddb/c105 0 2024-09-13T22:08:46.113 INFO:tasks.workunit.client.0.smithi089.stdout:4/842: fdatasync d0/d15/fbc 0 2024-09-13T22:08:46.115 INFO:tasks.workunit.client.0.smithi089.stdout:9/778: symlink d6/d54/dcb/l105 0 2024-09-13T22:08:46.115 INFO:tasks.workunit.client.0.smithi089.stdout:9/779: write d6/feb [26163,3376] 0 2024-09-13T22:08:46.115 INFO:tasks.workunit.client.0.smithi089.stdout:7/711: dwrite d0/fd [0,4194304] 0 2024-09-13T22:08:46.116 INFO:tasks.workunit.client.0.smithi089.stdout:3/757: unlink d1/d2/d23/d3d/d46/ff5 0 2024-09-13T22:08:46.117 INFO:tasks.workunit.client.0.smithi089.stdout:9/780: mknod d6/d18/d1b/d89/db8/c106 0 2024-09-13T22:08:46.118 INFO:tasks.workunit.client.0.smithi089.stdout:4/843: dread d0/fb9 [4194304,4194304] 0 2024-09-13T22:08:46.119 INFO:tasks.workunit.client.0.smithi089.stdout:3/758: dread d1/d2/f82 [0,4194304] 0 2024-09-13T22:08:46.120 INFO:tasks.workunit.client.0.smithi089.stdout:4/844: dread d0/d2c/d52/f73 [0,4194304] 0 2024-09-13T22:08:46.121 INFO:tasks.workunit.client.0.smithi089.stdout:9/781: symlink d6/d31/d5e/db1/l107 0 2024-09-13T22:08:46.125 INFO:tasks.workunit.client.0.smithi089.stdout:8/791: rename d0/d6a/db9 to d0/dd/db0/d20/d1c/d5a/d63/dce/d114 0 2024-09-13T22:08:46.127 INFO:tasks.workunit.client.0.smithi089.stdout:7/712: dread d0/d19/d45/d38/f39 [0,4194304] 0 2024-09-13T22:08:46.127 INFO:tasks.workunit.client.0.smithi089.stdout:6/687: rename d0/d5/d43/daf/db1/db7/fc0 to d0/d4/d12/fd2 0 2024-09-13T22:08:46.129 INFO:tasks.workunit.client.0.smithi089.stdout:8/792: mkdir d0/dd/db0/d20/d36/d80/d3b/da5/d115 0 2024-09-13T22:08:46.132 INFO:tasks.workunit.client.0.smithi089.stdout:9/782: rename d6/d18/d1b/d89/db8/d5a/l6f to d6/d18/d1b/d89/l108 0 2024-09-13T22:08:46.132 INFO:tasks.workunit.client.0.smithi089.stdout:9/783: stat d6/d54/ff6 0 2024-09-13T22:08:46.133 INFO:tasks.workunit.client.0.smithi089.stdout:4/845: dread d0/d15/d1f/d75/dee/d8c/fe7 [0,4194304] 0 2024-09-13T22:08:46.134 INFO:tasks.workunit.client.0.smithi089.stdout:4/846: stat d0/d2c/da1/cae 0 2024-09-13T22:08:46.134 INFO:tasks.workunit.client.0.smithi089.stdout:8/793: mknod d0/dd/db0/c116 0 2024-09-13T22:08:46.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/713: rename d0/d19/d28/d1d/d3d/f8e to d0/d19/d28/d1d/ff3 0 2024-09-13T22:08:46.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/714: stat d0/d19/d28/d61/fd4 0 2024-09-13T22:08:46.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/715: write d0/d19/d28/d1d/d3d/d9a/dcf/d41/f7e [822511,57484] 0 2024-09-13T22:08:46.138 INFO:tasks.workunit.client.0.smithi089.stdout:7/716: chown d0/d19/d28/fe4 31891232 1 2024-09-13T22:08:46.138 INFO:tasks.workunit.client.0.smithi089.stdout:9/784: dread d6/d31/d5e/f7d [0,4194304] 0 2024-09-13T22:08:46.138 INFO:tasks.workunit.client.0.smithi089.stdout:9/785: write d6/d18/d1b/d89/db8/d52/f97 [505067,117952] 0 2024-09-13T22:08:46.138 INFO:tasks.workunit.client.0.smithi089.stdout:4/847: mknod d0/d2c/d52/da5/d9d/ddb/de2/c106 0 2024-09-13T22:08:46.139 INFO:tasks.workunit.client.0.smithi089.stdout:8/794: truncate d0/dd/db0/d20/d36/d59/d89/f25 1374860 0 2024-09-13T22:08:46.141 INFO:tasks.workunit.client.0.smithi089.stdout:7/717: creat d0/d19/d45/d92/ff4 x:0 0 0 2024-09-13T22:08:46.141 INFO:tasks.workunit.client.0.smithi089.stdout:7/718: dread - d0/d19/d28/faa zero size 2024-09-13T22:08:46.141 INFO:tasks.workunit.client.0.smithi089.stdout:3/759: dwrite d1/d2/d31/f6e [0,4194304] 0 2024-09-13T22:08:46.142 INFO:tasks.workunit.client.0.smithi089.stdout:3/760: stat d1/d2/d31/cd3 0 2024-09-13T22:08:46.142 INFO:tasks.workunit.client.0.smithi089.stdout:3/761: chown d1/d2/d4/f9 24 1 2024-09-13T22:08:46.142 INFO:tasks.workunit.client.0.smithi089.stdout:3/762: fdatasync d1/d2/d23/d3d/dd2/fe5 0 2024-09-13T22:08:46.142 INFO:tasks.workunit.client.0.smithi089.stdout:3/763: write d1/d2/d23/d3d/d46/fb9 [312747,71562] 0 2024-09-13T22:08:46.142 INFO:tasks.workunit.client.0.smithi089.stdout:4/848: creat d0/d2c/d52/da5/d9d/ddf/f107 x:0 0 0 2024-09-13T22:08:46.143 INFO:tasks.workunit.client.0.smithi089.stdout:8/795: rename d0/dd/db0/d42/l6c to d0/dd/db0/d20/d1c/l117 0 2024-09-13T22:08:46.145 INFO:tasks.workunit.client.0.smithi089.stdout:7/719: symlink d0/d19/d28/d1d/de2/lf5 0 2024-09-13T22:08:46.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/796: getdents d0/dd/db0/d42/dc7 0 2024-09-13T22:08:46.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/797: write d0/dd/db0/d20/d1c/d5a/d63/f66 [3732552,4662] 0 2024-09-13T22:08:46.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/798: chown d0/dd/db0/d20/d36/d59/d89/c34 37479898 1 2024-09-13T22:08:46.147 INFO:tasks.workunit.client.0.smithi089.stdout:4/849: dread d0/d2c/da1/fd1 [0,4194304] 0 2024-09-13T22:08:46.147 INFO:tasks.workunit.client.0.smithi089.stdout:4/850: write d0/d2c/d35/d5d/da4/fe8 [4444969,40221] 0 2024-09-13T22:08:46.147 INFO:tasks.workunit.client.0.smithi089.stdout:4/851: dread - d0/d15/d1f/d75/f9f zero size 2024-09-13T22:08:46.147 INFO:tasks.workunit.client.0.smithi089.stdout:7/720: creat d0/d19/d28/d1d/d3d/ff6 x:0 0 0 2024-09-13T22:08:46.147 INFO:tasks.workunit.client.0.smithi089.stdout:7/721: write d0/d19/d28/d1d/d23/d24/f74 [643815,84839] 0 2024-09-13T22:08:46.147 INFO:tasks.workunit.client.0.smithi089.stdout:7/722: chown d0/d19/d28/d7b/f97 5 1 2024-09-13T22:08:46.148 INFO:tasks.workunit.client.0.smithi089.stdout:3/764: write d1/d2/d4/d1c/d7f/f86 [446665,67983] 0 2024-09-13T22:08:46.148 INFO:tasks.workunit.client.0.smithi089.stdout:3/765: dread - d1/d2/d23/d3d/d54/d5d/fa6 zero size 2024-09-13T22:08:46.149 INFO:tasks.workunit.client.0.smithi089.stdout:8/799: creat d0/dd/db0/d20/d36/f118 x:0 0 0 2024-09-13T22:08:46.149 INFO:tasks.workunit.client.0.smithi089.stdout:8/800: read - d0/dd/db0/d20/d36/d68/de6/ff9 zero size 2024-09-13T22:08:46.149 INFO:tasks.workunit.client.0.smithi089.stdout:8/801: chown d0/dd/db0/d20/d40 177077 1 2024-09-13T22:08:46.154 INFO:tasks.workunit.client.0.smithi089.stdout:7/723: getdents d0/d19/d28/d1d/d2d/d55 0 2024-09-13T22:08:46.158 INFO:tasks.workunit.client.0.smithi089.stdout:7/724: creat d0/d19/d45/d92/def/ff7 x:0 0 0 2024-09-13T22:08:46.158 INFO:tasks.workunit.client.0.smithi089.stdout:7/725: write d0/d19/d45/d92/ff4 [265555,130969] 0 2024-09-13T22:08:46.158 INFO:tasks.workunit.client.0.smithi089.stdout:7/726: truncate d0/d19/d28/d1d/d3d/d69/f91 269106 0 2024-09-13T22:08:46.158 INFO:tasks.workunit.client.0.smithi089.stdout:7/727: write d0/d19/d28/d1d/d3d/d9a/dcf/fc3 [702994,129817] 0 2024-09-13T22:08:46.158 INFO:tasks.workunit.client.0.smithi089.stdout:7/728: fsync d0/d19/d45/f95 0 2024-09-13T22:08:46.158 INFO:tasks.workunit.client.0.smithi089.stdout:7/729: read d0/f8c [14370,20412] 0 2024-09-13T22:08:46.159 INFO:tasks.workunit.client.0.smithi089.stdout:7/730: write d0/d19/d28/d1d/d3d/d9a/dcf/fc3 [1467212,74884] 0 2024-09-13T22:08:46.160 INFO:tasks.workunit.client.0.smithi089.stdout:2/734: sync 2024-09-13T22:08:46.160 INFO:tasks.workunit.client.0.smithi089.stdout:1/766: sync 2024-09-13T22:08:46.160 INFO:tasks.workunit.client.0.smithi089.stdout:5/694: sync 2024-09-13T22:08:46.160 INFO:tasks.workunit.client.0.smithi089.stdout:5/695: write d4/d19/d1e/d28/d31/d61/fe2 [28384,22208] 0 2024-09-13T22:08:46.160 INFO:tasks.workunit.client.0.smithi089.stdout:5/696: write d4/d19/d1e/d28/d31/f40 [349414,26143] 0 2024-09-13T22:08:46.161 INFO:tasks.workunit.client.0.smithi089.stdout:7/731: symlink d0/d19/d45/d38/d54/lf8 0 2024-09-13T22:08:46.161 INFO:tasks.workunit.client.0.smithi089.stdout:7/732: readlink d0/l16 0 2024-09-13T22:08:46.163 INFO:tasks.workunit.client.0.smithi089.stdout:1/767: dread d7/d40/dbe/d2b/d39/fd7 [0,4194304] 0 2024-09-13T22:08:46.163 INFO:tasks.workunit.client.0.smithi089.stdout:6/688: dwrite d0/d4/d12/d15/db3/f34 [0,4194304] 0 2024-09-13T22:08:46.163 INFO:tasks.workunit.client.0.smithi089.stdout:9/786: dwrite d6/d31/d5e/f7d [0,4194304] 0 2024-09-13T22:08:46.163 INFO:tasks.workunit.client.0.smithi089.stdout:9/787: fdatasync d6/d18/d1b/d89/db8/fec 0 2024-09-13T22:08:46.163 INFO:tasks.workunit.client.0.smithi089.stdout:9/788: read - d6/d31/fb0 zero size 2024-09-13T22:08:46.164 INFO:tasks.workunit.client.0.smithi089.stdout:9/789: write d6/d55/f6a [843644,63074] 0 2024-09-13T22:08:46.164 INFO:tasks.workunit.client.0.smithi089.stdout:9/790: fsync d6/d18/dab/f69 0 2024-09-13T22:08:46.164 INFO:tasks.workunit.client.0.smithi089.stdout:5/697: getdents d4/d19/d1e/d28/d31/d61 0 2024-09-13T22:08:46.164 INFO:tasks.workunit.client.0.smithi089.stdout:3/766: dread d1/d2/d23/d3d/dda/d1b/f59 [0,4194304] 0 2024-09-13T22:08:46.164 INFO:tasks.workunit.client.0.smithi089.stdout:3/767: write d1/d2/d4/d1c/d7e/f91 [416170,130232] 0 2024-09-13T22:08:46.164 INFO:tasks.workunit.client.0.smithi089.stdout:3/768: readlink d1/d2/d23/d3d/d46/lcc 0 2024-09-13T22:08:46.165 INFO:tasks.workunit.client.0.smithi089.stdout:7/733: link d0/d19/d28/d1d/f5f d0/d19/d28/d1d/d23/d24/d5d/ff9 0 2024-09-13T22:08:46.165 INFO:tasks.workunit.client.0.smithi089.stdout:1/768: getdents d7/d40/dbe/d80 0 2024-09-13T22:08:46.169 INFO:tasks.workunit.client.0.smithi089.stdout:9/791: mkdir d6/d18/d21/d5d/d109 0 2024-09-13T22:08:46.169 INFO:tasks.workunit.client.0.smithi089.stdout:9/792: readlink d6/d18/d1b/l5f 0 2024-09-13T22:08:46.170 INFO:tasks.workunit.client.0.smithi089.stdout:9/793: write d6/ff [3864146,51691] 0 2024-09-13T22:08:46.170 INFO:tasks.workunit.client.0.smithi089.stdout:9/794: creat d6/d18/d1b/d89/f10a x:0 0 0 2024-09-13T22:08:46.170 INFO:tasks.workunit.client.0.smithi089.stdout:8/802: dwrite d0/dd/db0/d20/d40/d4a/f9e [0,4194304] 0 2024-09-13T22:08:46.170 INFO:tasks.workunit.client.0.smithi089.stdout:8/803: write d0/dd/f35 [2329388,2910] 0 2024-09-13T22:08:46.173 INFO:tasks.workunit.client.0.smithi089.stdout:2/735: write df/d1a/f42 [3710695,11255] 0 2024-09-13T22:08:46.173 INFO:tasks.workunit.client.0.smithi089.stdout:2/736: write df/d5b/da5/dd7/ff0 [194141,84090] 0 2024-09-13T22:08:46.173 INFO:tasks.workunit.client.0.smithi089.stdout:5/698: mkdir d4/d19/d1e/d28/d31/dd1/df3 0 2024-09-13T22:08:46.175 INFO:tasks.workunit.client.0.smithi089.stdout:3/769: creat d1/d2/d96/d102/f108 x:0 0 0 2024-09-13T22:08:46.175 INFO:tasks.workunit.client.0.smithi089.stdout:7/734: symlink d0/d19/d45/d92/def/lfa 0 2024-09-13T22:08:46.176 INFO:tasks.workunit.client.0.smithi089.stdout:1/769: creat d7/d40/dbe/d2b/d39/d73/da9/ffe x:0 0 0 2024-09-13T22:08:46.177 INFO:tasks.workunit.client.0.smithi089.stdout:6/689: rmdir d0/d4/d12/d15/d3b/d62/da4 39 2024-09-13T22:08:46.179 INFO:tasks.workunit.client.0.smithi089.stdout:9/795: symlink d6/d18/dab/df9/l10b 0 2024-09-13T22:08:46.180 INFO:tasks.workunit.client.0.smithi089.stdout:9/796: stat d6/d18/l29 0 2024-09-13T22:08:46.180 INFO:tasks.workunit.client.0.smithi089.stdout:9/797: creat d6/d18/d1b/d89/db8/dbe/f10c x:0 0 0 2024-09-13T22:08:46.181 INFO:tasks.workunit.client.0.smithi089.stdout:5/699: write d4/d19/f24 [8198789,112468] 0 2024-09-13T22:08:46.186 INFO:tasks.workunit.client.0.smithi089.stdout:2/737: mknod df/d14/d2b/d61/dbd/cfe 0 2024-09-13T22:08:46.187 INFO:tasks.workunit.client.0.smithi089.stdout:3/770: mkdir d1/d2/d4/d5a/d109 0 2024-09-13T22:08:46.189 INFO:tasks.workunit.client.0.smithi089.stdout:6/690: creat d0/d5/d43/d79/fd3 x:0 0 0 2024-09-13T22:08:46.191 INFO:tasks.workunit.client.0.smithi089.stdout:9/798: unlink d6/d31/fb0 0 2024-09-13T22:08:46.191 INFO:tasks.workunit.client.0.smithi089.stdout:9/799: write d6/d18/dab/f4c [323102,28334] 0 2024-09-13T22:08:46.191 INFO:tasks.workunit.client.0.smithi089.stdout:7/735: read d0/d19/d28/d1d/d30/f3b [176011,93682] 0 2024-09-13T22:08:46.193 INFO:tasks.workunit.client.0.smithi089.stdout:2/738: symlink df/d14/d66/dfd/lff 0 2024-09-13T22:08:46.193 INFO:tasks.workunit.client.0.smithi089.stdout:3/771: creat d1/d2/d23/d3d/d54/dc6/f10a x:0 0 0 2024-09-13T22:08:46.194 INFO:tasks.workunit.client.0.smithi089.stdout:6/691: creat d0/d4/d12/d15/d3b/d62/da4/fd4 x:0 0 0 2024-09-13T22:08:46.198 INFO:tasks.workunit.client.0.smithi089.stdout:7/736: rename d0/d19/d45/d92/ddc/cde to d0/d19/d28/d1d/d3d/d9a/dcf/cfb 0 2024-09-13T22:08:46.199 INFO:tasks.workunit.client.0.smithi089.stdout:6/692: mknod d0/d4/d12/d15/d3b/d62/da4/cd5 0 2024-09-13T22:08:46.199 INFO:tasks.workunit.client.0.smithi089.stdout:1/770: dwrite d7/d40/dbe/d2b/d39/d73/da9/fab [0,4194304] 0 2024-09-13T22:08:46.199 INFO:tasks.workunit.client.0.smithi089.stdout:7/737: symlink d0/d19/d45/d9b/lfc 0 2024-09-13T22:08:46.200 INFO:tasks.workunit.client.0.smithi089.stdout:2/739: fsync df/d5b/da5/dd7/ff0 0 2024-09-13T22:08:46.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/771: mknod d7/de/da0/cff 0 2024-09-13T22:08:46.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/772: chown d7/d40/dbe/d80/dbb/de3 700258 1 2024-09-13T22:08:46.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/773: fdatasync d7/de/f27 0 2024-09-13T22:08:46.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/774: truncate d7/d34/d5c/d5d/fb8 956045 0 2024-09-13T22:08:46.207 INFO:tasks.workunit.client.0.smithi089.stdout:7/738: mknod d0/d19/d28/d1d/d30/cfd 0 2024-09-13T22:08:46.207 INFO:tasks.workunit.client.0.smithi089.stdout:5/700: dwrite d4/d19/d1e/d28/d3d/dc9/f64 [0,4194304] 0 2024-09-13T22:08:46.207 INFO:tasks.workunit.client.0.smithi089.stdout:6/693: rmdir d0/d5/d64 39 2024-09-13T22:08:46.207 INFO:tasks.workunit.client.0.smithi089.stdout:6/694: fsync d0/d5/f23 0 2024-09-13T22:08:46.208 INFO:tasks.workunit.client.0.smithi089.stdout:3/772: write d1/d2/d23/d3d/d54/d5d/f77 [2403907,51542] 0 2024-09-13T22:08:46.208 INFO:tasks.workunit.client.0.smithi089.stdout:1/775: mkdir d7/d40/dbe/d2b/da7/d100 0 2024-09-13T22:08:46.209 INFO:tasks.workunit.client.0.smithi089.stdout:6/695: unlink d0/d5/d1d/d54/f7c 0 2024-09-13T22:08:46.211 INFO:tasks.workunit.client.0.smithi089.stdout:6/696: dread d0/d4/d12/fd2 [0,4194304] 0 2024-09-13T22:08:46.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/776: unlink d7/d40/dbe/d2b/f2e 0 2024-09-13T22:08:46.212 INFO:tasks.workunit.client.0.smithi089.stdout:6/697: creat d0/dcb/fd6 x:0 0 0 2024-09-13T22:08:46.214 INFO:tasks.workunit.client.0.smithi089.stdout:1/777: symlink d7/de/d3a/d77/l101 0 2024-09-13T22:08:46.214 INFO:tasks.workunit.client.0.smithi089.stdout:1/778: write d7/d34/f37 [826311,96779] 0 2024-09-13T22:08:46.218 INFO:tasks.workunit.client.0.smithi089.stdout:1/779: rename d7/d1c/c44 to d7/d34/d5c/d5d/c102 0 2024-09-13T22:08:46.219 INFO:tasks.workunit.client.0.smithi089.stdout:7/739: write d0/d19/d45/d38/f39 [429061,9399] 0 2024-09-13T22:08:46.219 INFO:tasks.workunit.client.0.smithi089.stdout:9/800: dwrite d6/d18/d1b/d89/db8/dbe/f10c [0,4194304] 0 2024-09-13T22:08:46.219 INFO:tasks.workunit.client.0.smithi089.stdout:9/801: truncate d6/d18/dab/f41 4508646 0 2024-09-13T22:08:46.221 INFO:tasks.workunit.client.0.smithi089.stdout:9/802: mknod d6/d18/d1b/d3e/c10d 0 2024-09-13T22:08:46.221 INFO:tasks.workunit.client.0.smithi089.stdout:5/701: dread d4/f8 [0,4194304] 0 2024-09-13T22:08:46.222 INFO:tasks.workunit.client.0.smithi089.stdout:2/740: dwrite df/d5b/da5/fb7 [0,4194304] 0 2024-09-13T22:08:46.223 INFO:tasks.workunit.client.0.smithi089.stdout:2/741: dread - df/d1a/fda zero size 2024-09-13T22:08:46.223 INFO:tasks.workunit.client.0.smithi089.stdout:5/702: write d4/d19/d1e/d28/d31/d55/da4/fb6 [1251964,130287] 0 2024-09-13T22:08:46.225 INFO:tasks.workunit.client.0.smithi089.stdout:2/742: mknod df/d14/d66/d69/d2e/c100 0 2024-09-13T22:08:46.226 INFO:tasks.workunit.client.0.smithi089.stdout:5/703: symlink d4/d19/d1e/d28/lf4 0 2024-09-13T22:08:46.226 INFO:tasks.workunit.client.0.smithi089.stdout:5/704: readlink d4/d19/d1e/d28/d31/l82 0 2024-09-13T22:08:46.227 INFO:tasks.workunit.client.0.smithi089.stdout:5/705: truncate d4/d19/d1e/d28/d3d/dc9/f66 342193 0 2024-09-13T22:08:46.227 INFO:tasks.workunit.client.0.smithi089.stdout:5/706: chown d4/d19/d1e/d28/d31/d55/d58/d9d 225087471 1 2024-09-13T22:08:46.227 INFO:tasks.workunit.client.0.smithi089.stdout:5/707: truncate d4/d19/f56 1084612 0 2024-09-13T22:08:46.227 INFO:tasks.workunit.client.0.smithi089.stdout:5/708: fdatasync d4/d19/d1e/d28/d31/d55/f6d 0 2024-09-13T22:08:46.227 INFO:tasks.workunit.client.0.smithi089.stdout:5/709: dread - d4/d19/d1e/d28/d31/d55/fb0 zero size 2024-09-13T22:08:46.227 INFO:tasks.workunit.client.0.smithi089.stdout:5/710: creat d4/d19/d1e/d28/d31/d55/d58/d9d/ff5 x:0 0 0 2024-09-13T22:08:46.228 INFO:tasks.workunit.client.0.smithi089.stdout:5/711: symlink d4/d19/d1e/d28/d3d/dba/lf6 0 2024-09-13T22:08:46.228 INFO:tasks.workunit.client.0.smithi089.stdout:5/712: fdatasync d4/d19/d1e/d89/dce/f4e 0 2024-09-13T22:08:46.229 INFO:tasks.workunit.client.0.smithi089.stdout:5/713: write d4/d19/d1e/d53/d88/fc8 [394038,64678] 0 2024-09-13T22:08:46.231 INFO:tasks.workunit.client.0.smithi089.stdout:5/714: creat d4/d19/de4/ff7 x:0 0 0 2024-09-13T22:08:46.231 INFO:tasks.workunit.client.0.smithi089.stdout:5/715: stat d4/d19/d1e/l50 0 2024-09-13T22:08:46.232 INFO:tasks.workunit.client.0.smithi089.stdout:5/716: mkdir d4/d19/d1e/d28/d31/dd1/ddc/df8 0 2024-09-13T22:08:46.232 INFO:tasks.workunit.client.0.smithi089.stdout:3/773: dwrite d1/d2/d4/d1c/d7e/d40/d69/da1/f89 [0,4194304] 0 2024-09-13T22:08:46.234 INFO:tasks.workunit.client.0.smithi089.stdout:5/717: truncate d4/d19/d1e/d28/d31/fe9 490300 0 2024-09-13T22:08:46.234 INFO:tasks.workunit.client.0.smithi089.stdout:5/718: chown d4/d19/d1e/d28/d31/d55/d58/d84 0 1 2024-09-13T22:08:46.234 INFO:tasks.workunit.client.0.smithi089.stdout:5/719: fdatasync d4/f5 0 2024-09-13T22:08:46.234 INFO:tasks.workunit.client.0.smithi089.stdout:5/720: write d4/d19/d1e/d28/d3d/f7a [797644,87698] 0 2024-09-13T22:08:46.236 INFO:tasks.workunit.client.0.smithi089.stdout:5/721: rename d4/d19/f6f to d4/d19/d1e/d28/d31/d55/d58/d9d/ff9 0 2024-09-13T22:08:46.236 INFO:tasks.workunit.client.0.smithi089.stdout:5/722: chown d4/d19/l1a 59 1 2024-09-13T22:08:46.236 INFO:tasks.workunit.client.0.smithi089.stdout:5/723: chown d4/d19/d1e/fbf 30955 1 2024-09-13T22:08:46.236 INFO:tasks.workunit.client.0.smithi089.stdout:5/724: chown d4/d19/d1e/d89/dce/fe5 238759948 1 2024-09-13T22:08:46.237 INFO:tasks.workunit.client.0.smithi089.stdout:1/780: write d7/d40/dbe/d2b/d59/f85 [4516612,89482] 0 2024-09-13T22:08:46.237 INFO:tasks.workunit.client.0.smithi089.stdout:5/725: symlink d4/d19/d1e/d28/d3d/dba/lfa 0 2024-09-13T22:08:46.238 INFO:tasks.workunit.client.0.smithi089.stdout:2/743: dread df/d1a/d57/f8f [0,4194304] 0 2024-09-13T22:08:46.239 INFO:tasks.workunit.client.0.smithi089.stdout:5/726: mkdir d4/d19/d1e/d28/d31/d61/dfb 0 2024-09-13T22:08:46.239 INFO:tasks.workunit.client.0.smithi089.stdout:5/727: fsync d4/d19/d1e/d53/dae/fcd 0 2024-09-13T22:08:46.241 INFO:tasks.workunit.client.0.smithi089.stdout:7/740: dwrite d0/d19/d28/d1d/d3d/d9a/dcf/fce [0,4194304] 0 2024-09-13T22:08:46.242 INFO:tasks.workunit.client.0.smithi089.stdout:6/698: dwrite d0/d5/d1d/d2d/da0/faa [0,4194304] 0 2024-09-13T22:08:46.248 INFO:tasks.workunit.client.0.smithi089.stdout:7/741: mkdir d0/d19/dfe 0 2024-09-13T22:08:46.248 INFO:tasks.workunit.client.0.smithi089.stdout:7/742: chown d0/d19/d28/d1d/d2d/d55 26 1 2024-09-13T22:08:46.249 INFO:tasks.workunit.client.0.smithi089.stdout:5/728: write d4/d19/d1e/d53/f7e [1856634,66760] 0 2024-09-13T22:08:46.250 INFO:tasks.workunit.client.0.smithi089.stdout:2/744: dread df/d14/d66/d69/f44 [0,4194304] 0 2024-09-13T22:08:46.259 INFO:tasks.workunit.client.0.smithi089.stdout:5/729: getdents d4/d19/d1e/d28/d3d/dc9 0 2024-09-13T22:08:46.259 INFO:tasks.workunit.client.0.smithi089.stdout:5/730: write d4/d19/d1e/d28/d31/d61/d69/fde [985806,83571] 0 2024-09-13T22:08:46.261 INFO:tasks.workunit.client.0.smithi089.stdout:2/745: rmdir df/d5b/da5/dd7 39 2024-09-13T22:08:46.262 INFO:tasks.workunit.client.0.smithi089.stdout:3/774: dwrite d1/d2/d4/d1c/d7e/d40/d69/da1/f89 [4194304,4194304] 0 2024-09-13T22:08:46.264 INFO:tasks.workunit.client.0.smithi089.stdout:7/743: dread d0/d19/d28/d1d/d23/f35 [0,4194304] 0 2024-09-13T22:08:46.264 INFO:tasks.workunit.client.0.smithi089.stdout:1/781: dwrite d7/d40/dbe/d2b/d39/d73/da9/ffe [0,4194304] 0 2024-09-13T22:08:46.264 INFO:tasks.workunit.client.0.smithi089.stdout:1/782: write d7/de/de7/fa8 [541417,88661] 0 2024-09-13T22:08:46.265 INFO:tasks.workunit.client.0.smithi089.stdout:1/783: chown d7/d40/dbe/d2b/d39/d73/da9 9297101 1 2024-09-13T22:08:46.267 INFO:tasks.workunit.client.0.smithi089.stdout:4/852: sync 2024-09-13T22:08:46.267 INFO:tasks.workunit.client.0.smithi089.stdout:5/731: dread d4/ff [0,4194304] 0 2024-09-13T22:08:46.270 INFO:tasks.workunit.client.0.smithi089.stdout:1/784: symlink d7/d1c/l103 0 2024-09-13T22:08:46.271 INFO:tasks.workunit.client.0.smithi089.stdout:4/853: unlink d0/d15/fa6 0 2024-09-13T22:08:46.272 INFO:tasks.workunit.client.0.smithi089.stdout:2/746: read df/d5b/f73 [2547872,122085] 0 2024-09-13T22:08:46.272 INFO:tasks.workunit.client.0.smithi089.stdout:2/747: stat df/d76/d85/ff2 0 2024-09-13T22:08:46.272 INFO:tasks.workunit.client.0.smithi089.stdout:5/732: symlink d4/d19/d1e/d28/d31/d55/d58/d84/lfc 0 2024-09-13T22:08:46.273 INFO:tasks.workunit.client.0.smithi089.stdout:4/854: mknod d0/d15/c108 0 2024-09-13T22:08:46.275 INFO:tasks.workunit.client.0.smithi089.stdout:2/748: mkdir df/d14/d2b/d101 0 2024-09-13T22:08:46.276 INFO:tasks.workunit.client.0.smithi089.stdout:5/733: mkdir d4/d19/d1e/d28/d31/dfd 0 2024-09-13T22:08:46.278 INFO:tasks.workunit.client.0.smithi089.stdout:4/855: mknod d0/d2c/d52/da5/d9d/ddb/de2/dcd/c109 0 2024-09-13T22:08:46.281 INFO:tasks.workunit.client.0.smithi089.stdout:4/856: link d0/d15/d76/f7f d0/d2c/d52/da5/d9d/ddf/df8/f10a 0 2024-09-13T22:08:46.281 INFO:tasks.workunit.client.0.smithi089.stdout:4/857: readlink d0/d11/d16/le5 0 2024-09-13T22:08:46.281 INFO:tasks.workunit.client.0.smithi089.stdout:4/858: write d0/d11/d16/f80 [1775681,30710] 0 2024-09-13T22:08:46.281 INFO:tasks.workunit.client.0.smithi089.stdout:5/734: symlink d4/d19/lfe 0 2024-09-13T22:08:46.283 INFO:tasks.workunit.client.0.smithi089.stdout:4/859: creat d0/d2c/d52/da5/d8e/f10b x:0 0 0 2024-09-13T22:08:46.284 INFO:tasks.workunit.client.0.smithi089.stdout:5/735: creat d4/d19/d1e/d28/d31/d94/fff x:0 0 0 2024-09-13T22:08:46.285 INFO:tasks.workunit.client.0.smithi089.stdout:4/860: creat d0/d2c/d52/da5/d9d/f10c x:0 0 0 2024-09-13T22:08:46.303 INFO:tasks.workunit.client.0.smithi089.stdout:7/744: dwrite d0/d19/d28/d1d/d23/f7f [0,4194304] 0 2024-09-13T22:08:46.304 INFO:tasks.workunit.client.0.smithi089.stdout:2/749: dwrite df/d14/d2b/d61/f96 [0,4194304] 0 2024-09-13T22:08:46.304 INFO:tasks.workunit.client.0.smithi089.stdout:3/775: dwrite d1/d2/d96/d102/fdf [0,4194304] 0 2024-09-13T22:08:46.305 INFO:tasks.workunit.client.0.smithi089.stdout:1/785: dwrite d7/d34/d5c/d5d/f62 [0,4194304] 0 2024-09-13T22:08:46.306 INFO:tasks.workunit.client.0.smithi089.stdout:7/745: creat d0/d19/d45/de7/d90/db2/fff x:0 0 0 2024-09-13T22:08:46.311 INFO:tasks.workunit.client.0.smithi089.stdout:1/786: symlink d7/df6/l104 0 2024-09-13T22:08:46.313 INFO:tasks.workunit.client.0.smithi089.stdout:5/736: dwrite d4/d19/d1e/d28/d31/fa9 [0,4194304] 0 2024-09-13T22:08:46.319 INFO:tasks.workunit.client.0.smithi089.stdout:4/861: dwrite d0/d2c/d35/ff7 [0,4194304] 0 2024-09-13T22:08:46.325 INFO:tasks.workunit.client.0.smithi089.stdout:5/737: dread d4/d19/d1e/d28/d31/f97 [0,4194304] 0 2024-09-13T22:08:46.326 INFO:tasks.workunit.client.0.smithi089.stdout:5/738: readlink d4/d19/d1e/d28/lf4 0 2024-09-13T22:08:46.326 INFO:tasks.workunit.client.0.smithi089.stdout:4/862: rmdir d0/d2c/da1 39 2024-09-13T22:08:46.328 INFO:tasks.workunit.client.0.smithi089.stdout:5/739: creat d4/d19/d1e/d28/d31/d61/f100 x:0 0 0 2024-09-13T22:08:46.328 INFO:tasks.workunit.client.0.smithi089.stdout:5/740: read d4/d19/d1e/d28/d31/f40 [2277402,120131] 0 2024-09-13T22:08:46.328 INFO:tasks.workunit.client.0.smithi089.stdout:5/741: chown d4/d19/d1e/d89/dce/c9a 229440837 1 2024-09-13T22:08:46.328 INFO:tasks.workunit.client.0.smithi089.stdout:5/742: fdatasync d4/d19/d1e/d28/d31/d55/dcc/f47 0 2024-09-13T22:08:46.329 INFO:tasks.workunit.client.0.smithi089.stdout:4/863: creat d0/d15/d1f/f10d x:0 0 0 2024-09-13T22:08:46.329 INFO:tasks.workunit.client.0.smithi089.stdout:4/864: fsync d0/d2c/da1/fd1 0 2024-09-13T22:08:46.330 INFO:tasks.workunit.client.0.smithi089.stdout:4/865: mknod d0/d2c/da0/da9/c10e 0 2024-09-13T22:08:46.331 INFO:tasks.workunit.client.0.smithi089.stdout:4/866: mknod d0/d2c/d52/da5/d9d/ddf/c10f 0 2024-09-13T22:08:46.331 INFO:tasks.workunit.client.0.smithi089.stdout:4/867: fdatasync d0/d15/d1f/f10d 0 2024-09-13T22:08:46.334 INFO:tasks.workunit.client.0.smithi089.stdout:4/868: dread d0/d11/d16/d89/f95 [0,4194304] 0 2024-09-13T22:08:46.335 INFO:tasks.workunit.client.0.smithi089.stdout:4/869: mkdir d0/d11/d16/d89/d110 0 2024-09-13T22:08:46.336 INFO:tasks.workunit.client.0.smithi089.stdout:4/870: mkdir d0/d2c/d52/da5/d9d/d111 0 2024-09-13T22:08:46.337 INFO:tasks.workunit.client.0.smithi089.stdout:4/871: unlink d0/d15/l1d 0 2024-09-13T22:08:46.337 INFO:tasks.workunit.client.0.smithi089.stdout:5/743: dread d4/d19/d1e/fbf [0,4194304] 0 2024-09-13T22:08:46.337 INFO:tasks.workunit.client.0.smithi089.stdout:5/744: rmdir d4/d19/d1e/d28/d31/d61/d69 39 2024-09-13T22:08:46.338 INFO:tasks.workunit.client.0.smithi089.stdout:5/745: truncate d4/d19/d1e/d28/d31/f52 2568390 0 2024-09-13T22:08:46.342 INFO:tasks.workunit.client.0.smithi089.stdout:5/746: read d4/d19/d1e/d28/d31/f97 [3173820,62648] 0 2024-09-13T22:08:46.344 INFO:tasks.workunit.client.0.smithi089.stdout:4/872: dread d0/d2c/f84 [0,4194304] 0 2024-09-13T22:08:46.346 INFO:tasks.workunit.client.0.smithi089.stdout:5/747: dread d4/d19/d1e/d28/d31/f75 [0,4194304] 0 2024-09-13T22:08:46.347 INFO:tasks.workunit.client.0.smithi089.stdout:5/748: mkdir d4/d19/d1e/d28/d31/d55/d58/d84/d101 0 2024-09-13T22:08:46.347 INFO:tasks.workunit.client.0.smithi089.stdout:5/749: symlink d4/d19/d1e/d28/d31/d55/dcc/l102 0 2024-09-13T22:08:46.349 INFO:tasks.workunit.client.0.smithi089.stdout:5/750: unlink d4/d19/d1e/d28/ca3 0 2024-09-13T22:08:46.350 INFO:tasks.workunit.client.0.smithi089.stdout:5/751: rmdir d4/d19/d1e 39 2024-09-13T22:08:46.350 INFO:tasks.workunit.client.0.smithi089.stdout:5/752: readlink d4/d19/d1e/d28/d3d/dba/lf6 0 2024-09-13T22:08:46.350 INFO:tasks.workunit.client.0.smithi089.stdout:5/753: creat d4/d19/d1e/d28/d31/d55/f103 x:0 0 0 2024-09-13T22:08:46.353 INFO:tasks.workunit.client.0.smithi089.stdout:5/754: unlink d4/d19/d1e/d28/d31/d61/c81 0 2024-09-13T22:08:46.353 INFO:tasks.workunit.client.0.smithi089.stdout:5/755: creat d4/d19/de4/f104 x:0 0 0 2024-09-13T22:08:46.353 INFO:tasks.workunit.client.0.smithi089.stdout:3/776: dwrite d1/d2/d23/d3d/d54/d5d/deb/d97/fa2 [0,4194304] 0 2024-09-13T22:08:46.353 INFO:tasks.workunit.client.0.smithi089.stdout:3/777: truncate d1/d2/d4/d1c/d7e/d40/fdb 354600 0 2024-09-13T22:08:46.353 INFO:tasks.workunit.client.0.smithi089.stdout:3/778: chown d1/d2/d31/fe9 148188 1 2024-09-13T22:08:46.354 INFO:tasks.workunit.client.0.smithi089.stdout:1/787: dwrite d7/d34/f7e [0,4194304] 0 2024-09-13T22:08:46.357 INFO:tasks.workunit.client.0.smithi089.stdout:3/779: mknod d1/d2/d23/d3d/d54/d5d/deb/d63/da4/c10b 0 2024-09-13T22:08:46.357 INFO:tasks.workunit.client.0.smithi089.stdout:3/780: read d1/d2/fc5 [99122,26045] 0 2024-09-13T22:08:46.359 INFO:tasks.workunit.client.0.smithi089.stdout:1/788: mkdir d7/de/da0/d105 0 2024-09-13T22:08:46.360 INFO:tasks.workunit.client.0.smithi089.stdout:3/781: mknod d1/d2/d4/d1c/d7e/d40/d69/da1/c10c 0 2024-09-13T22:08:46.360 INFO:tasks.workunit.client.0.smithi089.stdout:3/782: write d1/d2/d23/d3d/dda/d5c/fe8 [975529,32376] 0 2024-09-13T22:08:46.360 INFO:tasks.workunit.client.0.smithi089.stdout:3/783: chown d1/d2/d23/d3d/d54/c103 219568489 1 2024-09-13T22:08:46.361 INFO:tasks.workunit.client.0.smithi089.stdout:8/804: sync 2024-09-13T22:08:46.361 INFO:tasks.workunit.client.0.smithi089.stdout:8/805: chown d0/dd/db0/d20/d36/d68 153 1 2024-09-13T22:08:46.362 INFO:tasks.workunit.client.0.smithi089.stdout:8/806: read d0/dd/db0/d20/d36/d59/d89/f2d [92216,43604] 0 2024-09-13T22:08:46.364 INFO:tasks.workunit.client.0.smithi089.stdout:1/789: dread d7/d34/f37 [0,4194304] 0 2024-09-13T22:08:46.364 INFO:tasks.workunit.client.0.smithi089.stdout:8/807: creat d0/dd/db0/d20/d36/d59/d89/dca/f119 x:0 0 0 2024-09-13T22:08:46.364 INFO:tasks.workunit.client.0.smithi089.stdout:8/808: readlink d0/dd/l3c 0 2024-09-13T22:08:46.364 INFO:tasks.workunit.client.0.smithi089.stdout:8/809: fdatasync d0/dd/db0/d20/d36/d80/d3b/f112 0 2024-09-13T22:08:46.365 INFO:tasks.workunit.client.0.smithi089.stdout:7/746: dwrite d0/d19/d28/d1d/f5f [0,4194304] 0 2024-09-13T22:08:46.366 INFO:tasks.workunit.client.0.smithi089.stdout:4/873: dwrite d0/d11/f30 [0,4194304] 0 2024-09-13T22:08:46.367 INFO:tasks.workunit.client.0.smithi089.stdout:5/756: write d4/f54 [2948512,79072] 0 2024-09-13T22:08:46.367 INFO:tasks.workunit.client.0.smithi089.stdout:2/750: dwrite df/d14/d2b/fd3 [0,4194304] 0 2024-09-13T22:08:46.368 INFO:tasks.workunit.client.0.smithi089.stdout:4/874: symlink d0/d2c/d35/l112 0 2024-09-13T22:08:46.368 INFO:tasks.workunit.client.0.smithi089.stdout:3/784: dread d1/d2/d23/f98 [0,4194304] 0 2024-09-13T22:08:46.373 INFO:tasks.workunit.client.0.smithi089.stdout:8/810: write d0/dd/db0/d20/d40/d4a/d7f/fbb [784666,21964] 0 2024-09-13T22:08:46.373 INFO:tasks.workunit.client.0.smithi089.stdout:8/811: fdatasync d0/dd/db0/d20/f17 0 2024-09-13T22:08:46.373 INFO:tasks.workunit.client.0.smithi089.stdout:8/812: write d0/dd/db0/d20/f17 [288,23638] 0 2024-09-13T22:08:46.377 INFO:tasks.workunit.client.0.smithi089.stdout:5/757: creat d4/d19/d1e/d28/d31/dd1/ddc/df8/f105 x:0 0 0 2024-09-13T22:08:46.377 INFO:tasks.workunit.client.0.smithi089.stdout:5/758: read d4/d19/d1e/d28/d3d/dc9/fa7 [1859044,62540] 0 2024-09-13T22:08:46.378 INFO:tasks.workunit.client.0.smithi089.stdout:4/875: symlink d0/d2c/d52/da5/d9d/ddf/df8/l113 0 2024-09-13T22:08:46.378 INFO:tasks.workunit.client.0.smithi089.stdout:4/876: chown d0/d2c/f45 4726 1 2024-09-13T22:08:46.379 INFO:tasks.workunit.client.0.smithi089.stdout:4/877: stat d0/d2c/d52/da5/d9d/ddb/de2/c97 0 2024-09-13T22:08:46.379 INFO:tasks.workunit.client.0.smithi089.stdout:4/878: readlink d0/d11/l4a 0 2024-09-13T22:08:46.379 INFO:tasks.workunit.client.0.smithi089.stdout:4/879: readlink d0/d2c/d35/d74/lef 0 2024-09-13T22:08:46.379 INFO:tasks.workunit.client.0.smithi089.stdout:4/880: write d0/d2c/d52/da5/d9d/ddb/feb [126107,38875] 0 2024-09-13T22:08:46.379 INFO:tasks.workunit.client.0.smithi089.stdout:3/785: creat d1/d2/d4/f10d x:0 0 0 2024-09-13T22:08:46.379 INFO:tasks.workunit.client.0.smithi089.stdout:3/786: chown d1/d2/d4/d1c/d7e/d40/l75 12 1 2024-09-13T22:08:46.381 INFO:tasks.workunit.client.0.smithi089.stdout:8/813: mkdir d0/dd/db0/d20/d1c/d5a/d11a 0 2024-09-13T22:08:46.381 INFO:tasks.workunit.client.0.smithi089.stdout:8/814: read d0/dd/db0/d20/f17 [149500,38154] 0 2024-09-13T22:08:46.382 INFO:tasks.workunit.client.0.smithi089.stdout:3/787: mkdir d1/d2/d23/d3d/d46/dab/d10e 0 2024-09-13T22:08:46.384 INFO:tasks.workunit.client.0.smithi089.stdout:3/788: symlink d1/d2/d4/d1c/d7f/l10f 0 2024-09-13T22:08:46.384 INFO:tasks.workunit.client.0.smithi089.stdout:4/881: dread d0/d15/f7d [0,4194304] 0 2024-09-13T22:08:46.384 INFO:tasks.workunit.client.0.smithi089.stdout:4/882: fdatasync d0/d2c/d35/d64/d6e/f77 0 2024-09-13T22:08:46.384 INFO:tasks.workunit.client.0.smithi089.stdout:1/790: dwrite d7/d1c/d3c/f3f [4194304,4194304] 0 2024-09-13T22:08:46.389 INFO:tasks.workunit.client.0.smithi089.stdout:2/751: dwrite df/f74 [0,4194304] 0 2024-09-13T22:08:46.389 INFO:tasks.workunit.client.0.smithi089.stdout:2/752: dread - df/d14/d66/f70 zero size 2024-09-13T22:08:46.389 INFO:tasks.workunit.client.0.smithi089.stdout:2/753: chown df/d5b/f86 0 1 2024-09-13T22:08:46.392 INFO:tasks.workunit.client.0.smithi089.stdout:5/759: write d4/f8 [580155,83271] 0 2024-09-13T22:08:46.393 INFO:tasks.workunit.client.0.smithi089.stdout:2/754: rename df/d14/f21 to df/d14/d48/d88/db9/f102 0 2024-09-13T22:08:46.393 INFO:tasks.workunit.client.0.smithi089.stdout:2/755: readlink df/d14/d48/d88/db9/dec/lf1 0 2024-09-13T22:08:46.394 INFO:tasks.workunit.client.0.smithi089.stdout:2/756: read df/d14/d66/d69/d2e/f7f [318833,19058] 0 2024-09-13T22:08:46.396 INFO:tasks.workunit.client.0.smithi089.stdout:5/760: write d4/d19/d1e/d28/d31/d55/d58/fad [648052,115663] 0 2024-09-13T22:08:46.396 INFO:tasks.workunit.client.0.smithi089.stdout:5/761: dread - d4/d19/d1e/d28/d3d/faf zero size 2024-09-13T22:08:46.397 INFO:tasks.workunit.client.0.smithi089.stdout:6/699: sync 2024-09-13T22:08:46.397 INFO:tasks.workunit.client.0.smithi089.stdout:9/803: sync 2024-09-13T22:08:46.397 INFO:tasks.workunit.client.0.smithi089.stdout:9/804: readlink d6/d31/l6b 0 2024-09-13T22:08:46.398 INFO:tasks.workunit.client.0.smithi089.stdout:5/762: mkdir d4/d19/d1e/d28/d3d/dc9/d106 0 2024-09-13T22:08:46.399 INFO:tasks.workunit.client.0.smithi089.stdout:5/763: write d4/d19/d1e/d89/dce/f4e [1574474,26207] 0 2024-09-13T22:08:46.400 INFO:tasks.workunit.client.0.smithi089.stdout:6/700: creat d0/d5/d43/fd7 x:0 0 0 2024-09-13T22:08:46.403 INFO:tasks.workunit.client.0.smithi089.stdout:9/805: unlink d6/d18/d21/d5d/lfe 0 2024-09-13T22:08:46.403 INFO:tasks.workunit.client.0.smithi089.stdout:9/806: fsync d6/d18/f32 0 2024-09-13T22:08:46.403 INFO:tasks.workunit.client.0.smithi089.stdout:9/807: write d6/d18/d21/f27 [65673,62526] 0 2024-09-13T22:08:46.409 INFO:tasks.workunit.client.0.smithi089.stdout:2/757: write df/d14/d66/d69/f44 [1915922,122574] 0 2024-09-13T22:08:46.409 INFO:tasks.workunit.client.0.smithi089.stdout:2/758: getdents df/d14/d66/d69/db5 0 2024-09-13T22:08:46.409 INFO:tasks.workunit.client.0.smithi089.stdout:5/764: unlink d4/d19/d1e/d28/d31/d55/d58/fab 0 2024-09-13T22:08:46.412 INFO:tasks.workunit.client.0.smithi089.stdout:5/765: rename d4/d19/d1e/d28/d31/d55/da4/dd2 to d4/d19/d107 0 2024-09-13T22:08:46.414 INFO:tasks.workunit.client.0.smithi089.stdout:5/766: symlink d4/d19/d1e/d28/d31/d55/d58/d9d/l108 0 2024-09-13T22:08:46.414 INFO:tasks.workunit.client.0.smithi089.stdout:5/767: readlink d4/d19/d1e/d53/lb5 0 2024-09-13T22:08:46.414 INFO:tasks.workunit.client.0.smithi089.stdout:5/768: chown d4/d19/d1e/d28/l2c 1 1 2024-09-13T22:08:46.414 INFO:tasks.workunit.client.0.smithi089.stdout:5/769: chown d4/d19/d1e/d28/d31/d55 9129 1 2024-09-13T22:08:46.428 INFO:tasks.workunit.client.0.smithi089.stdout:8/815: dwrite d0/dd/db0/d20/d36/f95 [0,4194304] 0 2024-09-13T22:08:46.441 INFO:tasks.workunit.client.0.smithi089.stdout:1/791: dwrite d7/de/d3a/d77/fa2 [0,4194304] 0 2024-09-13T22:08:46.441 INFO:tasks.workunit.client.0.smithi089.stdout:1/792: chown d7/d1c/d3c 0 1 2024-09-13T22:08:46.443 INFO:tasks.workunit.client.0.smithi089.stdout:1/793: symlink d7/de/da0/dbd/l106 0 2024-09-13T22:08:46.443 INFO:tasks.workunit.client.0.smithi089.stdout:1/794: chown d7/d34/faa 229991660 1 2024-09-13T22:08:46.443 INFO:tasks.workunit.client.0.smithi089.stdout:6/701: dwrite d0/d5/d43/f8a [0,4194304] 0 2024-09-13T22:08:46.444 INFO:tasks.workunit.client.0.smithi089.stdout:2/759: dwrite df/d76/d85/db2/fb6 [0,4194304] 0 2024-09-13T22:08:46.444 INFO:tasks.workunit.client.0.smithi089.stdout:3/789: dwrite d1/d2/f82 [0,4194304] 0 2024-09-13T22:08:46.444 INFO:tasks.workunit.client.0.smithi089.stdout:9/808: dwrite d6/d55/f6d [0,4194304] 0 2024-09-13T22:08:46.448 INFO:tasks.workunit.client.0.smithi089.stdout:2/760: symlink df/d14/d66/d69/db5/l103 0 2024-09-13T22:08:46.448 INFO:tasks.workunit.client.0.smithi089.stdout:2/761: chown df/d1a/f81 1577908665 1 2024-09-13T22:08:46.448 INFO:tasks.workunit.client.0.smithi089.stdout:2/762: chown df/d14/d48/d88/db9/dec/ff7 10 1 2024-09-13T22:08:46.449 INFO:tasks.workunit.client.0.smithi089.stdout:5/770: getdents d4/d19/d1e/d28/d3d/dc9 0 2024-09-13T22:08:46.450 INFO:tasks.workunit.client.0.smithi089.stdout:2/763: dread df/d5b/da5/dd7/ff0 [0,4194304] 0 2024-09-13T22:08:46.453 INFO:tasks.workunit.client.0.smithi089.stdout:3/790: rename d1/d2/d23/d3d/d54/l88 to d1/l110 0 2024-09-13T22:08:46.454 INFO:tasks.workunit.client.0.smithi089.stdout:3/791: creat d1/d2/de4/f111 x:0 0 0 2024-09-13T22:08:46.458 INFO:tasks.workunit.client.0.smithi089.stdout:1/795: write d7/d40/dbe/d2b/d39/d73/da9/ffe [274070,50065] 0 2024-09-13T22:08:46.458 INFO:tasks.workunit.client.0.smithi089.stdout:4/883: dwrite d0/d2c/d35/d5d/da4/fe8 [0,4194304] 0 2024-09-13T22:08:46.459 INFO:tasks.workunit.client.0.smithi089.stdout:4/884: truncate d0/d2c/d52/da5/d9d/f10c 210692 0 2024-09-13T22:08:46.460 INFO:tasks.workunit.client.0.smithi089.stdout:5/771: link d4/d19/lfe d4/d19/d1e/d28/d31/d55/dcc/l109 0 2024-09-13T22:08:46.462 INFO:tasks.workunit.client.0.smithi089.stdout:2/764: unlink df/d14/d2b/f63 0 2024-09-13T22:08:46.462 INFO:tasks.workunit.client.0.smithi089.stdout:2/765: dread - df/d14/d48/d88/fa2 zero size 2024-09-13T22:08:46.463 INFO:tasks.workunit.client.0.smithi089.stdout:5/772: write d4/d19/d1e/d28/d31/f52 [2031803,104074] 0 2024-09-13T22:08:46.467 INFO:tasks.workunit.client.0.smithi089.stdout:1/796: unlink d7/d1c/d3c/c76 0 2024-09-13T22:08:46.467 INFO:tasks.workunit.client.0.smithi089.stdout:1/797: write d7/d1c/d3c/f49 [1380968,24173] 0 2024-09-13T22:08:46.468 INFO:tasks.workunit.client.0.smithi089.stdout:4/885: mknod d0/d2c/d52/da5/d9d/ddb/c114 0 2024-09-13T22:08:46.468 INFO:tasks.workunit.client.0.smithi089.stdout:4/886: read - d0/d2c/da1/fff zero size 2024-09-13T22:08:46.468 INFO:tasks.workunit.client.0.smithi089.stdout:4/887: creat d0/d11/d16/f115 x:0 0 0 2024-09-13T22:08:46.470 INFO:tasks.workunit.client.0.smithi089.stdout:9/809: dwrite d6/d18/f1f [0,4194304] 0 2024-09-13T22:08:46.470 INFO:tasks.workunit.client.0.smithi089.stdout:9/810: truncate d6/d18/fbb 489661 0 2024-09-13T22:08:46.472 INFO:tasks.workunit.client.0.smithi089.stdout:4/888: rename d0/d2c/d35/d64/cf9 to d0/d2c/d52/df0/c116 0 2024-09-13T22:08:46.474 INFO:tasks.workunit.client.0.smithi089.stdout:2/766: dread df/d1a/d57/d68/f7c [0,4194304] 0 2024-09-13T22:08:46.475 INFO:tasks.workunit.client.0.smithi089.stdout:4/889: mkdir d0/d2c/d52/da5/d9d/ddb/de2/dcd/d117 0 2024-09-13T22:08:46.476 INFO:tasks.workunit.client.0.smithi089.stdout:4/890: fdatasync d0/d15/d1f/f10d 0 2024-09-13T22:08:46.477 INFO:tasks.workunit.client.0.smithi089.stdout:4/891: creat d0/d15/d1f/d75/dee/f118 x:0 0 0 2024-09-13T22:08:46.479 INFO:tasks.workunit.client.0.smithi089.stdout:4/892: truncate d0/d2c/d35/f87 494864 0 2024-09-13T22:08:46.479 INFO:tasks.workunit.client.0.smithi089.stdout:4/893: dread - d0/d2c/d8d/f94 zero size 2024-09-13T22:08:46.479 INFO:tasks.workunit.client.0.smithi089.stdout:4/894: stat d0/d2c/d52/l6c 0 2024-09-13T22:08:46.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/792: getdents d1/d2/de4 0 2024-09-13T22:08:46.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/793: write d1/d2/d23/d3d/d54/d5d/deb/d63/f6d [9600069,53014] 0 2024-09-13T22:08:46.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/794: fsync d1/d2/d23/d3d/dda/f61 0 2024-09-13T22:08:46.479 INFO:tasks.workunit.client.0.smithi089.stdout:5/773: dwrite d4/d19/d1e/d28/d31/fe9 [0,4194304] 0 2024-09-13T22:08:46.480 INFO:tasks.workunit.client.0.smithi089.stdout:4/895: rename d0/d15/d1f/fb1 to d0/d15/f119 0 2024-09-13T22:08:46.481 INFO:tasks.workunit.client.0.smithi089.stdout:3/795: mknod d1/c112 0 2024-09-13T22:08:46.481 INFO:tasks.workunit.client.0.smithi089.stdout:3/796: fsync d1/d2/d23/d3d/d54/d5d/deb/fd0 0 2024-09-13T22:08:46.483 INFO:tasks.workunit.client.0.smithi089.stdout:5/774: mknod d4/d19/d1e/d89/dce/c10a 0 2024-09-13T22:08:46.483 INFO:tasks.workunit.client.0.smithi089.stdout:5/775: chown d4/d19/d1e/d28/d31/dd1/ddc/df8/f105 29527593 1 2024-09-13T22:08:46.484 INFO:tasks.workunit.client.0.smithi089.stdout:4/896: mknod d0/d2c/da1/c11a 0 2024-09-13T22:08:46.486 INFO:tasks.workunit.client.0.smithi089.stdout:5/776: rename d4/d19/d1e/d28/d31/d61/d69/fde to d4/d19/d1e/d28/d31/d55/d58/d84/d101/f10b 0 2024-09-13T22:08:46.486 INFO:tasks.workunit.client.0.smithi089.stdout:5/777: stat d4/d19/d1e/d89/dce/f4e 0 2024-09-13T22:08:46.486 INFO:tasks.workunit.client.0.smithi089.stdout:5/778: chown d4/d19/c70 393302214 1 2024-09-13T22:08:46.486 INFO:tasks.workunit.client.0.smithi089.stdout:5/779: creat d4/d19/d1e/d53/d88/f10c x:0 0 0 2024-09-13T22:08:46.486 INFO:tasks.workunit.client.0.smithi089.stdout:7/747: sync 2024-09-13T22:08:46.486 INFO:tasks.workunit.client.0.smithi089.stdout:7/748: fdatasync d0/d19/d45/d38/d54/fe9 0 2024-09-13T22:08:46.488 INFO:tasks.workunit.client.0.smithi089.stdout:5/780: symlink d4/d19/d1e/d28/d31/d55/l10d 0 2024-09-13T22:08:46.488 INFO:tasks.workunit.client.0.smithi089.stdout:5/781: truncate d4/d19/d1e/d28/d31/d61/d69/fda 251990 0 2024-09-13T22:08:46.489 INFO:tasks.workunit.client.0.smithi089.stdout:5/782: link d4/d19/d1e/d28/fcb d4/d19/d1e/d28/d3d/dc9/f10e 0 2024-09-13T22:08:46.490 INFO:tasks.workunit.client.0.smithi089.stdout:5/783: mkdir d4/d19/d1e/d28/d31/dfd/d10f 0 2024-09-13T22:08:46.490 INFO:tasks.workunit.client.0.smithi089.stdout:5/784: creat d4/d19/d1e/d28/d31/d61/f110 x:0 0 0 2024-09-13T22:08:46.491 INFO:tasks.workunit.client.0.smithi089.stdout:2/767: dwrite df/d5b/da5/dd7/ff0 [0,4194304] 0 2024-09-13T22:08:46.497 INFO:tasks.workunit.client.0.smithi089.stdout:2/768: link df/d14/d2b/c5a df/d1a/d57/d68/c104 0 2024-09-13T22:08:46.497 INFO:tasks.workunit.client.0.smithi089.stdout:2/769: stat df/d5b/da5/db8/dbf 0 2024-09-13T22:08:46.497 INFO:tasks.workunit.client.0.smithi089.stdout:4/897: write d0/f23 [5727623,38262] 0 2024-09-13T22:08:46.500 INFO:tasks.workunit.client.0.smithi089.stdout:7/749: dread d0/d19/d28/d61/f87 [0,4194304] 0 2024-09-13T22:08:46.500 INFO:tasks.workunit.client.0.smithi089.stdout:4/898: unlink d0/d2c/d52/da5/d9d/fd2 0 2024-09-13T22:08:46.503 INFO:tasks.workunit.client.0.smithi089.stdout:5/785: fsync d4/d19/d1e/d28/fcb 0 2024-09-13T22:08:46.503 INFO:tasks.workunit.client.0.smithi089.stdout:5/786: creat d4/d19/d1e/d28/d31/d55/d58/d9d/f111 x:0 0 0 2024-09-13T22:08:46.503 INFO:tasks.workunit.client.0.smithi089.stdout:5/787: readlink d4/d19/d1e/d28/d3d/dc9/l8b 0 2024-09-13T22:08:46.503 INFO:tasks.workunit.client.0.smithi089.stdout:5/788: truncate d4/d19/d1e/d28/d3d/faf 193413 0 2024-09-13T22:08:46.504 INFO:tasks.workunit.client.0.smithi089.stdout:3/797: dread d1/d2/d23/d3d/d54/d5d/deb/d63/f6d [4194304,4194304] 0 2024-09-13T22:08:46.504 INFO:tasks.workunit.client.0.smithi089.stdout:3/798: write d1/d2/d4/d1c/d7e/d40/d69/f70 [82699,3679] 0 2024-09-13T22:08:46.507 INFO:tasks.workunit.client.0.smithi089.stdout:5/789: rename d4/d19/d1e/d28/d3d/l9f to d4/d19/d1e/d53/l112 0 2024-09-13T22:08:46.515 INFO:tasks.workunit.client.0.smithi089.stdout:3/799: read d1/d2/ff [2577390,47274] 0 2024-09-13T22:08:46.515 INFO:tasks.workunit.client.0.smithi089.stdout:3/800: chown d1/f6 762 1 2024-09-13T22:08:46.518 INFO:tasks.workunit.client.0.smithi089.stdout:3/801: mknod d1/d2/d4/d1c/c113 0 2024-09-13T22:08:46.518 INFO:tasks.workunit.client.0.smithi089.stdout:3/802: chown d1/d2/d23/df7 0 1 2024-09-13T22:08:46.519 INFO:tasks.workunit.client.0.smithi089.stdout:3/803: truncate d1/d2/d4/f5e 5003278 0 2024-09-13T22:08:46.540 INFO:tasks.workunit.client.0.smithi089.stdout:2/770: dwrite df/d5b/da5/db8/dbf/fc0 [0,4194304] 0 2024-09-13T22:08:46.540 INFO:tasks.workunit.client.0.smithi089.stdout:2/771: truncate df/fef 555876 0 2024-09-13T22:08:46.540 INFO:tasks.workunit.client.0.smithi089.stdout:2/772: chown df/d14/d66/d69/d2e/f37 7 1 2024-09-13T22:08:46.541 INFO:tasks.workunit.client.0.smithi089.stdout:7/750: dwrite d0/d19/d45/d9b/fa6 [0,4194304] 0 2024-09-13T22:08:46.541 INFO:tasks.workunit.client.0.smithi089.stdout:4/899: dwrite d0/d15/d1f/d75/dee/d8c/fe7 [4194304,4194304] 0 2024-09-13T22:08:46.542 INFO:tasks.workunit.client.0.smithi089.stdout:2/773: rename df/d14/d48/f84 to df/d1a/f105 0 2024-09-13T22:08:46.545 INFO:tasks.workunit.client.0.smithi089.stdout:7/751: mkdir d0/d19/d28/d100 0 2024-09-13T22:08:46.547 INFO:tasks.workunit.client.0.smithi089.stdout:4/900: creat d0/d2c/da0/da9/f11b x:0 0 0 2024-09-13T22:08:46.548 INFO:tasks.workunit.client.0.smithi089.stdout:7/752: symlink d0/d19/d45/de7/d90/db2/l101 0 2024-09-13T22:08:46.548 INFO:tasks.workunit.client.0.smithi089.stdout:7/753: truncate d0/d19/d28/d1d/d23/d24/dac/f7c 478876 0 2024-09-13T22:08:46.549 INFO:tasks.workunit.client.0.smithi089.stdout:4/901: link d0/d15/d1f/cc4 d0/d15/d1f/d75/dee/dfb/c11c 0 2024-09-13T22:08:46.550 INFO:tasks.workunit.client.0.smithi089.stdout:7/754: creat d0/d19/d28/d1d/d3d/d9a/dcf/da8/dd8/f102 x:0 0 0 2024-09-13T22:08:46.551 INFO:tasks.workunit.client.0.smithi089.stdout:2/774: write df/d76/d85/ff2 [819769,60006] 0 2024-09-13T22:08:46.551 INFO:tasks.workunit.client.0.smithi089.stdout:4/902: mknod d0/d2c/d52/da5/d9d/ddf/df8/c11d 0 2024-09-13T22:08:46.551 INFO:tasks.workunit.client.0.smithi089.stdout:4/903: fsync d0/d2c/d8d/f9c 0 2024-09-13T22:08:46.551 INFO:tasks.workunit.client.0.smithi089.stdout:4/904: readlink d0/d2c/l33 0 2024-09-13T22:08:46.552 INFO:tasks.workunit.client.0.smithi089.stdout:7/755: mknod d0/c103 0 2024-09-13T22:08:46.554 INFO:tasks.workunit.client.0.smithi089.stdout:4/905: creat d0/d2c/d52/da5/f11e x:0 0 0 2024-09-13T22:08:46.555 INFO:tasks.workunit.client.0.smithi089.stdout:7/756: mknod d0/d19/d45/c104 0 2024-09-13T22:08:46.555 INFO:tasks.workunit.client.0.smithi089.stdout:2/775: rmdir df/d14/d66/d69 39 2024-09-13T22:08:46.556 INFO:tasks.workunit.client.0.smithi089.stdout:8/816: sync 2024-09-13T22:08:46.558 INFO:tasks.workunit.client.0.smithi089.stdout:8/817: mkdir d0/dd/db0/d42/dc7/d11b 0 2024-09-13T22:08:46.558 INFO:tasks.workunit.client.0.smithi089.stdout:8/818: dread - d0/dd/db0/d20/d36/d80/d3b/da5/fb3 zero size 2024-09-13T22:08:46.558 INFO:tasks.workunit.client.0.smithi089.stdout:7/757: rmdir d0/d19/d45/d92 39 2024-09-13T22:08:46.560 INFO:tasks.workunit.client.0.smithi089.stdout:8/819: rename d0/dd/db0/d20/d36/d80/d3b/da5/f10f to d0/dd/db0/d20/d1c/f11c 0 2024-09-13T22:08:46.561 INFO:tasks.workunit.client.0.smithi089.stdout:4/906: write d0/f13 [2565600,74895] 0 2024-09-13T22:08:46.561 INFO:tasks.workunit.client.0.smithi089.stdout:7/758: link d0/d19/d45/d92/ff4 d0/d19/dfe/f105 0 2024-09-13T22:08:46.562 INFO:tasks.workunit.client.0.smithi089.stdout:4/907: mknod d0/d15/d1f/c11f 0 2024-09-13T22:08:46.563 INFO:tasks.workunit.client.0.smithi089.stdout:4/908: dread - d0/d2c/d35/d74/f9b zero size 2024-09-13T22:08:46.563 INFO:tasks.workunit.client.0.smithi089.stdout:4/909: fdatasync d0/d15/d1f/f31 0 2024-09-13T22:08:46.565 INFO:tasks.workunit.client.0.smithi089.stdout:4/910: link d0/d15/d1f/d75/dee/d8c/c101 d0/d2c/d35/d74/c120 0 2024-09-13T22:08:46.566 INFO:tasks.workunit.client.0.smithi089.stdout:4/911: chown d0/l66 12464424 1 2024-09-13T22:08:46.573 INFO:tasks.workunit.client.0.smithi089.stdout:8/820: dread d0/dd/db0/fa2 [0,4194304] 0 2024-09-13T22:08:46.574 INFO:tasks.workunit.client.0.smithi089.stdout:8/821: creat d0/dd/db0/d42/dc7/dfa/f11d x:0 0 0 2024-09-13T22:08:46.575 INFO:tasks.workunit.client.0.smithi089.stdout:8/822: creat d0/dd/db0/d42/dc7/d10d/f11e x:0 0 0 2024-09-13T22:08:46.575 INFO:tasks.workunit.client.0.smithi089.stdout:8/823: write d0/dd/db0/d20/d36/d68/de6/ffd [1703143,22462] 0 2024-09-13T22:08:46.577 INFO:tasks.workunit.client.0.smithi089.stdout:8/824: link d0/dd/db0/d20/d40/d4a/d7f/fcc d0/dd/db0/d20/d1c/d5a/d63/dce/d114/dde/f11f 0 2024-09-13T22:08:46.577 INFO:tasks.workunit.client.0.smithi089.stdout:8/825: truncate d0/dd/db0/d20/d36/d59/d89/f2d 2082701 0 2024-09-13T22:08:46.586 INFO:tasks.workunit.client.0.smithi089.stdout:7/759: dwrite d0/d19/dfe/f105 [0,4194304] 0 2024-09-13T22:08:46.598 INFO:tasks.workunit.client.0.smithi089.stdout:4/912: dwrite d0/d15/d1f/d75/dee/d8c/fe7 [8388608,4194304] 0 2024-09-13T22:08:46.598 INFO:tasks.workunit.client.0.smithi089.stdout:4/913: creat d0/d2c/d52/da5/d9d/ddb/de2/dcd/f121 x:0 0 0 2024-09-13T22:08:46.600 INFO:tasks.workunit.client.0.smithi089.stdout:4/914: creat d0/d2c/d52/da5/d9d/d111/f122 x:0 0 0 2024-09-13T22:08:46.601 INFO:tasks.workunit.client.0.smithi089.stdout:4/915: rename d0/d15/d1f/c4e to d0/d2c/d52/da5/d9d/ddb/de2/c123 0 2024-09-13T22:08:46.602 INFO:tasks.workunit.client.0.smithi089.stdout:2/776: dwrite df/d1a/ddf/feb [0,4194304] 0 2024-09-13T22:08:46.602 INFO:tasks.workunit.client.0.smithi089.stdout:2/777: dread - df/d1a/ddf/fea zero size 2024-09-13T22:08:46.602 INFO:tasks.workunit.client.0.smithi089.stdout:2/778: fsync df/d14/d48/d88/db9/dec/ff7 0 2024-09-13T22:08:46.602 INFO:tasks.workunit.client.0.smithi089.stdout:4/916: rmdir d0/d11/d16/d89/d110 0 2024-09-13T22:08:46.603 INFO:tasks.workunit.client.0.smithi089.stdout:8/826: dwrite d0/dd/db0/d20/d36/d80/f44 [0,4194304] 0 2024-09-13T22:08:46.603 INFO:tasks.workunit.client.0.smithi089.stdout:8/827: creat d0/dd/db0/d42/dc7/dfa/f120 x:0 0 0 2024-09-13T22:08:46.603 INFO:tasks.workunit.client.0.smithi089.stdout:8/828: write d0/dd/db0/d20/d36/d68/de6/ff9 [355105,98544] 0 2024-09-13T22:08:46.603 INFO:tasks.workunit.client.0.smithi089.stdout:8/829: chown d0/dd/db0/d20/d40/d4a/f9e 0 1 2024-09-13T22:08:46.606 INFO:tasks.workunit.client.0.smithi089.stdout:2/779: mkdir df/d14/d2b/d61/db1/d106 0 2024-09-13T22:08:46.607 INFO:tasks.workunit.client.0.smithi089.stdout:2/780: readlink df/d1a/d57/l64 0 2024-09-13T22:08:46.607 INFO:tasks.workunit.client.0.smithi089.stdout:7/760: dwrite d0/d19/d28/d1d/d23/d24/fbb [0,4194304] 0 2024-09-13T22:08:46.608 INFO:tasks.workunit.client.0.smithi089.stdout:4/917: rename d0/d2c/da0/fcf to d0/d2c/f124 0 2024-09-13T22:08:46.608 INFO:tasks.workunit.client.0.smithi089.stdout:4/918: stat d0/d11/l4a 0 2024-09-13T22:08:46.610 INFO:tasks.workunit.client.0.smithi089.stdout:8/830: mknod d0/dd/db0/d20/d36/d80/d3b/da5/d115/c121 0 2024-09-13T22:08:46.611 INFO:tasks.workunit.client.0.smithi089.stdout:2/781: mknod df/d5b/da5/dd7/c107 0 2024-09-13T22:08:46.611 INFO:tasks.workunit.client.0.smithi089.stdout:2/782: fsync df/d14/d66/d69/d2e/f3c 0 2024-09-13T22:08:46.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/831: dread d0/dd/f35 [0,4194304] 0 2024-09-13T22:08:46.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/832: readlink d0/dd/db0/d20/d36/d80/d3b/l4e 0 2024-09-13T22:08:46.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/833: write d0/dd/db0/d20/d36/d80/d3b/f8c [44636,122441] 0 2024-09-13T22:08:46.616 INFO:tasks.workunit.client.0.smithi089.stdout:7/761: link d0/d19/d28/d1d/d23/d24/f42 d0/d19/d45/f106 0 2024-09-13T22:08:46.617 INFO:tasks.workunit.client.0.smithi089.stdout:7/762: write d0/d19/d28/fdb [982702,20523] 0 2024-09-13T22:08:46.617 INFO:tasks.workunit.client.0.smithi089.stdout:7/763: truncate d0/d19/d28/d1d/d3d/d9a/dcf/fce 5093881 0 2024-09-13T22:08:46.617 INFO:tasks.workunit.client.0.smithi089.stdout:4/919: creat d0/d11/f125 x:0 0 0 2024-09-13T22:08:46.617 INFO:tasks.workunit.client.0.smithi089.stdout:4/920: readlink d0/d2c/d35/d64/ld8 0 2024-09-13T22:08:46.617 INFO:tasks.workunit.client.0.smithi089.stdout:4/921: fsync d0/d2c/fb7 0 2024-09-13T22:08:46.618 INFO:tasks.workunit.client.0.smithi089.stdout:2/783: link df/d5b/da5/ce4 df/d5b/da5/db8/dbf/c108 0 2024-09-13T22:08:46.618 INFO:tasks.workunit.client.0.smithi089.stdout:8/834: symlink d0/dd/db0/d20/d1c/d5a/d63/l122 0 2024-09-13T22:08:46.620 INFO:tasks.workunit.client.0.smithi089.stdout:7/764: symlink d0/d19/d28/d1d/d30/l107 0 2024-09-13T22:08:46.621 INFO:tasks.workunit.client.0.smithi089.stdout:7/765: fsync d0/fec 0 2024-09-13T22:08:46.621 INFO:tasks.workunit.client.0.smithi089.stdout:2/784: creat df/d14/d2b/f109 x:0 0 0 2024-09-13T22:08:46.624 INFO:tasks.workunit.client.0.smithi089.stdout:7/766: mkdir d0/d19/d28/d1d/d3d/d9a/dcf/da8/d108 0 2024-09-13T22:08:46.626 INFO:tasks.workunit.client.0.smithi089.stdout:6/702: sync 2024-09-13T22:08:46.627 INFO:tasks.workunit.client.0.smithi089.stdout:1/798: sync 2024-09-13T22:08:46.627 INFO:tasks.workunit.client.0.smithi089.stdout:9/811: sync 2024-09-13T22:08:46.632 INFO:tasks.workunit.client.0.smithi089.stdout:7/767: creat d0/d19/d28/d1d/d23/d24/dac/db3/f109 x:0 0 0 2024-09-13T22:08:46.632 INFO:tasks.workunit.client.0.smithi089.stdout:7/768: write d0/d19/d28/ff2 [352071,16127] 0 2024-09-13T22:08:46.634 INFO:tasks.workunit.client.0.smithi089.stdout:9/812: link d6/d18/d1b/da0/la6 d6/d18/d21/d5d/l10e 0 2024-09-13T22:08:46.635 INFO:tasks.workunit.client.0.smithi089.stdout:8/835: rename d0/dd/db0/d20/d36/d80 to d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123 0 2024-09-13T22:08:46.635 INFO:tasks.workunit.client.0.smithi089.stdout:8/836: truncate d0/dd/db0/d20/d36/fab 1040558 0 2024-09-13T22:08:46.636 INFO:tasks.workunit.client.0.smithi089.stdout:7/769: mknod d0/d19/d28/d1d/d23/d24/d5d/c10a 0 2024-09-13T22:08:46.637 INFO:tasks.workunit.client.0.smithi089.stdout:9/813: mkdir d6/d31/d5e/db1/d10f 0 2024-09-13T22:08:46.638 INFO:tasks.workunit.client.0.smithi089.stdout:8/837: mknod d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/c124 0 2024-09-13T22:08:46.638 INFO:tasks.workunit.client.0.smithi089.stdout:8/838: chown d0/dd/db0/f1a 1309 1 2024-09-13T22:08:46.639 INFO:tasks.workunit.client.0.smithi089.stdout:7/770: mkdir d0/d19/d28/d61/d10b 0 2024-09-13T22:08:46.640 INFO:tasks.workunit.client.0.smithi089.stdout:1/799: write d7/d40/dbe/d80/fa5 [1206938,11727] 0 2024-09-13T22:08:46.640 INFO:tasks.workunit.client.0.smithi089.stdout:8/839: creat d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d70/f125 x:0 0 0 2024-09-13T22:08:46.643 INFO:tasks.workunit.client.0.smithi089.stdout:8/840: unlink d0/dd/db0/d20/d1c/d5a/d63/f66 0 2024-09-13T22:08:46.645 INFO:tasks.workunit.client.0.smithi089.stdout:8/841: link d0/dd/db0/d20/d36/d68/de6/ffd d0/dd/db0/d20/d40/d4a/f126 0 2024-09-13T22:08:46.645 INFO:tasks.workunit.client.0.smithi089.stdout:8/842: creat d0/dd/db0/d3a/f127 x:0 0 0 2024-09-13T22:08:46.645 INFO:tasks.workunit.client.0.smithi089.stdout:8/843: fsync d0/dd/db0/d20/d36/d59/d89/f2d 0 2024-09-13T22:08:46.647 INFO:tasks.workunit.client.0.smithi089.stdout:9/814: write d6/d18/d21/f83 [2234860,111094] 0 2024-09-13T22:08:46.647 INFO:tasks.workunit.client.0.smithi089.stdout:9/815: chown d6/feb 13395385 1 2024-09-13T22:08:46.648 INFO:tasks.workunit.client.0.smithi089.stdout:9/816: write d6/d18/d1b/d89/db8/d52/f97 [297436,60992] 0 2024-09-13T22:08:46.648 INFO:tasks.workunit.client.0.smithi089.stdout:8/844: rename d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/fee to d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/d88/f128 0 2024-09-13T22:08:46.649 INFO:tasks.workunit.client.0.smithi089.stdout:8/845: write d0/dd/db0/d20/d40/d4a/d7f/f10c [986666,39844] 0 2024-09-13T22:08:46.649 INFO:tasks.workunit.client.0.smithi089.stdout:8/846: stat d0/dd/db0/d20/d1c/d5a/f74 0 2024-09-13T22:08:46.649 INFO:tasks.workunit.client.0.smithi089.stdout:1/800: dread d7/de/da0/fb4 [0,4194304] 0 2024-09-13T22:08:46.649 INFO:tasks.workunit.client.0.smithi089.stdout:1/801: chown d7/d1c/d3c/f3f 0 1 2024-09-13T22:08:46.650 INFO:tasks.workunit.client.0.smithi089.stdout:9/817: mknod d6/d18/d1b/d89/db8/c110 0 2024-09-13T22:08:46.650 INFO:tasks.workunit.client.0.smithi089.stdout:8/847: creat d0/dd/db0/d3a/dd4/f129 x:0 0 0 2024-09-13T22:08:46.653 INFO:tasks.workunit.client.0.smithi089.stdout:9/818: rename d6/d18/c61 to d6/d18/d1b/d3e/c111 0 2024-09-13T22:08:46.654 INFO:tasks.workunit.client.0.smithi089.stdout:9/819: creat d6/d18/d1b/da0/dae/f112 x:0 0 0 2024-09-13T22:08:46.654 INFO:tasks.workunit.client.0.smithi089.stdout:9/820: fdatasync f0 0 2024-09-13T22:08:46.654 INFO:tasks.workunit.client.0.smithi089.stdout:6/703: dwrite d0/d4/d12/d15/db3/f34 [0,4194304] 0 2024-09-13T22:08:46.656 INFO:tasks.workunit.client.0.smithi089.stdout:6/704: link d0/d4/f6f d0/d4/d12/d15/d3b/d62/fd8 0 2024-09-13T22:08:46.658 INFO:tasks.workunit.client.0.smithi089.stdout:6/705: link d0/d4/d12/d15/d3b/d62/da4/cd5 d0/d4/cd9 0 2024-09-13T22:08:46.658 INFO:tasks.workunit.client.0.smithi089.stdout:6/706: creat d0/d5/d43/fda x:0 0 0 2024-09-13T22:08:46.660 INFO:tasks.workunit.client.0.smithi089.stdout:6/707: mknod d0/d5/d43/cdb 0 2024-09-13T22:08:46.673 INFO:tasks.workunit.client.0.smithi089.stdout:1/802: dwrite d7/de/da0/dbd/fce [0,4194304] 0 2024-09-13T22:08:46.673 INFO:tasks.workunit.client.0.smithi089.stdout:1/803: read d7/de/f5f [1195038,115911] 0 2024-09-13T22:08:46.673 INFO:tasks.workunit.client.0.smithi089.stdout:1/804: fdatasync d7/d1c/d7a/fbf 0 2024-09-13T22:08:46.675 INFO:tasks.workunit.client.0.smithi089.stdout:9/821: dread d6/d18/d1b/d89/db8/d52/f97 [0,4194304] 0 2024-09-13T22:08:46.675 INFO:tasks.workunit.client.0.smithi089.stdout:9/822: creat d6/d54/f113 x:0 0 0 2024-09-13T22:08:46.676 INFO:tasks.workunit.client.0.smithi089.stdout:9/823: stat d6/d18/d1b/d89/db8/dbe/df8 0 2024-09-13T22:08:46.676 INFO:tasks.workunit.client.0.smithi089.stdout:9/824: chown d6/d18/d1b/d89/db8/d52/d102/fc9 29127 1 2024-09-13T22:08:46.677 INFO:tasks.workunit.client.0.smithi089.stdout:9/825: creat d6/d54/dcb/de0/f114 x:0 0 0 2024-09-13T22:08:46.678 INFO:tasks.workunit.client.0.smithi089.stdout:8/848: dwrite d0/dd/db0/d42/dc0/fc4 [0,4194304] 0 2024-09-13T22:08:46.678 INFO:tasks.workunit.client.0.smithi089.stdout:8/849: write d0/dd/db0/d20/d36/d68/de6/ffd [2723044,21453] 0 2024-09-13T22:08:46.678 INFO:tasks.workunit.client.0.smithi089.stdout:6/708: dwrite d0/d4/d12/d15/db3/d4a/f90 [0,4194304] 0 2024-09-13T22:08:46.683 INFO:tasks.workunit.client.0.smithi089.stdout:6/709: mkdir d0/d5/d1d/d54/ddc 0 2024-09-13T22:08:46.684 INFO:tasks.workunit.client.0.smithi089.stdout:8/850: dread d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/d88/f96 [0,4194304] 0 2024-09-13T22:08:46.684 INFO:tasks.workunit.client.0.smithi089.stdout:8/851: chown d0/dd/db0/d20/d1c/d5a/d63/fc5 0 1 2024-09-13T22:08:46.685 INFO:tasks.workunit.client.0.smithi089.stdout:6/710: link d0/d4/d12/d15/d3b/d62/da4/fcf d0/d4/d12/d15/db3/d28/dbf/fdd 0 2024-09-13T22:08:46.685 INFO:tasks.workunit.client.0.smithi089.stdout:6/711: chown d0/d4/f2b 5728 1 2024-09-13T22:08:46.685 INFO:tasks.workunit.client.0.smithi089.stdout:6/712: write d0/d4/d12/d15/db3/fbe [46601,82912] 0 2024-09-13T22:08:46.686 INFO:tasks.workunit.client.0.smithi089.stdout:3/804: sync 2024-09-13T22:08:46.686 INFO:tasks.workunit.client.0.smithi089.stdout:5/790: sync 2024-09-13T22:08:46.687 INFO:tasks.workunit.client.0.smithi089.stdout:3/805: chown d1/d2/d23/d3d/d54/d95 5 1 2024-09-13T22:08:46.687 INFO:tasks.workunit.client.0.smithi089.stdout:5/791: truncate d4/d19/d1e/fbf 4260017 0 2024-09-13T22:08:46.687 INFO:tasks.workunit.client.0.smithi089.stdout:8/852: link d0/dd/db0/d20/d1c/d5a/d63/l6e d0/dd/db0/d42/l12a 0 2024-09-13T22:08:46.688 INFO:tasks.workunit.client.0.smithi089.stdout:6/713: symlink d0/d5/d1d/d54/lde 0 2024-09-13T22:08:46.689 INFO:tasks.workunit.client.0.smithi089.stdout:6/714: write d0/d4/d12/d15/db3/d28/f8b [541297,28004] 0 2024-09-13T22:08:46.689 INFO:tasks.workunit.client.0.smithi089.stdout:6/715: truncate d0/d4/d12/d15/db3/d4b/fbc 954929 0 2024-09-13T22:08:46.689 INFO:tasks.workunit.client.0.smithi089.stdout:6/716: chown d0/d4/d12/d15/db3/d60 13488243 1 2024-09-13T22:08:46.689 INFO:tasks.workunit.client.0.smithi089.stdout:6/717: write d0/d5/d43/f77 [4932960,128772] 0 2024-09-13T22:08:46.689 INFO:tasks.workunit.client.0.smithi089.stdout:5/792: link d4/d19/d1e/d28/d31/d55/d58/d84/fa6 d4/d19/d1e/f113 0 2024-09-13T22:08:46.690 INFO:tasks.workunit.client.0.smithi089.stdout:5/793: fdatasync d4/d19/d1e/d28/f9b 0 2024-09-13T22:08:46.690 INFO:tasks.workunit.client.0.smithi089.stdout:1/805: dwrite d7/d40/dbe/d2b/d39/d73/da9/ffe [0,4194304] 0 2024-09-13T22:08:46.690 INFO:tasks.workunit.client.0.smithi089.stdout:3/806: mknod d1/d2/d23/d3d/d54/d5d/c114 0 2024-09-13T22:08:46.692 INFO:tasks.workunit.client.0.smithi089.stdout:8/853: creat d0/dd/db0/d20/d40/f12b x:0 0 0 2024-09-13T22:08:46.695 INFO:tasks.workunit.client.0.smithi089.stdout:6/718: symlink d0/d5/d43/daf/db1/db7/ldf 0 2024-09-13T22:08:46.697 INFO:tasks.workunit.client.0.smithi089.stdout:5/794: mkdir d4/d19/d1e/d53/d88/d114 0 2024-09-13T22:08:46.697 INFO:tasks.workunit.client.0.smithi089.stdout:5/795: creat d4/d19/de4/f115 x:0 0 0 2024-09-13T22:08:46.697 INFO:tasks.workunit.client.0.smithi089.stdout:5/796: dread - d4/d19/d1e/d28/d31/d55/d58/d9d/ff5 zero size 2024-09-13T22:08:46.702 INFO:tasks.workunit.client.0.smithi089.stdout:3/807: symlink d1/d2/d23/d3d/d54/d5d/dc1/l115 0 2024-09-13T22:08:46.711 INFO:tasks.workunit.client.0.smithi089.stdout:3/808: unlink d1/d2/ff 0 2024-09-13T22:08:46.712 INFO:tasks.workunit.client.0.smithi089.stdout:8/854: rmdir d0/dd/db0/d20/d36/d68 39 2024-09-13T22:08:46.713 INFO:tasks.workunit.client.0.smithi089.stdout:3/809: dread d1/d2/d4/d1c/d7e/d40/fad [0,4194304] 0 2024-09-13T22:08:46.714 INFO:tasks.workunit.client.0.smithi089.stdout:8/855: creat d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/f12c x:0 0 0 2024-09-13T22:08:46.715 INFO:tasks.workunit.client.0.smithi089.stdout:3/810: mkdir d1/d2/d96/d116 0 2024-09-13T22:08:46.716 INFO:tasks.workunit.client.0.smithi089.stdout:3/811: unlink d1/d2/d96/d102/l4a 0 2024-09-13T22:08:46.717 INFO:tasks.workunit.client.0.smithi089.stdout:3/812: creat d1/d2/d4/d1c/d7e/d40/d50/f117 x:0 0 0 2024-09-13T22:08:46.719 INFO:tasks.workunit.client.0.smithi089.stdout:3/813: getdents d1/d2/d4/d1c/d7e/d40 0 2024-09-13T22:08:46.719 INFO:tasks.workunit.client.0.smithi089.stdout:3/814: chown d1/d2/d23/d3d/d54/d95/ca3 0 1 2024-09-13T22:08:46.724 INFO:tasks.workunit.client.0.smithi089.stdout:8/856: dread d0/dd/db0/d20/f2e [0,4194304] 0 2024-09-13T22:08:46.725 INFO:tasks.workunit.client.0.smithi089.stdout:8/857: truncate d0/dd/db0/d20/d36/d57/f60 663384 0 2024-09-13T22:08:46.726 INFO:tasks.workunit.client.0.smithi089.stdout:8/858: getdents d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d70 0 2024-09-13T22:08:46.726 INFO:tasks.workunit.client.0.smithi089.stdout:8/859: dread - d0/dd/db0/d20/d1c/d5a/d63/dce/d114/f111 zero size 2024-09-13T22:08:46.727 INFO:tasks.workunit.client.0.smithi089.stdout:8/860: unlink d0/dd/db0/d20/d40/d4a/la4 0 2024-09-13T22:08:46.729 INFO:tasks.workunit.client.0.smithi089.stdout:1/806: dwrite d7/de/d3a/d77/fc5 [0,4194304] 0 2024-09-13T22:08:46.729 INFO:tasks.workunit.client.0.smithi089.stdout:8/861: mknod d0/dd/db0/d20/d36/d59/d5d/c12d 0 2024-09-13T22:08:46.730 INFO:tasks.workunit.client.0.smithi089.stdout:8/862: creat d0/d6a/f12e x:0 0 0 2024-09-13T22:08:46.730 INFO:tasks.workunit.client.0.smithi089.stdout:8/863: fdatasync d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/f97 0 2024-09-13T22:08:46.730 INFO:tasks.workunit.client.0.smithi089.stdout:8/864: dread - d0/dd/db0/d3a/fdd zero size 2024-09-13T22:08:46.730 INFO:tasks.workunit.client.0.smithi089.stdout:8/865: chown d0/dd/l3c 8101185 1 2024-09-13T22:08:46.730 INFO:tasks.workunit.client.0.smithi089.stdout:6/719: dwrite d0/d4/fc9 [0,4194304] 0 2024-09-13T22:08:46.730 INFO:tasks.workunit.client.0.smithi089.stdout:1/807: mkdir d7/de/d68/dd9/d107 0 2024-09-13T22:08:46.730 INFO:tasks.workunit.client.0.smithi089.stdout:1/808: chown d7/de/f5f 197974 1 2024-09-13T22:08:46.730 INFO:tasks.workunit.client.0.smithi089.stdout:5/797: dwrite d4/d19/d1e/d53/d88/fc8 [0,4194304] 0 2024-09-13T22:08:46.731 INFO:tasks.workunit.client.0.smithi089.stdout:8/866: symlink d0/dd/db0/d42/dc0/l12f 0 2024-09-13T22:08:46.735 INFO:tasks.workunit.client.0.smithi089.stdout:1/809: write d7/d1c/d3c/f3f [4071458,56651] 0 2024-09-13T22:08:46.738 INFO:tasks.workunit.client.0.smithi089.stdout:6/720: getdents d0/d5/d1d/d2d/d55 0 2024-09-13T22:08:46.738 INFO:tasks.workunit.client.0.smithi089.stdout:6/721: chown d0/d4/d12/d15/db3/d4b/f4e 442 1 2024-09-13T22:08:46.738 INFO:tasks.workunit.client.0.smithi089.stdout:6/722: dread - d0/dcb/fd6 zero size 2024-09-13T22:08:46.741 INFO:tasks.workunit.client.0.smithi089.stdout:5/798: creat d4/d19/d1e/d28/d31/f116 x:0 0 0 2024-09-13T22:08:46.741 INFO:tasks.workunit.client.0.smithi089.stdout:5/799: fdatasync d4/d19/d1e/d28/d31/d55/d58/d9d/f111 0 2024-09-13T22:08:46.742 INFO:tasks.workunit.client.0.smithi089.stdout:8/867: unlink d0/dd/db0/d20/d40/d4a/ld9 0 2024-09-13T22:08:46.742 INFO:tasks.workunit.client.0.smithi089.stdout:1/810: fdatasync d7/d40/dbe/d2b/d39/f98 0 2024-09-13T22:08:46.742 INFO:tasks.workunit.client.0.smithi089.stdout:1/811: chown d7/d40/cb9 252 1 2024-09-13T22:08:46.745 INFO:tasks.workunit.client.0.smithi089.stdout:6/723: link d0/d5/d64/f72 d0/d5/d1d/d2d/da0/fe0 0 2024-09-13T22:08:46.745 INFO:tasks.workunit.client.0.smithi089.stdout:6/724: creat d0/d5/d43/d79/fe1 x:0 0 0 2024-09-13T22:08:46.747 INFO:tasks.workunit.client.0.smithi089.stdout:5/800: dread d4/d19/d1e/d28/d31/d55/d58/d84/f8f [0,4194304] 0 2024-09-13T22:08:46.748 INFO:tasks.workunit.client.0.smithi089.stdout:5/801: symlink d4/d19/d1e/d28/d3d/dc9/l117 0 2024-09-13T22:08:46.750 INFO:tasks.workunit.client.0.smithi089.stdout:5/802: truncate d4/d19/d1e/d28/d3d/f57 826616 0 2024-09-13T22:08:46.752 INFO:tasks.workunit.client.0.smithi089.stdout:5/803: mknod d4/d19/d1e/d28/d31/c118 0 2024-09-13T22:08:46.752 INFO:tasks.workunit.client.0.smithi089.stdout:1/812: write d7/d40/dbe/d2b/d59/f85 [2257711,131071] 0 2024-09-13T22:08:46.753 INFO:tasks.workunit.client.0.smithi089.stdout:5/804: getdents d4/d19/de4 0 2024-09-13T22:08:46.753 INFO:tasks.workunit.client.0.smithi089.stdout:5/805: write d4/d19/d1e/d28/d31/d55/d58/fad [85591,128083] 0 2024-09-13T22:08:46.755 INFO:tasks.workunit.client.0.smithi089.stdout:5/806: rename d4/d19/d1e/d28/d31/d61/d69 to d4/d19/d1e/d53/d88/d114/d119 0 2024-09-13T22:08:46.757 INFO:tasks.workunit.client.0.smithi089.stdout:5/807: creat d4/d19/d1e/d28/d31/d55/dcc/f11a x:0 0 0 2024-09-13T22:08:46.757 INFO:tasks.workunit.client.0.smithi089.stdout:5/808: creat d4/d19/d1e/d28/d3d/dba/f11b x:0 0 0 2024-09-13T22:08:46.760 INFO:tasks.workunit.client.0.smithi089.stdout:2/785: sync 2024-09-13T22:08:46.760 INFO:tasks.workunit.client.0.smithi089.stdout:4/922: sync 2024-09-13T22:08:46.762 INFO:tasks.workunit.client.0.smithi089.stdout:6/725: dwrite d0/d4/d12/d15/d3b/d62/fd8 [0,4194304] 0 2024-09-13T22:08:46.762 INFO:tasks.workunit.client.0.smithi089.stdout:2/786: link df/d14/d48/d88/db9/dec/fdd df/d14/d66/d69/d2e/f10a 0 2024-09-13T22:08:46.769 INFO:tasks.workunit.client.0.smithi089.stdout:6/726: creat d0/d5/d1d/fe2 x:0 0 0 2024-09-13T22:08:46.773 INFO:tasks.workunit.client.0.smithi089.stdout:6/727: mkdir d0/d4/d12/d15/db3/d28/dbf/de3 0 2024-09-13T22:08:46.773 INFO:tasks.workunit.client.0.smithi089.stdout:6/728: rename d0/d5/d1d/d2d/da0 to d0/d5/d1d/d2d/da0/de4 22 2024-09-13T22:08:46.773 INFO:tasks.workunit.client.0.smithi089.stdout:1/813: dread d7/d40/dbe/d2b/d59/fb7 [0,4194304] 0 2024-09-13T22:08:46.774 INFO:tasks.workunit.client.0.smithi089.stdout:6/729: mknod d0/d4/d12/d15/db3/d28/dbf/de3/ce5 0 2024-09-13T22:08:46.775 INFO:tasks.workunit.client.0.smithi089.stdout:1/814: rmdir d7/de/da0/d105 0 2024-09-13T22:08:46.775 INFO:tasks.workunit.client.0.smithi089.stdout:1/815: chown d7/de/d68/dd9/ldb 5956 1 2024-09-13T22:08:46.776 INFO:tasks.workunit.client.0.smithi089.stdout:1/816: mkdir d7/d1c/d3c/d108 0 2024-09-13T22:08:46.777 INFO:tasks.workunit.client.0.smithi089.stdout:6/730: symlink d0/le6 0 2024-09-13T22:08:46.777 INFO:tasks.workunit.client.0.smithi089.stdout:6/731: chown d0/d4/d12/d15/fc1 76775165 1 2024-09-13T22:08:46.802 INFO:tasks.workunit.client.0.smithi089.stdout:8/868: dwrite d0/dd/db0/d20/f18 [0,4194304] 0 2024-09-13T22:08:46.802 INFO:tasks.workunit.client.0.smithi089.stdout:2/787: dwrite df/d5b/da5/db8/dbf/fc0 [0,4194304] 0 2024-09-13T22:08:46.802 INFO:tasks.workunit.client.0.smithi089.stdout:2/788: creat df/d14/d66/d8a/de1/f10b x:0 0 0 2024-09-13T22:08:46.803 INFO:tasks.workunit.client.0.smithi089.stdout:6/732: dwrite d0/d4/d12/f37 [0,4194304] 0 2024-09-13T22:08:46.803 INFO:tasks.workunit.client.0.smithi089.stdout:6/733: chown d0/d4/d12/d15/db3/d60/c7f 26 1 2024-09-13T22:08:46.803 INFO:tasks.workunit.client.0.smithi089.stdout:6/734: readlink d0/d5/d1d/d2d/d55/lc7 0 2024-09-13T22:08:46.803 INFO:tasks.workunit.client.0.smithi089.stdout:5/809: dwrite d4/d19/d1e/d28/d31/d55/dcc/f47 [0,4194304] 0 2024-09-13T22:08:46.808 INFO:tasks.workunit.client.0.smithi089.stdout:5/810: symlink d4/d19/d1e/d28/l11c 0 2024-09-13T22:08:46.811 INFO:tasks.workunit.client.0.smithi089.stdout:2/789: read df/d1a/d57/d68/f7c [6708407,116714] 0 2024-09-13T22:08:46.811 INFO:tasks.workunit.client.0.smithi089.stdout:5/811: dread d4/d19/d1e/d28/d31/f75 [0,4194304] 0 2024-09-13T22:08:46.812 INFO:tasks.workunit.client.0.smithi089.stdout:2/790: mkdir df/d14/d66/d69/d2e/d10c 0 2024-09-13T22:08:46.814 INFO:tasks.workunit.client.0.smithi089.stdout:5/812: creat d4/d19/d1e/d28/d31/d55/d58/d84/d101/f11d x:0 0 0 2024-09-13T22:08:46.814 INFO:tasks.workunit.client.0.smithi089.stdout:5/813: write d4/d19/d1e/d28/d31/dd1/ddc/df8/f105 [127413,105535] 0 2024-09-13T22:08:46.815 INFO:tasks.workunit.client.0.smithi089.stdout:5/814: mkdir d4/d19/d1e/d28/d31/dd1/ddc/df8/d11e 0 2024-09-13T22:08:46.816 INFO:tasks.workunit.client.0.smithi089.stdout:5/815: truncate d4/d19/d1e/d28/d3d/faf 189919 0 2024-09-13T22:08:46.817 INFO:tasks.workunit.client.0.smithi089.stdout:5/816: mknod d4/d19/d1e/d53/d88/d114/d119/c11f 0 2024-09-13T22:08:46.817 INFO:tasks.workunit.client.0.smithi089.stdout:2/791: dread df/d14/d2b/d61/f49 [4194304,4194304] 0 2024-09-13T22:08:46.818 INFO:tasks.workunit.client.0.smithi089.stdout:2/792: write df/d5b/da5/db8/fc7 [347351,13613] 0 2024-09-13T22:08:46.819 INFO:tasks.workunit.client.0.smithi089.stdout:5/817: mknod d4/d19/d1e/d53/d88/d114/c120 0 2024-09-13T22:08:46.820 INFO:tasks.workunit.client.0.smithi089.stdout:5/818: creat d4/d19/d1e/d28/d31/d55/d58/d84/d101/f121 x:0 0 0 2024-09-13T22:08:46.820 INFO:tasks.workunit.client.0.smithi089.stdout:9/826: sync 2024-09-13T22:08:46.821 INFO:tasks.workunit.client.0.smithi089.stdout:3/815: sync 2024-09-13T22:08:46.821 INFO:tasks.workunit.client.0.smithi089.stdout:7/771: sync 2024-09-13T22:08:46.821 INFO:tasks.workunit.client.0.smithi089.stdout:9/827: fdatasync d6/d18/fbb 0 2024-09-13T22:08:46.821 INFO:tasks.workunit.client.0.smithi089.stdout:3/816: write d1/d2/d23/d3d/d54/dc6/f10a [1023707,102532] 0 2024-09-13T22:08:46.821 INFO:tasks.workunit.client.0.smithi089.stdout:9/828: mkdir d6/d54/d115 0 2024-09-13T22:08:46.821 INFO:tasks.workunit.client.0.smithi089.stdout:8/869: dwrite d0/dd/db0/d20/d1c/d5a/fed [0,4194304] 0 2024-09-13T22:08:46.822 INFO:tasks.workunit.client.0.smithi089.stdout:8/870: fsync d0/dd/db0/d20/d1c/d5a/f101 0 2024-09-13T22:08:46.822 INFO:tasks.workunit.client.0.smithi089.stdout:8/871: truncate d0/dd/db0/d20/d40/d4a/f7a 5556517 0 2024-09-13T22:08:46.823 INFO:tasks.workunit.client.0.smithi089.stdout:7/772: mknod d0/d19/d28/d1d/d3d/d9a/c10c 0 2024-09-13T22:08:46.823 INFO:tasks.workunit.client.0.smithi089.stdout:9/829: creat d6/d31/d5e/db1/d10f/f116 x:0 0 0 2024-09-13T22:08:46.823 INFO:tasks.workunit.client.0.smithi089.stdout:7/773: readlink d0/l70 0 2024-09-13T22:08:46.823 INFO:tasks.workunit.client.0.smithi089.stdout:9/830: creat d6/d18/d1b/d3e/dbd/f117 x:0 0 0 2024-09-13T22:08:46.824 INFO:tasks.workunit.client.0.smithi089.stdout:9/831: chown d6/l87 4129 1 2024-09-13T22:08:46.824 INFO:tasks.workunit.client.0.smithi089.stdout:9/832: creat d6/d18/d1b/d89/db8/f118 x:0 0 0 2024-09-13T22:08:46.825 INFO:tasks.workunit.client.0.smithi089.stdout:7/774: symlink d0/d19/d28/d1d/d3d/d9a/dcf/da8/dd8/l10d 0 2024-09-13T22:08:46.825 INFO:tasks.workunit.client.0.smithi089.stdout:7/775: readlink d0/d19/d28/d7b/lad 0 2024-09-13T22:08:46.825 INFO:tasks.workunit.client.0.smithi089.stdout:7/776: write d0/d19/d28/faa [888699,21635] 0 2024-09-13T22:08:46.828 INFO:tasks.workunit.client.0.smithi089.stdout:9/833: creat d6/d54/dcb/f119 x:0 0 0 2024-09-13T22:08:46.829 INFO:tasks.workunit.client.0.smithi089.stdout:7/777: mkdir d0/d19/d45/d92/ddc/d10e 0 2024-09-13T22:08:46.829 INFO:tasks.workunit.client.0.smithi089.stdout:7/778: truncate d0/d19/d28/d1d/d23/d24/d5d/fe6 4840076 0 2024-09-13T22:08:46.829 INFO:tasks.workunit.client.0.smithi089.stdout:7/779: chown d0/d19/d28/d1d/d23/d24/d5d 6142 1 2024-09-13T22:08:46.830 INFO:tasks.workunit.client.0.smithi089.stdout:7/780: write d0/fec [143858,73542] 0 2024-09-13T22:08:46.830 INFO:tasks.workunit.client.0.smithi089.stdout:8/872: dread d0/dd/db0/d42/f39 [0,4194304] 0 2024-09-13T22:08:46.830 INFO:tasks.workunit.client.0.smithi089.stdout:5/819: truncate d4/d19/d1e/d28/d3d/faf 927143 0 2024-09-13T22:08:46.831 INFO:tasks.workunit.client.0.smithi089.stdout:5/820: creat d4/d19/d1e/d53/dae/f122 x:0 0 0 2024-09-13T22:08:46.831 INFO:tasks.workunit.client.0.smithi089.stdout:8/873: truncate d0/dd/db0/d42/f77 99412 0 2024-09-13T22:08:46.833 INFO:tasks.workunit.client.0.smithi089.stdout:5/821: mkdir d4/d19/d1e/d28/d31/d61/d123 0 2024-09-13T22:08:46.833 INFO:tasks.workunit.client.0.smithi089.stdout:5/822: fdatasync d4/d19/d1e/d28/d31/d55/dcc/fa1 0 2024-09-13T22:08:46.833 INFO:tasks.workunit.client.0.smithi089.stdout:5/823: truncate d4/d19/d1e/d28/d31/d55/d58/d9d/ff9 15285 0 2024-09-13T22:08:46.833 INFO:tasks.workunit.client.0.smithi089.stdout:5/824: fsync d4/d19/d1e/d89/dce/fa8 0 2024-09-13T22:08:46.835 INFO:tasks.workunit.client.0.smithi089.stdout:8/874: unlink d0/dd/db0/d20/d1c/lb4 0 2024-09-13T22:08:46.837 INFO:tasks.workunit.client.0.smithi089.stdout:5/825: rename d4/d19/d1e/d28/d31/dd1/ddc to d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124 0 2024-09-13T22:08:46.837 INFO:tasks.workunit.client.0.smithi089.stdout:5/826: write d4/d19/d1e/d28/d31/f97 [5012394,113160] 0 2024-09-13T22:08:46.837 INFO:tasks.workunit.client.0.smithi089.stdout:5/827: stat d4/d19/d1e/d28/f9b 0 2024-09-13T22:08:46.839 INFO:tasks.workunit.client.0.smithi089.stdout:8/875: dread d0/dd/db0/d20/d36/fab [0,4194304] 0 2024-09-13T22:08:46.840 INFO:tasks.workunit.client.0.smithi089.stdout:8/876: mkdir d0/dd/db0/d42/dc7/dfa/d130 0 2024-09-13T22:08:46.840 INFO:tasks.workunit.client.0.smithi089.stdout:9/834: dread d6/d18/fa2 [0,4194304] 0 2024-09-13T22:08:46.847 INFO:tasks.workunit.client.0.smithi089.stdout:2/793: dwrite df/d14/d66/d69/d2e/f3c [8388608,4194304] 0 2024-09-13T22:08:46.847 INFO:tasks.workunit.client.0.smithi089.stdout:2/794: readlink df/d14/d2b/d61/l5e 0 2024-09-13T22:08:46.849 INFO:tasks.workunit.client.0.smithi089.stdout:8/877: dread d0/dd/db0/d20/d40/d4a/f7a [0,4194304] 0 2024-09-13T22:08:46.849 INFO:tasks.workunit.client.0.smithi089.stdout:2/795: link df/d14/d48/d88/db9/dec/c50 df/d76/d93/c10d 0 2024-09-13T22:08:46.850 INFO:tasks.workunit.client.0.smithi089.stdout:3/817: dwrite d1/d2/d23/d3d/d46/f8b [0,4194304] 0 2024-09-13T22:08:46.850 INFO:tasks.workunit.client.0.smithi089.stdout:3/818: creat d1/d2/d23/d3d/d54/dc6/f118 x:0 0 0 2024-09-13T22:08:46.850 INFO:tasks.workunit.client.0.smithi089.stdout:3/819: stat d1/d2/d23/d3d/dda/l11 0 2024-09-13T22:08:46.851 INFO:tasks.workunit.client.0.smithi089.stdout:8/878: mknod d0/dd/db0/d3a/c131 0 2024-09-13T22:08:46.852 INFO:tasks.workunit.client.0.smithi089.stdout:2/796: creat df/d14/d2b/d61/db1/f10e x:0 0 0 2024-09-13T22:08:46.854 INFO:tasks.workunit.client.0.smithi089.stdout:8/879: symlink d0/dd/db0/d20/d1c/d5a/l132 0 2024-09-13T22:08:46.863 INFO:tasks.workunit.client.0.smithi089.stdout:3/820: dread d1/d2/d23/f35 [0,4194304] 0 2024-09-13T22:08:46.863 INFO:tasks.workunit.client.0.smithi089.stdout:7/781: dwrite d0/d19/d45/d92/def/fe0 [0,4194304] 0 2024-09-13T22:08:46.866 INFO:tasks.workunit.client.0.smithi089.stdout:3/821: mkdir d1/d2/d4/d1c/d7f/d119 0 2024-09-13T22:08:46.866 INFO:tasks.workunit.client.0.smithi089.stdout:3/822: chown d1/d2/d23/d3d/d46/f67 18 1 2024-09-13T22:08:46.866 INFO:tasks.workunit.client.0.smithi089.stdout:2/797: write df/f74 [3209578,53110] 0 2024-09-13T22:08:46.866 INFO:tasks.workunit.client.0.smithi089.stdout:5/828: dwrite d4/d19/d1e/d28/f51 [4194304,4194304] 0 2024-09-13T22:08:46.867 INFO:tasks.workunit.client.0.smithi089.stdout:3/823: unlink d1/d2/d23/d3d/d54/d5d/deb/d63/lc4 0 2024-09-13T22:08:46.867 INFO:tasks.workunit.client.0.smithi089.stdout:3/824: fsync d1/d2/d4/f9 0 2024-09-13T22:08:46.867 INFO:tasks.workunit.client.0.smithi089.stdout:3/825: dread - d1/d2/d23/fed zero size 2024-09-13T22:08:46.867 INFO:tasks.workunit.client.0.smithi089.stdout:3/826: write d1/d2/d23/d3d/d54/fd4 [215101,73519] 0 2024-09-13T22:08:46.868 INFO:tasks.workunit.client.0.smithi089.stdout:9/835: dwrite d6/d18/d1b/d89/db8/dbe/ff1 [0,4194304] 0 2024-09-13T22:08:46.874 INFO:tasks.workunit.client.0.smithi089.stdout:3/827: mknod d1/d2/d4/d1c/d7e/d40/d69/da1/c11a 0 2024-09-13T22:08:46.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/880: dread d0/dd/f46 [0,4194304] 0 2024-09-13T22:08:46.876 INFO:tasks.workunit.client.0.smithi089.stdout:7/782: write d0/d19/d45/f106 [678365,20203] 0 2024-09-13T22:08:46.876 INFO:tasks.workunit.client.0.smithi089.stdout:8/881: dread d0/dd/db0/d20/d36/fab [0,4194304] 0 2024-09-13T22:08:46.877 INFO:tasks.workunit.client.0.smithi089.stdout:8/882: write d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/d88/f106 [453488,35049] 0 2024-09-13T22:08:46.879 INFO:tasks.workunit.client.0.smithi089.stdout:3/828: rmdir d1/d2/d96/d116 0 2024-09-13T22:08:46.879 INFO:tasks.workunit.client.0.smithi089.stdout:2/798: write df/d14/f25 [366101,95579] 0 2024-09-13T22:08:46.879 INFO:tasks.workunit.client.0.smithi089.stdout:7/783: getdents d0/d19/d28/d1d/d23/d24/d5d 0 2024-09-13T22:08:46.879 INFO:tasks.workunit.client.0.smithi089.stdout:2/799: chown df/d14/fcb 678650 1 2024-09-13T22:08:46.879 INFO:tasks.workunit.client.0.smithi089.stdout:2/800: write df/d5b/fd2 [973044,8903] 0 2024-09-13T22:08:46.880 INFO:tasks.workunit.client.0.smithi089.stdout:8/883: creat d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d70/f133 x:0 0 0 2024-09-13T22:08:46.881 INFO:tasks.workunit.client.0.smithi089.stdout:5/829: dwrite d4/d19/d107/fd7 [0,4194304] 0 2024-09-13T22:08:46.883 INFO:tasks.workunit.client.0.smithi089.stdout:3/829: rename d1/d2/d31/c8e to d1/c11b 0 2024-09-13T22:08:46.885 INFO:tasks.workunit.client.0.smithi089.stdout:2/801: mkdir df/d76/d85/d10f 0 2024-09-13T22:08:46.885 INFO:tasks.workunit.client.0.smithi089.stdout:2/802: fdatasync df/d14/f24 0 2024-09-13T22:08:46.887 INFO:tasks.workunit.client.0.smithi089.stdout:8/884: mkdir d0/dd/db0/d20/d40/d134 0 2024-09-13T22:08:46.887 INFO:tasks.workunit.client.0.smithi089.stdout:8/885: creat d0/d6a/f135 x:0 0 0 2024-09-13T22:08:46.887 INFO:tasks.workunit.client.0.smithi089.stdout:8/886: chown d0/dd/db0/d20/d36/da0 8700548 1 2024-09-13T22:08:46.892 INFO:tasks.workunit.client.0.smithi089.stdout:7/784: rmdir d0/d19/d28/d1d/d23/d24/dac/db3 39 2024-09-13T22:08:46.893 INFO:tasks.workunit.client.0.smithi089.stdout:2/803: link df/d5b/f73 df/d14/d66/d69/d2e/d10c/f110 0 2024-09-13T22:08:46.893 INFO:tasks.workunit.client.0.smithi089.stdout:2/804: write df/d14/d48/d88/fa2 [100948,105042] 0 2024-09-13T22:08:46.895 INFO:tasks.workunit.client.0.smithi089.stdout:4/923: sync 2024-09-13T22:08:46.895 INFO:tasks.workunit.client.0.smithi089.stdout:1/817: sync 2024-09-13T22:08:46.895 INFO:tasks.workunit.client.0.smithi089.stdout:4/924: write d0/d2c/f84 [1373606,25015] 0 2024-09-13T22:08:46.896 INFO:tasks.workunit.client.0.smithi089.stdout:7/785: dread d0/d19/d28/d1d/d23/d24/f74 [0,4194304] 0 2024-09-13T22:08:46.897 INFO:tasks.workunit.client.0.smithi089.stdout:1/818: mkdir d7/d40/dbe/d2b/d39/d73/d109 0 2024-09-13T22:08:46.897 INFO:tasks.workunit.client.0.smithi089.stdout:6/735: sync 2024-09-13T22:08:46.898 INFO:tasks.workunit.client.0.smithi089.stdout:6/736: write d0/d5/fcd [700490,23549] 0 2024-09-13T22:08:46.899 INFO:tasks.workunit.client.0.smithi089.stdout:4/925: unlink d0/d2c/d52/da5/l25 0 2024-09-13T22:08:46.899 INFO:tasks.workunit.client.0.smithi089.stdout:4/926: dread - d0/d2c/da1/fc6 zero size 2024-09-13T22:08:46.901 INFO:tasks.workunit.client.0.smithi089.stdout:1/819: symlink d7/d40/dbe/d80/l10a 0 2024-09-13T22:08:46.901 INFO:tasks.workunit.client.0.smithi089.stdout:6/737: dread d0/d4/d12/d15/db3/d28/f8b [0,4194304] 0 2024-09-13T22:08:46.901 INFO:tasks.workunit.client.0.smithi089.stdout:6/738: chown d0/d5/d1d/d2d/d55/c6b 114246 1 2024-09-13T22:08:46.902 INFO:tasks.workunit.client.0.smithi089.stdout:1/820: unlink d7/d1c/f72 0 2024-09-13T22:08:46.904 INFO:tasks.workunit.client.0.smithi089.stdout:6/739: dread d0/d5/d43/d79/fa6 [0,4194304] 0 2024-09-13T22:08:46.904 INFO:tasks.workunit.client.0.smithi089.stdout:6/740: write d0/d4/d12/d15/db3/d4a/f58 [541933,73914] 0 2024-09-13T22:08:46.907 INFO:tasks.workunit.client.0.smithi089.stdout:6/741: unlink d0/d4/d12/fd2 0 2024-09-13T22:08:46.908 INFO:tasks.workunit.client.0.smithi089.stdout:6/742: mkdir d0/d5/de7 0 2024-09-13T22:08:46.908 INFO:tasks.workunit.client.0.smithi089.stdout:6/743: chown d0/d5/d43/f53 196128523 1 2024-09-13T22:08:46.911 INFO:tasks.workunit.client.0.smithi089.stdout:8/887: dwrite d0/dd/db0/d20/d40/f12b [0,4194304] 0 2024-09-13T22:08:46.913 INFO:tasks.workunit.client.0.smithi089.stdout:8/888: creat d0/dd/db0/d20/d40/d134/f136 x:0 0 0 2024-09-13T22:08:46.913 INFO:tasks.workunit.client.0.smithi089.stdout:3/830: dwrite d1/d2/d23/d3d/d54/dc6/f118 [0,4194304] 0 2024-09-13T22:08:46.913 INFO:tasks.workunit.client.0.smithi089.stdout:3/831: fsync d1/d2/d23/d3d/d54/dc6/f118 0 2024-09-13T22:08:46.913 INFO:tasks.workunit.client.0.smithi089.stdout:3/832: chown d1/d2/d4/d1c/fb3 5173 1 2024-09-13T22:08:46.914 INFO:tasks.workunit.client.0.smithi089.stdout:8/889: symlink d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/de4/l137 0 2024-09-13T22:08:46.914 INFO:tasks.workunit.client.0.smithi089.stdout:8/890: stat d0/dd/db0/d20/d40/d4a/f7a 0 2024-09-13T22:08:46.914 INFO:tasks.workunit.client.0.smithi089.stdout:8/891: write d0/dd/db0/d3a/dd4/f129 [863742,17096] 0 2024-09-13T22:08:46.915 INFO:tasks.workunit.client.0.smithi089.stdout:8/892: chown d0/l51 234827319 1 2024-09-13T22:08:46.915 INFO:tasks.workunit.client.0.smithi089.stdout:3/833: symlink d1/d2/de4/l11c 0 2024-09-13T22:08:46.916 INFO:tasks.workunit.client.0.smithi089.stdout:3/834: truncate d1/d2/d4/d1c/d7e/d40/d50/fb0 402820 0 2024-09-13T22:08:46.916 INFO:tasks.workunit.client.0.smithi089.stdout:3/835: write d1/d2/d23/d3d/d54/d5d/faa [1197907,77846] 0 2024-09-13T22:08:46.918 INFO:tasks.workunit.client.0.smithi089.stdout:3/836: rename d1/d2/d4/d1c/d7e/d40/d69/da1/faf to d1/d2/d4/d1c/d7e/f11d 0 2024-09-13T22:08:46.918 INFO:tasks.workunit.client.0.smithi089.stdout:3/837: creat d1/d2/d23/d3d/d46/dab/df2/f11e x:0 0 0 2024-09-13T22:08:46.921 INFO:tasks.workunit.client.0.smithi089.stdout:3/838: unlink d1/c30 0 2024-09-13T22:08:46.923 INFO:tasks.workunit.client.0.smithi089.stdout:3/839: write d1/d2/d96/dc3/f74 [420046,44429] 0 2024-09-13T22:08:46.924 INFO:tasks.workunit.client.0.smithi089.stdout:6/744: dread d0/d4/d12/d15/db3/d4a/f90 [0,4194304] 0 2024-09-13T22:08:46.931 INFO:tasks.workunit.client.0.smithi089.stdout:5/830: dwrite d4/d19/d1e/d28/d31/d55/dcc/f7b [4194304,4194304] 0 2024-09-13T22:08:46.931 INFO:tasks.workunit.client.0.smithi089.stdout:5/831: write d4/d19/d1e/d28/d3d/dc9/f10e [33609,6006] 0 2024-09-13T22:08:46.931 INFO:tasks.workunit.client.0.smithi089.stdout:5/832: truncate d4/d19/d1e/d28/d31/d61/fe2 927661 0 2024-09-13T22:08:46.932 INFO:tasks.workunit.client.0.smithi089.stdout:5/833: write d4/d19/d1e/d28/d31/d94/fc1 [395966,12896] 0 2024-09-13T22:08:46.933 INFO:tasks.workunit.client.0.smithi089.stdout:4/927: dwrite d0/f1a [0,4194304] 0 2024-09-13T22:08:46.933 INFO:tasks.workunit.client.0.smithi089.stdout:4/928: stat d0/d2c/d35/f87 0 2024-09-13T22:08:46.933 INFO:tasks.workunit.client.0.smithi089.stdout:4/929: dread - d0/d2c/da1/fff zero size 2024-09-13T22:08:46.934 INFO:tasks.workunit.client.0.smithi089.stdout:5/834: rename d4/d19/d1e/d28/d31/d55/d58/d84/fe7 to d4/d19/d107/f125 0 2024-09-13T22:08:46.936 INFO:tasks.workunit.client.0.smithi089.stdout:6/745: write d0/d5/d43/f9d [2992238,71640] 0 2024-09-13T22:08:46.936 INFO:tasks.workunit.client.0.smithi089.stdout:8/893: dwrite d0/dd/db0/d20/d40/d134/f136 [0,4194304] 0 2024-09-13T22:08:46.937 INFO:tasks.workunit.client.0.smithi089.stdout:4/930: mknod d0/d2c/d52/da5/c126 0 2024-09-13T22:08:46.946 INFO:tasks.workunit.client.0.smithi089.stdout:5/835: write d4/d19/f24 [4162142,30951] 0 2024-09-13T22:08:46.946 INFO:tasks.workunit.client.0.smithi089.stdout:5/836: dread - d4/d19/d1e/d28/d31/d55/d58/d9d/ff5 zero size 2024-09-13T22:08:46.946 INFO:tasks.workunit.client.0.smithi089.stdout:3/840: dwrite d1/d2/d4/d1c/d7e/f11d [0,4194304] 0 2024-09-13T22:08:46.946 INFO:tasks.workunit.client.0.smithi089.stdout:3/841: creat d1/d2/d23/d3d/d54/dc6/f11f x:0 0 0 2024-09-13T22:08:46.946 INFO:tasks.workunit.client.0.smithi089.stdout:3/842: fdatasync d1/d2/d23/d3d/d54/d5d/deb/d63/f79 0 2024-09-13T22:08:46.946 INFO:tasks.workunit.client.0.smithi089.stdout:3/843: truncate d1/d2/d23/f76 1318727 0 2024-09-13T22:08:46.946 INFO:tasks.workunit.client.0.smithi089.stdout:3/844: chown d1/d2/d31/c33 453672228 1 2024-09-13T22:08:46.946 INFO:tasks.workunit.client.0.smithi089.stdout:3/845: fsync d1/d2/d23/d3d/d46/f67 0 2024-09-13T22:08:46.949 INFO:tasks.workunit.client.0.smithi089.stdout:5/837: mknod d4/d19/d1e/d28/d31/dfd/c126 0 2024-09-13T22:08:46.949 INFO:tasks.workunit.client.0.smithi089.stdout:4/931: dread d0/d2c/d8d/f9c [0,4194304] 0 2024-09-13T22:08:46.953 INFO:tasks.workunit.client.0.smithi089.stdout:3/846: unlink d1/d2/d23/d3d/d54/d5d/dc1/c106 0 2024-09-13T22:08:46.954 INFO:tasks.workunit.client.0.smithi089.stdout:8/894: dwrite d0/dd/f46 [0,4194304] 0 2024-09-13T22:08:46.954 INFO:tasks.workunit.client.0.smithi089.stdout:8/895: readlink d0/dd/db0/l61 0 2024-09-13T22:08:46.960 INFO:tasks.workunit.client.0.smithi089.stdout:5/838: symlink d4/d19/l127 0 2024-09-13T22:08:46.960 INFO:tasks.workunit.client.0.smithi089.stdout:5/839: write d4/d19/d107/f125 [765035,15802] 0 2024-09-13T22:08:46.960 INFO:tasks.workunit.client.0.smithi089.stdout:5/840: chown d4/d19/d1e/d53/l9c 255167 1 2024-09-13T22:08:46.960 INFO:tasks.workunit.client.0.smithi089.stdout:5/841: dread - d4/d19/d1e/d28/d31/d55/d58/d84/fa6 zero size 2024-09-13T22:08:46.960 INFO:tasks.workunit.client.0.smithi089.stdout:5/842: fdatasync d4/d19/d1e/d53/d88/d114/d119/fda 0 2024-09-13T22:08:46.961 INFO:tasks.workunit.client.0.smithi089.stdout:5/843: chown d4/d19/d1e/d89/dce/fe5 0 1 2024-09-13T22:08:46.961 INFO:tasks.workunit.client.0.smithi089.stdout:8/896: mkdir d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d70/d138 0 2024-09-13T22:08:46.961 INFO:tasks.workunit.client.0.smithi089.stdout:8/897: stat d0/dd/db0/d42/dc7/dfa/d130 0 2024-09-13T22:08:46.961 INFO:tasks.workunit.client.0.smithi089.stdout:4/932: rmdir d0/d15 39 2024-09-13T22:08:46.961 INFO:tasks.workunit.client.0.smithi089.stdout:4/933: chown d0/d11/d16/d89/fdd 113840 1 2024-09-13T22:08:46.962 INFO:tasks.workunit.client.0.smithi089.stdout:4/934: read d0/d15/d1f/f31 [298758,586] 0 2024-09-13T22:08:46.963 INFO:tasks.workunit.client.0.smithi089.stdout:6/746: dwrite d0/d5/d43/daf/db1/fc4 [0,4194304] 0 2024-09-13T22:08:46.963 INFO:tasks.workunit.client.0.smithi089.stdout:5/844: rename d4/d19/d1e/d53/dae/f122 to d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/df8/d11e/f128 0 2024-09-13T22:08:46.963 INFO:tasks.workunit.client.0.smithi089.stdout:6/747: write d0/d4/d12/d15/db3/d4a/f58 [324726,109978] 0 2024-09-13T22:08:46.963 INFO:tasks.workunit.client.0.smithi089.stdout:6/748: write d0/d4/d12/f41 [1072233,93059] 0 2024-09-13T22:08:46.964 INFO:tasks.workunit.client.0.smithi089.stdout:6/749: chown d0/dcb 4156363 1 2024-09-13T22:08:46.969 INFO:tasks.workunit.client.0.smithi089.stdout:5/845: dread d4/f5 [0,4194304] 0 2024-09-13T22:08:46.969 INFO:tasks.workunit.client.0.smithi089.stdout:8/898: rename d0/dd/db0/d20/d36/f95 to d0/dd/db0/d20/d1c/d5a/d11a/f139 0 2024-09-13T22:08:46.972 INFO:tasks.workunit.client.0.smithi089.stdout:8/899: mknod d0/dd/db0/d20/d1c/d5a/d63/dce/d114/c13a 0 2024-09-13T22:08:46.974 INFO:tasks.workunit.client.0.smithi089.stdout:8/900: creat d0/dd/db0/d20/d36/d68/de6/f13b x:0 0 0 2024-09-13T22:08:46.974 INFO:tasks.workunit.client.0.smithi089.stdout:4/935: dread d0/d2c/da0/da9/fe1 [0,4194304] 0 2024-09-13T22:08:46.978 INFO:tasks.workunit.client.0.smithi089.stdout:9/836: sync 2024-09-13T22:08:46.978 INFO:tasks.workunit.client.0.smithi089.stdout:9/837: chown d6/d18/d1b/d3e/dbd/fc7 5565345 1 2024-09-13T22:08:46.979 INFO:tasks.workunit.client.0.smithi089.stdout:4/936: rename d0/d2c/da0 to d0/d2c/d52/da5/d9d/d127 0 2024-09-13T22:08:46.980 INFO:tasks.workunit.client.0.smithi089.stdout:4/937: dread - d0/d11/f125 zero size 2024-09-13T22:08:46.982 INFO:tasks.workunit.client.0.smithi089.stdout:9/838: getdents d6 0 2024-09-13T22:08:46.996 INFO:tasks.workunit.client.0.smithi089.stdout:9/839: dread d6/d18/d1b/da0/fd8 [0,4194304] 0 2024-09-13T22:08:46.996 INFO:tasks.workunit.client.0.smithi089.stdout:9/840: symlink d6/d18/d21/d5d/d6c/l11a 0 2024-09-13T22:08:46.997 INFO:tasks.workunit.client.0.smithi089.stdout:9/841: mknod d6/d54/dcb/de0/c11b 0 2024-09-13T22:08:46.997 INFO:tasks.workunit.client.0.smithi089.stdout:9/842: dread - d6/d54/dcb/de0/f114 zero size 2024-09-13T22:08:46.999 INFO:tasks.workunit.client.0.smithi089.stdout:9/843: link d6/d18/d1b/d3e/lce d6/l11c 0 2024-09-13T22:08:47.000 INFO:tasks.workunit.client.0.smithi089.stdout:9/844: creat d6/d18/d21/f11d x:0 0 0 2024-09-13T22:08:47.000 INFO:tasks.workunit.client.0.smithi089.stdout:9/845: readlink d6/d55/l84 0 2024-09-13T22:08:47.002 INFO:tasks.workunit.client.0.smithi089.stdout:9/846: link d6/d54/f113 d6/d54/f11e 0 2024-09-13T22:08:47.002 INFO:tasks.workunit.client.0.smithi089.stdout:9/847: symlink d6/d18/dab/l11f 0 2024-09-13T22:08:47.003 INFO:tasks.workunit.client.0.smithi089.stdout:9/848: mkdir d6/d18/d1b/da0/dae/d120 0 2024-09-13T22:08:47.010 INFO:tasks.workunit.client.0.smithi089.stdout:8/901: dwrite d0/dd/db0/d20/d1c/d5a/d63/fc5 [0,4194304] 0 2024-09-13T22:08:47.011 INFO:tasks.workunit.client.0.smithi089.stdout:8/902: readlink d0/dd/db0/d20/d1c/d5a/d63/la7 0 2024-09-13T22:08:47.011 INFO:tasks.workunit.client.0.smithi089.stdout:8/903: write d0/dd/db0/d42/dc7/d10d/f11e [815963,53585] 0 2024-09-13T22:08:47.011 INFO:tasks.workunit.client.0.smithi089.stdout:8/904: chown d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/f44 13087 1 2024-09-13T22:08:47.011 INFO:tasks.workunit.client.0.smithi089.stdout:6/750: dwrite d0/d4/d12/d15/f93 [0,4194304] 0 2024-09-13T22:08:47.011 INFO:tasks.workunit.client.0.smithi089.stdout:6/751: write d0/d5/d1d/d2d/da0/fe0 [2516987,63191] 0 2024-09-13T22:08:47.011 INFO:tasks.workunit.client.0.smithi089.stdout:5/846: dwrite d4/d19/d1e/d89/dce/f4e [0,4194304] 0 2024-09-13T22:08:47.011 INFO:tasks.workunit.client.0.smithi089.stdout:4/938: dwrite d0/d2c/d35/d74/f9b [0,4194304] 0 2024-09-13T22:08:47.011 INFO:tasks.workunit.client.0.smithi089.stdout:8/905: symlink d0/dd/db0/d20/d1c/l13c 0 2024-09-13T22:08:47.014 INFO:tasks.workunit.client.0.smithi089.stdout:8/906: write d0/dd/db0/d3a/f94 [754225,92678] 0 2024-09-13T22:08:47.014 INFO:tasks.workunit.client.0.smithi089.stdout:8/907: creat d0/dd/db0/d20/d40/f13d x:0 0 0 2024-09-13T22:08:47.014 INFO:tasks.workunit.client.0.smithi089.stdout:6/752: symlink d0/d4/d12/d15/db3/d4b/d7a/le8 0 2024-09-13T22:08:47.017 INFO:tasks.workunit.client.0.smithi089.stdout:9/849: write d6/d31/d5e/f7d [2904273,45744] 0 2024-09-13T22:08:47.020 INFO:tasks.workunit.client.0.smithi089.stdout:4/939: rename d0/d15/c34 to d0/d2c/c128 0 2024-09-13T22:08:47.022 INFO:tasks.workunit.client.0.smithi089.stdout:8/908: symlink d0/dd/db0/d20/d36/d68/l13e 0 2024-09-13T22:08:47.024 INFO:tasks.workunit.client.0.smithi089.stdout:9/850: creat d6/d18/d21/de6/f121 x:0 0 0 2024-09-13T22:08:47.025 INFO:tasks.workunit.client.0.smithi089.stdout:5/847: dwrite d4/f9 [0,4194304] 0 2024-09-13T22:08:47.025 INFO:tasks.workunit.client.0.smithi089.stdout:5/848: chown d4/d19/d1e/d53/d88/d114/d119/fda 0 1 2024-09-13T22:08:47.029 INFO:tasks.workunit.client.0.smithi089.stdout:4/940: unlink d0/d2c/f5f 0 2024-09-13T22:08:47.029 INFO:tasks.workunit.client.0.smithi089.stdout:4/941: stat d0/d11 0 2024-09-13T22:08:47.029 INFO:tasks.workunit.client.0.smithi089.stdout:8/909: unlink d0/d6a/d73/l75 0 2024-09-13T22:08:47.029 INFO:tasks.workunit.client.0.smithi089.stdout:8/910: chown d0/dd/db0/d20/d36/d59/d89/dca/f119 15910304 1 2024-09-13T22:08:47.029 INFO:tasks.workunit.client.0.smithi089.stdout:9/851: mknod d6/d55/c122 0 2024-09-13T22:08:47.029 INFO:tasks.workunit.client.0.smithi089.stdout:9/852: chown d6/faa 121797 1 2024-09-13T22:08:47.031 INFO:tasks.workunit.client.0.smithi089.stdout:8/911: creat d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/de4/f13f x:0 0 0 2024-09-13T22:08:47.031 INFO:tasks.workunit.client.0.smithi089.stdout:9/853: symlink d6/d31/d5e/db1/l123 0 2024-09-13T22:08:47.032 INFO:tasks.workunit.client.0.smithi089.stdout:8/912: rmdir d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b 39 2024-09-13T22:08:47.033 INFO:tasks.workunit.client.0.smithi089.stdout:8/913: creat d0/dd/db0/d20/d1c/d5a/d63/dce/d114/dde/f140 x:0 0 0 2024-09-13T22:08:47.034 INFO:tasks.workunit.client.0.smithi089.stdout:9/854: dread d6/d18/d1b/d89/fba [0,4194304] 0 2024-09-13T22:08:47.035 INFO:tasks.workunit.client.0.smithi089.stdout:8/914: dread d0/fc2 [0,4194304] 0 2024-09-13T22:08:47.036 INFO:tasks.workunit.client.0.smithi089.stdout:2/805: sync 2024-09-13T22:08:47.036 INFO:tasks.workunit.client.0.smithi089.stdout:2/806: readlink df/d1a/l28 0 2024-09-13T22:08:47.036 INFO:tasks.workunit.client.0.smithi089.stdout:9/855: symlink d6/d18/d1b/d89/db8/dbe/df8/l124 0 2024-09-13T22:08:47.036 INFO:tasks.workunit.client.0.smithi089.stdout:9/856: readlink d6/d18/dab/la7 0 2024-09-13T22:08:47.036 INFO:tasks.workunit.client.0.smithi089.stdout:9/857: creat d6/d18/d21/f125 x:0 0 0 2024-09-13T22:08:47.036 INFO:tasks.workunit.client.0.smithi089.stdout:9/858: chown d6/d18/d1b/f26 0 1 2024-09-13T22:08:47.037 INFO:tasks.workunit.client.0.smithi089.stdout:8/915: mkdir d0/dd/db0/d20/d40/d134/d141 0 2024-09-13T22:08:47.037 INFO:tasks.workunit.client.0.smithi089.stdout:8/916: write d0/dd/db0/d42/f77 [373113,99627] 0 2024-09-13T22:08:47.037 INFO:tasks.workunit.client.0.smithi089.stdout:8/917: creat d0/dd/db0/d20/d1c/d5a/f142 x:0 0 0 2024-09-13T22:08:47.038 INFO:tasks.workunit.client.0.smithi089.stdout:2/807: rmdir df/d76 39 2024-09-13T22:08:47.038 INFO:tasks.workunit.client.0.smithi089.stdout:2/808: rename df/d14 to df/d14/d2b/d111 22 2024-09-13T22:08:47.038 INFO:tasks.workunit.client.0.smithi089.stdout:2/809: write df/d1a/f81 [2844924,61996] 0 2024-09-13T22:08:47.038 INFO:tasks.workunit.client.0.smithi089.stdout:2/810: write df/d14/d66/d69/d2e/f37 [4675918,96605] 0 2024-09-13T22:08:47.038 INFO:tasks.workunit.client.0.smithi089.stdout:4/942: dread d0/d2c/d52/df0/ff2 [0,4194304] 0 2024-09-13T22:08:47.039 INFO:tasks.workunit.client.0.smithi089.stdout:9/859: symlink d6/d18/d1b/d89/l126 0 2024-09-13T22:08:47.042 INFO:tasks.workunit.client.0.smithi089.stdout:8/918: symlink d0/dd/db0/d20/d36/da0/l143 0 2024-09-13T22:08:47.042 INFO:tasks.workunit.client.0.smithi089.stdout:8/919: dread - d0/dd/db0/d20/d1c/d5a/d63/dce/d114/dde/f11f zero size 2024-09-13T22:08:47.042 INFO:tasks.workunit.client.0.smithi089.stdout:8/920: dread - d0/dd/db0/d20/d1c/d5a/d63/dce/d114/dde/f11f zero size 2024-09-13T22:08:47.042 INFO:tasks.workunit.client.0.smithi089.stdout:8/921: fdatasync d0/dd/db0/d20/d1c/d5a/d11a/f139 0 2024-09-13T22:08:47.044 INFO:tasks.workunit.client.0.smithi089.stdout:6/753: dwrite d0/d5/d1d/d2d/da0/faa [4194304,4194304] 0 2024-09-13T22:08:47.044 INFO:tasks.workunit.client.0.smithi089.stdout:6/754: readlink d0/d4/d12/d15/d3b/la3 0 2024-09-13T22:08:47.044 INFO:tasks.workunit.client.0.smithi089.stdout:6/755: fdatasync d0/d5/d43/d79/fa2 0 2024-09-13T22:08:47.045 INFO:tasks.workunit.client.0.smithi089.stdout:2/811: symlink df/d14/d2b/l112 0 2024-09-13T22:08:47.046 INFO:tasks.workunit.client.0.smithi089.stdout:4/943: write d0/d2c/d52/da5/d8e/fab [39019,67815] 0 2024-09-13T22:08:47.046 INFO:tasks.workunit.client.0.smithi089.stdout:5/849: dwrite d4/d19/d1e/d28/d31/d61/f8d [0,4194304] 0 2024-09-13T22:08:47.046 INFO:tasks.workunit.client.0.smithi089.stdout:8/922: rename d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/d88/d100 to d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/d88/d144 0 2024-09-13T22:08:47.046 INFO:tasks.workunit.client.0.smithi089.stdout:8/923: creat d0/d6a/d73/f145 x:0 0 0 2024-09-13T22:08:47.052 INFO:tasks.workunit.client.0.smithi089.stdout:5/850: mknod d4/d19/d1e/d28/d3d/c129 0 2024-09-13T22:08:47.054 INFO:tasks.workunit.client.0.smithi089.stdout:8/924: rmdir d0/d6a/d73/df1 0 2024-09-13T22:08:47.054 INFO:tasks.workunit.client.0.smithi089.stdout:8/925: chown d0/dd/db0/d42/cd3 89571 1 2024-09-13T22:08:47.054 INFO:tasks.workunit.client.0.smithi089.stdout:8/926: stat d0/dd/db0/d20 0 2024-09-13T22:08:47.056 INFO:tasks.workunit.client.0.smithi089.stdout:8/927: link d0/dd/db0/d20/d36/d68/l13e d0/dd/db0/d20/d1c/d5a/d63/dce/d114/dde/l146 0 2024-09-13T22:08:47.059 INFO:tasks.workunit.client.0.smithi089.stdout:9/860: dwrite d6/d18/d1b/f82 [0,4194304] 0 2024-09-13T22:08:47.063 INFO:tasks.workunit.client.0.smithi089.stdout:9/861: mkdir d6/d127 0 2024-09-13T22:08:47.064 INFO:tasks.workunit.client.0.smithi089.stdout:9/862: mknod d6/d18/d1b/da0/c128 0 2024-09-13T22:08:47.064 INFO:tasks.workunit.client.0.smithi089.stdout:9/863: fdatasync d6/d18/d1b/d89/db8/dbe/ffd 0 2024-09-13T22:08:47.065 INFO:tasks.workunit.client.0.smithi089.stdout:9/864: symlink d6/d54/dcb/de0/l129 0 2024-09-13T22:08:47.065 INFO:tasks.workunit.client.0.smithi089.stdout:9/865: read d6/d18/dab/f4c [821031,110851] 0 2024-09-13T22:08:47.071 INFO:tasks.workunit.client.0.smithi089.stdout:7/786: sync 2024-09-13T22:08:47.071 INFO:tasks.workunit.client.0.smithi089.stdout:1/821: sync 2024-09-13T22:08:47.071 INFO:tasks.workunit.client.0.smithi089.stdout:3/847: sync 2024-09-13T22:08:47.072 INFO:tasks.workunit.client.0.smithi089.stdout:4/944: dread d0/d15/d1f/f42 [0,4194304] 0 2024-09-13T22:08:47.072 INFO:tasks.workunit.client.0.smithi089.stdout:4/945: truncate d0/d15/d1f/d75/dee/fa8 573471 0 2024-09-13T22:08:47.072 INFO:tasks.workunit.client.0.smithi089.stdout:1/822: symlink d7/d40/dbe/d2b/d59/l10b 0 2024-09-13T22:08:47.072 INFO:tasks.workunit.client.0.smithi089.stdout:7/787: write d0/d19/d28/ff2 [181128,84434] 0 2024-09-13T22:08:47.073 INFO:tasks.workunit.client.0.smithi089.stdout:3/848: mkdir d1/d2/d23/d3d/d46/d120 0 2024-09-13T22:08:47.074 INFO:tasks.workunit.client.0.smithi089.stdout:4/946: rmdir d0/d15/d1f/d75/dee/dfb 39 2024-09-13T22:08:47.075 INFO:tasks.workunit.client.0.smithi089.stdout:1/823: creat d7/de/d68/dd9/d107/f10c x:0 0 0 2024-09-13T22:08:47.075 INFO:tasks.workunit.client.0.smithi089.stdout:7/788: symlink d0/d19/d45/d92/ddc/l10f 0 2024-09-13T22:08:47.077 INFO:tasks.workunit.client.0.smithi089.stdout:4/947: unlink d0/d15/d1f/f42 0 2024-09-13T22:08:47.077 INFO:tasks.workunit.client.0.smithi089.stdout:4/948: fdatasync d0/d11/d16/f103 0 2024-09-13T22:08:47.080 INFO:tasks.workunit.client.0.smithi089.stdout:4/949: rename d0/d15/d1f/d75/dee/d8c/fe7 to d0/d2c/d52/da5/d9d/f129 0 2024-09-13T22:08:47.080 INFO:tasks.workunit.client.0.smithi089.stdout:4/950: truncate d0/d2c/fb7 331427 0 2024-09-13T22:08:47.080 INFO:tasks.workunit.client.0.smithi089.stdout:4/951: write d0/d2c/d35/d5d/da4/fb3 [480749,113941] 0 2024-09-13T22:08:47.080 INFO:tasks.workunit.client.0.smithi089.stdout:4/952: fsync d0/d15/d1f/d75/dee/ff3 0 2024-09-13T22:08:47.081 INFO:tasks.workunit.client.0.smithi089.stdout:4/953: mkdir d0/d2c/d35/d5d/da4/d12a 0 2024-09-13T22:08:47.083 INFO:tasks.workunit.client.0.smithi089.stdout:6/756: dwrite d0/d4/d12/d15/db3/d28/dbf/fdd [0,4194304] 0 2024-09-13T22:08:47.083 INFO:tasks.workunit.client.0.smithi089.stdout:4/954: link d0/d11/d16/d89/fdd d0/d11/d16/f12b 0 2024-09-13T22:08:47.086 INFO:tasks.workunit.client.0.smithi089.stdout:1/824: dread d7/de/f27 [0,4194304] 0 2024-09-13T22:08:47.086 INFO:tasks.workunit.client.0.smithi089.stdout:2/812: dwrite df/f8d [0,4194304] 0 2024-09-13T22:08:47.086 INFO:tasks.workunit.client.0.smithi089.stdout:6/757: creat d0/d4/d12/d15/db3/d4b/fe9 x:0 0 0 2024-09-13T22:08:47.086 INFO:tasks.workunit.client.0.smithi089.stdout:5/851: dwrite d4/d19/d1e/d28/d31/d61/fe2 [0,4194304] 0 2024-09-13T22:08:47.087 INFO:tasks.workunit.client.0.smithi089.stdout:4/955: creat d0/d15/f12c x:0 0 0 2024-09-13T22:08:47.087 INFO:tasks.workunit.client.0.smithi089.stdout:4/956: write d0/d11/f125 [35781,73858] 0 2024-09-13T22:08:47.091 INFO:tasks.workunit.client.0.smithi089.stdout:4/957: getdents d0/d2c/d35/d64/d6e 0 2024-09-13T22:08:47.091 INFO:tasks.workunit.client.0.smithi089.stdout:4/958: readlink d0/d2c/d52/da5/d8e/lc7 0 2024-09-13T22:08:47.091 INFO:tasks.workunit.client.0.smithi089.stdout:7/789: dread d0/d19/d28/d1d/d2d/f6d [0,4194304] 0 2024-09-13T22:08:47.091 INFO:tasks.workunit.client.0.smithi089.stdout:4/959: truncate d0/d15/d1f/f10d 800029 0 2024-09-13T22:08:47.092 INFO:tasks.workunit.client.0.smithi089.stdout:2/813: rename df/d14/d66/d8a to df/d76/de8/d113 0 2024-09-13T22:08:47.093 INFO:tasks.workunit.client.0.smithi089.stdout:4/960: truncate d0/d2c/d35/d5d/f8a 1057108 0 2024-09-13T22:08:47.095 INFO:tasks.workunit.client.0.smithi089.stdout:7/790: rename d0/d19/d28/d1d/d23/d24/f8d to d0/d19/d28/d1d/d23/d24/dac/db3/f110 0 2024-09-13T22:08:47.095 INFO:tasks.workunit.client.0.smithi089.stdout:7/791: fdatasync d0/d19/d28/d1d/d3d/d9a/dcf/d41/fc2 0 2024-09-13T22:08:47.095 INFO:tasks.workunit.client.0.smithi089.stdout:7/792: chown d0/d19/f2b 0 1 2024-09-13T22:08:47.095 INFO:tasks.workunit.client.0.smithi089.stdout:2/814: creat df/d76/f114 x:0 0 0 2024-09-13T22:08:47.096 INFO:tasks.workunit.client.0.smithi089.stdout:4/961: creat d0/d2c/d35/d74/f12d x:0 0 0 2024-09-13T22:08:47.097 INFO:tasks.workunit.client.0.smithi089.stdout:7/793: creat d0/d19/f111 x:0 0 0 2024-09-13T22:08:47.097 INFO:tasks.workunit.client.0.smithi089.stdout:4/962: stat d0/d11/d16/l4b 0 2024-09-13T22:08:47.097 INFO:tasks.workunit.client.0.smithi089.stdout:9/866: dwrite d6/d18/d1b/d89/db8/dbe/f10c [4194304,4194304] 0 2024-09-13T22:08:47.098 INFO:tasks.workunit.client.0.smithi089.stdout:7/794: rmdir d0/d19/d28/d1d/d2d 39 2024-09-13T22:08:47.098 INFO:tasks.workunit.client.0.smithi089.stdout:7/795: chown d0/d19/d28/d1d/d23/d24/dac/fc1 69 1 2024-09-13T22:08:47.100 INFO:tasks.workunit.client.0.smithi089.stdout:3/849: dwrite d1/d2/d4/d1c/d7e/f7a [0,4194304] 0 2024-09-13T22:08:47.100 INFO:tasks.workunit.client.0.smithi089.stdout:3/850: write d1/d2/d96/d102/f108 [296444,124838] 0 2024-09-13T22:08:47.100 INFO:tasks.workunit.client.0.smithi089.stdout:8/928: dwrite d0/dd/db0/d3a/f94 [0,4194304] 0 2024-09-13T22:08:47.100 INFO:tasks.workunit.client.0.smithi089.stdout:6/758: read d0/d4/f6f [3386831,29677] 0 2024-09-13T22:08:47.101 INFO:tasks.workunit.client.0.smithi089.stdout:9/867: symlink d6/d31/d5e/db1/l12a 0 2024-09-13T22:08:47.104 INFO:tasks.workunit.client.0.smithi089.stdout:3/851: creat d1/d2/d23/d3d/d54/d5d/deb/d63/da4/f121 x:0 0 0 2024-09-13T22:08:47.105 INFO:tasks.workunit.client.0.smithi089.stdout:8/929: mkdir d0/dd/db0/d42/dc7/dfa/d130/d147 0 2024-09-13T22:08:47.105 INFO:tasks.workunit.client.0.smithi089.stdout:8/930: dread - d0/dd/db0/d20/d1c/d5a/d63/dce/d114/dde/f140 zero size 2024-09-13T22:08:47.106 INFO:tasks.workunit.client.0.smithi089.stdout:6/759: rmdir d0/d4/d12/d15/db3/d28/dbf/de3 39 2024-09-13T22:08:47.108 INFO:tasks.workunit.client.0.smithi089.stdout:4/963: dread d0/d15/f2e [0,4194304] 0 2024-09-13T22:08:47.109 INFO:tasks.workunit.client.0.smithi089.stdout:9/868: link d6/d55/fd2 d6/d54/d115/f12b 0 2024-09-13T22:08:47.109 INFO:tasks.workunit.client.0.smithi089.stdout:9/869: stat d6/f15 0 2024-09-13T22:08:47.110 INFO:tasks.workunit.client.0.smithi089.stdout:3/852: creat d1/d2/d4/d1c/d7f/f122 x:0 0 0 2024-09-13T22:08:47.112 INFO:tasks.workunit.client.0.smithi089.stdout:6/760: creat d0/d5/d64/fea x:0 0 0 2024-09-13T22:08:47.115 INFO:tasks.workunit.client.0.smithi089.stdout:9/870: truncate d6/f14 112751 0 2024-09-13T22:08:47.115 INFO:tasks.workunit.client.0.smithi089.stdout:7/796: write d0/d19/d28/d1d/d23/d24/d5d/ff9 [3491174,115756] 0 2024-09-13T22:08:47.115 INFO:tasks.workunit.client.0.smithi089.stdout:3/853: mkdir d1/d2/de4/d123 0 2024-09-13T22:08:47.116 INFO:tasks.workunit.client.0.smithi089.stdout:9/871: link d6/d31/d64/l94 d6/d18/d1b/d89/db8/d5a/l12c 0 2024-09-13T22:08:47.116 INFO:tasks.workunit.client.0.smithi089.stdout:9/872: chown d6/d31/l6b 2158767 1 2024-09-13T22:08:47.116 INFO:tasks.workunit.client.0.smithi089.stdout:5/852: dwrite d4/d19/d1e/d28/d3d/dba/f11b [0,4194304] 0 2024-09-13T22:08:47.118 INFO:tasks.workunit.client.0.smithi089.stdout:7/797: mknod d0/d19/d28/d100/c112 0 2024-09-13T22:08:47.119 INFO:tasks.workunit.client.0.smithi089.stdout:2/815: dwrite df/d5b/da5/fd4 [0,4194304] 0 2024-09-13T22:08:47.120 INFO:tasks.workunit.client.0.smithi089.stdout:1/825: rmdir d7/de/d68/dd9/d107 39 2024-09-13T22:08:47.120 INFO:tasks.workunit.client.0.smithi089.stdout:1/826: write d7/d1c/d3c/f65 [1402100,113647] 0 2024-09-13T22:08:47.122 INFO:tasks.workunit.client.0.smithi089.stdout:3/854: dread d1/d2/d23/d3d/dda/d1b/f4e [0,4194304] 0 2024-09-13T22:08:47.125 INFO:tasks.workunit.client.0.smithi089.stdout:1/827: mknod d7/de/def/c10d 0 2024-09-13T22:08:47.127 INFO:tasks.workunit.client.0.smithi089.stdout:6/761: dread d0/f3e [0,4194304] 0 2024-09-13T22:08:47.128 INFO:tasks.workunit.client.0.smithi089.stdout:6/762: truncate d0/d4/d12/d15/f32 1038193 0 2024-09-13T22:08:47.128 INFO:tasks.workunit.client.0.smithi089.stdout:1/828: creat d7/d1c/d7a/f10e x:0 0 0 2024-09-13T22:08:47.128 INFO:tasks.workunit.client.0.smithi089.stdout:1/829: stat d7/de/d3a/d77/l87 0 2024-09-13T22:08:47.128 INFO:tasks.workunit.client.0.smithi089.stdout:1/830: stat d7/db6/fcb 0 2024-09-13T22:08:47.131 INFO:tasks.workunit.client.0.smithi089.stdout:6/763: stat d0/c51 0 2024-09-13T22:08:47.133 INFO:tasks.workunit.client.0.smithi089.stdout:1/831: truncate d7/de/f27 661095 0 2024-09-13T22:08:47.133 INFO:tasks.workunit.client.0.smithi089.stdout:1/832: chown d7/de/da0/cff 2166 1 2024-09-13T22:08:47.133 INFO:tasks.workunit.client.0.smithi089.stdout:1/833: write d7/d40/dbe/d2b/d59/d9e/fe4 [68153,51326] 0 2024-09-13T22:08:47.135 INFO:tasks.workunit.client.0.smithi089.stdout:8/931: dwrite d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/de4/f13f [0,4194304] 0 2024-09-13T22:08:47.135 INFO:tasks.workunit.client.0.smithi089.stdout:1/834: symlink d7/de/de7/df9/l10f 0 2024-09-13T22:08:47.136 INFO:tasks.workunit.client.0.smithi089.stdout:4/964: dread d0/d2c/d52/da5/d9d/d127/da9/fe1 [0,4194304] 0 2024-09-13T22:08:47.137 INFO:tasks.workunit.client.0.smithi089.stdout:1/835: dread d7/de/d3a/fda [0,4194304] 0 2024-09-13T22:08:47.137 INFO:tasks.workunit.client.0.smithi089.stdout:1/836: truncate d7/d40/dbe/d2b/d59/f67 4360107 0 2024-09-13T22:08:47.139 INFO:tasks.workunit.client.0.smithi089.stdout:6/764: getdents d0/d4/d12/d15 0 2024-09-13T22:08:47.145 INFO:tasks.workunit.client.0.smithi089.stdout:8/932: mkdir d0/dd/db0/d42/dc7/dfa/d130/d147/d148 0 2024-09-13T22:08:47.145 INFO:tasks.workunit.client.0.smithi089.stdout:6/765: symlink d0/d5/d43/db6/leb 0 2024-09-13T22:08:47.146 INFO:tasks.workunit.client.0.smithi089.stdout:6/766: readlink d0/d4/d12/d15/db3/d4b/lac 0 2024-09-13T22:08:47.147 INFO:tasks.workunit.client.0.smithi089.stdout:8/933: unlink d0/d6a/f12e 0 2024-09-13T22:08:47.154 INFO:tasks.workunit.client.0.smithi089.stdout:6/767: read d0/f3e [2166653,105257] 0 2024-09-13T22:08:47.156 INFO:tasks.workunit.client.0.smithi089.stdout:6/768: creat d0/fec x:0 0 0 2024-09-13T22:08:47.157 INFO:tasks.workunit.client.0.smithi089.stdout:5/853: dwrite d4/d19/d1e/d28/d3d/faf [0,4194304] 0 2024-09-13T22:08:47.157 INFO:tasks.workunit.client.0.smithi089.stdout:5/854: dread - d4/d19/d1e/d28/d31/d55/f103 zero size 2024-09-13T22:08:47.157 INFO:tasks.workunit.client.0.smithi089.stdout:5/855: creat d4/d19/d1e/d28/d31/d55/d58/d9d/f12a x:0 0 0 2024-09-13T22:08:47.159 INFO:tasks.workunit.client.0.smithi089.stdout:5/856: dread d4/d19/f56 [0,4194304] 0 2024-09-13T22:08:47.177 INFO:tasks.workunit.client.0.smithi089.stdout:5/857: dread d4/f27 [0,4194304] 0 2024-09-13T22:08:47.178 INFO:tasks.workunit.client.0.smithi089.stdout:5/858: symlink d4/d19/d1e/d89/dce/l12b 0 2024-09-13T22:08:47.179 INFO:tasks.workunit.client.0.smithi089.stdout:5/859: getdents d4/d19/d1e/d53 0 2024-09-13T22:08:47.180 INFO:tasks.workunit.client.0.smithi089.stdout:5/860: rmdir d4/d19/d1e/d28/d3d 39 2024-09-13T22:08:47.180 INFO:tasks.workunit.client.0.smithi089.stdout:2/816: dwrite df/d14/d66/d69/fe0 [0,4194304] 0 2024-09-13T22:08:47.181 INFO:tasks.workunit.client.0.smithi089.stdout:9/873: dwrite d6/d18/f95 [0,4194304] 0 2024-09-13T22:08:47.181 INFO:tasks.workunit.client.0.smithi089.stdout:7/798: dwrite d0/d19/d28/d1d/d2d/d55/f79 [0,4194304] 0 2024-09-13T22:08:47.181 INFO:tasks.workunit.client.0.smithi089.stdout:9/874: creat d6/d18/d1b/d89/db8/f12d x:0 0 0 2024-09-13T22:08:47.182 INFO:tasks.workunit.client.0.smithi089.stdout:1/837: dwrite d7/de/d3a/fda [0,4194304] 0 2024-09-13T22:08:47.182 INFO:tasks.workunit.client.0.smithi089.stdout:1/838: write d7/d40/dbe/de9/ffd [1063331,76998] 0 2024-09-13T22:08:47.182 INFO:tasks.workunit.client.0.smithi089.stdout:8/934: dwrite d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/d88/f106 [0,4194304] 0 2024-09-13T22:08:47.183 INFO:tasks.workunit.client.0.smithi089.stdout:3/855: dwrite d1/d2/d23/d2b/fe7 [0,4194304] 0 2024-09-13T22:08:47.183 INFO:tasks.workunit.client.0.smithi089.stdout:5/861: symlink d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/df8/l12c 0 2024-09-13T22:08:47.183 INFO:tasks.workunit.client.0.smithi089.stdout:5/862: write d4/d19/d1e/d28/d3d/dc9/f78 [9068336,125537] 0 2024-09-13T22:08:47.183 INFO:tasks.workunit.client.0.smithi089.stdout:5/863: readlink d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/df8/l12c 0 2024-09-13T22:08:47.188 INFO:tasks.workunit.client.0.smithi089.stdout:2/817: rename df/d1a/ddf/feb to df/d14/d2b/d101/f115 0 2024-09-13T22:08:47.188 INFO:tasks.workunit.client.0.smithi089.stdout:2/818: fdatasync df/d14/d66/d69/f44 0 2024-09-13T22:08:47.188 INFO:tasks.workunit.client.0.smithi089.stdout:2/819: creat df/d14/d48/d88/db9/dec/f116 x:0 0 0 2024-09-13T22:08:47.189 INFO:tasks.workunit.client.0.smithi089.stdout:7/799: mkdir d0/d19/d28/d1d/d23/d24/d113 0 2024-09-13T22:08:47.196 INFO:tasks.workunit.client.0.smithi089.stdout:1/839: stat d7/de/d3a/c41 0 2024-09-13T22:08:47.201 INFO:tasks.workunit.client.0.smithi089.stdout:3/856: rename d1/d2/d4/d1c/d7e/d40/d69/da1/c78 to d1/d2/d23/d3d/d54/d5d/deb/d63/da4/c124 0 2024-09-13T22:08:47.201 INFO:tasks.workunit.client.0.smithi089.stdout:3/857: truncate d1/d2/d4/d1c/d7e/d40/d50/f117 342166 0 2024-09-13T22:08:47.202 INFO:tasks.workunit.client.0.smithi089.stdout:2/820: mkdir df/d14/d2b/d61/dbd/d117 0 2024-09-13T22:08:47.202 INFO:tasks.workunit.client.0.smithi089.stdout:2/821: readlink df/d76/d85/lf3 0 2024-09-13T22:08:47.202 INFO:tasks.workunit.client.0.smithi089.stdout:2/822: write df/d5b/fd2 [1463661,77473] 0 2024-09-13T22:08:47.203 INFO:tasks.workunit.client.0.smithi089.stdout:9/875: getdents d6/d31/d64 0 2024-09-13T22:08:47.203 INFO:tasks.workunit.client.0.smithi089.stdout:9/876: stat d6/d18/d1b/d89/db8/d52/c103 0 2024-09-13T22:08:47.204 INFO:tasks.workunit.client.0.smithi089.stdout:8/935: getdents d0/dd/db0/d20/d1c/d5a 0 2024-09-13T22:08:47.205 INFO:tasks.workunit.client.0.smithi089.stdout:1/840: dread d7/de/da0/dbd/fce [0,4194304] 0 2024-09-13T22:08:47.205 INFO:tasks.workunit.client.0.smithi089.stdout:1/841: readlink d7/d40/dbe/d2b/d59/lec 0 2024-09-13T22:08:47.205 INFO:tasks.workunit.client.0.smithi089.stdout:1/842: write d7/d34/f38 [5031198,118832] 0 2024-09-13T22:08:47.205 INFO:tasks.workunit.client.0.smithi089.stdout:1/843: write d7/d34/d5c/d5d/fb8 [572998,43651] 0 2024-09-13T22:08:47.206 INFO:tasks.workunit.client.0.smithi089.stdout:5/864: rename d4/d19/d1e/d28/d3d/cd4 to d4/d19/d1e/d28/d31/dd1/df3/c12d 0 2024-09-13T22:08:47.206 INFO:tasks.workunit.client.0.smithi089.stdout:3/858: getdents d1/d2/d23/d3d/d46/dab 0 2024-09-13T22:08:47.206 INFO:tasks.workunit.client.0.smithi089.stdout:3/859: write d1/d2/de4/f111 [289985,3358] 0 2024-09-13T22:08:47.207 INFO:tasks.workunit.client.0.smithi089.stdout:8/936: mkdir d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/de4/d149 0 2024-09-13T22:08:47.209 INFO:tasks.workunit.client.0.smithi089.stdout:1/844: symlink d7/d40/dbe/l110 0 2024-09-13T22:08:47.210 INFO:tasks.workunit.client.0.smithi089.stdout:7/800: rename d0/d19/d28/d1d/d3d/d69/fcc to d0/d19/d28/d1d/d23/d89/d93/f114 0 2024-09-13T22:08:47.211 INFO:tasks.workunit.client.0.smithi089.stdout:2/823: dread df/d14/f24 [0,4194304] 0 2024-09-13T22:08:47.211 INFO:tasks.workunit.client.0.smithi089.stdout:8/937: mkdir d0/dd/db0/d3a/dd4/d14a 0 2024-09-13T22:08:47.213 INFO:tasks.workunit.client.0.smithi089.stdout:9/877: dread d6/d18/f95 [0,4194304] 0 2024-09-13T22:08:47.214 INFO:tasks.workunit.client.0.smithi089.stdout:1/845: mknod d7/de/de7/df9/c111 0 2024-09-13T22:08:47.216 INFO:tasks.workunit.client.0.smithi089.stdout:8/938: link d0/dd/db0/d42/dc7/dfa/f120 d0/dd/db0/d42/dc0/f14b 0 2024-09-13T22:08:47.216 INFO:tasks.workunit.client.0.smithi089.stdout:8/939: dread - d0/dd/db0/d20/d36/da0/ff8 zero size 2024-09-13T22:08:47.219 INFO:tasks.workunit.client.0.smithi089.stdout:8/940: mknod d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/da5/d115/c14c 0 2024-09-13T22:08:47.219 INFO:tasks.workunit.client.0.smithi089.stdout:8/941: fdatasync d0/dd/db0/d20/d36/dd1/fd7 0 2024-09-13T22:08:47.220 INFO:tasks.workunit.client.0.smithi089.stdout:3/860: write d1/d2/d23/d3d/d54/dc6/f118 [1823096,55230] 0 2024-09-13T22:08:47.222 INFO:tasks.workunit.client.0.smithi089.stdout:8/942: symlink d0/dd/db0/d20/d1c/d5a/d11a/l14d 0 2024-09-13T22:08:47.222 INFO:tasks.workunit.client.0.smithi089.stdout:8/943: creat d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d70/f14e x:0 0 0 2024-09-13T22:08:47.223 INFO:tasks.workunit.client.0.smithi089.stdout:3/861: mknod d1/d2/d4/d5a/d109/c125 0 2024-09-13T22:08:47.224 INFO:tasks.workunit.client.0.smithi089.stdout:5/865: dwrite d4/d19/d1e/d28/d31/d55/dcc/fd5 [0,4194304] 0 2024-09-13T22:08:47.224 INFO:tasks.workunit.client.0.smithi089.stdout:5/866: truncate d4/d19/d1e/d28/d31/d55/fec 585624 0 2024-09-13T22:08:47.226 INFO:tasks.workunit.client.0.smithi089.stdout:3/862: mknod d1/d2/d23/df7/c126 0 2024-09-13T22:08:47.228 INFO:tasks.workunit.client.0.smithi089.stdout:5/867: rmdir d4/d19/d1e/d53/d88/d114/d119 39 2024-09-13T22:08:47.231 INFO:tasks.workunit.client.0.smithi089.stdout:3/863: link d1/d2/d23/d3d/d46/l62 d1/d2/d23/d3d/d54/d5d/dc1/l127 0 2024-09-13T22:08:47.232 INFO:tasks.workunit.client.0.smithi089.stdout:5/868: symlink d4/d19/d1e/d28/d31/d55/d58/d84/l12e 0 2024-09-13T22:08:47.233 INFO:tasks.workunit.client.0.smithi089.stdout:3/864: symlink d1/d2/d4/d1c/d7e/l128 0 2024-09-13T22:08:47.233 INFO:tasks.workunit.client.0.smithi089.stdout:8/944: read d0/dd/db0/d3a/d83/fd0 [3917008,10660] 0 2024-09-13T22:08:47.234 INFO:tasks.workunit.client.0.smithi089.stdout:3/865: rename d1/d2/d23/d3d/d54/d5d/ffe to d1/d2/d4/d5a/d109/f129 0 2024-09-13T22:08:47.234 INFO:tasks.workunit.client.0.smithi089.stdout:3/866: chown d1/d2/d23/d3d/d46/dab/df2/f11e 187759702 1 2024-09-13T22:08:47.235 INFO:tasks.workunit.client.0.smithi089.stdout:8/945: symlink d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/da5/l14f 0 2024-09-13T22:08:47.235 INFO:tasks.workunit.client.0.smithi089.stdout:8/946: mkdir d0/dd/db0/d20/d1c/d5a/d150 0 2024-09-13T22:08:47.236 INFO:tasks.workunit.client.0.smithi089.stdout:8/947: truncate d0/dd/f46 2126809 0 2024-09-13T22:08:47.236 INFO:tasks.workunit.client.0.smithi089.stdout:8/948: truncate d0/dd/db0/d20/d40/f12b 3440970 0 2024-09-13T22:08:47.237 INFO:tasks.workunit.client.0.smithi089.stdout:8/949: mknod d0/dd/db0/d20/d1c/d5a/d150/c151 0 2024-09-13T22:08:47.237 INFO:tasks.workunit.client.0.smithi089.stdout:8/950: dread - d0/dd/db0/d20/d40/d4a/d7f/da6/fb7 zero size 2024-09-13T22:08:47.237 INFO:tasks.workunit.client.0.smithi089.stdout:8/951: dread - d0/d6a/d73/f145 zero size 2024-09-13T22:08:47.238 INFO:tasks.workunit.client.0.smithi089.stdout:3/867: dread d1/d2/d4/d1c/d7e/f91 [0,4194304] 0 2024-09-13T22:08:47.238 INFO:tasks.workunit.client.0.smithi089.stdout:8/952: mkdir d0/d6a/d6f/d152 0 2024-09-13T22:08:47.239 INFO:tasks.workunit.client.0.smithi089.stdout:3/868: rename d1/d2/d96/d102/l8d to d1/d2/d23/d3d/dda/l12a 0 2024-09-13T22:08:47.239 INFO:tasks.workunit.client.0.smithi089.stdout:3/869: chown d1/d2/d4/d1c/d7f/fc0 16 1 2024-09-13T22:08:47.240 INFO:tasks.workunit.client.0.smithi089.stdout:3/870: symlink d1/d2/d23/d3d/d54/dc6/l12b 0 2024-09-13T22:08:47.241 INFO:tasks.workunit.client.0.smithi089.stdout:3/871: unlink d1/d2/d31/f6e 0 2024-09-13T22:08:47.241 INFO:tasks.workunit.client.0.smithi089.stdout:3/872: creat d1/d2/d4/d1c/d7f/d119/f12c x:0 0 0 2024-09-13T22:08:47.243 INFO:tasks.workunit.client.0.smithi089.stdout:3/873: link d1/d2/d23/d3d/d54/d5d/deb/d63/c8f d1/d2/d23/d3d/d46/dab/c12d 0 2024-09-13T22:08:47.243 INFO:tasks.workunit.client.0.smithi089.stdout:3/874: creat d1/d2/d23/d3d/dda/d1b/f12e x:0 0 0 2024-09-13T22:08:47.243 INFO:tasks.workunit.client.0.smithi089.stdout:5/869: dread d4/d19/d1e/d28/d31/d55/dcc/f7b [4194304,4194304] 0 2024-09-13T22:08:47.243 INFO:tasks.workunit.client.0.smithi089.stdout:5/870: write d4/d19/d1e/d28/d3d/f7a [1197957,41235] 0 2024-09-13T22:08:47.243 INFO:tasks.workunit.client.0.smithi089.stdout:8/953: dread d0/dd/db0/d20/d36/d68/de6/ff9 [0,4194304] 0 2024-09-13T22:08:47.244 INFO:tasks.workunit.client.0.smithi089.stdout:3/875: mkdir d1/d2/d23/d3d/d54/d12f 0 2024-09-13T22:08:47.244 INFO:tasks.workunit.client.0.smithi089.stdout:3/876: creat d1/d2/d23/d3d/dda/d1b/f130 x:0 0 0 2024-09-13T22:08:47.244 INFO:tasks.workunit.client.0.smithi089.stdout:2/824: dwrite df/d76/d85/f8e [0,4194304] 0 2024-09-13T22:08:47.246 INFO:tasks.workunit.client.0.smithi089.stdout:9/878: dwrite d6/d18/d21/f44 [4194304,4194304] 0 2024-09-13T22:08:47.246 INFO:tasks.workunit.client.0.smithi089.stdout:1/846: dwrite d7/db6/fe8 [0,4194304] 0 2024-09-13T22:08:47.246 INFO:tasks.workunit.client.0.smithi089.stdout:9/879: fdatasync d6/d18/d1b/da0/fd8 0 2024-09-13T22:08:47.246 INFO:tasks.workunit.client.0.smithi089.stdout:1/847: dread - d7/d1c/d7a/f10e zero size 2024-09-13T22:08:47.246 INFO:tasks.workunit.client.0.smithi089.stdout:1/848: write d7/de/d3a/d77/fcf [1020771,68695] 0 2024-09-13T22:08:47.246 INFO:tasks.workunit.client.0.smithi089.stdout:1/849: write d7/de/d3a/d77/fcf [771383,4001] 0 2024-09-13T22:08:47.254 INFO:tasks.workunit.client.0.smithi089.stdout:9/880: symlink d6/d18/d1b/l12e 0 2024-09-13T22:08:47.256 INFO:tasks.workunit.client.0.smithi089.stdout:9/881: mknod d6/d18/d1b/da0/d100/c12f 0 2024-09-13T22:08:47.256 INFO:tasks.workunit.client.0.smithi089.stdout:9/882: truncate d6/d18/d1b/d89/db8/d52/d102/fed 141514 0 2024-09-13T22:08:47.256 INFO:tasks.workunit.client.0.smithi089.stdout:9/883: fsync d6/ff 0 2024-09-13T22:08:47.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/884: chown d6/d18/d1b/d3e/dbd/fc7 180 1 2024-09-13T22:08:47.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/885: write d6/d31/d5e/f79 [1770836,73490] 0 2024-09-13T22:08:47.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/886: write d6/d54/f9d [1085553,69332] 0 2024-09-13T22:08:47.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/887: write d6/d54/dcb/fff [33189,120624] 0 2024-09-13T22:08:47.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/888: chown d6/d18/d1b/d89/db8/cc3 54 1 2024-09-13T22:08:47.258 INFO:tasks.workunit.client.0.smithi089.stdout:9/889: unlink d6/feb 0 2024-09-13T22:08:47.259 INFO:tasks.workunit.client.0.smithi089.stdout:9/890: mkdir d6/d18/d1b/d3e/d130 0 2024-09-13T22:08:47.259 INFO:tasks.workunit.client.0.smithi089.stdout:9/891: chown d6/fc 162308 1 2024-09-13T22:08:47.260 INFO:tasks.workunit.client.0.smithi089.stdout:9/892: creat d6/d18/d1b/d3e/f131 x:0 0 0 2024-09-13T22:08:47.260 INFO:tasks.workunit.client.0.smithi089.stdout:9/893: chown d6/d54/fb5 100183 1 2024-09-13T22:08:47.260 INFO:tasks.workunit.client.0.smithi089.stdout:9/894: truncate d6/d18/d1b/da0/fb9 449419 0 2024-09-13T22:08:47.264 INFO:tasks.workunit.client.0.smithi089.stdout:3/877: write d1/d2/d4/d1c/d7e/f7a [816686,72430] 0 2024-09-13T22:08:47.264 INFO:tasks.workunit.client.0.smithi089.stdout:3/878: chown d1/d2/d31 4656596 1 2024-09-13T22:08:47.266 INFO:tasks.workunit.client.0.smithi089.stdout:3/879: mknod d1/d2/d23/d3d/dda/d1b/c131 0 2024-09-13T22:08:47.267 INFO:tasks.workunit.client.0.smithi089.stdout:3/880: creat d1/d2/d4/d1c/d7f/f132 x:0 0 0 2024-09-13T22:08:47.268 INFO:tasks.workunit.client.0.smithi089.stdout:5/871: dwrite d4/d19/d1e/d28/f49 [0,4194304] 0 2024-09-13T22:08:47.269 INFO:tasks.workunit.client.0.smithi089.stdout:8/954: dwrite d0/dd/db0/d20/d36/d59/d89/fe0 [0,4194304] 0 2024-09-13T22:08:47.270 INFO:tasks.workunit.client.0.smithi089.stdout:3/881: rename d1/d2/d4/d1c/d7e/d40/fdb to d1/d2/d23/d3d/dda/d1b/f133 0 2024-09-13T22:08:47.270 INFO:tasks.workunit.client.0.smithi089.stdout:3/882: creat d1/d2/d4/d1c/d7f/f134 x:0 0 0 2024-09-13T22:08:47.277 INFO:tasks.workunit.client.0.smithi089.stdout:3/883: rename d1/d2/d23/d3d/dda/f9d to d1/d2/d23/d3d/d46/dab/f135 0 2024-09-13T22:08:47.277 INFO:tasks.workunit.client.0.smithi089.stdout:3/884: chown d1/d2/d96/dc3/c9a 4 1 2024-09-13T22:08:47.277 INFO:tasks.workunit.client.0.smithi089.stdout:3/885: fdatasync d1/d2/d23/d3d/d54/d5d/deb/fcf 0 2024-09-13T22:08:47.287 INFO:tasks.workunit.client.0.smithi089.stdout:6/769: sync 2024-09-13T22:08:47.287 INFO:tasks.workunit.client.0.smithi089.stdout:4/965: sync 2024-09-13T22:08:47.287 INFO:tasks.workunit.client.0.smithi089.stdout:4/966: creat d0/d2c/d52/da5/d9d/f12e x:0 0 0 2024-09-13T22:08:47.287 INFO:tasks.workunit.client.0.smithi089.stdout:4/967: read d0/d2c/d35/d74/f88 [166575,10971] 0 2024-09-13T22:08:47.287 INFO:tasks.workunit.client.0.smithi089.stdout:4/968: chown d0/d2c/d35/d64/ld8 7298616 1 2024-09-13T22:08:47.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/969: symlink d0/d2c/d52/da5/d9d/d127/da9/l12f 0 2024-09-13T22:08:47.289 INFO:tasks.workunit.client.0.smithi089.stdout:4/970: chown d0/c3a 13 1 2024-09-13T22:08:47.290 INFO:tasks.workunit.client.0.smithi089.stdout:4/971: unlink d0/d11/d16/c46 0 2024-09-13T22:08:47.299 INFO:tasks.workunit.client.0.smithi089.stdout:9/895: dwrite d6/d18/f70 [0,4194304] 0 2024-09-13T22:08:47.299 INFO:tasks.workunit.client.0.smithi089.stdout:9/896: chown d6/d54/dcb/ld5 0 1 2024-09-13T22:08:47.305 INFO:tasks.workunit.client.0.smithi089.stdout:6/770: write d0/d4/fc9 [1681608,38893] 0 2024-09-13T22:08:47.310 INFO:tasks.workunit.client.0.smithi089.stdout:8/955: dwrite d0/fc2 [0,4194304] 0 2024-09-13T22:08:47.310 INFO:tasks.workunit.client.0.smithi089.stdout:8/956: fsync d0/dd/db0/d20/d36/d59/d89/f29 0 2024-09-13T22:08:47.313 INFO:tasks.workunit.client.0.smithi089.stdout:8/957: unlink d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/da5/cfc 0 2024-09-13T22:08:47.313 INFO:tasks.workunit.client.0.smithi089.stdout:5/872: dwrite d4/d19/d1e/d28/d31/f116 [0,4194304] 0 2024-09-13T22:08:47.313 INFO:tasks.workunit.client.0.smithi089.stdout:5/873: readlink d4/d19/d1e/d28/d3d/dba/lf1 0 2024-09-13T22:08:47.313 INFO:tasks.workunit.client.0.smithi089.stdout:3/886: dwrite d1/d2/d23/d3d/d54/d5d/f77 [0,4194304] 0 2024-09-13T22:08:47.315 INFO:tasks.workunit.client.0.smithi089.stdout:8/958: creat d0/dd/db0/d42/dc7/dfa/d130/f153 x:0 0 0 2024-09-13T22:08:47.315 INFO:tasks.workunit.client.0.smithi089.stdout:8/959: write d0/dd/db0/d20/d40/d4a/fbc [3478586,75150] 0 2024-09-13T22:08:47.315 INFO:tasks.workunit.client.0.smithi089.stdout:8/960: write d0/dd/db0/d20/d1c/fba [4070559,56530] 0 2024-09-13T22:08:47.316 INFO:tasks.workunit.client.0.smithi089.stdout:8/961: fdatasync d0/dd/f35 0 2024-09-13T22:08:47.319 INFO:tasks.workunit.client.0.smithi089.stdout:8/962: rename d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/f8c to d0/dd/db0/d20/d1c/d5a/d150/f154 0 2024-09-13T22:08:47.320 INFO:tasks.workunit.client.0.smithi089.stdout:8/963: rmdir d0/dd/db0/d20/d36/d59/d5d 39 2024-09-13T22:08:47.320 INFO:tasks.workunit.client.0.smithi089.stdout:6/771: dread d0/d5/d1d/d2d/da0/faa [4194304,4194304] 0 2024-09-13T22:08:47.321 INFO:tasks.workunit.client.0.smithi089.stdout:4/972: dwrite d0/d2c/d52/da5/d9d/ddb/feb [0,4194304] 0 2024-09-13T22:08:47.321 INFO:tasks.workunit.client.0.smithi089.stdout:9/897: dwrite d6/d31/d5e/db1/fb6 [0,4194304] 0 2024-09-13T22:08:47.322 INFO:tasks.workunit.client.0.smithi089.stdout:8/964: unlink d0/dd/db0/d20/d36/d68/l13e 0 2024-09-13T22:08:47.324 INFO:tasks.workunit.client.0.smithi089.stdout:6/772: mkdir d0/d4/ded 0 2024-09-13T22:08:47.324 INFO:tasks.workunit.client.0.smithi089.stdout:6/773: chown d0/d4/d12/d15/d3b/d62/da4 15875434 1 2024-09-13T22:08:47.333 INFO:tasks.workunit.client.0.smithi089.stdout:4/973: mkdir d0/d15/d130 0 2024-09-13T22:08:47.333 INFO:tasks.workunit.client.0.smithi089.stdout:4/974: fsync d0/d2c/d35/d64/f78 0 2024-09-13T22:08:47.333 INFO:tasks.workunit.client.0.smithi089.stdout:4/975: write d0/d15/d1f/d75/dee/fa8 [1174688,79194] 0 2024-09-13T22:08:47.336 INFO:tasks.workunit.client.0.smithi089.stdout:9/898: link d6/d55/le9 d6/d31/d5e/db1/d10f/l132 0 2024-09-13T22:08:47.338 INFO:tasks.workunit.client.0.smithi089.stdout:4/976: creat d0/d2c/d52/da5/d9d/ddb/de2/f131 x:0 0 0 2024-09-13T22:08:47.338 INFO:tasks.workunit.client.0.smithi089.stdout:4/977: write d0/d11/d16/f103 [16465,60662] 0 2024-09-13T22:08:47.339 INFO:tasks.workunit.client.0.smithi089.stdout:9/899: mkdir d6/d18/d1b/d89/db8/dbe/d133 0 2024-09-13T22:08:47.341 INFO:tasks.workunit.client.0.smithi089.stdout:4/978: mkdir d0/d2c/d52/da5/d9d/ddb/de2/d132 0 2024-09-13T22:08:47.342 INFO:tasks.workunit.client.0.smithi089.stdout:9/900: symlink d6/d31/d5e/db1/l134 0 2024-09-13T22:08:47.343 INFO:tasks.workunit.client.0.smithi089.stdout:4/979: mkdir d0/d2c/d52/da5/d9d/d111/d133 0 2024-09-13T22:08:47.343 INFO:tasks.workunit.client.0.smithi089.stdout:4/980: stat d0/d2c/d35/d64/d6e/f77 0 2024-09-13T22:08:47.344 INFO:tasks.workunit.client.0.smithi089.stdout:5/874: dwrite d4/d19/d1e/d28/d31/d55/d58/d9d/f12a [0,4194304] 0 2024-09-13T22:08:47.344 INFO:tasks.workunit.client.0.smithi089.stdout:9/901: rename d6/d31/d5e/f7d to d6/f135 0 2024-09-13T22:08:47.345 INFO:tasks.workunit.client.0.smithi089.stdout:4/981: symlink d0/d2c/d52/l134 0 2024-09-13T22:08:47.349 INFO:tasks.workunit.client.0.smithi089.stdout:5/875: creat d4/d19/d1e/d28/d31/d61/dfb/f12f x:0 0 0 2024-09-13T22:08:47.350 INFO:tasks.workunit.client.0.smithi089.stdout:9/902: mknod d6/d18/d1b/d89/db8/d52/d102/c136 0 2024-09-13T22:08:47.351 INFO:tasks.workunit.client.0.smithi089.stdout:4/982: mknod d0/d2c/d35/d64/c135 0 2024-09-13T22:08:47.353 INFO:tasks.workunit.client.0.smithi089.stdout:5/876: creat d4/d19/d1e/d28/d3d/dc9/d106/f130 x:0 0 0 2024-09-13T22:08:47.353 INFO:tasks.workunit.client.0.smithi089.stdout:5/877: stat d4/d19/d1e/d28/d3d/dba 0 2024-09-13T22:08:47.354 INFO:tasks.workunit.client.0.smithi089.stdout:5/878: dread - d4/d19/d1e/d28/d31/d61/f110 zero size 2024-09-13T22:08:47.354 INFO:tasks.workunit.client.0.smithi089.stdout:5/879: fsync d4/d19/f79 0 2024-09-13T22:08:47.354 INFO:tasks.workunit.client.0.smithi089.stdout:9/903: getdents d6/d18/d1b/d89/db8/d5a 0 2024-09-13T22:08:47.355 INFO:tasks.workunit.client.0.smithi089.stdout:4/983: truncate d0/d2c/d52/da5/d9d/d127/da9/fe1 1807516 0 2024-09-13T22:08:47.355 INFO:tasks.workunit.client.0.smithi089.stdout:4/984: chown d0/d2c/d8d 1626782 1 2024-09-13T22:08:47.358 INFO:tasks.workunit.client.0.smithi089.stdout:5/880: creat d4/d19/d1e/d28/d31/d55/d58/f131 x:0 0 0 2024-09-13T22:08:47.358 INFO:tasks.workunit.client.0.smithi089.stdout:5/881: getdents d4/d19/d1e/d28/d31/d61/d123 0 2024-09-13T22:08:47.358 INFO:tasks.workunit.client.0.smithi089.stdout:5/882: truncate d4/d19/d1e/d28/d3d/f57 859619 0 2024-09-13T22:08:47.359 INFO:tasks.workunit.client.0.smithi089.stdout:5/883: mknod d4/d19/d1e/d28/d31/d55/d58/d84/c132 0 2024-09-13T22:08:47.361 INFO:tasks.workunit.client.0.smithi089.stdout:5/884: rename d4/d19/d1e/d28/d31/d55/d58/d9d/ff9 to d4/d19/d1e/d28/d31/d94/f133 0 2024-09-13T22:08:47.362 INFO:tasks.workunit.client.0.smithi089.stdout:3/887: dwrite d1/d2/d23/d3d/dda/d5c/ff0 [0,4194304] 0 2024-09-13T22:08:47.362 INFO:tasks.workunit.client.0.smithi089.stdout:8/965: dwrite d0/dd/db0/d42/f2c [4194304,4194304] 0 2024-09-13T22:08:47.362 INFO:tasks.workunit.client.0.smithi089.stdout:8/966: stat d0/dd/db0/d20/d36/d59/d89/cda 0 2024-09-13T22:08:47.362 INFO:tasks.workunit.client.0.smithi089.stdout:8/967: chown d0/dd/db0/d20/d40/d4a/d7f/l8f 5270627 1 2024-09-13T22:08:47.363 INFO:tasks.workunit.client.0.smithi089.stdout:6/774: dwrite d0/d5/d43/f8a [0,4194304] 0 2024-09-13T22:08:47.363 INFO:tasks.workunit.client.0.smithi089.stdout:5/885: creat d4/d19/d1e/d53/d88/d114/d119/f134 x:0 0 0 2024-09-13T22:08:47.367 INFO:tasks.workunit.client.0.smithi089.stdout:3/888: unlink d1/d2/f82 0 2024-09-13T22:08:47.378 INFO:tasks.workunit.client.0.smithi089.stdout:4/985: dwrite d0/d2c/d52/da5/f11e [0,4194304] 0 2024-09-13T22:08:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:47 smithi159 ceph-mon[35348]: pgmap v255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 149 MiB/s rd, 193 MiB/s wr, 672 op/s 2024-09-13T22:08:47.526 INFO:tasks.workunit.client.0.smithi089.stdout:6/775: mknod d0/d5/d1d/d54/cee 0 2024-09-13T22:08:47.530 INFO:tasks.workunit.client.0.smithi089.stdout:9/904: dwrite d6/d18/f1d [0,4194304] 0 2024-09-13T22:08:47.530 INFO:tasks.workunit.client.0.smithi089.stdout:8/968: dwrite d0/dd/db0/d20/d40/d4a/f7a [4194304,4194304] 0 2024-09-13T22:08:47.540 INFO:tasks.workunit.client.0.smithi089.stdout:5/886: creat d4/d19/de4/f135 x:0 0 0 2024-09-13T22:08:47.540 INFO:tasks.workunit.client.0.smithi089.stdout:5/887: read d4/d19/d1e/d28/d31/f75 [358252,78699] 0 2024-09-13T22:08:47.541 INFO:tasks.workunit.client.0.smithi089.stdout:5/888: chown d4/d19/d1e/d89/c93 0 1 2024-09-13T22:08:47.543 INFO:tasks.workunit.client.0.smithi089.stdout:4/986: mknod d0/d15/d1f/d75/dee/d8c/c136 0 2024-09-13T22:08:47.543 INFO:tasks.workunit.client.0.smithi089.stdout:4/987: creat d0/d2c/d52/da5/d9d/ddb/de2/f137 x:0 0 0 2024-09-13T22:08:47.543 INFO:tasks.workunit.client.0.smithi089.stdout:4/988: write d0/d15/fbc [116140,45843] 0 2024-09-13T22:08:47.543 INFO:tasks.workunit.client.0.smithi089.stdout:4/989: chown d0/d2c/d35/d5d 1168 1 2024-09-13T22:08:47.544 INFO:tasks.workunit.client.0.smithi089.stdout:6/776: mknod d0/d4/d12/d15/d3b/cef 0 2024-09-13T22:08:47.546 INFO:tasks.workunit.client.0.smithi089.stdout:9/905: truncate d6/f15 4172451 0 2024-09-13T22:08:47.549 INFO:tasks.workunit.client.0.smithi089.stdout:8/969: mknod d0/dd/db0/d20/d1c/c155 0 2024-09-13T22:08:47.549 INFO:tasks.workunit.client.0.smithi089.stdout:8/970: write d0/dd/db0/d42/dc0/f14b [128956,15245] 0 2024-09-13T22:08:47.550 INFO:tasks.workunit.client.0.smithi089.stdout:3/889: getdents d1/d2/d4/d1c 0 2024-09-13T22:08:47.550 INFO:tasks.workunit.client.0.smithi089.stdout:3/890: stat d1/d2 0 2024-09-13T22:08:47.551 INFO:tasks.workunit.client.0.smithi089.stdout:5/889: dread d4/d19/d1e/d28/d31/d55/f68 [0,4194304] 0 2024-09-13T22:08:47.551 INFO:tasks.workunit.client.0.smithi089.stdout:5/890: fdatasync d4/d19/d1e/d28/d31/d55/d58/d9d/f111 0 2024-09-13T22:08:47.552 INFO:tasks.workunit.client.0.smithi089.stdout:5/891: dread d4/fc5 [0,4194304] 0 2024-09-13T22:08:47.553 INFO:tasks.workunit.client.0.smithi089.stdout:5/892: fdatasync d4/d19/d1e/d28/d3d/f7a 0 2024-09-13T22:08:47.553 INFO:tasks.workunit.client.0.smithi089.stdout:6/777: dread d0/d5/d1d/d2d/da0/faa [0,4194304] 0 2024-09-13T22:08:47.553 INFO:tasks.workunit.client.0.smithi089.stdout:4/990: creat d0/d2c/d35/d64/f138 x:0 0 0 2024-09-13T22:08:47.558 INFO:tasks.workunit.client.0.smithi089.stdout:4/991: creat d0/d11/d16/d89/f139 x:0 0 0 2024-09-13T22:08:47.558 INFO:tasks.workunit.client.0.smithi089.stdout:1/850: sync 2024-09-13T22:08:47.558 INFO:tasks.workunit.client.0.smithi089.stdout:2/825: sync 2024-09-13T22:08:47.558 INFO:tasks.workunit.client.0.smithi089.stdout:7/801: sync 2024-09-13T22:08:47.558 INFO:tasks.workunit.client.0.smithi089.stdout:1/851: truncate d7/de/f27 752016 0 2024-09-13T22:08:47.559 INFO:tasks.workunit.client.0.smithi089.stdout:8/971: getdents d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/da5 0 2024-09-13T22:08:47.559 INFO:tasks.workunit.client.0.smithi089.stdout:8/972: write d0/dd/db0/d20/d1c/d5a/d63/dce/d114/f111 [432702,69435] 0 2024-09-13T22:08:47.562 INFO:tasks.workunit.client.0.smithi089.stdout:3/891: getdents d1 0 2024-09-13T22:08:47.562 INFO:tasks.workunit.client.0.smithi089.stdout:7/802: dread d0/d19/d28/d7b/f97 [0,4194304] 0 2024-09-13T22:08:47.565 INFO:tasks.workunit.client.0.smithi089.stdout:5/893: rename d4/d19/d1e/d53/d88/d114 to d4/d19/d1e/d53/d88/d136 0 2024-09-13T22:08:47.566 INFO:tasks.workunit.client.0.smithi089.stdout:4/992: mknod d0/d2c/d52/da5/c13a 0 2024-09-13T22:08:47.566 INFO:tasks.workunit.client.0.smithi089.stdout:4/993: write d0/f13 [3256633,5806] 0 2024-09-13T22:08:47.566 INFO:tasks.workunit.client.0.smithi089.stdout:6/778: dread d0/d4/d12/f85 [0,4194304] 0 2024-09-13T22:08:47.567 INFO:tasks.workunit.client.0.smithi089.stdout:8/973: dread d0/dd/db0/d20/f17 [0,4194304] 0 2024-09-13T22:08:47.568 INFO:tasks.workunit.client.0.smithi089.stdout:1/852: creat d7/d40/dbe/d2b/d59/f112 x:0 0 0 2024-09-13T22:08:47.570 INFO:tasks.workunit.client.0.smithi089.stdout:5/894: symlink d4/d19/d1e/d28/d31/d55/l137 0 2024-09-13T22:08:47.571 INFO:tasks.workunit.client.0.smithi089.stdout:4/994: creat d0/d15/d1f/d75/f13b x:0 0 0 2024-09-13T22:08:47.572 INFO:tasks.workunit.client.0.smithi089.stdout:6/779: mknod d0/d5/d43/daf/cf0 0 2024-09-13T22:08:47.572 INFO:tasks.workunit.client.0.smithi089.stdout:6/780: chown d0/d5/d43/f77 0 1 2024-09-13T22:08:47.573 INFO:tasks.workunit.client.0.smithi089.stdout:2/826: rmdir df/d76/d85 39 2024-09-13T22:08:47.574 INFO:tasks.workunit.client.0.smithi089.stdout:8/974: symlink d0/d6a/l156 0 2024-09-13T22:08:47.576 INFO:tasks.workunit.client.0.smithi089.stdout:1/853: mkdir d7/d40/dbe/d2b/da7/d100/d113 0 2024-09-13T22:08:47.577 INFO:tasks.workunit.client.0.smithi089.stdout:5/895: mknod d4/d19/d1e/d53/d88/d136/d119/c138 0 2024-09-13T22:08:47.578 INFO:tasks.workunit.client.0.smithi089.stdout:4/995: creat d0/d2c/d8d/f13c x:0 0 0 2024-09-13T22:08:47.578 INFO:tasks.workunit.client.0.smithi089.stdout:6/781: getdents d0/d4/d12/d15/db3/d28/dbf 0 2024-09-13T22:08:47.579 INFO:tasks.workunit.client.0.smithi089.stdout:2/827: truncate df/d5b/da5/fb7 2581286 0 2024-09-13T22:08:47.580 INFO:tasks.workunit.client.0.smithi089.stdout:8/975: mkdir d0/d6a/d6f/d152/d157 0 2024-09-13T22:08:47.580 INFO:tasks.workunit.client.0.smithi089.stdout:5/896: symlink d4/d19/d107/l139 0 2024-09-13T22:08:47.581 INFO:tasks.workunit.client.0.smithi089.stdout:4/996: mkdir d0/d2c/da1/d13d 0 2024-09-13T22:08:47.581 INFO:tasks.workunit.client.0.smithi089.stdout:4/997: readlink d0/d2c/d35/d64/d6e/l72 0 2024-09-13T22:08:47.581 INFO:tasks.workunit.client.0.smithi089.stdout:4/998: creat d0/d15/d1f/d75/f13e x:0 0 0 2024-09-13T22:08:47.582 INFO:tasks.workunit.client.0.smithi089.stdout:9/906: dwrite d6/d54/f9d [0,4194304] 0 2024-09-13T22:08:47.582 INFO:tasks.workunit.client.0.smithi089.stdout:2/828: link df/d14/d66/d69/fa7 df/d14/f118 0 2024-09-13T22:08:47.586 INFO:tasks.workunit.client.0.smithi089.stdout:5/897: symlink d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/df8/l13a 0 2024-09-13T22:08:47.586 INFO:tasks.workunit.client.0.smithi089.stdout:5/898: write d4/d19/d1e/d53/d88/d136/d119/fda [449177,99863] 0 2024-09-13T22:08:47.589 INFO:tasks.workunit.client.0.smithi089.stdout:4/999: creat d0/d15/d130/f13f x:0 0 0 2024-09-13T22:08:47.592 INFO:tasks.workunit.client.0.smithi089.stdout:7/803: dwrite d0/d19/d28/d1d/d3d/ff6 [0,4194304] 0 2024-09-13T22:08:47.593 INFO:tasks.workunit.client.0.smithi089.stdout:6/782: dread d0/f11 [0,4194304] 0 2024-09-13T22:08:47.593 INFO:tasks.workunit.client.0.smithi089.stdout:6/783: write d0/d5/fb8 [223198,42459] 0 2024-09-13T22:08:47.595 INFO:tasks.workunit.client.0.smithi089.stdout:9/907: dread d6/d54/f98 [4194304,4194304] 0 2024-09-13T22:08:47.597 INFO:tasks.workunit.client.0.smithi089.stdout:6/784: creat d0/d4/d12/d15/db3/d60/d94/ff1 x:0 0 0 2024-09-13T22:08:47.600 INFO:tasks.workunit.client.0.smithi089.stdout:7/804: link d0/d19/d28/d1d/d23/d24/dac/db3/f110 d0/d19/d28/d1d/d30/da7/f115 0 2024-09-13T22:08:47.600 INFO:tasks.workunit.client.0.smithi089.stdout:7/805: readlink d0/d19/d45/d92/ld1 0 2024-09-13T22:08:47.600 INFO:tasks.workunit.client.0.smithi089.stdout:6/785: chown d0/c2f 58 1 2024-09-13T22:08:47.601 INFO:tasks.workunit.client.0.smithi089.stdout:6/786: write d0/d5/d1d/fe2 [750030,56707] 0 2024-09-13T22:08:47.601 INFO:tasks.workunit.client.0.smithi089.stdout:6/787: stat d0/d4/d12/d15/d3b/d62/da4/fd4 0 2024-09-13T22:08:47.605 INFO:tasks.workunit.client.0.smithi089.stdout:5/899: dread d4/d19/d1e/d28/d31/d55/da4/fb6 [0,4194304] 0 2024-09-13T22:08:47.605 INFO:tasks.workunit.client.0.smithi089.stdout:1/854: dwrite d7/d1c/d7a/f10e [0,4194304] 0 2024-09-13T22:08:47.606 INFO:tasks.workunit.client.0.smithi089.stdout:1/855: write d7/de/fea [1026444,36985] 0 2024-09-13T22:08:47.606 INFO:tasks.workunit.client.0.smithi089.stdout:1/856: stat d7/de/d68/dd9 0 2024-09-13T22:08:47.606 INFO:tasks.workunit.client.0.smithi089.stdout:1/857: chown d7/fa4 302 1 2024-09-13T22:08:47.606 INFO:tasks.workunit.client.0.smithi089.stdout:1/858: dread - d7/d1c/d3c/fd4 zero size 2024-09-13T22:08:47.606 INFO:tasks.workunit.client.0.smithi089.stdout:1/859: dread - d7/db6/fcb zero size 2024-09-13T22:08:47.606 INFO:tasks.workunit.client.0.smithi089.stdout:1/860: write d7/de/d3a/d77/f7c [4902944,6453] 0 2024-09-13T22:08:47.608 INFO:tasks.workunit.client.0.smithi089.stdout:8/976: dwrite d0/dd/db0/d20/d36/d59/d89/dca/f119 [0,4194304] 0 2024-09-13T22:08:47.608 INFO:tasks.workunit.client.0.smithi089.stdout:8/977: chown d0/dd/db0/d20/d36/d59/d89/f2d 0 1 2024-09-13T22:08:47.609 INFO:tasks.workunit.client.0.smithi089.stdout:1/861: mkdir d7/d40/dbe/d114 0 2024-09-13T22:08:47.612 INFO:tasks.workunit.client.0.smithi089.stdout:9/908: dread d6/f59 [4194304,4194304] 0 2024-09-13T22:08:47.612 INFO:tasks.workunit.client.0.smithi089.stdout:8/978: symlink d0/dd/db0/d20/d36/d68/de6/l158 0 2024-09-13T22:08:47.614 INFO:tasks.workunit.client.0.smithi089.stdout:9/909: creat d6/d18/d21/d5d/d6c/f137 x:0 0 0 2024-09-13T22:08:47.614 INFO:tasks.workunit.client.0.smithi089.stdout:9/910: write d6/d18/d21/d5d/d6c/fd1 [330820,125794] 0 2024-09-13T22:08:47.614 INFO:tasks.workunit.client.0.smithi089.stdout:9/911: creat d6/d31/d5e/db1/d10f/f138 x:0 0 0 2024-09-13T22:08:47.616 INFO:tasks.workunit.client.0.smithi089.stdout:6/788: read d0/d4/f2b [4131029,89399] 0 2024-09-13T22:08:47.617 INFO:tasks.workunit.client.0.smithi089.stdout:9/912: truncate d6/d18/d1b/f26 7277391 0 2024-09-13T22:08:47.618 INFO:tasks.workunit.client.0.smithi089.stdout:6/789: creat d0/d5/d1d/d2d/da0/ff2 x:0 0 0 2024-09-13T22:08:47.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/790: read d0/d5/d1d/f33 [254117,125031] 0 2024-09-13T22:08:47.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/791: write d0/d5/d1d/d2d/f6d [879791,64046] 0 2024-09-13T22:08:47.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/792: stat d0/d5/d1d/d2d/d55/ca5 0 2024-09-13T22:08:47.620 INFO:tasks.workunit.client.0.smithi089.stdout:9/913: unlink d6/d31/d5e/f79 0 2024-09-13T22:08:47.620 INFO:tasks.workunit.client.0.smithi089.stdout:8/979: rename d0/dd/db0/d20/d40/d4a/d7f/da6 to d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/de4/d159 0 2024-09-13T22:08:47.620 INFO:tasks.workunit.client.0.smithi089.stdout:9/914: truncate d6/d18/dab/fd4 254027 0 2024-09-13T22:08:47.620 INFO:tasks.workunit.client.0.smithi089.stdout:9/915: dread - d6/d31/d64/ffc zero size 2024-09-13T22:08:47.620 INFO:tasks.workunit.client.0.smithi089.stdout:1/862: write d7/d40/dbe/d2b/d39/d73/da9/ffe [1077335,73352] 0 2024-09-13T22:08:47.620 INFO:tasks.workunit.client.0.smithi089.stdout:6/793: symlink d0/d5/d43/d79/lf3 0 2024-09-13T22:08:47.621 INFO:tasks.workunit.client.0.smithi089.stdout:8/980: rename d0/dd/db0/d20/d36/d59/d5d/c12d to d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/de4/c15a 0 2024-09-13T22:08:47.624 INFO:tasks.workunit.client.0.smithi089.stdout:6/794: rename d0/cf to d0/d5/d1d/d54/ddc/cf4 0 2024-09-13T22:08:47.624 INFO:tasks.workunit.client.0.smithi089.stdout:6/795: dread - d0/d5/d43/d79/fa2 zero size 2024-09-13T22:08:47.624 INFO:tasks.workunit.client.0.smithi089.stdout:6/796: creat d0/d4/ff5 x:0 0 0 2024-09-13T22:08:47.624 INFO:tasks.workunit.client.0.smithi089.stdout:6/797: creat d0/d5/ff6 x:0 0 0 2024-09-13T22:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:7/806: dwrite d0/d19/d45/f106 [4194304,4194304] 0 2024-09-13T22:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:2/829: dwrite df/d14/d66/d69/fe0 [0,4194304] 0 2024-09-13T22:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:1/863: dwrite d7/d1c/d7a/fbf [0,4194304] 0 2024-09-13T22:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:6/798: dwrite d0/d4/d12/d15/db3/d28/f8b [0,4194304] 0 2024-09-13T22:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:5/900: dwrite d4/d19/d1e/d53/f7e [0,4194304] 0 2024-09-13T22:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:9/916: dwrite d6/d18/d1b/d89/db8/f12d [0,4194304] 0 2024-09-13T22:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:5/901: stat d4/d19/d1e/d28/d31/d55/da4 0 2024-09-13T22:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:8/981: dwrite d0/dd/db0/d42/dc7/dfa/f11d [0,4194304] 0 2024-09-13T22:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:8/982: getdents d0/dd/db0/d42/dc7/dfa/d130/d147/d148 0 2024-09-13T22:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:8/983: write d0/dd/db0/d3a/f127 [911554,109947] 0 2024-09-13T22:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:1/864: symlink d7/de/de7/l115 0 2024-09-13T22:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:1/865: fdatasync d7/d34/d5c/f88 0 2024-09-13T22:08:47.660 INFO:tasks.workunit.client.0.smithi089.stdout:7/807: rename d0/d19/d28/d1d/d23/d24/dac to d0/d19/d28/d1d/d2d/d55/d116 0 2024-09-13T22:08:47.661 INFO:tasks.workunit.client.0.smithi089.stdout:1/866: dread d7/de/d3a/f6e [0,4194304] 0 2024-09-13T22:08:47.664 INFO:tasks.workunit.client.0.smithi089.stdout:9/917: creat d6/d54/d115/f139 x:0 0 0 2024-09-13T22:08:47.665 INFO:tasks.workunit.client.0.smithi089.stdout:9/918: chown d6/d31/c53 92 1 2024-09-13T22:08:47.666 INFO:tasks.workunit.client.0.smithi089.stdout:2/830: write df/d14/d66/f7e [195416,122252] 0 2024-09-13T22:08:47.668 INFO:tasks.workunit.client.0.smithi089.stdout:9/919: dread d6/d18/d21/f77 [4194304,4194304] 0 2024-09-13T22:08:47.668 INFO:tasks.workunit.client.0.smithi089.stdout:9/920: readlink d6/d31/d5e/db1/l12a 0 2024-09-13T22:08:47.668 INFO:tasks.workunit.client.0.smithi089.stdout:9/921: write d6/d18/d21/d5d/d6c/ff5 [1035493,59401] 0 2024-09-13T22:08:47.668 INFO:tasks.workunit.client.0.smithi089.stdout:9/922: readlink d6/d54/lcf 0 2024-09-13T22:08:47.676 INFO:tasks.workunit.client.0.smithi089.stdout:5/902: dwrite d4/f8 [0,4194304] 0 2024-09-13T22:08:47.678 INFO:tasks.workunit.client.0.smithi089.stdout:8/984: truncate d0/dd/db0/d42/dc0/fc4 2593127 0 2024-09-13T22:08:47.680 INFO:tasks.workunit.client.0.smithi089.stdout:6/799: rename d0/d4/d12/d15/f9c to d0/d4/d12/d15/db3/d28/dbf/ff7 0 2024-09-13T22:08:47.680 INFO:tasks.workunit.client.0.smithi089.stdout:6/800: stat d0/d5/d1d/d2d/d55/c6b 0 2024-09-13T22:08:47.682 INFO:tasks.workunit.client.0.smithi089.stdout:5/903: creat d4/d19/d1e/d53/d88/d136/f13b x:0 0 0 2024-09-13T22:08:47.684 INFO:tasks.workunit.client.0.smithi089.stdout:7/808: rename d0/d19/d45/d9b/cb1 to d0/d19/d28/d1d/d3d/d9a/c117 0 2024-09-13T22:08:47.685 INFO:tasks.workunit.client.0.smithi089.stdout:6/801: link d0/d4/d12/d15/db3/d28/dbf/fdd d0/d4/d12/d15/db3/d28/dbf/ff8 0 2024-09-13T22:08:47.685 INFO:tasks.workunit.client.0.smithi089.stdout:6/802: chown d0/d4/d12/d15/db3/ce 120 1 2024-09-13T22:08:47.687 INFO:tasks.workunit.client.0.smithi089.stdout:8/985: rename d0/lcd to d0/dd/db0/d42/dc7/d11b/l15b 0 2024-09-13T22:08:47.688 INFO:tasks.workunit.client.0.smithi089.stdout:7/809: creat d0/d19/d28/d1d/d30/d5b/f118 x:0 0 0 2024-09-13T22:08:47.688 INFO:tasks.workunit.client.0.smithi089.stdout:7/810: fsync d0/d19/d28/d1d/f64 0 2024-09-13T22:08:47.688 INFO:tasks.workunit.client.0.smithi089.stdout:1/867: dwrite d7/d34/d5c/f88 [4194304,4194304] 0 2024-09-13T22:08:47.689 INFO:tasks.workunit.client.0.smithi089.stdout:1/868: write d7/d34/f28 [869281,111495] 0 2024-09-13T22:08:47.689 INFO:tasks.workunit.client.0.smithi089.stdout:9/923: dwrite d6/d54/f113 [0,4194304] 0 2024-09-13T22:08:47.689 INFO:tasks.workunit.client.0.smithi089.stdout:6/803: mkdir d0/d4/d12/d15/db3/d28/dbf/df9 0 2024-09-13T22:08:47.691 INFO:tasks.workunit.client.0.smithi089.stdout:9/924: dread d6/d18/d21/f4a [0,4194304] 0 2024-09-13T22:08:47.696 INFO:tasks.workunit.client.0.smithi089.stdout:5/904: dwrite d4/d19/d1e/d28/d31/d61/f6b [0,4194304] 0 2024-09-13T22:08:47.696 INFO:tasks.workunit.client.0.smithi089.stdout:5/905: chown d4/d19/d1e/d53/d88/d136/d119/lb2 76046 1 2024-09-13T22:08:47.699 INFO:tasks.workunit.client.0.smithi089.stdout:1/869: dread d7/d40/dbe/d2b/d59/fb7 [0,4194304] 0 2024-09-13T22:08:47.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:47 smithi089 ceph-mon[27921]: pgmap v255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 149 MiB/s rd, 193 MiB/s wr, 672 op/s 2024-09-13T22:08:47.840 INFO:tasks.workunit.client.0.smithi089.stdout:8/986: truncate d0/dd/db0/d20/d1c/d5a/d63/dce/d114/dde/f140 685344 0 2024-09-13T22:08:47.840 INFO:tasks.workunit.client.0.smithi089.stdout:7/811: unlink d0/d19/d28/d1d/d23/caf 0 2024-09-13T22:08:47.853 INFO:tasks.workunit.client.0.smithi089.stdout:6/804: stat d0/d5/d1d/d54/f8f 0 2024-09-13T22:08:47.853 INFO:tasks.workunit.client.0.smithi089.stdout:6/805: dread - d0/d4/d12/f7b zero size 2024-09-13T22:08:47.853 INFO:tasks.workunit.client.0.smithi089.stdout:6/806: creat d0/d4/ffa x:0 0 0 2024-09-13T22:08:47.854 INFO:tasks.workunit.client.0.smithi089.stdout:9/925: mkdir d6/d18/d21/d5d/d109/d13a 0 2024-09-13T22:08:47.854 INFO:tasks.workunit.client.0.smithi089.stdout:9/926: chown d6/d31/d5e/db1 2619489 1 2024-09-13T22:08:47.854 INFO:tasks.workunit.client.0.smithi089.stdout:9/927: creat d6/d54/dcb/de0/f13b x:0 0 0 2024-09-13T22:08:47.854 INFO:tasks.workunit.client.0.smithi089.stdout:9/928: stat d6/d18/d1b/d89/db8/d52/l8c 0 2024-09-13T22:08:47.854 INFO:tasks.workunit.client.0.smithi089.stdout:9/929: creat d6/d18/d21/d5d/d6c/f13c x:0 0 0 2024-09-13T22:08:47.856 INFO:tasks.workunit.client.0.smithi089.stdout:5/906: unlink d4/d19/d1e/d28/d31/d55/dcc/f11a 0 2024-09-13T22:08:47.857 INFO:tasks.workunit.client.0.smithi089.stdout:1/870: creat d7/df6/f116 x:0 0 0 2024-09-13T22:08:47.858 INFO:tasks.workunit.client.0.smithi089.stdout:1/871: chown d7/d40/dbe/de9/lf7 47877843 1 2024-09-13T22:08:47.860 INFO:tasks.workunit.client.0.smithi089.stdout:1/872: write d7/d1c/fc6 [4334097,83808] 0 2024-09-13T22:08:47.860 INFO:tasks.workunit.client.0.smithi089.stdout:3/892: sync 2024-09-13T22:08:47.860 INFO:tasks.workunit.client.0.smithi089.stdout:3/893: write d1/d2/de4/ff9 [433602,42078] 0 2024-09-13T22:08:47.860 INFO:tasks.workunit.client.0.smithi089.stdout:3/894: readlink d1/d2/d96/dc3/l39 0 2024-09-13T22:08:47.860 INFO:tasks.workunit.client.0.smithi089.stdout:8/987: link d0/dd/db0/d20/d36/d59/d89/dca/cef d0/dd/db0/d20/d36/d59/d89/dca/c15c 0 2024-09-13T22:08:47.862 INFO:tasks.workunit.client.0.smithi089.stdout:7/812: creat d0/d19/d28/d100/f119 x:0 0 0 2024-09-13T22:08:47.866 INFO:tasks.workunit.client.0.smithi089.stdout:1/873: dread d7/d40/dbe/d2b/d39/d73/da9/ffe [0,4194304] 0 2024-09-13T22:08:47.867 INFO:tasks.workunit.client.0.smithi089.stdout:9/930: symlink d6/d18/d1b/l13d 0 2024-09-13T22:08:47.867 INFO:tasks.workunit.client.0.smithi089.stdout:1/874: write d7/fa4 [773414,100279] 0 2024-09-13T22:08:47.867 INFO:tasks.workunit.client.0.smithi089.stdout:9/931: write d6/d18/f1f [5196184,20578] 0 2024-09-13T22:08:47.869 INFO:tasks.workunit.client.0.smithi089.stdout:8/988: truncate d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/f97 523220 0 2024-09-13T22:08:47.870 INFO:tasks.workunit.client.0.smithi089.stdout:8/989: dread d0/dd/db0/d20/d1c/d5a/d63/dce/d114/dde/f140 [0,4194304] 0 2024-09-13T22:08:47.871 INFO:tasks.workunit.client.0.smithi089.stdout:7/813: link d0/d19/d28/d1d/d2d/fb5 d0/d19/d28/d1d/d3d/d9a/f11a 0 2024-09-13T22:08:47.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/990: symlink d0/dd/db0/d20/d36/d59/d89/l15d 0 2024-09-13T22:08:47.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/991: stat d0/dd/db0/d20/f18 0 2024-09-13T22:08:47.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/992: fsync d0/dd/db0/d20/d36/d59/d89/dca/f10a 0 2024-09-13T22:08:47.876 INFO:tasks.workunit.client.0.smithi089.stdout:8/993: unlink d0/dd/db0/d20/d36/d59/d89/c34 0 2024-09-13T22:08:47.877 INFO:tasks.workunit.client.0.smithi089.stdout:8/994: unlink d0/dd/db0/d20/d1c/c155 0 2024-09-13T22:08:47.877 INFO:tasks.workunit.client.0.smithi089.stdout:7/814: dread d0/d19/d45/fab [0,4194304] 0 2024-09-13T22:08:47.880 INFO:tasks.workunit.client.0.smithi089.stdout:8/995: symlink d0/d6a/l15e 0 2024-09-13T22:08:47.880 INFO:tasks.workunit.client.0.smithi089.stdout:8/996: readlink d0/dd/db0/d20/d1c/d5a/l132 0 2024-09-13T22:08:47.880 INFO:tasks.workunit.client.0.smithi089.stdout:8/997: fdatasync d0/dd/db0/d20/d1c/d5a/d63/dce/d114/d123/d3b/de4/f13f 0 2024-09-13T22:08:47.880 INFO:tasks.workunit.client.0.smithi089.stdout:8/998: fsync d0/dd/db0/d20/d40/d4a/f7a 0 2024-09-13T22:08:47.882 INFO:tasks.workunit.client.0.smithi089.stdout:7/815: rmdir d0/d19/d28/d7b 39 2024-09-13T22:08:47.889 INFO:tasks.workunit.client.0.smithi089.stdout:5/907: dwrite d4/d19/d1e/d28/d31/d55/dcc/f7b [4194304,4194304] 0 2024-09-13T22:08:47.893 INFO:tasks.workunit.client.0.smithi089.stdout:8/999: dread d0/dd/db0/d3a/d83/fb6 [0,4194304] 0 2024-09-13T22:08:47.893 INFO:tasks.workunit.client.0.smithi089.stdout:6/807: dwrite d0/d4/d12/d15/db3/d28/dbf/ff7 [0,4194304] 0 2024-09-13T22:08:47.897 INFO:tasks.workunit.client.0.smithi089.stdout:3/895: dwrite d1/f6 [0,4194304] 0 2024-09-13T22:08:47.897 INFO:tasks.workunit.client.0.smithi089.stdout:3/896: write d1/d2/d4/d1c/d7e/d40/d50/f117 [652341,6705] 0 2024-09-13T22:08:47.897 INFO:tasks.workunit.client.0.smithi089.stdout:3/897: stat d1/d2/d23/d3d/dda/d1b/f4e 0 2024-09-13T22:08:47.898 INFO:tasks.workunit.client.0.smithi089.stdout:3/898: link d1/d2/d23/f76 d1/d2/d4/d1c/d7e/d40/f136 0 2024-09-13T22:08:47.900 INFO:tasks.workunit.client.0.smithi089.stdout:2/831: sync 2024-09-13T22:08:47.901 INFO:tasks.workunit.client.0.smithi089.stdout:2/832: mknod df/d76/d93/c119 0 2024-09-13T22:08:47.902 INFO:tasks.workunit.client.0.smithi089.stdout:2/833: write df/d14/f24 [4308179,19848] 0 2024-09-13T22:08:47.903 INFO:tasks.workunit.client.0.smithi089.stdout:1/875: dwrite d7/d40/dbe/d2b/d39/f98 [0,4194304] 0 2024-09-13T22:08:47.903 INFO:tasks.workunit.client.0.smithi089.stdout:9/932: dwrite d6/d18/dab/fd4 [0,4194304] 0 2024-09-13T22:08:47.906 INFO:tasks.workunit.client.0.smithi089.stdout:7/816: dwrite d0/d19/d45/d38/d54/fe5 [0,4194304] 0 2024-09-13T22:08:47.906 INFO:tasks.workunit.client.0.smithi089.stdout:7/817: getdents d0/d19/d28/dee 0 2024-09-13T22:08:47.906 INFO:tasks.workunit.client.0.smithi089.stdout:7/818: write d0/d19/d28/d1d/d2d/d55/d116/db3/f109 [490747,73276] 0 2024-09-13T22:08:47.909 INFO:tasks.workunit.client.0.smithi089.stdout:3/899: dread d1/d2/d4/f5e [0,4194304] 0 2024-09-13T22:08:47.913 INFO:tasks.workunit.client.0.smithi089.stdout:2/834: dread df/d14/d66/d69/d2e/f3c [4194304,4194304] 0 2024-09-13T22:08:47.914 INFO:tasks.workunit.client.0.smithi089.stdout:7/819: rmdir d0/d19/d28/d1d/d2d 39 2024-09-13T22:08:47.915 INFO:tasks.workunit.client.0.smithi089.stdout:7/820: write d0/d19/d28/d1d/d3d/d9a/dcf/d41/f84 [1334333,130114] 0 2024-09-13T22:08:47.918 INFO:tasks.workunit.client.0.smithi089.stdout:3/900: dread d1/d2/d23/d3d/d54/d5d/deb/d63/f6d [4194304,4194304] 0 2024-09-13T22:08:47.920 INFO:tasks.workunit.client.0.smithi089.stdout:2/835: creat df/d14/d66/d69/f11a x:0 0 0 2024-09-13T22:08:47.921 INFO:tasks.workunit.client.0.smithi089.stdout:7/821: creat d0/d19/d28/d1d/d30/de1/f11b x:0 0 0 2024-09-13T22:08:47.921 INFO:tasks.workunit.client.0.smithi089.stdout:7/822: stat d0/d19/d28/d1d/d23/d89 0 2024-09-13T22:08:47.922 INFO:tasks.workunit.client.0.smithi089.stdout:3/901: symlink d1/d2/d23/d3d/d46/dab/l137 0 2024-09-13T22:08:47.922 INFO:tasks.workunit.client.0.smithi089.stdout:9/933: write d6/d18/fbb [1508340,74801] 0 2024-09-13T22:08:47.922 INFO:tasks.workunit.client.0.smithi089.stdout:9/934: chown d6/d18/dde 197074041 1 2024-09-13T22:08:47.923 INFO:tasks.workunit.client.0.smithi089.stdout:9/935: write d6/d18/dab/f4c [706493,60271] 0 2024-09-13T22:08:47.923 INFO:tasks.workunit.client.0.smithi089.stdout:6/808: dwrite d0/d4/d12/d15/f71 [4194304,4194304] 0 2024-09-13T22:08:47.923 INFO:tasks.workunit.client.0.smithi089.stdout:6/809: fsync d0/d4/d12/d15/db3/d4a/f7d 0 2024-09-13T22:08:47.923 INFO:tasks.workunit.client.0.smithi089.stdout:6/810: truncate d0/d5/f23 4238670 0 2024-09-13T22:08:47.923 INFO:tasks.workunit.client.0.smithi089.stdout:2/836: creat df/d5b/da5/dd7/dfb/f11b x:0 0 0 2024-09-13T22:08:47.924 INFO:tasks.workunit.client.0.smithi089.stdout:7/823: creat d0/d19/d28/d1d/d23/d89/f11c x:0 0 0 2024-09-13T22:08:47.925 INFO:tasks.workunit.client.0.smithi089.stdout:1/876: dwrite d7/d40/dbe/d2b/d59/f112 [0,4194304] 0 2024-09-13T22:08:47.927 INFO:tasks.workunit.client.0.smithi089.stdout:6/811: unlink d0/d5/d64/c81 0 2024-09-13T22:08:47.928 INFO:tasks.workunit.client.0.smithi089.stdout:2/837: creat df/d14/d48/d88/db9/f11c x:0 0 0 2024-09-13T22:08:47.930 INFO:tasks.workunit.client.0.smithi089.stdout:7/824: rename d0/d19/d45/d38/f71 to d0/d19/d28/d1d/d30/d5b/f11d 0 2024-09-13T22:08:47.930 INFO:tasks.workunit.client.0.smithi089.stdout:7/825: fdatasync d0/d19/d28/d1d/d3d/fb9 0 2024-09-13T22:08:47.930 INFO:tasks.workunit.client.0.smithi089.stdout:7/826: write d0/d19/d45/f95 [1592408,126710] 0 2024-09-13T22:08:47.930 INFO:tasks.workunit.client.0.smithi089.stdout:7/827: rename d0/d19 to d0/d19/d28/d1d/d3d/d9a/dcf/d41/dbf/d11e 22 2024-09-13T22:08:47.930 INFO:tasks.workunit.client.0.smithi089.stdout:2/838: dread df/d14/d48/d88/f9a [0,4194304] 0 2024-09-13T22:08:47.933 INFO:tasks.workunit.client.0.smithi089.stdout:6/812: truncate d0/d5/d43/f77 3800051 0 2024-09-13T22:08:47.933 INFO:tasks.workunit.client.0.smithi089.stdout:6/813: write d0/d5/d43/d79/fa2 [494980,56635] 0 2024-09-13T22:08:47.933 INFO:tasks.workunit.client.0.smithi089.stdout:3/902: write d1/f84 [3904865,43001] 0 2024-09-13T22:08:47.935 INFO:tasks.workunit.client.0.smithi089.stdout:2/839: fsync df/d5b/da5/dd7/dfb/f11b 0 2024-09-13T22:08:47.937 INFO:tasks.workunit.client.0.smithi089.stdout:1/877: getdents d7/de/da0/dbd 0 2024-09-13T22:08:47.938 INFO:tasks.workunit.client.0.smithi089.stdout:6/814: creat d0/d4/d12/ffb x:0 0 0 2024-09-13T22:08:47.940 INFO:tasks.workunit.client.0.smithi089.stdout:3/903: unlink d1/d2/d23/d3d/d46/l85 0 2024-09-13T22:08:47.942 INFO:tasks.workunit.client.0.smithi089.stdout:2/840: mknod df/d14/d66/d69/d2e/dca/c11d 0 2024-09-13T22:08:47.943 INFO:tasks.workunit.client.0.smithi089.stdout:1/878: mknod d7/d40/dbe/d2b/d39/d73/d109/c117 0 2024-09-13T22:08:47.944 INFO:tasks.workunit.client.0.smithi089.stdout:6/815: mknod d0/d4/d12/d15/d3b/d62/cfc 0 2024-09-13T22:08:47.945 INFO:tasks.workunit.client.0.smithi089.stdout:6/816: truncate d0/d5/fb8 1238442 0 2024-09-13T22:08:47.947 INFO:tasks.workunit.client.0.smithi089.stdout:2/841: symlink df/d5b/da5/db8/l11e 0 2024-09-13T22:08:47.947 INFO:tasks.workunit.client.0.smithi089.stdout:2/842: read df/d1a/f42 [562433,122260] 0 2024-09-13T22:08:47.947 INFO:tasks.workunit.client.0.smithi089.stdout:2/843: dread - df/d14/d66/f70 zero size 2024-09-13T22:08:47.948 INFO:tasks.workunit.client.0.smithi089.stdout:6/817: mknod d0/d4/d12/d15/db3/d60/d94/cfd 0 2024-09-13T22:08:47.948 INFO:tasks.workunit.client.0.smithi089.stdout:6/818: fsync d0/d4/d12/d15/db3/d4b/fe9 0 2024-09-13T22:08:47.948 INFO:tasks.workunit.client.0.smithi089.stdout:3/904: getdents d1/d2/d23/d3d/d54/d95 0 2024-09-13T22:08:47.948 INFO:tasks.workunit.client.0.smithi089.stdout:3/905: creat d1/d2/d4/d1c/d7e/d40/d69/da1/f138 x:0 0 0 2024-09-13T22:08:47.952 INFO:tasks.workunit.client.0.smithi089.stdout:3/906: link d1/d2/d23/d2b/l93 d1/d2/d4/d1c/d7e/d40/l139 0 2024-09-13T22:08:47.953 INFO:tasks.workunit.client.0.smithi089.stdout:7/828: dwrite d0/d19/d28/d1d/d30/d5b/f118 [0,4194304] 0 2024-09-13T22:08:47.962 INFO:tasks.workunit.client.0.smithi089.stdout:2/844: dread df/d14/d2b/f36 [0,4194304] 0 2024-09-13T22:08:47.964 INFO:tasks.workunit.client.0.smithi089.stdout:2/845: mkdir df/d14/d11f 0 2024-09-13T22:08:47.965 INFO:tasks.workunit.client.0.smithi089.stdout:1/879: dwrite d7/de/d3a/d77/fcf [0,4194304] 0 2024-09-13T22:08:47.967 INFO:tasks.workunit.client.0.smithi089.stdout:1/880: mknod d7/de/d3a/c118 0 2024-09-13T22:08:47.967 INFO:tasks.workunit.client.0.smithi089.stdout:1/881: fsync d7/d34/f7e 0 2024-09-13T22:08:47.973 INFO:tasks.workunit.client.0.smithi089.stdout:6/819: dread d0/d4/d12/d15/fb9 [0,4194304] 0 2024-09-13T22:08:47.973 INFO:tasks.workunit.client.0.smithi089.stdout:7/829: dwrite d0/d19/d28/d1d/d3d/d69/f91 [0,4194304] 0 2024-09-13T22:08:47.973 INFO:tasks.workunit.client.0.smithi089.stdout:7/830: truncate d0/d19/d28/d1d/d3d/d9a/dcf/d41/f6f 1777632 0 2024-09-13T22:08:47.975 INFO:tasks.workunit.client.0.smithi089.stdout:7/831: unlink d0/d19/d28/d1d/d3d/d69/f91 0 2024-09-13T22:08:47.982 INFO:tasks.workunit.client.0.smithi089.stdout:1/882: dread d7/d34/d5c/d5d/f62 [0,4194304] 0 2024-09-13T22:08:47.985 INFO:tasks.workunit.client.0.smithi089.stdout:2/846: dwrite df/d5b/da5/db8/fc7 [0,4194304] 0 2024-09-13T22:08:47.989 INFO:tasks.workunit.client.0.smithi089.stdout:1/883: dread d7/de/d3a/fda [0,4194304] 0 2024-09-13T22:08:47.990 INFO:tasks.workunit.client.0.smithi089.stdout:1/884: rmdir d7/de/d68/dd9/d107 39 2024-09-13T22:08:47.990 INFO:tasks.workunit.client.0.smithi089.stdout:1/885: creat d7/d34/d5c/f119 x:0 0 0 2024-09-13T22:08:47.990 INFO:tasks.workunit.client.0.smithi089.stdout:1/886: creat d7/d40/dbe/d80/dbb/f11a x:0 0 0 2024-09-13T22:08:47.993 INFO:tasks.workunit.client.0.smithi089.stdout:1/887: link d7/d34/d5c/d5d/l6b d7/d40/dbe/d2b/d39/d73/d109/l11b 0 2024-09-13T22:08:47.994 INFO:tasks.workunit.client.0.smithi089.stdout:1/888: symlink d7/de/d68/dd9/d107/l11c 0 2024-09-13T22:08:47.996 INFO:tasks.workunit.client.0.smithi089.stdout:1/889: symlink d7/de/da0/dbd/dde/l11d 0 2024-09-13T22:08:47.996 INFO:tasks.workunit.client.0.smithi089.stdout:1/890: chown d7/de/da0/fd2 22 1 2024-09-13T22:08:47.997 INFO:tasks.workunit.client.0.smithi089.stdout:2/847: dread df/d14/d48/d88/db9/f102 [0,4194304] 0 2024-09-13T22:08:47.997 INFO:tasks.workunit.client.0.smithi089.stdout:2/848: chown df/d5b/da5/db8/dbf/cc9 36623 1 2024-09-13T22:08:47.997 INFO:tasks.workunit.client.0.smithi089.stdout:1/891: mknod d7/d34/d5c/c11e 0 2024-09-13T22:08:47.997 INFO:tasks.workunit.client.0.smithi089.stdout:2/849: mkdir df/d14/d2b/d61/db1/d106/d120 0 2024-09-13T22:08:47.997 INFO:tasks.workunit.client.0.smithi089.stdout:2/850: read df/d14/d2b/f33 [419562,97187] 0 2024-09-13T22:08:47.998 INFO:tasks.workunit.client.0.smithi089.stdout:1/892: unlink d7/d40/dbe/d2b/d39/fd7 0 2024-09-13T22:08:47.998 INFO:tasks.workunit.client.0.smithi089.stdout:1/893: chown d7/de/d3a/cdf 15553582 1 2024-09-13T22:08:47.998 INFO:tasks.workunit.client.0.smithi089.stdout:1/894: stat d7/de/d68/dd9/d107 0 2024-09-13T22:08:47.999 INFO:tasks.workunit.client.0.smithi089.stdout:2/851: getdents df/d14/d2b/d61 0 2024-09-13T22:08:47.999 INFO:tasks.workunit.client.0.smithi089.stdout:2/852: chown df/d1a/c60 0 1 2024-09-13T22:08:47.999 INFO:tasks.workunit.client.0.smithi089.stdout:1/895: truncate d7/d1c/feb 1401906 0 2024-09-13T22:08:48.000 INFO:tasks.workunit.client.0.smithi089.stdout:2/853: unlink df/d76/d85/lf3 0 2024-09-13T22:08:48.000 INFO:tasks.workunit.client.0.smithi089.stdout:2/854: fdatasync df/f8d 0 2024-09-13T22:08:48.000 INFO:tasks.workunit.client.0.smithi089.stdout:2/855: chown df/d76/fd6 1105 1 2024-09-13T22:08:48.000 INFO:tasks.workunit.client.0.smithi089.stdout:1/896: creat d7/d40/dbe/d2b/d39/f11f x:0 0 0 2024-09-13T22:08:48.013 INFO:tasks.workunit.client.0.smithi089.stdout:2/856: dwrite df/d1a/fda [0,4194304] 0 2024-09-13T22:08:48.014 INFO:tasks.workunit.client.0.smithi089.stdout:1/897: truncate d7/d1c/feb 811747 0 2024-09-13T22:08:48.016 INFO:tasks.workunit.client.0.smithi089.stdout:2/857: dread df/d5b/f5f [0,4194304] 0 2024-09-13T22:08:48.016 INFO:tasks.workunit.client.0.smithi089.stdout:2/858: write df/d76/f114 [876828,85148] 0 2024-09-13T22:08:48.016 INFO:tasks.workunit.client.0.smithi089.stdout:2/859: dread - df/d14/d66/ff9 zero size 2024-09-13T22:08:48.016 INFO:tasks.workunit.client.0.smithi089.stdout:1/898: dread d7/d34/fba [0,4194304] 0 2024-09-13T22:08:48.017 INFO:tasks.workunit.client.0.smithi089.stdout:2/860: creat df/d14/d2b/d61/dbd/d117/f121 x:0 0 0 2024-09-13T22:08:48.018 INFO:tasks.workunit.client.0.smithi089.stdout:2/861: mkdir df/d122 0 2024-09-13T22:08:48.019 INFO:tasks.workunit.client.0.smithi089.stdout:2/862: symlink df/d14/d2b/d61/db1/d106/d120/l123 0 2024-09-13T22:08:48.019 INFO:tasks.workunit.client.0.smithi089.stdout:2/863: fsync df/d14/d66/f99 0 2024-09-13T22:08:48.025 INFO:tasks.workunit.client.0.smithi089.stdout:2/864: rename df/d14/d2b/d61 to df/d14/d48/d88/db9/d124 0 2024-09-13T22:08:48.026 INFO:tasks.workunit.client.0.smithi089.stdout:5/908: sync 2024-09-13T22:08:48.026 INFO:tasks.workunit.client.0.smithi089.stdout:2/865: creat df/d1a/d57/dab/f125 x:0 0 0 2024-09-13T22:08:48.027 INFO:tasks.workunit.client.0.smithi089.stdout:5/909: symlink d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/l13c 0 2024-09-13T22:08:48.028 INFO:tasks.workunit.client.0.smithi089.stdout:2/866: mknod df/d14/d2b/d101/c126 0 2024-09-13T22:08:48.029 INFO:tasks.workunit.client.0.smithi089.stdout:2/867: link df/d14/d66/f7e df/d14/d66/d69/d2e/dca/f127 0 2024-09-13T22:08:48.030 INFO:tasks.workunit.client.0.smithi089.stdout:2/868: getdents df/d1a 0 2024-09-13T22:08:48.031 INFO:tasks.workunit.client.0.smithi089.stdout:2/869: getdents df/d14/d48/d88/db9/d124/db1 0 2024-09-13T22:08:48.031 INFO:tasks.workunit.client.0.smithi089.stdout:2/870: stat df/d5b/da5/dd7/dfb 0 2024-09-13T22:08:48.033 INFO:tasks.workunit.client.0.smithi089.stdout:1/899: dwrite d7/de/f27 [0,4194304] 0 2024-09-13T22:08:48.041 INFO:tasks.workunit.client.0.smithi089.stdout:2/871: dread df/d1a/fda [0,4194304] 0 2024-09-13T22:08:48.044 INFO:tasks.workunit.client.0.smithi089.stdout:2/872: rename df/d14/d66/d69/d2e/dca to df/d14/d48/d88/d128 0 2024-09-13T22:08:48.044 INFO:tasks.workunit.client.0.smithi089.stdout:1/900: dread d7/d1c/d3c/f81 [0,4194304] 0 2024-09-13T22:08:48.044 INFO:tasks.workunit.client.0.smithi089.stdout:1/901: read d7/d40/dbe/d2b/f54 [1070934,86391] 0 2024-09-13T22:08:48.044 INFO:tasks.workunit.client.0.smithi089.stdout:2/873: truncate df/d14/d66/d69/d2e/f37 2337745 0 2024-09-13T22:08:48.045 INFO:tasks.workunit.client.0.smithi089.stdout:1/902: truncate d7/fa4 750607 0 2024-09-13T22:08:48.046 INFO:tasks.workunit.client.0.smithi089.stdout:2/874: symlink df/d76/de8/d113/l129 0 2024-09-13T22:08:48.047 INFO:tasks.workunit.client.0.smithi089.stdout:1/903: creat d7/d40/dbe/d2b/da7/d100/d113/f120 x:0 0 0 2024-09-13T22:08:48.048 INFO:tasks.workunit.client.0.smithi089.stdout:2/875: creat df/d76/d85/d10f/f12a x:0 0 0 2024-09-13T22:08:48.052 INFO:tasks.workunit.client.0.smithi089.stdout:2/876: mknod df/d14/d66/c12b 0 2024-09-13T22:08:48.052 INFO:tasks.workunit.client.0.smithi089.stdout:2/877: chown df/f74 238854 1 2024-09-13T22:08:48.054 INFO:tasks.workunit.client.0.smithi089.stdout:2/878: dread df/d14/d66/d69/d2e/d10c/f110 [0,4194304] 0 2024-09-13T22:08:48.074 INFO:tasks.workunit.client.0.smithi089.stdout:1/904: dwrite d7/de/d68/f6f [0,4194304] 0 2024-09-13T22:08:48.074 INFO:tasks.workunit.client.0.smithi089.stdout:1/905: fsync d7/d1c/d7a/dad/fc4 0 2024-09-13T22:08:48.074 INFO:tasks.workunit.client.0.smithi089.stdout:1/906: chown d7/de/da0/dbd/fce 940885 1 2024-09-13T22:08:48.075 INFO:tasks.workunit.client.0.smithi089.stdout:1/907: rename d7/d34/d5c/f92 to d7/f121 0 2024-09-13T22:08:48.075 INFO:tasks.workunit.client.0.smithi089.stdout:1/908: chown d7/d1c/d7a/fbf 905916 1 2024-09-13T22:08:48.076 INFO:tasks.workunit.client.0.smithi089.stdout:1/909: symlink d7/de/d3a/d77/l122 0 2024-09-13T22:08:48.076 INFO:tasks.workunit.client.0.smithi089.stdout:1/910: dread - d7/d40/dbe/d80/dbb/fdd zero size 2024-09-13T22:08:48.133 INFO:tasks.workunit.client.0.smithi089.stdout:5/910: dwrite d4/d19/d1e/d89/dce/f86 [0,4194304] 0 2024-09-13T22:08:48.133 INFO:tasks.workunit.client.0.smithi089.stdout:2/879: dwrite df/d14/d66/d69/f11a [0,4194304] 0 2024-09-13T22:08:48.133 INFO:tasks.workunit.client.0.smithi089.stdout:5/911: chown d4/d19/ldb 27215471 1 2024-09-13T22:08:48.136 INFO:tasks.workunit.client.0.smithi089.stdout:2/880: rename l6 to df/d5b/da5/dd7/l12c 0 2024-09-13T22:08:48.136 INFO:tasks.workunit.client.0.smithi089.stdout:2/881: chown df/d122 37040 1 2024-09-13T22:08:48.137 INFO:tasks.workunit.client.0.smithi089.stdout:2/882: mkdir df/dd9/d12d 0 2024-09-13T22:08:48.137 INFO:tasks.workunit.client.0.smithi089.stdout:6/820: sync 2024-09-13T22:08:48.137 INFO:tasks.workunit.client.0.smithi089.stdout:3/907: sync 2024-09-13T22:08:48.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/832: sync 2024-09-13T22:08:48.137 INFO:tasks.workunit.client.0.smithi089.stdout:9/936: sync 2024-09-13T22:08:48.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/833: write d0/d19/d28/d1d/d3d/d9a/dcf/da8/dd8/f102 [132314,56450] 0 2024-09-13T22:08:48.138 INFO:tasks.workunit.client.0.smithi089.stdout:7/834: stat d0/d19/d28/d61/f87 0 2024-09-13T22:08:48.138 INFO:tasks.workunit.client.0.smithi089.stdout:7/835: stat d0/d19/d28/d100 0 2024-09-13T22:08:48.140 INFO:tasks.workunit.client.0.smithi089.stdout:5/912: dread d4/d19/d1e/d28/d31/d61/f6b [0,4194304] 0 2024-09-13T22:08:48.140 INFO:tasks.workunit.client.0.smithi089.stdout:5/913: fdatasync d4/f27 0 2024-09-13T22:08:48.140 INFO:tasks.workunit.client.0.smithi089.stdout:5/914: dread - d4/d19/d1e/d28/d31/d55/d58/d84/d101/f121 zero size 2024-09-13T22:08:48.140 INFO:tasks.workunit.client.0.smithi089.stdout:5/915: write d4/d19/d1e/d28/d31/d94/fff [447595,78977] 0 2024-09-13T22:08:48.140 INFO:tasks.workunit.client.0.smithi089.stdout:5/916: fsync d4/d19/d1e/d28/f9b 0 2024-09-13T22:08:48.246 INFO:tasks.workunit.client.0.smithi089.stdout:2/883: mkdir df/d76/d85/d12e 0 2024-09-13T22:08:48.246 INFO:tasks.workunit.client.0.smithi089.stdout:2/884: chown df/d5b/f73 15150382 1 2024-09-13T22:08:48.246 INFO:tasks.workunit.client.0.smithi089.stdout:2/885: fsync df/d5b/f86 0 2024-09-13T22:08:48.246 INFO:tasks.workunit.client.0.smithi089.stdout:2/886: fdatasync df/d1a/f81 0 2024-09-13T22:08:48.246 INFO:tasks.workunit.client.0.smithi089.stdout:2/887: fsync df/d14/d48/d88/db9/dec/fdd 0 2024-09-13T22:08:48.247 INFO:tasks.workunit.client.0.smithi089.stdout:6/821: mkdir d0/d5/d43/daf/dfe 0 2024-09-13T22:08:48.249 INFO:tasks.workunit.client.0.smithi089.stdout:9/937: mknod d6/d127/c13e 0 2024-09-13T22:08:48.249 INFO:tasks.workunit.client.0.smithi089.stdout:9/938: readlink d6/d18/d1b/l5f 0 2024-09-13T22:08:48.251 INFO:tasks.workunit.client.0.smithi089.stdout:7/836: rename d0/d19/dfe/f105 to d0/d19/d45/f11f 0 2024-09-13T22:08:48.255 INFO:tasks.workunit.client.0.smithi089.stdout:2/888: link df/d76/d85/f8e df/d14/d2b/d101/f12f 0 2024-09-13T22:08:48.256 INFO:tasks.workunit.client.0.smithi089.stdout:3/908: creat d1/d2/d96/f13a x:0 0 0 2024-09-13T22:08:48.258 INFO:tasks.workunit.client.0.smithi089.stdout:9/939: rmdir d6/d18/d1b/d89/db8/dbe/d133 0 2024-09-13T22:08:48.260 INFO:tasks.workunit.client.0.smithi089.stdout:6/822: rename d0/d5/d1d/d2d/d55/ca5 to d0/d4/cff 0 2024-09-13T22:08:48.262 INFO:tasks.workunit.client.0.smithi089.stdout:7/837: truncate d0/d19/d45/d38/f49 264216 0 2024-09-13T22:08:48.262 INFO:tasks.workunit.client.0.smithi089.stdout:7/838: chown d0/f5 13 1 2024-09-13T22:08:48.264 INFO:tasks.workunit.client.0.smithi089.stdout:5/917: rmdir d4/d19/d1e/d28/d3d/dba 39 2024-09-13T22:08:48.266 INFO:tasks.workunit.client.0.smithi089.stdout:2/889: mkdir df/d14/d66/d69/db5/d130 0 2024-09-13T22:08:48.266 INFO:tasks.workunit.client.0.smithi089.stdout:2/890: write df/d5b/f5f [1015077,61995] 0 2024-09-13T22:08:48.266 INFO:tasks.workunit.client.0.smithi089.stdout:2/891: chown df/d76/d85/d10f 43211890 1 2024-09-13T22:08:48.267 INFO:tasks.workunit.client.0.smithi089.stdout:3/909: symlink d1/d2/d23/d3d/d54/d12f/l13b 0 2024-09-13T22:08:48.269 INFO:tasks.workunit.client.0.smithi089.stdout:9/940: symlink d6/d54/dcb/de0/l13f 0 2024-09-13T22:08:48.269 INFO:tasks.workunit.client.0.smithi089.stdout:3/910: dread d1/d2/d23/f76 [0,4194304] 0 2024-09-13T22:08:48.270 INFO:tasks.workunit.client.0.smithi089.stdout:1/911: sync 2024-09-13T22:08:48.271 INFO:tasks.workunit.client.0.smithi089.stdout:7/839: rename d0/d19/d28/d7b/fea to d0/d19/d28/d7b/f120 0 2024-09-13T22:08:48.272 INFO:tasks.workunit.client.0.smithi089.stdout:5/918: rename d4/d19/f79 to d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/df8/f13d 0 2024-09-13T22:08:48.274 INFO:tasks.workunit.client.0.smithi089.stdout:7/840: dread d0/d19/d28/fdb [0,4194304] 0 2024-09-13T22:08:48.274 INFO:tasks.workunit.client.0.smithi089.stdout:2/892: link df/d76/d85/f8e df/d14/d66/d69/f131 0 2024-09-13T22:08:48.274 INFO:tasks.workunit.client.0.smithi089.stdout:2/893: write df/d14/d48/d88/db9/dec/ff7 [359396,45676] 0 2024-09-13T22:08:48.275 INFO:tasks.workunit.client.0.smithi089.stdout:9/941: symlink d6/d18/dab/l140 0 2024-09-13T22:08:48.276 INFO:tasks.workunit.client.0.smithi089.stdout:1/912: creat d7/de/d68/f123 x:0 0 0 2024-09-13T22:08:48.276 INFO:tasks.workunit.client.0.smithi089.stdout:1/913: creat d7/d1c/d7a/dad/f124 x:0 0 0 2024-09-13T22:08:48.278 INFO:tasks.workunit.client.0.smithi089.stdout:6/823: dwrite d0/d4/d12/d15/f93 [4194304,4194304] 0 2024-09-13T22:08:48.279 INFO:tasks.workunit.client.0.smithi089.stdout:7/841: symlink d0/d19/d28/d1d/d3d/d9a/dcf/l121 0 2024-09-13T22:08:48.280 INFO:tasks.workunit.client.0.smithi089.stdout:9/942: dread d6/f15 [0,4194304] 0 2024-09-13T22:08:48.281 INFO:tasks.workunit.client.0.smithi089.stdout:2/894: symlink df/d76/de8/d113/de1/l132 0 2024-09-13T22:08:48.281 INFO:tasks.workunit.client.0.smithi089.stdout:2/895: write df/d14/d48/d88/db9/dec/fdd [427959,9638] 0 2024-09-13T22:08:48.285 INFO:tasks.workunit.client.0.smithi089.stdout:1/914: symlink d7/d1c/d7a/l125 0 2024-09-13T22:08:48.286 INFO:tasks.workunit.client.0.smithi089.stdout:3/911: dread d1/d2/d4/d1c/d7e/d40/d69/da1/f89 [4194304,4194304] 0 2024-09-13T22:08:48.305 INFO:tasks.workunit.client.0.smithi089.stdout:6/824: dwrite d0/d4/d12/f70 [0,4194304] 0 2024-09-13T22:08:48.305 INFO:tasks.workunit.client.0.smithi089.stdout:2/896: dwrite df/d14/d2b/f109 [0,4194304] 0 2024-09-13T22:08:48.310 INFO:tasks.workunit.client.0.smithi089.stdout:9/943: dwrite d6/f59 [0,4194304] 0 2024-09-13T22:08:48.310 INFO:tasks.workunit.client.0.smithi089.stdout:9/944: dread - d6/d54/d115/f139 zero size 2024-09-13T22:08:48.310 INFO:tasks.workunit.client.0.smithi089.stdout:9/945: chown d6/d18/d1b/d89/db8/d52/d102/fc9 1442100 1 2024-09-13T22:08:48.310 INFO:tasks.workunit.client.0.smithi089.stdout:9/946: truncate d6/d54/ff6 120077 0 2024-09-13T22:08:48.311 INFO:tasks.workunit.client.0.smithi089.stdout:6/825: dread d0/d4/d12/d15/db3/f2a [0,4194304] 0 2024-09-13T22:08:48.311 INFO:tasks.workunit.client.0.smithi089.stdout:5/919: rmdir d4 39 2024-09-13T22:08:48.316 INFO:tasks.workunit.client.0.smithi089.stdout:1/915: getdents d7/d40/dbe/d80 0 2024-09-13T22:08:48.331 INFO:tasks.workunit.client.0.smithi089.stdout:2/897: mkdir df/d14/d66/d69/db5/d133 0 2024-09-13T22:08:48.334 INFO:tasks.workunit.client.0.smithi089.stdout:6/826: mknod d0/d5/d1d/d2d/da0/c100 0 2024-09-13T22:08:48.335 INFO:tasks.workunit.client.0.smithi089.stdout:7/842: rmdir d0/d19/d28/d1d/d3d/d9a/dcf/d41 39 2024-09-13T22:08:48.337 INFO:tasks.workunit.client.0.smithi089.stdout:2/898: mkdir df/d1a/d57/d134 0 2024-09-13T22:08:48.337 INFO:tasks.workunit.client.0.smithi089.stdout:2/899: write df/d14/f25 [3738666,60119] 0 2024-09-13T22:08:48.339 INFO:tasks.workunit.client.0.smithi089.stdout:1/916: dwrite d7/d1c/d7a/dad/fc4 [0,4194304] 0 2024-09-13T22:08:48.340 INFO:tasks.workunit.client.0.smithi089.stdout:3/912: dwrite d1/f84 [0,4194304] 0 2024-09-13T22:08:48.340 INFO:tasks.workunit.client.0.smithi089.stdout:3/913: readlink d1/d2/de4/l11c 0 2024-09-13T22:08:48.341 INFO:tasks.workunit.client.0.smithi089.stdout:6/827: unlink d0/d5/d43/d79/fa2 0 2024-09-13T22:08:48.342 INFO:tasks.workunit.client.0.smithi089.stdout:7/843: symlink d0/d19/d28/d7b/l122 0 2024-09-13T22:08:48.344 INFO:tasks.workunit.client.0.smithi089.stdout:2/900: mkdir df/d14/d48/d88/db9/d124/dbd/d135 0 2024-09-13T22:08:48.344 INFO:tasks.workunit.client.0.smithi089.stdout:2/901: fdatasync df/d14/d66/d69/d2e/f37 0 2024-09-13T22:08:48.348 INFO:tasks.workunit.client.0.smithi089.stdout:1/917: rmdir d7/de/da0/dee 0 2024-09-13T22:08:48.349 INFO:tasks.workunit.client.0.smithi089.stdout:9/947: rename d6/d18/d21/d5d to d6/d18/dab/d141 0 2024-09-13T22:08:48.351 INFO:tasks.workunit.client.0.smithi089.stdout:3/914: creat d1/d2/d23/d3d/d54/d12f/f13c x:0 0 0 2024-09-13T22:08:48.351 INFO:tasks.workunit.client.0.smithi089.stdout:3/915: chown d1/d2/d96/f13a 118 1 2024-09-13T22:08:48.351 INFO:tasks.workunit.client.0.smithi089.stdout:3/916: write d1/d2/d23/d3d/d54/d5d/deb/fd0 [62473,91737] 0 2024-09-13T22:08:48.352 INFO:tasks.workunit.client.0.smithi089.stdout:7/844: link d0/d19/d28/d1d/d23/d24/d5d/fe6 d0/d19/d28/d1d/d2d/f123 0 2024-09-13T22:08:48.354 INFO:tasks.workunit.client.0.smithi089.stdout:2/902: creat df/d14/d2b/d101/f136 x:0 0 0 2024-09-13T22:08:48.355 INFO:tasks.workunit.client.0.smithi089.stdout:6/828: dwrite d0/d5/f4d [0,4194304] 0 2024-09-13T22:08:48.355 INFO:tasks.workunit.client.0.smithi089.stdout:6/829: readlink d0/d5/d1d/d2d/d55/lc7 0 2024-09-13T22:08:48.356 INFO:tasks.workunit.client.0.smithi089.stdout:1/918: mkdir d7/d40/dbe/d2b/da7/d126 0 2024-09-13T22:08:48.360 INFO:tasks.workunit.client.0.smithi089.stdout:5/920: rename d4/d19/d1e/d28/d3d/dc9/d106 to d4/d19/d1e/d53/d13e 0 2024-09-13T22:08:48.362 INFO:tasks.workunit.client.0.smithi089.stdout:3/917: creat d1/d2/de4/d123/f13d x:0 0 0 2024-09-13T22:08:48.363 INFO:tasks.workunit.client.0.smithi089.stdout:7/845: getdents d0/d19/d28/d1d/d2d/d55 0 2024-09-13T22:08:48.363 INFO:tasks.workunit.client.0.smithi089.stdout:7/846: truncate d0/d19/d28/d1d/d30/f3b 4609835 0 2024-09-13T22:08:48.366 INFO:tasks.workunit.client.0.smithi089.stdout:1/919: creat d7/de/d3a/d77/f127 x:0 0 0 2024-09-13T22:08:48.367 INFO:tasks.workunit.client.0.smithi089.stdout:1/920: fsync d7/d34/d5c/d5d/fd6 0 2024-09-13T22:08:48.367 INFO:tasks.workunit.client.0.smithi089.stdout:9/948: dwrite d6/d18/dab/fd4 [0,4194304] 0 2024-09-13T22:08:48.368 INFO:tasks.workunit.client.0.smithi089.stdout:1/921: dread d7/de/de7/fa8 [0,4194304] 0 2024-09-13T22:08:48.370 INFO:tasks.workunit.client.0.smithi089.stdout:1/922: dread d7/d40/dbe/d2b/d59/f83 [0,4194304] 0 2024-09-13T22:08:48.370 INFO:tasks.workunit.client.0.smithi089.stdout:1/923: creat d7/de/da0/f128 x:0 0 0 2024-09-13T22:08:48.372 INFO:tasks.workunit.client.0.smithi089.stdout:5/921: symlink d4/d19/d1e/d53/d13e/l13f 0 2024-09-13T22:08:48.372 INFO:tasks.workunit.client.0.smithi089.stdout:5/922: chown d4/d19/ldb 25073 1 2024-09-13T22:08:48.377 INFO:tasks.workunit.client.0.smithi089.stdout:3/918: getdents d1/d2/d43 0 2024-09-13T22:08:48.378 INFO:tasks.workunit.client.0.smithi089.stdout:3/919: write d1/d2/d4/d1c/d7f/f86 [2407279,10500] 0 2024-09-13T22:08:48.378 INFO:tasks.workunit.client.0.smithi089.stdout:3/920: truncate d1/d2/d4/d1c/d7e/d83/ff4 685395 0 2024-09-13T22:08:48.391 INFO:tasks.workunit.client.0.smithi089.stdout:7/847: creat d0/d19/d28/d1d/f124 x:0 0 0 2024-09-13T22:08:48.392 INFO:tasks.workunit.client.0.smithi089.stdout:6/830: getdents d0/dcb 0 2024-09-13T22:08:48.392 INFO:tasks.workunit.client.0.smithi089.stdout:6/831: stat d0/d4/f40 0 2024-09-13T22:08:48.392 INFO:tasks.workunit.client.0.smithi089.stdout:6/832: chown d0/d4/c75 1 1 2024-09-13T22:08:48.393 INFO:tasks.workunit.client.0.smithi089.stdout:1/924: dwrite d7/f121 [0,4194304] 0 2024-09-13T22:08:48.393 INFO:tasks.workunit.client.0.smithi089.stdout:1/925: creat d7/d40/dbe/d2b/d59/f129 x:0 0 0 2024-09-13T22:08:48.395 INFO:tasks.workunit.client.0.smithi089.stdout:9/949: mknod d6/d18/c142 0 2024-09-13T22:08:48.399 INFO:tasks.workunit.client.0.smithi089.stdout:5/923: getdents d4/d19/d1e/d53/dae 0 2024-09-13T22:08:48.399 INFO:tasks.workunit.client.0.smithi089.stdout:5/924: dread - d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/df8/d11e/f128 zero size 2024-09-13T22:08:48.400 INFO:tasks.workunit.client.0.smithi089.stdout:3/921: dwrite d1/d2/d4/d1c/d7e/fae [0,4194304] 0 2024-09-13T22:08:48.403 INFO:tasks.workunit.client.0.smithi089.stdout:6/833: dread d0/d4/d12/f13 [0,4194304] 0 2024-09-13T22:08:48.403 INFO:tasks.workunit.client.0.smithi089.stdout:6/834: creat d0/d4/d12/d15/db3/f101 x:0 0 0 2024-09-13T22:08:48.403 INFO:tasks.workunit.client.0.smithi089.stdout:6/835: dread - d0/d4/d12/d15/d3b/d62/da4/fd4 zero size 2024-09-13T22:08:48.403 INFO:tasks.workunit.client.0.smithi089.stdout:6/836: fdatasync d0/d4/d12/d15/db3/d60/f6e 0 2024-09-13T22:08:48.404 INFO:tasks.workunit.client.0.smithi089.stdout:6/837: write d0/d4/d12/d15/db3/d4a/f7d [390068,96954] 0 2024-09-13T22:08:48.406 INFO:tasks.workunit.client.0.smithi089.stdout:7/848: dwrite d0/d19/d45/f6b [0,4194304] 0 2024-09-13T22:08:48.410 INFO:tasks.workunit.client.0.smithi089.stdout:1/926: rename d7/df6/l104 to d7/d40/dbe/d2b/d59/l12a 0 2024-09-13T22:08:48.410 INFO:tasks.workunit.client.0.smithi089.stdout:1/927: chown d7/db6/fe8 44854 1 2024-09-13T22:08:48.410 INFO:tasks.workunit.client.0.smithi089.stdout:1/928: chown d7/de/d3a/cdf 3364430 1 2024-09-13T22:08:48.413 INFO:tasks.workunit.client.0.smithi089.stdout:9/950: mknod d6/d31/d5e/db1/d10f/c143 0 2024-09-13T22:08:48.413 INFO:tasks.workunit.client.0.smithi089.stdout:9/951: dread - d6/d18/d1b/da0/dae/f112 zero size 2024-09-13T22:08:48.413 INFO:tasks.workunit.client.0.smithi089.stdout:9/952: write d6/d31/d64/ffb [642908,6026] 0 2024-09-13T22:08:48.415 INFO:tasks.workunit.client.0.smithi089.stdout:5/925: symlink d4/d19/d1e/d28/d31/d55/d58/d84/d101/l140 0 2024-09-13T22:08:48.415 INFO:tasks.workunit.client.0.smithi089.stdout:5/926: fsync d4/d19/d1e/d28/f9b 0 2024-09-13T22:08:48.416 INFO:tasks.workunit.client.0.smithi089.stdout:5/927: read d4/fc5 [813784,49396] 0 2024-09-13T22:08:48.416 INFO:tasks.workunit.client.0.smithi089.stdout:5/928: dread - d4/d19/d1e/d28/d3d/dc9/fd9 zero size 2024-09-13T22:08:48.416 INFO:tasks.workunit.client.0.smithi089.stdout:5/929: truncate d4/d19/f1b 9043568 0 2024-09-13T22:08:48.416 INFO:tasks.workunit.client.0.smithi089.stdout:5/930: write d4/d19/d1e/d28/d3d/f5d [130937,108461] 0 2024-09-13T22:08:48.419 INFO:tasks.workunit.client.0.smithi089.stdout:3/922: link d1/d2/d23/d3d/dda/d1b/f48 d1/d2/d23/d3d/d46/dab/d10e/f13e 0 2024-09-13T22:08:48.424 INFO:tasks.workunit.client.0.smithi089.stdout:7/849: symlink d0/d19/d28/d1d/d23/d89/l125 0 2024-09-13T22:08:48.427 INFO:tasks.workunit.client.0.smithi089.stdout:1/929: rename d7/f121 to d7/d40/dbe/d2b/d39/d73/d109/f12b 0 2024-09-13T22:08:48.427 INFO:tasks.workunit.client.0.smithi089.stdout:1/930: write d7/d40/dbe/d2b/d59/fac [212963,130528] 0 2024-09-13T22:08:48.433 INFO:tasks.workunit.client.0.smithi089.stdout:6/838: dwrite d0/d5/d1d/fe2 [0,4194304] 0 2024-09-13T22:08:48.440 INFO:tasks.workunit.client.0.smithi089.stdout:9/953: dwrite d6/ff [0,4194304] 0 2024-09-13T22:08:48.440 INFO:tasks.workunit.client.0.smithi089.stdout:9/954: write d6/d18/dab/d141/d6c/ff3 [398612,52203] 0 2024-09-13T22:08:48.442 INFO:tasks.workunit.client.0.smithi089.stdout:5/931: dwrite d4/d19/d107/f125 [0,4194304] 0 2024-09-13T22:08:48.444 INFO:tasks.workunit.client.0.smithi089.stdout:3/923: dwrite d1/d2/d4/d1c/d7e/d40/d69/da1/f3b [0,4194304] 0 2024-09-13T22:08:48.444 INFO:tasks.workunit.client.0.smithi089.stdout:3/924: chown d1/d2 1078 1 2024-09-13T22:08:48.449 INFO:tasks.workunit.client.0.smithi089.stdout:3/925: dread d1/d2/d4/d1c/d7e/d40/d69/da1/f81 [0,4194304] 0 2024-09-13T22:08:48.461 INFO:tasks.workunit.client.0.smithi089.stdout:7/850: symlink d0/d19/l126 0 2024-09-13T22:08:48.461 INFO:tasks.workunit.client.0.smithi089.stdout:7/851: write d0/d19/d45/d38/d54/fe9 [112260,24071] 0 2024-09-13T22:08:48.461 INFO:tasks.workunit.client.0.smithi089.stdout:1/931: creat d7/de/da0/dbd/f12c x:0 0 0 2024-09-13T22:08:48.465 INFO:tasks.workunit.client.0.smithi089.stdout:6/839: dwrite d0/dcb/fd6 [0,4194304] 0 2024-09-13T22:08:48.465 INFO:tasks.workunit.client.0.smithi089.stdout:6/840: chown d0/d4/d12/d15/db3/d4b/d7a 105544 1 2024-09-13T22:08:48.543 INFO:tasks.workunit.client.0.smithi089.stdout:2/903: sync 2024-09-13T22:08:48.545 INFO:tasks.workunit.client.0.smithi089.stdout:2/904: dread df/d14/d48/d88/db9/dec/ff7 [0,4194304] 0 2024-09-13T22:08:48.554 INFO:tasks.workunit.client.0.smithi089.stdout:3/926: symlink d1/d2/d23/d3d/d54/d5d/deb/d97/l13f 0 2024-09-13T22:08:48.565 INFO:tasks.workunit.client.0.smithi089.stdout:9/955: creat d6/d18/d21/f144 x:0 0 0 2024-09-13T22:08:48.573 INFO:tasks.workunit.client.0.smithi089.stdout:2/905: dwrite df/d14/d66/d69/f44 [0,4194304] 0 2024-09-13T22:08:48.574 INFO:tasks.workunit.client.0.smithi089.stdout:3/927: dwrite d1/f84 [0,4194304] 0 2024-09-13T22:08:48.727 INFO:tasks.workunit.client.0.smithi089.stdout:7/852: creat d0/d19/d28/d1d/d23/d24/d5d/f127 x:0 0 0 2024-09-13T22:08:48.728 INFO:tasks.workunit.client.0.smithi089.stdout:1/932: symlink d7/de/d68/dd9/l12d 0 2024-09-13T22:08:48.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/841: creat d0/d4/d12/d15/db3/d28/dbf/f102 x:0 0 0 2024-09-13T22:08:48.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/842: dread - d0/d5/ff6 zero size 2024-09-13T22:08:48.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/843: write d0/d5/d43/fda [794016,59174] 0 2024-09-13T22:08:48.734 INFO:tasks.workunit.client.0.smithi089.stdout:6/844: read d0/d4/d12/d15/db3/d28/fa1 [93326,91551] 0 2024-09-13T22:08:48.735 INFO:tasks.workunit.client.0.smithi089.stdout:9/956: truncate d6/d18/f1d 3728744 0 2024-09-13T22:08:48.736 INFO:tasks.workunit.client.0.smithi089.stdout:9/957: fsync d6/d18/d1b/d89/db8/f118 0 2024-09-13T22:08:48.738 INFO:tasks.workunit.client.0.smithi089.stdout:2/906: creat df/d14/d48/d88/db9/d124/dbd/f137 x:0 0 0 2024-09-13T22:08:48.740 INFO:tasks.workunit.client.0.smithi089.stdout:3/928: write d1/d2/d23/d3d/dda/d5c/ff0 [1036288,13106] 0 2024-09-13T22:08:48.741 INFO:tasks.workunit.client.0.smithi089.stdout:7/853: truncate d0/d19/d28/d1d/d30/fb4 5612650 0 2024-09-13T22:08:48.742 INFO:tasks.workunit.client.0.smithi089.stdout:1/933: symlink d7/d40/l12e 0 2024-09-13T22:08:48.744 INFO:tasks.workunit.client.0.smithi089.stdout:6/845: unlink d0/d4/d12/d15/db3/d4b/lad 0 2024-09-13T22:08:48.746 INFO:tasks.workunit.client.0.smithi089.stdout:9/958: creat d6/d18/d1b/da0/d100/f145 x:0 0 0 2024-09-13T22:08:48.746 INFO:tasks.workunit.client.0.smithi089.stdout:9/959: dread - d6/d54/dcb/de0/f114 zero size 2024-09-13T22:08:48.747 INFO:tasks.workunit.client.0.smithi089.stdout:2/907: mkdir df/d76/d93/d138 0 2024-09-13T22:08:48.749 INFO:tasks.workunit.client.0.smithi089.stdout:3/929: symlink d1/d2/d96/dc3/l140 0 2024-09-13T22:08:48.749 INFO:tasks.workunit.client.0.smithi089.stdout:3/930: dread - d1/d2/d96/f13a zero size 2024-09-13T22:08:48.750 INFO:tasks.workunit.client.0.smithi089.stdout:1/934: rename d7/d40/dbe/d2b/c66 to d7/d40/dbe/d2b/da7/d126/c12f 0 2024-09-13T22:08:48.753 INFO:tasks.workunit.client.0.smithi089.stdout:9/960: stat d6/d31/d64/l94 0 2024-09-13T22:08:48.755 INFO:tasks.workunit.client.0.smithi089.stdout:7/854: dwrite d0/d19/d45/d92/ff4 [0,4194304] 0 2024-09-13T22:08:48.756 INFO:tasks.workunit.client.0.smithi089.stdout:3/931: creat d1/d2/d23/d3d/d54/d5d/deb/d97/f141 x:0 0 0 2024-09-13T22:08:48.758 INFO:tasks.workunit.client.0.smithi089.stdout:1/935: truncate d7/de/d68/f90 1708091 0 2024-09-13T22:08:48.760 INFO:tasks.workunit.client.0.smithi089.stdout:9/961: truncate d6/d55/f6d 285077 0 2024-09-13T22:08:48.760 INFO:tasks.workunit.client.0.smithi089.stdout:9/962: fsync d6/d18/fac 0 2024-09-13T22:08:48.760 INFO:tasks.workunit.client.0.smithi089.stdout:9/963: dread - d6/d31/d64/ffc zero size 2024-09-13T22:08:48.760 INFO:tasks.workunit.client.0.smithi089.stdout:9/964: write d6/d18/d1b/d89/db8/d52/f97 [105529,40308] 0 2024-09-13T22:08:48.761 INFO:tasks.workunit.client.0.smithi089.stdout:7/855: unlink d0/d19/d45/d38/l47 0 2024-09-13T22:08:48.762 INFO:tasks.workunit.client.0.smithi089.stdout:3/932: symlink d1/d2/d4/d1c/d7f/l142 0 2024-09-13T22:08:48.768 INFO:tasks.workunit.client.0.smithi089.stdout:7/856: unlink d0/d19/d45/d92/def/fe0 0 2024-09-13T22:08:48.768 INFO:tasks.workunit.client.0.smithi089.stdout:7/857: fdatasync d0/d19/d28/d1d/d3d/d9a/f11a 0 2024-09-13T22:08:48.768 INFO:tasks.workunit.client.0.smithi089.stdout:7/858: dread - d0/d19/d28/d1d/d23/d24/d5d/f127 zero size 2024-09-13T22:08:48.768 INFO:tasks.workunit.client.0.smithi089.stdout:7/859: chown d0/d19/d28/d1d/d3d/d9a/dcf/fbd 229829 1 2024-09-13T22:08:48.769 INFO:tasks.workunit.client.0.smithi089.stdout:3/933: chown d1/l110 7311080 1 2024-09-13T22:08:48.771 INFO:tasks.workunit.client.0.smithi089.stdout:7/860: symlink d0/d19/d28/d1d/d23/d24/l128 0 2024-09-13T22:08:48.771 INFO:tasks.workunit.client.0.smithi089.stdout:7/861: fsync d0/d19/d28/d1d/d23/d89/d93/f114 0 2024-09-13T22:08:48.772 INFO:tasks.workunit.client.0.smithi089.stdout:7/862: chown d0/cc 3496654 1 2024-09-13T22:08:48.772 INFO:tasks.workunit.client.0.smithi089.stdout:7/863: chown d0/d19/d45/d92/ddc/d10e 9328 1 2024-09-13T22:08:48.773 INFO:tasks.workunit.client.0.smithi089.stdout:3/934: symlink d1/d2/d23/d3d/d54/d5d/deb/d97/d107/l143 0 2024-09-13T22:08:48.773 INFO:tasks.workunit.client.0.smithi089.stdout:3/935: chown d1/d2/d4/d1c/d7e/d40/l139 0 1 2024-09-13T22:08:48.773 INFO:tasks.workunit.client.0.smithi089.stdout:3/936: getdents d1/d2/d23/d3d/d46/d120 0 2024-09-13T22:08:48.774 INFO:tasks.workunit.client.0.smithi089.stdout:7/864: mknod d0/d19/d28/d1d/d3d/d9a/dcf/da8/dd8/c129 0 2024-09-13T22:08:48.776 INFO:tasks.workunit.client.0.smithi089.stdout:3/937: mknod d1/d2/d96/d102/c144 0 2024-09-13T22:08:48.778 INFO:tasks.workunit.client.0.smithi089.stdout:1/936: dwrite d7/de/d3a/d77/f7c [0,4194304] 0 2024-09-13T22:08:48.778 INFO:tasks.workunit.client.0.smithi089.stdout:1/937: creat d7/d1c/d3c/f130 x:0 0 0 2024-09-13T22:08:48.780 INFO:tasks.workunit.client.0.smithi089.stdout:7/865: dread d0/d19/d28/d1d/d30/da7/f115 [0,4194304] 0 2024-09-13T22:08:48.783 INFO:tasks.workunit.client.0.smithi089.stdout:1/938: link d7/d34/d5c/l9a d7/de/def/l131 0 2024-09-13T22:08:48.783 INFO:tasks.workunit.client.0.smithi089.stdout:1/939: fdatasync d7/d1c/d3c/f49 0 2024-09-13T22:08:48.786 INFO:tasks.workunit.client.0.smithi089.stdout:1/940: rename d7/de/d3a/c47 to d7/de/da0/dbd/dde/c132 0 2024-09-13T22:08:48.789 INFO:tasks.workunit.client.0.smithi089.stdout:5/932: creat d4/d19/d1e/d28/d31/d55/f141 x:0 0 0 2024-09-13T22:08:48.789 INFO:tasks.workunit.client.0.smithi089.stdout:5/933: write d4/d19/d1e/d28/d31/f40 [3607859,35608] 0 2024-09-13T22:08:48.789 INFO:tasks.workunit.client.0.smithi089.stdout:5/934: write d4/d19/d1e/d28/d3d/dc9/f66 [518455,75113] 0 2024-09-13T22:08:48.790 INFO:tasks.workunit.client.0.smithi089.stdout:7/866: write d0/d19/d28/d1d/f2c [6710258,36625] 0 2024-09-13T22:08:48.790 INFO:tasks.workunit.client.0.smithi089.stdout:6/846: link d0/d4/d12/d15/db3/d4a/f58 d0/d5/d43/f103 0 2024-09-13T22:08:48.792 INFO:tasks.workunit.client.0.smithi089.stdout:6/847: dread d0/f48 [0,4194304] 0 2024-09-13T22:08:48.792 INFO:tasks.workunit.client.0.smithi089.stdout:6/848: chown d0/d4/fc3 5486257 1 2024-09-13T22:08:48.794 INFO:tasks.workunit.client.0.smithi089.stdout:5/935: symlink d4/d19/d1e/d28/d31/d55/d58/d84/l142 0 2024-09-13T22:08:48.794 INFO:tasks.workunit.client.0.smithi089.stdout:5/936: chown d4/d19/d1e/d28/d31/cd6 492 1 2024-09-13T22:08:48.795 INFO:tasks.workunit.client.0.smithi089.stdout:3/938: dwrite d1/d2/d23/d2b/ff3 [8388608,4194304] 0 2024-09-13T22:08:48.796 INFO:tasks.workunit.client.0.smithi089.stdout:3/939: fsync d1/d2/d96/dc3/f53 0 2024-09-13T22:08:48.798 INFO:tasks.workunit.client.0.smithi089.stdout:7/867: creat d0/d19/d28/d1d/d3d/d9a/dcf/d41/f12a x:0 0 0 2024-09-13T22:08:48.804 INFO:tasks.workunit.client.0.smithi089.stdout:1/941: dwrite d7/d1c/d3c/f81 [0,4194304] 0 2024-09-13T22:08:48.806 INFO:tasks.workunit.client.0.smithi089.stdout:7/868: rename d0/d19/d28/d1d/d30/d5b/l6e to d0/d19/d28/d1d/de2/l12b 0 2024-09-13T22:08:48.812 INFO:tasks.workunit.client.0.smithi089.stdout:5/937: dwrite d4/d19/d1e/d89/dce/f6e [0,4194304] 0 2024-09-13T22:08:48.817 INFO:tasks.workunit.client.0.smithi089.stdout:3/940: getdents d1/d2/d4/d1c/d7f/d119 0 2024-09-13T22:08:48.821 INFO:tasks.workunit.client.0.smithi089.stdout:1/942: truncate d7/d40/dbe/d2b/d39/f98 3380049 0 2024-09-13T22:08:48.824 INFO:tasks.workunit.client.0.smithi089.stdout:7/869: mkdir d0/d19/d28/d1d/d3d/d9a/dcf/d41/d12c 0 2024-09-13T22:08:48.824 INFO:tasks.workunit.client.0.smithi089.stdout:7/870: read - d0/d19/d28/d1d/d2d/d55/d116/fc1 zero size 2024-09-13T22:08:48.826 INFO:tasks.workunit.client.0.smithi089.stdout:3/941: creat d1/d2/d31/f145 x:0 0 0 2024-09-13T22:08:48.828 INFO:tasks.workunit.client.0.smithi089.stdout:7/871: symlink d0/d19/l12d 0 2024-09-13T22:08:48.828 INFO:tasks.workunit.client.0.smithi089.stdout:7/872: write d0/d19/f2b [1050136,121848] 0 2024-09-13T22:08:48.833 INFO:tasks.workunit.client.0.smithi089.stdout:7/873: rmdir d0/d19/d28/d1d/d3d/d9a/dcf/da8 39 2024-09-13T22:08:48.833 INFO:tasks.workunit.client.0.smithi089.stdout:7/874: chown d0/d19/d28/d1d/d23/f7f 322487 1 2024-09-13T22:08:48.833 INFO:tasks.workunit.client.0.smithi089.stdout:5/938: dwrite d4/d19/d1e/d28/d31/d55/f5a [0,4194304] 0 2024-09-13T22:08:48.838 INFO:tasks.workunit.client.0.smithi089.stdout:7/875: mknod d0/d19/d28/d1d/d23/d89/d93/c12e 0 2024-09-13T22:08:48.839 INFO:tasks.workunit.client.0.smithi089.stdout:1/943: write d7/d40/dbe/d2b/d59/f85 [2136908,18270] 0 2024-09-13T22:08:48.840 INFO:tasks.workunit.client.0.smithi089.stdout:1/944: chown d7/d40/dbe/cf3 2716 1 2024-09-13T22:08:48.840 INFO:tasks.workunit.client.0.smithi089.stdout:5/939: rename d4/d19/d1e/d28/d31/d94/cf0 to d4/d19/d1e/d53/d88/c143 0 2024-09-13T22:08:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:1/945: link d7/d34/l89 d7/d1c/d7a/dad/l133 0 2024-09-13T22:08:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:3/942: dwrite d1/d2/d23/d3d/d46/dab/df2/f104 [0,4194304] 0 2024-09-13T22:08:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:3/943: chown d1/d2/d4/l1f 319 1 2024-09-13T22:08:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:3/944: readlink d1/d2/d96/dc3/l39 0 2024-09-13T22:08:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:5/940: mkdir d4/d19/d1e/d53/d88/d136/d119/d144 0 2024-09-13T22:08:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:5/941: chown d4/d19/d1e/d53/d88/d136/c120 1309755162 1 2024-09-13T22:08:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:5/942: write d4/d19/d1e/fa0 [332042,72603] 0 2024-09-13T22:08:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:7/876: dread d0/d19/d28/d1d/d30/d5b/f11d [0,4194304] 0 2024-09-13T22:08:48.854 INFO:tasks.workunit.client.0.smithi089.stdout:7/877: creat d0/d19/d28/d1d/d2d/f12f x:0 0 0 2024-09-13T22:08:48.854 INFO:tasks.workunit.client.0.smithi089.stdout:7/878: fdatasync d0/d19/d28/d1d/d23/d24/f29 0 2024-09-13T22:08:48.856 INFO:tasks.workunit.client.0.smithi089.stdout:3/945: write d1/d2/d4/d1c/f2a [6280287,118699] 0 2024-09-13T22:08:48.856 INFO:tasks.workunit.client.0.smithi089.stdout:3/946: readlink d1/d2/d4/l1f 0 2024-09-13T22:08:48.856 INFO:tasks.workunit.client.0.smithi089.stdout:3/947: stat d1/d2/d43 0 2024-09-13T22:08:48.856 INFO:tasks.workunit.client.0.smithi089.stdout:3/948: read d1/d2/d4/d1c/d7e/d40/d50/f8a [3398977,8108] 0 2024-09-13T22:08:48.856 INFO:tasks.workunit.client.0.smithi089.stdout:3/949: write d1/d2/d96/dc3/f74 [1608375,81255] 0 2024-09-13T22:08:48.861 INFO:tasks.workunit.client.0.smithi089.stdout:7/879: truncate d0/d19/d45/d38/d54/fc7 3386950 0 2024-09-13T22:08:48.862 INFO:tasks.workunit.client.0.smithi089.stdout:2/908: creat df/d76/f139 x:0 0 0 2024-09-13T22:08:48.864 INFO:tasks.workunit.client.0.smithi089.stdout:2/909: rename df/d76/de8/d113/de1 to df/d14/d48/d88/db9/d124/dbd/d13a 0 2024-09-13T22:08:48.867 INFO:tasks.workunit.client.0.smithi089.stdout:2/910: mknod df/d14/d48/d88/db9/c13b 0 2024-09-13T22:08:48.867 INFO:tasks.workunit.client.0.smithi089.stdout:2/911: write df/d14/f65 [5572484,16922] 0 2024-09-13T22:08:48.869 INFO:tasks.workunit.client.0.smithi089.stdout:9/965: creat d6/d55/f146 x:0 0 0 2024-09-13T22:08:48.869 INFO:tasks.workunit.client.0.smithi089.stdout:9/966: chown d6/f2b 191 1 2024-09-13T22:08:48.869 INFO:tasks.workunit.client.0.smithi089.stdout:9/967: truncate d6/d18/d21/f44 8893589 0 2024-09-13T22:08:48.869 INFO:tasks.workunit.client.0.smithi089.stdout:1/946: dwrite d7/d34/f28 [0,4194304] 0 2024-09-13T22:08:48.870 INFO:tasks.workunit.client.0.smithi089.stdout:5/943: dwrite d4/d19/d1e/d28/d3d/faf [0,4194304] 0 2024-09-13T22:08:48.871 INFO:tasks.workunit.client.0.smithi089.stdout:7/880: dread d0/d19/d45/de7/fb7 [0,4194304] 0 2024-09-13T22:08:48.871 INFO:tasks.workunit.client.0.smithi089.stdout:7/881: fdatasync d0/d19/d28/ff2 0 2024-09-13T22:08:48.871 INFO:tasks.workunit.client.0.smithi089.stdout:2/912: rename df/d76/d93/c119 to df/d1a/d57/d134/c13c 0 2024-09-13T22:08:48.876 INFO:tasks.workunit.client.0.smithi089.stdout:1/947: mknod d7/d40/dbe/de9/c134 0 2024-09-13T22:08:48.882 INFO:tasks.workunit.client.0.smithi089.stdout:5/944: creat d4/d19/d1e/d28/d31/d55/dcc/f145 x:0 0 0 2024-09-13T22:08:48.883 INFO:tasks.workunit.client.0.smithi089.stdout:1/948: dread d7/d34/d5c/d5d/f62 [0,4194304] 0 2024-09-13T22:08:48.885 INFO:tasks.workunit.client.0.smithi089.stdout:7/882: dread d0/d19/d28/d1d/d30/f3b [0,4194304] 0 2024-09-13T22:08:48.885 INFO:tasks.workunit.client.0.smithi089.stdout:6/849: rmdir d0/d5 39 2024-09-13T22:08:48.893 INFO:tasks.workunit.client.0.smithi089.stdout:9/968: rename d6/d18/d1b/d89/db8/d5a/f9b to d6/d54/d115/f147 0 2024-09-13T22:08:48.894 INFO:tasks.workunit.client.0.smithi089.stdout:2/913: creat df/d76/de8/d113/f13d x:0 0 0 2024-09-13T22:08:48.894 INFO:tasks.workunit.client.0.smithi089.stdout:2/914: dread - df/d14/d48/d88/db9/d124/dbd/d117/f121 zero size 2024-09-13T22:08:48.896 INFO:tasks.workunit.client.0.smithi089.stdout:2/915: write df/d76/f114 [643835,51243] 0 2024-09-13T22:08:48.897 INFO:tasks.workunit.client.0.smithi089.stdout:6/850: fsync d0/d5/d43/daf/db1/fb5 0 2024-09-13T22:08:48.897 INFO:tasks.workunit.client.0.smithi089.stdout:6/851: read - d0/d4/d12/d15/d3b/d62/da4/fd4 zero size 2024-09-13T22:08:48.899 INFO:tasks.workunit.client.0.smithi089.stdout:9/969: truncate d6/d18/fbb 106208 0 2024-09-13T22:08:48.900 INFO:tasks.workunit.client.0.smithi089.stdout:5/945: mkdir d4/d19/d146 0 2024-09-13T22:08:48.901 INFO:tasks.workunit.client.0.smithi089.stdout:2/916: rmdir df/d14/d48/d88/db9/d124/dbd/d117 39 2024-09-13T22:08:48.903 INFO:tasks.workunit.client.0.smithi089.stdout:6/852: creat d0/d5/f104 x:0 0 0 2024-09-13T22:08:48.906 INFO:tasks.workunit.client.0.smithi089.stdout:9/970: mkdir d6/d54/dcb/d148 0 2024-09-13T22:08:48.908 INFO:tasks.workunit.client.0.smithi089.stdout:5/946: dread d4/d19/f48 [0,4194304] 0 2024-09-13T22:08:48.909 INFO:tasks.workunit.client.0.smithi089.stdout:2/917: rename df/d76/ldc to df/d5b/da5/l13e 0 2024-09-13T22:08:48.910 INFO:tasks.workunit.client.0.smithi089.stdout:6/853: mknod d0/d5/d1d/d2d/c105 0 2024-09-13T22:08:48.912 INFO:tasks.workunit.client.0.smithi089.stdout:2/918: dread df/d14/f24 [0,4194304] 0 2024-09-13T22:08:48.913 INFO:tasks.workunit.client.0.smithi089.stdout:6/854: rename d0/d5/f27 to d0/dcb/f106 0 2024-09-13T22:08:48.915 INFO:tasks.workunit.client.0.smithi089.stdout:2/919: unlink df/d14/d2b/f109 0 2024-09-13T22:08:48.915 INFO:tasks.workunit.client.0.smithi089.stdout:2/920: write df/d76/fd6 [1475548,38470] 0 2024-09-13T22:08:48.917 INFO:tasks.workunit.client.0.smithi089.stdout:6/855: truncate d0/d5/d1d/d2d/f66 318815 0 2024-09-13T22:08:48.918 INFO:tasks.workunit.client.0.smithi089.stdout:2/921: truncate df/d14/d2b/f36 427999 0 2024-09-13T22:08:48.920 INFO:tasks.workunit.client.0.smithi089.stdout:7/883: dwrite d0/f8c [0,4194304] 0 2024-09-13T22:08:48.922 INFO:tasks.workunit.client.0.smithi089.stdout:6/856: mkdir d0/d4/d12/d15/db3/d28/dbf/d107 0 2024-09-13T22:08:48.922 INFO:tasks.workunit.client.0.smithi089.stdout:6/857: truncate d0/d4/d12/d15/db3/fd1 390132 0 2024-09-13T22:08:48.922 INFO:tasks.workunit.client.0.smithi089.stdout:6/858: stat d0/d5/d1d/d2d/da0 0 2024-09-13T22:08:48.924 INFO:tasks.workunit.client.0.smithi089.stdout:2/922: rmdir df/d5b/da5/dd7/dfb 39 2024-09-13T22:08:48.924 INFO:tasks.workunit.client.0.smithi089.stdout:2/923: creat df/d14/d48/d88/db9/f13f x:0 0 0 2024-09-13T22:08:48.928 INFO:tasks.workunit.client.0.smithi089.stdout:5/947: dwrite d4/d19/d1e/fbf [0,4194304] 0 2024-09-13T22:08:48.928 INFO:tasks.workunit.client.0.smithi089.stdout:5/948: write d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/df8/f105 [702116,90471] 0 2024-09-13T22:08:48.930 INFO:tasks.workunit.client.0.smithi089.stdout:6/859: dread d0/d4/f40 [0,4194304] 0 2024-09-13T22:08:48.930 INFO:tasks.workunit.client.0.smithi089.stdout:6/860: fdatasync d0/d4/f6f 0 2024-09-13T22:08:48.938 INFO:tasks.workunit.client.0.smithi089.stdout:2/924: mkdir df/d1a/d57/d134/d140 0 2024-09-13T22:08:48.945 INFO:tasks.workunit.client.0.smithi089.stdout:2/925: dread df/d14/d66/d69/d2e/f3c [4194304,4194304] 0 2024-09-13T22:08:48.945 INFO:tasks.workunit.client.0.smithi089.stdout:2/926: chown df/d1a/l23 30546342 1 2024-09-13T22:08:48.945 INFO:tasks.workunit.client.0.smithi089.stdout:2/927: write df/f26 [3417796,107555] 0 2024-09-13T22:08:49.082 INFO:tasks.workunit.client.0.smithi089.stdout:5/949: rename d4/d19/ldb to d4/d19/d1e/d28/d3d/dba/l147 0 2024-09-13T22:08:49.084 INFO:tasks.workunit.client.0.smithi089.stdout:6/861: mkdir d0/dcb/d108 0 2024-09-13T22:08:49.084 INFO:tasks.workunit.client.0.smithi089.stdout:6/862: truncate d0/d4/d12/f7b 1023739 0 2024-09-13T22:08:49.085 INFO:tasks.workunit.client.0.smithi089.stdout:7/884: getdents d0/d19/d28/d1d/d3d/d9a/dcf/da8/dd8 0 2024-09-13T22:08:49.085 INFO:tasks.workunit.client.0.smithi089.stdout:7/885: fsync d0/d19/d28/d1d/d23/d24/fbb 0 2024-09-13T22:08:49.085 INFO:tasks.workunit.client.0.smithi089.stdout:7/886: stat d0/d19/d45/d9b 0 2024-09-13T22:08:49.089 INFO:tasks.workunit.client.0.smithi089.stdout:7/887: mknod d0/d19/d28/d1d/d23/d24/d113/c130 0 2024-09-13T22:08:49.092 INFO:tasks.workunit.client.0.smithi089.stdout:7/888: creat d0/d19/d28/d1d/de2/f131 x:0 0 0 2024-09-13T22:08:49.093 INFO:tasks.workunit.client.0.smithi089.stdout:5/950: write d4/f5 [959709,30400] 0 2024-09-13T22:08:49.093 INFO:tasks.workunit.client.0.smithi089.stdout:2/928: dwrite df/d1a/f81 [0,4194304] 0 2024-09-13T22:08:49.102 INFO:tasks.workunit.client.0.smithi089.stdout:7/889: dread d0/d19/d45/f106 [0,4194304] 0 2024-09-13T22:08:49.102 INFO:tasks.workunit.client.0.smithi089.stdout:6/863: dwrite d0/d4/d12/d15/d3b/d62/f80 [4194304,4194304] 0 2024-09-13T22:08:49.104 INFO:tasks.workunit.client.0.smithi089.stdout:6/864: dread d0/d4/d12/f91 [0,4194304] 0 2024-09-13T22:08:49.132 INFO:tasks.workunit.client.0.smithi089.stdout:2/929: dwrite df/d14/d48/d88/db9/d124/dbd/d117/f121 [0,4194304] 0 2024-09-13T22:08:49.132 INFO:tasks.workunit.client.0.smithi089.stdout:6/865: dwrite d0/d5/d43/f9d [4194304,4194304] 0 2024-09-13T22:08:49.132 INFO:tasks.workunit.client.0.smithi089.stdout:5/951: dwrite d4/d19/d1e/d28/d3d/faf [0,4194304] 0 2024-09-13T22:08:49.132 INFO:tasks.workunit.client.0.smithi089.stdout:5/952: chown d4/d19/d1e/d28/d3d/dc9/l91 1460205 1 2024-09-13T22:08:49.133 INFO:tasks.workunit.client.0.smithi089.stdout:5/953: fdatasync d4/d19/de4/f104 0 2024-09-13T22:08:49.133 INFO:tasks.workunit.client.0.smithi089.stdout:7/890: dwrite d0/d19/d45/f106 [4194304,4194304] 0 2024-09-13T22:08:49.133 INFO:tasks.workunit.client.0.smithi089.stdout:7/891: stat d0/d19/d28/d1d/d2d/d55/d116/f7c 0 2024-09-13T22:08:49.136 INFO:tasks.workunit.client.0.smithi089.stdout:6/866: dread d0/d4/d12/f13 [0,4194304] 0 2024-09-13T22:08:49.139 INFO:tasks.workunit.client.0.smithi089.stdout:5/954: dread d4/f5 [0,4194304] 0 2024-09-13T22:08:49.145 INFO:tasks.workunit.client.0.smithi089.stdout:6/867: getdents d0/d5/d43 0 2024-09-13T22:08:49.145 INFO:tasks.workunit.client.0.smithi089.stdout:6/868: truncate d0/d4/d12/d15/db3/f47 1566334 0 2024-09-13T22:08:49.148 INFO:tasks.workunit.client.0.smithi089.stdout:2/930: truncate df/d76/fd6 867598 0 2024-09-13T22:08:49.148 INFO:tasks.workunit.client.0.smithi089.stdout:2/931: creat df/d14/d2b/f141 x:0 0 0 2024-09-13T22:08:49.148 INFO:tasks.workunit.client.0.smithi089.stdout:5/955: dread d4/d19/d1e/fbf [0,4194304] 0 2024-09-13T22:08:49.148 INFO:tasks.workunit.client.0.smithi089.stdout:5/956: chown d4/d19/d1e/d28/d31/d55/ldf 6520 1 2024-09-13T22:08:49.148 INFO:tasks.workunit.client.0.smithi089.stdout:5/957: getdents d4/d19/d1e/d53/dae 0 2024-09-13T22:08:49.151 INFO:tasks.workunit.client.0.smithi089.stdout:2/932: link df/d1a/d57/dab/f125 df/d14/d48/d88/db9/dec/f142 0 2024-09-13T22:08:49.151 INFO:tasks.workunit.client.0.smithi089.stdout:2/933: write df/d76/f139 [332260,100450] 0 2024-09-13T22:08:49.152 INFO:tasks.workunit.client.0.smithi089.stdout:5/958: symlink d4/d19/d1e/d53/d13e/l148 0 2024-09-13T22:08:49.155 INFO:tasks.workunit.client.0.smithi089.stdout:5/959: mkdir d4/d19/d1e/d28/d149 0 2024-09-13T22:08:49.156 INFO:tasks.workunit.client.0.smithi089.stdout:5/960: stat d4/d19/d1e/d28/d31/d55/f103 0 2024-09-13T22:08:49.156 INFO:tasks.workunit.client.0.smithi089.stdout:5/961: stat d4/d19/d1e/d28/d3d 0 2024-09-13T22:08:49.156 INFO:tasks.workunit.client.0.smithi089.stdout:7/892: dwrite d0/d19/d45/d38/d54/fe5 [0,4194304] 0 2024-09-13T22:08:49.159 INFO:tasks.workunit.client.0.smithi089.stdout:7/893: mknod d0/d19/d28/d1d/d23/d24/d5d/c132 0 2024-09-13T22:08:49.168 INFO:tasks.workunit.client.0.smithi089.stdout:7/894: link d0/d19/d45/d9b/lfc d0/d19/d28/d61/l133 0 2024-09-13T22:08:49.168 INFO:tasks.workunit.client.0.smithi089.stdout:7/895: creat d0/d19/d28/d1d/d23/d24/d5d/f134 x:0 0 0 2024-09-13T22:08:49.168 INFO:tasks.workunit.client.0.smithi089.stdout:7/896: read d0/d19/d28/d1d/d30/fb4 [2730334,2907] 0 2024-09-13T22:08:49.168 INFO:tasks.workunit.client.0.smithi089.stdout:7/897: fdatasync d0/d19/d28/d7b/f120 0 2024-09-13T22:08:49.168 INFO:tasks.workunit.client.0.smithi089.stdout:7/898: dread - d0/d19/d28/d1d/d2d/d55/d116/fc1 zero size 2024-09-13T22:08:49.171 INFO:tasks.workunit.client.0.smithi089.stdout:2/934: dwrite df/d14/d48/d88/db9/d124/db1/f10e [0,4194304] 0 2024-09-13T22:08:49.171 INFO:tasks.workunit.client.0.smithi089.stdout:2/935: chown df/f12 358916762 1 2024-09-13T22:08:49.171 INFO:tasks.workunit.client.0.smithi089.stdout:5/962: dwrite d4/d19/d1e/d28/d31/d55/d58/f131 [0,4194304] 0 2024-09-13T22:08:49.171 INFO:tasks.workunit.client.0.smithi089.stdout:5/963: dread - d4/d19/de4/ff7 zero size 2024-09-13T22:08:49.172 INFO:tasks.workunit.client.0.smithi089.stdout:7/899: unlink d0/d19/d45/d92/ddc/l10f 0 2024-09-13T22:08:49.172 INFO:tasks.workunit.client.0.smithi089.stdout:7/900: write d0/d19/d45/d38/d54/fba [44342,33934] 0 2024-09-13T22:08:49.180 INFO:tasks.workunit.client.0.smithi089.stdout:7/901: creat d0/d19/d28/d1d/d3d/d9a/dcf/f135 x:0 0 0 2024-09-13T22:08:49.180 INFO:tasks.workunit.client.0.smithi089.stdout:7/902: fdatasync d0/fd 0 2024-09-13T22:08:49.180 INFO:tasks.workunit.client.0.smithi089.stdout:7/903: chown d0/c103 8740 1 2024-09-13T22:08:49.181 INFO:tasks.workunit.client.0.smithi089.stdout:7/904: truncate d0/d19/d28/d1d/d30/de1/f11b 572599 0 2024-09-13T22:08:49.182 INFO:tasks.workunit.client.0.smithi089.stdout:7/905: mkdir d0/d19/dfe/d136 0 2024-09-13T22:08:49.182 INFO:tasks.workunit.client.0.smithi089.stdout:7/906: read - d0/d19/d28/d1d/d23/d24/d5d/f127 zero size 2024-09-13T22:08:49.182 INFO:tasks.workunit.client.0.smithi089.stdout:7/907: chown d0/d19/d28/d1d/d3d/d9a/dcf/d41/f6f 592 1 2024-09-13T22:08:49.184 INFO:tasks.workunit.client.0.smithi089.stdout:9/971: sync 2024-09-13T22:08:49.184 INFO:tasks.workunit.client.0.smithi089.stdout:3/950: sync 2024-09-13T22:08:49.184 INFO:tasks.workunit.client.0.smithi089.stdout:3/951: creat d1/d2/d4/d1c/d7e/f146 x:0 0 0 2024-09-13T22:08:49.186 INFO:tasks.workunit.client.0.smithi089.stdout:1/949: sync 2024-09-13T22:08:49.188 INFO:tasks.workunit.client.0.smithi089.stdout:3/952: mkdir d1/d2/d4/d1c/d7e/d40/d50/d147 0 2024-09-13T22:08:49.188 INFO:tasks.workunit.client.0.smithi089.stdout:3/953: read - d1/d2/d4/d1c/d7e/f146 zero size 2024-09-13T22:08:49.188 INFO:tasks.workunit.client.0.smithi089.stdout:3/954: fdatasync d1/d2/d23/d3d/d46/dab/f135 0 2024-09-13T22:08:49.188 INFO:tasks.workunit.client.0.smithi089.stdout:3/955: write d1/d2/d23/d3d/d54/d5d/deb/d63/f6d [6591078,94003] 0 2024-09-13T22:08:49.190 INFO:tasks.workunit.client.0.smithi089.stdout:1/950: mkdir d7/d40/dbe/d135 0 2024-09-13T22:08:49.192 INFO:tasks.workunit.client.0.smithi089.stdout:3/956: creat d1/d2/d43/f148 x:0 0 0 2024-09-13T22:08:49.193 INFO:tasks.workunit.client.0.smithi089.stdout:2/936: dwrite df/d1a/ddf/fe9 [0,4194304] 0 2024-09-13T22:08:49.195 INFO:tasks.workunit.client.0.smithi089.stdout:3/957: symlink d1/d2/d4/d1c/d7e/l149 0 2024-09-13T22:08:49.195 INFO:tasks.workunit.client.0.smithi089.stdout:3/958: readlink d1/d2/d31/lf6 0 2024-09-13T22:08:49.195 INFO:tasks.workunit.client.0.smithi089.stdout:3/959: readlink d1/d2/d23/d3d/d54/d12f/l13b 0 2024-09-13T22:08:49.197 INFO:tasks.workunit.client.0.smithi089.stdout:1/951: getdents d7/db6 0 2024-09-13T22:08:49.197 INFO:tasks.workunit.client.0.smithi089.stdout:1/952: fdatasync d7/de/da0/f128 0 2024-09-13T22:08:49.197 INFO:tasks.workunit.client.0.smithi089.stdout:1/953: chown d7/de/d68 17612 1 2024-09-13T22:08:49.199 INFO:tasks.workunit.client.0.smithi089.stdout:2/937: mknod df/d1a/d57/dab/c143 0 2024-09-13T22:08:49.202 INFO:tasks.workunit.client.0.smithi089.stdout:5/964: dwrite d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/df8/f13d [0,4194304] 0 2024-09-13T22:08:49.203 INFO:tasks.workunit.client.0.smithi089.stdout:1/954: mkdir d7/d1c/d3c/d136 0 2024-09-13T22:08:49.205 INFO:tasks.workunit.client.0.smithi089.stdout:2/938: mknod df/d14/d66/d69/db5/d130/c144 0 2024-09-13T22:08:49.205 INFO:tasks.workunit.client.0.smithi089.stdout:2/939: read - df/dd9/fe3 zero size 2024-09-13T22:08:49.206 INFO:tasks.workunit.client.0.smithi089.stdout:3/960: rmdir d1/d2/d23/d3d/d46/dab/df2 39 2024-09-13T22:08:49.206 INFO:tasks.workunit.client.0.smithi089.stdout:3/961: stat d1/d2/d96/dc3/lbf 0 2024-09-13T22:08:49.206 INFO:tasks.workunit.client.0.smithi089.stdout:3/962: chown d1/d2/d23/d3d/d54/dc6 31283947 1 2024-09-13T22:08:49.207 INFO:tasks.workunit.client.0.smithi089.stdout:7/908: dwrite d0/d19/d28/d1d/d2d/d55/d116/f7c [0,4194304] 0 2024-09-13T22:08:49.207 INFO:tasks.workunit.client.0.smithi089.stdout:9/972: dwrite d6/d18/d1b/d89/db8/d52/ff7 [0,4194304] 0 2024-09-13T22:08:49.214 INFO:tasks.workunit.client.0.smithi089.stdout:2/940: symlink df/d14/d48/d88/db9/l145 0 2024-09-13T22:08:49.214 INFO:tasks.workunit.client.0.smithi089.stdout:2/941: write f3 [7643390,97589] 0 2024-09-13T22:08:49.215 INFO:tasks.workunit.client.0.smithi089.stdout:3/963: stat d1/d2/d4/d1c/d7e/d40/l139 0 2024-09-13T22:08:49.217 INFO:tasks.workunit.client.0.smithi089.stdout:7/909: write d0/d19/d45/d9b/fa6 [2061188,32724] 0 2024-09-13T22:08:49.217 INFO:tasks.workunit.client.0.smithi089.stdout:7/910: stat d0/d19/d28/d1d/d23/d24/d5d/f134 0 2024-09-13T22:08:49.222 INFO:tasks.workunit.client.0.smithi089.stdout:9/973: truncate d6/d18/d1b/d89/db8/d5a/fa8 747194 0 2024-09-13T22:08:49.223 INFO:tasks.workunit.client.0.smithi089.stdout:9/974: write d6/d18/d1b/da0/fb9 [75068,25914] 0 2024-09-13T22:08:49.224 INFO:tasks.workunit.client.0.smithi089.stdout:5/965: mkdir d4/d19/d14a 0 2024-09-13T22:08:49.224 INFO:tasks.workunit.client.0.smithi089.stdout:5/966: dread - d4/d19/d1e/d28/d31/d55/dcc/f145 zero size 2024-09-13T22:08:49.224 INFO:tasks.workunit.client.0.smithi089.stdout:5/967: chown d4/d19/d1e/d28/d31/d55/l137 782 1 2024-09-13T22:08:49.226 INFO:tasks.workunit.client.0.smithi089.stdout:1/955: link d7/ca d7/d1c/d3c/d136/c137 0 2024-09-13T22:08:49.230 INFO:tasks.workunit.client.0.smithi089.stdout:2/942: link df/d14/d48/d88/db9/f13f df/f146 0 2024-09-13T22:08:49.233 INFO:tasks.workunit.client.0.smithi089.stdout:7/911: creat d0/d19/d28/d1d/d2d/d55/d116/db3/f137 x:0 0 0 2024-09-13T22:08:49.236 INFO:tasks.workunit.client.0.smithi089.stdout:9/975: rename d6/d18/d1b/l20 to d6/d18/dab/d141/d6c/l149 0 2024-09-13T22:08:49.238 INFO:tasks.workunit.client.0.smithi089.stdout:2/943: mkdir df/d14/d66/d69/d2e/d147 0 2024-09-13T22:08:49.238 INFO:tasks.workunit.client.0.smithi089.stdout:3/964: dwrite d1/d2/d4/d1c/d7e/fae [0,4194304] 0 2024-09-13T22:08:49.239 INFO:tasks.workunit.client.0.smithi089.stdout:1/956: write d7/d40/dbe/d2b/d39/d73/da9/fab [499519,89477] 0 2024-09-13T22:08:49.239 INFO:tasks.workunit.client.0.smithi089.stdout:1/957: truncate d7/d1c/d3c/f130 957256 0 2024-09-13T22:08:49.239 INFO:tasks.workunit.client.0.smithi089.stdout:5/968: dread d4/d19/d1e/d28/d31/d55/dcc/f7b [0,4194304] 0 2024-09-13T22:08:49.240 INFO:tasks.workunit.client.0.smithi089.stdout:2/944: mknod df/d14/d48/d88/db9/d124/db1/d106/d120/c148 0 2024-09-13T22:08:49.240 INFO:tasks.workunit.client.0.smithi089.stdout:2/945: write df/d76/d85/fb0 [715653,98412] 0 2024-09-13T22:08:49.240 INFO:tasks.workunit.client.0.smithi089.stdout:2/946: chown df/d14/d2b/d101/f12f 0 1 2024-09-13T22:08:49.241 INFO:tasks.workunit.client.0.smithi089.stdout:2/947: read - df/d14/d48/d88/db9/dec/f142 zero size 2024-09-13T22:08:49.248 INFO:tasks.workunit.client.0.smithi089.stdout:9/976: dread d6/d54/f98 [8388608,4194304] 0 2024-09-13T22:08:49.252 INFO:tasks.workunit.client.0.smithi089.stdout:7/912: getdents d0/d19/d28/d1d/d3d/d9a/dcf/d41 0 2024-09-13T22:08:49.253 INFO:tasks.workunit.client.0.smithi089.stdout:3/965: dwrite d1/d2/de4/f111 [0,4194304] 0 2024-09-13T22:08:49.253 INFO:tasks.workunit.client.0.smithi089.stdout:3/966: fsync d1/d2/d4/d1c/d7e/d40/d69/da1/f138 0 2024-09-13T22:08:49.255 INFO:tasks.workunit.client.0.smithi089.stdout:1/958: symlink d7/d40/dbe/d2b/da7/l138 0 2024-09-13T22:08:49.255 INFO:tasks.workunit.client.0.smithi089.stdout:1/959: chown d7/d1c/fc6 230 1 2024-09-13T22:08:49.255 INFO:tasks.workunit.client.0.smithi089.stdout:1/960: chown d7/d34/l89 8 1 2024-09-13T22:08:49.256 INFO:tasks.workunit.client.0.smithi089.stdout:5/969: creat d4/d19/d1e/d28/d31/d55/da4/f14b x:0 0 0 2024-09-13T22:08:49.257 INFO:tasks.workunit.client.0.smithi089.stdout:2/948: mknod df/d5b/da5/dd7/dfb/c149 0 2024-09-13T22:08:49.259 INFO:tasks.workunit.client.0.smithi089.stdout:9/977: mknod d6/d18/d1b/da0/dae/d120/c14a 0 2024-09-13T22:08:49.260 INFO:tasks.workunit.client.0.smithi089.stdout:7/913: creat d0/d19/d28/d1d/d2d/d55/f138 x:0 0 0 2024-09-13T22:08:49.264 INFO:tasks.workunit.client.0.smithi089.stdout:3/967: creat d1/d2/d23/d3d/f14a x:0 0 0 2024-09-13T22:08:49.264 INFO:tasks.workunit.client.0.smithi089.stdout:3/968: creat d1/d2/d23/d3d/d54/d5d/deb/d97/f14b x:0 0 0 2024-09-13T22:08:49.265 INFO:tasks.workunit.client.0.smithi089.stdout:2/949: dread df/d14/d48/d88/db9/d124/f49 [8388608,4194304] 0 2024-09-13T22:08:49.265 INFO:tasks.workunit.client.0.smithi089.stdout:2/950: fsync df/d76/d85/db2/fb6 0 2024-09-13T22:08:49.265 INFO:tasks.workunit.client.0.smithi089.stdout:2/951: fdatasync df/d5b/da5/fd4 0 2024-09-13T22:08:49.266 INFO:tasks.workunit.client.0.smithi089.stdout:1/961: unlink d7/d1c/d3c/f81 0 2024-09-13T22:08:49.267 INFO:tasks.workunit.client.0.smithi089.stdout:5/970: mkdir d4/d19/d1e/d28/d31/d14c 0 2024-09-13T22:08:49.267 INFO:tasks.workunit.client.0.smithi089.stdout:5/971: readlink d4/d19/d1e/d28/d31/d55/d58/d84/lc2 0 2024-09-13T22:08:49.269 INFO:tasks.workunit.client.0.smithi089.stdout:9/978: mknod d6/d18/d1b/d89/db8/dbe/c14b 0 2024-09-13T22:08:49.271 INFO:tasks.workunit.client.0.smithi089.stdout:7/914: creat d0/d19/d45/d38/dd6/f139 x:0 0 0 2024-09-13T22:08:49.275 INFO:tasks.workunit.client.0.smithi089.stdout:3/969: unlink d1/d2/de4/f111 0 2024-09-13T22:08:49.276 INFO:tasks.workunit.client.0.smithi089.stdout:1/962: mknod d7/d34/d5c/de0/c139 0 2024-09-13T22:08:49.277 INFO:tasks.workunit.client.0.smithi089.stdout:7/915: dread d0/d19/d28/d1d/d3d/f43 [0,4194304] 0 2024-09-13T22:08:49.280 INFO:tasks.workunit.client.0.smithi089.stdout:9/979: rename d6/d31/d5e/lea to d6/d31/l14c 0 2024-09-13T22:08:49.281 INFO:tasks.workunit.client.0.smithi089.stdout:3/970: link d1/d2/d31/f145 d1/d2/d23/d3d/d54/d5d/f14c 0 2024-09-13T22:08:49.284 INFO:tasks.workunit.client.0.smithi089.stdout:7/916: mknod d0/d19/d45/c13a 0 2024-09-13T22:08:49.284 INFO:tasks.workunit.client.0.smithi089.stdout:7/917: stat d0/d19/d45/de7/d90/cd7 0 2024-09-13T22:08:49.286 INFO:tasks.workunit.client.0.smithi089.stdout:5/972: mkdir d4/d19/d14d 0 2024-09-13T22:08:49.287 INFO:tasks.workunit.client.0.smithi089.stdout:5/973: chown d4/d19/d1e/d53 386 1 2024-09-13T22:08:49.287 INFO:tasks.workunit.client.0.smithi089.stdout:5/974: chown d4/d19/d1e/d28/d3d/f7a 128651 1 2024-09-13T22:08:49.287 INFO:tasks.workunit.client.0.smithi089.stdout:1/963: dread d7/de/f27 [0,4194304] 0 2024-09-13T22:08:49.288 INFO:tasks.workunit.client.0.smithi089.stdout:2/952: dwrite df/d14/d48/d88/fe7 [0,4194304] 0 2024-09-13T22:08:49.288 INFO:tasks.workunit.client.0.smithi089.stdout:9/980: link d6/d31/lc2 d6/d18/d1b/da0/l14d 0 2024-09-13T22:08:49.288 INFO:tasks.workunit.client.0.smithi089.stdout:9/981: fsync d6/d18/d1b/f26 0 2024-09-13T22:08:49.289 INFO:tasks.workunit.client.0.smithi089.stdout:9/982: read d6/d54/f98 [3803131,118919] 0 2024-09-13T22:08:49.289 INFO:tasks.workunit.client.0.smithi089.stdout:3/971: unlink d1/d2/d23/d3d/d54/d5d/dc1/l127 0 2024-09-13T22:08:49.291 INFO:tasks.workunit.client.0.smithi089.stdout:5/975: rename d4/d19/d1e/d28/d3d/dba/lfa to d4/d19/d1e/d28/d31/dfd/l14e 0 2024-09-13T22:08:49.291 INFO:tasks.workunit.client.0.smithi089.stdout:5/976: readlink d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/l13c 0 2024-09-13T22:08:49.291 INFO:tasks.workunit.client.0.smithi089.stdout:5/977: read - d4/d19/d1e/f113 zero size 2024-09-13T22:08:49.293 INFO:tasks.workunit.client.0.smithi089.stdout:1/964: creat d7/d1c/d3c/d136/f13a x:0 0 0 2024-09-13T22:08:49.293 INFO:tasks.workunit.client.0.smithi089.stdout:1/965: write d7/de/fea [1904792,110850] 0 2024-09-13T22:08:49.295 INFO:tasks.workunit.client.0.smithi089.stdout:2/953: rmdir df/d1a 39 2024-09-13T22:08:49.297 INFO:tasks.workunit.client.0.smithi089.stdout:9/983: mkdir d6/d18/d1b/d3e/d130/d14e 0 2024-09-13T22:08:49.298 INFO:tasks.workunit.client.0.smithi089.stdout:7/918: dwrite d0/d19/d28/d1d/d3d/d9a/dcf/f135 [0,4194304] 0 2024-09-13T22:08:49.300 INFO:tasks.workunit.client.0.smithi089.stdout:5/978: symlink d4/d19/d146/l14f 0 2024-09-13T22:08:49.300 INFO:tasks.workunit.client.0.smithi089.stdout:5/979: chown d4/d19/d1e/d28/d31/d55/c74 97447030 1 2024-09-13T22:08:49.305 INFO:tasks.workunit.client.0.smithi089.stdout:3/972: dwrite d1/d2/d4/d1c/d7f/f86 [0,4194304] 0 2024-09-13T22:08:49.305 INFO:tasks.workunit.client.0.smithi089.stdout:1/966: unlink d7/de/c12 0 2024-09-13T22:08:49.308 INFO:tasks.workunit.client.0.smithi089.stdout:2/954: unlink df/d5b/fc6 0 2024-09-13T22:08:49.312 INFO:tasks.workunit.client.0.smithi089.stdout:9/984: unlink d6/d18/d1b/d89/l108 0 2024-09-13T22:08:49.316 INFO:tasks.workunit.client.0.smithi089.stdout:5/980: dwrite d4/d19/d1e/d53/d88/d136/d119/f92 [0,4194304] 0 2024-09-13T22:08:49.318 INFO:tasks.workunit.client.0.smithi089.stdout:1/967: write d7/de/d3a/d77/fa2 [1459399,57658] 0 2024-09-13T22:08:49.318 INFO:tasks.workunit.client.0.smithi089.stdout:3/973: mknod d1/d2/d4/d1c/d7e/d40/d69/da1/c14d 0 2024-09-13T22:08:49.324 INFO:tasks.workunit.client.0.smithi089.stdout:2/955: rename df/d5b/c6d to df/d1a/d57/d134/c14a 0 2024-09-13T22:08:49.325 INFO:tasks.workunit.client.0.smithi089.stdout:9/985: symlink d6/d18/d21/l14f 0 2024-09-13T22:08:49.327 INFO:tasks.workunit.client.0.smithi089.stdout:5/981: link d4/d19/d1e/d28/d31/fa5 d4/d19/d1e/d28/f150 0 2024-09-13T22:08:49.331 INFO:tasks.workunit.client.0.smithi089.stdout:6/869: sync 2024-09-13T22:08:49.336 INFO:tasks.workunit.client.0.smithi089.stdout:1/968: rmdir d7/d1c/d3c/d108 0 2024-09-13T22:08:49.338 INFO:tasks.workunit.client.0.smithi089.stdout:3/974: truncate d1/d2/d23/d3d/dda/d5c/ff0 229669 0 2024-09-13T22:08:49.340 INFO:tasks.workunit.client.0.smithi089.stdout:2/956: unlink df/d5b/lfc 0 2024-09-13T22:08:49.342 INFO:tasks.workunit.client.0.smithi089.stdout:5/982: mknod d4/d19/d1e/d28/dea/c151 0 2024-09-13T22:08:49.344 INFO:tasks.workunit.client.0.smithi089.stdout:6/870: creat d0/d5/d43/daf/dfe/f109 x:0 0 0 2024-09-13T22:08:49.344 INFO:tasks.workunit.client.0.smithi089.stdout:6/871: dread - d0/d5/d43/d79/fe1 zero size 2024-09-13T22:08:49.344 INFO:tasks.workunit.client.0.smithi089.stdout:6/872: fdatasync d0/f3e 0 2024-09-13T22:08:49.346 INFO:tasks.workunit.client.0.smithi089.stdout:6/873: rmdir d0/d5/d43/daf 39 2024-09-13T22:08:49.346 INFO:tasks.workunit.client.0.smithi089.stdout:6/874: chown d0/d4/d12/d15/db3/d28/dbf/ff7 20832 1 2024-09-13T22:08:49.346 INFO:tasks.workunit.client.0.smithi089.stdout:6/875: fdatasync d0/d5/d1d/fe2 0 2024-09-13T22:08:49.347 INFO:tasks.workunit.client.0.smithi089.stdout:1/969: write d7/db6/fe8 [2539369,91256] 0 2024-09-13T22:08:49.349 INFO:tasks.workunit.client.0.smithi089.stdout:6/876: unlink d0/d5/d1d/d54/ddc/cf4 0 2024-09-13T22:08:49.352 INFO:tasks.workunit.client.0.smithi089.stdout:1/970: truncate d7/d34/d5c/d5d/f62 3393047 0 2024-09-13T22:08:49.352 INFO:tasks.workunit.client.0.smithi089.stdout:1/971: truncate d7/d34/f37 1444414 0 2024-09-13T22:08:49.355 INFO:tasks.workunit.client.0.smithi089.stdout:6/877: creat d0/dcb/d108/f10a x:0 0 0 2024-09-13T22:08:49.356 INFO:tasks.workunit.client.0.smithi089.stdout:6/878: write d0/d4/d12/d15/db3/f3f [144377,95949] 0 2024-09-13T22:08:49.357 INFO:tasks.workunit.client.0.smithi089.stdout:1/972: getdents d7/de/d3a 0 2024-09-13T22:08:49.361 INFO:tasks.workunit.client.0.smithi089.stdout:6/879: symlink d0/d5/d1d/l10b 0 2024-09-13T22:08:49.361 INFO:tasks.workunit.client.0.smithi089.stdout:6/880: chown d0/d4/d12/d15 2 1 2024-09-13T22:08:49.362 INFO:tasks.workunit.client.0.smithi089.stdout:6/881: read d0/d4/d12/d15/d3b/d62/fd8 [284306,46937] 0 2024-09-13T22:08:49.362 INFO:tasks.workunit.client.0.smithi089.stdout:6/882: write d0/d4/d12/f7b [1574607,108903] 0 2024-09-13T22:08:49.362 INFO:tasks.workunit.client.0.smithi089.stdout:3/975: dwrite d1/d2/d23/d3d/f4d [4194304,4194304] 0 2024-09-13T22:08:49.366 INFO:tasks.workunit.client.0.smithi089.stdout:6/883: creat d0/d5/d1d/d2d/f10c x:0 0 0 2024-09-13T22:08:49.366 INFO:tasks.workunit.client.0.smithi089.stdout:6/884: chown d0/d5/d1d/d2d/f10c 13420 1 2024-09-13T22:08:49.366 INFO:tasks.workunit.client.0.smithi089.stdout:6/885: truncate d0/d4/d12/d15/db3/f101 1000191 0 2024-09-13T22:08:49.371 INFO:tasks.workunit.client.0.smithi089.stdout:2/957: dwrite df/d14/d48/d88/db9/f13f [0,4194304] 0 2024-09-13T22:08:49.374 INFO:tasks.workunit.client.0.smithi089.stdout:3/976: dread d1/d2/d96/dc3/f53 [0,4194304] 0 2024-09-13T22:08:49.375 INFO:tasks.workunit.client.0.smithi089.stdout:2/958: creat df/d14/f14b x:0 0 0 2024-09-13T22:08:49.376 INFO:tasks.workunit.client.0.smithi089.stdout:1/973: dwrite d7/d40/f97 [0,4194304] 0 2024-09-13T22:08:49.377 INFO:tasks.workunit.client.0.smithi089.stdout:5/983: dwrite d4/d19/d1e/d28/f51 [4194304,4194304] 0 2024-09-13T22:08:49.378 INFO:tasks.workunit.client.0.smithi089.stdout:1/974: dread d7/fa4 [0,4194304] 0 2024-09-13T22:08:49.378 INFO:tasks.workunit.client.0.smithi089.stdout:1/975: truncate d7/d1c/d3c/f5e 973930 0 2024-09-13T22:08:49.379 INFO:tasks.workunit.client.0.smithi089.stdout:1/976: creat d7/de/da0/f13b x:0 0 0 2024-09-13T22:08:49.379 INFO:tasks.workunit.client.0.smithi089.stdout:3/977: rename d1/d2/d23/d2b/ff3 to d1/d2/d96/f14e 0 2024-09-13T22:08:49.387 INFO:tasks.workunit.client.0.smithi089.stdout:1/977: dread d7/d40/dbe/d80/fa5 [0,4194304] 0 2024-09-13T22:08:49.388 INFO:tasks.workunit.client.0.smithi089.stdout:5/984: getdents d4/d19/d1e/d53/d88/d136/d119 0 2024-09-13T22:08:49.391 INFO:tasks.workunit.client.0.smithi089.stdout:1/978: dread d7/d40/dbe/d2b/f54 [0,4194304] 0 2024-09-13T22:08:49.391 INFO:tasks.workunit.client.0.smithi089.stdout:3/978: dread d1/d2/d23/d3d/d46/dab/df2/f104 [0,4194304] 0 2024-09-13T22:08:49.391 INFO:tasks.workunit.client.0.smithi089.stdout:3/979: fsync d1/d2/de4/d123/f13d 0 2024-09-13T22:08:49.392 INFO:tasks.workunit.client.0.smithi089.stdout:3/980: readlink d1/d2/d4/d1c/d7e/lbd 0 2024-09-13T22:08:49.396 INFO:tasks.workunit.client.0.smithi089.stdout:2/959: dwrite df/d14/d48/d88/db9/d124/dbd/d117/f121 [0,4194304] 0 2024-09-13T22:08:49.396 INFO:tasks.workunit.client.0.smithi089.stdout:2/960: write df/d14/d66/ff9 [913639,2915] 0 2024-09-13T22:08:49.397 INFO:tasks.workunit.client.0.smithi089.stdout:2/961: write df/d1a/d57/fba [331341,57546] 0 2024-09-13T22:08:49.397 INFO:tasks.workunit.client.0.smithi089.stdout:5/985: truncate d4/d19/d1e/d53/d88/fc8 299300 0 2024-09-13T22:08:49.399 INFO:tasks.workunit.client.0.smithi089.stdout:1/979: mkdir d7/de/da0/dbd/d13c 0 2024-09-13T22:08:49.401 INFO:tasks.workunit.client.0.smithi089.stdout:3/981: creat d1/d2/f14f x:0 0 0 2024-09-13T22:08:49.403 INFO:tasks.workunit.client.0.smithi089.stdout:3/982: dread d1/d2/d4/d1c/d7e/d40/fad [0,4194304] 0 2024-09-13T22:08:49.403 INFO:tasks.workunit.client.0.smithi089.stdout:3/983: stat d1/d2/d23/d3d/d54/d5d/c114 0 2024-09-13T22:08:49.403 INFO:tasks.workunit.client.0.smithi089.stdout:3/984: chown d1/d2/d23/d3d/d46/dab/df2/c100 15 1 2024-09-13T22:08:49.403 INFO:tasks.workunit.client.0.smithi089.stdout:3/985: readlink d1/d2/d23/d3d/d54/dc6/l12b 0 2024-09-13T22:08:49.404 INFO:tasks.workunit.client.0.smithi089.stdout:3/986: dread d1/d2/d23/d3d/d54/d5d/deb/fd0 [0,4194304] 0 2024-09-13T22:08:49.407 INFO:tasks.workunit.client.0.smithi089.stdout:2/962: creat df/d76/d85/f14c x:0 0 0 2024-09-13T22:08:49.408 INFO:tasks.workunit.client.0.smithi089.stdout:5/986: creat d4/d19/d1e/d28/d31/d55/d58/d84/d101/d124/df8/d11e/f152 x:0 0 0 2024-09-13T22:08:49.412 INFO:tasks.workunit.client.0.smithi089.stdout:2/963: unlink df/d14/d48/d88/db9/d124/l40 0 2024-09-13T22:08:49.414 INFO:tasks.workunit.client.0.smithi089.stdout:5/987: mknod d4/d19/d1e/d28/d31/d55/da4/c153 0 2024-09-13T22:08:49.414 INFO:tasks.workunit.client.0.smithi089.stdout:5/988: chown d4/d19/f24 93061142 1 2024-09-13T22:08:49.420 INFO:tasks.workunit.client.0.smithi089.stdout:3/987: dwrite d1/d2/f66 [0,4194304] 0 2024-09-13T22:08:49.422 INFO:tasks.workunit.client.0.smithi089.stdout:3/988: symlink d1/d2/d23/d3d/d54/l150 0 2024-09-13T22:08:49.425 INFO:tasks.workunit.client.0.smithi089.stdout:3/989: unlink d1/d2/d4/d1c/d7f/l10f 0 2024-09-13T22:08:49.427 INFO:tasks.workunit.client.0.smithi089.stdout:3/990: symlink d1/d2/d4/d1c/d7e/l151 0 2024-09-13T22:08:49.427 INFO:tasks.workunit.client.0.smithi089.stdout:3/991: stat d1/d2/d4/d1c/d7f/f122 0 2024-09-13T22:08:49.430 INFO:tasks.workunit.client.0.smithi089.stdout:3/992: getdents d1/d2/d23/d3d/d46/dab/d10e 0 2024-09-13T22:08:49.430 INFO:tasks.workunit.client.0.smithi089.stdout:3/993: fsync d1/d2/d4/f10d 0 2024-09-13T22:08:49.430 INFO:tasks.workunit.client.0.smithi089.stdout:3/994: creat d1/d2/d23/d3d/d54/dc6/f152 x:0 0 0 2024-09-13T22:08:49.439 INFO:tasks.workunit.client.0.smithi089.stdout:3/995: read d1/d2/d4/f16 [7195409,48665] 0 2024-09-13T22:08:49.441 INFO:tasks.workunit.client.0.smithi089.stdout:3/996: dread d1/d2/d4/d1c/d7e/d83/fac [0,4194304] 0 2024-09-13T22:08:49.444 INFO:tasks.workunit.client.0.smithi089.stdout:3/997: unlink d1/d2/d23/d3d/d54/d5d/deb/cee 0 2024-09-13T22:08:49.446 INFO:tasks.workunit.client.0.smithi089.stdout:3/998: rename d1/d2/d4/d1c/d7e/d40/c6b to d1/d2/d23/d3d/d54/d5d/deb/d97/d107/c153 0 2024-09-13T22:08:49.446 INFO:tasks.workunit.client.0.smithi089.stdout:3/999: fsync d1/d2/d23/d3d/d46/dab/df2/f11e 0 2024-09-13T22:08:49.470 INFO:tasks.workunit.client.0.smithi089.stdout:7/919: sync 2024-09-13T22:08:49.476 INFO:tasks.workunit.client.0.smithi089.stdout:7/920: dread d0/ff [0,4194304] 0 2024-09-13T22:08:49.483 INFO:tasks.workunit.client.0.smithi089.stdout:7/921: rename d0/d19/d28/d1d/d3d/d9a to d0/d19/dfe/d13b 0 2024-09-13T22:08:49.485 INFO:tasks.workunit.client.0.smithi089.stdout:7/922: mkdir d0/d19/d28/d1d/d23/d24/d13c 0 2024-09-13T22:08:49.485 INFO:tasks.workunit.client.0.smithi089.stdout:7/923: write d0/d19/dfe/d13b/dcf/da8/dd8/f102 [798483,85845] 0 2024-09-13T22:08:49.485 INFO:tasks.workunit.client.0.smithi089.stdout:7/924: creat d0/d19/d28/d61/f13d x:0 0 0 2024-09-13T22:08:49.488 INFO:tasks.workunit.client.0.smithi089.stdout:7/925: mknod d0/d19/dfe/d13b/c13e 0 2024-09-13T22:08:49.491 INFO:tasks.workunit.client.0.smithi089.stdout:7/926: write d0/d19/d45/de7/fb7 [3483838,11973] 0 2024-09-13T22:08:49.499 INFO:tasks.workunit.client.0.smithi089.stdout:7/927: dread d0/d19/d28/d1d/d3d/ff6 [0,4194304] 0 2024-09-13T22:08:49.541 INFO:tasks.workunit.client.0.smithi089.stdout:6/886: sync 2024-09-13T22:08:49.541 INFO:tasks.workunit.client.0.smithi089.stdout:9/986: sync 2024-09-13T22:08:49.541 INFO:tasks.workunit.client.0.smithi089.stdout:9/987: stat d6/d18/d1b/d89/db8/dbe/df8 0 2024-09-13T22:08:49.542 INFO:tasks.workunit.client.0.smithi089.stdout:6/887: unlink d0/d5/d1d/d2d/d55/c6b 0 2024-09-13T22:08:49.544 INFO:tasks.workunit.client.0.smithi089.stdout:9/988: symlink d6/d18/d1b/d89/db8/d5a/l150 0 2024-09-13T22:08:49.546 INFO:tasks.workunit.client.0.smithi089.stdout:6/888: mknod d0/d4/d12/d15/db3/d28/dbf/d107/c10d 0 2024-09-13T22:08:49.546 INFO:tasks.workunit.client.0.smithi089.stdout:6/889: read - d0/d4/d12/d15/d3b/d62/da4/fd4 zero size 2024-09-13T22:08:49.560 INFO:tasks.workunit.client.0.smithi089.stdout:9/989: dwrite d6/d31/d64/ffc [0,4194304] 0 2024-09-13T22:08:49.568 INFO:tasks.workunit.client.0.smithi089.stdout:9/990: dread d6/d54/fb5 [0,4194304] 0 2024-09-13T22:08:49.570 INFO:tasks.workunit.client.0.smithi089.stdout:9/991: rmdir d6/d18/d1b/d3e 39 2024-09-13T22:08:49.570 INFO:tasks.workunit.client.0.smithi089.stdout:9/992: chown d6/d31/d5e/db1/l134 42114 1 2024-09-13T22:08:49.579 INFO:tasks.workunit.client.0.smithi089.stdout:9/993: write d6/d18/d1b/d89/db8/dbe/ff1 [3904893,104136] 0 2024-09-13T22:08:49.579 INFO:tasks.workunit.client.0.smithi089.stdout:9/994: write d6/d54/f9d [1099439,45365] 0 2024-09-13T22:08:49.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/995: dwrite d6/d18/d1b/d3e/dbd/f117 [0,4194304] 0 2024-09-13T22:08:49.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/996: chown d6/d18/d1b/d89 593 1 2024-09-13T22:08:49.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/997: fdatasync f0 0 2024-09-13T22:08:49.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/998: write d6/d55/f6a [1390657,73827] 0 2024-09-13T22:08:49.603 INFO:tasks.workunit.client.0.smithi089.stdout:9/999: mkdir d6/d31/d5e/d151 0 2024-09-13T22:08:49.617 INFO:tasks.workunit.client.0.smithi089.stdout:1/980: sync 2024-09-13T22:08:49.617 INFO:tasks.workunit.client.0.smithi089.stdout:5/989: sync 2024-09-13T22:08:49.617 INFO:tasks.workunit.client.0.smithi089.stdout:2/964: sync 2024-09-13T22:08:49.617 INFO:tasks.workunit.client.0.smithi089.stdout:2/965: write df/d14/d48/d88/db9/d124/dbd/d13a/f10b [390033,94085] 0 2024-09-13T22:08:49.620 INFO:tasks.workunit.client.0.smithi089.stdout:2/966: unlink df/d14/d66/d69/l3b 0 2024-09-13T22:08:49.627 INFO:tasks.workunit.client.0.smithi089.stdout:1/981: rename d7/de/d68 to d7/de/da0/dbd/d13d 0 2024-09-13T22:08:49.638 INFO:tasks.workunit.client.0.smithi089.stdout:2/967: dwrite df/d14/d48/d88/fa2 [0,4194304] 0 2024-09-13T22:08:49.639 INFO:tasks.workunit.client.0.smithi089.stdout:2/968: fdatasync df/d14/d66/d69/f51 0 2024-09-13T22:08:49.639 INFO:tasks.workunit.client.0.smithi089.stdout:2/969: write df/d5b/fe5 [173539,89245] 0 2024-09-13T22:08:49.639 INFO:tasks.workunit.client.0.smithi089.stdout:5/990: dwrite d4/d19/d1e/d28/d31/d55/d58/f131 [4194304,4194304] 0 2024-09-13T22:08:49.640 INFO:tasks.workunit.client.0.smithi089.stdout:1/982: read d7/d40/dbe/d2b/d39/f98 [2481361,110427] 0 2024-09-13T22:08:49.642 INFO:tasks.workunit.client.0.smithi089.stdout:2/970: stat df/d5b/da5/ce4 0 2024-09-13T22:08:49.642 INFO:tasks.workunit.client.0.smithi089.stdout:2/971: chown df/d1a/d57/d134 74886 1 2024-09-13T22:08:49.643 INFO:tasks.workunit.client.0.smithi089.stdout:7/928: sync 2024-09-13T22:08:49.644 INFO:tasks.workunit.client.0.smithi089.stdout:1/983: symlink d7/de/de7/df9/l13e 0 2024-09-13T22:08:49.647 INFO:tasks.workunit.client.0.smithi089.stdout:2/972: creat df/dd9/f14d x:0 0 0 2024-09-13T22:08:49.647 INFO:tasks.workunit.client.0.smithi089.stdout:2/973: read df/d14/d48/d88/db9/d124/f49 [4351235,90673] 0 2024-09-13T22:08:49.649 INFO:tasks.workunit.client.0.smithi089.stdout:5/991: read d4/d19/d1e/d89/dce/f6e [2359831,106480] 0 2024-09-13T22:08:49.650 INFO:tasks.workunit.client.0.smithi089.stdout:1/984: read d7/d40/dbe/d80/f82 [161978,84995] 0 2024-09-13T22:08:49.664 INFO:tasks.workunit.client.0.smithi089.stdout:2/974: dwrite df/f22 [0,4194304] 0 2024-09-13T22:08:49.665 INFO:tasks.workunit.client.0.smithi089.stdout:2/975: truncate df/d14/d48/d88/db9/d124/f96 4658057 0 2024-09-13T22:08:49.665 INFO:tasks.workunit.client.0.smithi089.stdout:5/992: mkdir d4/d19/d1e/d28/d149/d154 0 2024-09-13T22:08:49.668 INFO:tasks.workunit.client.0.smithi089.stdout:7/929: rename d0/d19/d28 to d0/d19/d45/d38/d54/d13f 0 2024-09-13T22:08:49.672 INFO:tasks.workunit.client.0.smithi089.stdout:2/976: creat df/d14/d48/d88/f14e x:0 0 0 2024-09-13T22:08:49.672 INFO:tasks.workunit.client.0.smithi089.stdout:2/977: stat df/d14/d66/dfd/lff 0 2024-09-13T22:08:49.672 INFO:tasks.workunit.client.0.smithi089.stdout:2/978: chown df/fe2 169230 1 2024-09-13T22:08:49.673 INFO:tasks.workunit.client.0.smithi089.stdout:5/993: link d4/d19/d1e/d53/d88/d136/d119/lb2 d4/d19/d1e/d53/d88/l155 0 2024-09-13T22:08:49.674 INFO:tasks.workunit.client.0.smithi089.stdout:5/994: write d4/d19/d1e/d28/d31/d55/f6d [332730,16293] 0 2024-09-13T22:08:49.675 INFO:tasks.workunit.client.0.smithi089.stdout:1/985: mknod d7/c13f 0 2024-09-13T22:08:49.676 INFO:tasks.workunit.client.0.smithi089.stdout:7/930: mkdir d0/d19/d45/d38/d54/d13f/d100/d140 0 2024-09-13T22:08:49.678 INFO:tasks.workunit.client.0.smithi089.stdout:2/979: truncate df/d14/d66/d69/d2e/f37 1526138 0 2024-09-13T22:08:49.678 INFO:tasks.workunit.client.0.smithi089.stdout:2/980: fdatasync df/d14/d66/f70 0 2024-09-13T22:08:49.678 INFO:tasks.workunit.client.0.smithi089.stdout:2/981: read - df/d14/d48/d88/db9/dec/f142 zero size 2024-09-13T22:08:49.678 INFO:tasks.workunit.client.0.smithi089.stdout:2/982: getdents df/d122 0 2024-09-13T22:08:49.679 INFO:tasks.workunit.client.0.smithi089.stdout:7/931: symlink d0/d19/d45/d38/d54/d13f/d1d/d3d/d69/l141 0 2024-09-13T22:08:49.684 INFO:tasks.workunit.client.0.smithi089.stdout:7/932: dread d0/d19/d45/f95 [0,4194304] 0 2024-09-13T22:08:49.684 INFO:tasks.workunit.client.0.smithi089.stdout:5/995: dread d4/f27 [0,4194304] 0 2024-09-13T22:08:49.684 INFO:tasks.workunit.client.0.smithi089.stdout:7/933: stat d0/d19/d45/d38/d54/d13f/d1d/d23/d89/cc5 0 2024-09-13T22:08:49.684 INFO:tasks.workunit.client.0.smithi089.stdout:5/996: write d4/d19/d1e/d28/d31/d55/d58/d84/d101/f121 [813552,76115] 0 2024-09-13T22:08:49.684 INFO:tasks.workunit.client.0.smithi089.stdout:5/997: stat d4/d19/d1e/d28 0 2024-09-13T22:08:49.684 INFO:tasks.workunit.client.0.smithi089.stdout:5/998: fsync d4/d19/d1e/d28/d31/d55/d58/d9d/f12a 0 2024-09-13T22:08:49.684 INFO:tasks.workunit.client.0.smithi089.stdout:5/999: truncate d4/d19/d1e/d28/d31/d94/fc1 528413 0 2024-09-13T22:08:49.688 INFO:tasks.workunit.client.0.smithi089.stdout:6/890: sync 2024-09-13T22:08:49.688 INFO:tasks.workunit.client.0.smithi089.stdout:2/983: write df/f146 [2260661,73767] 0 2024-09-13T22:08:49.690 INFO:tasks.workunit.client.0.smithi089.stdout:6/891: creat d0/d5/d43/daf/db1/db7/f10e x:0 0 0 2024-09-13T22:08:49.690 INFO:tasks.workunit.client.0.smithi089.stdout:6/892: dread - d0/d4/ff5 zero size 2024-09-13T22:08:49.690 INFO:tasks.workunit.client.0.smithi089.stdout:6/893: write d0/d4/d12/d15/db3/d28/fd0 [177203,6125] 0 2024-09-13T22:08:49.690 INFO:tasks.workunit.client.0.smithi089.stdout:6/894: truncate d0/d4/d12/d15/fc1 4791685 0 2024-09-13T22:08:49.690 INFO:tasks.workunit.client.0.smithi089.stdout:6/895: write d0/d4/d12/d15/db3/d28/dbf/fdd [4590430,65561] 0 2024-09-13T22:08:49.693 INFO:tasks.workunit.client.0.smithi089.stdout:7/934: dread d0/d19/d45/d38/f6a [0,4194304] 0 2024-09-13T22:08:49.693 INFO:tasks.workunit.client.0.smithi089.stdout:7/935: readlink d0/d19/d45/d38/d54/d13f/d1d/d30/l96 0 2024-09-13T22:08:49.693 INFO:tasks.workunit.client.0.smithi089.stdout:1/986: dwrite d7/d40/dbe/d2b/d59/d9e/fd3 [0,4194304] 0 2024-09-13T22:08:49.701 INFO:tasks.workunit.client.0.smithi089.stdout:1/987: symlink d7/d40/dbe/d2b/l140 0 2024-09-13T22:08:49.701 INFO:tasks.workunit.client.0.smithi089.stdout:1/988: creat d7/d1c/d3c/d136/f141 x:0 0 0 2024-09-13T22:08:49.709 INFO:tasks.workunit.client.0.smithi089.stdout:1/989: mknod d7/d40/dbe/d2b/da7/d100/d113/c142 0 2024-09-13T22:08:49.712 INFO:tasks.workunit.client.0.smithi089.stdout:1/990: unlink d7/de/d3a/c48 0 2024-09-13T22:08:49.712 INFO:tasks.workunit.client.0.smithi089.stdout:1/991: chown d7/d40/dbe/d114 44316449 1 2024-09-13T22:08:49.713 INFO:tasks.workunit.client.0.smithi089.stdout:1/992: fsync d7/de/da0/dbd/d13d/f90 0 2024-09-13T22:08:49.713 INFO:tasks.workunit.client.0.smithi089.stdout:1/993: truncate d7/d1c/d3c/f49 1620779 0 2024-09-13T22:08:49.714 INFO:tasks.workunit.client.0.smithi089.stdout:1/994: mkdir d7/d40/dbe/d2b/da7/d100/d143 0 2024-09-13T22:08:49.722 INFO:tasks.workunit.client.0.smithi089.stdout:2/984: dwrite df/d14/d48/d88/db9/d124/f49 [0,4194304] 0 2024-09-13T22:08:49.724 INFO:tasks.workunit.client.0.smithi089.stdout:7/936: dwrite d0/fec [0,4194304] 0 2024-09-13T22:08:49.724 INFO:tasks.workunit.client.0.smithi089.stdout:6/896: dwrite d0/d5/d1d/fe2 [0,4194304] 0 2024-09-13T22:08:49.729 INFO:tasks.workunit.client.0.smithi089.stdout:1/995: dwrite d7/d40/dbe/de9/ffd [4194304,4194304] 0 2024-09-13T22:08:49.729 INFO:tasks.workunit.client.0.smithi089.stdout:7/937: link d0/d19/d45/d38/d54/d13f/d1d/d23/d24/fbb d0/d19/d45/d38/d54/d13f/d1d/d30/d5b/f142 0 2024-09-13T22:08:49.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/897: mknod d0/d4/ded/c10f 0 2024-09-13T22:08:49.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/898: creat d0/d4/d12/d15/db3/d4b/f110 x:0 0 0 2024-09-13T22:08:49.741 INFO:tasks.workunit.client.0.smithi089.stdout:6/899: dread d0/d4/f2b [0,4194304] 0 2024-09-13T22:08:49.741 INFO:tasks.workunit.client.0.smithi089.stdout:6/900: dread - d0/d4/ff5 zero size 2024-09-13T22:08:49.743 INFO:tasks.workunit.client.0.smithi089.stdout:6/901: rmdir d0/d4/d12/d15/db3/d28/dbf/d107 39 2024-09-13T22:08:49.743 INFO:tasks.workunit.client.0.smithi089.stdout:6/902: chown d0/d4/d12/d15/d3b 53043300 1 2024-09-13T22:08:49.745 INFO:tasks.workunit.client.0.smithi089.stdout:6/903: unlink d0/d5/d43/daf/db1/db7/ldf 0 2024-09-13T22:08:49.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:49 smithi089 ceph-mon[27921]: pgmap v256: 65 pgs: 65 active+clean; 1.7 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 196 MiB/s rd, 254 MiB/s wr, 578 op/s 2024-09-13T22:08:49.753 INFO:tasks.workunit.client.0.smithi089.stdout:2/985: dwrite df/d14/d48/d88/f14e [0,4194304] 0 2024-09-13T22:08:49.753 INFO:tasks.workunit.client.0.smithi089.stdout:2/986: write df/d76/fd6 [976637,62939] 0 2024-09-13T22:08:49.753 INFO:tasks.workunit.client.0.smithi089.stdout:2/987: chown df/f12 226898 1 2024-09-13T22:08:49.753 INFO:tasks.workunit.client.0.smithi089.stdout:2/988: truncate df/d14/d2b/d101/f136 590900 0 2024-09-13T22:08:49.754 INFO:tasks.workunit.client.0.smithi089.stdout:7/938: dwrite d0/d19/d45/d38/d54/d13f/fdb [0,4194304] 0 2024-09-13T22:08:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:49 smithi159 ceph-mon[35348]: pgmap v256: 65 pgs: 65 active+clean; 1.7 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 196 MiB/s rd, 254 MiB/s wr, 578 op/s 2024-09-13T22:08:49.760 INFO:tasks.workunit.client.0.smithi089.stdout:2/989: creat df/d14/d48/d88/db9/d124/dbd/d135/f14f x:0 0 0 2024-09-13T22:08:49.762 INFO:tasks.workunit.client.0.smithi089.stdout:6/904: dwrite d0/d5/d43/d79/fd3 [0,4194304] 0 2024-09-13T22:08:49.762 INFO:tasks.workunit.client.0.smithi089.stdout:6/905: readlink d0/d4/d12/d15/lc2 0 2024-09-13T22:08:49.764 INFO:tasks.workunit.client.0.smithi089.stdout:7/939: symlink d0/d19/dfe/d13b/dcf/l143 0 2024-09-13T22:08:49.777 INFO:tasks.workunit.client.0.smithi089.stdout:6/906: dwrite d0/d5/d43/f9d [0,4194304] 0 2024-09-13T22:08:49.781 INFO:tasks.workunit.client.0.smithi089.stdout:2/990: creat df/dd9/d12d/f150 x:0 0 0 2024-09-13T22:08:49.781 INFO:tasks.workunit.client.0.smithi089.stdout:2/991: write df/d14/d66/d69/d2e/d10c/f110 [3227699,16198] 0 2024-09-13T22:08:49.784 INFO:tasks.workunit.client.0.smithi089.stdout:7/940: creat d0/d19/d45/d38/d54/d13f/d1d/d23/d89/f144 x:0 0 0 2024-09-13T22:08:49.786 INFO:tasks.workunit.client.0.smithi089.stdout:6/907: creat d0/d5/d43/daf/f111 x:0 0 0 2024-09-13T22:08:49.789 INFO:tasks.workunit.client.0.smithi089.stdout:7/941: mknod d0/d19/d45/d38/d54/d13f/d1d/d3d/c145 0 2024-09-13T22:08:49.790 INFO:tasks.workunit.client.0.smithi089.stdout:2/992: dread df/d76/d85/ff2 [0,4194304] 0 2024-09-13T22:08:49.790 INFO:tasks.workunit.client.0.smithi089.stdout:2/993: fdatasync df/d76/d85/d10f/f12a 0 2024-09-13T22:08:49.790 INFO:tasks.workunit.client.0.smithi089.stdout:2/994: write df/d5b/fd2 [1865004,55584] 0 2024-09-13T22:08:49.791 INFO:tasks.workunit.client.0.smithi089.stdout:7/942: symlink d0/d19/d45/d9b/l146 0 2024-09-13T22:08:49.791 INFO:tasks.workunit.client.0.smithi089.stdout:7/943: stat d0/d19/d45/d38/d54/d13f/d1d/d2d/f12f 0 2024-09-13T22:08:49.797 INFO:tasks.workunit.client.0.smithi089.stdout:2/995: write df/d5b/da5/dd7/ff0 [3070658,71990] 0 2024-09-13T22:08:49.797 INFO:tasks.workunit.client.0.smithi089.stdout:2/996: readlink df/d5b/da5/db8/ld8 0 2024-09-13T22:08:49.797 INFO:tasks.workunit.client.0.smithi089.stdout:2/997: creat df/dd9/d12d/f151 x:0 0 0 2024-09-13T22:08:49.797 INFO:tasks.workunit.client.0.smithi089.stdout:2/998: fsync df/d14/d48/d88/fe7 0 2024-09-13T22:08:49.797 INFO:tasks.workunit.client.0.smithi089.stdout:2/999: stat df/dd9/f14d 0 2024-09-13T22:08:49.818 INFO:tasks.workunit.client.0.smithi089.stdout:7/944: mkdir d0/d19/d45/d38/dd6/d147 0 2024-09-13T22:08:49.823 INFO:tasks.workunit.client.0.smithi089.stdout:7/945: creat d0/d19/d45/d92/ddc/f148 x:0 0 0 2024-09-13T22:08:49.823 INFO:tasks.workunit.client.0.smithi089.stdout:7/946: truncate d0/d19/d45/d38/d54/d13f/d1d/d23/d24/d5d/f127 813059 0 2024-09-13T22:08:49.825 INFO:tasks.workunit.client.0.smithi089.stdout:7/947: rename d0/d19/d45/d38/d54/d13f/d1d/d23/d24/d5d/f134 to d0/d19/d45/d38/d54/d13f/d1d/d2d/d55/d116/db3/f149 0 2024-09-13T22:08:49.825 INFO:tasks.workunit.client.0.smithi089.stdout:7/948: truncate d0/d19/d45/d92/ddc/f148 591268 0 2024-09-13T22:08:49.832 INFO:tasks.workunit.client.0.smithi089.stdout:7/949: dread d0/d19/d45/d38/d54/d13f/d1d/d30/d5b/f118 [0,4194304] 0 2024-09-13T22:08:49.832 INFO:tasks.workunit.client.0.smithi089.stdout:7/950: fsync d0/d19/d45/d38/d54/d13f/d1d/d23/f56 0 2024-09-13T22:08:49.898 INFO:tasks.workunit.client.0.smithi089.stdout:6/908: sync 2024-09-13T22:08:49.898 INFO:tasks.workunit.client.0.smithi089.stdout:1/996: sync 2024-09-13T22:08:49.898 INFO:tasks.workunit.client.0.smithi089.stdout:1/997: chown d7/d1c/fc6 0 1 2024-09-13T22:08:49.905 INFO:tasks.workunit.client.0.smithi089.stdout:6/909: rename d0/d4/d12/d15/d3b to d0/d4/d12/d15/db3/d28/dbf/d112 0 2024-09-13T22:08:49.910 INFO:tasks.workunit.client.0.smithi089.stdout:6/910: symlink d0/d4/d12/d15/db3/d4b/d7a/l113 0 2024-09-13T22:08:49.911 INFO:tasks.workunit.client.0.smithi089.stdout:6/911: truncate d0/d4/d12/f41 5087884 0 2024-09-13T22:08:49.913 INFO:tasks.workunit.client.0.smithi089.stdout:1/998: rename d7/d40/dbe/d2b/da7/d100 to d7/de/da0/dbd/dde/d144 0 2024-09-13T22:08:49.913 INFO:tasks.workunit.client.0.smithi089.stdout:1/999: truncate d7/d1c/d3c/f130 1293743 0 2024-09-13T22:08:49.916 INFO:tasks.workunit.client.0.smithi089.stdout:6/912: rename d0/d4/d12/d15/db3/d28/dbf/df9 to d0/d4/d12/d15/db3/d28/dbf/d114 0 2024-09-13T22:08:49.916 INFO:tasks.workunit.client.0.smithi089.stdout:6/913: dread - d0/d5/d43/daf/db1/fb5 zero size 2024-09-13T22:08:49.916 INFO:tasks.workunit.client.0.smithi089.stdout:6/914: chown d0/d4/ff5 738640 1 2024-09-13T22:08:49.918 INFO:tasks.workunit.client.0.smithi089.stdout:6/915: mkdir d0/d5/d1d/d2d/d115 0 2024-09-13T22:08:49.935 INFO:tasks.workunit.client.0.smithi089.stdout:6/916: dwrite d0/d5/d43/daf/db1/fb5 [0,4194304] 0 2024-09-13T22:08:49.935 INFO:tasks.workunit.client.0.smithi089.stdout:6/917: truncate d0/d4/d12/d15/db3/d4b/fe9 79750 0 2024-09-13T22:08:49.935 INFO:tasks.workunit.client.0.smithi089.stdout:6/918: write d0/fec [726985,65609] 0 2024-09-13T22:08:49.939 INFO:tasks.workunit.client.0.smithi089.stdout:6/919: mkdir d0/d5/d1d/d2d/d115/d116 0 2024-09-13T22:08:49.940 INFO:tasks.workunit.client.0.smithi089.stdout:6/920: creat d0/d5/d1d/f117 x:0 0 0 2024-09-13T22:08:49.940 INFO:tasks.workunit.client.0.smithi089.stdout:6/921: chown d0/d5/f4d 57561001 1 2024-09-13T22:08:49.941 INFO:tasks.workunit.client.0.smithi089.stdout:6/922: mkdir d0/d4/d12/d15/db3/d4b/d7a/d118 0 2024-09-13T22:08:49.941 INFO:tasks.workunit.client.0.smithi089.stdout:6/923: read - d0/d4/d12/d15/db3/d60/d94/ff1 zero size 2024-09-13T22:08:49.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/924: write d0/d4/ffa [377491,17737] 0 2024-09-13T22:08:49.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/925: fdatasync d0/d4/d12/d15/db3/d28/dbf/f102 0 2024-09-13T22:08:49.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/926: fsync d0/d4/d12/d15/fc1 0 2024-09-13T22:08:49.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/927: creat d0/d4/f119 x:0 0 0 2024-09-13T22:08:49.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/928: truncate d0/dcb/d108/f10a 86174 0 2024-09-13T22:08:49.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/929: read d0/d4/d12/f91 [517336,16101] 0 2024-09-13T22:08:49.943 INFO:tasks.workunit.client.0.smithi089.stdout:6/930: fdatasync d0/fec 0 2024-09-13T22:08:49.944 INFO:tasks.workunit.client.0.smithi089.stdout:6/931: symlink d0/d5/d1d/d2d/d115/l11a 0 2024-09-13T22:08:49.944 INFO:tasks.workunit.client.0.smithi089.stdout:6/932: chown d0/d4/f119 318146884 1 2024-09-13T22:08:49.944 INFO:tasks.workunit.client.0.smithi089.stdout:6/933: write d0/d4/d12/d15/db3/d4a/f7d [199078,129816] 0 2024-09-13T22:08:49.954 INFO:tasks.workunit.client.0.smithi089.stdout:7/951: sync 2024-09-13T22:08:49.954 INFO:tasks.workunit.client.0.smithi089.stdout:7/952: chown d0/d19/dfe/d13b 90 1 2024-09-13T22:08:49.969 INFO:tasks.workunit.client.0.smithi089.stdout:6/934: dwrite d0/d5/fcd [0,4194304] 0 2024-09-13T22:08:49.969 INFO:tasks.workunit.client.0.smithi089.stdout:6/935: dread - d0/d5/d43/fd7 zero size 2024-09-13T22:08:49.969 INFO:tasks.workunit.client.0.smithi089.stdout:6/936: chown d0/d5/d1d/d2d/l89 156842990 1 2024-09-13T22:08:49.976 INFO:tasks.workunit.client.0.smithi089.stdout:7/953: dwrite d0/d19/d45/d38/d54/d13f/d1d/d23/d89/d93/f114 [0,4194304] 0 2024-09-13T22:08:49.979 INFO:tasks.workunit.client.0.smithi089.stdout:7/954: dread d0/d19/d45/d38/d54/d13f/d1d/d30/da7/f115 [0,4194304] 0 2024-09-13T22:08:49.980 INFO:tasks.workunit.client.0.smithi089.stdout:7/955: symlink d0/d19/d45/d38/d54/d13f/d1d/l14a 0 2024-09-13T22:08:49.981 INFO:tasks.workunit.client.0.smithi089.stdout:7/956: creat d0/d19/d45/d38/d54/d13f/d1d/d23/d24/d113/f14b x:0 0 0 2024-09-13T22:08:49.982 INFO:tasks.workunit.client.0.smithi089.stdout:7/957: creat d0/d19/d45/de7/d90/db2/f14c x:0 0 0 2024-09-13T22:08:49.983 INFO:tasks.workunit.client.0.smithi089.stdout:7/958: mkdir d0/d19/dfe/d13b/dcf/da8/d14d 0 2024-09-13T22:08:49.984 INFO:tasks.workunit.client.0.smithi089.stdout:7/959: truncate d0/d19/d45/d38/d54/d13f/f1c 676534 0 2024-09-13T22:08:49.984 INFO:tasks.workunit.client.0.smithi089.stdout:7/960: dread - d0/d19/d45/d38/d54/d13f/d1d/d23/d89/f144 zero size 2024-09-13T22:08:49.987 INFO:tasks.workunit.client.0.smithi089.stdout:6/937: dwrite d0/dcb/fd6 [0,4194304] 0 2024-09-13T22:08:49.987 INFO:tasks.workunit.client.0.smithi089.stdout:6/938: stat d0/d5/fcd 0 2024-09-13T22:08:49.987 INFO:tasks.workunit.client.0.smithi089.stdout:6/939: write d0/d4/d12/d15/db3/d28/fa1 [464378,60526] 0 2024-09-13T22:08:49.987 INFO:tasks.workunit.client.0.smithi089.stdout:6/940: readlink d0/d5/d1d/d2d/d55/l63 0 2024-09-13T22:08:49.987 INFO:tasks.workunit.client.0.smithi089.stdout:6/941: stat d0/d5/d64 0 2024-09-13T22:08:50.008 INFO:tasks.workunit.client.0.smithi089.stdout:6/942: dwrite d0/d4/d12/d15/fc1 [0,4194304] 0 2024-09-13T22:08:50.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/961: dwrite d0/d19/d45/d38/d54/d13f/d1d/d30/f9d [0,4194304] 0 2024-09-13T22:08:50.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/962: fsync d0/d19/d45/d38/d54/d13f/d1d/d30/d5b/f118 0 2024-09-13T22:08:50.010 INFO:tasks.workunit.client.0.smithi089.stdout:6/943: unlink d0/f11 0 2024-09-13T22:08:50.011 INFO:tasks.workunit.client.0.smithi089.stdout:7/963: getdents d0/d19/d45/d38/d54/d13f/d1d/d2d/d55/d116/db3 0 2024-09-13T22:08:50.012 INFO:tasks.workunit.client.0.smithi089.stdout:6/944: mknod d0/d4/d12/d15/db3/d4b/d7a/d118/c11b 0 2024-09-13T22:08:50.013 INFO:tasks.workunit.client.0.smithi089.stdout:7/964: creat d0/d19/d45/d38/d54/d13f/d1d/d2d/d55/d116/db3/f14e x:0 0 0 2024-09-13T22:08:50.014 INFO:tasks.workunit.client.0.smithi089.stdout:6/945: truncate d0/d4/d12/d15/db3/d28/dbf/d112/d62/f80 530641 0 2024-09-13T22:08:50.015 INFO:tasks.workunit.client.0.smithi089.stdout:7/965: rename d0/d19/d45/d38/lc9 to d0/d19/d45/d38/l14f 0 2024-09-13T22:08:50.017 INFO:tasks.workunit.client.0.smithi089.stdout:6/946: getdents d0/d5 0 2024-09-13T22:08:50.036 INFO:tasks.workunit.client.0.smithi089.stdout:6/947: dwrite d0/d4/f6f [0,4194304] 0 2024-09-13T22:08:50.057 INFO:tasks.workunit.client.0.smithi089.stdout:6/948: dwrite d0/d4/d12/f7b [0,4194304] 0 2024-09-13T22:08:50.067 INFO:tasks.workunit.client.0.smithi089.stdout:6/949: write d0/d5/d43/daf/db1/fc4 [2047575,108761] 0 2024-09-13T22:08:50.067 INFO:tasks.workunit.client.0.smithi089.stdout:6/950: chown d0/d4/d12/d15/db3/d4b/lac 369665793 1 2024-09-13T22:08:50.067 INFO:tasks.workunit.client.0.smithi089.stdout:6/951: readlink d0/d5/d43/l65 0 2024-09-13T22:08:50.069 INFO:tasks.workunit.client.0.smithi089.stdout:6/952: dread d0/d4/d12/d15/db3/f3f [0,4194304] 0 2024-09-13T22:08:50.069 INFO:tasks.workunit.client.0.smithi089.stdout:6/953: fdatasync d0/d4/d12/d15/db3/d28/dbf/d112/d62/fa8 0 2024-09-13T22:08:50.070 INFO:tasks.workunit.client.0.smithi089.stdout:6/954: symlink d0/d5/d43/daf/dfe/l11c 0 2024-09-13T22:08:50.074 INFO:tasks.workunit.client.0.smithi089.stdout:7/966: sync 2024-09-13T22:08:50.075 INFO:tasks.workunit.client.0.smithi089.stdout:7/967: rename d0/d19/d45/d38/d54/d13f/d61/fb8 to d0/d19/d45/d38/d54/d13f/d1d/d30/f150 0 2024-09-13T22:08:50.077 INFO:tasks.workunit.client.0.smithi089.stdout:7/968: symlink d0/d19/d45/d38/d54/d13f/d100/d140/l151 0 2024-09-13T22:08:50.077 INFO:tasks.workunit.client.0.smithi089.stdout:7/969: fdatasync d0/d19/d45/f95 0 2024-09-13T22:08:50.077 INFO:tasks.workunit.client.0.smithi089.stdout:7/970: symlink d0/d19/d45/d38/d54/d13f/d1d/d23/d89/l152 0 2024-09-13T22:08:50.079 INFO:tasks.workunit.client.0.smithi089.stdout:7/971: creat d0/d19/d45/d92/ddc/d10e/f153 x:0 0 0 2024-09-13T22:08:50.079 INFO:tasks.workunit.client.0.smithi089.stdout:7/972: chown d0/d19/d45/d38/d54/d13f 507509998 1 2024-09-13T22:08:50.079 INFO:tasks.workunit.client.0.smithi089.stdout:7/973: write d0/d19/d45/f106 [4103388,45529] 0 2024-09-13T22:08:50.079 INFO:tasks.workunit.client.0.smithi089.stdout:7/974: write d0/d19/d45/d38/d54/d13f/d1d/f64 [3244887,95013] 0 2024-09-13T22:08:50.079 INFO:tasks.workunit.client.0.smithi089.stdout:7/975: fsync d0/d19/fb0 0 2024-09-13T22:08:50.079 INFO:tasks.workunit.client.0.smithi089.stdout:7/976: chown d0/d19/d45/d38/d54/d13f/d7b/f97 1253562 1 2024-09-13T22:08:50.079 INFO:tasks.workunit.client.0.smithi089.stdout:7/977: fdatasync d0/d19/d45/d38/d54/d13f/d7b/f120 0 2024-09-13T22:08:50.102 INFO:tasks.workunit.client.0.smithi089.stdout:7/978: dwrite d0/d19/d45/d38/f3a [0,4194304] 0 2024-09-13T22:08:50.103 INFO:tasks.workunit.client.0.smithi089.stdout:7/979: creat d0/d19/d45/d92/f154 x:0 0 0 2024-09-13T22:08:50.103 INFO:tasks.workunit.client.0.smithi089.stdout:7/980: chown d0/d19/dfe/d13b/dcf/d41/dbf 1348174 1 2024-09-13T22:08:50.104 INFO:tasks.workunit.client.0.smithi089.stdout:7/981: mknod d0/c155 0 2024-09-13T22:08:50.105 INFO:tasks.workunit.client.0.smithi089.stdout:7/982: symlink d0/d19/d45/d9b/l156 0 2024-09-13T22:08:50.105 INFO:tasks.workunit.client.0.smithi089.stdout:7/983: creat d0/d19/d45/d38/d54/d13f/d1d/d2d/d55/d116/db3/f157 x:0 0 0 2024-09-13T22:08:50.106 INFO:tasks.workunit.client.0.smithi089.stdout:7/984: getdents d0/d19/d45/d92/def 0 2024-09-13T22:08:50.106 INFO:tasks.workunit.client.0.smithi089.stdout:7/985: stat d0/d19/d45/d38/d54/d13f/d1d/de2/lf5 0 2024-09-13T22:08:50.108 INFO:tasks.workunit.client.0.smithi089.stdout:7/986: write d0/d19/d45/d38/d54/d13f/d1d/d2d/d55/d116/db3/f110 [1072405,104390] 0 2024-09-13T22:08:50.108 INFO:tasks.workunit.client.0.smithi089.stdout:7/987: write d0/d19/d45/d38/d54/d13f/d1d/d3d/fb9 [721516,566] 0 2024-09-13T22:08:50.139 INFO:tasks.workunit.client.0.smithi089.stdout:6/955: sync 2024-09-13T22:08:50.139 INFO:tasks.workunit.client.0.smithi089.stdout:6/956: creat d0/d5/d1d/d2d/f11d x:0 0 0 2024-09-13T22:08:50.140 INFO:tasks.workunit.client.0.smithi089.stdout:6/957: truncate d0/d4/f2b 3420332 0 2024-09-13T22:08:50.140 INFO:tasks.workunit.client.1.smithi159.stdout:7/10: sync 2024-09-13T22:08:50.141 INFO:tasks.workunit.client.1.smithi159.stdout:7/11: write - no filename 2024-09-13T22:08:50.141 INFO:tasks.workunit.client.1.smithi159.stdout:7/12: readlink - no filename 2024-09-13T22:08:50.142 INFO:tasks.workunit.client.0.smithi089.stdout:6/958: rename d0/d5/c6c to d0/d4/d12/d15/db3/d28/dbf/d112/d62/da4/c11e 0 2024-09-13T22:08:50.142 INFO:tasks.workunit.client.0.smithi089.stdout:6/959: fsync d0/d5/d1d/d2d/da0/ff2 0 2024-09-13T22:08:50.142 INFO:tasks.workunit.client.0.smithi089.stdout:6/960: chown d0/f3e 37 1 2024-09-13T22:08:50.143 INFO:tasks.workunit.client.1.smithi159.stdout:7/13: mknod c0 0 2024-09-13T22:08:50.143 INFO:tasks.workunit.client.1.smithi159.stdout:7/14: dwrite - no filename 2024-09-13T22:08:50.144 INFO:tasks.workunit.client.0.smithi089.stdout:6/961: getdents d0/d4/d12/d15 0 2024-09-13T22:08:50.144 INFO:tasks.workunit.client.0.smithi089.stdout:6/962: read - d0/d5/d43/fd7 zero size 2024-09-13T22:08:50.145 INFO:tasks.workunit.client.1.smithi159.stdout:7/15: symlink l1 0 2024-09-13T22:08:50.145 INFO:tasks.workunit.client.1.smithi159.stdout:7/16: write - no filename 2024-09-13T22:08:50.145 INFO:tasks.workunit.client.1.smithi159.stdout:7/17: rename l1 to l2 0 2024-09-13T22:08:50.146 INFO:tasks.workunit.client.1.smithi159.stdout:7/18: chown c0 100 1 2024-09-13T22:08:50.146 INFO:tasks.workunit.client.1.smithi159.stdout:7/19: read - no filename 2024-09-13T22:08:50.151 INFO:tasks.workunit.client.0.smithi089.stdout:6/963: dread d0/d5/d43/daf/db1/fc4 [0,4194304] 0 2024-09-13T22:08:50.203 INFO:tasks.workunit.client.1.smithi159.stdout:7/20: mkdir d3 0 2024-09-13T22:08:50.203 INFO:tasks.workunit.client.1.smithi159.stdout:7/21: stat c0 0 2024-09-13T22:08:50.204 INFO:tasks.workunit.client.1.smithi159.stdout:7/22: mkdir d3/d4 0 2024-09-13T22:08:50.204 INFO:tasks.workunit.client.1.smithi159.stdout:7/23: read - no filename 2024-09-13T22:08:50.204 INFO:tasks.workunit.client.1.smithi159.stdout:7/24: fsync - no filename 2024-09-13T22:08:50.204 INFO:tasks.workunit.client.1.smithi159.stdout:7/25: dread - no filename 2024-09-13T22:08:50.204 INFO:tasks.workunit.client.1.smithi159.stdout:7/26: fdatasync - no filename 2024-09-13T22:08:50.204 INFO:tasks.workunit.client.1.smithi159.stdout:7/27: truncate - no filename 2024-09-13T22:08:50.204 INFO:tasks.workunit.client.1.smithi159.stdout:7/28: rename d3 to d3/d5 22 2024-09-13T22:08:50.204 INFO:tasks.workunit.client.1.smithi159.stdout:7/29: stat c0 0 2024-09-13T22:08:50.205 INFO:tasks.workunit.client.1.smithi159.stdout:7/30: link l2 d3/l6 0 2024-09-13T22:08:50.206 INFO:tasks.workunit.client.1.smithi159.stdout:7/31: rmdir d3/d4 0 2024-09-13T22:08:50.207 INFO:tasks.workunit.client.0.smithi089.stdout:6/964: dwrite d0/d5/d64/fea [0,4194304] 0 2024-09-13T22:08:50.208 INFO:tasks.workunit.client.0.smithi089.stdout:7/988: sync 2024-09-13T22:08:50.208 INFO:tasks.workunit.client.1.smithi159.stdout:7/32: creat d3/f7 x:0 0 0 2024-09-13T22:08:50.210 INFO:tasks.workunit.client.1.smithi159.stdout:7/33: symlink d3/l8 0 2024-09-13T22:08:50.210 INFO:tasks.workunit.client.1.smithi159.stdout:7/34: dread - d3/f7 zero size 2024-09-13T22:08:50.210 INFO:tasks.workunit.client.1.smithi159.stdout:7/35: creat d3/f9 x:0 0 0 2024-09-13T22:08:50.211 INFO:tasks.workunit.client.1.smithi159.stdout:7/36: write d3/f7 [308716,78944] 0 2024-09-13T22:08:50.211 INFO:tasks.workunit.client.1.smithi159.stdout:7/37: dread - d3/f9 zero size 2024-09-13T22:08:50.211 INFO:tasks.workunit.client.0.smithi089.stdout:7/989: mknod d0/d19/d45/d38/d54/d13f/d1d/d30/d5b/c158 0 2024-09-13T22:08:50.213 INFO:tasks.workunit.client.1.smithi159.stdout:7/38: mknod d3/ca 0 2024-09-13T22:08:50.214 INFO:tasks.workunit.client.1.smithi159.stdout:7/39: read d3/f7 [286681,64224] 0 2024-09-13T22:08:50.214 INFO:tasks.workunit.client.1.smithi159.stdout:7/40: write d3/f9 [411445,85944] 0 2024-09-13T22:08:50.214 INFO:tasks.workunit.client.1.smithi159.stdout:7/41: read d3/f9 [178229,24822] 0 2024-09-13T22:08:50.215 INFO:tasks.workunit.client.0.smithi089.stdout:7/990: mknod d0/d19/d45/d92/ddc/c159 0 2024-09-13T22:08:50.218 INFO:tasks.workunit.client.1.smithi159.stdout:7/42: getdents d3 0 2024-09-13T22:08:50.219 INFO:tasks.workunit.client.1.smithi159.stdout:7/43: rename d3/l6 to d3/lb 0 2024-09-13T22:08:50.220 INFO:tasks.workunit.client.0.smithi089.stdout:7/991: getdents d0/d19/d45/d92/ddc 0 2024-09-13T22:08:50.222 INFO:tasks.workunit.client.0.smithi089.stdout:7/992: rename d0/d19/dfe/d13b/dcf/da8 to d0/d19/d45/d38/d54/d13f/d1d/d3d/d69/d15a 0 2024-09-13T22:08:50.222 INFO:tasks.workunit.client.0.smithi089.stdout:7/993: chown d0/d19/d45/d38/d54/d13f/d1d/d23/d24/f42 22525740 1 2024-09-13T22:08:50.222 INFO:tasks.workunit.client.1.smithi159.stdout:7/44: symlink d3/lc 0 2024-09-13T22:08:50.222 INFO:tasks.workunit.client.0.smithi089.stdout:7/994: creat d0/d19/d45/d9b/f15b x:0 0 0 2024-09-13T22:08:50.223 INFO:tasks.workunit.client.1.smithi159.stdout:7/45: write d3/f9 [282524,124137] 0 2024-09-13T22:08:50.223 INFO:tasks.workunit.client.0.smithi089.stdout:7/995: write d0/d19/d45/d38/d54/d13f/d1d/d2d/d55/d116/db3/f149 [700959,1066] 0 2024-09-13T22:08:50.224 INFO:tasks.workunit.client.1.smithi159.stdout:7/46: link d3/f9 d3/fd 0 2024-09-13T22:08:50.225 INFO:tasks.workunit.client.0.smithi089.stdout:6/965: dwrite d0/d4/d12/d15/db3/d28/dbf/d112/d62/da4/fcf [0,4194304] 0 2024-09-13T22:08:50.225 INFO:tasks.workunit.client.1.smithi159.stdout:7/47: chown d3/ca 167035 1 2024-09-13T22:08:50.226 INFO:tasks.workunit.client.1.smithi159.stdout:7/48: rmdir d3 39 2024-09-13T22:08:50.227 INFO:tasks.workunit.client.0.smithi089.stdout:6/966: rmdir d0/d5/d43/daf/dfe 39 2024-09-13T22:08:50.228 INFO:tasks.workunit.client.0.smithi089.stdout:6/967: mknod d0/d4/d12/c11f 0 2024-09-13T22:08:50.228 INFO:tasks.workunit.client.0.smithi089.stdout:6/968: chown d0/d4/d12/d15/db3/d28/dbf/d112/d62/fa8 71369 1 2024-09-13T22:08:50.229 INFO:tasks.workunit.client.1.smithi159.stdout:7/49: fdatasync d3/fd 0 2024-09-13T22:08:50.230 INFO:tasks.workunit.client.0.smithi089.stdout:6/969: rmdir d0/d4/d12/d15/db3/d28/dbf/d112/d62/da4 39 2024-09-13T22:08:50.233 INFO:tasks.workunit.client.0.smithi089.stdout:6/970: unlink d0/d5/d43/daf/db1/db7/f10e 0 2024-09-13T22:08:50.233 INFO:tasks.workunit.client.0.smithi089.stdout:6/971: chown d0/d4/d12/c1b 93779 1 2024-09-13T22:08:50.245 INFO:tasks.workunit.client.0.smithi089.stdout:7/996: dwrite d0/d19/dfe/d13b/dcf/d41/f12a [0,4194304] 0 2024-09-13T22:08:50.247 INFO:tasks.workunit.client.1.smithi159.stdout:7/50: dread d3/f7 [0,4194304] 0 2024-09-13T22:08:50.247 INFO:tasks.workunit.client.0.smithi089.stdout:7/997: rename d0/d19/d45/d92/ld1 to d0/d19/d45/d38/d54/d13f/d1d/d3d/d69/d15a/dd8/l15c 0 2024-09-13T22:08:50.249 INFO:tasks.workunit.client.0.smithi089.stdout:7/998: creat d0/d19/d45/d92/ddc/f15d x:0 0 0 2024-09-13T22:08:50.253 INFO:tasks.workunit.client.1.smithi159.stdout:7/51: truncate d3/fd 48889 0 2024-09-13T22:08:50.253 INFO:tasks.workunit.client.1.smithi159.stdout:7/52: readlink l2 0 2024-09-13T22:08:50.273 INFO:tasks.workunit.client.0.smithi089.stdout:7/999: dwrite d0/d19/d45/d38/d54/d13f/d1d/d2d/d55/d116/fc1 [0,4194304] 0 2024-09-13T22:08:50.273 INFO:tasks.workunit.client.1.smithi159.stdout:7/53: dwrite d3/f7 [0,4194304] 0 2024-09-13T22:08:50.275 INFO:tasks.workunit.client.1.smithi159.stdout:7/54: unlink d3/f7 0 2024-09-13T22:08:50.276 INFO:tasks.workunit.client.1.smithi159.stdout:7/55: creat d3/fe x:0 0 0 2024-09-13T22:08:50.277 INFO:tasks.workunit.client.1.smithi159.stdout:7/56: link d3/fe d3/ff 0 2024-09-13T22:08:50.278 INFO:tasks.workunit.client.1.smithi159.stdout:7/57: dread d3/f9 [0,4194304] 0 2024-09-13T22:08:50.279 INFO:tasks.workunit.client.1.smithi159.stdout:7/58: creat d3/f10 x:0 0 0 2024-09-13T22:08:50.280 INFO:tasks.workunit.client.1.smithi159.stdout:7/59: creat d3/f11 x:0 0 0 2024-09-13T22:08:50.280 INFO:tasks.workunit.client.1.smithi159.stdout:7/60: chown d3/lc 218 1 2024-09-13T22:08:50.280 INFO:tasks.workunit.client.1.smithi159.stdout:7/61: creat d3/f12 x:0 0 0 2024-09-13T22:08:50.298 INFO:tasks.workunit.client.0.smithi089.stdout:6/972: sync 2024-09-13T22:08:50.478 INFO:tasks.workunit.client.0.smithi089.stdout:6/973: dwrite d0/d4/d12/f85 [0,4194304] 0 2024-09-13T22:08:50.491 INFO:tasks.workunit.client.0.smithi089.stdout:6/974: dwrite d0/d5/d1d/d54/f8f [0,4194304] 0 2024-09-13T22:08:50.491 INFO:tasks.workunit.client.0.smithi089.stdout:6/975: write d0/d5/fb8 [2099259,87004] 0 2024-09-13T22:08:50.508 INFO:tasks.workunit.client.0.smithi089.stdout:6/976: dwrite d0/d4/d12/d15/fc1 [0,4194304] 0 2024-09-13T22:08:50.509 INFO:tasks.workunit.client.0.smithi089.stdout:6/977: chown d0/d4/d12 475 1 2024-09-13T22:08:50.509 INFO:tasks.workunit.client.0.smithi089.stdout:6/978: fdatasync d0/d4/d12/d15/db3/d28/dbf/d112/d62/da4/fcf 0 2024-09-13T22:08:50.509 INFO:tasks.workunit.client.0.smithi089.stdout:6/979: mkdir d0/d5/d43/daf/d120 0 2024-09-13T22:08:50.523 INFO:tasks.workunit.client.0.smithi089.stdout:6/980: dwrite d0/d4/d12/d15/db3/d28/dbf/ff7 [4194304,4194304] 0 2024-09-13T22:08:50.525 INFO:tasks.workunit.client.0.smithi089.stdout:6/981: link d0/d5/d1d/f117 d0/d4/d12/d15/db3/d4b/d7a/f121 0 2024-09-13T22:08:50.525 INFO:tasks.workunit.client.0.smithi089.stdout:6/982: mkdir d0/dcb/d122 0 2024-09-13T22:08:50.526 INFO:tasks.workunit.client.0.smithi089.stdout:6/983: chown d0/d5/fb8 3 1 2024-09-13T22:08:50.526 INFO:tasks.workunit.client.0.smithi089.stdout:6/984: stat d0/d4/d12/f70 0 2024-09-13T22:08:50.527 INFO:tasks.workunit.client.0.smithi089.stdout:6/985: rename d0/d4/f5b to d0/d4/d12/d15/db3/d28/dbf/d112/d62/f123 0 2024-09-13T22:08:50.528 INFO:tasks.workunit.client.0.smithi089.stdout:6/986: symlink d0/d4/d12/d15/l124 0 2024-09-13T22:08:50.529 INFO:tasks.workunit.client.0.smithi089.stdout:6/987: creat d0/d5/d43/daf/d120/f125 x:0 0 0 2024-09-13T22:08:50.582 INFO:tasks.workunit.client.0.smithi089.stdout:6/988: sync 2024-09-13T22:08:50.583 INFO:tasks.workunit.client.0.smithi089.stdout:6/989: rmdir d0/dcb/d122 0 2024-09-13T22:08:50.583 INFO:tasks.workunit.client.0.smithi089.stdout:6/990: truncate d0/dcb/d108/f10a 974278 0 2024-09-13T22:08:50.590 INFO:tasks.workunit.client.0.smithi089.stdout:6/991: dread d0/d5/fcd [4194304,4194304] 0 2024-09-13T22:08:50.592 INFO:tasks.workunit.client.0.smithi089.stdout:6/992: rename d0/d4/d12/d15/db3/d28/dbf/d112/d62/f123 to d0/f126 0 2024-09-13T22:08:50.593 INFO:tasks.workunit.client.0.smithi089.stdout:6/993: mknod d0/d5/d43/c127 0 2024-09-13T22:08:50.594 INFO:tasks.workunit.client.0.smithi089.stdout:6/994: creat d0/f128 x:0 0 0 2024-09-13T22:08:50.595 INFO:tasks.workunit.client.0.smithi089.stdout:6/995: rename d0/d4/d12/d15/db3/d28/fa1 to d0/d4/d12/d15/db3/d28/dbf/f129 0 2024-09-13T22:08:50.595 INFO:tasks.workunit.client.0.smithi089.stdout:6/996: chown d0/d5/d1d/d2d/d55 814685 1 2024-09-13T22:08:50.595 INFO:tasks.workunit.client.0.smithi089.stdout:6/997: chown d0/d4/d12 126 1 2024-09-13T22:08:50.600 INFO:tasks.workunit.client.0.smithi089.stdout:6/998: dread d0/d4/f2b [0,4194304] 0 2024-09-13T22:08:50.600 INFO:tasks.workunit.client.0.smithi089.stdout:6/999: fdatasync d0/d5/d43/f8a 0 2024-09-13T22:08:50.603 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm -rf -- ./tmp.sKhXxecTPl 2024-09-13T22:08:51.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:51 smithi089 ceph-mon[27921]: pgmap v257: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 233 MiB/s rd, 297 MiB/s wr, 486 op/s 2024-09-13T22:08:51.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:51 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:51.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:51 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:51.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:51 smithi159 ceph-mon[35348]: pgmap v257: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 233 MiB/s rd, 297 MiB/s wr, 486 op/s 2024-09-13T22:08:51.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:51 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:51.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:51 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:51.891 INFO:tasks.workunit.client.1.smithi159.stdout:2/11: sync 2024-09-13T22:08:51.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/12: unlink f0 0 2024-09-13T22:08:51.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/13: dwrite - no filename 2024-09-13T22:08:51.897 INFO:tasks.workunit.client.1.smithi159.stdout:2/14: rmdir d1 0 2024-09-13T22:08:51.897 INFO:tasks.workunit.client.1.smithi159.stdout:2/15: fdatasync - no filename 2024-09-13T22:08:52.116 INFO:tasks.workunit.client.1.smithi159.stdout:1/40: sync 2024-09-13T22:08:52.116 INFO:tasks.workunit.client.1.smithi159.stdout:8/33: sync 2024-09-13T22:08:52.116 INFO:tasks.workunit.client.1.smithi159.stdout:5/16: sync 2024-09-13T22:08:52.116 INFO:tasks.workunit.client.1.smithi159.stdout:9/18: sync 2024-09-13T22:08:52.117 INFO:tasks.workunit.client.1.smithi159.stdout:6/31: sync 2024-09-13T22:08:52.117 INFO:tasks.workunit.client.1.smithi159.stdout:1/41: write f7 [148953,19495] 0 2024-09-13T22:08:52.117 INFO:tasks.workunit.client.1.smithi159.stdout:1/42: readlink - no filename 2024-09-13T22:08:52.117 INFO:tasks.workunit.client.1.smithi159.stdout:1/43: chown c5 22833 1 2024-09-13T22:08:52.117 INFO:tasks.workunit.client.1.smithi159.stdout:3/71: sync 2024-09-13T22:08:52.118 INFO:tasks.workunit.client.1.smithi159.stdout:0/149: sync 2024-09-13T22:08:52.118 INFO:tasks.workunit.client.1.smithi159.stdout:7/62: sync 2024-09-13T22:08:52.118 INFO:tasks.workunit.client.1.smithi159.stdout:7/63: fdatasync d3/fd 0 2024-09-13T22:08:52.118 INFO:tasks.workunit.client.1.smithi159.stdout:4/19: sync 2024-09-13T22:08:52.120 INFO:tasks.workunit.client.1.smithi159.stdout:7/64: dread d3/f9 [0,4194304] 0 2024-09-13T22:08:52.120 INFO:tasks.workunit.client.1.smithi159.stdout:3/72: symlink d0/l16 0 2024-09-13T22:08:52.120 INFO:tasks.workunit.client.1.smithi159.stdout:3/73: creat d0/d1/d3/d5/f17 x:0 0 0 2024-09-13T22:08:52.120 INFO:tasks.workunit.client.1.smithi159.stdout:3/74: creat d0/d1/d3/dd/f18 x:0 0 0 2024-09-13T22:08:52.121 INFO:tasks.workunit.client.1.smithi159.stdout:3/75: write d0/d1/d3/dd/f18 [652627,63359] 0 2024-09-13T22:08:52.121 INFO:tasks.workunit.client.1.smithi159.stdout:1/44: dread f3 [0,4194304] 0 2024-09-13T22:08:52.121 INFO:tasks.workunit.client.1.smithi159.stdout:6/32: mknod d3/c9 0 2024-09-13T22:08:52.125 INFO:tasks.workunit.client.1.smithi159.stdout:3/76: creat d0/d1/d3/d5/d14/f19 x:0 0 0 2024-09-13T22:08:52.129 INFO:tasks.workunit.client.1.smithi159.stdout:1/45: symlink la 0 2024-09-13T22:08:52.134 INFO:tasks.workunit.client.1.smithi159.stdout:3/77: dread d0/d1/d3/dd/f18 [0,4194304] 0 2024-09-13T22:08:52.135 INFO:tasks.workunit.client.1.smithi159.stdout:7/65: rename d3/fd to d3/f13 0 2024-09-13T22:08:52.135 INFO:tasks.workunit.client.1.smithi159.stdout:7/66: stat d3/f9 0 2024-09-13T22:08:52.135 INFO:tasks.workunit.client.1.smithi159.stdout:7/67: stat d3/fe 0 2024-09-13T22:08:52.137 INFO:tasks.workunit.client.1.smithi159.stdout:1/46: rename f6 to fb 0 2024-09-13T22:08:52.137 INFO:tasks.workunit.client.1.smithi159.stdout:1/47: write f3 [1315645,81210] 0 2024-09-13T22:08:52.138 INFO:tasks.workunit.client.1.smithi159.stdout:6/33: mkdir d3/da 0 2024-09-13T22:08:52.138 INFO:tasks.workunit.client.1.smithi159.stdout:6/34: truncate - no filename 2024-09-13T22:08:52.138 INFO:tasks.workunit.client.1.smithi159.stdout:6/35: truncate - no filename 2024-09-13T22:08:52.138 INFO:tasks.workunit.client.1.smithi159.stdout:6/36: truncate - no filename 2024-09-13T22:08:52.139 INFO:tasks.workunit.client.1.smithi159.stdout:6/37: getdents d3/da 0 2024-09-13T22:08:52.140 INFO:tasks.workunit.client.1.smithi159.stdout:7/68: creat d3/f14 x:0 0 0 2024-09-13T22:08:52.140 INFO:tasks.workunit.client.1.smithi159.stdout:7/69: dread - d3/fe zero size 2024-09-13T22:08:52.140 INFO:tasks.workunit.client.1.smithi159.stdout:7/70: read - d3/f14 zero size 2024-09-13T22:08:52.141 INFO:tasks.workunit.client.1.smithi159.stdout:1/48: mknod cc 0 2024-09-13T22:08:52.143 INFO:tasks.workunit.client.1.smithi159.stdout:7/71: creat d3/f15 x:0 0 0 2024-09-13T22:08:52.143 INFO:tasks.workunit.client.1.smithi159.stdout:7/72: chown d3/f14 669 1 2024-09-13T22:08:52.144 INFO:tasks.workunit.client.1.smithi159.stdout:1/49: mkdir dd 0 2024-09-13T22:08:52.146 INFO:tasks.workunit.client.1.smithi159.stdout:6/38: link d3/c4 d3/da/cb 0 2024-09-13T22:08:52.148 INFO:tasks.workunit.client.1.smithi159.stdout:7/73: creat d3/f16 x:0 0 0 2024-09-13T22:08:52.148 INFO:tasks.workunit.client.1.smithi159.stdout:5/17: dwrite d1/f5 [0,4194304] 0 2024-09-13T22:08:52.148 INFO:tasks.workunit.client.1.smithi159.stdout:0/150: dwrite d0/d7/d22/d2b/f2f [0,4194304] 0 2024-09-13T22:08:52.148 INFO:tasks.workunit.client.1.smithi159.stdout:0/151: stat d0/d7/f14 0 2024-09-13T22:08:52.151 INFO:tasks.workunit.client.1.smithi159.stdout:1/50: dread f3 [0,4194304] 0 2024-09-13T22:08:52.158 INFO:tasks.workunit.client.1.smithi159.stdout:0/152: creat d0/d7/d22/f35 x:0 0 0 2024-09-13T22:08:52.159 INFO:tasks.workunit.client.1.smithi159.stdout:0/153: write d0/d7/f1a [1123667,248] 0 2024-09-13T22:08:52.159 INFO:tasks.workunit.client.1.smithi159.stdout:0/154: creat d0/d2c/f36 x:0 0 0 2024-09-13T22:08:52.160 INFO:tasks.workunit.client.1.smithi159.stdout:6/39: mkdir d3/dc 0 2024-09-13T22:08:52.160 INFO:tasks.workunit.client.1.smithi159.stdout:3/78: fsync d0/d1/d3/d5/d14/f19 0 2024-09-13T22:08:52.161 INFO:tasks.workunit.client.1.smithi159.stdout:7/74: mknod d3/c17 0 2024-09-13T22:08:52.164 INFO:tasks.workunit.client.1.smithi159.stdout:4/20: write f2 [3652919,82348] 0 2024-09-13T22:08:52.164 INFO:tasks.workunit.client.1.smithi159.stdout:4/21: write f2 [1519207,73700] 0 2024-09-13T22:08:52.165 INFO:tasks.workunit.client.1.smithi159.stdout:5/18: rmdir d1 39 2024-09-13T22:08:52.165 INFO:tasks.workunit.client.1.smithi159.stdout:5/19: stat d1/f4 0 2024-09-13T22:08:52.174 INFO:tasks.workunit.client.1.smithi159.stdout:3/79: truncate d0/d1/d3/d5/fe 845983 0 2024-09-13T22:08:52.175 INFO:tasks.workunit.client.1.smithi159.stdout:4/22: symlink l4 0 2024-09-13T22:08:52.178 INFO:tasks.workunit.client.1.smithi159.stdout:6/40: mknod d3/cd 0 2024-09-13T22:08:52.178 INFO:tasks.workunit.client.1.smithi159.stdout:6/41: stat c0 0 2024-09-13T22:08:52.178 INFO:tasks.workunit.client.1.smithi159.stdout:6/42: dread - no filename 2024-09-13T22:08:52.185 INFO:tasks.workunit.client.1.smithi159.stdout:7/75: dwrite d3/f14 [0,4194304] 0 2024-09-13T22:08:52.185 INFO:tasks.workunit.client.1.smithi159.stdout:7/76: truncate d3/f10 140181 0 2024-09-13T22:08:52.188 INFO:tasks.workunit.client.1.smithi159.stdout:5/20: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:08:52.188 INFO:tasks.workunit.client.1.smithi159.stdout:5/21: chown l0 27770 1 2024-09-13T22:08:52.214 INFO:tasks.workunit.client.1.smithi159.stdout:6/43: mkdir d3/da/de 0 2024-09-13T22:08:52.214 INFO:tasks.workunit.client.1.smithi159.stdout:3/80: getdents d0/d1/d3/dd 0 2024-09-13T22:08:52.219 INFO:tasks.workunit.client.1.smithi159.stdout:5/22: getdents d1 0 2024-09-13T22:08:52.222 INFO:tasks.workunit.client.1.smithi159.stdout:6/44: creat d3/da/de/ff x:0 0 0 2024-09-13T22:08:52.222 INFO:tasks.workunit.client.1.smithi159.stdout:6/45: truncate d3/da/de/ff 315422 0 2024-09-13T22:08:52.222 INFO:tasks.workunit.client.1.smithi159.stdout:6/46: write d3/da/de/ff [1321570,112443] 0 2024-09-13T22:08:52.223 INFO:tasks.workunit.client.1.smithi159.stdout:6/47: write d3/da/de/ff [1891482,6926] 0 2024-09-13T22:08:52.223 INFO:tasks.workunit.client.1.smithi159.stdout:5/23: dread d1/f2 [0,4194304] 0 2024-09-13T22:08:52.224 INFO:tasks.workunit.client.1.smithi159.stdout:6/48: creat d3/da/f10 x:0 0 0 2024-09-13T22:08:52.224 INFO:tasks.workunit.client.1.smithi159.stdout:6/49: creat d3/da/de/f11 x:0 0 0 2024-09-13T22:08:52.225 INFO:tasks.workunit.client.1.smithi159.stdout:3/81: dread d0/d1/d3/dd/f13 [0,4194304] 0 2024-09-13T22:08:52.225 INFO:tasks.workunit.client.1.smithi159.stdout:3/82: fsync d0/d1/d3/d5/d14/f19 0 2024-09-13T22:08:52.229 INFO:tasks.workunit.client.1.smithi159.stdout:3/83: creat d0/d1/f1a x:0 0 0 2024-09-13T22:08:52.231 INFO:tasks.workunit.client.1.smithi159.stdout:3/84: getdents d0/d1/d3/d5 0 2024-09-13T22:08:52.231 INFO:tasks.workunit.client.1.smithi159.stdout:3/85: getdents d0/d1/d15 0 2024-09-13T22:08:52.231 INFO:tasks.workunit.client.1.smithi159.stdout:4/23: dwrite f2 [0,4194304] 0 2024-09-13T22:08:52.231 INFO:tasks.workunit.client.1.smithi159.stdout:4/24: rmdir - no directory 2024-09-13T22:08:52.231 INFO:tasks.workunit.client.1.smithi159.stdout:4/25: chown l3 58241522 1 2024-09-13T22:08:52.232 INFO:tasks.workunit.client.1.smithi159.stdout:7/77: dwrite d3/ff [0,4194304] 0 2024-09-13T22:08:52.232 INFO:tasks.workunit.client.1.smithi159.stdout:3/86: creat d0/d1/d3/dd/f1b x:0 0 0 2024-09-13T22:08:52.235 INFO:tasks.workunit.client.1.smithi159.stdout:3/87: creat d0/d1/d3/f1c x:0 0 0 2024-09-13T22:08:52.236 INFO:tasks.workunit.client.1.smithi159.stdout:3/88: mknod d0/d1/c1d 0 2024-09-13T22:08:52.236 INFO:tasks.workunit.client.1.smithi159.stdout:3/89: readlink d0/l16 0 2024-09-13T22:08:52.237 INFO:tasks.workunit.client.1.smithi159.stdout:5/24: dread d1/f5 [0,4194304] 0 2024-09-13T22:08:52.237 INFO:tasks.workunit.client.1.smithi159.stdout:5/25: getdents d1 0 2024-09-13T22:08:52.237 INFO:tasks.workunit.client.1.smithi159.stdout:5/26: chown l0 1838931 1 2024-09-13T22:08:52.238 INFO:tasks.workunit.client.1.smithi159.stdout:5/27: rename l0 to d1/l6 0 2024-09-13T22:08:52.238 INFO:tasks.workunit.client.1.smithi159.stdout:5/28: chown d1/f5 88966 1 2024-09-13T22:08:52.238 INFO:tasks.workunit.client.1.smithi159.stdout:0/155: write d0/d7/d22/fb [2578096,111548] 0 2024-09-13T22:08:52.239 INFO:tasks.workunit.client.1.smithi159.stdout:5/29: symlink d1/l7 0 2024-09-13T22:08:52.239 INFO:tasks.workunit.client.1.smithi159.stdout:6/50: getdents d3/da 0 2024-09-13T22:08:52.239 INFO:tasks.workunit.client.1.smithi159.stdout:6/51: fdatasync d3/da/de/f11 0 2024-09-13T22:08:52.239 INFO:tasks.workunit.client.1.smithi159.stdout:6/52: chown d3/da 1341310 1 2024-09-13T22:08:52.241 INFO:tasks.workunit.client.1.smithi159.stdout:4/26: dread f2 [0,4194304] 0 2024-09-13T22:08:52.246 INFO:tasks.workunit.client.1.smithi159.stdout:5/30: read d1/f4 [3920293,90202] 0 2024-09-13T22:08:52.249 INFO:tasks.workunit.client.1.smithi159.stdout:5/31: rename d1/f4 to d1/f8 0 2024-09-13T22:08:52.253 INFO:tasks.workunit.client.1.smithi159.stdout:6/53: write d3/da/de/ff [1133723,68901] 0 2024-09-13T22:08:52.253 INFO:tasks.workunit.client.1.smithi159.stdout:6/54: chown d3/da/cb 118851 1 2024-09-13T22:08:52.253 INFO:tasks.workunit.client.1.smithi159.stdout:4/27: dread f2 [0,4194304] 0 2024-09-13T22:08:52.253 INFO:tasks.workunit.client.1.smithi159.stdout:6/55: creat d3/da/de/f12 x:0 0 0 2024-09-13T22:08:52.257 INFO:tasks.workunit.client.1.smithi159.stdout:4/28: symlink l5 0 2024-09-13T22:08:52.257 INFO:tasks.workunit.client.1.smithi159.stdout:3/90: dwrite d0/d1/f2 [0,4194304] 0 2024-09-13T22:08:52.257 INFO:tasks.workunit.client.1.smithi159.stdout:3/91: chown d0/d1/d3 195 1 2024-09-13T22:08:52.257 INFO:tasks.workunit.client.1.smithi159.stdout:6/56: rmdir d3/dc 0 2024-09-13T22:08:52.259 INFO:tasks.workunit.client.1.smithi159.stdout:4/29: rename c1 to c6 0 2024-09-13T22:08:52.260 INFO:tasks.workunit.client.1.smithi159.stdout:6/57: mknod d3/da/de/c13 0 2024-09-13T22:08:52.261 INFO:tasks.workunit.client.1.smithi159.stdout:4/30: symlink l7 0 2024-09-13T22:08:52.262 INFO:tasks.workunit.client.1.smithi159.stdout:6/58: symlink d3/l14 0 2024-09-13T22:08:52.262 INFO:tasks.workunit.client.1.smithi159.stdout:6/59: creat d3/da/de/f15 x:0 0 0 2024-09-13T22:08:52.266 INFO:tasks.workunit.client.1.smithi159.stdout:4/31: read f2 [3856563,28509] 0 2024-09-13T22:08:52.266 INFO:tasks.workunit.client.1.smithi159.stdout:4/32: creat f8 x:0 0 0 2024-09-13T22:08:52.266 INFO:tasks.workunit.client.1.smithi159.stdout:6/60: write d3/da/de/ff [1541852,41814] 0 2024-09-13T22:08:52.269 INFO:tasks.workunit.client.1.smithi159.stdout:6/61: creat d3/da/f16 x:0 0 0 2024-09-13T22:08:52.290 INFO:tasks.workunit.client.1.smithi159.stdout:4/33: dwrite f2 [0,4194304] 0 2024-09-13T22:08:52.290 INFO:tasks.workunit.client.1.smithi159.stdout:4/34: dread - f8 zero size 2024-09-13T22:08:52.292 INFO:tasks.workunit.client.1.smithi159.stdout:4/35: link f2 f9 0 2024-09-13T22:08:52.292 INFO:tasks.workunit.client.1.smithi159.stdout:4/36: rmdir - no directory 2024-09-13T22:08:52.294 INFO:tasks.workunit.client.1.smithi159.stdout:4/37: mknod ca 0 2024-09-13T22:08:52.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/38: mknod cb 0 2024-09-13T22:08:52.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/39: creat fc x:0 0 0 2024-09-13T22:08:52.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/40: stat l3 0 2024-09-13T22:08:52.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/41: dread - f8 zero size 2024-09-13T22:08:52.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/42: fdatasync f2 0 2024-09-13T22:08:52.424 INFO:tasks.workunit.client.1.smithi159.stdout:2/16: sync 2024-09-13T22:08:52.424 INFO:tasks.workunit.client.1.smithi159.stdout:2/17: write - no filename 2024-09-13T22:08:52.424 INFO:tasks.workunit.client.1.smithi159.stdout:2/18: fsync - no filename 2024-09-13T22:08:52.424 INFO:tasks.workunit.client.1.smithi159.stdout:2/19: write - no filename 2024-09-13T22:08:52.424 INFO:tasks.workunit.client.1.smithi159.stdout:2/20: write - no filename 2024-09-13T22:08:52.424 INFO:tasks.workunit.client.1.smithi159.stdout:2/21: rename - no filename 2024-09-13T22:08:52.424 INFO:tasks.workunit.client.1.smithi159.stdout:2/22: write - no filename 2024-09-13T22:08:52.425 INFO:tasks.workunit.client.1.smithi159.stdout:2/23: readlink - no filename 2024-09-13T22:08:52.425 INFO:tasks.workunit.client.1.smithi159.stdout:2/24: truncate - no filename 2024-09-13T22:08:52.425 INFO:tasks.workunit.client.1.smithi159.stdout:2/25: truncate - no filename 2024-09-13T22:08:52.425 INFO:tasks.workunit.client.1.smithi159.stdout:2/26: read - no filename 2024-09-13T22:08:52.425 INFO:tasks.workunit.client.1.smithi159.stdout:2/27: dwrite - no filename 2024-09-13T22:08:52.426 INFO:tasks.workunit.client.1.smithi159.stdout:2/28: creat f2 x:0 0 0 2024-09-13T22:08:52.426 INFO:tasks.workunit.client.1.smithi159.stdout:2/29: creat f3 x:0 0 0 2024-09-13T22:08:52.426 INFO:tasks.workunit.client.1.smithi159.stdout:2/30: creat f4 x:0 0 0 2024-09-13T22:08:52.426 INFO:tasks.workunit.client.1.smithi159.stdout:2/31: write f4 [203013,89563] 0 2024-09-13T22:08:52.428 INFO:tasks.workunit.client.1.smithi159.stdout:2/32: unlink f2 0 2024-09-13T22:08:52.429 INFO:tasks.workunit.client.1.smithi159.stdout:2/33: rename f3 to f5 0 2024-09-13T22:08:52.447 INFO:tasks.workunit.client.1.smithi159.stdout:2/34: dwrite f4 [0,4194304] 0 2024-09-13T22:08:52.451 INFO:tasks.workunit.client.1.smithi159.stdout:2/35: rename f4 to f6 0 2024-09-13T22:08:52.454 INFO:tasks.workunit.client.1.smithi159.stdout:2/36: link f5 f7 0 2024-09-13T22:08:52.457 INFO:tasks.workunit.client.1.smithi159.stdout:2/37: symlink l8 0 2024-09-13T22:08:52.466 INFO:tasks.workunit.client.1.smithi159.stdout:2/38: write f6 [22400,37491] 0 2024-09-13T22:08:52.467 INFO:tasks.workunit.client.1.smithi159.stdout:2/39: mkdir d9 0 2024-09-13T22:08:52.468 INFO:tasks.workunit.client.1.smithi159.stdout:2/40: mkdir d9/da 0 2024-09-13T22:08:52.468 INFO:tasks.workunit.client.1.smithi159.stdout:2/41: symlink d9/da/lb 0 2024-09-13T22:08:52.469 INFO:tasks.workunit.client.1.smithi159.stdout:2/42: rename d9/da/lb to d9/da/lc 0 2024-09-13T22:08:52.483 INFO:tasks.workunit.client.1.smithi159.stdout:2/43: dwrite f5 [0,4194304] 0 2024-09-13T22:08:52.486 INFO:tasks.workunit.client.1.smithi159.stdout:2/44: creat d9/fd x:0 0 0 2024-09-13T22:08:52.486 INFO:tasks.workunit.client.1.smithi159.stdout:2/45: creat d9/fe x:0 0 0 2024-09-13T22:08:52.488 INFO:tasks.workunit.client.1.smithi159.stdout:2/46: mknod d9/da/cf 0 2024-09-13T22:08:52.489 INFO:tasks.workunit.client.1.smithi159.stdout:2/47: mknod d9/c10 0 2024-09-13T22:08:52.490 INFO:tasks.workunit.client.1.smithi159.stdout:2/48: creat d9/f11 x:0 0 0 2024-09-13T22:08:52.497 INFO:tasks.workunit.client.1.smithi159.stdout:2/49: getdents d9/da 0 2024-09-13T22:08:52.514 INFO:tasks.workunit.client.1.smithi159.stdout:2/50: dwrite d9/fd [0,4194304] 0 2024-09-13T22:08:52.518 INFO:tasks.workunit.client.1.smithi159.stdout:2/51: mknod d9/c12 0 2024-09-13T22:08:52.524 INFO:tasks.workunit.client.1.smithi159.stdout:2/52: getdents d9 0 2024-09-13T22:08:52.526 INFO:tasks.workunit.client.1.smithi159.stdout:2/53: mknod d9/c13 0 2024-09-13T22:08:52.529 INFO:tasks.workunit.client.1.smithi159.stdout:2/54: rmdir d9 39 2024-09-13T22:08:52.544 INFO:tasks.workunit.client.1.smithi159.stdout:2/55: write d9/fd [3709302,121890] 0 2024-09-13T22:08:52.547 INFO:tasks.workunit.client.1.smithi159.stdout:2/56: creat d9/da/f14 x:0 0 0 2024-09-13T22:08:52.552 INFO:tasks.workunit.client.1.smithi159.stdout:2/57: link d9/c13 d9/da/c15 0 2024-09-13T22:08:52.556 INFO:tasks.workunit.client.1.smithi159.stdout:2/58: symlink d9/l16 0 2024-09-13T22:08:52.559 INFO:tasks.workunit.client.1.smithi159.stdout:2/59: dread - d9/fe zero size 2024-09-13T22:08:52.561 INFO:tasks.workunit.client.1.smithi159.stdout:2/60: rmdir d9 39 2024-09-13T22:08:52.566 INFO:tasks.workunit.client.1.smithi159.stdout:2/61: getdents d9 0 2024-09-13T22:08:52.574 INFO:tasks.workunit.client.1.smithi159.stdout:2/62: dread f6 [0,4194304] 0 2024-09-13T22:08:52.907 INFO:tasks.workunit.client.1.smithi159.stdout:8/34: sync 2024-09-13T22:08:52.907 INFO:tasks.workunit.client.1.smithi159.stdout:9/19: sync 2024-09-13T22:08:52.911 INFO:tasks.workunit.client.1.smithi159.stdout:9/20: creat d1/d4/f8 x:0 0 0 2024-09-13T22:08:52.911 INFO:tasks.workunit.client.1.smithi159.stdout:9/21: mkdir d1/d9 0 2024-09-13T22:08:52.911 INFO:tasks.workunit.client.1.smithi159.stdout:9/22: read - d1/d4/f8 zero size 2024-09-13T22:08:52.932 INFO:tasks.workunit.client.1.smithi159.stdout:9/23: dwrite d1/d4/f8 [0,4194304] 0 2024-09-13T22:08:52.945 INFO:tasks.workunit.client.1.smithi159.stdout:9/24: dread d1/d4/f8 [0,4194304] 0 2024-09-13T22:08:52.950 INFO:tasks.workunit.client.1.smithi159.stdout:9/25: dread d1/d4/f8 [0,4194304] 0 2024-09-13T22:08:52.950 INFO:tasks.workunit.client.1.smithi159.stdout:9/26: fdatasync d1/d4/f8 0 2024-09-13T22:08:52.956 INFO:tasks.workunit.client.1.smithi159.stdout:9/27: symlink d1/la 0 2024-09-13T22:08:52.956 INFO:tasks.workunit.client.1.smithi159.stdout:9/28: creat d1/d4/fb x:0 0 0 2024-09-13T22:08:52.977 INFO:tasks.workunit.client.1.smithi159.stdout:9/29: rename d1/d4 to d1/dc 0 2024-09-13T22:08:52.978 INFO:tasks.workunit.client.1.smithi159.stdout:9/30: mknod d1/dc/cd 0 2024-09-13T22:08:52.979 INFO:tasks.workunit.client.1.smithi159.stdout:9/31: creat d1/fe x:0 0 0 2024-09-13T22:08:52.982 INFO:tasks.workunit.client.1.smithi159.stdout:9/32: rename d1/dc/f8 to d1/d9/ff 0 2024-09-13T22:08:52.998 INFO:tasks.workunit.client.1.smithi159.stdout:9/33: getdents d1 0 2024-09-13T22:08:52.998 INFO:tasks.workunit.client.1.smithi159.stdout:9/34: chown d1/la 23147733 1 2024-09-13T22:08:52.998 INFO:tasks.workunit.client.1.smithi159.stdout:9/35: read - d1/dc/fb zero size 2024-09-13T22:08:53.003 INFO:tasks.workunit.client.1.smithi159.stdout:9/36: write d1/d9/ff [182673,114347] 0 2024-09-13T22:08:53.003 INFO:tasks.workunit.client.1.smithi159.stdout:9/37: readlink d1/l3 0 2024-09-13T22:08:53.003 INFO:tasks.workunit.client.1.smithi159.stdout:9/38: write d1/fe [72089,50879] 0 2024-09-13T22:08:53.004 INFO:tasks.workunit.client.1.smithi159.stdout:9/39: mkdir d1/dc/d10 0 2024-09-13T22:08:53.005 INFO:tasks.workunit.client.1.smithi159.stdout:9/40: symlink d1/dc/d10/l11 0 2024-09-13T22:08:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:52 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:52 smithi159 ceph-mon[35348]: pgmap v258: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 227 MiB/s rd, 290 MiB/s wr, 481 op/s 2024-09-13T22:08:53.012 INFO:tasks.workunit.client.1.smithi159.stdout:0/156: sync 2024-09-13T22:08:53.012 INFO:tasks.workunit.client.1.smithi159.stdout:7/78: sync 2024-09-13T22:08:53.012 INFO:tasks.workunit.client.1.smithi159.stdout:0/157: chown d0/d2c/l2d 3832738 1 2024-09-13T22:08:53.013 INFO:tasks.workunit.client.1.smithi159.stdout:7/79: fdatasync d3/ff 0 2024-09-13T22:08:53.013 INFO:tasks.workunit.client.1.smithi159.stdout:0/158: creat d0/d2c/f37 x:0 0 0 2024-09-13T22:08:53.013 INFO:tasks.workunit.client.1.smithi159.stdout:1/51: sync 2024-09-13T22:08:53.017 INFO:tasks.workunit.client.1.smithi159.stdout:1/52: dread f3 [0,4194304] 0 2024-09-13T22:08:53.021 INFO:tasks.workunit.client.1.smithi159.stdout:0/159: dread d0/d7/d22/d2b/f2f [0,4194304] 0 2024-09-13T22:08:53.021 INFO:tasks.workunit.client.1.smithi159.stdout:0/160: chown d0/f8 14062223 1 2024-09-13T22:08:53.024 INFO:tasks.workunit.client.1.smithi159.stdout:0/161: rmdir d0/d7 39 2024-09-13T22:08:53.024 INFO:tasks.workunit.client.1.smithi159.stdout:0/162: truncate d0/d7/f27 234124 0 2024-09-13T22:08:53.024 INFO:tasks.workunit.client.1.smithi159.stdout:0/163: stat d0/d7/d22/f35 0 2024-09-13T22:08:53.029 INFO:tasks.workunit.client.1.smithi159.stdout:0/164: write d0/d7/d22/d2b/f2f [2510803,112719] 0 2024-09-13T22:08:53.030 INFO:tasks.workunit.client.1.smithi159.stdout:9/41: truncate d1/d9/ff 3919368 0 2024-09-13T22:08:53.033 INFO:tasks.workunit.client.1.smithi159.stdout:9/42: creat d1/dc/f12 x:0 0 0 2024-09-13T22:08:53.033 INFO:tasks.workunit.client.1.smithi159.stdout:7/80: dwrite d3/f10 [0,4194304] 0 2024-09-13T22:08:53.033 INFO:tasks.workunit.client.1.smithi159.stdout:9/43: write d1/fe [751932,66959] 0 2024-09-13T22:08:53.033 INFO:tasks.workunit.client.1.smithi159.stdout:9/44: readlink d1/dc/d10/l11 0 2024-09-13T22:08:53.033 INFO:tasks.workunit.client.1.smithi159.stdout:9/45: creat d1/dc/f13 x:0 0 0 2024-09-13T22:08:53.033 INFO:tasks.workunit.client.1.smithi159.stdout:9/46: stat d1/fe 0 2024-09-13T22:08:53.039 INFO:tasks.workunit.client.1.smithi159.stdout:7/81: mkdir d3/d18 0 2024-09-13T22:08:53.040 INFO:tasks.workunit.client.1.smithi159.stdout:7/82: truncate d3/f9 702083 0 2024-09-13T22:08:53.040 INFO:tasks.workunit.client.1.smithi159.stdout:0/165: fsync d0/d2c/f37 0 2024-09-13T22:08:53.040 INFO:tasks.workunit.client.1.smithi159.stdout:7/83: mknod d3/d18/c19 0 2024-09-13T22:08:53.040 INFO:tasks.workunit.client.1.smithi159.stdout:7/84: stat d3/d18 0 2024-09-13T22:08:53.043 INFO:tasks.workunit.client.1.smithi159.stdout:7/85: link d3/f14 d3/f1a 0 2024-09-13T22:08:53.043 INFO:tasks.workunit.client.1.smithi159.stdout:7/86: chown d3/f9 100 1 2024-09-13T22:08:53.043 INFO:tasks.workunit.client.1.smithi159.stdout:7/87: chown d3/fe 118625 1 2024-09-13T22:08:53.056 INFO:tasks.workunit.client.1.smithi159.stdout:7/88: dread d3/f10 [0,4194304] 0 2024-09-13T22:08:53.057 INFO:tasks.workunit.client.1.smithi159.stdout:9/47: dwrite d1/dc/fb [0,4194304] 0 2024-09-13T22:08:53.057 INFO:tasks.workunit.client.1.smithi159.stdout:9/48: chown d1/dc/d10 46984 1 2024-09-13T22:08:53.058 INFO:tasks.workunit.client.1.smithi159.stdout:0/166: dwrite d0/d7/f9 [0,4194304] 0 2024-09-13T22:08:53.058 INFO:tasks.workunit.client.1.smithi159.stdout:0/167: write d0/f8 [476474,118680] 0 2024-09-13T22:08:53.069 INFO:tasks.workunit.client.1.smithi159.stdout:7/89: link d3/l8 d3/d18/l1b 0 2024-09-13T22:08:53.069 INFO:tasks.workunit.client.1.smithi159.stdout:7/90: write d3/f11 [291512,50292] 0 2024-09-13T22:08:53.069 INFO:tasks.workunit.client.1.smithi159.stdout:7/91: chown d3/f14 226972 1 2024-09-13T22:08:53.069 INFO:tasks.workunit.client.1.smithi159.stdout:7/92: chown d3/f10 18 1 2024-09-13T22:08:53.069 INFO:tasks.workunit.client.1.smithi159.stdout:0/168: stat d0/d7/d22/c1f 0 2024-09-13T22:08:53.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/93: creat d3/f1c x:0 0 0 2024-09-13T22:08:53.071 INFO:tasks.workunit.client.1.smithi159.stdout:7/94: write d3/f9 [76041,127611] 0 2024-09-13T22:08:53.071 INFO:tasks.workunit.client.1.smithi159.stdout:9/49: dwrite d1/dc/fb [0,4194304] 0 2024-09-13T22:08:53.071 INFO:tasks.workunit.client.1.smithi159.stdout:9/50: dread - d1/dc/f12 zero size 2024-09-13T22:08:53.072 INFO:tasks.workunit.client.1.smithi159.stdout:0/169: mknod d0/d7/c38 0 2024-09-13T22:08:53.072 INFO:tasks.workunit.client.1.smithi159.stdout:0/170: truncate d0/f26 706069 0 2024-09-13T22:08:53.072 INFO:tasks.workunit.client.1.smithi159.stdout:0/171: chown d0/f8 2479 1 2024-09-13T22:08:53.073 INFO:tasks.workunit.client.1.smithi159.stdout:7/95: rename d3/f10 to d3/d18/f1d 0 2024-09-13T22:08:53.073 INFO:tasks.workunit.client.1.smithi159.stdout:7/96: write d3/f16 [131595,117038] 0 2024-09-13T22:08:53.075 INFO:tasks.workunit.client.1.smithi159.stdout:9/51: creat d1/dc/d10/f14 x:0 0 0 2024-09-13T22:08:53.078 INFO:tasks.workunit.client.1.smithi159.stdout:7/97: creat d3/f1e x:0 0 0 2024-09-13T22:08:53.078 INFO:tasks.workunit.client.1.smithi159.stdout:0/172: getdents d0/d7/d22 0 2024-09-13T22:08:53.078 INFO:tasks.workunit.client.1.smithi159.stdout:0/173: write d0/d7/d22/fb [755629,96455] 0 2024-09-13T22:08:53.082 INFO:tasks.workunit.client.1.smithi159.stdout:0/174: mknod d0/d7/d22/d2b/c39 0 2024-09-13T22:08:53.082 INFO:tasks.workunit.client.1.smithi159.stdout:0/175: dread - d0/d7/f19 zero size 2024-09-13T22:08:53.085 INFO:tasks.workunit.client.1.smithi159.stdout:9/52: dread d1/d9/ff [0,4194304] 0 2024-09-13T22:08:53.085 INFO:tasks.workunit.client.1.smithi159.stdout:9/53: stat d1/dc/d10/l11 0 2024-09-13T22:08:53.088 INFO:tasks.workunit.client.1.smithi159.stdout:9/54: symlink d1/dc/l15 0 2024-09-13T22:08:53.092 INFO:tasks.workunit.client.1.smithi159.stdout:7/98: dwrite d3/fe [0,4194304] 0 2024-09-13T22:08:53.094 INFO:tasks.workunit.client.1.smithi159.stdout:7/99: creat d3/f1f x:0 0 0 2024-09-13T22:08:53.094 INFO:tasks.workunit.client.1.smithi159.stdout:7/100: write d3/f12 [304004,35153] 0 2024-09-13T22:08:53.095 INFO:tasks.workunit.client.1.smithi159.stdout:7/101: write d3/f11 [643400,36611] 0 2024-09-13T22:08:53.097 INFO:tasks.workunit.client.1.smithi159.stdout:0/176: truncate d0/f26 246693 0 2024-09-13T22:08:53.100 INFO:tasks.workunit.client.1.smithi159.stdout:0/177: symlink d0/d7/d22/l3a 0 2024-09-13T22:08:53.109 INFO:tasks.workunit.client.1.smithi159.stdout:9/55: dwrite d1/d9/ff [0,4194304] 0 2024-09-13T22:08:53.109 INFO:tasks.workunit.client.1.smithi159.stdout:9/56: truncate d1/dc/fb 4663173 0 2024-09-13T22:08:53.110 INFO:tasks.workunit.client.1.smithi159.stdout:9/57: rmdir d1/dc/d10 39 2024-09-13T22:08:53.111 INFO:tasks.workunit.client.1.smithi159.stdout:9/58: mknod d1/dc/d10/c16 0 2024-09-13T22:08:53.112 INFO:tasks.workunit.client.1.smithi159.stdout:9/59: creat d1/dc/d10/f17 x:0 0 0 2024-09-13T22:08:53.112 INFO:tasks.workunit.client.1.smithi159.stdout:9/60: truncate d1/dc/f13 591589 0 2024-09-13T22:08:53.113 INFO:tasks.workunit.client.1.smithi159.stdout:9/61: creat d1/d9/f18 x:0 0 0 2024-09-13T22:08:53.113 INFO:tasks.workunit.client.1.smithi159.stdout:9/62: truncate d1/dc/d10/f17 757076 0 2024-09-13T22:08:53.120 INFO:tasks.workunit.client.1.smithi159.stdout:7/102: dwrite d3/f11 [0,4194304] 0 2024-09-13T22:08:53.121 INFO:tasks.workunit.client.1.smithi159.stdout:7/103: creat d3/d18/f20 x:0 0 0 2024-09-13T22:08:53.122 INFO:tasks.workunit.client.1.smithi159.stdout:0/178: dwrite d0/d7/f1a [0,4194304] 0 2024-09-13T22:08:53.122 INFO:tasks.workunit.client.1.smithi159.stdout:0/179: creat d0/d7/d22/d2b/f3b x:0 0 0 2024-09-13T22:08:53.124 INFO:tasks.workunit.client.1.smithi159.stdout:0/180: fsync d0/f8 0 2024-09-13T22:08:53.124 INFO:tasks.workunit.client.1.smithi159.stdout:0/181: creat d0/d2c/f3c x:0 0 0 2024-09-13T22:08:53.130 INFO:tasks.workunit.client.1.smithi159.stdout:0/182: symlink d0/d2c/l3d 0 2024-09-13T22:08:53.130 INFO:tasks.workunit.client.1.smithi159.stdout:0/183: chown d0/d7/f27 32408716 1 2024-09-13T22:08:53.130 INFO:tasks.workunit.client.1.smithi159.stdout:0/184: chown d0/f26 8246892 1 2024-09-13T22:08:53.130 INFO:tasks.workunit.client.1.smithi159.stdout:0/185: chown d0/d2c/l3d 14 1 2024-09-13T22:08:53.135 INFO:tasks.workunit.client.1.smithi159.stdout:9/63: rmdir d1/dc/d10 39 2024-09-13T22:08:53.143 INFO:tasks.workunit.client.1.smithi159.stdout:0/186: dread d0/d7/d22/fd [0,4194304] 0 2024-09-13T22:08:53.143 INFO:tasks.workunit.client.1.smithi159.stdout:7/104: dwrite d3/f1a [0,4194304] 0 2024-09-13T22:08:53.145 INFO:tasks.workunit.client.1.smithi159.stdout:0/187: creat d0/f3e x:0 0 0 2024-09-13T22:08:53.146 INFO:tasks.workunit.client.1.smithi159.stdout:0/188: creat d0/d7/f3f x:0 0 0 2024-09-13T22:08:53.147 INFO:tasks.workunit.client.1.smithi159.stdout:7/105: getdents d3 0 2024-09-13T22:08:53.148 INFO:tasks.workunit.client.1.smithi159.stdout:0/189: stat d0/l24 0 2024-09-13T22:08:53.149 INFO:tasks.workunit.client.1.smithi159.stdout:0/190: symlink d0/d7/d22/l40 0 2024-09-13T22:08:53.150 INFO:tasks.workunit.client.1.smithi159.stdout:0/191: truncate d0/d7/f1a 3226009 0 2024-09-13T22:08:53.155 INFO:tasks.workunit.client.1.smithi159.stdout:9/64: dwrite d1/dc/f13 [0,4194304] 0 2024-09-13T22:08:53.158 INFO:tasks.workunit.client.1.smithi159.stdout:9/65: mknod d1/d9/c19 0 2024-09-13T22:08:53.158 INFO:tasks.workunit.client.1.smithi159.stdout:9/66: truncate d1/d9/f18 573693 0 2024-09-13T22:08:53.160 INFO:tasks.workunit.client.1.smithi159.stdout:0/192: read d0/d7/f9 [2414776,115539] 0 2024-09-13T22:08:53.164 INFO:tasks.workunit.client.1.smithi159.stdout:0/193: rename d0/d7/c20 to d0/d7/d22/d2b/c41 0 2024-09-13T22:08:53.166 INFO:tasks.workunit.client.1.smithi159.stdout:0/194: symlink d0/d2c/l42 0 2024-09-13T22:08:53.170 INFO:tasks.workunit.client.1.smithi159.stdout:0/195: link d0/d7/f1a d0/d2c/f43 0 2024-09-13T22:08:53.173 INFO:tasks.workunit.client.1.smithi159.stdout:9/67: dwrite d1/dc/f13 [0,4194304] 0 2024-09-13T22:08:53.177 INFO:tasks.workunit.client.1.smithi159.stdout:9/68: mknod d1/dc/c1a 0 2024-09-13T22:08:53.179 INFO:tasks.workunit.client.1.smithi159.stdout:9/69: symlink d1/d9/l1b 0 2024-09-13T22:08:53.179 INFO:tasks.workunit.client.1.smithi159.stdout:9/70: write d1/dc/d10/f17 [319485,122343] 0 2024-09-13T22:08:53.188 INFO:tasks.workunit.client.1.smithi159.stdout:9/71: write d1/dc/fb [678450,112897] 0 2024-09-13T22:08:53.189 INFO:tasks.workunit.client.1.smithi159.stdout:9/72: creat d1/f1c x:0 0 0 2024-09-13T22:08:53.190 INFO:tasks.workunit.client.1.smithi159.stdout:0/196: dwrite d0/d7/d22/d2b/f3b [0,4194304] 0 2024-09-13T22:08:53.191 INFO:tasks.workunit.client.1.smithi159.stdout:9/73: rmdir d1/d9 39 2024-09-13T22:08:53.194 INFO:tasks.workunit.client.1.smithi159.stdout:9/74: rename d1/dc/c6 to d1/dc/d10/c1d 0 2024-09-13T22:08:53.195 INFO:tasks.workunit.client.1.smithi159.stdout:9/75: dread - d1/dc/f12 zero size 2024-09-13T22:08:53.196 INFO:tasks.workunit.client.1.smithi159.stdout:9/76: symlink d1/d9/l1e 0 2024-09-13T22:08:53.196 INFO:tasks.workunit.client.1.smithi159.stdout:9/77: chown d1/dc/cd 0 1 2024-09-13T22:08:53.197 INFO:tasks.workunit.client.1.smithi159.stdout:9/78: mkdir d1/d9/d1f 0 2024-09-13T22:08:53.199 INFO:tasks.workunit.client.1.smithi159.stdout:9/79: mknod d1/d9/d1f/c20 0 2024-09-13T22:08:53.199 INFO:tasks.workunit.client.1.smithi159.stdout:9/80: chown d1/dc/cd 1561679705 1 2024-09-13T22:08:53.200 INFO:tasks.workunit.client.1.smithi159.stdout:9/81: mknod d1/d9/c21 0 2024-09-13T22:08:53.201 INFO:tasks.workunit.client.1.smithi159.stdout:9/82: fsync d1/d9/f18 0 2024-09-13T22:08:53.201 INFO:tasks.workunit.client.1.smithi159.stdout:9/83: dread - d1/f1c zero size 2024-09-13T22:08:53.201 INFO:tasks.workunit.client.1.smithi159.stdout:9/84: write d1/d9/f18 [798302,85346] 0 2024-09-13T22:08:53.213 INFO:tasks.workunit.client.1.smithi159.stdout:0/197: dwrite d0/d7/d22/d2b/f3b [0,4194304] 0 2024-09-13T22:08:53.213 INFO:tasks.workunit.client.1.smithi159.stdout:0/198: creat d0/d7/f44 x:0 0 0 2024-09-13T22:08:53.213 INFO:tasks.workunit.client.1.smithi159.stdout:0/199: chown d0/f16 6803 1 2024-09-13T22:08:53.217 INFO:tasks.workunit.client.1.smithi159.stdout:9/85: dwrite d1/dc/f12 [0,4194304] 0 2024-09-13T22:08:53.218 INFO:tasks.workunit.client.1.smithi159.stdout:9/86: stat d1/dc/d10/f14 0 2024-09-13T22:08:53.222 INFO:tasks.workunit.client.1.smithi159.stdout:9/87: unlink d1/d9/c19 0 2024-09-13T22:08:53.222 INFO:tasks.workunit.client.1.smithi159.stdout:9/88: truncate d1/d9/f18 1232723 0 2024-09-13T22:08:53.223 INFO:tasks.workunit.client.1.smithi159.stdout:9/89: rename d1/dc/d10/c16 to d1/dc/c22 0 2024-09-13T22:08:53.226 INFO:tasks.workunit.client.1.smithi159.stdout:0/200: dwrite d0/d7/d22/f35 [0,4194304] 0 2024-09-13T22:08:53.226 INFO:tasks.workunit.client.1.smithi159.stdout:0/201: write d0/f3e [332536,6430] 0 2024-09-13T22:08:53.226 INFO:tasks.workunit.client.1.smithi159.stdout:0/202: readlink d0/d2c/l42 0 2024-09-13T22:08:53.226 INFO:tasks.workunit.client.1.smithi159.stdout:0/203: write d0/d2c/f36 [532665,112001] 0 2024-09-13T22:08:53.230 INFO:tasks.workunit.client.1.smithi159.stdout:0/204: rename d0/d7/d22/f25 to d0/f45 0 2024-09-13T22:08:53.242 INFO:tasks.workunit.client.1.smithi159.stdout:9/90: dwrite d1/dc/fb [0,4194304] 0 2024-09-13T22:08:53.243 INFO:tasks.workunit.client.1.smithi159.stdout:9/91: fsync d1/d9/f18 0 2024-09-13T22:08:53.243 INFO:tasks.workunit.client.1.smithi159.stdout:9/92: dread - d1/f1c zero size 2024-09-13T22:08:53.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:53.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:52 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:08:53.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:52 smithi089 ceph-mon[27921]: pgmap v258: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 227 MiB/s rd, 290 MiB/s wr, 481 op/s 2024-09-13T22:08:53.247 INFO:tasks.workunit.client.1.smithi159.stdout:0/205: rmdir d0 39 2024-09-13T22:08:53.247 INFO:tasks.workunit.client.1.smithi159.stdout:0/206: dread - d0/d2c/f3c zero size 2024-09-13T22:08:53.247 INFO:tasks.workunit.client.1.smithi159.stdout:0/207: readlink d0/d7/l23 0 2024-09-13T22:08:53.251 INFO:tasks.workunit.client.1.smithi159.stdout:9/93: symlink d1/dc/l23 0 2024-09-13T22:08:53.259 INFO:tasks.workunit.client.1.smithi159.stdout:9/94: dread d1/dc/f12 [0,4194304] 0 2024-09-13T22:08:53.260 INFO:tasks.workunit.client.1.smithi159.stdout:9/95: dread - d1/f1c zero size 2024-09-13T22:08:53.260 INFO:tasks.workunit.client.1.smithi159.stdout:9/96: rename d1/dc/c22 to d1/d9/d1f/c24 0 2024-09-13T22:08:53.262 INFO:tasks.workunit.client.1.smithi159.stdout:9/97: mknod d1/d9/c25 0 2024-09-13T22:08:53.262 INFO:tasks.workunit.client.1.smithi159.stdout:9/98: chown d1/dc/d10/f17 0 1 2024-09-13T22:08:53.262 INFO:tasks.workunit.client.1.smithi159.stdout:0/208: dwrite d0/d7/d22/f35 [0,4194304] 0 2024-09-13T22:08:53.262 INFO:tasks.workunit.client.1.smithi159.stdout:0/209: chown d0/d7/d22/c1f 31 1 2024-09-13T22:08:53.263 INFO:tasks.workunit.client.1.smithi159.stdout:9/99: mkdir d1/d9/d1f/d26 0 2024-09-13T22:08:53.263 INFO:tasks.workunit.client.1.smithi159.stdout:9/100: chown d1/d9/l1b 3 1 2024-09-13T22:08:53.263 INFO:tasks.workunit.client.1.smithi159.stdout:9/101: fdatasync d1/dc/f13 0 2024-09-13T22:08:53.271 INFO:tasks.workunit.client.1.smithi159.stdout:9/102: dread d1/dc/fb [0,4194304] 0 2024-09-13T22:08:53.272 INFO:tasks.workunit.client.1.smithi159.stdout:9/103: mkdir d1/dc/d27 0 2024-09-13T22:08:53.273 INFO:tasks.workunit.client.1.smithi159.stdout:9/104: chown d1/fe 16072872 1 2024-09-13T22:08:53.273 INFO:tasks.workunit.client.1.smithi159.stdout:0/210: write d0/d7/f1e [1478694,82899] 0 2024-09-13T22:08:53.274 INFO:tasks.workunit.client.1.smithi159.stdout:0/211: creat d0/d7/d22/f46 x:0 0 0 2024-09-13T22:08:53.275 INFO:tasks.workunit.client.1.smithi159.stdout:0/212: readlink d0/d7/l23 0 2024-09-13T22:08:53.275 INFO:tasks.workunit.client.1.smithi159.stdout:9/105: dread d1/fe [0,4194304] 0 2024-09-13T22:08:53.275 INFO:tasks.workunit.client.1.smithi159.stdout:9/106: chown d1/dc/d10 171 1 2024-09-13T22:08:53.275 INFO:tasks.workunit.client.1.smithi159.stdout:9/107: chown d1/d9/l1e 3195242 1 2024-09-13T22:08:53.277 INFO:tasks.workunit.client.1.smithi159.stdout:9/108: rename d1/dc/l5 to d1/dc/d10/l28 0 2024-09-13T22:08:53.278 INFO:tasks.workunit.client.1.smithi159.stdout:9/109: rmdir d1/dc/d10 39 2024-09-13T22:08:53.280 INFO:tasks.workunit.client.1.smithi159.stdout:9/110: link d1/dc/d10/c1d d1/dc/c29 0 2024-09-13T22:08:53.281 INFO:tasks.workunit.client.1.smithi159.stdout:0/213: dread d0/d7/f1e [0,4194304] 0 2024-09-13T22:08:53.281 INFO:tasks.workunit.client.1.smithi159.stdout:0/214: write d0/d7/f3f [1031224,52583] 0 2024-09-13T22:08:53.282 INFO:tasks.workunit.client.1.smithi159.stdout:9/111: mkdir d1/d9/d2a 0 2024-09-13T22:08:53.284 INFO:tasks.workunit.client.1.smithi159.stdout:0/215: mknod d0/d7/c47 0 2024-09-13T22:08:53.284 INFO:tasks.workunit.client.1.smithi159.stdout:0/216: fsync d0/d2c/f33 0 2024-09-13T22:08:53.284 INFO:tasks.workunit.client.1.smithi159.stdout:0/217: truncate d0/f10 948355 0 2024-09-13T22:08:53.284 INFO:tasks.workunit.client.1.smithi159.stdout:0/218: write d0/d7/f19 [547047,126377] 0 2024-09-13T22:08:53.285 INFO:tasks.workunit.client.1.smithi159.stdout:9/112: creat d1/d9/f2b x:0 0 0 2024-09-13T22:08:53.287 INFO:tasks.workunit.client.1.smithi159.stdout:0/219: mkdir d0/d48 0 2024-09-13T22:08:53.295 INFO:tasks.workunit.client.1.smithi159.stdout:0/220: getdents d0 0 2024-09-13T22:08:53.309 INFO:tasks.workunit.client.1.smithi159.stdout:9/113: dwrite d1/dc/fb [4194304,4194304] 0 2024-09-13T22:08:53.309 INFO:tasks.workunit.client.1.smithi159.stdout:9/114: dread - d1/d9/f2b zero size 2024-09-13T22:08:53.309 INFO:tasks.workunit.client.1.smithi159.stdout:9/115: chown d1/dc/l15 750 1 2024-09-13T22:08:53.310 INFO:tasks.workunit.client.1.smithi159.stdout:9/116: truncate d1/d9/f18 336444 0 2024-09-13T22:08:53.310 INFO:tasks.workunit.client.1.smithi159.stdout:9/117: write d1/dc/d10/f17 [842396,51799] 0 2024-09-13T22:08:53.320 INFO:tasks.workunit.client.1.smithi159.stdout:9/118: write d1/d9/ff [1423311,121725] 0 2024-09-13T22:08:53.321 INFO:tasks.workunit.client.1.smithi159.stdout:9/119: symlink d1/dc/l2c 0 2024-09-13T22:08:53.323 INFO:tasks.workunit.client.1.smithi159.stdout:9/120: mknod d1/d9/c2d 0 2024-09-13T22:08:53.325 INFO:tasks.workunit.client.1.smithi159.stdout:9/121: mknod d1/d9/d1f/c2e 0 2024-09-13T22:08:53.325 INFO:tasks.workunit.client.1.smithi159.stdout:9/122: stat d1/d9/d1f/c20 0 2024-09-13T22:08:53.348 INFO:tasks.workunit.client.1.smithi159.stdout:9/123: dwrite d1/d9/f18 [0,4194304] 0 2024-09-13T22:08:53.365 INFO:tasks.workunit.client.1.smithi159.stdout:5/32: sync 2024-09-13T22:08:53.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/124: dwrite d1/dc/d10/f14 [0,4194304] 0 2024-09-13T22:08:53.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/125: readlink d1/dc/l15 0 2024-09-13T22:08:53.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/126: chown d1/fe 35 1 2024-09-13T22:08:53.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/127: stat d1/d9/ff 0 2024-09-13T22:08:53.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/128: fdatasync d1/d9/f2b 0 2024-09-13T22:08:53.380 INFO:tasks.workunit.client.1.smithi159.stdout:5/33: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:08:53.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/129: write d1/dc/d10/f17 [1103436,121812] 0 2024-09-13T22:08:53.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/130: fsync d1/d9/f2b 0 2024-09-13T22:08:53.384 INFO:tasks.workunit.client.1.smithi159.stdout:5/34: dread d1/f5 [0,4194304] 0 2024-09-13T22:08:53.386 INFO:tasks.workunit.client.1.smithi159.stdout:9/131: mkdir d1/d9/d1f/d26/d2f 0 2024-09-13T22:08:53.386 INFO:tasks.workunit.client.1.smithi159.stdout:9/132: fdatasync d1/d9/f2b 0 2024-09-13T22:08:53.386 INFO:tasks.workunit.client.1.smithi159.stdout:9/133: chown d1/l3 1 1 2024-09-13T22:08:53.387 INFO:tasks.workunit.client.1.smithi159.stdout:9/134: chown d1/d9/d1f/d26/d2f 21687 1 2024-09-13T22:08:53.387 INFO:tasks.workunit.client.1.smithi159.stdout:9/135: creat d1/f30 x:0 0 0 2024-09-13T22:08:53.388 INFO:tasks.workunit.client.1.smithi159.stdout:9/136: mknod d1/d9/d1f/d26/c31 0 2024-09-13T22:08:53.388 INFO:tasks.workunit.client.1.smithi159.stdout:9/137: dread - d1/d9/f2b zero size 2024-09-13T22:08:53.388 INFO:tasks.workunit.client.1.smithi159.stdout:9/138: write d1/d9/ff [4882581,102495] 0 2024-09-13T22:08:53.391 INFO:tasks.workunit.client.1.smithi159.stdout:9/139: mknod d1/dc/d10/c32 0 2024-09-13T22:08:53.394 INFO:tasks.workunit.client.1.smithi159.stdout:9/140: read d1/dc/f12 [2325240,14639] 0 2024-09-13T22:08:53.394 INFO:tasks.workunit.client.1.smithi159.stdout:9/141: write d1/dc/f12 [2076897,67847] 0 2024-09-13T22:08:53.403 INFO:tasks.workunit.client.1.smithi159.stdout:9/142: truncate d1/dc/fb 7407111 0 2024-09-13T22:08:53.405 INFO:tasks.workunit.client.1.smithi159.stdout:9/143: rename d1/dc/d10/l11 to d1/dc/d27/l33 0 2024-09-13T22:08:53.425 INFO:tasks.workunit.client.1.smithi159.stdout:9/144: dwrite d1/d9/ff [0,4194304] 0 2024-09-13T22:08:53.450 INFO:tasks.workunit.client.1.smithi159.stdout:9/145: dwrite d1/dc/d10/f14 [0,4194304] 0 2024-09-13T22:08:53.459 INFO:tasks.workunit.client.1.smithi159.stdout:9/146: dread d1/dc/d10/f14 [0,4194304] 0 2024-09-13T22:08:53.507 INFO:tasks.workunit.client.1.smithi159.stdout:9/147: symlink d1/d9/l34 0 2024-09-13T22:08:53.511 INFO:tasks.workunit.client.1.smithi159.stdout:9/148: mknod d1/d9/c35 0 2024-09-13T22:08:53.513 INFO:tasks.workunit.client.1.smithi159.stdout:9/149: dread d1/fe [0,4194304] 0 2024-09-13T22:08:53.517 INFO:tasks.workunit.client.1.smithi159.stdout:9/150: symlink d1/dc/d27/l36 0 2024-09-13T22:08:53.521 INFO:tasks.workunit.client.1.smithi159.stdout:9/151: creat d1/d9/d1f/d26/d2f/f37 x:0 0 0 2024-09-13T22:08:53.524 INFO:tasks.workunit.client.1.smithi159.stdout:9/152: truncate d1/d9/f18 2159790 0 2024-09-13T22:08:53.600 INFO:tasks.workunit.client.1.smithi159.stdout:6/62: sync 2024-09-13T22:08:53.601 INFO:tasks.workunit.client.1.smithi159.stdout:3/92: sync 2024-09-13T22:08:53.605 INFO:tasks.workunit.client.1.smithi159.stdout:3/93: symlink d0/d1/d3/dd/l1e 0 2024-09-13T22:08:53.605 INFO:tasks.workunit.client.1.smithi159.stdout:6/63: getdents d3/da/de 0 2024-09-13T22:08:53.605 INFO:tasks.workunit.client.1.smithi159.stdout:6/64: write d3/da/f16 [683333,122058] 0 2024-09-13T22:08:53.606 INFO:tasks.workunit.client.1.smithi159.stdout:6/65: dread - d3/da/de/f11 zero size 2024-09-13T22:08:53.608 INFO:tasks.workunit.client.1.smithi159.stdout:6/66: creat d3/da/de/f17 x:0 0 0 2024-09-13T22:08:53.610 INFO:tasks.workunit.client.1.smithi159.stdout:6/67: symlink d3/da/l18 0 2024-09-13T22:08:53.612 INFO:tasks.workunit.client.1.smithi159.stdout:6/68: symlink d3/da/l19 0 2024-09-13T22:08:53.612 INFO:tasks.workunit.client.1.smithi159.stdout:6/69: dread - d3/da/de/f17 zero size 2024-09-13T22:08:53.613 INFO:tasks.workunit.client.1.smithi159.stdout:7/106: sync 2024-09-13T22:08:53.613 INFO:tasks.workunit.client.1.smithi159.stdout:8/35: sync 2024-09-13T22:08:53.613 INFO:tasks.workunit.client.1.smithi159.stdout:4/43: sync 2024-09-13T22:08:53.613 INFO:tasks.workunit.client.1.smithi159.stdout:5/35: sync 2024-09-13T22:08:53.613 INFO:tasks.workunit.client.1.smithi159.stdout:1/53: sync 2024-09-13T22:08:53.613 INFO:tasks.workunit.client.1.smithi159.stdout:2/63: sync 2024-09-13T22:08:53.613 INFO:tasks.workunit.client.1.smithi159.stdout:4/44: read - f8 zero size 2024-09-13T22:08:53.613 INFO:tasks.workunit.client.1.smithi159.stdout:5/36: rename d1 to d1/d9 22 2024-09-13T22:08:53.613 INFO:tasks.workunit.client.1.smithi159.stdout:5/37: readlink d1/l7 0 2024-09-13T22:08:53.614 INFO:tasks.workunit.client.1.smithi159.stdout:0/221: sync 2024-09-13T22:08:53.614 INFO:tasks.workunit.client.1.smithi159.stdout:0/222: write d0/d7/d22/d2b/f2f [2525146,21266] 0 2024-09-13T22:08:53.616 INFO:tasks.workunit.client.1.smithi159.stdout:6/70: unlink d3/da/l18 0 2024-09-13T22:08:53.617 INFO:tasks.workunit.client.1.smithi159.stdout:6/71: write d3/da/f16 [140558,32920] 0 2024-09-13T22:08:53.617 INFO:tasks.workunit.client.1.smithi159.stdout:6/72: write d3/da/de/f17 [163536,6331] 0 2024-09-13T22:08:53.617 INFO:tasks.workunit.client.1.smithi159.stdout:6/73: write d3/da/de/ff [2842574,43323] 0 2024-09-13T22:08:53.617 INFO:tasks.workunit.client.1.smithi159.stdout:1/54: unlink la 0 2024-09-13T22:08:53.619 INFO:tasks.workunit.client.1.smithi159.stdout:5/38: write d1/f5 [2589638,21363] 0 2024-09-13T22:08:53.621 INFO:tasks.workunit.client.1.smithi159.stdout:8/36: mknod c9 0 2024-09-13T22:08:53.623 INFO:tasks.workunit.client.1.smithi159.stdout:7/107: symlink d3/l21 0 2024-09-13T22:08:53.624 INFO:tasks.workunit.client.1.smithi159.stdout:7/108: truncate d3/d18/f1d 4308279 0 2024-09-13T22:08:53.625 INFO:tasks.workunit.client.1.smithi159.stdout:9/153: dread d1/d9/f18 [0,4194304] 0 2024-09-13T22:08:53.625 INFO:tasks.workunit.client.1.smithi159.stdout:9/154: creat d1/d9/f38 x:0 0 0 2024-09-13T22:08:53.626 INFO:tasks.workunit.client.1.smithi159.stdout:2/64: mknod d9/da/c17 0 2024-09-13T22:08:53.628 INFO:tasks.workunit.client.1.smithi159.stdout:0/223: symlink d0/d7/d22/l49 0 2024-09-13T22:08:53.628 INFO:tasks.workunit.client.1.smithi159.stdout:0/224: read - d0/d2c/f37 zero size 2024-09-13T22:08:53.629 INFO:tasks.workunit.client.1.smithi159.stdout:6/74: mkdir d3/da/de/d1a 0 2024-09-13T22:08:53.632 INFO:tasks.workunit.client.1.smithi159.stdout:1/55: rename cc to dd/ce 0 2024-09-13T22:08:53.635 INFO:tasks.workunit.client.1.smithi159.stdout:8/37: mkdir da 0 2024-09-13T22:08:53.637 INFO:tasks.workunit.client.1.smithi159.stdout:7/109: mknod d3/c22 0 2024-09-13T22:08:53.640 INFO:tasks.workunit.client.1.smithi159.stdout:9/155: creat d1/dc/d10/f39 x:0 0 0 2024-09-13T22:08:53.643 INFO:tasks.workunit.client.1.smithi159.stdout:0/225: symlink d0/d2c/l4a 0 2024-09-13T22:08:53.644 INFO:tasks.workunit.client.1.smithi159.stdout:6/75: mknod d3/da/de/c1b 0 2024-09-13T22:08:53.644 INFO:tasks.workunit.client.1.smithi159.stdout:6/76: readlink d3/da/l19 0 2024-09-13T22:08:53.646 INFO:tasks.workunit.client.1.smithi159.stdout:0/226: dread d0/d7/f1e [0,4194304] 0 2024-09-13T22:08:53.648 INFO:tasks.workunit.client.1.smithi159.stdout:9/156: rename d1/d9/d1f/c24 to d1/d9/d2a/c3a 0 2024-09-13T22:08:53.648 INFO:tasks.workunit.client.1.smithi159.stdout:9/157: creat d1/dc/d10/f3b x:0 0 0 2024-09-13T22:08:53.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/77: creat d3/da/de/d1a/f1c x:0 0 0 2024-09-13T22:08:53.653 INFO:tasks.workunit.client.1.smithi159.stdout:7/110: write d3/ff [3376550,89238] 0 2024-09-13T22:08:53.653 INFO:tasks.workunit.client.1.smithi159.stdout:7/111: stat d3/f1e 0 2024-09-13T22:08:53.654 INFO:tasks.workunit.client.1.smithi159.stdout:9/158: rename d1/d9/c2d to d1/d9/d1f/d26/c3c 0 2024-09-13T22:08:53.656 INFO:tasks.workunit.client.1.smithi159.stdout:7/112: dread d3/f9 [0,4194304] 0 2024-09-13T22:08:53.656 INFO:tasks.workunit.client.1.smithi159.stdout:7/113: stat d3/ca 0 2024-09-13T22:08:53.656 INFO:tasks.workunit.client.1.smithi159.stdout:0/227: write d0/d7/f14 [2806262,117206] 0 2024-09-13T22:08:53.657 INFO:tasks.workunit.client.1.smithi159.stdout:7/114: symlink d3/d18/l23 0 2024-09-13T22:08:53.658 INFO:tasks.workunit.client.1.smithi159.stdout:0/228: creat d0/d7/f4b x:0 0 0 2024-09-13T22:08:53.659 INFO:tasks.workunit.client.1.smithi159.stdout:0/229: chown d0/d2c/l31 613167448 1 2024-09-13T22:08:53.661 INFO:tasks.workunit.client.1.smithi159.stdout:7/115: write d3/d18/f1d [3825344,15085] 0 2024-09-13T22:08:53.665 INFO:tasks.workunit.client.1.smithi159.stdout:7/116: unlink d3/f12 0 2024-09-13T22:08:53.666 INFO:tasks.workunit.client.1.smithi159.stdout:7/117: creat d3/d18/f24 x:0 0 0 2024-09-13T22:08:53.666 INFO:tasks.workunit.client.1.smithi159.stdout:7/118: truncate d3/f1c 630975 0 2024-09-13T22:08:53.667 INFO:tasks.workunit.client.1.smithi159.stdout:5/39: dwrite d1/f8 [0,4194304] 0 2024-09-13T22:08:53.669 INFO:tasks.workunit.client.1.smithi159.stdout:5/40: link d1/f2 d1/fa 0 2024-09-13T22:08:53.677 INFO:tasks.workunit.client.1.smithi159.stdout:4/45: dwrite f9 [0,4194304] 0 2024-09-13T22:08:53.677 INFO:tasks.workunit.client.1.smithi159.stdout:4/46: stat ca 0 2024-09-13T22:08:53.681 INFO:tasks.workunit.client.1.smithi159.stdout:5/41: dread d1/f8 [0,4194304] 0 2024-09-13T22:08:53.681 INFO:tasks.workunit.client.1.smithi159.stdout:7/119: fsync d3/ff 0 2024-09-13T22:08:53.683 INFO:tasks.workunit.client.1.smithi159.stdout:1/56: dwrite f7 [0,4194304] 0 2024-09-13T22:08:53.684 INFO:tasks.workunit.client.1.smithi159.stdout:1/57: readlink - no filename 2024-09-13T22:08:53.684 INFO:tasks.workunit.client.1.smithi159.stdout:1/58: write f9 [209129,102189] 0 2024-09-13T22:08:53.684 INFO:tasks.workunit.client.1.smithi159.stdout:1/59: chown c8 267417135 1 2024-09-13T22:08:53.684 INFO:tasks.workunit.client.1.smithi159.stdout:1/60: dread - fb zero size 2024-09-13T22:08:53.684 INFO:tasks.workunit.client.1.smithi159.stdout:1/61: fdatasync f3 0 2024-09-13T22:08:53.684 INFO:tasks.workunit.client.1.smithi159.stdout:1/62: fsync f7 0 2024-09-13T22:08:53.685 INFO:tasks.workunit.client.1.smithi159.stdout:8/38: dwrite f6 [0,4194304] 0 2024-09-13T22:08:53.685 INFO:tasks.workunit.client.1.smithi159.stdout:0/230: dwrite d0/d2c/f37 [0,4194304] 0 2024-09-13T22:08:53.685 INFO:tasks.workunit.client.1.smithi159.stdout:0/231: write d0/d7/f44 [254855,92179] 0 2024-09-13T22:08:53.685 INFO:tasks.workunit.client.1.smithi159.stdout:0/232: readlink d0/l32 0 2024-09-13T22:08:53.685 INFO:tasks.workunit.client.1.smithi159.stdout:0/233: dread - d0/d7/d22/f46 zero size 2024-09-13T22:08:53.688 INFO:tasks.workunit.client.1.smithi159.stdout:4/47: write f9 [248003,83104] 0 2024-09-13T22:08:53.691 INFO:tasks.workunit.client.1.smithi159.stdout:1/63: creat dd/ff x:0 0 0 2024-09-13T22:08:53.691 INFO:tasks.workunit.client.1.smithi159.stdout:1/64: creat dd/f10 x:0 0 0 2024-09-13T22:08:53.692 INFO:tasks.workunit.client.1.smithi159.stdout:8/39: mknod da/cb 0 2024-09-13T22:08:53.693 INFO:tasks.workunit.client.1.smithi159.stdout:5/42: write d1/fa [2896346,2744] 0 2024-09-13T22:08:53.697 INFO:tasks.workunit.client.1.smithi159.stdout:1/65: mkdir dd/d11 0 2024-09-13T22:08:53.698 INFO:tasks.workunit.client.1.smithi159.stdout:8/40: mkdir da/dc 0 2024-09-13T22:08:53.699 INFO:tasks.workunit.client.1.smithi159.stdout:8/41: chown f8 32016541 1 2024-09-13T22:08:53.700 INFO:tasks.workunit.client.1.smithi159.stdout:5/43: mkdir d1/db 0 2024-09-13T22:08:53.701 INFO:tasks.workunit.client.1.smithi159.stdout:5/44: symlink d1/lc 0 2024-09-13T22:08:53.702 INFO:tasks.workunit.client.1.smithi159.stdout:1/66: write f3 [1223062,27879] 0 2024-09-13T22:08:53.702 INFO:tasks.workunit.client.1.smithi159.stdout:2/65: getdents d9/da 0 2024-09-13T22:08:53.713 INFO:tasks.workunit.client.1.smithi159.stdout:8/42: read f8 [3304579,91819] 0 2024-09-13T22:08:53.714 INFO:tasks.workunit.client.1.smithi159.stdout:7/120: dwrite d3/f15 [0,4194304] 0 2024-09-13T22:08:53.715 INFO:tasks.workunit.client.1.smithi159.stdout:8/43: rmdir da/dc 0 2024-09-13T22:08:53.721 INFO:tasks.workunit.client.1.smithi159.stdout:8/44: symlink da/ld 0 2024-09-13T22:08:53.722 INFO:tasks.workunit.client.1.smithi159.stdout:4/48: dwrite f8 [0,4194304] 0 2024-09-13T22:08:53.723 INFO:tasks.workunit.client.1.smithi159.stdout:6/78: dwrite d3/da/de/ff [0,4194304] 0 2024-09-13T22:08:53.724 INFO:tasks.workunit.client.1.smithi159.stdout:8/45: mknod da/ce 0 2024-09-13T22:08:53.724 INFO:tasks.workunit.client.1.smithi159.stdout:8/46: write f4 [147671,121364] 0 2024-09-13T22:08:53.725 INFO:tasks.workunit.client.1.smithi159.stdout:2/66: dwrite f5 [0,4194304] 0 2024-09-13T22:08:53.725 INFO:tasks.workunit.client.1.smithi159.stdout:2/67: dread - d9/da/f14 zero size 2024-09-13T22:08:53.726 INFO:tasks.workunit.client.1.smithi159.stdout:2/68: write d9/f11 [1024603,14071] 0 2024-09-13T22:08:53.733 INFO:tasks.workunit.client.1.smithi159.stdout:9/159: rename d1/d9/d1f/d26 to d1/d9/d3d 0 2024-09-13T22:08:53.733 INFO:tasks.workunit.client.1.smithi159.stdout:9/160: write d1/dc/d10/f3b [788425,31932] 0 2024-09-13T22:08:53.735 INFO:tasks.workunit.client.1.smithi159.stdout:2/69: unlink l8 0 2024-09-13T22:08:53.736 INFO:tasks.workunit.client.1.smithi159.stdout:4/49: dread f8 [0,4194304] 0 2024-09-13T22:08:53.738 INFO:tasks.workunit.client.1.smithi159.stdout:6/79: dread d3/da/de/ff [0,4194304] 0 2024-09-13T22:08:53.738 INFO:tasks.workunit.client.1.smithi159.stdout:6/80: creat d3/da/f1d x:0 0 0 2024-09-13T22:08:53.739 INFO:tasks.workunit.client.1.smithi159.stdout:0/234: rename d0/d7/c47 to d0/d48/c4c 0 2024-09-13T22:08:53.739 INFO:tasks.workunit.client.1.smithi159.stdout:0/235: truncate d0/d2c/f43 3534692 0 2024-09-13T22:08:53.742 INFO:tasks.workunit.client.1.smithi159.stdout:2/70: creat d9/da/f18 x:0 0 0 2024-09-13T22:08:53.742 INFO:tasks.workunit.client.1.smithi159.stdout:2/71: stat d9/da/c17 0 2024-09-13T22:08:53.742 INFO:tasks.workunit.client.1.smithi159.stdout:2/72: fsync d9/da/f14 0 2024-09-13T22:08:53.744 INFO:tasks.workunit.client.1.smithi159.stdout:5/45: dwrite d1/fa [0,4194304] 0 2024-09-13T22:08:53.744 INFO:tasks.workunit.client.1.smithi159.stdout:5/46: readlink d1/lc 0 2024-09-13T22:08:53.748 INFO:tasks.workunit.client.1.smithi159.stdout:9/161: dread d1/dc/f13 [0,4194304] 0 2024-09-13T22:08:53.748 INFO:tasks.workunit.client.1.smithi159.stdout:7/121: dwrite d3/f1e [0,4194304] 0 2024-09-13T22:08:53.748 INFO:tasks.workunit.client.1.smithi159.stdout:7/122: chown d3/d18/f20 11539 1 2024-09-13T22:08:53.748 INFO:tasks.workunit.client.1.smithi159.stdout:9/162: creat d1/dc/f3e x:0 0 0 2024-09-13T22:08:53.748 INFO:tasks.workunit.client.1.smithi159.stdout:7/123: write d3/f1a [4821691,6544] 0 2024-09-13T22:08:53.752 INFO:tasks.workunit.client.1.smithi159.stdout:9/163: dread d1/d9/ff [4194304,4194304] 0 2024-09-13T22:08:53.752 INFO:tasks.workunit.client.1.smithi159.stdout:9/164: dread - d1/f30 zero size 2024-09-13T22:08:53.752 INFO:tasks.workunit.client.1.smithi159.stdout:9/165: chown d1/dc/fb 9704339 1 2024-09-13T22:08:53.752 INFO:tasks.workunit.client.1.smithi159.stdout:6/81: getdents d3 0 2024-09-13T22:08:53.755 INFO:tasks.workunit.client.1.smithi159.stdout:0/236: creat d0/d48/f4d x:0 0 0 2024-09-13T22:08:53.756 INFO:tasks.workunit.client.1.smithi159.stdout:2/73: symlink d9/da/l19 0 2024-09-13T22:08:53.756 INFO:tasks.workunit.client.1.smithi159.stdout:2/74: chown f5 7 1 2024-09-13T22:08:53.761 INFO:tasks.workunit.client.1.smithi159.stdout:5/47: creat d1/db/fd x:0 0 0 2024-09-13T22:08:53.762 INFO:tasks.workunit.client.1.smithi159.stdout:0/237: read d0/d7/f1a [3144731,6305] 0 2024-09-13T22:08:53.764 INFO:tasks.workunit.client.1.smithi159.stdout:1/67: getdents dd 0 2024-09-13T22:08:53.768 INFO:tasks.workunit.client.1.smithi159.stdout:0/238: dread d0/d7/f14 [0,4194304] 0 2024-09-13T22:08:53.768 INFO:tasks.workunit.client.1.smithi159.stdout:0/239: dread - d0/d48/f4d zero size 2024-09-13T22:08:53.768 INFO:tasks.workunit.client.1.smithi159.stdout:0/240: fdatasync d0/d7/d22/fd 0 2024-09-13T22:08:53.771 INFO:tasks.workunit.client.1.smithi159.stdout:4/50: dwrite f2 [0,4194304] 0 2024-09-13T22:08:53.771 INFO:tasks.workunit.client.1.smithi159.stdout:4/51: creat fd x:0 0 0 2024-09-13T22:08:53.771 INFO:tasks.workunit.client.1.smithi159.stdout:9/166: rmdir d1/d9/d3d/d2f 39 2024-09-13T22:08:53.772 INFO:tasks.workunit.client.1.smithi159.stdout:9/167: write d1/fe [328949,65997] 0 2024-09-13T22:08:53.773 INFO:tasks.workunit.client.1.smithi159.stdout:9/168: read - d1/dc/f3e zero size 2024-09-13T22:08:53.774 INFO:tasks.workunit.client.1.smithi159.stdout:6/82: mknod d3/c1e 0 2024-09-13T22:08:53.775 INFO:tasks.workunit.client.1.smithi159.stdout:7/124: write d3/f15 [5115470,63985] 0 2024-09-13T22:08:53.775 INFO:tasks.workunit.client.1.smithi159.stdout:7/125: chown d3/d18/f1d 239589255 1 2024-09-13T22:08:53.775 INFO:tasks.workunit.client.1.smithi159.stdout:5/48: dread d1/f2 [0,4194304] 0 2024-09-13T22:08:53.780 INFO:tasks.workunit.client.1.smithi159.stdout:2/75: rename f7 to d9/da/f1a 0 2024-09-13T22:08:53.780 INFO:tasks.workunit.client.1.smithi159.stdout:2/76: readlink d9/da/lc 0 2024-09-13T22:08:53.780 INFO:tasks.workunit.client.1.smithi159.stdout:2/77: chown d9/da/f14 2755 1 2024-09-13T22:08:53.780 INFO:tasks.workunit.client.1.smithi159.stdout:2/78: chown d9/fd 814 1 2024-09-13T22:08:53.780 INFO:tasks.workunit.client.1.smithi159.stdout:2/79: dread - d9/da/f18 zero size 2024-09-13T22:08:53.781 INFO:tasks.workunit.client.1.smithi159.stdout:0/241: mknod d0/d7/c4e 0 2024-09-13T22:08:53.785 INFO:tasks.workunit.client.1.smithi159.stdout:4/52: rename l7 to le 0 2024-09-13T22:08:53.785 INFO:tasks.workunit.client.1.smithi159.stdout:4/53: chown f8 134279 1 2024-09-13T22:08:53.786 INFO:tasks.workunit.client.1.smithi159.stdout:9/169: mknod d1/d9/d3d/d2f/c3f 0 2024-09-13T22:08:53.786 INFO:tasks.workunit.client.1.smithi159.stdout:9/170: readlink d1/d9/l1e 0 2024-09-13T22:08:53.786 INFO:tasks.workunit.client.1.smithi159.stdout:9/171: read d1/dc/f12 [3705400,130989] 0 2024-09-13T22:08:53.787 INFO:tasks.workunit.client.1.smithi159.stdout:6/83: readlink d3/da/l19 0 2024-09-13T22:08:53.787 INFO:tasks.workunit.client.1.smithi159.stdout:6/84: dread - d3/da/de/f12 zero size 2024-09-13T22:08:53.787 INFO:tasks.workunit.client.1.smithi159.stdout:6/85: truncate d3/da/f1d 343826 0 2024-09-13T22:08:53.787 INFO:tasks.workunit.client.1.smithi159.stdout:6/86: write d3/da/de/f12 [826857,74967] 0 2024-09-13T22:08:53.787 INFO:tasks.workunit.client.1.smithi159.stdout:6/87: fsync d3/da/f16 0 2024-09-13T22:08:53.789 INFO:tasks.workunit.client.1.smithi159.stdout:7/126: symlink d3/l25 0 2024-09-13T22:08:53.790 INFO:tasks.workunit.client.1.smithi159.stdout:5/49: mknod d1/ce 0 2024-09-13T22:08:53.793 INFO:tasks.workunit.client.1.smithi159.stdout:2/80: dwrite d9/da/f18 [0,4194304] 0 2024-09-13T22:08:53.794 INFO:tasks.workunit.client.1.smithi159.stdout:4/54: symlink lf 0 2024-09-13T22:08:53.794 INFO:tasks.workunit.client.1.smithi159.stdout:4/55: creat f10 x:0 0 0 2024-09-13T22:08:53.794 INFO:tasks.workunit.client.1.smithi159.stdout:4/56: chown lf 5481 1 2024-09-13T22:08:53.795 INFO:tasks.workunit.client.1.smithi159.stdout:5/50: stat d1/l6 0 2024-09-13T22:08:53.802 INFO:tasks.workunit.client.1.smithi159.stdout:1/68: truncate f3 978209 0 2024-09-13T22:08:53.802 INFO:tasks.workunit.client.1.smithi159.stdout:1/69: write fb [680439,125306] 0 2024-09-13T22:08:53.806 INFO:tasks.workunit.client.1.smithi159.stdout:4/57: rename fd to f11 0 2024-09-13T22:08:53.806 INFO:tasks.workunit.client.1.smithi159.stdout:5/51: truncate d1/f8 2889275 0 2024-09-13T22:08:53.808 INFO:tasks.workunit.client.1.smithi159.stdout:0/242: rename d0/d7/d22 to d0/d48/d4f 0 2024-09-13T22:08:53.809 INFO:tasks.workunit.client.1.smithi159.stdout:2/81: rename d9/fd to d9/f1b 0 2024-09-13T22:08:53.811 INFO:tasks.workunit.client.1.smithi159.stdout:1/70: link c8 dd/d11/c12 0 2024-09-13T22:08:53.811 INFO:tasks.workunit.client.1.smithi159.stdout:1/71: fsync dd/f10 0 2024-09-13T22:08:53.813 INFO:tasks.workunit.client.1.smithi159.stdout:0/243: creat d0/d48/d4f/d2b/f50 x:0 0 0 2024-09-13T22:08:53.813 INFO:tasks.workunit.client.1.smithi159.stdout:0/244: chown d0/d48/d4f/fd 55806 1 2024-09-13T22:08:53.814 INFO:tasks.workunit.client.1.smithi159.stdout:2/82: mknod d9/da/c1c 0 2024-09-13T22:08:53.814 INFO:tasks.workunit.client.1.smithi159.stdout:2/83: chown d9/da 52745051 1 2024-09-13T22:08:53.815 INFO:tasks.workunit.client.1.smithi159.stdout:6/88: dwrite d3/da/de/ff [0,4194304] 0 2024-09-13T22:08:53.815 INFO:tasks.workunit.client.1.smithi159.stdout:4/58: write f2 [2449933,74118] 0 2024-09-13T22:08:53.815 INFO:tasks.workunit.client.1.smithi159.stdout:4/59: chown le 6836 1 2024-09-13T22:08:53.821 INFO:tasks.workunit.client.1.smithi159.stdout:4/60: symlink l12 0 2024-09-13T22:08:53.821 INFO:tasks.workunit.client.1.smithi159.stdout:2/84: dread d9/f1b [0,4194304] 0 2024-09-13T22:08:53.825 INFO:tasks.workunit.client.1.smithi159.stdout:2/85: creat d9/f1d x:0 0 0 2024-09-13T22:08:53.825 INFO:tasks.workunit.client.1.smithi159.stdout:2/86: readlink d9/da/l19 0 2024-09-13T22:08:53.825 INFO:tasks.workunit.client.1.smithi159.stdout:2/87: fdatasync d9/da/f14 0 2024-09-13T22:08:53.825 INFO:tasks.workunit.client.1.smithi159.stdout:2/88: write f6 [1118320,125159] 0 2024-09-13T22:08:53.833 INFO:tasks.workunit.client.1.smithi159.stdout:6/89: dwrite d3/da/de/f15 [0,4194304] 0 2024-09-13T22:08:53.843 INFO:tasks.workunit.client.1.smithi159.stdout:6/90: write d3/da/de/f15 [3127373,120232] 0 2024-09-13T22:08:53.844 INFO:tasks.workunit.client.1.smithi159.stdout:6/91: truncate d3/da/de/d1a/f1c 795082 0 2024-09-13T22:08:53.844 INFO:tasks.workunit.client.1.smithi159.stdout:6/92: chown d3/da/f10 73 1 2024-09-13T22:08:53.846 INFO:tasks.workunit.client.1.smithi159.stdout:2/89: rmdir d9/da 39 2024-09-13T22:08:53.850 INFO:tasks.workunit.client.1.smithi159.stdout:2/90: symlink d9/da/l1e 0 2024-09-13T22:08:53.852 INFO:tasks.workunit.client.1.smithi159.stdout:2/91: mknod d9/da/c1f 0 2024-09-13T22:08:53.853 INFO:tasks.workunit.client.1.smithi159.stdout:4/61: getdents . 0 2024-09-13T22:08:53.856 INFO:tasks.workunit.client.1.smithi159.stdout:4/62: mkdir d13 0 2024-09-13T22:08:53.857 INFO:tasks.workunit.client.1.smithi159.stdout:4/63: fsync f10 0 2024-09-13T22:08:53.858 INFO:tasks.workunit.client.1.smithi159.stdout:4/64: write f11 [479911,86137] 0 2024-09-13T22:08:53.874 INFO:tasks.workunit.client.1.smithi159.stdout:1/72: dwrite f3 [0,4194304] 0 2024-09-13T22:08:53.874 INFO:tasks.workunit.client.1.smithi159.stdout:6/93: dwrite d3/da/de/d1a/f1c [0,4194304] 0 2024-09-13T22:08:53.874 INFO:tasks.workunit.client.1.smithi159.stdout:0/245: dwrite d0/f10 [0,4194304] 0 2024-09-13T22:08:53.876 INFO:tasks.workunit.client.1.smithi159.stdout:2/92: getdents d9/da 0 2024-09-13T22:08:53.878 INFO:tasks.workunit.client.1.smithi159.stdout:1/73: mkdir dd/d11/d13 0 2024-09-13T22:08:53.880 INFO:tasks.workunit.client.1.smithi159.stdout:4/65: dwrite f8 [0,4194304] 0 2024-09-13T22:08:53.884 INFO:tasks.workunit.client.1.smithi159.stdout:6/94: rename d3/l5 to d3/da/l1f 0 2024-09-13T22:08:53.885 INFO:tasks.workunit.client.1.smithi159.stdout:1/74: symlink dd/d11/d13/l14 0 2024-09-13T22:08:53.885 INFO:tasks.workunit.client.1.smithi159.stdout:5/52: truncate d1/f8 716858 0 2024-09-13T22:08:53.888 INFO:tasks.workunit.client.1.smithi159.stdout:4/66: creat d13/f14 x:0 0 0 2024-09-13T22:08:53.889 INFO:tasks.workunit.client.1.smithi159.stdout:2/93: mknod d9/c20 0 2024-09-13T22:08:53.893 INFO:tasks.workunit.client.1.smithi159.stdout:1/75: link dd/d11/c12 dd/c15 0 2024-09-13T22:08:53.895 INFO:tasks.workunit.client.1.smithi159.stdout:5/53: link d1/l6 d1/lf 0 2024-09-13T22:08:53.895 INFO:tasks.workunit.client.1.smithi159.stdout:5/54: creat d1/db/f10 x:0 0 0 2024-09-13T22:08:53.898 INFO:tasks.workunit.client.1.smithi159.stdout:4/67: mkdir d13/d15 0 2024-09-13T22:08:53.902 INFO:tasks.workunit.client.1.smithi159.stdout:6/95: rename d3/da/de/ff to d3/f20 0 2024-09-13T22:08:53.903 INFO:tasks.workunit.client.1.smithi159.stdout:1/76: getdents dd/d11/d13 0 2024-09-13T22:08:53.903 INFO:tasks.workunit.client.1.smithi159.stdout:1/77: truncate dd/ff 1020655 0 2024-09-13T22:08:53.907 INFO:tasks.workunit.client.1.smithi159.stdout:5/55: mkdir d1/d11 0 2024-09-13T22:08:53.907 INFO:tasks.workunit.client.1.smithi159.stdout:5/56: stat d1 0 2024-09-13T22:08:53.907 INFO:tasks.workunit.client.1.smithi159.stdout:5/57: chown d1/fa 1 1 2024-09-13T22:08:53.907 INFO:tasks.workunit.client.1.smithi159.stdout:5/58: chown d1/d11 1 1 2024-09-13T22:08:53.908 INFO:tasks.workunit.client.1.smithi159.stdout:4/68: chown ca 58466 1 2024-09-13T22:08:53.909 INFO:tasks.workunit.client.1.smithi159.stdout:2/94: mknod d9/c21 0 2024-09-13T22:08:53.909 INFO:tasks.workunit.client.1.smithi159.stdout:2/95: chown f6 0 1 2024-09-13T22:08:53.910 INFO:tasks.workunit.client.1.smithi159.stdout:6/96: write d3/da/de/d1a/f1c [1051477,113682] 0 2024-09-13T22:08:53.910 INFO:tasks.workunit.client.1.smithi159.stdout:6/97: dread - d3/da/f10 zero size 2024-09-13T22:08:53.911 INFO:tasks.workunit.client.1.smithi159.stdout:1/78: creat dd/f16 x:0 0 0 2024-09-13T22:08:53.913 INFO:tasks.workunit.client.1.smithi159.stdout:4/69: dread - fc zero size 2024-09-13T22:08:53.916 INFO:tasks.workunit.client.1.smithi159.stdout:5/59: dread d1/fa [0,4194304] 0 2024-09-13T22:08:53.917 INFO:tasks.workunit.client.1.smithi159.stdout:2/96: dread f6 [0,4194304] 0 2024-09-13T22:08:53.919 INFO:tasks.workunit.client.1.smithi159.stdout:5/60: mknod d1/c12 0 2024-09-13T22:08:53.920 INFO:tasks.workunit.client.1.smithi159.stdout:4/70: rmdir d13 39 2024-09-13T22:08:53.920 INFO:tasks.workunit.client.1.smithi159.stdout:4/71: write f10 [949386,98276] 0 2024-09-13T22:08:53.923 INFO:tasks.workunit.client.1.smithi159.stdout:2/97: rename d9/f11 to d9/da/f22 0 2024-09-13T22:08:53.923 INFO:tasks.workunit.client.1.smithi159.stdout:2/98: readlink d9/da/lc 0 2024-09-13T22:08:53.923 INFO:tasks.workunit.client.1.smithi159.stdout:2/99: chown d9/da/f1a 254745 1 2024-09-13T22:08:53.923 INFO:tasks.workunit.client.1.smithi159.stdout:5/61: write d1/fa [2216841,58999] 0 2024-09-13T22:08:53.924 INFO:tasks.workunit.client.1.smithi159.stdout:4/72: creat d13/d15/f16 x:0 0 0 2024-09-13T22:08:53.925 INFO:tasks.workunit.client.1.smithi159.stdout:5/62: symlink d1/l13 0 2024-09-13T22:08:53.925 INFO:tasks.workunit.client.1.smithi159.stdout:4/73: readlink le 0 2024-09-13T22:08:53.927 INFO:tasks.workunit.client.1.smithi159.stdout:5/63: mknod d1/d11/c14 0 2024-09-13T22:08:53.927 INFO:tasks.workunit.client.1.smithi159.stdout:5/64: chown d1/c12 5 1 2024-09-13T22:08:53.927 INFO:tasks.workunit.client.1.smithi159.stdout:5/65: chown d1/l7 5233 1 2024-09-13T22:08:53.927 INFO:tasks.workunit.client.1.smithi159.stdout:4/74: write f9 [949598,55835] 0 2024-09-13T22:08:53.928 INFO:tasks.workunit.client.1.smithi159.stdout:4/75: truncate f8 4599800 0 2024-09-13T22:08:53.928 INFO:tasks.workunit.client.1.smithi159.stdout:4/76: write f11 [635272,66258] 0 2024-09-13T22:08:53.928 INFO:tasks.workunit.client.1.smithi159.stdout:5/66: mkdir d1/d15 0 2024-09-13T22:08:53.929 INFO:tasks.workunit.client.1.smithi159.stdout:5/67: creat d1/db/f16 x:0 0 0 2024-09-13T22:08:53.929 INFO:tasks.workunit.client.1.smithi159.stdout:5/68: dread - d1/db/f16 zero size 2024-09-13T22:08:53.930 INFO:tasks.workunit.client.1.smithi159.stdout:5/69: mkdir d1/db/d17 0 2024-09-13T22:08:53.930 INFO:tasks.workunit.client.1.smithi159.stdout:5/70: readlink d1/l13 0 2024-09-13T22:08:53.932 INFO:tasks.workunit.client.1.smithi159.stdout:6/98: dwrite d3/da/de/f17 [0,4194304] 0 2024-09-13T22:08:53.933 INFO:tasks.workunit.client.1.smithi159.stdout:5/71: dread d1/f8 [0,4194304] 0 2024-09-13T22:08:53.933 INFO:tasks.workunit.client.1.smithi159.stdout:1/79: dwrite dd/f16 [0,4194304] 0 2024-09-13T22:08:53.933 INFO:tasks.workunit.client.1.smithi159.stdout:1/80: fsync dd/f10 0 2024-09-13T22:08:53.937 INFO:tasks.workunit.client.1.smithi159.stdout:4/77: write f8 [442611,88601] 0 2024-09-13T22:08:53.940 INFO:tasks.workunit.client.1.smithi159.stdout:6/99: getdents d3 0 2024-09-13T22:08:53.940 INFO:tasks.workunit.client.1.smithi159.stdout:6/100: chown d3/da/f16 99 1 2024-09-13T22:08:53.947 INFO:tasks.workunit.client.1.smithi159.stdout:1/81: link dd/d11/d13/l14 dd/l17 0 2024-09-13T22:08:53.948 INFO:tasks.workunit.client.1.smithi159.stdout:6/101: symlink d3/da/de/l21 0 2024-09-13T22:08:53.949 INFO:tasks.workunit.client.1.smithi159.stdout:1/82: mkdir dd/d11/d18 0 2024-09-13T22:08:53.949 INFO:tasks.workunit.client.1.smithi159.stdout:1/83: fsync dd/f10 0 2024-09-13T22:08:53.949 INFO:tasks.workunit.client.1.smithi159.stdout:1/84: dread dd/ff [0,4194304] 0 2024-09-13T22:08:53.950 INFO:tasks.workunit.client.1.smithi159.stdout:6/102: rename d3/da/l1f to d3/da/de/d1a/l22 0 2024-09-13T22:08:53.951 INFO:tasks.workunit.client.1.smithi159.stdout:6/103: creat d3/f23 x:0 0 0 2024-09-13T22:08:53.951 INFO:tasks.workunit.client.1.smithi159.stdout:6/104: stat d3/da/f16 0 2024-09-13T22:08:53.952 INFO:tasks.workunit.client.1.smithi159.stdout:6/105: fdatasync d3/da/f16 0 2024-09-13T22:08:53.956 INFO:tasks.workunit.client.1.smithi159.stdout:5/72: dwrite d1/f8 [0,4194304] 0 2024-09-13T22:08:53.958 INFO:tasks.workunit.client.1.smithi159.stdout:5/73: symlink d1/db/l18 0 2024-09-13T22:08:53.959 INFO:tasks.workunit.client.1.smithi159.stdout:4/78: dwrite d13/d15/f16 [0,4194304] 0 2024-09-13T22:08:53.960 INFO:tasks.workunit.client.1.smithi159.stdout:5/74: symlink d1/d15/l19 0 2024-09-13T22:08:53.960 INFO:tasks.workunit.client.1.smithi159.stdout:5/75: truncate d1/db/fd 409098 0 2024-09-13T22:08:53.962 INFO:tasks.workunit.client.1.smithi159.stdout:4/79: chown l3 132018951 1 2024-09-13T22:08:53.962 INFO:tasks.workunit.client.1.smithi159.stdout:4/80: truncate f10 1081726 0 2024-09-13T22:08:53.963 INFO:tasks.workunit.client.1.smithi159.stdout:4/81: fdatasync d13/f14 0 2024-09-13T22:08:53.963 INFO:tasks.workunit.client.1.smithi159.stdout:4/82: stat d13 0 2024-09-13T22:08:53.963 INFO:tasks.workunit.client.1.smithi159.stdout:4/83: fdatasync d13/d15/f16 0 2024-09-13T22:08:53.963 INFO:tasks.workunit.client.1.smithi159.stdout:4/84: creat d13/d15/f17 x:0 0 0 2024-09-13T22:08:53.965 INFO:tasks.workunit.client.1.smithi159.stdout:5/76: rename d1/db/f16 to d1/f1a 0 2024-09-13T22:08:53.968 INFO:tasks.workunit.client.1.smithi159.stdout:4/85: unlink f9 0 2024-09-13T22:08:53.970 INFO:tasks.workunit.client.1.smithi159.stdout:5/77: mknod d1/db/d17/c1b 0 2024-09-13T22:08:53.972 INFO:tasks.workunit.client.1.smithi159.stdout:5/78: mkdir d1/d11/d1c 0 2024-09-13T22:08:53.973 INFO:tasks.workunit.client.1.smithi159.stdout:1/85: dwrite f9 [0,4194304] 0 2024-09-13T22:08:53.973 INFO:tasks.workunit.client.1.smithi159.stdout:4/86: fsync f2 0 2024-09-13T22:08:53.973 INFO:tasks.workunit.client.1.smithi159.stdout:6/106: dwrite d3/f23 [0,4194304] 0 2024-09-13T22:08:53.974 INFO:tasks.workunit.client.1.smithi159.stdout:5/79: symlink d1/db/d17/l1d 0 2024-09-13T22:08:53.974 INFO:tasks.workunit.client.1.smithi159.stdout:5/80: truncate d1/fa 4985081 0 2024-09-13T22:08:53.975 INFO:tasks.workunit.client.1.smithi159.stdout:4/87: fsync f8 0 2024-09-13T22:08:53.981 INFO:tasks.workunit.client.1.smithi159.stdout:1/86: write f7 [4174380,116421] 0 2024-09-13T22:08:53.986 INFO:tasks.workunit.client.1.smithi159.stdout:5/81: getdents d1 0 2024-09-13T22:08:53.987 INFO:tasks.workunit.client.1.smithi159.stdout:4/88: symlink d13/d15/l18 0 2024-09-13T22:08:53.987 INFO:tasks.workunit.client.1.smithi159.stdout:4/89: fsync f10 0 2024-09-13T22:08:53.993 INFO:tasks.workunit.client.1.smithi159.stdout:1/87: mkdir dd/d11/d19 0 2024-09-13T22:08:53.993 INFO:tasks.workunit.client.1.smithi159.stdout:1/88: stat dd/ce 0 2024-09-13T22:08:53.993 INFO:tasks.workunit.client.1.smithi159.stdout:1/89: dread - dd/f10 zero size 2024-09-13T22:08:53.993 INFO:tasks.workunit.client.1.smithi159.stdout:1/90: getdents dd/d11/d18 0 2024-09-13T22:08:53.994 INFO:tasks.workunit.client.1.smithi159.stdout:5/82: creat d1/d11/f1e x:0 0 0 2024-09-13T22:08:53.995 INFO:tasks.workunit.client.1.smithi159.stdout:5/83: creat d1/d11/f1f x:0 0 0 2024-09-13T22:08:53.998 INFO:tasks.workunit.client.1.smithi159.stdout:4/90: creat d13/f19 x:0 0 0 2024-09-13T22:08:53.999 INFO:tasks.workunit.client.1.smithi159.stdout:1/91: symlink dd/d11/d18/l1a 0 2024-09-13T22:08:53.999 INFO:tasks.workunit.client.1.smithi159.stdout:1/92: chown c8 598485991 1 2024-09-13T22:08:53.999 INFO:tasks.workunit.client.1.smithi159.stdout:1/93: dread - dd/f10 zero size 2024-09-13T22:08:53.999 INFO:tasks.workunit.client.1.smithi159.stdout:1/94: creat dd/f1b x:0 0 0 2024-09-13T22:08:54.002 INFO:tasks.workunit.client.1.smithi159.stdout:5/84: mkdir d1/d11/d1c/d20 0 2024-09-13T22:08:54.002 INFO:tasks.workunit.client.1.smithi159.stdout:5/85: fsync d1/f5 0 2024-09-13T22:08:54.004 INFO:tasks.workunit.client.1.smithi159.stdout:4/91: mknod d13/c1a 0 2024-09-13T22:08:54.010 INFO:tasks.workunit.client.1.smithi159.stdout:4/92: mknod d13/d15/c1b 0 2024-09-13T22:08:54.010 INFO:tasks.workunit.client.1.smithi159.stdout:4/93: dread - d13/f19 zero size 2024-09-13T22:08:54.010 INFO:tasks.workunit.client.1.smithi159.stdout:4/94: creat d13/d15/f1c x:0 0 0 2024-09-13T22:08:54.010 INFO:tasks.workunit.client.1.smithi159.stdout:4/95: fdatasync d13/d15/f16 0 2024-09-13T22:08:54.023 INFO:tasks.workunit.client.1.smithi159.stdout:5/86: dwrite d1/d11/f1e [0,4194304] 0 2024-09-13T22:08:54.024 INFO:tasks.workunit.client.1.smithi159.stdout:1/95: dwrite f7 [4194304,4194304] 0 2024-09-13T22:08:54.027 INFO:tasks.workunit.client.1.smithi159.stdout:1/96: rmdir dd/d11 39 2024-09-13T22:08:54.029 INFO:tasks.workunit.client.1.smithi159.stdout:1/97: mkdir dd/d1c 0 2024-09-13T22:08:54.029 INFO:tasks.workunit.client.1.smithi159.stdout:1/98: chown dd/ff 206603 1 2024-09-13T22:08:54.029 INFO:tasks.workunit.client.1.smithi159.stdout:1/99: fsync f9 0 2024-09-13T22:08:54.030 INFO:tasks.workunit.client.1.smithi159.stdout:1/100: link dd/d11/c12 dd/c1d 0 2024-09-13T22:08:54.030 INFO:tasks.workunit.client.1.smithi159.stdout:1/101: readlink dd/l17 0 2024-09-13T22:08:54.031 INFO:tasks.workunit.client.1.smithi159.stdout:1/102: mkdir dd/d1e 0 2024-09-13T22:08:54.034 INFO:tasks.workunit.client.1.smithi159.stdout:4/96: getdents d13/d15 0 2024-09-13T22:08:54.034 INFO:tasks.workunit.client.1.smithi159.stdout:4/97: fdatasync d13/d15/f1c 0 2024-09-13T22:08:54.034 INFO:tasks.workunit.client.1.smithi159.stdout:4/98: readlink l3 0 2024-09-13T22:08:54.043 INFO:tasks.workunit.client.1.smithi159.stdout:4/99: write d13/d15/f16 [2953949,103908] 0 2024-09-13T22:08:54.043 INFO:tasks.workunit.client.1.smithi159.stdout:5/87: dwrite d1/f1a [0,4194304] 0 2024-09-13T22:08:54.045 INFO:tasks.workunit.client.1.smithi159.stdout:4/100: dread f11 [0,4194304] 0 2024-09-13T22:08:54.048 INFO:tasks.workunit.client.1.smithi159.stdout:5/88: rename d1/l7 to d1/d11/l21 0 2024-09-13T22:08:54.049 INFO:tasks.workunit.client.1.smithi159.stdout:4/101: creat d13/d15/f1d x:0 0 0 2024-09-13T22:08:54.057 INFO:tasks.workunit.client.1.smithi159.stdout:1/103: dwrite f3 [0,4194304] 0 2024-09-13T22:08:54.061 INFO:tasks.workunit.client.1.smithi159.stdout:4/102: fsync d13/d15/f1d 0 2024-09-13T22:08:54.070 INFO:tasks.workunit.client.1.smithi159.stdout:1/104: read f9 [503219,62755] 0 2024-09-13T22:08:54.070 INFO:tasks.workunit.client.1.smithi159.stdout:5/89: dwrite d1/db/f10 [0,4194304] 0 2024-09-13T22:08:54.071 INFO:tasks.workunit.client.1.smithi159.stdout:1/105: rmdir dd/d11 39 2024-09-13T22:08:54.072 INFO:tasks.workunit.client.1.smithi159.stdout:1/106: write f7 [9345865,112439] 0 2024-09-13T22:08:54.072 INFO:tasks.workunit.client.1.smithi159.stdout:1/107: chown dd/ce 343 1 2024-09-13T22:08:54.072 INFO:tasks.workunit.client.1.smithi159.stdout:1/108: write f9 [4309492,115456] 0 2024-09-13T22:08:54.075 INFO:tasks.workunit.client.1.smithi159.stdout:5/90: symlink d1/db/d17/l22 0 2024-09-13T22:08:54.076 INFO:tasks.workunit.client.1.smithi159.stdout:1/109: rmdir dd/d11/d18 39 2024-09-13T22:08:54.077 INFO:tasks.workunit.client.1.smithi159.stdout:4/103: dwrite f10 [0,4194304] 0 2024-09-13T22:08:54.077 INFO:tasks.workunit.client.1.smithi159.stdout:4/104: write f8 [4257839,36119] 0 2024-09-13T22:08:54.080 INFO:tasks.workunit.client.1.smithi159.stdout:5/91: dread d1/f2 [0,4194304] 0 2024-09-13T22:08:54.081 INFO:tasks.workunit.client.1.smithi159.stdout:4/105: mknod d13/c1e 0 2024-09-13T22:08:54.081 INFO:tasks.workunit.client.1.smithi159.stdout:4/106: creat d13/d15/f1f x:0 0 0 2024-09-13T22:08:54.081 INFO:tasks.workunit.client.1.smithi159.stdout:4/107: chown d13/d15/f1c 10589 1 2024-09-13T22:08:54.083 INFO:tasks.workunit.client.1.smithi159.stdout:5/92: link d1/db/d17/l22 d1/d11/d1c/d20/l23 0 2024-09-13T22:08:54.085 INFO:tasks.workunit.client.1.smithi159.stdout:1/110: write f3 [4848,108505] 0 2024-09-13T22:08:54.085 INFO:tasks.workunit.client.1.smithi159.stdout:1/111: chown c5 22697702 1 2024-09-13T22:08:54.085 INFO:tasks.workunit.client.1.smithi159.stdout:4/108: readlink lf 0 2024-09-13T22:08:54.088 INFO:tasks.workunit.client.1.smithi159.stdout:5/93: unlink d1/d11/f1f 0 2024-09-13T22:08:54.089 INFO:tasks.workunit.client.1.smithi159.stdout:1/112: creat dd/d1e/f1f x:0 0 0 2024-09-13T22:08:54.092 INFO:tasks.workunit.client.1.smithi159.stdout:1/113: mknod dd/d11/c20 0 2024-09-13T22:08:54.094 INFO:tasks.workunit.client.1.smithi159.stdout:4/109: getdents d13 0 2024-09-13T22:08:54.094 INFO:tasks.workunit.client.1.smithi159.stdout:4/110: chown d13 256 1 2024-09-13T22:08:54.099 INFO:tasks.workunit.client.1.smithi159.stdout:4/111: unlink ca 0 2024-09-13T22:08:54.099 INFO:tasks.workunit.client.1.smithi159.stdout:4/112: dread - d13/d15/f17 zero size 2024-09-13T22:08:54.099 INFO:tasks.workunit.client.1.smithi159.stdout:4/113: write d13/d15/f1d [946289,13563] 0 2024-09-13T22:08:54.101 INFO:tasks.workunit.client.1.smithi159.stdout:1/114: rmdir dd/d1e 39 2024-09-13T22:08:54.102 INFO:tasks.workunit.client.1.smithi159.stdout:4/114: rmdir d13 39 2024-09-13T22:08:54.103 INFO:tasks.workunit.client.1.smithi159.stdout:5/94: dwrite d1/f8 [0,4194304] 0 2024-09-13T22:08:54.103 INFO:tasks.workunit.client.1.smithi159.stdout:1/115: mkdir dd/d11/d21 0 2024-09-13T22:08:54.104 INFO:tasks.workunit.client.1.smithi159.stdout:4/115: mkdir d13/d20 0 2024-09-13T22:08:54.113 INFO:tasks.workunit.client.1.smithi159.stdout:5/95: dread d1/f8 [0,4194304] 0 2024-09-13T22:08:54.113 INFO:tasks.workunit.client.1.smithi159.stdout:5/96: chown d1/f5 801652 1 2024-09-13T22:08:54.114 INFO:tasks.workunit.client.1.smithi159.stdout:5/97: unlink d1/f1a 0 2024-09-13T22:08:54.115 INFO:tasks.workunit.client.1.smithi159.stdout:5/98: creat d1/d15/f24 x:0 0 0 2024-09-13T22:08:54.115 INFO:tasks.workunit.client.1.smithi159.stdout:5/99: creat d1/db/f25 x:0 0 0 2024-09-13T22:08:54.115 INFO:tasks.workunit.client.1.smithi159.stdout:5/100: creat d1/d15/f26 x:0 0 0 2024-09-13T22:08:54.118 INFO:tasks.workunit.client.1.smithi159.stdout:5/101: rename d1/lf to d1/d11/d1c/l27 0 2024-09-13T22:08:54.119 INFO:tasks.workunit.client.1.smithi159.stdout:5/102: symlink d1/d11/l28 0 2024-09-13T22:08:54.119 INFO:tasks.workunit.client.1.smithi159.stdout:4/116: dwrite f10 [0,4194304] 0 2024-09-13T22:08:54.121 INFO:tasks.workunit.client.1.smithi159.stdout:4/117: link d13/d15/f1f d13/d15/f21 0 2024-09-13T22:08:54.121 INFO:tasks.workunit.client.1.smithi159.stdout:1/116: rmdir dd 39 2024-09-13T22:08:54.123 INFO:tasks.workunit.client.1.smithi159.stdout:4/118: creat d13/f22 x:0 0 0 2024-09-13T22:08:54.123 INFO:tasks.workunit.client.1.smithi159.stdout:4/119: write d13/f22 [44722,62167] 0 2024-09-13T22:08:54.123 INFO:tasks.workunit.client.1.smithi159.stdout:4/120: write d13/d15/f1d [70926,98436] 0 2024-09-13T22:08:54.124 INFO:tasks.workunit.client.1.smithi159.stdout:1/117: creat dd/d1e/f22 x:0 0 0 2024-09-13T22:08:54.126 INFO:tasks.workunit.client.1.smithi159.stdout:4/121: symlink d13/l23 0 2024-09-13T22:08:54.126 INFO:tasks.workunit.client.1.smithi159.stdout:4/122: creat d13/f24 x:0 0 0 2024-09-13T22:08:54.129 INFO:tasks.workunit.client.1.smithi159.stdout:4/123: unlink d13/d15/f1c 0 2024-09-13T22:08:54.131 INFO:tasks.workunit.client.1.smithi159.stdout:1/118: dread f3 [0,4194304] 0 2024-09-13T22:08:54.131 INFO:tasks.workunit.client.1.smithi159.stdout:1/119: getdents dd/d11/d21 0 2024-09-13T22:08:54.133 INFO:tasks.workunit.client.1.smithi159.stdout:4/124: link d13/d15/f17 d13/d15/f25 0 2024-09-13T22:08:54.133 INFO:tasks.workunit.client.1.smithi159.stdout:4/125: chown d13/d15/f25 25316770 1 2024-09-13T22:08:54.134 INFO:tasks.workunit.client.1.smithi159.stdout:1/120: getdents dd/d11/d18 0 2024-09-13T22:08:54.135 INFO:tasks.workunit.client.1.smithi159.stdout:4/126: mkdir d13/d15/d26 0 2024-09-13T22:08:54.137 INFO:tasks.workunit.client.1.smithi159.stdout:5/103: getdents d1/d11 0 2024-09-13T22:08:54.139 INFO:tasks.workunit.client.1.smithi159.stdout:1/121: link f9 dd/d11/d18/f23 0 2024-09-13T22:08:54.140 INFO:tasks.workunit.client.1.smithi159.stdout:4/127: symlink d13/d15/d26/l27 0 2024-09-13T22:08:54.143 INFO:tasks.workunit.client.1.smithi159.stdout:1/122: creat dd/d11/f24 x:0 0 0 2024-09-13T22:08:54.143 INFO:tasks.workunit.client.1.smithi159.stdout:1/123: dread - dd/f1b zero size 2024-09-13T22:08:54.144 INFO:tasks.workunit.client.1.smithi159.stdout:4/128: mknod d13/c28 0 2024-09-13T22:08:54.144 INFO:tasks.workunit.client.1.smithi159.stdout:4/129: fsync f10 0 2024-09-13T22:08:54.144 INFO:tasks.workunit.client.1.smithi159.stdout:4/130: fsync f8 0 2024-09-13T22:08:54.145 INFO:tasks.workunit.client.1.smithi159.stdout:4/131: mkdir d13/d15/d26/d29 0 2024-09-13T22:08:54.147 INFO:tasks.workunit.client.1.smithi159.stdout:4/132: symlink d13/d20/l2a 0 2024-09-13T22:08:54.147 INFO:tasks.workunit.client.1.smithi159.stdout:4/133: fsync f8 0 2024-09-13T22:08:54.147 INFO:tasks.workunit.client.1.smithi159.stdout:4/134: write d13/f14 [229897,98219] 0 2024-09-13T22:08:54.151 INFO:tasks.workunit.client.1.smithi159.stdout:1/124: dread f7 [4194304,4194304] 0 2024-09-13T22:08:54.154 INFO:tasks.workunit.client.1.smithi159.stdout:1/125: creat dd/d1c/f25 x:0 0 0 2024-09-13T22:08:54.154 INFO:tasks.workunit.client.1.smithi159.stdout:1/126: fsync dd/d1e/f1f 0 2024-09-13T22:08:54.154 INFO:tasks.workunit.client.1.smithi159.stdout:1/127: creat dd/d1c/f26 x:0 0 0 2024-09-13T22:08:54.154 INFO:tasks.workunit.client.1.smithi159.stdout:1/128: write dd/d1e/f22 [271565,78104] 0 2024-09-13T22:08:54.162 INFO:tasks.workunit.client.1.smithi159.stdout:4/135: dwrite d13/f19 [0,4194304] 0 2024-09-13T22:08:54.162 INFO:tasks.workunit.client.1.smithi159.stdout:4/136: chown d13/d20 7721694 1 2024-09-13T22:08:54.165 INFO:tasks.workunit.client.1.smithi159.stdout:4/137: mknod d13/d15/c2b 0 2024-09-13T22:08:54.166 INFO:tasks.workunit.client.1.smithi159.stdout:4/138: symlink d13/l2c 0 2024-09-13T22:08:54.166 INFO:tasks.workunit.client.1.smithi159.stdout:4/139: chown d13/l23 21 1 2024-09-13T22:08:54.167 INFO:tasks.workunit.client.1.smithi159.stdout:4/140: getdents d13/d15/d26 0 2024-09-13T22:08:54.167 INFO:tasks.workunit.client.1.smithi159.stdout:1/129: truncate dd/d1e/f22 240607 0 2024-09-13T22:08:54.171 INFO:tasks.workunit.client.1.smithi159.stdout:4/141: link l3 d13/d15/d26/l2d 0 2024-09-13T22:08:54.201 INFO:tasks.workunit.client.1.smithi159.stdout:1/130: dwrite dd/d11/f24 [0,4194304] 0 2024-09-13T22:08:54.201 INFO:tasks.workunit.client.1.smithi159.stdout:1/131: creat dd/d1c/f27 x:0 0 0 2024-09-13T22:08:54.201 INFO:tasks.workunit.client.1.smithi159.stdout:1/132: dread - dd/f1b zero size 2024-09-13T22:08:54.201 INFO:tasks.workunit.client.1.smithi159.stdout:1/133: write dd/d1c/f26 [667,71095] 0 2024-09-13T22:08:54.202 INFO:tasks.workunit.client.1.smithi159.stdout:4/142: dwrite f8 [0,4194304] 0 2024-09-13T22:08:54.203 INFO:tasks.workunit.client.1.smithi159.stdout:4/143: mkdir d13/d15/d2e 0 2024-09-13T22:08:54.204 INFO:tasks.workunit.client.1.smithi159.stdout:1/134: dread f7 [4194304,4194304] 0 2024-09-13T22:08:54.204 INFO:tasks.workunit.client.1.smithi159.stdout:4/144: truncate d13/d15/f1d 751607 0 2024-09-13T22:08:54.207 INFO:tasks.workunit.client.1.smithi159.stdout:1/135: rename dd/d1c/f27 to dd/d1e/f28 0 2024-09-13T22:08:54.209 INFO:tasks.workunit.client.1.smithi159.stdout:1/136: read dd/ff [323055,116011] 0 2024-09-13T22:08:54.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/137: creat dd/d11/d18/f29 x:0 0 0 2024-09-13T22:08:54.213 INFO:tasks.workunit.client.1.smithi159.stdout:1/138: symlink dd/d11/d13/l2a 0 2024-09-13T22:08:54.216 INFO:tasks.workunit.client.1.smithi159.stdout:1/139: rename dd/d11/d18/f29 to dd/d11/d18/f2b 0 2024-09-13T22:08:54.217 INFO:tasks.workunit.client.1.smithi159.stdout:1/140: symlink dd/d1e/l2c 0 2024-09-13T22:08:54.218 INFO:tasks.workunit.client.1.smithi159.stdout:1/141: chown dd/d11/d18/l1a 194 1 2024-09-13T22:08:54.219 INFO:tasks.workunit.client.1.smithi159.stdout:1/142: chown dd/l17 97 1 2024-09-13T22:08:54.220 INFO:tasks.workunit.client.1.smithi159.stdout:1/143: mkdir dd/d11/d19/d2d 0 2024-09-13T22:08:54.229 INFO:tasks.workunit.client.1.smithi159.stdout:4/145: dwrite d13/d15/f21 [0,4194304] 0 2024-09-13T22:08:54.301 INFO:tasks.workunit.client.1.smithi159.stdout:4/146: mknod d13/c2f 0 2024-09-13T22:08:54.305 INFO:tasks.workunit.client.1.smithi159.stdout:4/147: symlink d13/d15/d26/d29/l30 0 2024-09-13T22:08:54.308 INFO:tasks.workunit.client.1.smithi159.stdout:3/94: sync 2024-09-13T22:08:54.308 INFO:tasks.workunit.client.1.smithi159.stdout:8/47: sync 2024-09-13T22:08:54.308 INFO:tasks.workunit.client.1.smithi159.stdout:8/48: fsync f8 0 2024-09-13T22:08:54.309 INFO:tasks.workunit.client.1.smithi159.stdout:8/49: symlink da/lf 0 2024-09-13T22:08:54.311 INFO:tasks.workunit.client.1.smithi159.stdout:8/50: creat da/f10 x:0 0 0 2024-09-13T22:08:54.312 INFO:tasks.workunit.client.1.smithi159.stdout:8/51: dread - da/f10 zero size 2024-09-13T22:08:54.312 INFO:tasks.workunit.client.1.smithi159.stdout:8/52: stat da/ld 0 2024-09-13T22:08:54.312 INFO:tasks.workunit.client.1.smithi159.stdout:8/53: chown da/cb 154485 1 2024-09-13T22:08:54.314 INFO:tasks.workunit.client.1.smithi159.stdout:4/148: write d13/d15/f21 [3868764,100811] 0 2024-09-13T22:08:54.319 INFO:tasks.workunit.client.1.smithi159.stdout:3/95: dread d0/d1/f2 [0,4194304] 0 2024-09-13T22:08:54.319 INFO:tasks.workunit.client.1.smithi159.stdout:8/54: rmdir da 39 2024-09-13T22:08:54.320 INFO:tasks.workunit.client.1.smithi159.stdout:3/96: dread - d0/d1/d3/d5/d14/f19 zero size 2024-09-13T22:08:54.320 INFO:tasks.workunit.client.1.smithi159.stdout:3/97: truncate d0/d1/d3/d5/d14/f19 570981 0 2024-09-13T22:08:54.320 INFO:tasks.workunit.client.1.smithi159.stdout:3/98: creat d0/d1/d3/f1f x:0 0 0 2024-09-13T22:08:54.320 INFO:tasks.workunit.client.1.smithi159.stdout:3/99: creat d0/d1/d3/dd/f20 x:0 0 0 2024-09-13T22:08:54.320 INFO:tasks.workunit.client.1.smithi159.stdout:3/100: creat d0/d1/d3/d5/d14/f21 x:0 0 0 2024-09-13T22:08:54.321 INFO:tasks.workunit.client.1.smithi159.stdout:8/55: symlink da/l11 0 2024-09-13T22:08:54.321 INFO:tasks.workunit.client.1.smithi159.stdout:8/56: write f8 [3790487,15929] 0 2024-09-13T22:08:54.323 INFO:tasks.workunit.client.1.smithi159.stdout:4/149: dread f2 [0,4194304] 0 2024-09-13T22:08:54.323 INFO:tasks.workunit.client.1.smithi159.stdout:4/150: chown d13/d15 1995 1 2024-09-13T22:08:54.323 INFO:tasks.workunit.client.1.smithi159.stdout:4/151: truncate fc 181356 0 2024-09-13T22:08:54.325 INFO:tasks.workunit.client.1.smithi159.stdout:3/101: rmdir d0/d1/d3/d5 39 2024-09-13T22:08:54.325 INFO:tasks.workunit.client.1.smithi159.stdout:3/102: fdatasync d0/d1/d3/dd/f13 0 2024-09-13T22:08:54.348 INFO:tasks.workunit.client.1.smithi159.stdout:8/57: dwrite f7 [0,4194304] 0 2024-09-13T22:08:54.348 INFO:tasks.workunit.client.1.smithi159.stdout:8/58: chown f4 401 1 2024-09-13T22:08:54.349 INFO:tasks.workunit.client.1.smithi159.stdout:3/103: dwrite d0/d1/f1a [0,4194304] 0 2024-09-13T22:08:54.351 INFO:tasks.workunit.client.1.smithi159.stdout:3/104: symlink d0/l22 0 2024-09-13T22:08:54.352 INFO:tasks.workunit.client.1.smithi159.stdout:4/152: dwrite f2 [0,4194304] 0 2024-09-13T22:08:54.360 INFO:tasks.workunit.client.1.smithi159.stdout:3/105: dread d0/d1/f2 [0,4194304] 0 2024-09-13T22:08:54.360 INFO:tasks.workunit.client.1.smithi159.stdout:3/106: write d0/d1/d3/dd/f20 [364279,130111] 0 2024-09-13T22:08:54.362 INFO:tasks.workunit.client.1.smithi159.stdout:8/59: dread f7 [0,4194304] 0 2024-09-13T22:08:54.362 INFO:tasks.workunit.client.1.smithi159.stdout:8/60: fsync f6 0 2024-09-13T22:08:54.362 INFO:tasks.workunit.client.1.smithi159.stdout:8/61: readlink da/ld 0 2024-09-13T22:08:54.365 INFO:tasks.workunit.client.1.smithi159.stdout:3/107: mknod d0/d1/c23 0 2024-09-13T22:08:54.368 INFO:tasks.workunit.client.1.smithi159.stdout:8/62: getdents da 0 2024-09-13T22:08:54.369 INFO:tasks.workunit.client.1.smithi159.stdout:8/63: mknod da/c12 0 2024-09-13T22:08:54.371 INFO:tasks.workunit.client.1.smithi159.stdout:8/64: symlink da/l13 0 2024-09-13T22:08:54.371 INFO:tasks.workunit.client.1.smithi159.stdout:8/65: write f4 [1277483,80979] 0 2024-09-13T22:08:54.376 INFO:tasks.workunit.client.1.smithi159.stdout:8/66: write f7 [704899,20234] 0 2024-09-13T22:08:54.377 INFO:tasks.workunit.client.1.smithi159.stdout:8/67: rmdir da 39 2024-09-13T22:08:54.379 INFO:tasks.workunit.client.1.smithi159.stdout:3/108: dwrite d0/d1/d3/dd/f10 [0,4194304] 0 2024-09-13T22:08:54.379 INFO:tasks.workunit.client.1.smithi159.stdout:3/109: creat d0/d1/d3/f24 x:0 0 0 2024-09-13T22:08:54.381 INFO:tasks.workunit.client.1.smithi159.stdout:3/110: mkdir d0/d1/d3/d5/d25 0 2024-09-13T22:08:54.382 INFO:tasks.workunit.client.1.smithi159.stdout:3/111: write d0/d1/d3/dd/f1b [740346,102308] 0 2024-09-13T22:08:54.382 INFO:tasks.workunit.client.1.smithi159.stdout:3/112: fdatasync d0/d1/d3/dd/f18 0 2024-09-13T22:08:54.383 INFO:tasks.workunit.client.1.smithi159.stdout:3/113: rename d0/d1/d3/dd/f18 to d0/d1/d3/dd/f26 0 2024-09-13T22:08:54.383 INFO:tasks.workunit.client.1.smithi159.stdout:3/114: write d0/d1/d3/dd/f1b [912562,77541] 0 2024-09-13T22:08:54.468 INFO:tasks.workunit.client.1.smithi159.stdout:3/115: dread d0/d1/f1a [0,4194304] 0 2024-09-13T22:08:54.469 INFO:tasks.workunit.client.1.smithi159.stdout:4/153: dwrite f10 [0,4194304] 0 2024-09-13T22:08:54.469 INFO:tasks.workunit.client.1.smithi159.stdout:4/154: read f11 [90348,80694] 0 2024-09-13T22:08:54.470 INFO:tasks.workunit.client.1.smithi159.stdout:3/116: creat d0/d1/d3/d5/d25/f27 x:0 0 0 2024-09-13T22:08:54.470 INFO:tasks.workunit.client.1.smithi159.stdout:3/117: chown d0 955461 1 2024-09-13T22:08:54.477 INFO:tasks.workunit.client.1.smithi159.stdout:4/155: dread d13/d15/f1f [0,4194304] 0 2024-09-13T22:08:54.479 INFO:tasks.workunit.client.1.smithi159.stdout:4/156: rename d13/d15/d26/l2d to d13/l31 0 2024-09-13T22:08:54.481 INFO:tasks.workunit.client.1.smithi159.stdout:4/157: rmdir d13/d20 39 2024-09-13T22:08:54.481 INFO:tasks.workunit.client.1.smithi159.stdout:4/158: write fc [377362,91353] 0 2024-09-13T22:08:54.481 INFO:tasks.workunit.client.1.smithi159.stdout:4/159: truncate f11 974719 0 2024-09-13T22:08:54.481 INFO:tasks.workunit.client.1.smithi159.stdout:4/160: write d13/d15/f25 [593384,98638] 0 2024-09-13T22:08:54.481 INFO:tasks.workunit.client.1.smithi159.stdout:4/161: fdatasync d13/d15/f21 0 2024-09-13T22:08:54.481 INFO:tasks.workunit.client.1.smithi159.stdout:4/162: fdatasync d13/d15/f21 0 2024-09-13T22:08:54.483 INFO:tasks.workunit.client.1.smithi159.stdout:8/68: dwrite f6 [0,4194304] 0 2024-09-13T22:08:54.486 INFO:tasks.workunit.client.1.smithi159.stdout:8/69: link f4 da/f14 0 2024-09-13T22:08:54.487 INFO:tasks.workunit.client.1.smithi159.stdout:8/70: read da/f14 [571497,70056] 0 2024-09-13T22:08:54.488 INFO:tasks.workunit.client.1.smithi159.stdout:8/71: unlink da/cb 0 2024-09-13T22:08:54.495 INFO:tasks.workunit.client.1.smithi159.stdout:3/118: dwrite d0/d1/d3/d5/d14/f21 [0,4194304] 0 2024-09-13T22:08:54.495 INFO:tasks.workunit.client.1.smithi159.stdout:4/163: dread f8 [0,4194304] 0 2024-09-13T22:08:54.495 INFO:tasks.workunit.client.1.smithi159.stdout:3/119: readlink d0/l16 0 2024-09-13T22:08:54.495 INFO:tasks.workunit.client.1.smithi159.stdout:3/120: readlink d0/l16 0 2024-09-13T22:08:54.495 INFO:tasks.workunit.client.1.smithi159.stdout:3/121: readlink d0/l22 0 2024-09-13T22:08:54.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:54 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:08:54.497 INFO:tasks.workunit.client.1.smithi159.stdout:4/164: rmdir d13/d15/d2e 0 2024-09-13T22:08:54.498 INFO:tasks.workunit.client.1.smithi159.stdout:8/72: fsync da/f14 0 2024-09-13T22:08:54.498 INFO:tasks.workunit.client.1.smithi159.stdout:3/122: mknod d0/c28 0 2024-09-13T22:08:54.499 INFO:tasks.workunit.client.1.smithi159.stdout:4/165: dread d13/f14 [0,4194304] 0 2024-09-13T22:08:54.500 INFO:tasks.workunit.client.1.smithi159.stdout:8/73: creat da/f15 x:0 0 0 2024-09-13T22:08:54.500 INFO:tasks.workunit.client.1.smithi159.stdout:8/74: chown da/ce 64 1 2024-09-13T22:08:54.504 INFO:tasks.workunit.client.1.smithi159.stdout:8/75: symlink da/l16 0 2024-09-13T22:08:54.504 INFO:tasks.workunit.client.1.smithi159.stdout:8/76: chown da/f15 29474376 1 2024-09-13T22:08:54.504 INFO:tasks.workunit.client.1.smithi159.stdout:8/77: write da/f10 [12420,88162] 0 2024-09-13T22:08:54.504 INFO:tasks.workunit.client.1.smithi159.stdout:8/78: truncate f4 2015626 0 2024-09-13T22:08:54.504 INFO:tasks.workunit.client.1.smithi159.stdout:3/123: truncate d0/d1/d3/d5/d14/f21 2841917 0 2024-09-13T22:08:54.507 INFO:tasks.workunit.client.1.smithi159.stdout:4/166: mkdir d13/d15/d26/d32 0 2024-09-13T22:08:54.507 INFO:tasks.workunit.client.1.smithi159.stdout:4/167: fsync d13/d15/f1f 0 2024-09-13T22:08:54.507 INFO:tasks.workunit.client.1.smithi159.stdout:8/79: mknod da/c17 0 2024-09-13T22:08:54.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:54 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:08:54.513 INFO:tasks.workunit.client.1.smithi159.stdout:9/172: sync 2024-09-13T22:08:54.513 INFO:tasks.workunit.client.1.smithi159.stdout:9/173: write d1/d9/d3d/d2f/f37 [325495,53264] 0 2024-09-13T22:08:54.513 INFO:tasks.workunit.client.1.smithi159.stdout:3/124: write d0/d1/d3/dd/f10 [4050964,45838] 0 2024-09-13T22:08:54.515 INFO:tasks.workunit.client.1.smithi159.stdout:4/168: truncate f2 4168800 0 2024-09-13T22:08:54.516 INFO:tasks.workunit.client.1.smithi159.stdout:3/125: symlink d0/d1/d15/l29 0 2024-09-13T22:08:54.516 INFO:tasks.workunit.client.1.smithi159.stdout:3/126: read - d0/d1/d3/d5/f17 zero size 2024-09-13T22:08:54.516 INFO:tasks.workunit.client.1.smithi159.stdout:3/127: truncate d0/d1/d3/dd/f10 4500989 0 2024-09-13T22:08:54.517 INFO:tasks.workunit.client.1.smithi159.stdout:3/128: link d0/d1/d3/d5/f17 d0/d1/f2a 0 2024-09-13T22:08:54.520 INFO:tasks.workunit.client.1.smithi159.stdout:8/80: read f7 [2963052,55825] 0 2024-09-13T22:08:54.520 INFO:tasks.workunit.client.1.smithi159.stdout:8/81: write da/f10 [1145310,113876] 0 2024-09-13T22:08:54.520 INFO:tasks.workunit.client.1.smithi159.stdout:8/82: truncate da/f15 127489 0 2024-09-13T22:08:54.525 INFO:tasks.workunit.client.1.smithi159.stdout:9/174: read d1/dc/fb [4445817,11301] 0 2024-09-13T22:08:54.525 INFO:tasks.workunit.client.1.smithi159.stdout:9/175: stat d1/d9/d1f 0 2024-09-13T22:08:54.531 INFO:tasks.workunit.client.1.smithi159.stdout:9/176: mkdir d1/dc/d27/d40 0 2024-09-13T22:08:54.532 INFO:tasks.workunit.client.1.smithi159.stdout:9/177: write d1/dc/d10/f3b [113554,8658] 0 2024-09-13T22:08:54.536 INFO:tasks.workunit.client.1.smithi159.stdout:9/178: rename d1/dc/d10/f14 to d1/d9/d2a/f41 0 2024-09-13T22:08:54.536 INFO:tasks.workunit.client.1.smithi159.stdout:9/179: chown d1/d9/f38 56123968 1 2024-09-13T22:08:54.536 INFO:tasks.workunit.client.1.smithi159.stdout:9/180: write d1/d9/f2b [922768,115423] 0 2024-09-13T22:08:54.537 INFO:tasks.workunit.client.1.smithi159.stdout:8/83: dwrite f7 [4194304,4194304] 0 2024-09-13T22:08:54.537 INFO:tasks.workunit.client.1.smithi159.stdout:9/181: rename d1/d9/d3d/d2f/c3f to d1/d9/d3d/c42 0 2024-09-13T22:08:54.541 INFO:tasks.workunit.client.1.smithi159.stdout:8/84: unlink l0 0 2024-09-13T22:08:54.543 INFO:tasks.workunit.client.1.smithi159.stdout:8/85: getdents da 0 2024-09-13T22:08:54.543 INFO:tasks.workunit.client.1.smithi159.stdout:4/169: dwrite d13/d15/f21 [0,4194304] 0 2024-09-13T22:08:54.546 INFO:tasks.workunit.client.1.smithi159.stdout:8/86: dread da/f14 [0,4194304] 0 2024-09-13T22:08:54.547 INFO:tasks.workunit.client.1.smithi159.stdout:4/170: creat d13/d15/d26/f33 x:0 0 0 2024-09-13T22:08:54.551 INFO:tasks.workunit.client.1.smithi159.stdout:8/87: dread da/f10 [0,4194304] 0 2024-09-13T22:08:54.551 INFO:tasks.workunit.client.1.smithi159.stdout:8/88: write da/f14 [350578,84245] 0 2024-09-13T22:08:54.557 INFO:tasks.workunit.client.1.smithi159.stdout:3/129: dwrite d0/d1/d3/d5/fe [0,4194304] 0 2024-09-13T22:08:54.557 INFO:tasks.workunit.client.1.smithi159.stdout:3/130: dread - d0/d1/f2a zero size 2024-09-13T22:08:54.574 INFO:tasks.workunit.client.1.smithi159.stdout:4/171: dwrite f8 [0,4194304] 0 2024-09-13T22:08:54.574 INFO:tasks.workunit.client.1.smithi159.stdout:8/89: dwrite f4 [0,4194304] 0 2024-09-13T22:08:54.575 INFO:tasks.workunit.client.1.smithi159.stdout:4/172: creat d13/d15/d26/f34 x:0 0 0 2024-09-13T22:08:54.575 INFO:tasks.workunit.client.1.smithi159.stdout:4/173: fsync f10 0 2024-09-13T22:08:54.576 INFO:tasks.workunit.client.1.smithi159.stdout:4/174: symlink d13/d15/l35 0 2024-09-13T22:08:54.579 INFO:tasks.workunit.client.1.smithi159.stdout:3/131: write d0/d1/d3/d5/fe [5201144,11783] 0 2024-09-13T22:08:54.579 INFO:tasks.workunit.client.1.smithi159.stdout:4/175: unlink c0 0 2024-09-13T22:08:54.580 INFO:tasks.workunit.client.1.smithi159.stdout:4/176: truncate d13/d15/f21 5119429 0 2024-09-13T22:08:54.581 INFO:tasks.workunit.client.1.smithi159.stdout:3/132: symlink d0/d1/d3/d5/d25/l2b 0 2024-09-13T22:08:54.582 INFO:tasks.workunit.client.1.smithi159.stdout:8/90: truncate f6 6376411 0 2024-09-13T22:08:54.583 INFO:tasks.workunit.client.1.smithi159.stdout:3/133: dread d0/d1/d3/dd/f1b [0,4194304] 0 2024-09-13T22:08:54.584 INFO:tasks.workunit.client.1.smithi159.stdout:3/134: mkdir d0/d1/d3/d5/d25/d2c 0 2024-09-13T22:08:54.584 INFO:tasks.workunit.client.1.smithi159.stdout:3/135: chown d0/d1/d3/f1f 438474 1 2024-09-13T22:08:54.586 INFO:tasks.workunit.client.1.smithi159.stdout:3/136: creat d0/d1/d3/d5/d25/d2c/f2d x:0 0 0 2024-09-13T22:08:54.588 INFO:tasks.workunit.client.1.smithi159.stdout:8/91: write f6 [4057429,78480] 0 2024-09-13T22:08:54.588 INFO:tasks.workunit.client.1.smithi159.stdout:8/92: stat da/c17 0 2024-09-13T22:08:54.588 INFO:tasks.workunit.client.1.smithi159.stdout:8/93: chown f4 497 1 2024-09-13T22:08:54.588 INFO:tasks.workunit.client.1.smithi159.stdout:8/94: chown da/lf 151 1 2024-09-13T22:08:54.594 INFO:tasks.workunit.client.1.smithi159.stdout:8/95: creat da/f18 x:0 0 0 2024-09-13T22:08:54.594 INFO:tasks.workunit.client.1.smithi159.stdout:8/96: creat da/f19 x:0 0 0 2024-09-13T22:08:54.598 INFO:tasks.workunit.client.1.smithi159.stdout:8/97: symlink da/l1a 0 2024-09-13T22:08:54.601 INFO:tasks.workunit.client.1.smithi159.stdout:8/98: symlink da/l1b 0 2024-09-13T22:08:54.607 INFO:tasks.workunit.client.1.smithi159.stdout:3/137: dwrite d0/d1/d3/dd/f13 [4194304,4194304] 0 2024-09-13T22:08:54.607 INFO:tasks.workunit.client.1.smithi159.stdout:3/138: chown d0/l22 616 1 2024-09-13T22:08:54.609 INFO:tasks.workunit.client.1.smithi159.stdout:3/139: mknod d0/d1/d3/d5/c2e 0 2024-09-13T22:08:54.609 INFO:tasks.workunit.client.1.smithi159.stdout:3/140: mknod d0/d1/d15/c2f 0 2024-09-13T22:08:54.612 INFO:tasks.workunit.client.1.smithi159.stdout:8/99: write f4 [4096200,20952] 0 2024-09-13T22:08:54.614 INFO:tasks.workunit.client.1.smithi159.stdout:8/100: getdents da 0 2024-09-13T22:08:54.614 INFO:tasks.workunit.client.1.smithi159.stdout:8/101: write da/f18 [467983,6410] 0 2024-09-13T22:08:54.619 INFO:tasks.workunit.client.1.smithi159.stdout:3/141: dread d0/d1/d3/dd/f13 [0,4194304] 0 2024-09-13T22:08:54.619 INFO:tasks.workunit.client.1.smithi159.stdout:3/142: creat d0/d1/d3/dd/f30 x:0 0 0 2024-09-13T22:08:54.621 INFO:tasks.workunit.client.1.smithi159.stdout:3/143: rename d0/d1/d3/d5/fe to d0/d1/d3/d5/f31 0 2024-09-13T22:08:54.622 INFO:tasks.workunit.client.1.smithi159.stdout:3/144: creat d0/d1/d3/d5/d25/d2c/f32 x:0 0 0 2024-09-13T22:08:54.622 INFO:tasks.workunit.client.1.smithi159.stdout:3/145: write d0/d1/d3/f1f [153848,124759] 0 2024-09-13T22:08:54.623 INFO:tasks.workunit.client.1.smithi159.stdout:8/102: dread f7 [0,4194304] 0 2024-09-13T22:08:54.635 INFO:tasks.workunit.client.1.smithi159.stdout:7/127: sync 2024-09-13T22:08:54.635 INFO:tasks.workunit.client.1.smithi159.stdout:7/128: chown d3/l21 54553 1 2024-09-13T22:08:54.635 INFO:tasks.workunit.client.1.smithi159.stdout:7/129: stat d3/f9 0 2024-09-13T22:08:54.636 INFO:tasks.workunit.client.1.smithi159.stdout:3/146: dread d0/d1/d3/d5/f31 [0,4194304] 0 2024-09-13T22:08:54.636 INFO:tasks.workunit.client.1.smithi159.stdout:3/147: creat d0/d1/d3/d5/d25/d2c/f33 x:0 0 0 2024-09-13T22:08:54.636 INFO:tasks.workunit.client.1.smithi159.stdout:3/148: chown d0/l16 1864 1 2024-09-13T22:08:54.636 INFO:tasks.workunit.client.1.smithi159.stdout:3/149: fsync d0/d1/f2a 0 2024-09-13T22:08:54.636 INFO:tasks.workunit.client.1.smithi159.stdout:3/150: readlink d0/d1/d3/d5/l11 0 2024-09-13T22:08:54.636 INFO:tasks.workunit.client.1.smithi159.stdout:3/151: readlink d0/d1/d15/l29 0 2024-09-13T22:08:54.639 INFO:tasks.workunit.client.1.smithi159.stdout:3/152: mkdir d0/d1/d34 0 2024-09-13T22:08:54.644 INFO:tasks.workunit.client.1.smithi159.stdout:3/153: dread d0/d1/d3/dd/f10 [0,4194304] 0 2024-09-13T22:08:54.646 INFO:tasks.workunit.client.1.smithi159.stdout:3/154: mkdir d0/d1/d3/d35 0 2024-09-13T22:08:54.650 INFO:tasks.workunit.client.1.smithi159.stdout:3/155: mkdir d0/d1/d3/dd/d36 0 2024-09-13T22:08:54.652 INFO:tasks.workunit.client.1.smithi159.stdout:8/103: dwrite da/f15 [0,4194304] 0 2024-09-13T22:08:54.656 INFO:tasks.workunit.client.1.smithi159.stdout:8/104: link da/c17 da/c1c 0 2024-09-13T22:08:54.656 INFO:tasks.workunit.client.1.smithi159.stdout:8/105: write da/f19 [453608,69410] 0 2024-09-13T22:08:54.657 INFO:tasks.workunit.client.1.smithi159.stdout:7/130: dwrite d3/f9 [0,4194304] 0 2024-09-13T22:08:54.662 INFO:tasks.workunit.client.1.smithi159.stdout:3/156: write d0/d1/d3/d5/d14/f21 [1850328,105853] 0 2024-09-13T22:08:54.662 INFO:tasks.workunit.client.1.smithi159.stdout:3/157: write d0/d1/d3/d5/d14/f19 [925889,45992] 0 2024-09-13T22:08:54.662 INFO:tasks.workunit.client.1.smithi159.stdout:3/158: write d0/d1/d3/f1c [981933,127544] 0 2024-09-13T22:08:54.663 INFO:tasks.workunit.client.1.smithi159.stdout:7/131: mknod d3/c26 0 2024-09-13T22:08:54.664 INFO:tasks.workunit.client.1.smithi159.stdout:3/159: symlink d0/d1/d3/d5/d14/l37 0 2024-09-13T22:08:54.666 INFO:tasks.workunit.client.1.smithi159.stdout:7/132: creat d3/f27 x:0 0 0 2024-09-13T22:08:54.666 INFO:tasks.workunit.client.1.smithi159.stdout:7/133: chown d3/f1a 14015549 1 2024-09-13T22:08:54.667 INFO:tasks.workunit.client.1.smithi159.stdout:3/160: creat d0/d1/d3/d35/f38 x:0 0 0 2024-09-13T22:08:54.668 INFO:tasks.workunit.client.1.smithi159.stdout:7/134: symlink d3/d18/l28 0 2024-09-13T22:08:54.669 INFO:tasks.workunit.client.1.smithi159.stdout:3/161: mkdir d0/d1/d3/d5/db/d39 0 2024-09-13T22:08:54.671 INFO:tasks.workunit.client.1.smithi159.stdout:7/135: mknod d3/c29 0 2024-09-13T22:08:54.673 INFO:tasks.workunit.client.1.smithi159.stdout:3/162: write d0/d1/d3/dd/f13 [2744457,60653] 0 2024-09-13T22:08:54.673 INFO:tasks.workunit.client.1.smithi159.stdout:3/163: chown d0/d1/d3/dd/l1e 165 1 2024-09-13T22:08:54.673 INFO:tasks.workunit.client.1.smithi159.stdout:3/164: stat d0/d1/d3/d5 0 2024-09-13T22:08:54.681 INFO:tasks.workunit.client.1.smithi159.stdout:8/106: getdents da 0 2024-09-13T22:08:54.689 INFO:tasks.workunit.client.1.smithi159.stdout:8/107: dread f8 [0,4194304] 0 2024-09-13T22:08:54.689 INFO:tasks.workunit.client.1.smithi159.stdout:8/108: stat c3 0 2024-09-13T22:08:54.690 INFO:tasks.workunit.client.1.smithi159.stdout:8/109: truncate da/f19 620634 0 2024-09-13T22:08:54.690 INFO:tasks.workunit.client.1.smithi159.stdout:8/110: symlink da/l1d 0 2024-09-13T22:08:54.698 INFO:tasks.workunit.client.1.smithi159.stdout:3/165: dwrite d0/d1/d3/d5/d25/d2c/f32 [0,4194304] 0 2024-09-13T22:08:54.703 INFO:tasks.workunit.client.1.smithi159.stdout:7/136: dwrite d3/f1a [0,4194304] 0 2024-09-13T22:08:54.704 INFO:tasks.workunit.client.1.smithi159.stdout:7/137: creat d3/f2a x:0 0 0 2024-09-13T22:08:54.726 INFO:tasks.workunit.client.1.smithi159.stdout:8/111: dwrite da/f15 [0,4194304] 0 2024-09-13T22:08:54.727 INFO:tasks.workunit.client.1.smithi159.stdout:7/138: dwrite d3/f9 [0,4194304] 0 2024-09-13T22:08:54.727 INFO:tasks.workunit.client.1.smithi159.stdout:7/139: fsync d3/f27 0 2024-09-13T22:08:54.727 INFO:tasks.workunit.client.1.smithi159.stdout:3/166: dwrite d0/d1/d3/dd/f30 [0,4194304] 0 2024-09-13T22:08:54.727 INFO:tasks.workunit.client.1.smithi159.stdout:8/112: symlink da/l1e 0 2024-09-13T22:08:54.728 INFO:tasks.workunit.client.1.smithi159.stdout:7/140: unlink d3/f13 0 2024-09-13T22:08:54.731 INFO:tasks.workunit.client.1.smithi159.stdout:8/113: symlink da/l1f 0 2024-09-13T22:08:54.732 INFO:tasks.workunit.client.1.smithi159.stdout:7/141: mknod d3/c2b 0 2024-09-13T22:08:54.732 INFO:tasks.workunit.client.1.smithi159.stdout:7/142: fsync d3/f27 0 2024-09-13T22:08:54.734 INFO:tasks.workunit.client.1.smithi159.stdout:8/114: mknod da/c20 0 2024-09-13T22:08:54.735 INFO:tasks.workunit.client.1.smithi159.stdout:7/143: symlink d3/d18/l2c 0 2024-09-13T22:08:54.737 INFO:tasks.workunit.client.1.smithi159.stdout:8/115: write da/f18 [116941,104670] 0 2024-09-13T22:08:54.739 INFO:tasks.workunit.client.1.smithi159.stdout:7/144: rename d3/c22 to d3/d18/c2d 0 2024-09-13T22:08:54.740 INFO:tasks.workunit.client.1.smithi159.stdout:8/116: symlink da/l21 0 2024-09-13T22:08:54.741 INFO:tasks.workunit.client.1.smithi159.stdout:8/117: write f4 [581393,3888] 0 2024-09-13T22:08:54.741 INFO:tasks.workunit.client.1.smithi159.stdout:8/118: chown f7 106687336 1 2024-09-13T22:08:54.745 INFO:tasks.workunit.client.1.smithi159.stdout:8/119: mkdir da/d22 0 2024-09-13T22:08:54.745 INFO:tasks.workunit.client.1.smithi159.stdout:8/120: chown da/l1d 63633 1 2024-09-13T22:08:54.750 INFO:tasks.workunit.client.1.smithi159.stdout:8/121: dread f8 [0,4194304] 0 2024-09-13T22:08:54.751 INFO:tasks.workunit.client.1.smithi159.stdout:3/167: dwrite d0/d1/d3/dd/f30 [0,4194304] 0 2024-09-13T22:08:54.753 INFO:tasks.workunit.client.1.smithi159.stdout:3/168: fsync d0/d1/d3/d5/d14/f21 0 2024-09-13T22:08:54.754 INFO:tasks.workunit.client.1.smithi159.stdout:8/122: symlink da/l23 0 2024-09-13T22:08:54.757 INFO:tasks.workunit.client.1.smithi159.stdout:3/169: write d0/d1/f1a [83897,42383] 0 2024-09-13T22:08:54.762 INFO:tasks.workunit.client.1.smithi159.stdout:7/145: getdents d3 0 2024-09-13T22:08:54.762 INFO:tasks.workunit.client.1.smithi159.stdout:7/146: write d3/f1c [800432,26944] 0 2024-09-13T22:08:54.762 INFO:tasks.workunit.client.1.smithi159.stdout:7/147: write d3/f1f [897652,46838] 0 2024-09-13T22:08:54.762 INFO:tasks.workunit.client.1.smithi159.stdout:7/148: write d3/ff [988329,50316] 0 2024-09-13T22:08:54.762 INFO:tasks.workunit.client.1.smithi159.stdout:7/149: fdatasync d3/f9 0 2024-09-13T22:08:54.780 INFO:tasks.workunit.client.1.smithi159.stdout:8/123: symlink da/l24 0 2024-09-13T22:08:54.780 INFO:tasks.workunit.client.1.smithi159.stdout:8/124: stat da/l1e 0 2024-09-13T22:08:54.781 INFO:tasks.workunit.client.1.smithi159.stdout:3/170: dwrite d0/d1/d3/d5/d14/f21 [0,4194304] 0 2024-09-13T22:08:54.782 INFO:tasks.workunit.client.1.smithi159.stdout:7/150: dwrite d3/f1e [0,4194304] 0 2024-09-13T22:08:54.785 INFO:tasks.workunit.client.1.smithi159.stdout:8/125: mknod da/c25 0 2024-09-13T22:08:54.791 INFO:tasks.workunit.client.1.smithi159.stdout:7/151: mkdir d3/d2e 0 2024-09-13T22:08:54.792 INFO:tasks.workunit.client.1.smithi159.stdout:8/126: mkdir da/d22/d26 0 2024-09-13T22:08:54.793 INFO:tasks.workunit.client.1.smithi159.stdout:7/152: creat d3/f2f x:0 0 0 2024-09-13T22:08:54.795 INFO:tasks.workunit.client.1.smithi159.stdout:8/127: creat da/d22/f27 x:0 0 0 2024-09-13T22:08:54.797 INFO:tasks.workunit.client.1.smithi159.stdout:8/128: rename da/l1d to da/l28 0 2024-09-13T22:08:54.799 INFO:tasks.workunit.client.1.smithi159.stdout:8/129: truncate f7 3586761 0 2024-09-13T22:08:54.801 INFO:tasks.workunit.client.1.smithi159.stdout:8/130: write da/f10 [190959,129521] 0 2024-09-13T22:08:54.813 INFO:tasks.workunit.client.1.smithi159.stdout:3/171: dwrite d0/d1/d3/dd/f30 [0,4194304] 0 2024-09-13T22:08:54.813 INFO:tasks.workunit.client.1.smithi159.stdout:8/131: fdatasync da/f10 0 2024-09-13T22:08:54.813 INFO:tasks.workunit.client.1.smithi159.stdout:8/132: write da/f14 [3199873,125758] 0 2024-09-13T22:08:54.813 INFO:tasks.workunit.client.1.smithi159.stdout:8/133: chown da/f10 70 1 2024-09-13T22:08:54.813 INFO:tasks.workunit.client.1.smithi159.stdout:8/134: readlink da/l1e 0 2024-09-13T22:08:54.815 INFO:tasks.workunit.client.1.smithi159.stdout:0/246: sync 2024-09-13T22:08:54.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/100: sync 2024-09-13T22:08:54.815 INFO:tasks.workunit.client.1.smithi159.stdout:0/247: fsync d0/d7/f3f 0 2024-09-13T22:08:54.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/101: truncate d9/fe 996759 0 2024-09-13T22:08:54.815 INFO:tasks.workunit.client.1.smithi159.stdout:0/248: truncate d0/d2c/f37 5006090 0 2024-09-13T22:08:54.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/102: fsync d9/f1b 0 2024-09-13T22:08:54.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/103: write d9/da/f14 [448123,82666] 0 2024-09-13T22:08:54.816 INFO:tasks.workunit.client.1.smithi159.stdout:3/172: getdents d0/d1/d3/d5/db 0 2024-09-13T22:08:54.816 INFO:tasks.workunit.client.1.smithi159.stdout:3/173: chown d0/d1/d3/f1f 0 1 2024-09-13T22:08:54.818 INFO:tasks.workunit.client.1.smithi159.stdout:7/153: dwrite d3/d18/f1d [0,4194304] 0 2024-09-13T22:08:54.822 INFO:tasks.workunit.client.1.smithi159.stdout:7/154: dread d3/f15 [4194304,4194304] 0 2024-09-13T22:08:54.823 INFO:tasks.workunit.client.1.smithi159.stdout:7/155: write d3/f1c [524026,2669] 0 2024-09-13T22:08:54.825 INFO:tasks.workunit.client.1.smithi159.stdout:7/156: rename d3/d18/c19 to d3/c30 0 2024-09-13T22:08:54.825 INFO:tasks.workunit.client.1.smithi159.stdout:2/104: dread d9/da/f18 [0,4194304] 0 2024-09-13T22:08:54.826 INFO:tasks.workunit.client.1.smithi159.stdout:7/157: mkdir d3/d31 0 2024-09-13T22:08:54.828 INFO:tasks.workunit.client.1.smithi159.stdout:7/158: dread d3/d18/f1d [4194304,4194304] 0 2024-09-13T22:08:54.828 INFO:tasks.workunit.client.1.smithi159.stdout:7/159: creat d3/d18/f32 x:0 0 0 2024-09-13T22:08:54.828 INFO:tasks.workunit.client.1.smithi159.stdout:2/105: link d9/da/c17 d9/da/c23 0 2024-09-13T22:08:54.828 INFO:tasks.workunit.client.1.smithi159.stdout:2/106: fdatasync d9/da/f22 0 2024-09-13T22:08:54.830 INFO:tasks.workunit.client.1.smithi159.stdout:7/160: rename d3/f27 to d3/d31/f33 0 2024-09-13T22:08:54.831 INFO:tasks.workunit.client.1.smithi159.stdout:7/161: creat d3/f34 x:0 0 0 2024-09-13T22:08:54.831 INFO:tasks.workunit.client.1.smithi159.stdout:2/107: creat d9/da/f24 x:0 0 0 2024-09-13T22:08:54.834 INFO:tasks.workunit.client.1.smithi159.stdout:3/174: dread d0/d1/d3/dd/f13 [4194304,4194304] 0 2024-09-13T22:08:54.834 INFO:tasks.workunit.client.1.smithi159.stdout:7/162: creat d3/d2e/f35 x:0 0 0 2024-09-13T22:08:54.845 INFO:tasks.workunit.client.1.smithi159.stdout:8/135: dwrite f8 [0,4194304] 0 2024-09-13T22:08:54.846 INFO:tasks.workunit.client.1.smithi159.stdout:2/108: write d9/da/f1a [3383493,18227] 0 2024-09-13T22:08:54.848 INFO:tasks.workunit.client.1.smithi159.stdout:2/109: mkdir d9/da/d25 0 2024-09-13T22:08:54.848 INFO:tasks.workunit.client.1.smithi159.stdout:2/110: creat d9/da/f26 x:0 0 0 2024-09-13T22:08:54.848 INFO:tasks.workunit.client.1.smithi159.stdout:2/111: write d9/da/f24 [100901,63331] 0 2024-09-13T22:08:54.856 INFO:tasks.workunit.client.1.smithi159.stdout:0/249: dwrite d0/d7/f4b [0,4194304] 0 2024-09-13T22:08:54.856 INFO:tasks.workunit.client.1.smithi159.stdout:0/250: stat d0/d2c/f37 0 2024-09-13T22:08:54.856 INFO:tasks.workunit.client.1.smithi159.stdout:0/251: fsync d0/d7/f1e 0 2024-09-13T22:08:54.856 INFO:tasks.workunit.client.1.smithi159.stdout:3/175: dwrite d0/d1/d3/f24 [0,4194304] 0 2024-09-13T22:08:54.859 INFO:tasks.workunit.client.1.smithi159.stdout:0/252: rename d0/d48/d4f/fd to d0/d7/f51 0 2024-09-13T22:08:54.865 INFO:tasks.workunit.client.1.smithi159.stdout:3/176: unlink d0/d1/d15/l29 0 2024-09-13T22:08:54.872 INFO:tasks.workunit.client.1.smithi159.stdout:7/163: getdents d3/d31 0 2024-09-13T22:08:54.877 INFO:tasks.workunit.client.1.smithi159.stdout:3/177: dread d0/d1/d3/d5/d25/d2c/f32 [0,4194304] 0 2024-09-13T22:08:54.878 INFO:tasks.workunit.client.1.smithi159.stdout:2/112: dwrite d9/f1b [0,4194304] 0 2024-09-13T22:08:54.879 INFO:tasks.workunit.client.1.smithi159.stdout:2/113: dread d9/fe [0,4194304] 0 2024-09-13T22:08:54.879 INFO:tasks.workunit.client.1.smithi159.stdout:2/114: chown d9/l16 3667385 1 2024-09-13T22:08:54.881 INFO:tasks.workunit.client.1.smithi159.stdout:2/115: mkdir d9/da/d27 0 2024-09-13T22:08:54.882 INFO:tasks.workunit.client.1.smithi159.stdout:2/116: mknod d9/da/d25/c28 0 2024-09-13T22:08:54.883 INFO:tasks.workunit.client.1.smithi159.stdout:2/117: chown d9/l16 820800 1 2024-09-13T22:08:54.883 INFO:tasks.workunit.client.1.smithi159.stdout:2/118: dread - d9/da/f26 zero size 2024-09-13T22:08:54.884 INFO:tasks.workunit.client.1.smithi159.stdout:3/178: dread d0/d1/f1a [0,4194304] 0 2024-09-13T22:08:54.884 INFO:tasks.workunit.client.1.smithi159.stdout:3/179: rename d0/d1/d3/d5 to d0/d1/d3/d5/d3a 22 2024-09-13T22:08:54.886 INFO:tasks.workunit.client.1.smithi159.stdout:2/119: creat d9/f29 x:0 0 0 2024-09-13T22:08:54.899 INFO:tasks.workunit.client.1.smithi159.stdout:5/104: sync 2024-09-13T22:08:54.899 INFO:tasks.workunit.client.1.smithi159.stdout:6/107: sync 2024-09-13T22:08:54.899 INFO:tasks.workunit.client.1.smithi159.stdout:5/105: write d1/f2 [3010607,93660] 0 2024-09-13T22:08:54.901 INFO:tasks.workunit.client.1.smithi159.stdout:5/106: link d1/l13 d1/d11/l29 0 2024-09-13T22:08:54.902 INFO:tasks.workunit.client.1.smithi159.stdout:1/144: sync 2024-09-13T22:08:54.904 INFO:tasks.workunit.client.1.smithi159.stdout:5/107: symlink d1/db/d17/l2a 0 2024-09-13T22:08:54.905 INFO:tasks.workunit.client.1.smithi159.stdout:5/108: symlink d1/db/l2b 0 2024-09-13T22:08:54.907 INFO:tasks.workunit.client.1.smithi159.stdout:1/145: dread f7 [4194304,4194304] 0 2024-09-13T22:08:54.907 INFO:tasks.workunit.client.1.smithi159.stdout:2/120: dwrite d9/da/f24 [0,4194304] 0 2024-09-13T22:08:54.907 INFO:tasks.workunit.client.1.smithi159.stdout:2/121: creat d9/da/f2a x:0 0 0 2024-09-13T22:08:54.907 INFO:tasks.workunit.client.1.smithi159.stdout:5/109: creat d1/db/d17/f2c x:0 0 0 2024-09-13T22:08:54.908 INFO:tasks.workunit.client.1.smithi159.stdout:5/110: write d1/db/fd [82623,108371] 0 2024-09-13T22:08:54.908 INFO:tasks.workunit.client.1.smithi159.stdout:5/111: chown d1/db/f10 1 1 2024-09-13T22:08:54.909 INFO:tasks.workunit.client.1.smithi159.stdout:1/146: dread dd/ff [0,4194304] 0 2024-09-13T22:08:54.913 INFO:tasks.workunit.client.1.smithi159.stdout:5/112: rename d1/lc to d1/l2d 0 2024-09-13T22:08:54.916 INFO:tasks.workunit.client.1.smithi159.stdout:5/113: symlink d1/d11/d1c/l2e 0 2024-09-13T22:08:54.918 INFO:tasks.workunit.client.1.smithi159.stdout:1/147: mkdir dd/d11/d18/d2e 0 2024-09-13T22:08:54.919 INFO:tasks.workunit.client.1.smithi159.stdout:5/114: rename d1/d11/l28 to d1/db/d17/l2f 0 2024-09-13T22:08:54.921 INFO:tasks.workunit.client.1.smithi159.stdout:1/148: symlink dd/l2f 0 2024-09-13T22:08:54.921 INFO:tasks.workunit.client.1.smithi159.stdout:1/149: write dd/d11/d18/f2b [320701,62982] 0 2024-09-13T22:08:54.921 INFO:tasks.workunit.client.1.smithi159.stdout:1/150: write dd/d11/d18/f2b [1298401,26845] 0 2024-09-13T22:08:54.921 INFO:tasks.workunit.client.1.smithi159.stdout:1/151: chown dd/d1c/f26 3691226 1 2024-09-13T22:08:54.921 INFO:tasks.workunit.client.1.smithi159.stdout:1/152: fsync f3 0 2024-09-13T22:08:54.921 INFO:tasks.workunit.client.1.smithi159.stdout:1/153: dread - dd/d1c/f25 zero size 2024-09-13T22:08:54.921 INFO:tasks.workunit.client.1.smithi159.stdout:5/115: mknod d1/db/d17/c30 0 2024-09-13T22:08:54.922 INFO:tasks.workunit.client.1.smithi159.stdout:5/116: creat d1/d15/f31 x:0 0 0 2024-09-13T22:08:54.922 INFO:tasks.workunit.client.1.smithi159.stdout:5/117: readlink d1/d11/d1c/l2e 0 2024-09-13T22:08:54.922 INFO:tasks.workunit.client.1.smithi159.stdout:5/118: truncate d1/db/f25 921742 0 2024-09-13T22:08:54.922 INFO:tasks.workunit.client.1.smithi159.stdout:5/119: chown d1/l6 176911438 1 2024-09-13T22:08:54.922 INFO:tasks.workunit.client.1.smithi159.stdout:5/120: mkdir d1/d11/d1c/d32 0 2024-09-13T22:08:54.924 INFO:tasks.workunit.client.1.smithi159.stdout:5/121: unlink d1/d15/f24 0 2024-09-13T22:08:54.924 INFO:tasks.workunit.client.1.smithi159.stdout:5/122: readlink d1/db/l2b 0 2024-09-13T22:08:54.928 INFO:tasks.workunit.client.1.smithi159.stdout:1/154: write dd/d11/f24 [529370,35281] 0 2024-09-13T22:08:54.930 INFO:tasks.workunit.client.1.smithi159.stdout:6/108: dwrite d3/da/f16 [0,4194304] 0 2024-09-13T22:08:54.930 INFO:tasks.workunit.client.1.smithi159.stdout:6/109: read d3/da/de/f15 [614506,19996] 0 2024-09-13T22:08:54.932 INFO:tasks.workunit.client.1.smithi159.stdout:1/155: symlink dd/d1c/l30 0 2024-09-13T22:08:54.932 INFO:tasks.workunit.client.1.smithi159.stdout:1/156: write fb [1264178,64913] 0 2024-09-13T22:08:54.932 INFO:tasks.workunit.client.1.smithi159.stdout:1/157: creat dd/d11/f31 x:0 0 0 2024-09-13T22:08:54.932 INFO:tasks.workunit.client.1.smithi159.stdout:1/158: truncate dd/d11/d18/f2b 1568362 0 2024-09-13T22:08:54.932 INFO:tasks.workunit.client.1.smithi159.stdout:1/159: dread - dd/d1e/f28 zero size 2024-09-13T22:08:54.932 INFO:tasks.workunit.client.1.smithi159.stdout:1/160: chown dd/d11/d18/d2e 335668 1 2024-09-13T22:08:54.932 INFO:tasks.workunit.client.1.smithi159.stdout:1/161: write f3 [4964169,77161] 0 2024-09-13T22:08:54.937 INFO:tasks.workunit.client.1.smithi159.stdout:2/122: rmdir d9 39 2024-09-13T22:08:54.944 INFO:tasks.workunit.client.1.smithi159.stdout:1/162: fdatasync f3 0 2024-09-13T22:08:54.944 INFO:tasks.workunit.client.1.smithi159.stdout:1/163: creat dd/d11/f32 x:0 0 0 2024-09-13T22:08:54.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/110: truncate d3/da/de/f17 2147893 0 2024-09-13T22:08:54.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/111: fdatasync d3/f20 0 2024-09-13T22:08:54.946 INFO:tasks.workunit.client.1.smithi159.stdout:5/123: dwrite d1/d15/f26 [0,4194304] 0 2024-09-13T22:08:54.947 INFO:tasks.workunit.client.1.smithi159.stdout:5/124: dread d1/db/f25 [0,4194304] 0 2024-09-13T22:08:54.949 INFO:tasks.workunit.client.1.smithi159.stdout:1/164: link fb dd/d11/d18/d2e/f33 0 2024-09-13T22:08:54.953 INFO:tasks.workunit.client.1.smithi159.stdout:2/123: rename d9/da/f1a to d9/f2b 0 2024-09-13T22:08:54.953 INFO:tasks.workunit.client.1.smithi159.stdout:2/124: write d9/f1d [832114,50207] 0 2024-09-13T22:08:54.958 INFO:tasks.workunit.client.1.smithi159.stdout:6/112: dread d3/da/f16 [0,4194304] 0 2024-09-13T22:08:54.961 INFO:tasks.workunit.client.1.smithi159.stdout:5/125: symlink d1/d15/l33 0 2024-09-13T22:08:54.967 INFO:tasks.workunit.client.1.smithi159.stdout:1/165: mkdir dd/d11/d34 0 2024-09-13T22:08:54.968 INFO:tasks.workunit.client.1.smithi159.stdout:1/166: read - dd/d11/f32 zero size 2024-09-13T22:08:54.968 INFO:tasks.workunit.client.1.smithi159.stdout:6/113: unlink d3/da/de/f15 0 2024-09-13T22:08:54.969 INFO:tasks.workunit.client.1.smithi159.stdout:6/114: creat d3/da/de/d1a/f24 x:0 0 0 2024-09-13T22:08:54.969 INFO:tasks.workunit.client.1.smithi159.stdout:6/115: stat d3/l14 0 2024-09-13T22:08:54.969 INFO:tasks.workunit.client.1.smithi159.stdout:6/116: chown d3/c1e 14988 1 2024-09-13T22:08:54.972 INFO:tasks.workunit.client.1.smithi159.stdout:5/126: mknod d1/db/c34 0 2024-09-13T22:08:54.979 INFO:tasks.workunit.client.1.smithi159.stdout:5/127: mkdir d1/db/d35 0 2024-09-13T22:08:54.979 INFO:tasks.workunit.client.1.smithi159.stdout:2/125: dwrite d9/f1b [0,4194304] 0 2024-09-13T22:08:54.980 INFO:tasks.workunit.client.1.smithi159.stdout:1/167: fdatasync dd/d11/d18/d2e/f33 0 2024-09-13T22:08:54.982 INFO:tasks.workunit.client.1.smithi159.stdout:5/128: link d1/fa d1/d15/f36 0 2024-09-13T22:08:54.985 INFO:tasks.workunit.client.1.smithi159.stdout:1/168: symlink dd/d11/d18/d2e/l35 0 2024-09-13T22:08:54.985 INFO:tasks.workunit.client.1.smithi159.stdout:1/169: read - dd/d1c/f25 zero size 2024-09-13T22:08:54.985 INFO:tasks.workunit.client.1.smithi159.stdout:1/170: write dd/ff [7555,71983] 0 2024-09-13T22:08:54.986 INFO:tasks.workunit.client.1.smithi159.stdout:5/129: creat d1/d11/f37 x:0 0 0 2024-09-13T22:08:54.989 INFO:tasks.workunit.client.1.smithi159.stdout:1/171: creat dd/d11/d19/d2d/f36 x:0 0 0 2024-09-13T22:08:54.989 INFO:tasks.workunit.client.1.smithi159.stdout:1/172: write f3 [2567516,34166] 0 2024-09-13T22:08:54.989 INFO:tasks.workunit.client.1.smithi159.stdout:1/173: creat dd/d1e/f37 x:0 0 0 2024-09-13T22:08:54.992 INFO:tasks.workunit.client.1.smithi159.stdout:2/126: dread d9/da/f24 [0,4194304] 0 2024-09-13T22:08:54.992 INFO:tasks.workunit.client.1.smithi159.stdout:2/127: truncate d9/fe 1311312 0 2024-09-13T22:08:54.995 INFO:tasks.workunit.client.1.smithi159.stdout:9/182: sync 2024-09-13T22:08:54.996 INFO:tasks.workunit.client.1.smithi159.stdout:4/177: sync 2024-09-13T22:08:54.996 INFO:tasks.workunit.client.1.smithi159.stdout:9/183: dread - d1/dc/f3e zero size 2024-09-13T22:08:54.996 INFO:tasks.workunit.client.1.smithi159.stdout:9/184: dread - d1/dc/f3e zero size 2024-09-13T22:08:54.996 INFO:tasks.workunit.client.1.smithi159.stdout:2/128: creat d9/da/d25/f2c x:0 0 0 2024-09-13T22:08:54.998 INFO:tasks.workunit.client.1.smithi159.stdout:9/185: symlink d1/dc/l43 0 2024-09-13T22:08:54.998 INFO:tasks.workunit.client.1.smithi159.stdout:1/174: dread fb [0,4194304] 0 2024-09-13T22:08:55.010 INFO:tasks.workunit.client.1.smithi159.stdout:2/129: dread d9/f1b [0,4194304] 0 2024-09-13T22:08:55.010 INFO:tasks.workunit.client.1.smithi159.stdout:2/130: fdatasync d9/da/f14 0 2024-09-13T22:08:55.013 INFO:tasks.workunit.client.1.smithi159.stdout:9/186: write d1/d9/ff [1512239,58147] 0 2024-09-13T22:08:55.014 INFO:tasks.workunit.client.1.smithi159.stdout:9/187: truncate d1/fe 1504622 0 2024-09-13T22:08:55.014 INFO:tasks.workunit.client.1.smithi159.stdout:9/188: truncate d1/f1c 806456 0 2024-09-13T22:08:55.027 INFO:tasks.workunit.client.1.smithi159.stdout:5/130: dwrite d1/d11/f37 [0,4194304] 0 2024-09-13T22:08:55.028 INFO:tasks.workunit.client.1.smithi159.stdout:1/175: mknod dd/d11/d19/c38 0 2024-09-13T22:08:55.032 INFO:tasks.workunit.client.1.smithi159.stdout:9/189: unlink d1/d9/d3d/c42 0 2024-09-13T22:08:55.033 INFO:tasks.workunit.client.1.smithi159.stdout:9/190: dread d1/d9/d3d/d2f/f37 [0,4194304] 0 2024-09-13T22:08:55.037 INFO:tasks.workunit.client.1.smithi159.stdout:9/191: write d1/dc/fb [445433,121527] 0 2024-09-13T22:08:55.045 INFO:tasks.workunit.client.1.smithi159.stdout:5/131: dwrite d1/d11/f37 [0,4194304] 0 2024-09-13T22:08:55.055 INFO:tasks.workunit.client.1.smithi159.stdout:5/132: write d1/d15/f26 [2290517,98368] 0 2024-09-13T22:08:55.055 INFO:tasks.workunit.client.1.smithi159.stdout:5/133: read d1/d15/f36 [2340209,70444] 0 2024-09-13T22:08:55.055 INFO:tasks.workunit.client.1.smithi159.stdout:5/134: write d1/f5 [694851,54165] 0 2024-09-13T22:08:55.055 INFO:tasks.workunit.client.1.smithi159.stdout:9/192: dwrite d1/fe [0,4194304] 0 2024-09-13T22:08:55.144 INFO:tasks.workunit.client.1.smithi159.stdout:6/117: rmdir d3/da/de/d1a 39 2024-09-13T22:08:55.150 INFO:tasks.workunit.client.1.smithi159.stdout:1/176: mknod dd/d11/d18/d2e/c39 0 2024-09-13T22:08:55.151 INFO:tasks.workunit.client.1.smithi159.stdout:1/177: write dd/d11/d18/d2e/f33 [1250628,116655] 0 2024-09-13T22:08:55.151 INFO:tasks.workunit.client.1.smithi159.stdout:1/178: dread - dd/f1b zero size 2024-09-13T22:08:55.151 INFO:tasks.workunit.client.1.smithi159.stdout:1/179: chown dd/d11/f32 24 1 2024-09-13T22:08:55.151 INFO:tasks.workunit.client.1.smithi159.stdout:1/180: truncate dd/d1e/f28 498412 0 2024-09-13T22:08:55.151 INFO:tasks.workunit.client.1.smithi159.stdout:2/131: mkdir d9/d2d 0 2024-09-13T22:08:55.154 INFO:tasks.workunit.client.1.smithi159.stdout:5/135: link d1/d11/c14 d1/db/d35/c38 0 2024-09-13T22:08:55.154 INFO:tasks.workunit.client.1.smithi159.stdout:5/136: dread - d1/d15/f31 zero size 2024-09-13T22:08:55.156 INFO:tasks.workunit.client.1.smithi159.stdout:1/181: dread f3 [0,4194304] 0 2024-09-13T22:08:55.158 INFO:tasks.workunit.client.1.smithi159.stdout:9/193: symlink d1/d9/d1f/l44 0 2024-09-13T22:08:55.158 INFO:tasks.workunit.client.1.smithi159.stdout:9/194: stat d1/d9/d1f/c2e 0 2024-09-13T22:08:55.158 INFO:tasks.workunit.client.1.smithi159.stdout:9/195: write d1/f30 [112171,66440] 0 2024-09-13T22:08:55.163 INFO:tasks.workunit.client.1.smithi159.stdout:1/182: dread f7 [0,4194304] 0 2024-09-13T22:08:55.166 INFO:tasks.workunit.client.1.smithi159.stdout:9/196: dread d1/dc/f12 [0,4194304] 0 2024-09-13T22:08:55.169 INFO:tasks.workunit.client.1.smithi159.stdout:6/118: mkdir d3/da/d25 0 2024-09-13T22:08:55.171 INFO:tasks.workunit.client.1.smithi159.stdout:9/197: dread d1/f30 [0,4194304] 0 2024-09-13T22:08:55.172 INFO:tasks.workunit.client.1.smithi159.stdout:2/132: creat d9/da/d27/f2e x:0 0 0 2024-09-13T22:08:55.172 INFO:tasks.workunit.client.1.smithi159.stdout:2/133: dread - d9/da/f26 zero size 2024-09-13T22:08:55.172 INFO:tasks.workunit.client.1.smithi159.stdout:2/134: creat d9/da/d25/f2f x:0 0 0 2024-09-13T22:08:55.172 INFO:tasks.workunit.client.1.smithi159.stdout:2/135: write d9/f29 [622015,114641] 0 2024-09-13T22:08:55.173 INFO:tasks.workunit.client.1.smithi159.stdout:5/137: symlink d1/db/l39 0 2024-09-13T22:08:55.174 INFO:tasks.workunit.client.1.smithi159.stdout:5/138: dread d1/f2 [4194304,4194304] 0 2024-09-13T22:08:55.174 INFO:tasks.workunit.client.1.smithi159.stdout:5/139: fdatasync d1/db/f10 0 2024-09-13T22:08:55.174 INFO:tasks.workunit.client.1.smithi159.stdout:5/140: chown d1/d11/c14 7842604 1 2024-09-13T22:08:55.174 INFO:tasks.workunit.client.1.smithi159.stdout:1/183: creat dd/d11/d19/f3a x:0 0 0 2024-09-13T22:08:55.176 INFO:tasks.workunit.client.1.smithi159.stdout:6/119: mkdir d3/da/de/d26 0 2024-09-13T22:08:55.177 INFO:tasks.workunit.client.1.smithi159.stdout:9/198: mknod d1/dc/c45 0 2024-09-13T22:08:55.180 INFO:tasks.workunit.client.1.smithi159.stdout:2/136: symlink d9/da/d25/l30 0 2024-09-13T22:08:55.182 INFO:tasks.workunit.client.1.smithi159.stdout:9/199: symlink d1/d9/d3d/l46 0 2024-09-13T22:08:55.183 INFO:tasks.workunit.client.1.smithi159.stdout:2/137: unlink d9/c10 0 2024-09-13T22:08:55.184 INFO:tasks.workunit.client.1.smithi159.stdout:5/141: getdents d1/db 0 2024-09-13T22:08:55.184 INFO:tasks.workunit.client.1.smithi159.stdout:5/142: chown d1/d11/d1c/l27 59 1 2024-09-13T22:08:55.184 INFO:tasks.workunit.client.1.smithi159.stdout:5/143: truncate d1/f2 5754421 0 2024-09-13T22:08:55.187 INFO:tasks.workunit.client.1.smithi159.stdout:9/200: creat d1/d9/d3d/f47 x:0 0 0 2024-09-13T22:08:55.187 INFO:tasks.workunit.client.1.smithi159.stdout:9/201: creat d1/f48 x:0 0 0 2024-09-13T22:08:55.188 INFO:tasks.workunit.client.1.smithi159.stdout:2/138: dread d9/f2b [0,4194304] 0 2024-09-13T22:08:55.189 INFO:tasks.workunit.client.1.smithi159.stdout:1/184: rename dd/d11/d19/f3a to dd/d11/d18/f3b 0 2024-09-13T22:08:55.193 INFO:tasks.workunit.client.1.smithi159.stdout:9/202: mknod d1/d9/d3d/c49 0 2024-09-13T22:08:55.193 INFO:tasks.workunit.client.1.smithi159.stdout:9/203: dread - d1/d9/f38 zero size 2024-09-13T22:08:55.196 INFO:tasks.workunit.client.1.smithi159.stdout:2/139: creat d9/f31 x:0 0 0 2024-09-13T22:08:55.197 INFO:tasks.workunit.client.1.smithi159.stdout:2/140: write d9/fe [1076183,70827] 0 2024-09-13T22:08:55.197 INFO:tasks.workunit.client.1.smithi159.stdout:2/141: fsync d9/da/f18 0 2024-09-13T22:08:55.197 INFO:tasks.workunit.client.1.smithi159.stdout:6/120: rename d3/da/f1d to d3/f27 0 2024-09-13T22:08:55.197 INFO:tasks.workunit.client.1.smithi159.stdout:6/121: write d3/f27 [670701,116465] 0 2024-09-13T22:08:55.199 INFO:tasks.workunit.client.1.smithi159.stdout:1/185: mkdir dd/d11/d18/d2e/d3c 0 2024-09-13T22:08:55.203 INFO:tasks.workunit.client.1.smithi159.stdout:5/144: dwrite d1/fa [4194304,4194304] 0 2024-09-13T22:08:55.206 INFO:tasks.workunit.client.1.smithi159.stdout:1/186: dread dd/d11/f24 [0,4194304] 0 2024-09-13T22:08:55.207 INFO:tasks.workunit.client.1.smithi159.stdout:9/204: rename d1/d9/c21 to d1/d9/d3d/d2f/c4a 0 2024-09-13T22:08:55.209 INFO:tasks.workunit.client.1.smithi159.stdout:1/187: truncate dd/d11/f24 908451 0 2024-09-13T22:08:55.209 INFO:tasks.workunit.client.1.smithi159.stdout:6/122: dread d3/f27 [0,4194304] 0 2024-09-13T22:08:55.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/188: creat dd/d11/d18/f3d x:0 0 0 2024-09-13T22:08:55.214 INFO:tasks.workunit.client.1.smithi159.stdout:5/145: dread d1/d11/f37 [0,4194304] 0 2024-09-13T22:08:55.214 INFO:tasks.workunit.client.1.smithi159.stdout:5/146: getdents d1/d11/d1c/d32 0 2024-09-13T22:08:55.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/147: creat d1/d11/d1c/d32/f3a x:0 0 0 2024-09-13T22:08:55.217 INFO:tasks.workunit.client.1.smithi159.stdout:5/148: mknod d1/d15/c3b 0 2024-09-13T22:08:55.222 INFO:tasks.workunit.client.1.smithi159.stdout:5/149: write d1/d11/f37 [3777270,75662] 0 2024-09-13T22:08:55.223 INFO:tasks.workunit.client.1.smithi159.stdout:5/150: rmdir d1/db 39 2024-09-13T22:08:55.225 INFO:tasks.workunit.client.1.smithi159.stdout:2/142: dwrite d9/da/f24 [0,4194304] 0 2024-09-13T22:08:55.225 INFO:tasks.workunit.client.1.smithi159.stdout:5/151: rename d1/d11/d1c/d20/l23 to d1/db/d17/l3c 0 2024-09-13T22:08:55.228 INFO:tasks.workunit.client.1.smithi159.stdout:2/143: rename d9/da/l1e to d9/da/d25/l32 0 2024-09-13T22:08:55.228 INFO:tasks.workunit.client.1.smithi159.stdout:2/144: fdatasync d9/f1d 0 2024-09-13T22:08:55.228 INFO:tasks.workunit.client.1.smithi159.stdout:2/145: write f5 [1133947,83980] 0 2024-09-13T22:08:55.232 INFO:tasks.workunit.client.1.smithi159.stdout:2/146: rename d9/da/c15 to d9/da/d25/c33 0 2024-09-13T22:08:55.232 INFO:tasks.workunit.client.1.smithi159.stdout:2/147: chown d9/da/d27/f2e 190560989 1 2024-09-13T22:08:55.233 INFO:tasks.workunit.client.1.smithi159.stdout:9/205: dwrite d1/dc/d10/f17 [0,4194304] 0 2024-09-13T22:08:55.235 INFO:tasks.workunit.client.1.smithi159.stdout:2/148: dread d9/da/f14 [0,4194304] 0 2024-09-13T22:08:55.235 INFO:tasks.workunit.client.1.smithi159.stdout:2/149: write d9/da/d25/f2f [479637,75242] 0 2024-09-13T22:08:55.240 INFO:tasks.workunit.client.1.smithi159.stdout:6/123: dwrite d3/f20 [0,4194304] 0 2024-09-13T22:08:55.240 INFO:tasks.workunit.client.1.smithi159.stdout:6/124: creat d3/da/f28 x:0 0 0 2024-09-13T22:08:55.241 INFO:tasks.workunit.client.1.smithi159.stdout:9/206: dread d1/dc/f12 [0,4194304] 0 2024-09-13T22:08:55.241 INFO:tasks.workunit.client.1.smithi159.stdout:9/207: read - d1/d9/d3d/f47 zero size 2024-09-13T22:08:55.241 INFO:tasks.workunit.client.1.smithi159.stdout:9/208: write d1/dc/d10/f39 [875961,88410] 0 2024-09-13T22:08:55.244 INFO:tasks.workunit.client.1.smithi159.stdout:5/152: dread d1/fa [4194304,4194304] 0 2024-09-13T22:08:55.248 INFO:tasks.workunit.client.1.smithi159.stdout:9/209: dread d1/dc/f13 [0,4194304] 0 2024-09-13T22:08:55.255 INFO:tasks.workunit.client.1.smithi159.stdout:5/153: mknod d1/c3d 0 2024-09-13T22:08:55.256 INFO:tasks.workunit.client.1.smithi159.stdout:9/210: mkdir d1/d9/d3d/d4b 0 2024-09-13T22:08:55.258 INFO:tasks.workunit.client.1.smithi159.stdout:9/211: unlink d1/dc/fb 0 2024-09-13T22:08:55.260 INFO:tasks.workunit.client.1.smithi159.stdout:5/154: dread d1/db/fd [0,4194304] 0 2024-09-13T22:08:55.260 INFO:tasks.workunit.client.1.smithi159.stdout:9/212: mknod d1/c4c 0 2024-09-13T22:08:55.262 INFO:tasks.workunit.client.1.smithi159.stdout:9/213: symlink d1/d9/d3d/l4d 0 2024-09-13T22:08:55.264 INFO:tasks.workunit.client.1.smithi159.stdout:9/214: creat d1/d9/d2a/f4e x:0 0 0 2024-09-13T22:08:55.264 INFO:tasks.workunit.client.1.smithi159.stdout:9/215: write d1/dc/d10/f39 [1995336,128227] 0 2024-09-13T22:08:55.268 INFO:tasks.workunit.client.1.smithi159.stdout:5/155: dread d1/f8 [0,4194304] 0 2024-09-13T22:08:55.270 INFO:tasks.workunit.client.1.smithi159.stdout:5/156: rename d1/f5 to d1/f3e 0 2024-09-13T22:08:55.271 INFO:tasks.workunit.client.1.smithi159.stdout:5/157: truncate d1/f3e 2539988 0 2024-09-13T22:08:55.271 INFO:tasks.workunit.client.1.smithi159.stdout:5/158: write d1/f2 [4122882,47035] 0 2024-09-13T22:08:55.280 INFO:tasks.workunit.client.1.smithi159.stdout:9/216: dread d1/fe [0,4194304] 0 2024-09-13T22:08:55.280 INFO:tasks.workunit.client.1.smithi159.stdout:9/217: mknod d1/dc/d10/c4f 0 2024-09-13T22:08:55.281 INFO:tasks.workunit.client.1.smithi159.stdout:9/218: mknod d1/d9/d3d/d4b/c50 0 2024-09-13T22:08:55.281 INFO:tasks.workunit.client.1.smithi159.stdout:9/219: write d1/dc/f3e [124568,12594] 0 2024-09-13T22:08:55.282 INFO:tasks.workunit.client.1.smithi159.stdout:9/220: rename d1/c4c to d1/dc/d27/c51 0 2024-09-13T22:08:55.283 INFO:tasks.workunit.client.1.smithi159.stdout:1/189: dwrite dd/d11/f24 [0,4194304] 0 2024-09-13T22:08:55.283 INFO:tasks.workunit.client.1.smithi159.stdout:2/150: dwrite d9/da/f22 [0,4194304] 0 2024-09-13T22:08:55.283 INFO:tasks.workunit.client.1.smithi159.stdout:2/151: readlink d9/da/d25/l30 0 2024-09-13T22:08:55.285 INFO:tasks.workunit.client.1.smithi159.stdout:9/221: mknod d1/dc/d27/c52 0 2024-09-13T22:08:55.286 INFO:tasks.workunit.client.1.smithi159.stdout:1/190: rename dd/c1d to dd/d11/d21/c3e 0 2024-09-13T22:08:55.287 INFO:tasks.workunit.client.1.smithi159.stdout:1/191: read f9 [135408,17377] 0 2024-09-13T22:08:55.287 INFO:tasks.workunit.client.1.smithi159.stdout:9/222: creat d1/f53 x:0 0 0 2024-09-13T22:08:55.287 INFO:tasks.workunit.client.1.smithi159.stdout:9/223: chown d1/dc/l15 349 1 2024-09-13T22:08:55.287 INFO:tasks.workunit.client.1.smithi159.stdout:6/125: dwrite d3/da/f16 [0,4194304] 0 2024-09-13T22:08:55.287 INFO:tasks.workunit.client.1.smithi159.stdout:6/126: readlink d3/da/de/d1a/l22 0 2024-09-13T22:08:55.294 INFO:tasks.workunit.client.1.smithi159.stdout:1/192: dread f7 [4194304,4194304] 0 2024-09-13T22:08:55.294 INFO:tasks.workunit.client.1.smithi159.stdout:1/193: fdatasync dd/d1c/f25 0 2024-09-13T22:08:55.299 INFO:tasks.workunit.client.1.smithi159.stdout:9/224: read d1/dc/d10/f17 [2212171,32465] 0 2024-09-13T22:08:55.299 INFO:tasks.workunit.client.1.smithi159.stdout:2/152: dwrite d9/da/d27/f2e [0,4194304] 0 2024-09-13T22:08:55.299 INFO:tasks.workunit.client.1.smithi159.stdout:2/153: chown d9/da/f2a 11 1 2024-09-13T22:08:55.300 INFO:tasks.workunit.client.1.smithi159.stdout:2/154: write d9/f1d [24719,127671] 0 2024-09-13T22:08:55.303 INFO:tasks.workunit.client.1.smithi159.stdout:1/194: truncate f3 1082806 0 2024-09-13T22:08:55.304 INFO:tasks.workunit.client.1.smithi159.stdout:9/225: mknod d1/dc/d27/d40/c54 0 2024-09-13T22:08:55.309 INFO:tasks.workunit.client.1.smithi159.stdout:6/127: rename d3/da/de to d3/da/d29 0 2024-09-13T22:08:55.313 INFO:tasks.workunit.client.1.smithi159.stdout:1/195: link dd/d11/d21/c3e dd/d11/d18/d2e/d3c/c3f 0 2024-09-13T22:08:55.315 INFO:tasks.workunit.client.1.smithi159.stdout:9/226: creat d1/d9/d3d/d4b/f55 x:0 0 0 2024-09-13T22:08:55.315 INFO:tasks.workunit.client.1.smithi159.stdout:9/227: creat d1/d9/d3d/f56 x:0 0 0 2024-09-13T22:08:55.315 INFO:tasks.workunit.client.1.smithi159.stdout:9/228: stat d1/d9/f38 0 2024-09-13T22:08:55.317 INFO:tasks.workunit.client.1.smithi159.stdout:6/128: mkdir d3/d2a 0 2024-09-13T22:08:55.320 INFO:tasks.workunit.client.1.smithi159.stdout:1/196: unlink dd/d11/f32 0 2024-09-13T22:08:55.322 INFO:tasks.workunit.client.1.smithi159.stdout:9/229: getdents d1/d9/d3d/d2f 0 2024-09-13T22:08:55.324 INFO:tasks.workunit.client.1.smithi159.stdout:5/159: dwrite d1/f3e [0,4194304] 0 2024-09-13T22:08:55.324 INFO:tasks.workunit.client.1.smithi159.stdout:5/160: getdents d1/db 0 2024-09-13T22:08:55.324 INFO:tasks.workunit.client.1.smithi159.stdout:5/161: write d1/db/d17/f2c [202681,67758] 0 2024-09-13T22:08:55.324 INFO:tasks.workunit.client.1.smithi159.stdout:5/162: write d1/d11/d1c/d32/f3a [279315,64146] 0 2024-09-13T22:08:55.325 INFO:tasks.workunit.client.1.smithi159.stdout:6/129: rename d3/f20 to d3/f2b 0 2024-09-13T22:08:55.326 INFO:tasks.workunit.client.1.smithi159.stdout:1/197: truncate dd/d11/d18/f23 1490293 0 2024-09-13T22:08:55.328 INFO:tasks.workunit.client.1.smithi159.stdout:8/136: sync 2024-09-13T22:08:55.328 INFO:tasks.workunit.client.1.smithi159.stdout:9/230: mkdir d1/d9/d3d/d2f/d57 0 2024-09-13T22:08:55.329 INFO:tasks.workunit.client.1.smithi159.stdout:1/198: rename dd/d11/f31 to dd/d11/f40 0 2024-09-13T22:08:55.329 INFO:tasks.workunit.client.1.smithi159.stdout:1/199: chown dd/d1c/f26 224668 1 2024-09-13T22:08:55.330 INFO:tasks.workunit.client.1.smithi159.stdout:5/163: write d1/d15/f36 [8358694,5911] 0 2024-09-13T22:08:55.330 INFO:tasks.workunit.client.1.smithi159.stdout:5/164: chown d1/db/d17/l2a 5 1 2024-09-13T22:08:55.332 INFO:tasks.workunit.client.1.smithi159.stdout:8/137: dread da/f14 [0,4194304] 0 2024-09-13T22:08:55.333 INFO:tasks.workunit.client.1.smithi159.stdout:9/231: truncate d1/fe 3672022 0 2024-09-13T22:08:55.333 INFO:tasks.workunit.client.1.smithi159.stdout:9/232: fsync d1/d9/f2b 0 2024-09-13T22:08:55.333 INFO:tasks.workunit.client.1.smithi159.stdout:1/200: stat dd/d11/d21/c3e 0 2024-09-13T22:08:55.334 INFO:tasks.workunit.client.1.smithi159.stdout:1/201: write dd/d1e/f37 [683907,26964] 0 2024-09-13T22:08:55.337 INFO:tasks.workunit.client.1.smithi159.stdout:8/138: creat da/f29 x:0 0 0 2024-09-13T22:08:55.341 INFO:tasks.workunit.client.1.smithi159.stdout:1/202: creat dd/d11/d21/f41 x:0 0 0 2024-09-13T22:08:55.341 INFO:tasks.workunit.client.1.smithi159.stdout:1/203: read - dd/d11/d19/d2d/f36 zero size 2024-09-13T22:08:55.341 INFO:tasks.workunit.client.1.smithi159.stdout:1/204: read dd/d1e/f22 [63354,95372] 0 2024-09-13T22:08:55.342 INFO:tasks.workunit.client.1.smithi159.stdout:1/205: creat dd/d11/d21/f42 x:0 0 0 2024-09-13T22:08:55.342 INFO:tasks.workunit.client.1.smithi159.stdout:5/165: dread d1/d15/f36 [4194304,4194304] 0 2024-09-13T22:08:55.342 INFO:tasks.workunit.client.1.smithi159.stdout:5/166: chown d1/db/d17/l2f 14648313 1 2024-09-13T22:08:55.342 INFO:tasks.workunit.client.1.smithi159.stdout:5/167: write d1/f8 [4545055,67401] 0 2024-09-13T22:08:55.342 INFO:tasks.workunit.client.1.smithi159.stdout:5/168: truncate d1/db/d17/f2c 1252326 0 2024-09-13T22:08:55.342 INFO:tasks.workunit.client.1.smithi159.stdout:5/169: readlink d1/db/l18 0 2024-09-13T22:08:55.342 INFO:tasks.workunit.client.1.smithi159.stdout:8/139: dread da/f19 [0,4194304] 0 2024-09-13T22:08:55.343 INFO:tasks.workunit.client.1.smithi159.stdout:8/140: readlink da/l16 0 2024-09-13T22:08:55.343 INFO:tasks.workunit.client.1.smithi159.stdout:6/130: dwrite d3/da/f28 [0,4194304] 0 2024-09-13T22:08:55.349 INFO:tasks.workunit.client.1.smithi159.stdout:8/141: mkdir da/d22/d2a 0 2024-09-13T22:08:55.352 INFO:tasks.workunit.client.1.smithi159.stdout:5/170: dread d1/d11/f1e [0,4194304] 0 2024-09-13T22:08:55.352 INFO:tasks.workunit.client.1.smithi159.stdout:5/171: dread - d1/d15/f31 zero size 2024-09-13T22:08:55.352 INFO:tasks.workunit.client.1.smithi159.stdout:5/172: write d1/d15/f26 [4019152,13642] 0 2024-09-13T22:08:55.355 INFO:tasks.workunit.client.1.smithi159.stdout:5/173: getdents d1/db/d35 0 2024-09-13T22:08:55.359 INFO:tasks.workunit.client.1.smithi159.stdout:5/174: rmdir d1/d11 39 2024-09-13T22:08:55.359 INFO:tasks.workunit.client.1.smithi159.stdout:5/175: write d1/d11/f37 [64297,7943] 0 2024-09-13T22:08:55.361 INFO:tasks.workunit.client.1.smithi159.stdout:5/176: creat d1/db/f3f x:0 0 0 2024-09-13T22:08:55.361 INFO:tasks.workunit.client.1.smithi159.stdout:5/177: fsync d1/f3e 0 2024-09-13T22:08:55.367 INFO:tasks.workunit.client.1.smithi159.stdout:8/142: rmdir da 39 2024-09-13T22:08:55.368 INFO:tasks.workunit.client.1.smithi159.stdout:8/143: rename da/f29 to da/d22/d26/f2b 0 2024-09-13T22:08:55.368 INFO:tasks.workunit.client.1.smithi159.stdout:8/144: fsync da/d22/f27 0 2024-09-13T22:08:55.381 INFO:tasks.workunit.client.1.smithi159.stdout:8/145: dread f8 [0,4194304] 0 2024-09-13T22:08:55.381 INFO:tasks.workunit.client.1.smithi159.stdout:8/146: link da/l24 da/l2c 0 2024-09-13T22:08:55.382 INFO:tasks.workunit.client.1.smithi159.stdout:1/206: dwrite dd/d11/f24 [0,4194304] 0 2024-09-13T22:08:55.383 INFO:tasks.workunit.client.1.smithi159.stdout:1/207: write fb [947911,107695] 0 2024-09-13T22:08:55.383 INFO:tasks.workunit.client.1.smithi159.stdout:5/178: dwrite d1/d11/d1c/d32/f3a [0,4194304] 0 2024-09-13T22:08:55.383 INFO:tasks.workunit.client.1.smithi159.stdout:6/131: dwrite d3/f27 [0,4194304] 0 2024-09-13T22:08:55.383 INFO:tasks.workunit.client.1.smithi159.stdout:5/179: read d1/db/f25 [846099,21141] 0 2024-09-13T22:08:55.384 INFO:tasks.workunit.client.1.smithi159.stdout:1/208: unlink dd/c15 0 2024-09-13T22:08:55.390 INFO:tasks.workunit.client.1.smithi159.stdout:8/147: getdents da 0 2024-09-13T22:08:55.392 INFO:tasks.workunit.client.1.smithi159.stdout:5/180: rmdir d1/d11/d1c/d32 39 2024-09-13T22:08:55.393 INFO:tasks.workunit.client.1.smithi159.stdout:1/209: creat dd/d11/d18/d2e/f43 x:0 0 0 2024-09-13T22:08:55.393 INFO:tasks.workunit.client.1.smithi159.stdout:1/210: creat dd/d1e/f44 x:0 0 0 2024-09-13T22:08:55.394 INFO:tasks.workunit.client.1.smithi159.stdout:8/148: getdents da/d22/d26 0 2024-09-13T22:08:55.394 INFO:tasks.workunit.client.1.smithi159.stdout:5/181: rmdir d1/d11/d1c/d32 39 2024-09-13T22:08:55.395 INFO:tasks.workunit.client.1.smithi159.stdout:1/211: dread f3 [0,4194304] 0 2024-09-13T22:08:55.395 INFO:tasks.workunit.client.1.smithi159.stdout:1/212: getdents dd/d11/d34 0 2024-09-13T22:08:55.395 INFO:tasks.workunit.client.1.smithi159.stdout:6/132: dwrite d3/da/d29/f12 [0,4194304] 0 2024-09-13T22:08:55.397 INFO:tasks.workunit.client.1.smithi159.stdout:8/149: mknod da/d22/d2a/c2d 0 2024-09-13T22:08:55.398 INFO:tasks.workunit.client.1.smithi159.stdout:5/182: creat d1/db/d35/f40 x:0 0 0 2024-09-13T22:08:55.399 INFO:tasks.workunit.client.1.smithi159.stdout:1/213: rename dd/d1e/f37 to dd/d11/d13/f45 0 2024-09-13T22:08:55.400 INFO:tasks.workunit.client.1.smithi159.stdout:1/214: chown dd/d11/d19/d2d 1 1 2024-09-13T22:08:55.400 INFO:tasks.workunit.client.1.smithi159.stdout:1/215: stat dd/d1e/l2c 0 2024-09-13T22:08:55.403 INFO:tasks.workunit.client.1.smithi159.stdout:8/150: rename da/c12 to da/c2e 0 2024-09-13T22:08:55.403 INFO:tasks.workunit.client.1.smithi159.stdout:8/151: read da/f14 [1787218,709] 0 2024-09-13T22:08:55.403 INFO:tasks.workunit.client.1.smithi159.stdout:8/152: read f6 [1269197,54517] 0 2024-09-13T22:08:55.404 INFO:tasks.workunit.client.1.smithi159.stdout:6/133: write d3/f27 [574178,52576] 0 2024-09-13T22:08:55.405 INFO:tasks.workunit.client.1.smithi159.stdout:1/216: link dd/d1c/l30 dd/d11/d19/d2d/l46 0 2024-09-13T22:08:55.406 INFO:tasks.workunit.client.1.smithi159.stdout:1/217: dread dd/d1e/f22 [0,4194304] 0 2024-09-13T22:08:55.406 INFO:tasks.workunit.client.1.smithi159.stdout:1/218: chown dd/d11/d21/c3e 32327 1 2024-09-13T22:08:55.407 INFO:tasks.workunit.client.1.smithi159.stdout:6/134: creat d3/da/d25/f2c x:0 0 0 2024-09-13T22:08:55.409 INFO:tasks.workunit.client.1.smithi159.stdout:1/219: getdents dd/d11/d18/d2e/d3c 0 2024-09-13T22:08:55.415 INFO:tasks.workunit.client.1.smithi159.stdout:6/135: unlink d3/da/d29/f12 0 2024-09-13T22:08:55.415 INFO:tasks.workunit.client.1.smithi159.stdout:6/136: write d3/da/d25/f2c [941019,120466] 0 2024-09-13T22:08:55.417 INFO:tasks.workunit.client.1.smithi159.stdout:5/183: truncate d1/d11/f37 3865186 0 2024-09-13T22:08:55.418 INFO:tasks.workunit.client.1.smithi159.stdout:1/220: getdents dd/d11/d18 0 2024-09-13T22:08:55.418 INFO:tasks.workunit.client.1.smithi159.stdout:1/221: chown dd/d11/d13 0 1 2024-09-13T22:08:55.420 INFO:tasks.workunit.client.1.smithi159.stdout:1/222: mknod dd/d11/d34/c47 0 2024-09-13T22:08:55.420 INFO:tasks.workunit.client.1.smithi159.stdout:1/223: truncate dd/d11/d21/f42 243129 0 2024-09-13T22:08:55.420 INFO:tasks.workunit.client.1.smithi159.stdout:1/224: write f3 [105262,5074] 0 2024-09-13T22:08:55.422 INFO:tasks.workunit.client.1.smithi159.stdout:1/225: rename dd/d11/d18/f3b to dd/d1c/f48 0 2024-09-13T22:08:55.422 INFO:tasks.workunit.client.1.smithi159.stdout:1/226: readlink dd/d11/d13/l2a 0 2024-09-13T22:08:55.422 INFO:tasks.workunit.client.1.smithi159.stdout:1/227: chown dd/d11/d18/d2e/d3c 32 1 2024-09-13T22:08:55.424 INFO:tasks.workunit.client.1.smithi159.stdout:6/137: write d3/da/f16 [2383258,86129] 0 2024-09-13T22:08:55.425 INFO:tasks.workunit.client.1.smithi159.stdout:6/138: chown d3 81254 1 2024-09-13T22:08:55.425 INFO:tasks.workunit.client.1.smithi159.stdout:8/153: dwrite da/d22/f27 [0,4194304] 0 2024-09-13T22:08:55.428 INFO:tasks.workunit.client.1.smithi159.stdout:5/184: write d1/f3e [236947,63821] 0 2024-09-13T22:08:55.428 INFO:tasks.workunit.client.1.smithi159.stdout:6/139: creat d3/da/d29/f2d x:0 0 0 2024-09-13T22:08:55.431 INFO:tasks.workunit.client.1.smithi159.stdout:8/154: truncate da/f19 255793 0 2024-09-13T22:08:55.432 INFO:tasks.workunit.client.1.smithi159.stdout:1/228: dread fb [0,4194304] 0 2024-09-13T22:08:55.441 INFO:tasks.workunit.client.1.smithi159.stdout:5/185: getdents d1/d11/d1c/d32 0 2024-09-13T22:08:55.441 INFO:tasks.workunit.client.1.smithi159.stdout:8/155: symlink da/d22/l2f 0 2024-09-13T22:08:55.443 INFO:tasks.workunit.client.1.smithi159.stdout:5/186: symlink d1/d11/d1c/d32/l41 0 2024-09-13T22:08:55.445 INFO:tasks.workunit.client.1.smithi159.stdout:1/229: rename dd/d11/d19 to dd/d11/d18/d49 0 2024-09-13T22:08:55.451 INFO:tasks.workunit.client.1.smithi159.stdout:6/140: dwrite d3/f27 [0,4194304] 0 2024-09-13T22:08:55.451 INFO:tasks.workunit.client.1.smithi159.stdout:6/141: write d3/f23 [4714390,106975] 0 2024-09-13T22:08:55.455 INFO:tasks.workunit.client.1.smithi159.stdout:6/142: creat d3/da/d29/d1a/f2e x:0 0 0 2024-09-13T22:08:55.457 INFO:tasks.workunit.client.1.smithi159.stdout:6/143: symlink d3/da/d29/d26/l2f 0 2024-09-13T22:08:55.457 INFO:tasks.workunit.client.1.smithi159.stdout:6/144: fdatasync d3/f2b 0 2024-09-13T22:08:55.457 INFO:tasks.workunit.client.1.smithi159.stdout:8/156: write da/f15 [130770,1299] 0 2024-09-13T22:08:55.457 INFO:tasks.workunit.client.1.smithi159.stdout:8/157: getdents da/d22/d26 0 2024-09-13T22:08:55.460 INFO:tasks.workunit.client.1.smithi159.stdout:6/145: symlink d3/d2a/l30 0 2024-09-13T22:08:55.462 INFO:tasks.workunit.client.1.smithi159.stdout:8/158: truncate da/f14 3968185 0 2024-09-13T22:08:55.464 INFO:tasks.workunit.client.1.smithi159.stdout:8/159: mknod da/d22/d2a/c30 0 2024-09-13T22:08:55.464 INFO:tasks.workunit.client.1.smithi159.stdout:8/160: chown da/f10 65268287 1 2024-09-13T22:08:55.464 INFO:tasks.workunit.client.1.smithi159.stdout:5/187: dwrite d1/f2 [4194304,4194304] 0 2024-09-13T22:08:55.467 INFO:tasks.workunit.client.1.smithi159.stdout:5/188: link d1/db/d17/c1b d1/db/c42 0 2024-09-13T22:08:55.467 INFO:tasks.workunit.client.1.smithi159.stdout:5/189: chown d1/d11/l21 1794 1 2024-09-13T22:08:55.468 INFO:tasks.workunit.client.1.smithi159.stdout:6/146: fsync d3/da/d29/d1a/f2e 0 2024-09-13T22:08:55.469 INFO:tasks.workunit.client.1.smithi159.stdout:6/147: stat d3/da/d29/d26 0 2024-09-13T22:08:55.470 INFO:tasks.workunit.client.1.smithi159.stdout:6/148: mknod d3/d2a/c31 0 2024-09-13T22:08:55.470 INFO:tasks.workunit.client.1.smithi159.stdout:6/149: write d3/da/d29/d1a/f1c [4330375,27458] 0 2024-09-13T22:08:55.471 INFO:tasks.workunit.client.1.smithi159.stdout:5/190: dread d1/d15/f26 [0,4194304] 0 2024-09-13T22:08:55.484 INFO:tasks.workunit.client.1.smithi159.stdout:8/161: dwrite f6 [0,4194304] 0 2024-09-13T22:08:55.486 INFO:tasks.workunit.client.1.smithi159.stdout:7/164: sync 2024-09-13T22:08:55.486 INFO:tasks.workunit.client.1.smithi159.stdout:0/253: sync 2024-09-13T22:08:55.486 INFO:tasks.workunit.client.1.smithi159.stdout:0/254: fdatasync d0/d48/d4f/f35 0 2024-09-13T22:08:55.488 INFO:tasks.workunit.client.1.smithi159.stdout:7/165: read d3/f15 [4660864,72608] 0 2024-09-13T22:08:55.488 INFO:tasks.workunit.client.1.smithi159.stdout:0/255: rename d0/f8 to d0/f52 0 2024-09-13T22:08:55.488 INFO:tasks.workunit.client.1.smithi159.stdout:8/162: dread da/f14 [0,4194304] 0 2024-09-13T22:08:55.489 INFO:tasks.workunit.client.1.smithi159.stdout:0/256: creat d0/d48/d4f/f53 x:0 0 0 2024-09-13T22:08:55.491 INFO:tasks.workunit.client.1.smithi159.stdout:8/163: creat da/f31 x:0 0 0 2024-09-13T22:08:55.495 INFO:tasks.workunit.client.1.smithi159.stdout:0/257: mkdir d0/d48/d4f/d54 0 2024-09-13T22:08:55.495 INFO:tasks.workunit.client.1.smithi159.stdout:5/191: dwrite d1/f2 [4194304,4194304] 0 2024-09-13T22:08:55.495 INFO:tasks.workunit.client.1.smithi159.stdout:5/192: fsync d1/d15/f31 0 2024-09-13T22:08:55.495 INFO:tasks.workunit.client.1.smithi159.stdout:5/193: chown d1/db 1270063 1 2024-09-13T22:08:55.495 INFO:tasks.workunit.client.1.smithi159.stdout:8/164: mknod da/d22/d26/c32 0 2024-09-13T22:08:55.496 INFO:tasks.workunit.client.1.smithi159.stdout:8/165: write da/d22/d26/f2b [109682,39866] 0 2024-09-13T22:08:55.496 INFO:tasks.workunit.client.1.smithi159.stdout:6/150: dwrite d3/da/d29/d1a/f1c [0,4194304] 0 2024-09-13T22:08:55.496 INFO:tasks.workunit.client.1.smithi159.stdout:6/151: truncate d3/da/d29/d1a/f24 307867 0 2024-09-13T22:08:55.507 INFO:tasks.workunit.client.1.smithi159.stdout:6/152: dread d3/da/d29/f17 [0,4194304] 0 2024-09-13T22:08:55.507 INFO:tasks.workunit.client.1.smithi159.stdout:6/153: fsync d3/da/f10 0 2024-09-13T22:08:55.508 INFO:tasks.workunit.client.1.smithi159.stdout:6/154: truncate d3/da/f28 3557581 0 2024-09-13T22:08:55.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:55 smithi159 ceph-mon[35348]: pgmap v259: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 183 MiB/s rd, 232 MiB/s wr, 387 op/s 2024-09-13T22:08:55.510 INFO:tasks.workunit.client.1.smithi159.stdout:7/166: dwrite d3/d18/f1d [0,4194304] 0 2024-09-13T22:08:55.511 INFO:tasks.workunit.client.1.smithi159.stdout:7/167: creat d3/d18/f36 x:0 0 0 2024-09-13T22:08:55.511 INFO:tasks.workunit.client.1.smithi159.stdout:0/258: write d0/d2c/f37 [219785,55820] 0 2024-09-13T22:08:55.514 INFO:tasks.workunit.client.1.smithi159.stdout:8/166: getdents da 0 2024-09-13T22:08:55.519 INFO:tasks.workunit.client.1.smithi159.stdout:8/167: mkdir da/d22/d33 0 2024-09-13T22:08:55.520 INFO:tasks.workunit.client.1.smithi159.stdout:8/168: creat da/d22/f34 x:0 0 0 2024-09-13T22:08:55.531 INFO:tasks.workunit.client.1.smithi159.stdout:6/155: dwrite d3/da/d29/f11 [0,4194304] 0 2024-09-13T22:08:55.532 INFO:tasks.workunit.client.1.smithi159.stdout:6/156: readlink d3/da/d29/d1a/l22 0 2024-09-13T22:08:55.532 INFO:tasks.workunit.client.1.smithi159.stdout:6/157: dread - d3/da/d29/d1a/f2e zero size 2024-09-13T22:08:55.532 INFO:tasks.workunit.client.1.smithi159.stdout:7/168: dwrite d3/fe [0,4194304] 0 2024-09-13T22:08:55.534 INFO:tasks.workunit.client.1.smithi159.stdout:6/158: dread d3/da/d29/f17 [0,4194304] 0 2024-09-13T22:08:55.535 INFO:tasks.workunit.client.1.smithi159.stdout:8/169: fsync da/d22/f34 0 2024-09-13T22:08:55.537 INFO:tasks.workunit.client.1.smithi159.stdout:8/170: dread da/d22/d26/f2b [0,4194304] 0 2024-09-13T22:08:55.539 INFO:tasks.workunit.client.1.smithi159.stdout:8/171: symlink da/d22/d2a/l35 0 2024-09-13T22:08:55.540 INFO:tasks.workunit.client.1.smithi159.stdout:8/172: mkdir da/d36 0 2024-09-13T22:08:55.540 INFO:tasks.workunit.client.1.smithi159.stdout:8/173: fdatasync da/f14 0 2024-09-13T22:08:55.541 INFO:tasks.workunit.client.1.smithi159.stdout:8/174: dread da/d22/d26/f2b [0,4194304] 0 2024-09-13T22:08:55.543 INFO:tasks.workunit.client.1.smithi159.stdout:8/175: mknod da/c37 0 2024-09-13T22:08:55.543 INFO:tasks.workunit.client.1.smithi159.stdout:8/176: write da/f15 [3648071,29703] 0 2024-09-13T22:08:55.547 INFO:tasks.workunit.client.1.smithi159.stdout:7/169: dwrite d3/f1f [0,4194304] 0 2024-09-13T22:08:55.554 INFO:tasks.workunit.client.1.smithi159.stdout:8/177: dread f8 [0,4194304] 0 2024-09-13T22:08:55.562 INFO:tasks.workunit.client.1.smithi159.stdout:7/170: dwrite d3/ff [0,4194304] 0 2024-09-13T22:08:55.562 INFO:tasks.workunit.client.1.smithi159.stdout:7/171: rename d3 to d3/d18/d37 22 2024-09-13T22:08:55.562 INFO:tasks.workunit.client.1.smithi159.stdout:7/172: chown d3/f11 235460133 1 2024-09-13T22:08:55.563 INFO:tasks.workunit.client.1.smithi159.stdout:8/178: dread f6 [0,4194304] 0 2024-09-13T22:08:55.565 INFO:tasks.workunit.client.1.smithi159.stdout:8/179: creat da/d22/d33/f38 x:0 0 0 2024-09-13T22:08:55.566 INFO:tasks.workunit.client.1.smithi159.stdout:8/180: write da/d22/d26/f2b [420376,8300] 0 2024-09-13T22:08:55.567 INFO:tasks.workunit.client.1.smithi159.stdout:8/181: mkdir da/d22/d2a/d39 0 2024-09-13T22:08:55.591 INFO:tasks.workunit.client.1.smithi159.stdout:7/173: dwrite d3/f14 [4194304,4194304] 0 2024-09-13T22:08:55.591 INFO:tasks.workunit.client.1.smithi159.stdout:8/182: dwrite f7 [0,4194304] 0 2024-09-13T22:08:55.591 INFO:tasks.workunit.client.1.smithi159.stdout:8/183: write da/f31 [528041,37878] 0 2024-09-13T22:08:55.591 INFO:tasks.workunit.client.1.smithi159.stdout:8/184: truncate da/f18 1518590 0 2024-09-13T22:08:55.595 INFO:tasks.workunit.client.1.smithi159.stdout:7/174: symlink d3/d31/l38 0 2024-09-13T22:08:55.620 INFO:tasks.workunit.client.1.smithi159.stdout:7/175: symlink d3/l39 0 2024-09-13T22:08:55.620 INFO:tasks.workunit.client.1.smithi159.stdout:7/176: write d3/d18/f32 [446489,7388] 0 2024-09-13T22:08:55.621 INFO:tasks.workunit.client.1.smithi159.stdout:7/177: unlink d3/f1c 0 2024-09-13T22:08:55.623 INFO:tasks.workunit.client.1.smithi159.stdout:7/178: rename d3/l21 to d3/d2e/l3a 0 2024-09-13T22:08:55.623 INFO:tasks.workunit.client.1.smithi159.stdout:7/179: write d3/d31/f33 [80967,105084] 0 2024-09-13T22:08:55.623 INFO:tasks.workunit.client.1.smithi159.stdout:7/180: write d3/d2e/f35 [656563,72872] 0 2024-09-13T22:08:55.625 INFO:tasks.workunit.client.1.smithi159.stdout:8/185: dwrite f6 [4194304,4194304] 0 2024-09-13T22:08:55.625 INFO:tasks.workunit.client.1.smithi159.stdout:7/181: fdatasync d3/d18/f32 0 2024-09-13T22:08:55.631 INFO:tasks.workunit.client.1.smithi159.stdout:8/186: symlink da/d22/d2a/d39/l3a 0 2024-09-13T22:08:55.631 INFO:tasks.workunit.client.1.smithi159.stdout:8/187: readlink da/l1b 0 2024-09-13T22:08:55.634 INFO:tasks.workunit.client.1.smithi159.stdout:7/182: symlink d3/d18/l3b 0 2024-09-13T22:08:55.634 INFO:tasks.workunit.client.1.smithi159.stdout:7/183: dread - d3/d18/f36 zero size 2024-09-13T22:08:55.634 INFO:tasks.workunit.client.1.smithi159.stdout:7/184: chown d3/l39 13625 1 2024-09-13T22:08:55.634 INFO:tasks.workunit.client.1.smithi159.stdout:7/185: readlink d3/l25 0 2024-09-13T22:08:55.639 INFO:tasks.workunit.client.1.smithi159.stdout:8/188: dread da/d22/f27 [0,4194304] 0 2024-09-13T22:08:55.640 INFO:tasks.workunit.client.1.smithi159.stdout:7/186: truncate d3/ff 1043574 0 2024-09-13T22:08:55.640 INFO:tasks.workunit.client.1.smithi159.stdout:7/187: creat d3/d18/f3c x:0 0 0 2024-09-13T22:08:55.643 INFO:tasks.workunit.client.1.smithi159.stdout:8/189: link da/l2c da/d22/d2a/d39/l3b 0 2024-09-13T22:08:55.643 INFO:tasks.workunit.client.1.smithi159.stdout:8/190: write da/f19 [778920,86213] 0 2024-09-13T22:08:55.643 INFO:tasks.workunit.client.1.smithi159.stdout:8/191: readlink da/l13 0 2024-09-13T22:08:55.643 INFO:tasks.workunit.client.1.smithi159.stdout:8/192: chown da/d22/d2a/l35 97144305 1 2024-09-13T22:08:55.647 INFO:tasks.workunit.client.1.smithi159.stdout:7/188: rename d3/f1a to d3/d18/f3d 0 2024-09-13T22:08:55.647 INFO:tasks.workunit.client.1.smithi159.stdout:7/189: creat d3/d18/f3e x:0 0 0 2024-09-13T22:08:55.647 INFO:tasks.workunit.client.1.smithi159.stdout:7/190: dread - d3/d18/f20 zero size 2024-09-13T22:08:55.650 INFO:tasks.workunit.client.1.smithi159.stdout:7/191: mkdir d3/d3f 0 2024-09-13T22:08:55.650 INFO:tasks.workunit.client.1.smithi159.stdout:7/192: creat d3/d18/f40 x:0 0 0 2024-09-13T22:08:55.654 INFO:tasks.workunit.client.1.smithi159.stdout:7/193: mknod d3/d2e/c41 0 2024-09-13T22:08:55.655 INFO:tasks.workunit.client.1.smithi159.stdout:7/194: chown d3/d31 2 1 2024-09-13T22:08:55.663 INFO:tasks.workunit.client.1.smithi159.stdout:8/193: dwrite da/d22/d33/f38 [0,4194304] 0 2024-09-13T22:08:55.663 INFO:tasks.workunit.client.1.smithi159.stdout:8/194: write da/f31 [990895,61902] 0 2024-09-13T22:08:55.665 INFO:tasks.workunit.client.1.smithi159.stdout:7/195: dread d3/d31/f33 [0,4194304] 0 2024-09-13T22:08:55.667 INFO:tasks.workunit.client.1.smithi159.stdout:7/196: mknod d3/d2e/c42 0 2024-09-13T22:08:55.667 INFO:tasks.workunit.client.1.smithi159.stdout:7/197: write d3/d18/f3e [494660,15753] 0 2024-09-13T22:08:55.669 INFO:tasks.workunit.client.1.smithi159.stdout:7/198: symlink d3/d2e/l43 0 2024-09-13T22:08:55.671 INFO:tasks.workunit.client.1.smithi159.stdout:7/199: rename d3/d2e/c42 to d3/d2e/c44 0 2024-09-13T22:08:55.678 INFO:tasks.workunit.client.1.smithi159.stdout:7/200: dread d3/f1e [0,4194304] 0 2024-09-13T22:08:55.682 INFO:tasks.workunit.client.1.smithi159.stdout:7/201: unlink d3/f16 0 2024-09-13T22:08:55.682 INFO:tasks.workunit.client.1.smithi159.stdout:8/195: dwrite f8 [0,4194304] 0 2024-09-13T22:08:55.684 INFO:tasks.workunit.client.1.smithi159.stdout:7/202: rename d3/d18/l2c to d3/l45 0 2024-09-13T22:08:55.684 INFO:tasks.workunit.client.1.smithi159.stdout:8/196: mknod da/d22/d33/c3c 0 2024-09-13T22:08:55.686 INFO:tasks.workunit.client.1.smithi159.stdout:7/203: rename d3/l8 to d3/d2e/l46 0 2024-09-13T22:08:55.687 INFO:tasks.workunit.client.1.smithi159.stdout:8/197: creat da/d36/f3d x:0 0 0 2024-09-13T22:08:55.687 INFO:tasks.workunit.client.1.smithi159.stdout:8/198: dread - da/d36/f3d zero size 2024-09-13T22:08:55.689 INFO:tasks.workunit.client.1.smithi159.stdout:7/204: rename c0 to d3/d18/c47 0 2024-09-13T22:08:55.691 INFO:tasks.workunit.client.1.smithi159.stdout:8/199: dread da/f10 [0,4194304] 0 2024-09-13T22:08:55.691 INFO:tasks.workunit.client.1.smithi159.stdout:7/205: rename d3/f9 to d3/d3f/f48 0 2024-09-13T22:08:55.693 INFO:tasks.workunit.client.1.smithi159.stdout:8/200: mkdir da/d22/d2a/d39/d3e 0 2024-09-13T22:08:55.695 INFO:tasks.workunit.client.1.smithi159.stdout:8/201: mknod da/d22/d2a/d39/d3e/c3f 0 2024-09-13T22:08:55.695 INFO:tasks.workunit.client.1.smithi159.stdout:8/202: fsync da/f15 0 2024-09-13T22:08:55.695 INFO:tasks.workunit.client.1.smithi159.stdout:8/203: dread - da/d36/f3d zero size 2024-09-13T22:08:55.695 INFO:tasks.workunit.client.1.smithi159.stdout:8/204: creat da/d36/f40 x:0 0 0 2024-09-13T22:08:55.698 INFO:tasks.workunit.client.1.smithi159.stdout:8/205: unlink da/l1a 0 2024-09-13T22:08:55.699 INFO:tasks.workunit.client.1.smithi159.stdout:8/206: write da/f31 [729607,76263] 0 2024-09-13T22:08:55.700 INFO:tasks.workunit.client.1.smithi159.stdout:7/206: dread d3/f15 [0,4194304] 0 2024-09-13T22:08:55.700 INFO:tasks.workunit.client.1.smithi159.stdout:7/207: fdatasync d3/d18/f3d 0 2024-09-13T22:08:55.703 INFO:tasks.workunit.client.1.smithi159.stdout:8/207: rename da/f19 to da/d36/f41 0 2024-09-13T22:08:55.703 INFO:tasks.workunit.client.1.smithi159.stdout:8/208: write f4 [1388083,118526] 0 2024-09-13T22:08:55.704 INFO:tasks.workunit.client.1.smithi159.stdout:7/208: unlink d3/d18/f24 0 2024-09-13T22:08:55.714 INFO:tasks.workunit.client.1.smithi159.stdout:8/209: rmdir da/d22/d33 39 2024-09-13T22:08:55.715 INFO:tasks.workunit.client.1.smithi159.stdout:8/210: symlink da/d22/d2a/l42 0 2024-09-13T22:08:55.718 INFO:tasks.workunit.client.1.smithi159.stdout:7/209: dwrite d3/d18/f40 [0,4194304] 0 2024-09-13T22:08:55.720 INFO:tasks.workunit.client.1.smithi159.stdout:7/210: mkdir d3/d31/d49 0 2024-09-13T22:08:55.725 INFO:tasks.workunit.client.1.smithi159.stdout:8/211: dread f7 [0,4194304] 0 2024-09-13T22:08:55.725 INFO:tasks.workunit.client.1.smithi159.stdout:8/212: truncate da/d36/f40 305229 0 2024-09-13T22:08:55.727 INFO:tasks.workunit.client.1.smithi159.stdout:8/213: dread da/d36/f41 [0,4194304] 0 2024-09-13T22:08:55.727 INFO:tasks.workunit.client.1.smithi159.stdout:7/211: write d3/f1f [2499446,109341] 0 2024-09-13T22:08:55.729 INFO:tasks.workunit.client.1.smithi159.stdout:7/212: rename d3/f1f to d3/d3f/f4a 0 2024-09-13T22:08:55.730 INFO:tasks.workunit.client.1.smithi159.stdout:7/213: mkdir d3/d4b 0 2024-09-13T22:08:55.732 INFO:tasks.workunit.client.1.smithi159.stdout:7/214: unlink d3/l25 0 2024-09-13T22:08:55.732 INFO:tasks.workunit.client.1.smithi159.stdout:8/214: write da/d22/f27 [2873167,91596] 0 2024-09-13T22:08:55.733 INFO:tasks.workunit.client.1.smithi159.stdout:8/215: fsync da/d22/d33/f38 0 2024-09-13T22:08:55.733 INFO:tasks.workunit.client.1.smithi159.stdout:7/215: dread d3/d31/f33 [0,4194304] 0 2024-09-13T22:08:55.733 INFO:tasks.workunit.client.1.smithi159.stdout:8/216: mknod da/d22/d26/c43 0 2024-09-13T22:08:55.734 INFO:tasks.workunit.client.1.smithi159.stdout:7/216: symlink d3/d4b/l4c 0 2024-09-13T22:08:55.735 INFO:tasks.workunit.client.1.smithi159.stdout:8/217: creat da/d22/d2a/d39/d3e/f44 x:0 0 0 2024-09-13T22:08:55.735 INFO:tasks.workunit.client.1.smithi159.stdout:8/218: readlink da/d22/l2f 0 2024-09-13T22:08:55.736 INFO:tasks.workunit.client.1.smithi159.stdout:7/217: unlink d3/d18/f3e 0 2024-09-13T22:08:55.737 INFO:tasks.workunit.client.1.smithi159.stdout:7/218: chown d3/l39 97 1 2024-09-13T22:08:55.737 INFO:tasks.workunit.client.1.smithi159.stdout:8/219: mknod da/d22/d33/c45 0 2024-09-13T22:08:55.738 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:55 smithi089 ceph-mon[27921]: pgmap v259: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 183 MiB/s rd, 232 MiB/s wr, 387 op/s 2024-09-13T22:08:55.743 INFO:tasks.workunit.client.1.smithi159.stdout:3/180: sync 2024-09-13T22:08:55.743 INFO:tasks.workunit.client.1.smithi159.stdout:4/178: sync 2024-09-13T22:08:55.745 INFO:tasks.workunit.client.1.smithi159.stdout:7/219: write d3/d18/f40 [3252338,87256] 0 2024-09-13T22:08:55.746 INFO:tasks.workunit.client.1.smithi159.stdout:3/181: symlink d0/d1/d3/d35/l3b 0 2024-09-13T22:08:55.747 INFO:tasks.workunit.client.1.smithi159.stdout:7/220: rmdir d3/d31 39 2024-09-13T22:08:55.750 INFO:tasks.workunit.client.1.smithi159.stdout:3/182: dread d0/d1/f1a [0,4194304] 0 2024-09-13T22:08:55.751 INFO:tasks.workunit.client.1.smithi159.stdout:3/183: write d0/d1/d3/f1f [415862,87858] 0 2024-09-13T22:08:55.760 INFO:tasks.workunit.client.1.smithi159.stdout:7/221: mkdir d3/d31/d4d 0 2024-09-13T22:08:55.760 INFO:tasks.workunit.client.1.smithi159.stdout:7/222: dread - d3/f2a zero size 2024-09-13T22:08:55.760 INFO:tasks.workunit.client.1.smithi159.stdout:7/223: write d3/f34 [236736,43366] 0 2024-09-13T22:08:55.761 INFO:tasks.workunit.client.1.smithi159.stdout:3/184: symlink d0/d1/d15/l3c 0 2024-09-13T22:08:55.761 INFO:tasks.workunit.client.1.smithi159.stdout:3/185: write d0/d1/d3/d5/f17 [132903,70183] 0 2024-09-13T22:08:55.764 INFO:tasks.workunit.client.1.smithi159.stdout:3/186: rename d0/d1/f1a to d0/d1/d3/d5/d25/d2c/f3d 0 2024-09-13T22:08:55.764 INFO:tasks.workunit.client.1.smithi159.stdout:3/187: write d0/d1/d3/dd/f1b [767934,111302] 0 2024-09-13T22:08:55.766 INFO:tasks.workunit.client.1.smithi159.stdout:7/224: write d3/fe [440611,17112] 0 2024-09-13T22:08:55.766 INFO:tasks.workunit.client.1.smithi159.stdout:4/179: dwrite f10 [0,4194304] 0 2024-09-13T22:08:55.766 INFO:tasks.workunit.client.1.smithi159.stdout:8/220: dwrite f6 [0,4194304] 0 2024-09-13T22:08:55.766 INFO:tasks.workunit.client.1.smithi159.stdout:7/225: rmdir d3/d3f 39 2024-09-13T22:08:55.769 INFO:tasks.workunit.client.1.smithi159.stdout:3/188: dread d0/d1/d3/f1f [0,4194304] 0 2024-09-13T22:08:55.769 INFO:tasks.workunit.client.1.smithi159.stdout:3/189: truncate d0/d1/d3/d5/d25/f27 124371 0 2024-09-13T22:08:55.770 INFO:tasks.workunit.client.1.smithi159.stdout:8/221: creat da/d22/d33/f46 x:0 0 0 2024-09-13T22:08:55.770 INFO:tasks.workunit.client.1.smithi159.stdout:8/222: fsync f6 0 2024-09-13T22:08:55.770 INFO:tasks.workunit.client.1.smithi159.stdout:8/223: creat da/d36/f47 x:0 0 0 2024-09-13T22:08:55.771 INFO:tasks.workunit.client.1.smithi159.stdout:8/224: chown da/l24 30083 1 2024-09-13T22:08:55.771 INFO:tasks.workunit.client.1.smithi159.stdout:8/225: chown da/d22/d33/f46 1498 1 2024-09-13T22:08:55.772 INFO:tasks.workunit.client.1.smithi159.stdout:8/226: write da/f31 [400608,123073] 0 2024-09-13T22:08:55.772 INFO:tasks.workunit.client.1.smithi159.stdout:3/190: creat d0/d1/d34/f3e x:0 0 0 2024-09-13T22:08:55.779 INFO:tasks.workunit.client.1.smithi159.stdout:8/227: mkdir da/d36/d48 0 2024-09-13T22:08:55.780 INFO:tasks.workunit.client.1.smithi159.stdout:3/191: creat d0/d1/d3/d5/db/d39/f3f x:0 0 0 2024-09-13T22:08:55.782 INFO:tasks.workunit.client.1.smithi159.stdout:8/228: mkdir da/d22/d33/d49 0 2024-09-13T22:08:55.783 INFO:tasks.workunit.client.1.smithi159.stdout:3/192: link d0/d1/d3/f24 d0/d1/d34/f40 0 2024-09-13T22:08:55.784 INFO:tasks.workunit.client.1.smithi159.stdout:8/229: mkdir da/d22/d4a 0 2024-09-13T22:08:55.784 INFO:tasks.workunit.client.1.smithi159.stdout:8/230: dread - da/d22/d33/f46 zero size 2024-09-13T22:08:55.784 INFO:tasks.workunit.client.1.smithi159.stdout:8/231: write f4 [2465658,106347] 0 2024-09-13T22:08:55.786 INFO:tasks.workunit.client.1.smithi159.stdout:8/232: getdents da 0 2024-09-13T22:08:55.788 INFO:tasks.workunit.client.1.smithi159.stdout:8/233: mkdir da/d22/d26/d4b 0 2024-09-13T22:08:55.792 INFO:tasks.workunit.client.1.smithi159.stdout:4/180: dwrite d13/f14 [0,4194304] 0 2024-09-13T22:08:55.792 INFO:tasks.workunit.client.1.smithi159.stdout:7/226: dwrite d3/fe [0,4194304] 0 2024-09-13T22:08:55.792 INFO:tasks.workunit.client.1.smithi159.stdout:4/181: dread - d13/f24 zero size 2024-09-13T22:08:55.793 INFO:tasks.workunit.client.1.smithi159.stdout:4/182: creat d13/d15/f36 x:0 0 0 2024-09-13T22:08:55.796 INFO:tasks.workunit.client.1.smithi159.stdout:7/227: mkdir d3/d31/d4d/d4e 0 2024-09-13T22:08:55.796 INFO:tasks.workunit.client.1.smithi159.stdout:3/193: dread d0/d1/d3/d5/f17 [0,4194304] 0 2024-09-13T22:08:55.799 INFO:tasks.workunit.client.1.smithi159.stdout:4/183: creat d13/d15/d26/f37 x:0 0 0 2024-09-13T22:08:55.799 INFO:tasks.workunit.client.1.smithi159.stdout:4/184: creat d13/f38 x:0 0 0 2024-09-13T22:08:55.799 INFO:tasks.workunit.client.1.smithi159.stdout:4/185: stat d13/c28 0 2024-09-13T22:08:55.799 INFO:tasks.workunit.client.1.smithi159.stdout:7/228: truncate d3/f1e 3031814 0 2024-09-13T22:08:55.803 INFO:tasks.workunit.client.1.smithi159.stdout:4/186: chown lf 854030 1 2024-09-13T22:08:55.803 INFO:tasks.workunit.client.1.smithi159.stdout:4/187: chown d13/d15/f1f 1028883291 1 2024-09-13T22:08:55.809 INFO:tasks.workunit.client.1.smithi159.stdout:3/194: dread d0/d1/d3/dd/f30 [0,4194304] 0 2024-09-13T22:08:55.810 INFO:tasks.workunit.client.1.smithi159.stdout:8/234: dwrite da/d36/f47 [0,4194304] 0 2024-09-13T22:08:55.810 INFO:tasks.workunit.client.1.smithi159.stdout:8/235: creat da/d22/d2a/d39/d3e/f4c x:0 0 0 2024-09-13T22:08:55.819 INFO:tasks.workunit.client.1.smithi159.stdout:3/195: write d0/d1/d3/f24 [3097911,78787] 0 2024-09-13T22:08:55.820 INFO:tasks.workunit.client.1.smithi159.stdout:3/196: creat d0/d1/d34/f41 x:0 0 0 2024-09-13T22:08:55.823 INFO:tasks.workunit.client.1.smithi159.stdout:7/229: dwrite d3/d18/f20 [0,4194304] 0 2024-09-13T22:08:55.823 INFO:tasks.workunit.client.1.smithi159.stdout:7/230: chown d3/c2b 763 1 2024-09-13T22:08:55.824 INFO:tasks.workunit.client.1.smithi159.stdout:4/188: dwrite d13/f14 [0,4194304] 0 2024-09-13T22:08:55.836 INFO:tasks.workunit.client.1.smithi159.stdout:2/155: sync 2024-09-13T22:08:55.836 INFO:tasks.workunit.client.1.smithi159.stdout:2/156: creat d9/da/d25/f34 x:0 0 0 2024-09-13T22:08:55.836 INFO:tasks.workunit.client.1.smithi159.stdout:2/157: stat d9/da/d27 0 2024-09-13T22:08:55.840 INFO:tasks.workunit.client.1.smithi159.stdout:4/189: write f2 [108187,73630] 0 2024-09-13T22:08:55.840 INFO:tasks.workunit.client.1.smithi159.stdout:4/190: creat d13/d15/f39 x:0 0 0 2024-09-13T22:08:55.840 INFO:tasks.workunit.client.1.smithi159.stdout:4/191: stat d13/d15/f16 0 2024-09-13T22:08:55.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/197: dwrite d0/d1/d3/d5/d25/d2c/f3d [0,4194304] 0 2024-09-13T22:08:55.853 INFO:tasks.workunit.client.1.smithi159.stdout:3/198: mkdir d0/d1/d3/d5/d14/d42 0 2024-09-13T22:08:55.858 INFO:tasks.workunit.client.1.smithi159.stdout:7/231: dwrite d3/d18/f40 [0,4194304] 0 2024-09-13T22:08:55.862 INFO:tasks.workunit.client.1.smithi159.stdout:7/232: mkdir d3/d31/d4d/d4e/d4f 0 2024-09-13T22:08:55.862 INFO:tasks.workunit.client.1.smithi159.stdout:7/233: fdatasync d3/d18/f3d 0 2024-09-13T22:08:55.863 INFO:tasks.workunit.client.1.smithi159.stdout:4/192: rmdir d13/d15/d26 39 2024-09-13T22:08:55.863 INFO:tasks.workunit.client.1.smithi159.stdout:4/193: truncate d13/d15/d26/f37 772846 0 2024-09-13T22:08:55.866 INFO:tasks.workunit.client.1.smithi159.stdout:7/234: mknod d3/d18/c50 0 2024-09-13T22:08:55.866 INFO:tasks.workunit.client.1.smithi159.stdout:7/235: chown d3/d18/f1d 101500 1 2024-09-13T22:08:55.866 INFO:tasks.workunit.client.1.smithi159.stdout:4/194: getdents d13/d15/d26 0 2024-09-13T22:08:55.870 INFO:tasks.workunit.client.1.smithi159.stdout:4/195: mknod d13/d15/d26/c3a 0 2024-09-13T22:08:55.875 INFO:tasks.workunit.client.1.smithi159.stdout:4/196: dread - d13/d15/d26/f33 zero size 2024-09-13T22:08:55.879 INFO:tasks.workunit.client.1.smithi159.stdout:7/236: write d3/f14 [7245338,49796] 0 2024-09-13T22:08:55.880 INFO:tasks.workunit.client.1.smithi159.stdout:8/236: rmdir da/d22/d2a/d39/d3e 39 2024-09-13T22:08:55.882 INFO:tasks.workunit.client.1.smithi159.stdout:4/197: chown d13/d15/d26/f37 4 1 2024-09-13T22:08:55.885 INFO:tasks.workunit.client.1.smithi159.stdout:7/237: creat d3/d31/d4d/d4e/f51 x:0 0 0 2024-09-13T22:08:55.885 INFO:tasks.workunit.client.1.smithi159.stdout:7/238: chown d3/lb 1 1 2024-09-13T22:08:55.889 INFO:tasks.workunit.client.1.smithi159.stdout:4/198: mkdir d13/d15/d26/d29/d3b 0 2024-09-13T22:08:55.889 INFO:tasks.workunit.client.1.smithi159.stdout:4/199: write d13/d15/d26/f37 [1525506,58586] 0 2024-09-13T22:08:55.892 INFO:tasks.workunit.client.1.smithi159.stdout:7/239: dread d3/d3f/f4a [0,4194304] 0 2024-09-13T22:08:55.892 INFO:tasks.workunit.client.1.smithi159.stdout:8/237: write f7 [1185892,95447] 0 2024-09-13T22:08:55.892 INFO:tasks.workunit.client.1.smithi159.stdout:8/238: creat da/d22/f4d x:0 0 0 2024-09-13T22:08:55.892 INFO:tasks.workunit.client.1.smithi159.stdout:8/239: stat da/d36/f41 0 2024-09-13T22:08:55.892 INFO:tasks.workunit.client.1.smithi159.stdout:8/240: write da/f31 [569436,37777] 0 2024-09-13T22:08:55.893 INFO:tasks.workunit.client.1.smithi159.stdout:4/200: truncate d13/d15/f16 1310631 0 2024-09-13T22:08:55.896 INFO:tasks.workunit.client.1.smithi159.stdout:4/201: rename f2 to d13/d15/f3c 0 2024-09-13T22:08:55.898 INFO:tasks.workunit.client.1.smithi159.stdout:4/202: link d13/d15/f17 d13/d15/d26/d29/d3b/f3d 0 2024-09-13T22:08:55.898 INFO:tasks.workunit.client.1.smithi159.stdout:4/203: chown d13/d15/c2b 1090002 1 2024-09-13T22:08:55.900 INFO:tasks.workunit.client.1.smithi159.stdout:4/204: stat d13/d15/d26/f34 0 2024-09-13T22:08:55.905 INFO:tasks.workunit.client.1.smithi159.stdout:7/240: write d3/f11 [2344873,101087] 0 2024-09-13T22:08:55.909 INFO:tasks.workunit.client.1.smithi159.stdout:7/241: dread d3/d18/f32 [0,4194304] 0 2024-09-13T22:08:55.910 INFO:tasks.workunit.client.1.smithi159.stdout:8/241: fsync da/d22/f4d 0 2024-09-13T22:08:55.912 INFO:tasks.workunit.client.1.smithi159.stdout:7/242: link d3/f2a d3/d31/d4d/d4e/f52 0 2024-09-13T22:08:55.914 INFO:tasks.workunit.client.1.smithi159.stdout:7/243: symlink d3/d31/d4d/l53 0 2024-09-13T22:08:55.919 INFO:tasks.workunit.client.1.smithi159.stdout:7/244: dread d3/f15 [0,4194304] 0 2024-09-13T22:08:55.920 INFO:tasks.workunit.client.1.smithi159.stdout:7/245: truncate d3/f14 378209 0 2024-09-13T22:08:55.923 INFO:tasks.workunit.client.1.smithi159.stdout:4/205: dwrite d13/d15/f1d [0,4194304] 0 2024-09-13T22:08:55.923 INFO:tasks.workunit.client.1.smithi159.stdout:8/242: write da/d36/f47 [3419755,29155] 0 2024-09-13T22:08:55.930 INFO:tasks.workunit.client.1.smithi159.stdout:8/243: creat da/d22/d4a/f4e x:0 0 0 2024-09-13T22:08:55.950 INFO:tasks.workunit.client.1.smithi159.stdout:4/206: write d13/d15/f1d [2448270,72665] 0 2024-09-13T22:08:55.960 INFO:tasks.workunit.client.1.smithi159.stdout:1/230: sync 2024-09-13T22:08:55.960 INFO:tasks.workunit.client.1.smithi159.stdout:9/233: sync 2024-09-13T22:08:55.960 INFO:tasks.workunit.client.1.smithi159.stdout:9/234: chown d1/d9/d3d 0 1 2024-09-13T22:08:55.965 INFO:tasks.workunit.client.1.smithi159.stdout:4/207: dread d13/d15/f1f [0,4194304] 0 2024-09-13T22:08:55.965 INFO:tasks.workunit.client.1.smithi159.stdout:8/244: dwrite da/d22/f27 [0,4194304] 0 2024-09-13T22:08:55.965 INFO:tasks.workunit.client.1.smithi159.stdout:8/245: fdatasync da/d22/d4a/f4e 0 2024-09-13T22:08:55.967 INFO:tasks.workunit.client.1.smithi159.stdout:9/235: mknod d1/d9/d3d/d2f/c58 0 2024-09-13T22:08:55.968 INFO:tasks.workunit.client.1.smithi159.stdout:4/208: rmdir d13/d15/d26/d29/d3b 39 2024-09-13T22:08:55.969 INFO:tasks.workunit.client.1.smithi159.stdout:9/236: dread d1/dc/f3e [0,4194304] 0 2024-09-13T22:08:55.971 INFO:tasks.workunit.client.1.smithi159.stdout:8/246: rmdir da/d22/d26/d4b 0 2024-09-13T22:08:55.971 INFO:tasks.workunit.client.1.smithi159.stdout:8/247: chown da/d22/d26 10214123 1 2024-09-13T22:08:55.971 INFO:tasks.workunit.client.1.smithi159.stdout:8/248: creat da/d22/f4f x:0 0 0 2024-09-13T22:08:55.973 INFO:tasks.workunit.client.1.smithi159.stdout:8/249: getdents da/d22/d2a 0 2024-09-13T22:08:55.973 INFO:tasks.workunit.client.1.smithi159.stdout:9/237: truncate d1/d9/d3d/d2f/f37 310579 0 2024-09-13T22:08:55.976 INFO:tasks.workunit.client.1.smithi159.stdout:9/238: symlink d1/dc/d10/l59 0 2024-09-13T22:08:55.977 INFO:tasks.workunit.client.1.smithi159.stdout:1/231: dwrite fb [0,4194304] 0 2024-09-13T22:08:55.979 INFO:tasks.workunit.client.1.smithi159.stdout:8/250: dread da/f31 [0,4194304] 0 2024-09-13T22:08:55.979 INFO:tasks.workunit.client.1.smithi159.stdout:8/251: write f7 [4004174,13269] 0 2024-09-13T22:08:55.982 INFO:tasks.workunit.client.1.smithi159.stdout:1/232: link dd/d11/d13/l14 dd/d11/d34/l4a 0 2024-09-13T22:08:55.984 INFO:tasks.workunit.client.1.smithi159.stdout:8/252: rename da/l11 to da/d22/d33/d49/l50 0 2024-09-13T22:08:55.985 INFO:tasks.workunit.client.1.smithi159.stdout:1/233: mkdir dd/d11/d13/d4b 0 2024-09-13T22:08:55.986 INFO:tasks.workunit.client.1.smithi159.stdout:8/253: creat da/d22/d2a/d39/d3e/f51 x:0 0 0 2024-09-13T22:08:55.986 INFO:tasks.workunit.client.1.smithi159.stdout:1/234: mknod dd/d11/d13/c4c 0 2024-09-13T22:08:55.987 INFO:tasks.workunit.client.1.smithi159.stdout:4/209: dwrite d13/d15/f25 [0,4194304] 0 2024-09-13T22:08:55.988 INFO:tasks.workunit.client.1.smithi159.stdout:4/210: fdatasync d13/d15/d26/f34 0 2024-09-13T22:08:55.988 INFO:tasks.workunit.client.1.smithi159.stdout:1/235: mknod dd/d11/d18/d49/d2d/c4d 0 2024-09-13T22:08:55.988 INFO:tasks.workunit.client.1.smithi159.stdout:1/236: write dd/d11/d21/f41 [752660,60443] 0 2024-09-13T22:08:55.988 INFO:tasks.workunit.client.1.smithi159.stdout:1/237: creat dd/d11/d18/d2e/f4e x:0 0 0 2024-09-13T22:08:55.988 INFO:tasks.workunit.client.1.smithi159.stdout:1/238: chown dd/d11/d13/d4b 2071058226 1 2024-09-13T22:08:55.988 INFO:tasks.workunit.client.1.smithi159.stdout:1/239: chown dd/d11/d34 89686407 1 2024-09-13T22:08:55.994 INFO:tasks.workunit.client.1.smithi159.stdout:4/211: rmdir d13/d15 39 2024-09-13T22:08:55.994 INFO:tasks.workunit.client.1.smithi159.stdout:4/212: write d13/f14 [4287226,91451] 0 2024-09-13T22:08:55.994 INFO:tasks.workunit.client.1.smithi159.stdout:4/213: dread - d13/f24 zero size 2024-09-13T22:08:55.994 INFO:tasks.workunit.client.1.smithi159.stdout:4/214: dread - d13/d15/d26/f34 zero size 2024-09-13T22:08:55.995 INFO:tasks.workunit.client.1.smithi159.stdout:9/239: dwrite d1/d9/ff [0,4194304] 0 2024-09-13T22:08:56.002 INFO:tasks.workunit.client.1.smithi159.stdout:9/240: mkdir d1/d5a 0 2024-09-13T22:08:56.002 INFO:tasks.workunit.client.1.smithi159.stdout:9/241: stat d1/d9/d1f/l44 0 2024-09-13T22:08:56.003 INFO:tasks.workunit.client.1.smithi159.stdout:4/215: rmdir d13/d15/d26/d32 0 2024-09-13T22:08:56.005 INFO:tasks.workunit.client.1.smithi159.stdout:9/242: mknod d1/dc/d27/d40/c5b 0 2024-09-13T22:08:56.005 INFO:tasks.workunit.client.1.smithi159.stdout:9/243: dread - d1/f48 zero size 2024-09-13T22:08:56.005 INFO:tasks.workunit.client.1.smithi159.stdout:4/216: write d13/d15/f17 [4663067,25228] 0 2024-09-13T22:08:56.008 INFO:tasks.workunit.client.1.smithi159.stdout:4/217: mknod d13/d15/d26/d29/d3b/c3e 0 2024-09-13T22:08:56.012 INFO:tasks.workunit.client.1.smithi159.stdout:4/218: write d13/d15/d26/f37 [83975,121687] 0 2024-09-13T22:08:56.013 INFO:tasks.workunit.client.1.smithi159.stdout:4/219: rmdir d13/d15/d26 39 2024-09-13T22:08:56.013 INFO:tasks.workunit.client.1.smithi159.stdout:1/240: dwrite dd/d11/d18/f3d [0,4194304] 0 2024-09-13T22:08:56.013 INFO:tasks.workunit.client.1.smithi159.stdout:1/241: chown dd/d11/d18/f23 6479692 1 2024-09-13T22:08:56.018 INFO:tasks.workunit.client.1.smithi159.stdout:8/254: dwrite f7 [0,4194304] 0 2024-09-13T22:08:56.018 INFO:tasks.workunit.client.1.smithi159.stdout:8/255: readlink da/d22/l2f 0 2024-09-13T22:08:56.018 INFO:tasks.workunit.client.1.smithi159.stdout:4/220: rename d13/l23 to d13/d15/l3f 0 2024-09-13T22:08:56.022 INFO:tasks.workunit.client.1.smithi159.stdout:8/256: rename da/d22/d2a/d39/d3e/f44 to da/d22/d4a/f52 0 2024-09-13T22:08:56.032 INFO:tasks.workunit.client.1.smithi159.stdout:9/244: dwrite d1/dc/d10/f39 [0,4194304] 0 2024-09-13T22:08:56.035 INFO:tasks.workunit.client.1.smithi159.stdout:1/242: dwrite dd/d1e/f28 [0,4194304] 0 2024-09-13T22:08:56.036 INFO:tasks.workunit.client.1.smithi159.stdout:9/245: dread d1/dc/f13 [0,4194304] 0 2024-09-13T22:08:56.036 INFO:tasks.workunit.client.1.smithi159.stdout:9/246: dread - d1/f53 zero size 2024-09-13T22:08:56.041 INFO:tasks.workunit.client.1.smithi159.stdout:8/257: dread da/d22/f27 [0,4194304] 0 2024-09-13T22:08:56.041 INFO:tasks.workunit.client.1.smithi159.stdout:1/243: rename dd/f10 to dd/d11/f4f 0 2024-09-13T22:08:56.042 INFO:tasks.workunit.client.1.smithi159.stdout:8/258: mknod da/d36/d48/c53 0 2024-09-13T22:08:56.043 INFO:tasks.workunit.client.1.smithi159.stdout:1/244: mknod dd/c50 0 2024-09-13T22:08:56.045 INFO:tasks.workunit.client.1.smithi159.stdout:1/245: creat dd/d11/d18/d49/f51 x:0 0 0 2024-09-13T22:08:56.045 INFO:tasks.workunit.client.1.smithi159.stdout:1/246: mkdir dd/d11/d13/d4b/d52 0 2024-09-13T22:08:56.046 INFO:tasks.workunit.client.1.smithi159.stdout:1/247: chown dd/d11/c12 1105206 1 2024-09-13T22:08:56.049 INFO:tasks.workunit.client.1.smithi159.stdout:9/247: dread d1/dc/f12 [0,4194304] 0 2024-09-13T22:08:56.050 INFO:tasks.workunit.client.1.smithi159.stdout:4/221: dwrite d13/d15/f1f [0,4194304] 0 2024-09-13T22:08:56.051 INFO:tasks.workunit.client.1.smithi159.stdout:9/248: symlink d1/l5c 0 2024-09-13T22:08:56.052 INFO:tasks.workunit.client.1.smithi159.stdout:4/222: dread d13/d15/f16 [0,4194304] 0 2024-09-13T22:08:56.054 INFO:tasks.workunit.client.1.smithi159.stdout:9/249: rename d1/d9/d3d/c3c to d1/d9/d2a/c5d 0 2024-09-13T22:08:56.055 INFO:tasks.workunit.client.1.smithi159.stdout:8/259: dread f7 [4194304,4194304] 0 2024-09-13T22:08:56.059 INFO:tasks.workunit.client.1.smithi159.stdout:9/250: unlink d1/d9/f18 0 2024-09-13T22:08:56.080 INFO:tasks.workunit.client.1.smithi159.stdout:4/223: dwrite d13/d15/f39 [0,4194304] 0 2024-09-13T22:08:56.081 INFO:tasks.workunit.client.1.smithi159.stdout:8/260: dwrite da/d22/f4d [0,4194304] 0 2024-09-13T22:08:56.081 INFO:tasks.workunit.client.1.smithi159.stdout:9/251: dwrite d1/dc/d10/f17 [0,4194304] 0 2024-09-13T22:08:56.085 INFO:tasks.workunit.client.1.smithi159.stdout:4/224: mkdir d13/d15/d26/d29/d40 0 2024-09-13T22:08:56.086 INFO:tasks.workunit.client.1.smithi159.stdout:8/261: read da/d22/f27 [206099,59428] 0 2024-09-13T22:08:56.086 INFO:tasks.workunit.client.1.smithi159.stdout:8/262: write da/f31 [1774249,116724] 0 2024-09-13T22:08:56.086 INFO:tasks.workunit.client.1.smithi159.stdout:8/263: write da/d36/f40 [271863,34097] 0 2024-09-13T22:08:56.086 INFO:tasks.workunit.client.1.smithi159.stdout:9/252: creat d1/dc/d27/d40/f5e x:0 0 0 2024-09-13T22:08:56.098 INFO:tasks.workunit.client.1.smithi159.stdout:4/225: write d13/d15/d26/d29/d3b/f3d [1601935,87170] 0 2024-09-13T22:08:56.100 INFO:tasks.workunit.client.1.smithi159.stdout:4/226: mkdir d13/d41 0 2024-09-13T22:08:56.101 INFO:tasks.workunit.client.1.smithi159.stdout:9/253: write d1/d9/ff [2052406,67460] 0 2024-09-13T22:08:56.101 INFO:tasks.workunit.client.1.smithi159.stdout:9/254: readlink d1/dc/d10/l59 0 2024-09-13T22:08:56.104 INFO:tasks.workunit.client.1.smithi159.stdout:9/255: rename d1/d9/f2b to d1/dc/f5f 0 2024-09-13T22:08:56.106 INFO:tasks.workunit.client.1.smithi159.stdout:9/256: rename d1/dc/l23 to d1/l60 0 2024-09-13T22:08:56.108 INFO:tasks.workunit.client.1.smithi159.stdout:9/257: rmdir d1/d9/d1f 39 2024-09-13T22:08:56.108 INFO:tasks.workunit.client.1.smithi159.stdout:9/258: write d1/d9/d3d/d2f/f37 [1322670,74119] 0 2024-09-13T22:08:56.108 INFO:tasks.workunit.client.1.smithi159.stdout:9/259: chown d1/dc/d10/f3b 0 1 2024-09-13T22:08:56.108 INFO:tasks.workunit.client.1.smithi159.stdout:9/260: dread - d1/d9/d3d/d4b/f55 zero size 2024-09-13T22:08:56.108 INFO:tasks.workunit.client.1.smithi159.stdout:9/261: readlink d1/dc/d10/l28 0 2024-09-13T22:08:56.114 INFO:tasks.workunit.client.1.smithi159.stdout:8/264: dwrite da/d22/d2a/d39/d3e/f4c [0,4194304] 0 2024-09-13T22:08:56.117 INFO:tasks.workunit.client.1.smithi159.stdout:8/265: mknod da/c54 0 2024-09-13T22:08:56.118 INFO:tasks.workunit.client.1.smithi159.stdout:9/262: read d1/d9/d2a/f41 [1341575,30327] 0 2024-09-13T22:08:56.118 INFO:tasks.workunit.client.1.smithi159.stdout:4/227: dwrite d13/f24 [0,4194304] 0 2024-09-13T22:08:56.120 INFO:tasks.workunit.client.1.smithi159.stdout:9/263: rename d1/dc/c1a to d1/d9/d3d/d2f/d57/c61 0 2024-09-13T22:08:56.121 INFO:tasks.workunit.client.1.smithi159.stdout:8/266: dread da/d36/f47 [0,4194304] 0 2024-09-13T22:08:56.123 INFO:tasks.workunit.client.1.smithi159.stdout:4/228: rmdir d13/d15 39 2024-09-13T22:08:56.127 INFO:tasks.workunit.client.1.smithi159.stdout:8/267: link da/d22/d33/d49/l50 da/d22/d33/l55 0 2024-09-13T22:08:56.127 INFO:tasks.workunit.client.1.smithi159.stdout:8/268: chown da/l23 424176916 1 2024-09-13T22:08:56.127 INFO:tasks.workunit.client.1.smithi159.stdout:8/269: write da/d36/f41 [938484,123169] 0 2024-09-13T22:08:56.127 INFO:tasks.workunit.client.1.smithi159.stdout:8/270: fdatasync da/d22/d2a/d39/d3e/f4c 0 2024-09-13T22:08:56.129 INFO:tasks.workunit.client.1.smithi159.stdout:4/229: link d13/d15/f16 d13/d41/f42 0 2024-09-13T22:08:56.130 INFO:tasks.workunit.client.1.smithi159.stdout:8/271: symlink da/l56 0 2024-09-13T22:08:56.131 INFO:tasks.workunit.client.1.smithi159.stdout:4/230: link d13/d15/d26/d29/d3b/c3e d13/c43 0 2024-09-13T22:08:56.132 INFO:tasks.workunit.client.1.smithi159.stdout:8/272: mkdir da/d36/d57 0 2024-09-13T22:08:56.134 INFO:tasks.workunit.client.1.smithi159.stdout:4/231: mknod d13/d15/d26/d29/d3b/c44 0 2024-09-13T22:08:56.134 INFO:tasks.workunit.client.1.smithi159.stdout:4/232: truncate d13/d41/f42 2311692 0 2024-09-13T22:08:56.135 INFO:tasks.workunit.client.1.smithi159.stdout:4/233: mkdir d13/d15/d26/d29/d40/d45 0 2024-09-13T22:08:56.135 INFO:tasks.workunit.client.1.smithi159.stdout:9/264: dwrite d1/d9/d3d/f56 [0,4194304] 0 2024-09-13T22:08:56.135 INFO:tasks.workunit.client.1.smithi159.stdout:9/265: chown d1/f30 210380063 1 2024-09-13T22:08:56.137 INFO:tasks.workunit.client.1.smithi159.stdout:4/234: stat c6 0 2024-09-13T22:08:56.137 INFO:tasks.workunit.client.1.smithi159.stdout:4/235: chown d13/f24 233985065 1 2024-09-13T22:08:56.138 INFO:tasks.workunit.client.1.smithi159.stdout:9/266: symlink d1/d9/d3d/l62 0 2024-09-13T22:08:56.138 INFO:tasks.workunit.client.1.smithi159.stdout:9/267: dread - d1/dc/d27/d40/f5e zero size 2024-09-13T22:08:56.138 INFO:tasks.workunit.client.1.smithi159.stdout:9/268: stat d1/d9/d3d/f56 0 2024-09-13T22:08:56.138 INFO:tasks.workunit.client.1.smithi159.stdout:4/236: readlink l3 0 2024-09-13T22:08:56.140 INFO:tasks.workunit.client.1.smithi159.stdout:9/269: mknod d1/d9/d3d/d2f/c63 0 2024-09-13T22:08:56.140 INFO:tasks.workunit.client.1.smithi159.stdout:9/270: stat d1/dc/f12 0 2024-09-13T22:08:56.140 INFO:tasks.workunit.client.1.smithi159.stdout:9/271: creat d1/f64 x:0 0 0 2024-09-13T22:08:56.140 INFO:tasks.workunit.client.1.smithi159.stdout:9/272: chown d1/d9/d1f/c2e 8071 1 2024-09-13T22:08:56.163 INFO:tasks.workunit.client.1.smithi159.stdout:8/273: dwrite da/f31 [0,4194304] 0 2024-09-13T22:08:56.163 INFO:tasks.workunit.client.1.smithi159.stdout:8/274: stat da/d36 0 2024-09-13T22:08:56.165 INFO:tasks.workunit.client.1.smithi159.stdout:8/275: getdents da/d22/d33 0 2024-09-13T22:08:56.167 INFO:tasks.workunit.client.1.smithi159.stdout:8/276: rename da/d22/d33/d49/l50 to da/l58 0 2024-09-13T22:08:56.168 INFO:tasks.workunit.client.1.smithi159.stdout:8/277: creat da/d22/d33/f59 x:0 0 0 2024-09-13T22:08:56.169 INFO:tasks.workunit.client.1.smithi159.stdout:4/237: dwrite d13/d15/f25 [0,4194304] 0 2024-09-13T22:08:56.170 INFO:tasks.workunit.client.1.smithi159.stdout:9/273: dwrite d1/d9/d3d/d2f/f37 [0,4194304] 0 2024-09-13T22:08:56.170 INFO:tasks.workunit.client.1.smithi159.stdout:9/274: dread - d1/d9/d3d/d4b/f55 zero size 2024-09-13T22:08:56.171 INFO:tasks.workunit.client.1.smithi159.stdout:4/238: mkdir d13/d41/d46 0 2024-09-13T22:08:56.180 INFO:tasks.workunit.client.1.smithi159.stdout:4/239: dread d13/f24 [0,4194304] 0 2024-09-13T22:08:56.180 INFO:tasks.workunit.client.1.smithi159.stdout:4/240: write d13/d15/f1f [6115016,19070] 0 2024-09-13T22:08:56.180 INFO:tasks.workunit.client.1.smithi159.stdout:4/241: read d13/d15/f1d [1369092,20950] 0 2024-09-13T22:08:56.180 INFO:tasks.workunit.client.1.smithi159.stdout:4/242: write d13/d15/d26/f33 [421724,123225] 0 2024-09-13T22:08:56.180 INFO:tasks.workunit.client.1.smithi159.stdout:4/243: chown d13/d15/f16 21 1 2024-09-13T22:08:56.183 INFO:tasks.workunit.client.1.smithi159.stdout:4/244: unlink l3 0 2024-09-13T22:08:56.185 INFO:tasks.workunit.client.1.smithi159.stdout:4/245: creat d13/d15/d26/f47 x:0 0 0 2024-09-13T22:08:56.187 INFO:tasks.workunit.client.1.smithi159.stdout:4/246: symlink d13/d15/d26/d29/d3b/l48 0 2024-09-13T22:08:56.187 INFO:tasks.workunit.client.1.smithi159.stdout:4/247: write d13/f38 [932548,118632] 0 2024-09-13T22:08:56.187 INFO:tasks.workunit.client.1.smithi159.stdout:4/248: creat d13/f49 x:0 0 0 2024-09-13T22:08:56.189 INFO:tasks.workunit.client.1.smithi159.stdout:9/275: dwrite d1/f1c [0,4194304] 0 2024-09-13T22:08:56.189 INFO:tasks.workunit.client.1.smithi159.stdout:9/276: stat d1/d9/d3d/d2f/d57 0 2024-09-13T22:08:56.189 INFO:tasks.workunit.client.1.smithi159.stdout:8/278: getdents da 0 2024-09-13T22:08:56.189 INFO:tasks.workunit.client.1.smithi159.stdout:8/279: chown da/d22/d33/f59 3 1 2024-09-13T22:08:56.195 INFO:tasks.workunit.client.1.smithi159.stdout:8/280: getdents da/d36/d48 0 2024-09-13T22:08:56.198 INFO:tasks.workunit.client.1.smithi159.stdout:4/249: rename lf to d13/d15/d26/l4a 0 2024-09-13T22:08:56.198 INFO:tasks.workunit.client.1.smithi159.stdout:9/277: getdents d1/d9/d3d/d4b 0 2024-09-13T22:08:56.198 INFO:tasks.workunit.client.1.smithi159.stdout:9/278: fsync d1/d9/f38 0 2024-09-13T22:08:56.201 INFO:tasks.workunit.client.1.smithi159.stdout:8/281: creat da/d22/d26/f5a x:0 0 0 2024-09-13T22:08:56.201 INFO:tasks.workunit.client.1.smithi159.stdout:8/282: fsync da/f31 0 2024-09-13T22:08:56.201 INFO:tasks.workunit.client.1.smithi159.stdout:8/283: write da/d36/f47 [2864249,65824] 0 2024-09-13T22:08:56.201 INFO:tasks.workunit.client.1.smithi159.stdout:4/250: write f11 [87535,69371] 0 2024-09-13T22:08:56.207 INFO:tasks.workunit.client.1.smithi159.stdout:9/279: write d1/f1c [161559,20049] 0 2024-09-13T22:08:56.207 INFO:tasks.workunit.client.1.smithi159.stdout:9/280: fsync d1/d9/d3d/f56 0 2024-09-13T22:08:56.210 INFO:tasks.workunit.client.1.smithi159.stdout:8/284: getdents da/d22/d33 0 2024-09-13T22:08:56.210 INFO:tasks.workunit.client.1.smithi159.stdout:4/251: dread d13/d15/f3c [0,4194304] 0 2024-09-13T22:08:56.212 INFO:tasks.workunit.client.1.smithi159.stdout:9/281: creat d1/dc/d27/f65 x:0 0 0 2024-09-13T22:08:56.215 INFO:tasks.workunit.client.1.smithi159.stdout:8/285: symlink da/d22/d33/l5b 0 2024-09-13T22:08:56.218 INFO:tasks.workunit.client.1.smithi159.stdout:9/282: symlink d1/d5a/l66 0 2024-09-13T22:08:56.218 INFO:tasks.workunit.client.1.smithi159.stdout:9/283: write d1/d9/ff [2682194,102753] 0 2024-09-13T22:08:56.218 INFO:tasks.workunit.client.1.smithi159.stdout:9/284: write d1/dc/f3e [331325,129932] 0 2024-09-13T22:08:56.222 INFO:tasks.workunit.client.1.smithi159.stdout:4/252: link d13/d15/l3f d13/l4b 0 2024-09-13T22:08:56.225 INFO:tasks.workunit.client.1.smithi159.stdout:8/286: dread f8 [0,4194304] 0 2024-09-13T22:08:56.226 INFO:tasks.workunit.client.1.smithi159.stdout:8/287: fsync da/d22/d26/f5a 0 2024-09-13T22:08:56.227 INFO:tasks.workunit.client.1.smithi159.stdout:4/253: unlink d13/c43 0 2024-09-13T22:08:56.228 INFO:tasks.workunit.client.1.smithi159.stdout:9/285: read d1/d9/d3d/f56 [3903372,89748] 0 2024-09-13T22:08:56.228 INFO:tasks.workunit.client.1.smithi159.stdout:9/286: write d1/d9/d3d/f47 [871178,117227] 0 2024-09-13T22:08:56.230 INFO:tasks.workunit.client.1.smithi159.stdout:9/287: rename d1/d9/d3d/d4b/c50 to d1/d9/d1f/c67 0 2024-09-13T22:08:56.233 INFO:tasks.workunit.client.1.smithi159.stdout:9/288: rename d1/d9/d3d/f56 to d1/d9/d3d/d2f/f68 0 2024-09-13T22:08:56.235 INFO:tasks.workunit.client.1.smithi159.stdout:9/289: mkdir d1/dc/d10/d69 0 2024-09-13T22:08:56.237 INFO:tasks.workunit.client.1.smithi159.stdout:9/290: mknod d1/d9/d3d/d2f/c6a 0 2024-09-13T22:08:56.237 INFO:tasks.workunit.client.1.smithi159.stdout:4/254: write d13/f19 [193064,114353] 0 2024-09-13T22:08:56.237 INFO:tasks.workunit.client.1.smithi159.stdout:9/291: symlink d1/d9/d3d/d2f/d57/l6b 0 2024-09-13T22:08:56.238 INFO:tasks.workunit.client.1.smithi159.stdout:4/255: rmdir d13/d15 39 2024-09-13T22:08:56.238 INFO:tasks.workunit.client.1.smithi159.stdout:9/292: rmdir d1/d9/d3d/d2f/d57 39 2024-09-13T22:08:56.240 INFO:tasks.workunit.client.1.smithi159.stdout:9/293: link d1/dc/f13 d1/d9/d3d/d4b/f6c 0 2024-09-13T22:08:56.241 INFO:tasks.workunit.client.1.smithi159.stdout:4/256: symlink d13/d20/l4c 0 2024-09-13T22:08:56.250 INFO:tasks.workunit.client.1.smithi159.stdout:8/288: dwrite da/d22/d33/f46 [0,4194304] 0 2024-09-13T22:08:56.254 INFO:tasks.workunit.client.1.smithi159.stdout:8/289: creat da/d22/d2a/f5c x:0 0 0 2024-09-13T22:08:56.259 INFO:tasks.workunit.client.1.smithi159.stdout:9/294: rename d1/d9/d3d to d1/dc/d10/d6d 0 2024-09-13T22:08:56.259 INFO:tasks.workunit.client.1.smithi159.stdout:9/295: chown d1/dc/d10/d6d/f47 28182743 1 2024-09-13T22:08:56.264 INFO:tasks.workunit.client.1.smithi159.stdout:9/296: unlink d1/d9/l34 0 2024-09-13T22:08:56.266 INFO:tasks.workunit.client.1.smithi159.stdout:4/257: rename d13/d15/d26/d29/d40 to d13/d41/d4d 0 2024-09-13T22:08:56.271 INFO:tasks.workunit.client.1.smithi159.stdout:4/258: chown l5 3 1 2024-09-13T22:08:56.271 INFO:tasks.workunit.client.1.smithi159.stdout:4/259: fdatasync d13/d15/f21 0 2024-09-13T22:08:56.273 INFO:tasks.workunit.client.1.smithi159.stdout:8/290: dwrite da/d22/d33/f38 [4194304,4194304] 0 2024-09-13T22:08:56.277 INFO:tasks.workunit.client.1.smithi159.stdout:4/260: mknod d13/c4e 0 2024-09-13T22:08:56.281 INFO:tasks.workunit.client.1.smithi159.stdout:8/291: mkdir da/d5d 0 2024-09-13T22:08:56.281 INFO:tasks.workunit.client.1.smithi159.stdout:8/292: getdents da/d5d 0 2024-09-13T22:08:56.283 INFO:tasks.workunit.client.1.smithi159.stdout:9/297: dwrite d1/d9/d2a/f4e [0,4194304] 0 2024-09-13T22:08:56.283 INFO:tasks.workunit.client.1.smithi159.stdout:9/298: write d1/dc/d10/f3b [874040,5435] 0 2024-09-13T22:08:56.283 INFO:tasks.workunit.client.1.smithi159.stdout:9/299: dread - d1/d9/f38 zero size 2024-09-13T22:08:56.283 INFO:tasks.workunit.client.1.smithi159.stdout:8/293: link da/l16 da/d5d/l5e 0 2024-09-13T22:08:56.287 INFO:tasks.workunit.client.1.smithi159.stdout:4/261: dread d13/d15/d26/d29/d3b/f3d [0,4194304] 0 2024-09-13T22:08:56.288 INFO:tasks.workunit.client.1.smithi159.stdout:9/300: creat d1/d5a/f6e x:0 0 0 2024-09-13T22:08:56.290 INFO:tasks.workunit.client.1.smithi159.stdout:9/301: symlink d1/dc/d10/d6d/l6f 0 2024-09-13T22:08:56.291 INFO:tasks.workunit.client.1.smithi159.stdout:9/302: creat d1/dc/d27/d40/f70 x:0 0 0 2024-09-13T22:08:56.294 INFO:tasks.workunit.client.1.smithi159.stdout:8/294: write da/d22/d2a/d39/d3e/f4c [1144408,74646] 0 2024-09-13T22:08:56.295 INFO:tasks.workunit.client.1.smithi159.stdout:9/303: symlink d1/dc/d10/d6d/d2f/l71 0 2024-09-13T22:08:56.296 INFO:tasks.workunit.client.1.smithi159.stdout:8/295: rmdir da/d22/d33 39 2024-09-13T22:08:56.296 INFO:tasks.workunit.client.1.smithi159.stdout:8/296: chown da/d22/d2a/d39/d3e 282 1 2024-09-13T22:08:56.298 INFO:tasks.workunit.client.1.smithi159.stdout:8/297: mkdir da/d36/d57/d5f 0 2024-09-13T22:08:56.298 INFO:tasks.workunit.client.1.smithi159.stdout:8/298: write da/d36/f47 [181866,37990] 0 2024-09-13T22:08:56.300 INFO:tasks.workunit.client.1.smithi159.stdout:9/304: link d1/dc/d10/d6d/d2f/d57/l6b d1/dc/d10/d6d/d2f/l72 0 2024-09-13T22:08:56.301 INFO:tasks.workunit.client.1.smithi159.stdout:9/305: link d1/d9/d1f/c20 d1/dc/d10/d69/c73 0 2024-09-13T22:08:56.303 INFO:tasks.workunit.client.1.smithi159.stdout:9/306: mkdir d1/d9/d2a/d74 0 2024-09-13T22:08:56.303 INFO:tasks.workunit.client.1.smithi159.stdout:9/307: dread - d1/dc/d27/f65 zero size 2024-09-13T22:08:56.304 INFO:tasks.workunit.client.1.smithi159.stdout:9/308: mkdir d1/d9/d2a/d75 0 2024-09-13T22:08:56.305 INFO:tasks.workunit.client.1.smithi159.stdout:9/309: creat d1/dc/d10/d6d/d4b/f76 x:0 0 0 2024-09-13T22:08:56.305 INFO:tasks.workunit.client.1.smithi159.stdout:9/310: chown d1/f53 51 1 2024-09-13T22:08:56.306 INFO:tasks.workunit.client.1.smithi159.stdout:9/311: creat d1/d9/d1f/f77 x:0 0 0 2024-09-13T22:08:56.308 INFO:tasks.workunit.client.1.smithi159.stdout:4/262: dwrite d13/f14 [4194304,4194304] 0 2024-09-13T22:08:56.314 INFO:tasks.workunit.client.1.smithi159.stdout:4/263: symlink d13/d41/l4f 0 2024-09-13T22:08:56.316 INFO:tasks.workunit.client.1.smithi159.stdout:4/264: dread d13/d41/f42 [0,4194304] 0 2024-09-13T22:08:56.318 INFO:tasks.workunit.client.1.smithi159.stdout:4/265: mkdir d13/d41/d50 0 2024-09-13T22:08:56.320 INFO:tasks.workunit.client.1.smithi159.stdout:4/266: rmdir d13/d20 39 2024-09-13T22:08:56.321 INFO:tasks.workunit.client.1.smithi159.stdout:4/267: chown c6 26807841 1 2024-09-13T22:08:56.322 INFO:tasks.workunit.client.1.smithi159.stdout:4/268: rmdir d13/d41/d4d/d45 0 2024-09-13T22:08:56.322 INFO:tasks.workunit.client.1.smithi159.stdout:4/269: chown d13/d15/d26/f47 3 1 2024-09-13T22:08:56.324 INFO:tasks.workunit.client.1.smithi159.stdout:8/299: dwrite da/d22/d4a/f52 [0,4194304] 0 2024-09-13T22:08:56.324 INFO:tasks.workunit.client.1.smithi159.stdout:9/312: dwrite d1/dc/f13 [0,4194304] 0 2024-09-13T22:08:56.324 INFO:tasks.workunit.client.1.smithi159.stdout:8/300: chown da/d36/d57 2 1 2024-09-13T22:08:56.339 INFO:tasks.workunit.client.1.smithi159.stdout:8/301: dwrite f4 [0,4194304] 0 2024-09-13T22:08:56.343 INFO:tasks.workunit.client.1.smithi159.stdout:9/313: mknod d1/dc/d10/d6d/d4b/c78 0 2024-09-13T22:08:56.345 INFO:tasks.workunit.client.1.smithi159.stdout:4/270: mkdir d13/d15/d26/d51 0 2024-09-13T22:08:56.345 INFO:tasks.workunit.client.1.smithi159.stdout:4/271: stat d13/d15 0 2024-09-13T22:08:56.346 INFO:tasks.workunit.client.1.smithi159.stdout:8/302: truncate da/d22/d33/f59 728667 0 2024-09-13T22:08:56.348 INFO:tasks.workunit.client.1.smithi159.stdout:9/314: creat d1/dc/d10/d69/f79 x:0 0 0 2024-09-13T22:08:56.349 INFO:tasks.workunit.client.1.smithi159.stdout:9/315: dread - d1/f48 zero size 2024-09-13T22:08:56.350 INFO:tasks.workunit.client.1.smithi159.stdout:4/272: chown le 128932227 1 2024-09-13T22:08:56.350 INFO:tasks.workunit.client.1.smithi159.stdout:4/273: readlink d13/d20/l2a 0 2024-09-13T22:08:56.352 INFO:tasks.workunit.client.1.smithi159.stdout:8/303: dread da/f15 [0,4194304] 0 2024-09-13T22:08:56.356 INFO:tasks.workunit.client.1.smithi159.stdout:5/194: sync 2024-09-13T22:08:56.356 INFO:tasks.workunit.client.1.smithi159.stdout:2/158: sync 2024-09-13T22:08:56.356 INFO:tasks.workunit.client.1.smithi159.stdout:1/248: sync 2024-09-13T22:08:56.356 INFO:tasks.workunit.client.1.smithi159.stdout:6/159: sync 2024-09-13T22:08:56.357 INFO:tasks.workunit.client.1.smithi159.stdout:2/159: creat d9/da/d25/f35 x:0 0 0 2024-09-13T22:08:56.357 INFO:tasks.workunit.client.1.smithi159.stdout:7/246: sync 2024-09-13T22:08:56.357 INFO:tasks.workunit.client.1.smithi159.stdout:0/259: sync 2024-09-13T22:08:56.357 INFO:tasks.workunit.client.1.smithi159.stdout:7/247: readlink d3/lb 0 2024-09-13T22:08:56.357 INFO:tasks.workunit.client.1.smithi159.stdout:7/248: chown d3/lb 4679 1 2024-09-13T22:08:56.357 INFO:tasks.workunit.client.1.smithi159.stdout:0/260: chown d0/d48/d4f/l3a 9828862 1 2024-09-13T22:08:56.357 INFO:tasks.workunit.client.1.smithi159.stdout:7/249: write d3/f2a [357527,11240] 0 2024-09-13T22:08:56.357 INFO:tasks.workunit.client.1.smithi159.stdout:7/250: creat d3/d18/f54 x:0 0 0 2024-09-13T22:08:56.358 INFO:tasks.workunit.client.1.smithi159.stdout:3/199: sync 2024-09-13T22:08:56.358 INFO:tasks.workunit.client.1.smithi159.stdout:3/200: fdatasync d0/d1/d34/f3e 0 2024-09-13T22:08:56.358 INFO:tasks.workunit.client.1.smithi159.stdout:9/316: mkdir d1/dc/d10/d6d/d4b/d7a 0 2024-09-13T22:08:56.363 INFO:tasks.workunit.client.1.smithi159.stdout:1/249: truncate fb 4094737 0 2024-09-13T22:08:56.369 INFO:tasks.workunit.client.1.smithi159.stdout:7/251: link d3/d31/d4d/l53 d3/d18/l55 0 2024-09-13T22:08:56.370 INFO:tasks.workunit.client.1.smithi159.stdout:0/261: dread d0/d7/f4b [0,4194304] 0 2024-09-13T22:08:56.370 INFO:tasks.workunit.client.1.smithi159.stdout:0/262: creat d0/d7/f55 x:0 0 0 2024-09-13T22:08:56.370 INFO:tasks.workunit.client.1.smithi159.stdout:0/263: read - d0/d48/d4f/d2b/f50 zero size 2024-09-13T22:08:56.372 INFO:tasks.workunit.client.1.smithi159.stdout:9/317: rename d1/dc/d10/d6d/f47 to d1/f7b 0 2024-09-13T22:08:56.372 INFO:tasks.workunit.client.1.smithi159.stdout:9/318: chown d1/dc/d10/d6d/d2f/c58 25 1 2024-09-13T22:08:56.372 INFO:tasks.workunit.client.1.smithi159.stdout:9/319: chown d1/f7b 26961 1 2024-09-13T22:08:56.374 INFO:tasks.workunit.client.1.smithi159.stdout:6/160: read d3/da/d29/d1a/f1c [3651112,41910] 0 2024-09-13T22:08:56.374 INFO:tasks.workunit.client.1.smithi159.stdout:6/161: chown d3/da/d29 238708 1 2024-09-13T22:08:56.374 INFO:tasks.workunit.client.1.smithi159.stdout:4/274: dwrite d13/d15/f36 [0,4194304] 0 2024-09-13T22:08:56.375 INFO:tasks.workunit.client.1.smithi159.stdout:4/275: chown d13/d15/f17 2 1 2024-09-13T22:08:56.375 INFO:tasks.workunit.client.1.smithi159.stdout:5/195: link d1/d11/d1c/d32/f3a d1/db/f43 0 2024-09-13T22:08:56.375 INFO:tasks.workunit.client.1.smithi159.stdout:5/196: dread - d1/db/f3f zero size 2024-09-13T22:08:56.375 INFO:tasks.workunit.client.1.smithi159.stdout:5/197: write d1/f3e [4304618,108348] 0 2024-09-13T22:08:56.377 INFO:tasks.workunit.client.1.smithi159.stdout:1/250: mkdir dd/d11/d34/d53 0 2024-09-13T22:08:56.377 INFO:tasks.workunit.client.1.smithi159.stdout:1/251: fsync dd/d1e/f44 0 2024-09-13T22:08:56.377 INFO:tasks.workunit.client.1.smithi159.stdout:1/252: write dd/d11/d18/d49/d2d/f36 [521437,20704] 0 2024-09-13T22:08:56.379 INFO:tasks.workunit.client.1.smithi159.stdout:7/252: rename d3/d18/f3c to d3/d31/d4d/d4e/d4f/f56 0 2024-09-13T22:08:56.380 INFO:tasks.workunit.client.1.smithi159.stdout:6/162: unlink d3/da/d29/c13 0 2024-09-13T22:08:56.380 INFO:tasks.workunit.client.1.smithi159.stdout:8/304: dwrite da/d36/f40 [0,4194304] 0 2024-09-13T22:08:56.381 INFO:tasks.workunit.client.1.smithi159.stdout:3/201: dwrite d0/d1/d3/dd/f20 [0,4194304] 0 2024-09-13T22:08:56.381 INFO:tasks.workunit.client.1.smithi159.stdout:3/202: dread - d0/d1/d3/d5/db/d39/f3f zero size 2024-09-13T22:08:56.382 INFO:tasks.workunit.client.1.smithi159.stdout:4/276: fdatasync d13/f24 0 2024-09-13T22:08:56.382 INFO:tasks.workunit.client.1.smithi159.stdout:5/198: stat d1/db/d35/c38 0 2024-09-13T22:08:56.383 INFO:tasks.workunit.client.1.smithi159.stdout:1/253: symlink dd/d11/d18/d2e/l54 0 2024-09-13T22:08:56.383 INFO:tasks.workunit.client.1.smithi159.stdout:1/254: fsync dd/d11/d21/f41 0 2024-09-13T22:08:56.383 INFO:tasks.workunit.client.1.smithi159.stdout:1/255: read - dd/d1e/f44 zero size 2024-09-13T22:08:56.383 INFO:tasks.workunit.client.1.smithi159.stdout:1/256: stat dd/d11/d13/d4b 0 2024-09-13T22:08:56.383 INFO:tasks.workunit.client.1.smithi159.stdout:1/257: write dd/d11/d21/f41 [1526116,19453] 0 2024-09-13T22:08:56.384 INFO:tasks.workunit.client.1.smithi159.stdout:0/264: rmdir d0/d48/d4f 39 2024-09-13T22:08:56.388 INFO:tasks.workunit.client.1.smithi159.stdout:4/277: dread d13/d15/f21 [4194304,4194304] 0 2024-09-13T22:08:56.389 INFO:tasks.workunit.client.1.smithi159.stdout:7/253: creat d3/d31/d4d/f57 x:0 0 0 2024-09-13T22:08:56.391 INFO:tasks.workunit.client.1.smithi159.stdout:6/163: link d3/da/l19 d3/da/d25/l32 0 2024-09-13T22:08:56.392 INFO:tasks.workunit.client.1.smithi159.stdout:8/305: write da/d22/d33/f38 [6848036,66266] 0 2024-09-13T22:08:56.392 INFO:tasks.workunit.client.1.smithi159.stdout:8/306: fsync da/d22/d2a/d39/d3e/f51 0 2024-09-13T22:08:56.392 INFO:tasks.workunit.client.1.smithi159.stdout:8/307: chown da/d22/f27 273102452 1 2024-09-13T22:08:56.394 INFO:tasks.workunit.client.1.smithi159.stdout:9/320: dwrite d1/dc/d27/f65 [0,4194304] 0 2024-09-13T22:08:56.394 INFO:tasks.workunit.client.1.smithi159.stdout:9/321: write d1/dc/d10/f3b [424669,36360] 0 2024-09-13T22:08:56.394 INFO:tasks.workunit.client.1.smithi159.stdout:1/258: dread dd/d1e/f28 [0,4194304] 0 2024-09-13T22:08:56.397 INFO:tasks.workunit.client.1.smithi159.stdout:3/203: dwrite d0/d1/d3/f1f [0,4194304] 0 2024-09-13T22:08:56.397 INFO:tasks.workunit.client.1.smithi159.stdout:6/164: write d3/f23 [4236797,72397] 0 2024-09-13T22:08:56.403 INFO:tasks.workunit.client.1.smithi159.stdout:0/265: mknod d0/d7/c56 0 2024-09-13T22:08:56.407 INFO:tasks.workunit.client.1.smithi159.stdout:0/266: dread d0/d2c/f43 [0,4194304] 0 2024-09-13T22:08:56.407 INFO:tasks.workunit.client.1.smithi159.stdout:0/267: truncate d0/d7/f14 5149800 0 2024-09-13T22:08:56.407 INFO:tasks.workunit.client.1.smithi159.stdout:8/308: mknod da/d22/c60 0 2024-09-13T22:08:56.407 INFO:tasks.workunit.client.1.smithi159.stdout:8/309: truncate da/d36/f47 4624429 0 2024-09-13T22:08:56.408 INFO:tasks.workunit.client.1.smithi159.stdout:8/310: write da/d22/d33/f59 [90239,79862] 0 2024-09-13T22:08:56.408 INFO:tasks.workunit.client.1.smithi159.stdout:8/311: chown da/l58 90391 1 2024-09-13T22:08:56.408 INFO:tasks.workunit.client.1.smithi159.stdout:8/312: getdents da/d36/d48 0 2024-09-13T22:08:56.413 INFO:tasks.workunit.client.1.smithi159.stdout:4/278: dwrite d13/d15/f1f [0,4194304] 0 2024-09-13T22:08:56.419 INFO:tasks.workunit.client.1.smithi159.stdout:1/259: mknod dd/d11/d13/c55 0 2024-09-13T22:08:56.419 INFO:tasks.workunit.client.1.smithi159.stdout:1/260: dread - dd/d1c/f25 zero size 2024-09-13T22:08:56.423 INFO:tasks.workunit.client.1.smithi159.stdout:6/165: mknod d3/da/d29/d26/c33 0 2024-09-13T22:08:56.424 INFO:tasks.workunit.client.1.smithi159.stdout:0/268: dwrite d0/d2c/f43 [0,4194304] 0 2024-09-13T22:08:56.424 INFO:tasks.workunit.client.1.smithi159.stdout:5/199: rmdir d1/db/d35 39 2024-09-13T22:08:56.433 INFO:tasks.workunit.client.1.smithi159.stdout:7/254: getdents d3 0 2024-09-13T22:08:56.434 INFO:tasks.workunit.client.1.smithi159.stdout:8/313: mknod da/c61 0 2024-09-13T22:08:56.435 INFO:tasks.workunit.client.1.smithi159.stdout:4/279: symlink d13/d15/l52 0 2024-09-13T22:08:56.437 INFO:tasks.workunit.client.1.smithi159.stdout:9/322: getdents d1/dc/d27/d40 0 2024-09-13T22:08:56.438 INFO:tasks.workunit.client.1.smithi159.stdout:1/261: creat dd/d11/d18/d2e/d3c/f56 x:0 0 0 2024-09-13T22:08:56.439 INFO:tasks.workunit.client.1.smithi159.stdout:0/269: symlink d0/d48/l57 0 2024-09-13T22:08:56.442 INFO:tasks.workunit.client.1.smithi159.stdout:7/255: rmdir d3/d3f 39 2024-09-13T22:08:56.442 INFO:tasks.workunit.client.1.smithi159.stdout:7/256: fdatasync d3/f11 0 2024-09-13T22:08:56.442 INFO:tasks.workunit.client.1.smithi159.stdout:5/200: dwrite d1/db/f43 [0,4194304] 0 2024-09-13T22:08:56.443 INFO:tasks.workunit.client.1.smithi159.stdout:4/280: creat d13/d41/d50/f53 x:0 0 0 2024-09-13T22:08:56.443 INFO:tasks.workunit.client.1.smithi159.stdout:9/323: mknod d1/dc/d10/d69/c7c 0 2024-09-13T22:08:56.444 INFO:tasks.workunit.client.1.smithi159.stdout:9/324: write d1/dc/d27/d40/f70 [401734,68664] 0 2024-09-13T22:08:56.445 INFO:tasks.workunit.client.1.smithi159.stdout:0/270: mknod d0/d7/c58 0 2024-09-13T22:08:56.445 INFO:tasks.workunit.client.1.smithi159.stdout:0/271: fsync d0/d7/f14 0 2024-09-13T22:08:56.445 INFO:tasks.workunit.client.1.smithi159.stdout:0/272: creat d0/d48/f59 x:0 0 0 2024-09-13T22:08:56.445 INFO:tasks.workunit.client.1.smithi159.stdout:0/273: write d0/d2c/f37 [5207030,9306] 0 2024-09-13T22:08:56.446 INFO:tasks.workunit.client.1.smithi159.stdout:0/274: readlink d0/d2c/l4a 0 2024-09-13T22:08:56.446 INFO:tasks.workunit.client.1.smithi159.stdout:7/257: rename d3/d31/d4d/d4e/d4f/f56 to d3/d31/d4d/d4e/d4f/f58 0 2024-09-13T22:08:56.452 INFO:tasks.workunit.client.1.smithi159.stdout:5/201: mkdir d1/d11/d1c/d20/d44 0 2024-09-13T22:08:56.453 INFO:tasks.workunit.client.1.smithi159.stdout:8/314: creat da/d22/d33/d49/f62 x:0 0 0 2024-09-13T22:08:56.456 INFO:tasks.workunit.client.1.smithi159.stdout:5/202: symlink d1/d11/d1c/l45 0 2024-09-13T22:08:56.457 INFO:tasks.workunit.client.1.smithi159.stdout:8/315: symlink da/d22/d26/l63 0 2024-09-13T22:08:56.457 INFO:tasks.workunit.client.1.smithi159.stdout:5/203: write d1/f8 [4282958,7896] 0 2024-09-13T22:08:56.458 INFO:tasks.workunit.client.1.smithi159.stdout:8/316: mknod da/d22/d2a/d39/c64 0 2024-09-13T22:08:56.458 INFO:tasks.workunit.client.1.smithi159.stdout:8/317: readlink da/l23 0 2024-09-13T22:08:56.459 INFO:tasks.workunit.client.1.smithi159.stdout:8/318: chown da/d22/d33/c3c 9 1 2024-09-13T22:08:56.459 INFO:tasks.workunit.client.1.smithi159.stdout:8/319: readlink da/d22/d2a/l42 0 2024-09-13T22:08:56.459 INFO:tasks.workunit.client.1.smithi159.stdout:8/320: readlink da/l56 0 2024-09-13T22:08:56.459 INFO:tasks.workunit.client.1.smithi159.stdout:5/204: mknod d1/d11/d1c/d32/c46 0 2024-09-13T22:08:56.460 INFO:tasks.workunit.client.1.smithi159.stdout:8/321: creat da/d36/d57/f65 x:0 0 0 2024-09-13T22:08:56.460 INFO:tasks.workunit.client.1.smithi159.stdout:8/322: readlink da/l1e 0 2024-09-13T22:08:56.461 INFO:tasks.workunit.client.1.smithi159.stdout:8/323: mkdir da/d22/d33/d66 0 2024-09-13T22:08:56.470 INFO:tasks.workunit.client.1.smithi159.stdout:1/262: dwrite dd/d11/d13/f45 [0,4194304] 0 2024-09-13T22:08:56.473 INFO:tasks.workunit.client.1.smithi159.stdout:1/263: rename dd/d11/d18/d2e/d3c/f56 to dd/d11/d18/f57 0 2024-09-13T22:08:56.474 INFO:tasks.workunit.client.1.smithi159.stdout:1/264: unlink dd/d11/d18/d49/d2d/c4d 0 2024-09-13T22:08:56.479 INFO:tasks.workunit.client.1.smithi159.stdout:0/275: dwrite d0/d7/f9 [0,4194304] 0 2024-09-13T22:08:56.480 INFO:tasks.workunit.client.1.smithi159.stdout:4/281: dwrite d13/d15/f25 [0,4194304] 0 2024-09-13T22:08:56.480 INFO:tasks.workunit.client.1.smithi159.stdout:9/325: dwrite d1/dc/f5f [0,4194304] 0 2024-09-13T22:08:56.481 INFO:tasks.workunit.client.1.smithi159.stdout:0/276: link d0/d7/f14 d0/d2c/f5a 0 2024-09-13T22:08:56.482 INFO:tasks.workunit.client.1.smithi159.stdout:4/282: dread d13/d41/f42 [0,4194304] 0 2024-09-13T22:08:56.482 INFO:tasks.workunit.client.1.smithi159.stdout:5/205: dwrite d1/db/f10 [0,4194304] 0 2024-09-13T22:08:56.482 INFO:tasks.workunit.client.1.smithi159.stdout:5/206: creat d1/db/f47 x:0 0 0 2024-09-13T22:08:56.485 INFO:tasks.workunit.client.1.smithi159.stdout:0/277: symlink d0/d7/l5b 0 2024-09-13T22:08:56.485 INFO:tasks.workunit.client.1.smithi159.stdout:0/278: read - d0/f45 zero size 2024-09-13T22:08:56.487 INFO:tasks.workunit.client.1.smithi159.stdout:4/283: creat d13/d15/d26/d51/f54 x:0 0 0 2024-09-13T22:08:56.488 INFO:tasks.workunit.client.1.smithi159.stdout:4/284: chown d13/f14 0 1 2024-09-13T22:08:56.488 INFO:tasks.workunit.client.1.smithi159.stdout:1/265: dread dd/d11/f24 [0,4194304] 0 2024-09-13T22:08:56.489 INFO:tasks.workunit.client.1.smithi159.stdout:5/207: rmdir d1/db/d35 39 2024-09-13T22:08:56.494 INFO:tasks.workunit.client.1.smithi159.stdout:4/285: symlink d13/l55 0 2024-09-13T22:08:56.496 INFO:tasks.workunit.client.1.smithi159.stdout:9/326: dwrite d1/dc/d10/d6d/d2f/f37 [0,4194304] 0 2024-09-13T22:08:56.497 INFO:tasks.workunit.client.1.smithi159.stdout:4/286: symlink d13/d20/l56 0 2024-09-13T22:08:56.498 INFO:tasks.workunit.client.1.smithi159.stdout:9/327: mkdir d1/d9/d2a/d74/d7d 0 2024-09-13T22:08:56.498 INFO:tasks.workunit.client.1.smithi159.stdout:9/328: write d1/f53 [622017,112259] 0 2024-09-13T22:08:56.498 INFO:tasks.workunit.client.1.smithi159.stdout:9/329: chown d1/dc/d10/d6d/d4b/c78 2504397 1 2024-09-13T22:08:56.499 INFO:tasks.workunit.client.1.smithi159.stdout:9/330: chown d1/dc/d10/d6d/l62 4 1 2024-09-13T22:08:56.500 INFO:tasks.workunit.client.1.smithi159.stdout:9/331: symlink d1/dc/d10/d6d/d4b/l7e 0 2024-09-13T22:08:56.501 INFO:tasks.workunit.client.1.smithi159.stdout:4/287: symlink d13/d15/d26/l57 0 2024-09-13T22:08:56.502 INFO:tasks.workunit.client.1.smithi159.stdout:4/288: write d13/d41/d50/f53 [681045,69369] 0 2024-09-13T22:08:56.502 INFO:tasks.workunit.client.1.smithi159.stdout:4/289: chown d13/l31 52019944 1 2024-09-13T22:08:56.506 INFO:tasks.workunit.client.1.smithi159.stdout:8/324: getdents da/d22/d33/d49 0 2024-09-13T22:08:56.507 INFO:tasks.workunit.client.1.smithi159.stdout:8/325: write da/f18 [1324206,113255] 0 2024-09-13T22:08:56.509 INFO:tasks.workunit.client.1.smithi159.stdout:8/326: rename f8 to da/d36/d48/f67 0 2024-09-13T22:08:56.512 INFO:tasks.workunit.client.1.smithi159.stdout:1/266: dwrite fb [0,4194304] 0 2024-09-13T22:08:56.513 INFO:tasks.workunit.client.1.smithi159.stdout:8/327: getdents da/d22/d2a/d39/d3e 0 2024-09-13T22:08:56.513 INFO:tasks.workunit.client.1.smithi159.stdout:8/328: dread - da/d22/f4f zero size 2024-09-13T22:08:56.513 INFO:tasks.workunit.client.1.smithi159.stdout:5/208: dwrite d1/db/d17/f2c [0,4194304] 0 2024-09-13T22:08:56.516 INFO:tasks.workunit.client.1.smithi159.stdout:1/267: mkdir dd/d1e/d58 0 2024-09-13T22:08:56.517 INFO:tasks.workunit.client.1.smithi159.stdout:4/290: write d13/d15/f1f [2016854,75414] 0 2024-09-13T22:08:56.520 INFO:tasks.workunit.client.1.smithi159.stdout:5/209: link d1/d11/d1c/d32/l41 d1/l48 0 2024-09-13T22:08:56.522 INFO:tasks.workunit.client.1.smithi159.stdout:1/268: mkdir dd/d11/d34/d59 0 2024-09-13T22:08:56.522 INFO:tasks.workunit.client.1.smithi159.stdout:1/269: chown dd/d11/d34 8 1 2024-09-13T22:08:56.522 INFO:tasks.workunit.client.1.smithi159.stdout:1/270: creat dd/d11/d18/d49/f5a x:0 0 0 2024-09-13T22:08:56.523 INFO:tasks.workunit.client.1.smithi159.stdout:1/271: readlink dd/l2f 0 2024-09-13T22:08:56.523 INFO:tasks.workunit.client.1.smithi159.stdout:1/272: fsync dd/d1c/f25 0 2024-09-13T22:08:56.524 INFO:tasks.workunit.client.1.smithi159.stdout:5/210: mkdir d1/d49 0 2024-09-13T22:08:56.524 INFO:tasks.workunit.client.1.smithi159.stdout:5/211: dread - d1/db/f47 zero size 2024-09-13T22:08:56.525 INFO:tasks.workunit.client.1.smithi159.stdout:5/212: chown d1/l2d 293 1 2024-09-13T22:08:56.526 INFO:tasks.workunit.client.1.smithi159.stdout:8/329: write f4 [3579938,38720] 0 2024-09-13T22:08:56.526 INFO:tasks.workunit.client.1.smithi159.stdout:8/330: fsync da/d36/f40 0 2024-09-13T22:08:56.527 INFO:tasks.workunit.client.1.smithi159.stdout:1/273: unlink dd/d11/d21/f41 0 2024-09-13T22:08:56.527 INFO:tasks.workunit.client.1.smithi159.stdout:5/213: truncate d1/d11/f1e 1413807 0 2024-09-13T22:08:56.528 INFO:tasks.workunit.client.1.smithi159.stdout:0/279: write d0/d7/f27 [934742,93543] 0 2024-09-13T22:08:56.529 INFO:tasks.workunit.client.1.smithi159.stdout:8/331: symlink da/d22/d2a/d39/d3e/l68 0 2024-09-13T22:08:56.530 INFO:tasks.workunit.client.1.smithi159.stdout:1/274: creat dd/d11/d13/d4b/f5b x:0 0 0 2024-09-13T22:08:56.532 INFO:tasks.workunit.client.1.smithi159.stdout:0/280: getdents d0/d48/d4f 0 2024-09-13T22:08:56.532 INFO:tasks.workunit.client.1.smithi159.stdout:0/281: write d0/d48/d4f/d2b/f50 [362304,45087] 0 2024-09-13T22:08:56.533 INFO:tasks.workunit.client.1.smithi159.stdout:8/332: symlink da/d36/l69 0 2024-09-13T22:08:56.533 INFO:tasks.workunit.client.1.smithi159.stdout:8/333: creat da/d36/f6a x:0 0 0 2024-09-13T22:08:56.533 INFO:tasks.workunit.client.1.smithi159.stdout:8/334: readlink da/l2c 0 2024-09-13T22:08:56.533 INFO:tasks.workunit.client.1.smithi159.stdout:8/335: write da/d22/d26/f5a [664445,16149] 0 2024-09-13T22:08:56.533 INFO:tasks.workunit.client.1.smithi159.stdout:4/291: dwrite d13/d41/f42 [0,4194304] 0 2024-09-13T22:08:56.534 INFO:tasks.workunit.client.1.smithi159.stdout:1/275: getdents dd 0 2024-09-13T22:08:56.534 INFO:tasks.workunit.client.1.smithi159.stdout:1/276: chown dd/d11/d18/d49/c38 27785 1 2024-09-13T22:08:56.535 INFO:tasks.workunit.client.1.smithi159.stdout:5/214: rename d1/d15/f36 to d1/d11/d1c/d32/f4a 0 2024-09-13T22:08:56.536 INFO:tasks.workunit.client.1.smithi159.stdout:5/215: creat d1/db/d17/f4b x:0 0 0 2024-09-13T22:08:56.537 INFO:tasks.workunit.client.1.smithi159.stdout:0/282: symlink d0/d48/l5c 0 2024-09-13T22:08:56.540 INFO:tasks.workunit.client.1.smithi159.stdout:8/336: getdents da/d5d 0 2024-09-13T22:08:56.540 INFO:tasks.workunit.client.1.smithi159.stdout:8/337: truncate da/d22/d4a/f4e 780195 0 2024-09-13T22:08:56.542 INFO:tasks.workunit.client.1.smithi159.stdout:1/277: creat dd/d11/d13/f5c x:0 0 0 2024-09-13T22:08:56.545 INFO:tasks.workunit.client.1.smithi159.stdout:5/216: creat d1/db/d35/f4c x:0 0 0 2024-09-13T22:08:56.546 INFO:tasks.workunit.client.1.smithi159.stdout:8/338: dread da/d22/d26/f5a [0,4194304] 0 2024-09-13T22:08:56.546 INFO:tasks.workunit.client.1.smithi159.stdout:0/283: creat d0/d48/d4f/f5d x:0 0 0 2024-09-13T22:08:56.549 INFO:tasks.workunit.client.1.smithi159.stdout:4/292: symlink d13/l58 0 2024-09-13T22:08:56.551 INFO:tasks.workunit.client.1.smithi159.stdout:1/278: rename dd/d11/d18/d49/d2d/f36 to dd/d11/d18/d49/d2d/f5d 0 2024-09-13T22:08:56.554 INFO:tasks.workunit.client.1.smithi159.stdout:8/339: symlink da/d22/l6b 0 2024-09-13T22:08:56.561 INFO:tasks.workunit.client.1.smithi159.stdout:4/293: dread d13/d15/f36 [0,4194304] 0 2024-09-13T22:08:56.565 INFO:tasks.workunit.client.1.smithi159.stdout:4/294: truncate d13/f14 7890227 0 2024-09-13T22:08:56.566 INFO:tasks.workunit.client.1.smithi159.stdout:8/340: write da/d36/d48/f67 [1560182,20555] 0 2024-09-13T22:08:56.566 INFO:tasks.workunit.client.1.smithi159.stdout:8/341: chown da/d36/f6a 101604 1 2024-09-13T22:08:56.566 INFO:tasks.workunit.client.1.smithi159.stdout:8/342: dread - da/d22/d2a/d39/d3e/f51 zero size 2024-09-13T22:08:56.567 INFO:tasks.workunit.client.1.smithi159.stdout:0/284: dwrite d0/d48/f4d [0,4194304] 0 2024-09-13T22:08:56.567 INFO:tasks.workunit.client.1.smithi159.stdout:4/295: dread f11 [0,4194304] 0 2024-09-13T22:08:56.575 INFO:tasks.workunit.client.1.smithi159.stdout:1/279: dwrite f9 [0,4194304] 0 2024-09-13T22:08:56.575 INFO:tasks.workunit.client.1.smithi159.stdout:1/280: write dd/d11/d18/d49/f51 [253089,24947] 0 2024-09-13T22:08:56.575 INFO:tasks.workunit.client.1.smithi159.stdout:5/217: dwrite d1/d11/f1e [0,4194304] 0 2024-09-13T22:08:56.584 INFO:tasks.workunit.client.1.smithi159.stdout:0/285: dwrite d0/d7/f55 [0,4194304] 0 2024-09-13T22:08:56.590 INFO:tasks.workunit.client.1.smithi159.stdout:0/286: dread d0/d2c/f5a [0,4194304] 0 2024-09-13T22:08:56.590 INFO:tasks.workunit.client.1.smithi159.stdout:0/287: chown d0/d2c 3 1 2024-09-13T22:08:56.643 INFO:tasks.workunit.client.1.smithi159.stdout:8/343: truncate da/d22/d26/f2b 204932 0 2024-09-13T22:08:56.644 INFO:tasks.workunit.client.1.smithi159.stdout:8/344: dread - da/d36/d57/f65 zero size 2024-09-13T22:08:56.644 INFO:tasks.workunit.client.1.smithi159.stdout:8/345: stat da/d36/d57/f65 0 2024-09-13T22:08:56.646 INFO:tasks.workunit.client.1.smithi159.stdout:8/346: dread da/f10 [0,4194304] 0 2024-09-13T22:08:56.650 INFO:tasks.workunit.client.1.smithi159.stdout:4/296: truncate f8 4617572 0 2024-09-13T22:08:56.652 INFO:tasks.workunit.client.1.smithi159.stdout:1/281: symlink dd/d11/d18/l5e 0 2024-09-13T22:08:56.652 INFO:tasks.workunit.client.1.smithi159.stdout:1/282: readlink dd/l2f 0 2024-09-13T22:08:56.652 INFO:tasks.workunit.client.1.smithi159.stdout:1/283: truncate dd/d11/d13/d4b/f5b 505013 0 2024-09-13T22:08:56.653 INFO:tasks.workunit.client.1.smithi159.stdout:1/284: readlink dd/d11/d13/l2a 0 2024-09-13T22:08:56.653 INFO:tasks.workunit.client.1.smithi159.stdout:4/297: dread d13/f19 [0,4194304] 0 2024-09-13T22:08:56.655 INFO:tasks.workunit.client.1.smithi159.stdout:5/218: creat d1/d11/f4d x:0 0 0 2024-09-13T22:08:56.671 INFO:tasks.workunit.client.1.smithi159.stdout:4/298: dwrite f10 [0,4194304] 0 2024-09-13T22:08:56.673 INFO:tasks.workunit.client.1.smithi159.stdout:8/347: rmdir da/d22/d33 39 2024-09-13T22:08:56.690 INFO:tasks.workunit.client.1.smithi159.stdout:1/285: rmdir dd/d11/d18 39 2024-09-13T22:08:56.690 INFO:tasks.workunit.client.1.smithi159.stdout:1/286: write dd/d11/f40 [519362,99079] 0 2024-09-13T22:08:56.691 INFO:tasks.workunit.client.1.smithi159.stdout:5/219: symlink d1/d15/l4e 0 2024-09-13T22:08:56.697 INFO:tasks.workunit.client.1.smithi159.stdout:4/299: creat d13/d20/f59 x:0 0 0 2024-09-13T22:08:56.698 INFO:tasks.workunit.client.1.smithi159.stdout:8/348: mknod da/d22/d4a/c6c 0 2024-09-13T22:08:56.698 INFO:tasks.workunit.client.1.smithi159.stdout:8/349: fsync da/d36/f41 0 2024-09-13T22:08:56.699 INFO:tasks.workunit.client.1.smithi159.stdout:8/350: write da/d22/d33/f38 [4494448,116880] 0 2024-09-13T22:08:56.700 INFO:tasks.workunit.client.1.smithi159.stdout:0/288: rename d0/d7 to d0/d5e 0 2024-09-13T22:08:56.702 INFO:tasks.workunit.client.1.smithi159.stdout:4/300: rename d13/d41/d46 to d13/d15/d5a 0 2024-09-13T22:08:56.703 INFO:tasks.workunit.client.1.smithi159.stdout:8/351: unlink da/d22/d2a/d39/l3a 0 2024-09-13T22:08:56.704 INFO:tasks.workunit.client.1.smithi159.stdout:5/220: getdents d1/db 0 2024-09-13T22:08:56.705 INFO:tasks.workunit.client.1.smithi159.stdout:1/287: dwrite dd/f1b [0,4194304] 0 2024-09-13T22:08:56.705 INFO:tasks.workunit.client.1.smithi159.stdout:1/288: fdatasync dd/d11/d18/f3d 0 2024-09-13T22:08:56.707 INFO:tasks.workunit.client.1.smithi159.stdout:0/289: rename d0/d48/d4f/f35 to d0/d48/f5f 0 2024-09-13T22:08:56.707 INFO:tasks.workunit.client.1.smithi159.stdout:0/290: readlink d0/d5e/l23 0 2024-09-13T22:08:56.709 INFO:tasks.workunit.client.1.smithi159.stdout:8/352: rmdir da/d36/d57/d5f 0 2024-09-13T22:08:56.713 INFO:tasks.workunit.client.1.smithi159.stdout:1/289: unlink dd/d1c/f48 0 2024-09-13T22:08:56.715 INFO:tasks.workunit.client.1.smithi159.stdout:0/291: creat d0/d48/d4f/d2b/f60 x:0 0 0 2024-09-13T22:08:56.719 INFO:tasks.workunit.client.1.smithi159.stdout:8/353: creat da/d36/d48/f6d x:0 0 0 2024-09-13T22:08:56.721 INFO:tasks.workunit.client.1.smithi159.stdout:1/290: unlink dd/ff 0 2024-09-13T22:08:56.721 INFO:tasks.workunit.client.1.smithi159.stdout:1/291: fdatasync dd/d11/d13/f45 0 2024-09-13T22:08:56.723 INFO:tasks.workunit.client.1.smithi159.stdout:5/221: dwrite d1/db/f43 [0,4194304] 0 2024-09-13T22:08:56.724 INFO:tasks.workunit.client.1.smithi159.stdout:0/292: unlink d0/d5e/l2a 0 2024-09-13T22:08:56.725 INFO:tasks.workunit.client.1.smithi159.stdout:8/354: rmdir da 39 2024-09-13T22:08:56.725 INFO:tasks.workunit.client.1.smithi159.stdout:8/355: readlink da/d22/d26/l63 0 2024-09-13T22:08:56.725 INFO:tasks.workunit.client.1.smithi159.stdout:8/356: dread - da/d36/d48/f6d zero size 2024-09-13T22:08:56.725 INFO:tasks.workunit.client.1.smithi159.stdout:1/292: dread dd/d11/d18/d49/d2d/f5d [0,4194304] 0 2024-09-13T22:08:56.728 INFO:tasks.workunit.client.1.smithi159.stdout:4/301: rename fc to d13/f5b 0 2024-09-13T22:08:56.730 INFO:tasks.workunit.client.1.smithi159.stdout:5/222: creat d1/d49/f4f x:0 0 0 2024-09-13T22:08:56.730 INFO:tasks.workunit.client.1.smithi159.stdout:5/223: fsync d1/d11/f1e 0 2024-09-13T22:08:56.730 INFO:tasks.workunit.client.1.smithi159.stdout:5/224: chown d1 1882400809 1 2024-09-13T22:08:56.732 INFO:tasks.workunit.client.1.smithi159.stdout:0/293: creat d0/d5e/f61 x:0 0 0 2024-09-13T22:08:56.732 INFO:tasks.workunit.client.1.smithi159.stdout:0/294: dread - d0/d2c/f33 zero size 2024-09-13T22:08:56.732 INFO:tasks.workunit.client.1.smithi159.stdout:1/293: mkdir dd/d1e/d58/d5f 0 2024-09-13T22:08:56.732 INFO:tasks.workunit.client.1.smithi159.stdout:4/302: dread - d13/f49 zero size 2024-09-13T22:08:56.733 INFO:tasks.workunit.client.1.smithi159.stdout:5/225: stat d1/d11/d1c/d32/l41 0 2024-09-13T22:08:56.735 INFO:tasks.workunit.client.1.smithi159.stdout:5/226: mkdir d1/d11/d50 0 2024-09-13T22:08:56.737 INFO:tasks.workunit.client.1.smithi159.stdout:4/303: mknod d13/c5c 0 2024-09-13T22:08:56.738 INFO:tasks.workunit.client.1.smithi159.stdout:5/227: creat d1/d11/d1c/f51 x:0 0 0 2024-09-13T22:08:56.739 INFO:tasks.workunit.client.1.smithi159.stdout:5/228: chown d1/db/c42 5936415 1 2024-09-13T22:08:56.739 INFO:tasks.workunit.client.1.smithi159.stdout:5/229: symlink d1/d11/d1c/d20/l52 0 2024-09-13T22:08:56.739 INFO:tasks.workunit.client.1.smithi159.stdout:4/304: dread d13/d15/f1f [4194304,4194304] 0 2024-09-13T22:08:56.740 INFO:tasks.workunit.client.1.smithi159.stdout:4/305: stat d13/d20/f59 0 2024-09-13T22:08:56.740 INFO:tasks.workunit.client.1.smithi159.stdout:4/306: fdatasync f8 0 2024-09-13T22:08:56.740 INFO:tasks.workunit.client.1.smithi159.stdout:5/230: mkdir d1/d11/d1c/d20/d53 0 2024-09-13T22:08:56.755 INFO:tasks.workunit.client.1.smithi159.stdout:5/231: dread d1/d15/f26 [0,4194304] 0 2024-09-13T22:08:56.755 INFO:tasks.workunit.client.1.smithi159.stdout:5/232: fsync d1/db/f43 0 2024-09-13T22:08:56.755 INFO:tasks.workunit.client.1.smithi159.stdout:5/233: write d1/db/f3f [262500,46249] 0 2024-09-13T22:08:56.755 INFO:tasks.workunit.client.1.smithi159.stdout:5/234: fdatasync d1/db/d35/f4c 0 2024-09-13T22:08:56.755 INFO:tasks.workunit.client.1.smithi159.stdout:5/235: creat d1/db/d17/f54 x:0 0 0 2024-09-13T22:08:56.757 INFO:tasks.workunit.client.1.smithi159.stdout:5/236: symlink d1/d11/l55 0 2024-09-13T22:08:56.758 INFO:tasks.workunit.client.1.smithi159.stdout:5/237: link d1/d11/f37 d1/db/d35/f56 0 2024-09-13T22:08:56.758 INFO:tasks.workunit.client.1.smithi159.stdout:5/238: dread - d1/db/d17/f54 zero size 2024-09-13T22:08:56.758 INFO:tasks.workunit.client.1.smithi159.stdout:5/239: stat d1/d11/d1c/d32/l41 0 2024-09-13T22:08:56.759 INFO:tasks.workunit.client.1.smithi159.stdout:8/357: dwrite da/d22/d33/f46 [0,4194304] 0 2024-09-13T22:08:56.759 INFO:tasks.workunit.client.1.smithi159.stdout:5/240: getdents d1/d11/d1c/d32 0 2024-09-13T22:08:56.759 INFO:tasks.workunit.client.1.smithi159.stdout:5/241: readlink d1/l48 0 2024-09-13T22:08:56.759 INFO:tasks.workunit.client.1.smithi159.stdout:5/242: creat d1/db/d35/f57 x:0 0 0 2024-09-13T22:08:56.764 INFO:tasks.workunit.client.1.smithi159.stdout:1/294: dwrite dd/d11/d18/d2e/f43 [0,4194304] 0 2024-09-13T22:08:56.764 INFO:tasks.workunit.client.1.smithi159.stdout:1/295: chown dd/d1e 69 1 2024-09-13T22:08:56.764 INFO:tasks.workunit.client.1.smithi159.stdout:1/296: fsync dd/d11/f40 0 2024-09-13T22:08:56.764 INFO:tasks.workunit.client.1.smithi159.stdout:0/295: dwrite d0/d2c/f3c [0,4194304] 0 2024-09-13T22:08:56.764 INFO:tasks.workunit.client.1.smithi159.stdout:0/296: chown d0/cf 20 1 2024-09-13T22:08:56.764 INFO:tasks.workunit.client.1.smithi159.stdout:0/297: chown d0/d48/f59 482 1 2024-09-13T22:08:56.764 INFO:tasks.workunit.client.1.smithi159.stdout:0/298: truncate d0/d48/d4f/d2b/f60 379245 0 2024-09-13T22:08:56.768 INFO:tasks.workunit.client.1.smithi159.stdout:8/358: unlink da/d22/l2f 0 2024-09-13T22:08:56.770 INFO:tasks.workunit.client.1.smithi159.stdout:4/307: dwrite d13/d15/f1f [0,4194304] 0 2024-09-13T22:08:56.770 INFO:tasks.workunit.client.1.smithi159.stdout:5/243: rename d1/db/c42 to d1/db/d35/c58 0 2024-09-13T22:08:56.773 INFO:tasks.workunit.client.1.smithi159.stdout:1/297: creat dd/d1e/d58/d5f/f60 x:0 0 0 2024-09-13T22:08:56.773 INFO:tasks.workunit.client.1.smithi159.stdout:1/298: creat dd/d1e/f61 x:0 0 0 2024-09-13T22:08:56.776 INFO:tasks.workunit.client.1.smithi159.stdout:0/299: symlink d0/d48/d4f/d2b/l62 0 2024-09-13T22:08:56.778 INFO:tasks.workunit.client.1.smithi159.stdout:8/359: creat da/d22/d2a/d39/f6e x:0 0 0 2024-09-13T22:08:56.782 INFO:tasks.workunit.client.1.smithi159.stdout:4/308: mkdir d13/d41/d5d 0 2024-09-13T22:08:56.784 INFO:tasks.workunit.client.1.smithi159.stdout:5/244: symlink d1/d49/l59 0 2024-09-13T22:08:56.784 INFO:tasks.workunit.client.1.smithi159.stdout:5/245: fdatasync d1/db/f25 0 2024-09-13T22:08:56.786 INFO:tasks.workunit.client.1.smithi159.stdout:1/299: mkdir dd/d11/d18/d49/d2d/d62 0 2024-09-13T22:08:56.789 INFO:tasks.workunit.client.1.smithi159.stdout:4/309: write d13/d41/f42 [3590376,91682] 0 2024-09-13T22:08:56.792 INFO:tasks.workunit.client.1.smithi159.stdout:0/300: mknod d0/d2c/c63 0 2024-09-13T22:08:56.792 INFO:tasks.workunit.client.1.smithi159.stdout:0/301: write d0/d48/d4f/f53 [679825,67143] 0 2024-09-13T22:08:56.793 INFO:tasks.workunit.client.1.smithi159.stdout:0/302: write d0/d5e/f51 [694463,53784] 0 2024-09-13T22:08:56.794 INFO:tasks.workunit.client.1.smithi159.stdout:8/360: unlink da/lf 0 2024-09-13T22:08:56.794 INFO:tasks.workunit.client.1.smithi159.stdout:8/361: fsync da/d22/d33/f59 0 2024-09-13T22:08:56.795 INFO:tasks.workunit.client.1.smithi159.stdout:5/246: creat d1/d11/d1c/d20/f5a x:0 0 0 2024-09-13T22:08:56.795 INFO:tasks.workunit.client.1.smithi159.stdout:5/247: write d1/d11/d1c/f51 [530131,127646] 0 2024-09-13T22:08:56.796 INFO:tasks.workunit.client.1.smithi159.stdout:4/310: mknod d13/d15/d5a/c5e 0 2024-09-13T22:08:56.796 INFO:tasks.workunit.client.1.smithi159.stdout:4/311: creat d13/d15/d26/d51/f5f x:0 0 0 2024-09-13T22:08:56.796 INFO:tasks.workunit.client.1.smithi159.stdout:4/312: creat d13/d41/d50/f60 x:0 0 0 2024-09-13T22:08:56.800 INFO:tasks.workunit.client.1.smithi159.stdout:8/362: unlink da/d22/d26/f2b 0 2024-09-13T22:08:56.800 INFO:tasks.workunit.client.1.smithi159.stdout:8/363: chown da/d22/d33/f46 1 1 2024-09-13T22:08:56.802 INFO:tasks.workunit.client.1.smithi159.stdout:5/248: rename d1/d11/d1c/l27 to d1/db/l5b 0 2024-09-13T22:08:56.802 INFO:tasks.workunit.client.1.smithi159.stdout:5/249: truncate d1/db/d17/f54 372636 0 2024-09-13T22:08:56.803 INFO:tasks.workunit.client.1.smithi159.stdout:1/300: rmdir dd/d11/d18/d2e 39 2024-09-13T22:08:56.807 INFO:tasks.workunit.client.1.smithi159.stdout:4/313: creat d13/d15/d26/f61 x:0 0 0 2024-09-13T22:08:56.807 INFO:tasks.workunit.client.1.smithi159.stdout:4/314: readlink d13/d15/d26/l4a 0 2024-09-13T22:08:56.807 INFO:tasks.workunit.client.1.smithi159.stdout:0/303: rmdir d0/d5e 39 2024-09-13T22:08:56.809 INFO:tasks.workunit.client.1.smithi159.stdout:8/364: truncate f4 3002778 0 2024-09-13T22:08:56.810 INFO:tasks.workunit.client.1.smithi159.stdout:1/301: mkdir dd/d11/d13/d4b/d52/d63 0 2024-09-13T22:08:56.812 INFO:tasks.workunit.client.1.smithi159.stdout:4/315: creat d13/d15/f62 x:0 0 0 2024-09-13T22:08:56.813 INFO:tasks.workunit.client.1.smithi159.stdout:0/304: mknod d0/d48/d4f/d54/c64 0 2024-09-13T22:08:56.813 INFO:tasks.workunit.client.1.smithi159.stdout:0/305: write d0/d2c/f5a [6013796,93520] 0 2024-09-13T22:08:56.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/302: unlink dd/l17 0 2024-09-13T22:08:56.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/303: readlink dd/d11/d18/d49/d2d/l46 0 2024-09-13T22:08:56.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/304: stat dd/d1e/d58/d5f 0 2024-09-13T22:08:56.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/305: write dd/d11/f40 [846252,81746] 0 2024-09-13T22:08:56.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/306: chown dd/d1e/l2c 37232556 1 2024-09-13T22:08:56.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/160: sync 2024-09-13T22:08:56.816 INFO:tasks.workunit.client.1.smithi159.stdout:1/307: mknod dd/d11/d34/c64 0 2024-09-13T22:08:56.816 INFO:tasks.workunit.client.1.smithi159.stdout:1/308: write dd/d11/d18/d49/d2d/f5d [832496,95320] 0 2024-09-13T22:08:56.817 INFO:tasks.workunit.client.1.smithi159.stdout:1/309: getdents dd/d11/d18 0 2024-09-13T22:08:56.818 INFO:tasks.workunit.client.1.smithi159.stdout:2/161: mknod d9/c36 0 2024-09-13T22:08:56.819 INFO:tasks.workunit.client.1.smithi159.stdout:3/204: sync 2024-09-13T22:08:56.819 INFO:tasks.workunit.client.1.smithi159.stdout:6/166: sync 2024-09-13T22:08:56.819 INFO:tasks.workunit.client.1.smithi159.stdout:1/310: rmdir dd/d1e/d58 39 2024-09-13T22:08:56.819 INFO:tasks.workunit.client.1.smithi159.stdout:9/332: sync 2024-09-13T22:08:56.819 INFO:tasks.workunit.client.1.smithi159.stdout:7/258: sync 2024-09-13T22:08:56.819 INFO:tasks.workunit.client.1.smithi159.stdout:7/259: creat d3/d31/d4d/d4e/f59 x:0 0 0 2024-09-13T22:08:56.821 INFO:tasks.workunit.client.1.smithi159.stdout:5/250: dwrite d1/db/d17/f2c [0,4194304] 0 2024-09-13T22:08:56.821 INFO:tasks.workunit.client.1.smithi159.stdout:5/251: chown d1/db 4 1 2024-09-13T22:08:56.823 INFO:tasks.workunit.client.1.smithi159.stdout:1/311: unlink dd/d11/d18/l5e 0 2024-09-13T22:08:56.823 INFO:tasks.workunit.client.1.smithi159.stdout:1/312: chown dd/d11/d18/d2e/l54 46409221 1 2024-09-13T22:08:56.823 INFO:tasks.workunit.client.1.smithi159.stdout:1/313: chown dd/d1e/f22 69 1 2024-09-13T22:08:56.824 INFO:tasks.workunit.client.1.smithi159.stdout:6/167: symlink d3/da/d29/d26/l34 0 2024-09-13T22:08:56.824 INFO:tasks.workunit.client.1.smithi159.stdout:6/168: chown d3/d2a 12 1 2024-09-13T22:08:56.824 INFO:tasks.workunit.client.1.smithi159.stdout:6/169: chown d3/da/f10 320 1 2024-09-13T22:08:56.825 INFO:tasks.workunit.client.1.smithi159.stdout:6/170: chown d3/da/d25 1 1 2024-09-13T22:08:56.825 INFO:tasks.workunit.client.1.smithi159.stdout:6/171: creat d3/f35 x:0 0 0 2024-09-13T22:08:56.825 INFO:tasks.workunit.client.1.smithi159.stdout:0/306: dread d0/d2c/f43 [0,4194304] 0 2024-09-13T22:08:56.826 INFO:tasks.workunit.client.1.smithi159.stdout:9/333: creat d1/dc/d10/d6d/d4b/d7a/f7f x:0 0 0 2024-09-13T22:08:56.826 INFO:tasks.workunit.client.1.smithi159.stdout:9/334: chown d1/dc/d10/d69/c7c 6486945 1 2024-09-13T22:08:56.826 INFO:tasks.workunit.client.1.smithi159.stdout:9/335: chown d1/f30 1002856224 1 2024-09-13T22:08:56.826 INFO:tasks.workunit.client.1.smithi159.stdout:9/336: fsync d1/f64 0 2024-09-13T22:08:56.828 INFO:tasks.workunit.client.1.smithi159.stdout:5/252: truncate d1/db/f25 438031 0 2024-09-13T22:08:56.830 INFO:tasks.workunit.client.1.smithi159.stdout:8/365: dwrite da/d22/d26/f5a [0,4194304] 0 2024-09-13T22:08:56.830 INFO:tasks.workunit.client.1.smithi159.stdout:8/366: chown da/d36/d48/f67 18375907 1 2024-09-13T22:08:56.831 INFO:tasks.workunit.client.1.smithi159.stdout:8/367: truncate da/d22/d33/d49/f62 845798 0 2024-09-13T22:08:56.831 INFO:tasks.workunit.client.1.smithi159.stdout:8/368: chown da/d22/d2a/d39/d3e/c3f 60060 1 2024-09-13T22:08:56.831 INFO:tasks.workunit.client.1.smithi159.stdout:8/369: getdents da/d22/d33/d49 0 2024-09-13T22:08:56.831 INFO:tasks.workunit.client.1.smithi159.stdout:2/162: dread d9/f2b [0,4194304] 0 2024-09-13T22:08:56.831 INFO:tasks.workunit.client.1.smithi159.stdout:2/163: truncate d9/da/f22 5046152 0 2024-09-13T22:08:56.832 INFO:tasks.workunit.client.1.smithi159.stdout:9/337: dread d1/dc/d10/f3b [0,4194304] 0 2024-09-13T22:08:56.832 INFO:tasks.workunit.client.1.smithi159.stdout:9/338: chown d1/dc/d27/d40/f70 0 1 2024-09-13T22:08:56.832 INFO:tasks.workunit.client.1.smithi159.stdout:1/314: creat dd/d11/d18/d2e/f65 x:0 0 0 2024-09-13T22:08:56.832 INFO:tasks.workunit.client.1.smithi159.stdout:1/315: creat dd/d11/d18/d2e/f66 x:0 0 0 2024-09-13T22:08:56.836 INFO:tasks.workunit.client.1.smithi159.stdout:8/370: dread da/d22/d33/f59 [0,4194304] 0 2024-09-13T22:08:56.836 INFO:tasks.workunit.client.1.smithi159.stdout:0/307: creat d0/d2c/f65 x:0 0 0 2024-09-13T22:08:56.848 INFO:tasks.workunit.client.1.smithi159.stdout:7/260: dwrite d3/d31/d4d/d4e/d4f/f58 [0,4194304] 0 2024-09-13T22:08:56.849 INFO:tasks.workunit.client.1.smithi159.stdout:1/316: mknod dd/d11/d18/d49/d2d/c67 0 2024-09-13T22:08:56.852 INFO:tasks.workunit.client.1.smithi159.stdout:0/308: mkdir d0/d48/d4f/d66 0 2024-09-13T22:08:56.852 INFO:tasks.workunit.client.1.smithi159.stdout:0/309: chown d0/f45 1028422 1 2024-09-13T22:08:56.852 INFO:tasks.workunit.client.1.smithi159.stdout:0/310: creat d0/d48/d4f/f67 x:0 0 0 2024-09-13T22:08:56.853 INFO:tasks.workunit.client.1.smithi159.stdout:5/253: getdents d1/db/d35 0 2024-09-13T22:08:56.853 INFO:tasks.workunit.client.1.smithi159.stdout:0/311: write d0/d48/d4f/d2b/f60 [25135,13527] 0 2024-09-13T22:08:56.855 INFO:tasks.workunit.client.1.smithi159.stdout:6/172: dwrite d3/da/d29/f2d [0,4194304] 0 2024-09-13T22:08:56.855 INFO:tasks.workunit.client.1.smithi159.stdout:9/339: dwrite d1/d9/ff [0,4194304] 0 2024-09-13T22:08:56.855 INFO:tasks.workunit.client.1.smithi159.stdout:2/164: mkdir d9/d37 0 2024-09-13T22:08:56.862 INFO:tasks.workunit.client.1.smithi159.stdout:8/371: dwrite da/d22/f4f [0,4194304] 0 2024-09-13T22:08:56.862 INFO:tasks.workunit.client.1.smithi159.stdout:8/372: fdatasync da/f10 0 2024-09-13T22:08:56.863 INFO:tasks.workunit.client.1.smithi159.stdout:1/317: rmdir dd/d11/d34 39 2024-09-13T22:08:56.863 INFO:tasks.workunit.client.1.smithi159.stdout:1/318: rename dd/d11/d34/d53 to dd/d11/d34/d53/d68 22 2024-09-13T22:08:56.863 INFO:tasks.workunit.client.1.smithi159.stdout:1/319: dread - dd/d11/d18/d2e/f66 zero size 2024-09-13T22:08:56.863 INFO:tasks.workunit.client.1.smithi159.stdout:1/320: readlink dd/d11/d13/l2a 0 2024-09-13T22:08:56.863 INFO:tasks.workunit.client.1.smithi159.stdout:1/321: dread - dd/d1c/f25 zero size 2024-09-13T22:08:56.863 INFO:tasks.workunit.client.1.smithi159.stdout:1/322: creat dd/d11/d18/d49/f69 x:0 0 0 2024-09-13T22:08:56.865 INFO:tasks.workunit.client.1.smithi159.stdout:5/254: symlink d1/db/l5c 0 2024-09-13T22:08:56.865 INFO:tasks.workunit.client.1.smithi159.stdout:5/255: write d1/db/fd [577270,51872] 0 2024-09-13T22:08:56.867 INFO:tasks.workunit.client.1.smithi159.stdout:0/312: symlink d0/d5e/l68 0 2024-09-13T22:08:56.867 INFO:tasks.workunit.client.1.smithi159.stdout:0/313: readlink d0/d5e/l68 0 2024-09-13T22:08:56.868 INFO:tasks.workunit.client.1.smithi159.stdout:0/314: write d0/d2c/f33 [37839,126934] 0 2024-09-13T22:08:56.868 INFO:tasks.workunit.client.1.smithi159.stdout:0/315: chown d0/d5e/l23 37668 1 2024-09-13T22:08:56.868 INFO:tasks.workunit.client.1.smithi159.stdout:0/316: fsync d0/d5e/f51 0 2024-09-13T22:08:56.868 INFO:tasks.workunit.client.1.smithi159.stdout:0/317: write d0/d48/d4f/f67 [482131,129736] 0 2024-09-13T22:08:56.873 INFO:tasks.workunit.client.1.smithi159.stdout:6/173: mknod d3/da/d29/c36 0 2024-09-13T22:08:56.875 INFO:tasks.workunit.client.1.smithi159.stdout:1/323: dread f7 [0,4194304] 0 2024-09-13T22:08:56.875 INFO:tasks.workunit.client.1.smithi159.stdout:9/340: dwrite d1/dc/f13 [0,4194304] 0 2024-09-13T22:08:56.875 INFO:tasks.workunit.client.1.smithi159.stdout:9/341: chown d1/dc/l2c 8036 1 2024-09-13T22:08:56.877 INFO:tasks.workunit.client.1.smithi159.stdout:1/324: read f7 [8947209,1978] 0 2024-09-13T22:08:56.877 INFO:tasks.workunit.client.1.smithi159.stdout:1/325: write dd/d1e/d58/d5f/f60 [356964,88085] 0 2024-09-13T22:08:56.879 INFO:tasks.workunit.client.1.smithi159.stdout:6/174: dread d3/da/d25/f2c [0,4194304] 0 2024-09-13T22:08:56.879 INFO:tasks.workunit.client.1.smithi159.stdout:5/256: dread d1/f8 [0,4194304] 0 2024-09-13T22:08:56.879 INFO:tasks.workunit.client.1.smithi159.stdout:5/257: write d1/d15/f26 [895459,12030] 0 2024-09-13T22:08:56.879 INFO:tasks.workunit.client.1.smithi159.stdout:5/258: chown d1/db/fd 3 1 2024-09-13T22:08:56.879 INFO:tasks.workunit.client.1.smithi159.stdout:5/259: write d1/d11/d1c/d20/f5a [1086,12332] 0 2024-09-13T22:08:56.884 INFO:tasks.workunit.client.1.smithi159.stdout:2/165: link d9/f1b d9/f38 0 2024-09-13T22:08:56.885 INFO:tasks.workunit.client.1.smithi159.stdout:1/326: write dd/d1e/f28 [1870122,65277] 0 2024-09-13T22:08:56.888 INFO:tasks.workunit.client.1.smithi159.stdout:5/260: creat d1/d11/d1c/d20/d44/f5d x:0 0 0 2024-09-13T22:08:56.889 INFO:tasks.workunit.client.1.smithi159.stdout:5/261: write d1/db/f47 [499300,100264] 0 2024-09-13T22:08:56.889 INFO:tasks.workunit.client.1.smithi159.stdout:0/318: dwrite d0/f10 [0,4194304] 0 2024-09-13T22:08:56.891 INFO:tasks.workunit.client.1.smithi159.stdout:1/327: creat dd/d11/d18/d49/d2d/d62/f6a x:0 0 0 2024-09-13T22:08:56.892 INFO:tasks.workunit.client.1.smithi159.stdout:6/175: getdents d3/da/d25 0 2024-09-13T22:08:56.893 INFO:tasks.workunit.client.1.smithi159.stdout:1/328: symlink dd/d11/d13/d4b/l6b 0 2024-09-13T22:08:56.895 INFO:tasks.workunit.client.1.smithi159.stdout:6/176: truncate d3/da/d29/d1a/f1c 3083870 0 2024-09-13T22:08:56.902 INFO:tasks.workunit.client.1.smithi159.stdout:9/342: rmdir d1/dc/d10/d6d/d4b 39 2024-09-13T22:08:56.904 INFO:tasks.workunit.client.1.smithi159.stdout:0/319: dread d0/f16 [0,4194304] 0 2024-09-13T22:08:56.909 INFO:tasks.workunit.client.1.smithi159.stdout:2/166: dwrite d9/f31 [0,4194304] 0 2024-09-13T22:08:56.913 INFO:tasks.workunit.client.1.smithi159.stdout:2/167: truncate d9/da/d25/f2f 360520 0 2024-09-13T22:08:56.917 INFO:tasks.workunit.client.1.smithi159.stdout:2/168: dread d9/f1d [0,4194304] 0 2024-09-13T22:08:56.919 INFO:tasks.workunit.client.1.smithi159.stdout:2/169: symlink d9/da/d27/l39 0 2024-09-13T22:08:56.919 INFO:tasks.workunit.client.1.smithi159.stdout:2/170: write f6 [930800,43291] 0 2024-09-13T22:08:56.919 INFO:tasks.workunit.client.1.smithi159.stdout:2/171: chown d9/c36 22 1 2024-09-13T22:08:56.921 INFO:tasks.workunit.client.1.smithi159.stdout:5/262: dwrite d1/db/d35/f4c [0,4194304] 0 2024-09-13T22:08:56.923 INFO:tasks.workunit.client.1.smithi159.stdout:5/263: symlink d1/l5e 0 2024-09-13T22:08:56.925 INFO:tasks.workunit.client.1.smithi159.stdout:1/329: dwrite dd/d11/d18/d49/d2d/f5d [0,4194304] 0 2024-09-13T22:08:56.926 INFO:tasks.workunit.client.1.smithi159.stdout:1/330: write dd/d1e/d58/d5f/f60 [1009697,119988] 0 2024-09-13T22:08:56.926 INFO:tasks.workunit.client.1.smithi159.stdout:1/331: chown dd/d1e/f1f 6727 1 2024-09-13T22:08:56.926 INFO:tasks.workunit.client.1.smithi159.stdout:6/177: dwrite d3/da/f28 [0,4194304] 0 2024-09-13T22:08:56.931 INFO:tasks.workunit.client.1.smithi159.stdout:1/332: symlink dd/d11/d18/d2e/l6c 0 2024-09-13T22:08:56.931 INFO:tasks.workunit.client.1.smithi159.stdout:1/333: read f7 [2799598,113024] 0 2024-09-13T22:08:56.949 INFO:tasks.workunit.client.1.smithi159.stdout:5/264: dwrite d1/d49/f4f [0,4194304] 0 2024-09-13T22:08:56.949 INFO:tasks.workunit.client.1.smithi159.stdout:5/265: fsync d1/d11/d1c/d20/f5a 0 2024-09-13T22:08:56.953 INFO:tasks.workunit.client.1.smithi159.stdout:5/266: symlink d1/d11/d1c/d20/d44/l5f 0 2024-09-13T22:08:56.956 INFO:tasks.workunit.client.1.smithi159.stdout:5/267: mkdir d1/db/d35/d60 0 2024-09-13T22:08:56.956 INFO:tasks.workunit.client.1.smithi159.stdout:5/268: creat d1/d49/f61 x:0 0 0 2024-09-13T22:08:56.956 INFO:tasks.workunit.client.1.smithi159.stdout:5/269: fsync d1/db/fd 0 2024-09-13T22:08:56.956 INFO:tasks.workunit.client.1.smithi159.stdout:5/270: readlink d1/d11/l21 0 2024-09-13T22:08:56.968 INFO:tasks.workunit.client.1.smithi159.stdout:5/271: read d1/d11/f1e [3918851,114158] 0 2024-09-13T22:08:56.968 INFO:tasks.workunit.client.1.smithi159.stdout:5/272: chown d1/db/f43 1870307 1 2024-09-13T22:08:56.970 INFO:tasks.workunit.client.1.smithi159.stdout:6/178: dread d3/da/d29/d1a/f1c [0,4194304] 0 2024-09-13T22:08:56.970 INFO:tasks.workunit.client.1.smithi159.stdout:6/179: chown d3/da/d29/d26/l34 94352879 1 2024-09-13T22:08:56.971 INFO:tasks.workunit.client.1.smithi159.stdout:5/273: rename d1/d49/f61 to d1/d11/d50/f62 0 2024-09-13T22:08:56.979 INFO:tasks.workunit.client.1.smithi159.stdout:5/274: unlink d1/db/d17/l2f 0 2024-09-13T22:08:56.979 INFO:tasks.workunit.client.1.smithi159.stdout:5/275: chown d1/d11/d1c/d20/d44/l5f 152 1 2024-09-13T22:08:56.991 INFO:tasks.workunit.client.1.smithi159.stdout:6/180: dwrite d3/da/d29/d1a/f1c [0,4194304] 0 2024-09-13T22:08:56.995 INFO:tasks.workunit.client.1.smithi159.stdout:6/181: creat d3/da/d29/d26/f37 x:0 0 0 2024-09-13T22:08:56.995 INFO:tasks.workunit.client.1.smithi159.stdout:6/182: write d3/da/d29/d1a/f24 [1112361,105694] 0 2024-09-13T22:08:56.998 INFO:tasks.workunit.client.1.smithi159.stdout:6/183: rename d3/da/d29/d1a/f24 to d3/da/d25/f38 0 2024-09-13T22:08:56.998 INFO:tasks.workunit.client.1.smithi159.stdout:6/184: write d3/da/d29/f11 [5099172,8626] 0 2024-09-13T22:08:56.998 INFO:tasks.workunit.client.1.smithi159.stdout:6/185: fsync d3/f27 0 2024-09-13T22:08:57.002 INFO:tasks.workunit.client.1.smithi159.stdout:6/186: mknod d3/da/d25/c39 0 2024-09-13T22:08:57.002 INFO:tasks.workunit.client.1.smithi159.stdout:5/276: getdents d1/db/d17 0 2024-09-13T22:08:57.004 INFO:tasks.workunit.client.1.smithi159.stdout:6/187: mknod d3/da/c3a 0 2024-09-13T22:08:57.007 INFO:tasks.workunit.client.1.smithi159.stdout:5/277: dread d1/d15/f26 [0,4194304] 0 2024-09-13T22:08:57.009 INFO:tasks.workunit.client.1.smithi159.stdout:5/278: rmdir d1/d11/d1c/d32 39 2024-09-13T22:08:57.009 INFO:tasks.workunit.client.1.smithi159.stdout:5/279: creat d1/d11/f63 x:0 0 0 2024-09-13T22:08:57.012 INFO:tasks.workunit.client.1.smithi159.stdout:5/280: unlink d1/d11/d1c/d32/l41 0 2024-09-13T22:08:57.015 INFO:tasks.workunit.client.1.smithi159.stdout:5/281: rename d1/db to d1/d11/d64 0 2024-09-13T22:08:57.015 INFO:tasks.workunit.client.1.smithi159.stdout:5/282: write d1/d11/d64/d35/f56 [1760067,21010] 0 2024-09-13T22:08:57.015 INFO:tasks.workunit.client.1.smithi159.stdout:5/283: fsync d1/d11/d1c/d20/f5a 0 2024-09-13T22:08:57.015 INFO:tasks.workunit.client.1.smithi159.stdout:6/188: getdents d3/da 0 2024-09-13T22:08:57.024 INFO:tasks.workunit.client.1.smithi159.stdout:6/189: write d3/f2b [1924543,72345] 0 2024-09-13T22:08:57.025 INFO:tasks.workunit.client.1.smithi159.stdout:6/190: write d3/f2b [2179581,58301] 0 2024-09-13T22:08:57.030 INFO:tasks.workunit.client.1.smithi159.stdout:5/284: dwrite d1/d11/d1c/d20/d44/f5d [0,4194304] 0 2024-09-13T22:08:57.035 INFO:tasks.workunit.client.1.smithi159.stdout:5/285: write d1/f2 [1691483,129949] 0 2024-09-13T22:08:57.038 INFO:tasks.workunit.client.1.smithi159.stdout:6/191: dwrite d3/da/d25/f2c [0,4194304] 0 2024-09-13T22:08:57.038 INFO:tasks.workunit.client.1.smithi159.stdout:6/192: stat d3/da/d29/f11 0 2024-09-13T22:08:57.040 INFO:tasks.workunit.client.1.smithi159.stdout:6/193: unlink d3/da/d29/d26/c33 0 2024-09-13T22:08:57.048 INFO:tasks.workunit.client.1.smithi159.stdout:6/194: dread d3/da/d29/f11 [0,4194304] 0 2024-09-13T22:08:57.057 INFO:tasks.workunit.client.1.smithi159.stdout:6/195: dread d3/da/f28 [0,4194304] 0 2024-09-13T22:08:57.058 INFO:tasks.workunit.client.1.smithi159.stdout:6/196: unlink d3/da/c3a 0 2024-09-13T22:08:57.072 INFO:tasks.workunit.client.1.smithi159.stdout:6/197: dwrite d3/da/d29/d1a/f2e [0,4194304] 0 2024-09-13T22:08:57.075 INFO:tasks.workunit.client.1.smithi159.stdout:6/198: symlink d3/d2a/l3b 0 2024-09-13T22:08:57.080 INFO:tasks.workunit.client.1.smithi159.stdout:6/199: truncate d3/da/d29/d1a/f2e 1100474 0 2024-09-13T22:08:57.080 INFO:tasks.workunit.client.1.smithi159.stdout:6/200: mkdir d3/d2a/d3c 0 2024-09-13T22:08:57.080 INFO:tasks.workunit.client.1.smithi159.stdout:6/201: write d3/da/f16 [4308971,63712] 0 2024-09-13T22:08:57.082 INFO:tasks.workunit.client.1.smithi159.stdout:6/202: creat d3/d2a/d3c/f3d x:0 0 0 2024-09-13T22:08:57.082 INFO:tasks.workunit.client.1.smithi159.stdout:6/203: stat d3/c8 0 2024-09-13T22:08:57.083 INFO:tasks.workunit.client.1.smithi159.stdout:6/204: mkdir d3/da/d29/d1a/d3e 0 2024-09-13T22:08:57.083 INFO:tasks.workunit.client.1.smithi159.stdout:6/205: chown d3/f23 3423753 1 2024-09-13T22:08:57.085 INFO:tasks.workunit.client.1.smithi159.stdout:6/206: mknod d3/da/d29/d26/c3f 0 2024-09-13T22:08:57.086 INFO:tasks.workunit.client.1.smithi159.stdout:6/207: symlink d3/da/d29/l40 0 2024-09-13T22:08:57.086 INFO:tasks.workunit.client.1.smithi159.stdout:6/208: chown d3 446540 1 2024-09-13T22:08:57.086 INFO:tasks.workunit.client.1.smithi159.stdout:6/209: fsync d3/da/d29/f2d 0 2024-09-13T22:08:57.088 INFO:tasks.workunit.client.1.smithi159.stdout:6/210: truncate d3/da/d29/f11 2803232 0 2024-09-13T22:08:57.098 INFO:tasks.workunit.client.1.smithi159.stdout:6/211: read d3/f27 [2700154,36165] 0 2024-09-13T22:08:57.099 INFO:tasks.workunit.client.1.smithi159.stdout:6/212: creat d3/da/d25/f41 x:0 0 0 2024-09-13T22:08:57.101 INFO:tasks.workunit.client.1.smithi159.stdout:6/213: creat d3/da/f42 x:0 0 0 2024-09-13T22:08:57.109 INFO:tasks.workunit.client.1.smithi159.stdout:6/214: read d3/da/d29/d1a/f1c [3934900,96539] 0 2024-09-13T22:08:57.124 INFO:tasks.workunit.client.1.smithi159.stdout:6/215: dwrite d3/da/d25/f2c [0,4194304] 0 2024-09-13T22:08:57.135 INFO:tasks.workunit.client.1.smithi159.stdout:6/216: write d3/da/d29/f2d [1989959,30505] 0 2024-09-13T22:08:57.135 INFO:tasks.workunit.client.1.smithi159.stdout:6/217: write d3/f35 [427220,53533] 0 2024-09-13T22:08:57.136 INFO:tasks.workunit.client.1.smithi159.stdout:6/218: read d3/da/d29/f17 [629804,7487] 0 2024-09-13T22:08:57.138 INFO:tasks.workunit.client.1.smithi159.stdout:6/219: creat d3/da/d29/d1a/d3e/f43 x:0 0 0 2024-09-13T22:08:57.154 INFO:tasks.workunit.client.1.smithi159.stdout:6/220: dwrite d3/da/f42 [0,4194304] 0 2024-09-13T22:08:57.154 INFO:tasks.workunit.client.1.smithi159.stdout:6/221: readlink d3/da/d29/l40 0 2024-09-13T22:08:57.154 INFO:tasks.workunit.client.1.smithi159.stdout:6/222: fsync d3/da/d25/f41 0 2024-09-13T22:08:57.154 INFO:tasks.workunit.client.1.smithi159.stdout:6/223: dread - d3/da/d29/d26/f37 zero size 2024-09-13T22:08:57.157 INFO:tasks.workunit.client.1.smithi159.stdout:6/224: rename d3/da/d29/l21 to d3/da/d29/d1a/d3e/l44 0 2024-09-13T22:08:57.157 INFO:tasks.workunit.client.1.smithi159.stdout:6/225: readlink d3/da/l19 0 2024-09-13T22:08:57.157 INFO:tasks.workunit.client.1.smithi159.stdout:6/226: truncate d3/da/d29/f17 2662960 0 2024-09-13T22:08:57.157 INFO:tasks.workunit.client.1.smithi159.stdout:6/227: creat d3/da/d29/f45 x:0 0 0 2024-09-13T22:08:57.157 INFO:tasks.workunit.client.1.smithi159.stdout:6/228: write d3/da/d29/f2d [320349,123394] 0 2024-09-13T22:08:57.158 INFO:tasks.workunit.client.1.smithi159.stdout:6/229: dread - d3/d2a/d3c/f3d zero size 2024-09-13T22:08:57.499 INFO:tasks.workunit.client.1.smithi159.stdout:4/316: sync 2024-09-13T22:08:57.499 INFO:tasks.workunit.client.1.smithi159.stdout:3/205: sync 2024-09-13T22:08:57.499 INFO:tasks.workunit.client.1.smithi159.stdout:4/317: chown d13/d15/d26 167164 1 2024-09-13T22:08:57.499 INFO:tasks.workunit.client.1.smithi159.stdout:4/318: fsync d13/d15/d26/d51/f5f 0 2024-09-13T22:08:57.499 INFO:tasks.workunit.client.1.smithi159.stdout:4/319: write d13/d15/f16 [3989251,103313] 0 2024-09-13T22:08:57.501 INFO:tasks.workunit.client.1.smithi159.stdout:3/206: dread d0/d1/d3/dd/f10 [0,4194304] 0 2024-09-13T22:08:57.545 INFO:tasks.workunit.client.1.smithi159.stdout:4/320: creat d13/d15/d26/d29/d3b/f63 x:0 0 0 2024-09-13T22:08:57.545 INFO:tasks.workunit.client.1.smithi159.stdout:4/321: fsync d13/d15/d26/d51/f54 0 2024-09-13T22:08:57.550 INFO:tasks.workunit.client.1.smithi159.stdout:3/207: symlink d0/d1/d3/d5/db/d39/l43 0 2024-09-13T22:08:57.552 INFO:tasks.workunit.client.1.smithi159.stdout:3/208: mkdir d0/d1/d3/d5/d44 0 2024-09-13T22:08:57.552 INFO:tasks.workunit.client.1.smithi159.stdout:3/209: fsync d0/d1/d3/dd/f20 0 2024-09-13T22:08:57.554 INFO:tasks.workunit.client.1.smithi159.stdout:3/210: mkdir d0/d1/d3/d5/d14/d42/d45 0 2024-09-13T22:08:57.556 INFO:tasks.workunit.client.1.smithi159.stdout:3/211: mknod d0/d1/d15/c46 0 2024-09-13T22:08:57.572 INFO:tasks.workunit.client.1.smithi159.stdout:3/212: dwrite d0/d1/d3/d5/d25/d2c/f2d [0,4194304] 0 2024-09-13T22:08:57.572 INFO:tasks.workunit.client.1.smithi159.stdout:4/322: dwrite d13/f24 [0,4194304] 0 2024-09-13T22:08:57.572 INFO:tasks.workunit.client.1.smithi159.stdout:4/323: dread - d13/d41/d50/f60 zero size 2024-09-13T22:08:57.572 INFO:tasks.workunit.client.1.smithi159.stdout:3/213: dread - d0/d1/d34/f41 zero size 2024-09-13T22:08:57.572 INFO:tasks.workunit.client.1.smithi159.stdout:4/324: dread - d13/d15/d26/f34 zero size 2024-09-13T22:08:57.572 INFO:tasks.workunit.client.1.smithi159.stdout:3/214: creat d0/d1/f47 x:0 0 0 2024-09-13T22:08:57.573 INFO:tasks.workunit.client.1.smithi159.stdout:3/215: readlink d0/d1/d3/d5/d25/l2b 0 2024-09-13T22:08:57.573 INFO:tasks.workunit.client.1.smithi159.stdout:3/216: chown d0/d1/d3/d5/d25 110387433 1 2024-09-13T22:08:57.573 INFO:tasks.workunit.client.1.smithi159.stdout:3/217: chown d0/d1/d3/d5/db/d39 7 1 2024-09-13T22:08:57.573 INFO:tasks.workunit.client.1.smithi159.stdout:3/218: creat d0/d1/d3/f48 x:0 0 0 2024-09-13T22:08:57.575 INFO:tasks.workunit.client.1.smithi159.stdout:4/325: dread d13/d15/f1d [0,4194304] 0 2024-09-13T22:08:57.579 INFO:tasks.workunit.client.1.smithi159.stdout:3/219: getdents d0 0 2024-09-13T22:08:57.581 INFO:tasks.workunit.client.1.smithi159.stdout:4/326: symlink d13/d41/l64 0 2024-09-13T22:08:57.581 INFO:tasks.workunit.client.1.smithi159.stdout:4/327: chown l5 4653159 1 2024-09-13T22:08:57.583 INFO:tasks.workunit.client.1.smithi159.stdout:3/220: rmdir d0/d1/d3/dd/d36 0 2024-09-13T22:08:57.583 INFO:tasks.workunit.client.1.smithi159.stdout:3/221: fdatasync d0/d1/d3/dd/f13 0 2024-09-13T22:08:57.590 INFO:tasks.workunit.client.1.smithi159.stdout:4/328: write d13/d15/f39 [748947,94570] 0 2024-09-13T22:08:57.591 INFO:tasks.workunit.client.1.smithi159.stdout:4/329: chown le 4802803 1 2024-09-13T22:08:57.591 INFO:tasks.workunit.client.1.smithi159.stdout:4/330: truncate d13/d15/d26/f61 122499 0 2024-09-13T22:08:57.591 INFO:tasks.workunit.client.1.smithi159.stdout:4/331: chown d13/d15/l18 3281 1 2024-09-13T22:08:57.591 INFO:tasks.workunit.client.1.smithi159.stdout:4/332: write d13/f19 [1744586,9441] 0 2024-09-13T22:08:57.594 INFO:tasks.workunit.client.1.smithi159.stdout:4/333: getdents d13/d15/d26 0 2024-09-13T22:08:57.595 INFO:tasks.workunit.client.1.smithi159.stdout:4/334: mkdir d13/d15/d26/d51/d65 0 2024-09-13T22:08:57.596 INFO:tasks.workunit.client.1.smithi159.stdout:4/335: getdents d13/d15/d5a 0 2024-09-13T22:08:57.600 INFO:tasks.workunit.client.1.smithi159.stdout:3/222: dwrite d0/d1/d3/d5/db/d39/f3f [0,4194304] 0 2024-09-13T22:08:57.608 INFO:tasks.workunit.client.1.smithi159.stdout:3/223: write d0/d1/d3/d5/d25/d2c/f2d [1362651,40950] 0 2024-09-13T22:08:57.608 INFO:tasks.workunit.client.1.smithi159.stdout:3/224: chown d0/d1/d3/f1c 235639746 1 2024-09-13T22:08:57.612 INFO:tasks.workunit.client.1.smithi159.stdout:3/225: mknod d0/d1/d3/d5/c49 0 2024-09-13T22:08:57.627 INFO:tasks.workunit.client.1.smithi159.stdout:4/336: dwrite d13/d15/f25 [0,4194304] 0 2024-09-13T22:08:57.627 INFO:tasks.workunit.client.1.smithi159.stdout:3/226: write d0/d1/d3/dd/f20 [940035,110838] 0 2024-09-13T22:08:57.633 INFO:tasks.workunit.client.1.smithi159.stdout:7/261: sync 2024-09-13T22:08:57.633 INFO:tasks.workunit.client.1.smithi159.stdout:7/262: getdents d3 0 2024-09-13T22:08:57.635 INFO:tasks.workunit.client.1.smithi159.stdout:4/337: write d13/f14 [5246233,15828] 0 2024-09-13T22:08:57.639 INFO:tasks.workunit.client.1.smithi159.stdout:7/263: write d3/f15 [2336681,129792] 0 2024-09-13T22:08:57.657 INFO:tasks.workunit.client.1.smithi159.stdout:4/338: dwrite d13/d15/f36 [0,4194304] 0 2024-09-13T22:08:57.658 INFO:tasks.workunit.client.1.smithi159.stdout:4/339: mkdir d13/d15/d26/d29/d3b/d66 0 2024-09-13T22:08:57.658 INFO:tasks.workunit.client.1.smithi159.stdout:7/264: dwrite d3/d31/d4d/d4e/d4f/f58 [0,4194304] 0 2024-09-13T22:08:57.658 INFO:tasks.workunit.client.1.smithi159.stdout:7/265: write d3/d3f/f4a [3120557,32254] 0 2024-09-13T22:08:57.660 INFO:tasks.workunit.client.1.smithi159.stdout:4/340: mkdir d13/d15/d26/d51/d65/d67 0 2024-09-13T22:08:57.662 INFO:tasks.workunit.client.1.smithi159.stdout:7/266: rmdir d3/d31/d4d 39 2024-09-13T22:08:57.664 INFO:tasks.workunit.client.1.smithi159.stdout:4/341: mknod d13/c68 0 2024-09-13T22:08:57.666 INFO:tasks.workunit.client.1.smithi159.stdout:7/267: mknod d3/d2e/c5a 0 2024-09-13T22:08:57.669 INFO:tasks.workunit.client.1.smithi159.stdout:7/268: rename d3/d18/l3b to d3/d2e/l5b 0 2024-09-13T22:08:57.669 INFO:tasks.workunit.client.1.smithi159.stdout:7/269: chown d3/d2e/l5b 19687 1 2024-09-13T22:08:57.670 INFO:tasks.workunit.client.1.smithi159.stdout:7/270: write d3/f14 [248688,17708] 0 2024-09-13T22:08:57.672 INFO:tasks.workunit.client.1.smithi159.stdout:7/271: symlink d3/d31/d49/l5c 0 2024-09-13T22:08:57.679 INFO:tasks.workunit.client.1.smithi159.stdout:7/272: write d3/d3f/f48 [2935430,13700] 0 2024-09-13T22:08:57.681 INFO:tasks.workunit.client.1.smithi159.stdout:7/273: symlink d3/d31/l5d 0 2024-09-13T22:08:57.682 INFO:tasks.workunit.client.1.smithi159.stdout:7/274: mkdir d3/d4b/d5e 0 2024-09-13T22:08:57.683 INFO:tasks.workunit.client.1.smithi159.stdout:7/275: creat d3/d31/f5f x:0 0 0 2024-09-13T22:08:57.683 INFO:tasks.workunit.client.1.smithi159.stdout:7/276: truncate d3/d18/f3d 379342 0 2024-09-13T22:08:57.685 INFO:tasks.workunit.client.1.smithi159.stdout:7/277: symlink d3/d31/d49/l60 0 2024-09-13T22:08:57.685 INFO:tasks.workunit.client.1.smithi159.stdout:4/342: dwrite d13/d15/f17 [0,4194304] 0 2024-09-13T22:08:57.686 INFO:tasks.workunit.client.1.smithi159.stdout:7/278: link d3/d31/l5d d3/d2e/l61 0 2024-09-13T22:08:57.688 INFO:tasks.workunit.client.1.smithi159.stdout:4/343: creat d13/d15/d5a/f69 x:0 0 0 2024-09-13T22:08:57.688 INFO:tasks.workunit.client.1.smithi159.stdout:7/279: getdents d3/d31/d4d 0 2024-09-13T22:08:57.688 INFO:tasks.workunit.client.1.smithi159.stdout:7/280: fdatasync d3/d18/f54 0 2024-09-13T22:08:57.692 INFO:tasks.workunit.client.1.smithi159.stdout:4/344: dread d13/f22 [0,4194304] 0 2024-09-13T22:08:57.692 INFO:tasks.workunit.client.1.smithi159.stdout:7/281: unlink d3/d18/f36 0 2024-09-13T22:08:57.692 INFO:tasks.workunit.client.1.smithi159.stdout:7/282: stat d3/d31/d4d/d4e/d4f 0 2024-09-13T22:08:57.692 INFO:tasks.workunit.client.1.smithi159.stdout:7/283: truncate d3/d31/d4d/d4e/d4f/f58 5054810 0 2024-09-13T22:08:57.698 INFO:tasks.workunit.client.1.smithi159.stdout:4/345: write f10 [2801389,78892] 0 2024-09-13T22:08:57.698 INFO:tasks.workunit.client.1.smithi159.stdout:4/346: dread - d13/d15/d26/d29/d3b/f63 zero size 2024-09-13T22:08:57.714 INFO:tasks.workunit.client.1.smithi159.stdout:7/284: dwrite d3/d31/d4d/d4e/f52 [0,4194304] 0 2024-09-13T22:08:57.714 INFO:tasks.workunit.client.1.smithi159.stdout:7/285: dread - d3/d18/f54 zero size 2024-09-13T22:08:57.715 INFO:tasks.workunit.client.1.smithi159.stdout:4/347: dwrite d13/d41/d50/f60 [0,4194304] 0 2024-09-13T22:08:57.724 INFO:tasks.workunit.client.1.smithi159.stdout:7/286: write d3/d18/f20 [213482,47463] 0 2024-09-13T22:08:57.725 INFO:tasks.workunit.client.1.smithi159.stdout:4/348: getdents d13/d41/d4d 0 2024-09-13T22:08:57.730 INFO:tasks.workunit.client.1.smithi159.stdout:7/287: creat d3/f62 x:0 0 0 2024-09-13T22:08:57.730 INFO:tasks.workunit.client.1.smithi159.stdout:7/288: write d3/d2e/f35 [1426776,33730] 0 2024-09-13T22:08:57.730 INFO:tasks.workunit.client.1.smithi159.stdout:7/289: fsync d3/fe 0 2024-09-13T22:08:57.731 INFO:tasks.workunit.client.1.smithi159.stdout:4/349: link d13/d15/d26/d51/f5f d13/d15/d26/d51/d65/f6a 0 2024-09-13T22:08:57.731 INFO:tasks.workunit.client.1.smithi159.stdout:4/350: chown le 16087 1 2024-09-13T22:08:57.731 INFO:tasks.workunit.client.1.smithi159.stdout:4/351: dread - d13/d15/d26/d51/f5f zero size 2024-09-13T22:08:57.731 INFO:tasks.workunit.client.1.smithi159.stdout:4/352: fdatasync f11 0 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:6/230: sync 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:1/334: sync 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:2/172: sync 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:0/320: sync 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:8/373: sync 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:5/286: sync 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:9/343: sync 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:6/231: stat d3/d2a/l3b 0 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:0/321: creat d0/d48/d4f/f69 x:0 0 0 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:9/344: creat d1/dc/d10/d69/f80 x:0 0 0 2024-09-13T22:08:57.733 INFO:tasks.workunit.client.1.smithi159.stdout:0/322: readlink d0/d2c/l2d 0 2024-09-13T22:08:57.734 INFO:tasks.workunit.client.1.smithi159.stdout:0/323: fsync d0/d5e/f1a 0 2024-09-13T22:08:57.734 INFO:tasks.workunit.client.1.smithi159.stdout:9/345: readlink d1/dc/d10/d6d/d2f/l72 0 2024-09-13T22:08:57.734 INFO:tasks.workunit.client.1.smithi159.stdout:7/290: mknod d3/d3f/c63 0 2024-09-13T22:08:57.738 INFO:tasks.workunit.client.1.smithi159.stdout:4/353: link d13/l58 d13/d41/d5d/l6b 0 2024-09-13T22:08:57.738 INFO:tasks.workunit.client.1.smithi159.stdout:4/354: stat le 0 2024-09-13T22:08:57.739 INFO:tasks.workunit.client.1.smithi159.stdout:0/324: dread d0/d5e/f4b [0,4194304] 0 2024-09-13T22:08:57.739 INFO:tasks.workunit.client.1.smithi159.stdout:0/325: fsync d0/d48/d4f/f5d 0 2024-09-13T22:08:57.744 INFO:tasks.workunit.client.1.smithi159.stdout:8/374: rmdir da/d22/d2a/d39/d3e 39 2024-09-13T22:08:57.744 INFO:tasks.workunit.client.1.smithi159.stdout:8/375: chown da/d5d/l5e 343018417 1 2024-09-13T22:08:57.744 INFO:tasks.workunit.client.1.smithi159.stdout:6/232: dread d3/f23 [0,4194304] 0 2024-09-13T22:08:57.745 INFO:tasks.workunit.client.1.smithi159.stdout:2/173: creat d9/d37/f3a x:0 0 0 2024-09-13T22:08:57.745 INFO:tasks.workunit.client.1.smithi159.stdout:2/174: chown d9/da/c1c 476497 1 2024-09-13T22:08:57.745 INFO:tasks.workunit.client.1.smithi159.stdout:2/175: chown d9/da/d27 479978289 1 2024-09-13T22:08:57.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:57 smithi089 ceph-mon[27921]: pgmap v260: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 159 MiB/s rd, 204 MiB/s wr, 342 op/s 2024-09-13T22:08:57.747 INFO:tasks.workunit.client.1.smithi159.stdout:1/335: dwrite dd/d11/d21/f42 [0,4194304] 0 2024-09-13T22:08:57.747 INFO:tasks.workunit.client.1.smithi159.stdout:1/336: write dd/d1e/f28 [5007357,64149] 0 2024-09-13T22:08:57.748 INFO:tasks.workunit.client.1.smithi159.stdout:1/337: write dd/d11/d13/d4b/f5b [148320,55884] 0 2024-09-13T22:08:57.749 INFO:tasks.workunit.client.1.smithi159.stdout:9/346: unlink d1/d9/d1f/c67 0 2024-09-13T22:08:57.751 INFO:tasks.workunit.client.1.smithi159.stdout:7/291: rename d3/d31/f5f to d3/d4b/d5e/f64 0 2024-09-13T22:08:57.754 INFO:tasks.workunit.client.1.smithi159.stdout:4/355: mkdir d13/d15/d26/d29/d3b/d66/d6c 0 2024-09-13T22:08:57.754 INFO:tasks.workunit.client.1.smithi159.stdout:4/356: chown d13/d15/f21 23262654 1 2024-09-13T22:08:57.755 INFO:tasks.workunit.client.1.smithi159.stdout:5/287: mknod d1/d11/d50/c65 0 2024-09-13T22:08:57.756 INFO:tasks.workunit.client.1.smithi159.stdout:8/376: mkdir da/d22/d33/d49/d6f 0 2024-09-13T22:08:57.758 INFO:tasks.workunit.client.1.smithi159.stdout:6/233: mkdir d3/d2a/d3c/d46 0 2024-09-13T22:08:57.758 INFO:tasks.workunit.client.1.smithi159.stdout:6/234: dread - d3/da/f10 zero size 2024-09-13T22:08:57.758 INFO:tasks.workunit.client.1.smithi159.stdout:6/235: truncate d3/d2a/d3c/f3d 722790 0 2024-09-13T22:08:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:57 smithi159 ceph-mon[35348]: pgmap v260: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 159 MiB/s rd, 204 MiB/s wr, 342 op/s 2024-09-13T22:08:57.767 INFO:tasks.workunit.client.1.smithi159.stdout:0/326: rename d0/d48/f5f to d0/f6a 0 2024-09-13T22:08:57.767 INFO:tasks.workunit.client.1.smithi159.stdout:0/327: write d0/d5e/f14 [3543549,116730] 0 2024-09-13T22:08:57.767 INFO:tasks.workunit.client.1.smithi159.stdout:0/328: chown d0/d2c/c30 0 1 2024-09-13T22:08:57.771 INFO:tasks.workunit.client.1.smithi159.stdout:4/357: write f8 [2507510,47720] 0 2024-09-13T22:08:57.771 INFO:tasks.workunit.client.1.smithi159.stdout:4/358: chown d13/f14 96 1 2024-09-13T22:08:57.772 INFO:tasks.workunit.client.1.smithi159.stdout:0/329: dread d0/d5e/f19 [0,4194304] 0 2024-09-13T22:08:57.773 INFO:tasks.workunit.client.1.smithi159.stdout:5/288: symlink d1/d11/d50/l66 0 2024-09-13T22:08:57.777 INFO:tasks.workunit.client.1.smithi159.stdout:8/377: write da/d22/d33/f38 [2266377,128142] 0 2024-09-13T22:08:57.778 INFO:tasks.workunit.client.1.smithi159.stdout:2/176: dwrite f6 [0,4194304] 0 2024-09-13T22:08:57.778 INFO:tasks.workunit.client.1.smithi159.stdout:2/177: creat d9/da/d25/f3b x:0 0 0 2024-09-13T22:08:57.779 INFO:tasks.workunit.client.1.smithi159.stdout:1/338: rmdir dd/d11/d18 39 2024-09-13T22:08:57.779 INFO:tasks.workunit.client.1.smithi159.stdout:1/339: write f7 [10123120,37301] 0 2024-09-13T22:08:57.779 INFO:tasks.workunit.client.1.smithi159.stdout:1/340: creat dd/d11/d13/f6d x:0 0 0 2024-09-13T22:08:57.779 INFO:tasks.workunit.client.1.smithi159.stdout:0/330: mknod d0/d48/d4f/d66/c6b 0 2024-09-13T22:08:57.781 INFO:tasks.workunit.client.1.smithi159.stdout:1/341: dread dd/d1c/f26 [0,4194304] 0 2024-09-13T22:08:57.782 INFO:tasks.workunit.client.1.smithi159.stdout:0/331: dread d0/f3e [0,4194304] 0 2024-09-13T22:08:57.782 INFO:tasks.workunit.client.1.smithi159.stdout:9/347: dwrite d1/dc/d10/d6d/d2f/f68 [0,4194304] 0 2024-09-13T22:08:57.782 INFO:tasks.workunit.client.1.smithi159.stdout:0/332: fdatasync d0/f52 0 2024-09-13T22:08:57.782 INFO:tasks.workunit.client.1.smithi159.stdout:9/348: write d1/d9/f38 [661474,13278] 0 2024-09-13T22:08:57.782 INFO:tasks.workunit.client.1.smithi159.stdout:0/333: creat d0/d48/f6c x:0 0 0 2024-09-13T22:08:57.782 INFO:tasks.workunit.client.1.smithi159.stdout:5/289: mknod d1/d11/d64/c67 0 2024-09-13T22:08:57.782 INFO:tasks.workunit.client.1.smithi159.stdout:5/290: fdatasync d1/d11/d64/d17/f2c 0 2024-09-13T22:08:57.783 INFO:tasks.workunit.client.1.smithi159.stdout:6/236: getdents d3/da/d25 0 2024-09-13T22:08:57.789 INFO:tasks.workunit.client.1.smithi159.stdout:7/292: dwrite d3/d18/f20 [0,4194304] 0 2024-09-13T22:08:57.790 INFO:tasks.workunit.client.1.smithi159.stdout:2/178: symlink d9/d2d/l3c 0 2024-09-13T22:08:57.791 INFO:tasks.workunit.client.1.smithi159.stdout:4/359: dwrite d13/f14 [4194304,4194304] 0 2024-09-13T22:08:57.795 INFO:tasks.workunit.client.1.smithi159.stdout:1/342: creat dd/d11/d34/d53/f6e x:0 0 0 2024-09-13T22:08:57.804 INFO:tasks.workunit.client.1.smithi159.stdout:5/291: fdatasync d1/fa 0 2024-09-13T22:08:57.804 INFO:tasks.workunit.client.1.smithi159.stdout:4/360: write d13/d15/d26/d29/d3b/f3d [3426557,82688] 0 2024-09-13T22:08:57.805 INFO:tasks.workunit.client.1.smithi159.stdout:7/293: dread d3/fe [0,4194304] 0 2024-09-13T22:08:57.808 INFO:tasks.workunit.client.1.smithi159.stdout:5/292: dread d1/d11/d64/f47 [0,4194304] 0 2024-09-13T22:08:57.813 INFO:tasks.workunit.client.1.smithi159.stdout:4/361: mkdir d13/d15/d26/d51/d65/d6d 0 2024-09-13T22:08:57.813 INFO:tasks.workunit.client.1.smithi159.stdout:4/362: creat d13/d15/d5a/f6e x:0 0 0 2024-09-13T22:08:57.813 INFO:tasks.workunit.client.1.smithi159.stdout:4/363: chown d13/d15/f16 11784172 1 2024-09-13T22:08:57.814 INFO:tasks.workunit.client.1.smithi159.stdout:7/294: getdents d3/d4b 0 2024-09-13T22:08:57.814 INFO:tasks.workunit.client.1.smithi159.stdout:7/295: readlink d3/d4b/l4c 0 2024-09-13T22:08:57.817 INFO:tasks.workunit.client.1.smithi159.stdout:2/179: link d9/da/f26 d9/f3d 0 2024-09-13T22:08:57.817 INFO:tasks.workunit.client.1.smithi159.stdout:2/180: readlink d9/da/d25/l30 0 2024-09-13T22:08:57.817 INFO:tasks.workunit.client.1.smithi159.stdout:2/181: chown d9/da/d25/f2f 255714 1 2024-09-13T22:08:57.817 INFO:tasks.workunit.client.1.smithi159.stdout:2/182: stat d9/da/f24 0 2024-09-13T22:08:57.817 INFO:tasks.workunit.client.1.smithi159.stdout:2/183: dread - d9/da/f26 zero size 2024-09-13T22:08:57.818 INFO:tasks.workunit.client.1.smithi159.stdout:6/237: dwrite d3/da/d29/f2d [0,4194304] 0 2024-09-13T22:08:57.818 INFO:tasks.workunit.client.1.smithi159.stdout:6/238: write d3/d2a/d3c/f3d [820417,97081] 0 2024-09-13T22:08:57.818 INFO:tasks.workunit.client.1.smithi159.stdout:6/239: creat d3/da/d29/f47 x:0 0 0 2024-09-13T22:08:57.818 INFO:tasks.workunit.client.1.smithi159.stdout:6/240: creat d3/d2a/d3c/f48 x:0 0 0 2024-09-13T22:08:57.818 INFO:tasks.workunit.client.1.smithi159.stdout:8/378: dwrite f7 [4194304,4194304] 0 2024-09-13T22:08:57.818 INFO:tasks.workunit.client.1.smithi159.stdout:1/343: dwrite dd/d11/d18/f2b [0,4194304] 0 2024-09-13T22:08:57.818 INFO:tasks.workunit.client.1.smithi159.stdout:1/344: dread - dd/d11/d34/d53/f6e zero size 2024-09-13T22:08:57.819 INFO:tasks.workunit.client.1.smithi159.stdout:1/345: truncate dd/d11/d18/d2e/f4e 418644 0 2024-09-13T22:08:57.820 INFO:tasks.workunit.client.1.smithi159.stdout:4/364: getdents d13/d41/d5d 0 2024-09-13T22:08:57.820 INFO:tasks.workunit.client.1.smithi159.stdout:4/365: dread - d13/d15/d26/f34 zero size 2024-09-13T22:08:57.821 INFO:tasks.workunit.client.1.smithi159.stdout:7/296: mknod d3/d4b/c65 0 2024-09-13T22:08:57.830 INFO:tasks.workunit.client.1.smithi159.stdout:1/346: write dd/f16 [3591750,114756] 0 2024-09-13T22:08:57.830 INFO:tasks.workunit.client.1.smithi159.stdout:2/184: write d9/da/f18 [2542223,45097] 0 2024-09-13T22:08:57.830 INFO:tasks.workunit.client.1.smithi159.stdout:1/347: creat dd/d11/d21/f6f x:0 0 0 2024-09-13T22:08:57.833 INFO:tasks.workunit.client.1.smithi159.stdout:6/241: rename d3/cd to d3/d2a/d3c/d46/c49 0 2024-09-13T22:08:57.834 INFO:tasks.workunit.client.1.smithi159.stdout:2/185: dread f5 [0,4194304] 0 2024-09-13T22:08:57.836 INFO:tasks.workunit.client.1.smithi159.stdout:5/293: dwrite d1/d11/d64/d35/f56 [4194304,4194304] 0 2024-09-13T22:08:57.836 INFO:tasks.workunit.client.1.smithi159.stdout:5/294: write d1/d11/f37 [1790885,27011] 0 2024-09-13T22:08:57.837 INFO:tasks.workunit.client.1.smithi159.stdout:8/379: mkdir da/d5d/d70 0 2024-09-13T22:08:57.837 INFO:tasks.workunit.client.1.smithi159.stdout:1/348: dread dd/d1e/d58/d5f/f60 [0,4194304] 0 2024-09-13T22:08:57.839 INFO:tasks.workunit.client.1.smithi159.stdout:1/349: read dd/d11/f40 [833317,45805] 0 2024-09-13T22:08:57.839 INFO:tasks.workunit.client.1.smithi159.stdout:1/350: chown dd/d11/d18/d49/c38 7 1 2024-09-13T22:08:57.840 INFO:tasks.workunit.client.1.smithi159.stdout:1/351: truncate dd/d11/f4f 544493 0 2024-09-13T22:08:57.840 INFO:tasks.workunit.client.1.smithi159.stdout:1/352: readlink dd/l2f 0 2024-09-13T22:08:57.840 INFO:tasks.workunit.client.1.smithi159.stdout:1/353: creat dd/d11/d34/d53/f70 x:0 0 0 2024-09-13T22:08:57.843 INFO:tasks.workunit.client.1.smithi159.stdout:4/366: symlink d13/d15/d26/d29/l6f 0 2024-09-13T22:08:57.843 INFO:tasks.workunit.client.1.smithi159.stdout:4/367: readlink d13/d41/l4f 0 2024-09-13T22:08:57.843 INFO:tasks.workunit.client.1.smithi159.stdout:4/368: stat d13/l31 0 2024-09-13T22:08:57.844 INFO:tasks.workunit.client.1.smithi159.stdout:6/242: stat d3/da/d29/d1a/l22 0 2024-09-13T22:08:57.848 INFO:tasks.workunit.client.1.smithi159.stdout:8/380: rename da/d22/d2a/d39/d3e/l68 to da/d22/d2a/d39/l71 0 2024-09-13T22:08:57.851 INFO:tasks.workunit.client.1.smithi159.stdout:4/369: creat d13/d15/d26/d51/d65/f70 x:0 0 0 2024-09-13T22:08:57.853 INFO:tasks.workunit.client.1.smithi159.stdout:6/243: mknod d3/da/d29/d1a/d3e/c4a 0 2024-09-13T22:08:57.853 INFO:tasks.workunit.client.1.smithi159.stdout:6/244: dread - d3/d2a/d3c/f48 zero size 2024-09-13T22:08:57.853 INFO:tasks.workunit.client.1.smithi159.stdout:1/354: read dd/d11/d18/d49/d2d/f5d [4165661,44560] 0 2024-09-13T22:08:57.853 INFO:tasks.workunit.client.1.smithi159.stdout:1/355: chown dd/d11/d18/d2e/l35 63 1 2024-09-13T22:08:57.853 INFO:tasks.workunit.client.1.smithi159.stdout:1/356: stat dd/d11/d34/c47 0 2024-09-13T22:08:57.853 INFO:tasks.workunit.client.1.smithi159.stdout:4/370: mknod d13/d15/d26/d51/c71 0 2024-09-13T22:08:57.855 INFO:tasks.workunit.client.1.smithi159.stdout:6/245: creat d3/da/d25/f4b x:0 0 0 2024-09-13T22:08:57.856 INFO:tasks.workunit.client.1.smithi159.stdout:4/371: creat d13/d15/d26/f72 x:0 0 0 2024-09-13T22:08:57.858 INFO:tasks.workunit.client.1.smithi159.stdout:7/297: dwrite d3/d18/f32 [0,4194304] 0 2024-09-13T22:08:57.858 INFO:tasks.workunit.client.1.smithi159.stdout:7/298: creat d3/d31/f66 x:0 0 0 2024-09-13T22:08:57.858 INFO:tasks.workunit.client.1.smithi159.stdout:7/299: creat d3/f67 x:0 0 0 2024-09-13T22:08:57.859 INFO:tasks.workunit.client.1.smithi159.stdout:4/372: rename d13/d20/l4c to d13/d15/d26/d51/l73 0 2024-09-13T22:08:57.860 INFO:tasks.workunit.client.1.smithi159.stdout:6/246: dread d3/f27 [0,4194304] 0 2024-09-13T22:08:57.861 INFO:tasks.workunit.client.1.smithi159.stdout:8/381: write da/d22/f4d [1138,56134] 0 2024-09-13T22:08:57.861 INFO:tasks.workunit.client.1.smithi159.stdout:8/382: read da/d22/d33/f38 [693993,16699] 0 2024-09-13T22:08:57.864 INFO:tasks.workunit.client.1.smithi159.stdout:8/383: dread da/d22/d33/f59 [0,4194304] 0 2024-09-13T22:08:57.864 INFO:tasks.workunit.client.1.smithi159.stdout:8/384: chown da/c61 11 1 2024-09-13T22:08:57.865 INFO:tasks.workunit.client.1.smithi159.stdout:5/295: dwrite d1/d11/d1c/f51 [0,4194304] 0 2024-09-13T22:08:57.866 INFO:tasks.workunit.client.1.smithi159.stdout:2/186: dwrite d9/da/f24 [0,4194304] 0 2024-09-13T22:08:57.868 INFO:tasks.workunit.client.1.smithi159.stdout:4/373: creat d13/f74 x:0 0 0 2024-09-13T22:08:57.869 INFO:tasks.workunit.client.1.smithi159.stdout:8/385: dread da/d36/f41 [0,4194304] 0 2024-09-13T22:08:57.870 INFO:tasks.workunit.client.1.smithi159.stdout:8/386: chown da/d22/f4f 402479669 1 2024-09-13T22:08:57.872 INFO:tasks.workunit.client.1.smithi159.stdout:1/357: read dd/d11/d18/f23 [2299506,997] 0 2024-09-13T22:08:57.872 INFO:tasks.workunit.client.1.smithi159.stdout:1/358: chown dd/d11/d21/c3e 3847889 1 2024-09-13T22:08:57.876 INFO:tasks.workunit.client.1.smithi159.stdout:8/387: creat da/d5d/d70/f72 x:0 0 0 2024-09-13T22:08:57.881 INFO:tasks.workunit.client.1.smithi159.stdout:0/334: write d0/f26 [650242,41517] 0 2024-09-13T22:08:57.881 INFO:tasks.workunit.client.1.smithi159.stdout:0/335: dread - d0/d48/f6c zero size 2024-09-13T22:08:57.881 INFO:tasks.workunit.client.1.smithi159.stdout:0/336: chown d0/d2c 16 1 2024-09-13T22:08:57.881 INFO:tasks.workunit.client.1.smithi159.stdout:0/337: truncate d0/d48/d4f/f5d 400729 0 2024-09-13T22:08:57.881 INFO:tasks.workunit.client.1.smithi159.stdout:0/338: read d0/f52 [55001,103156] 0 2024-09-13T22:08:57.886 INFO:tasks.workunit.client.1.smithi159.stdout:1/359: mknod dd/d11/d18/d49/d2d/c71 0 2024-09-13T22:08:57.888 INFO:tasks.workunit.client.1.smithi159.stdout:0/339: unlink d0/d48/d4f/l18 0 2024-09-13T22:08:57.888 INFO:tasks.workunit.client.1.smithi159.stdout:0/340: chown d0/d5e/lc 4809 1 2024-09-13T22:08:57.889 INFO:tasks.workunit.client.1.smithi159.stdout:6/247: dwrite d3/da/d29/f17 [0,4194304] 0 2024-09-13T22:08:57.896 INFO:tasks.workunit.client.1.smithi159.stdout:7/300: dwrite d3/d18/f1d [0,4194304] 0 2024-09-13T22:08:57.897 INFO:tasks.workunit.client.1.smithi159.stdout:7/301: getdents d3/d18 0 2024-09-13T22:08:57.898 INFO:tasks.workunit.client.1.smithi159.stdout:7/302: mkdir d3/d31/d68 0 2024-09-13T22:08:57.898 INFO:tasks.workunit.client.1.smithi159.stdout:7/303: chown d3/d31/d4d/d4e/f52 549136755 1 2024-09-13T22:08:57.899 INFO:tasks.workunit.client.1.smithi159.stdout:7/304: symlink d3/d3f/l69 0 2024-09-13T22:08:57.902 INFO:tasks.workunit.client.1.smithi159.stdout:6/248: fsync d3/da/d29/f47 0 2024-09-13T22:08:57.903 INFO:tasks.workunit.client.1.smithi159.stdout:6/249: chown d3/c9 11447 1 2024-09-13T22:08:57.905 INFO:tasks.workunit.client.1.smithi159.stdout:6/250: link d3/f35 d3/d2a/d3c/d46/f4c 0 2024-09-13T22:08:57.910 INFO:tasks.workunit.client.1.smithi159.stdout:6/251: dread d3/d2a/d3c/f3d [0,4194304] 0 2024-09-13T22:08:57.910 INFO:tasks.workunit.client.1.smithi159.stdout:6/252: creat d3/da/d29/d26/f4d x:0 0 0 2024-09-13T22:08:57.910 INFO:tasks.workunit.client.1.smithi159.stdout:6/253: fsync d3/da/d29/d1a/f2e 0 2024-09-13T22:08:57.910 INFO:tasks.workunit.client.1.smithi159.stdout:6/254: write d3/da/d25/f41 [19069,83071] 0 2024-09-13T22:08:57.918 INFO:tasks.workunit.client.1.smithi159.stdout:7/305: write d3/d18/f1d [3199957,60042] 0 2024-09-13T22:08:57.918 INFO:tasks.workunit.client.1.smithi159.stdout:7/306: fdatasync d3/f15 0 2024-09-13T22:08:57.922 INFO:tasks.workunit.client.1.smithi159.stdout:5/296: dwrite d1/d11/d64/d35/f56 [4194304,4194304] 0 2024-09-13T22:08:57.922 INFO:tasks.workunit.client.1.smithi159.stdout:5/297: truncate d1/d11/d64/f3f 637353 0 2024-09-13T22:08:57.923 INFO:tasks.workunit.client.1.smithi159.stdout:5/298: creat d1/d11/d64/d17/f68 x:0 0 0 2024-09-13T22:08:57.923 INFO:tasks.workunit.client.1.smithi159.stdout:5/299: dread - d1/d11/f63 zero size 2024-09-13T22:08:57.925 INFO:tasks.workunit.client.1.smithi159.stdout:5/300: rename d1/d15/l19 to d1/d11/d64/d35/d60/l69 0 2024-09-13T22:08:57.925 INFO:tasks.workunit.client.1.smithi159.stdout:5/301: write d1/d11/d50/f62 [882301,90259] 0 2024-09-13T22:08:57.925 INFO:tasks.workunit.client.1.smithi159.stdout:5/302: write d1/d11/f37 [1751611,44332] 0 2024-09-13T22:08:57.926 INFO:tasks.workunit.client.1.smithi159.stdout:5/303: creat d1/d11/d1c/d20/d53/f6a x:0 0 0 2024-09-13T22:08:57.927 INFO:tasks.workunit.client.1.smithi159.stdout:5/304: mknod d1/d11/d64/c6b 0 2024-09-13T22:08:57.928 INFO:tasks.workunit.client.1.smithi159.stdout:5/305: rmdir d1/d11/d64 39 2024-09-13T22:08:57.928 INFO:tasks.workunit.client.1.smithi159.stdout:5/306: stat d1/d11/d1c/d20/d44/l5f 0 2024-09-13T22:08:57.929 INFO:tasks.workunit.client.1.smithi159.stdout:5/307: truncate d1/d11/d1c/d32/f3a 291311 0 2024-09-13T22:08:57.931 INFO:tasks.workunit.client.1.smithi159.stdout:4/374: dwrite d13/f49 [0,4194304] 0 2024-09-13T22:08:57.931 INFO:tasks.workunit.client.1.smithi159.stdout:4/375: dread - d13/d15/d26/d51/d65/f6a zero size 2024-09-13T22:08:57.932 INFO:tasks.workunit.client.1.smithi159.stdout:4/376: mkdir d13/d41/d4d/d75 0 2024-09-13T22:08:57.934 INFO:tasks.workunit.client.1.smithi159.stdout:8/388: dwrite da/d22/d2a/d39/f6e [0,4194304] 0 2024-09-13T22:08:57.934 INFO:tasks.workunit.client.1.smithi159.stdout:8/389: chown da/f15 123 1 2024-09-13T22:08:57.934 INFO:tasks.workunit.client.1.smithi159.stdout:8/390: write da/d22/d4a/f4e [136902,49825] 0 2024-09-13T22:08:57.935 INFO:tasks.workunit.client.1.smithi159.stdout:1/360: dwrite fb [0,4194304] 0 2024-09-13T22:08:57.935 INFO:tasks.workunit.client.1.smithi159.stdout:0/341: dwrite d0/d48/d4f/d2b/f3b [0,4194304] 0 2024-09-13T22:08:57.935 INFO:tasks.workunit.client.1.smithi159.stdout:0/342: chown d0/f26 240529411 1 2024-09-13T22:08:57.937 INFO:tasks.workunit.client.1.smithi159.stdout:6/255: dwrite d3/da/f42 [4194304,4194304] 0 2024-09-13T22:08:57.941 INFO:tasks.workunit.client.1.smithi159.stdout:8/391: link da/l24 da/d36/l73 0 2024-09-13T22:08:57.943 INFO:tasks.workunit.client.1.smithi159.stdout:1/361: mkdir dd/d11/d13/d4b/d72 0 2024-09-13T22:08:57.945 INFO:tasks.workunit.client.1.smithi159.stdout:8/392: write da/f10 [591280,60573] 0 2024-09-13T22:08:57.945 INFO:tasks.workunit.client.1.smithi159.stdout:8/393: chown da/c17 1829925 1 2024-09-13T22:08:57.953 INFO:tasks.workunit.client.1.smithi159.stdout:6/256: write d3/da/d25/f2c [3831612,124593] 0 2024-09-13T22:08:57.953 INFO:tasks.workunit.client.1.smithi159.stdout:5/308: dread d1/d11/d64/d35/f56 [0,4194304] 0 2024-09-13T22:08:57.956 INFO:tasks.workunit.client.1.smithi159.stdout:1/362: mknod dd/d11/c73 0 2024-09-13T22:08:57.959 INFO:tasks.workunit.client.1.smithi159.stdout:6/257: rename d3/d2a/d3c/f3d to d3/da/f4e 0 2024-09-13T22:08:57.961 INFO:tasks.workunit.client.1.smithi159.stdout:5/309: symlink d1/d11/d1c/l6c 0 2024-09-13T22:08:57.961 INFO:tasks.workunit.client.1.smithi159.stdout:1/363: mkdir dd/d11/d18/d74 0 2024-09-13T22:08:57.962 INFO:tasks.workunit.client.1.smithi159.stdout:1/364: readlink dd/d11/d13/l14 0 2024-09-13T22:08:57.962 INFO:tasks.workunit.client.1.smithi159.stdout:1/365: chown dd/d11/d13/d4b/d72 16651812 1 2024-09-13T22:08:57.963 INFO:tasks.workunit.client.1.smithi159.stdout:4/377: dwrite d13/d15/f21 [4194304,4194304] 0 2024-09-13T22:08:57.964 INFO:tasks.workunit.client.1.smithi159.stdout:6/258: link d3/da/d25/f38 d3/d2a/d3c/f4f 0 2024-09-13T22:08:57.965 INFO:tasks.workunit.client.1.smithi159.stdout:1/366: unlink c8 0 2024-09-13T22:08:57.965 INFO:tasks.workunit.client.1.smithi159.stdout:1/367: fsync dd/f1b 0 2024-09-13T22:08:57.969 INFO:tasks.workunit.client.1.smithi159.stdout:1/368: getdents dd/d11/d18/d49/d2d 0 2024-09-13T22:08:57.971 INFO:tasks.workunit.client.1.smithi159.stdout:4/378: getdents d13/d41/d50 0 2024-09-13T22:08:57.971 INFO:tasks.workunit.client.1.smithi159.stdout:4/379: fsync d13/f19 0 2024-09-13T22:08:57.972 INFO:tasks.workunit.client.1.smithi159.stdout:4/380: write d13/d41/d50/f53 [1096878,35802] 0 2024-09-13T22:08:57.973 INFO:tasks.workunit.client.1.smithi159.stdout:8/394: dwrite da/d22/d2a/f5c [0,4194304] 0 2024-09-13T22:08:57.973 INFO:tasks.workunit.client.1.smithi159.stdout:8/395: creat da/d36/d57/f74 x:0 0 0 2024-09-13T22:08:57.974 INFO:tasks.workunit.client.1.smithi159.stdout:1/369: creat dd/d11/d18/d49/d2d/d62/f75 x:0 0 0 2024-09-13T22:08:57.975 INFO:tasks.workunit.client.1.smithi159.stdout:4/381: symlink d13/d15/d26/l76 0 2024-09-13T22:08:57.979 INFO:tasks.workunit.client.1.smithi159.stdout:8/396: unlink da/c37 0 2024-09-13T22:08:57.981 INFO:tasks.workunit.client.1.smithi159.stdout:8/397: creat da/d22/d33/d66/f75 x:0 0 0 2024-09-13T22:08:57.982 INFO:tasks.workunit.client.1.smithi159.stdout:4/382: getdents d13/d15/d26/d29/d3b 0 2024-09-13T22:08:57.986 INFO:tasks.workunit.client.1.smithi159.stdout:4/383: creat d13/d15/d26/d29/d3b/d66/f77 x:0 0 0 2024-09-13T22:08:57.988 INFO:tasks.workunit.client.1.smithi159.stdout:8/398: rmdir da/d22/d2a 39 2024-09-13T22:08:57.988 INFO:tasks.workunit.client.1.smithi159.stdout:8/399: chown l5 6049784 1 2024-09-13T22:08:57.989 INFO:tasks.workunit.client.1.smithi159.stdout:4/384: creat d13/d41/d5d/f78 x:0 0 0 2024-09-13T22:08:57.989 INFO:tasks.workunit.client.1.smithi159.stdout:4/385: read d13/d41/f42 [455533,111647] 0 2024-09-13T22:08:57.990 INFO:tasks.workunit.client.1.smithi159.stdout:8/400: rename da/d22/d26/c32 to da/d22/d33/d49/d6f/c76 0 2024-09-13T22:08:57.991 INFO:tasks.workunit.client.1.smithi159.stdout:4/386: mkdir d13/d41/d79 0 2024-09-13T22:08:57.991 INFO:tasks.workunit.client.1.smithi159.stdout:4/387: chown d13/f74 81222 1 2024-09-13T22:08:57.991 INFO:tasks.workunit.client.1.smithi159.stdout:5/310: dwrite d1/d11/d1c/f51 [0,4194304] 0 2024-09-13T22:08:57.992 INFO:tasks.workunit.client.1.smithi159.stdout:5/311: creat d1/d11/d64/d17/f6d x:0 0 0 2024-09-13T22:08:57.993 INFO:tasks.workunit.client.1.smithi159.stdout:8/401: link da/c2e da/d22/d2a/d39/c77 0 2024-09-13T22:08:57.994 INFO:tasks.workunit.client.1.smithi159.stdout:1/370: dwrite dd/d1e/f61 [0,4194304] 0 2024-09-13T22:08:57.999 INFO:tasks.workunit.client.1.smithi159.stdout:5/312: link d1/d11/d1c/f51 d1/d11/d1c/f6e 0 2024-09-13T22:08:58.000 INFO:tasks.workunit.client.1.smithi159.stdout:5/313: chown d1/d11/d1c/d32/c46 101211 1 2024-09-13T22:08:58.000 INFO:tasks.workunit.client.1.smithi159.stdout:8/402: mknod da/d36/d48/c78 0 2024-09-13T22:08:58.000 INFO:tasks.workunit.client.1.smithi159.stdout:8/403: truncate da/d36/d48/f6d 22489 0 2024-09-13T22:08:58.000 INFO:tasks.workunit.client.1.smithi159.stdout:8/404: fsync da/d22/d26/f5a 0 2024-09-13T22:08:58.000 INFO:tasks.workunit.client.1.smithi159.stdout:8/405: truncate da/d36/d57/f65 631271 0 2024-09-13T22:08:58.004 INFO:tasks.workunit.client.1.smithi159.stdout:1/371: link dd/d11/d18/d49/d2d/f5d dd/d11/d18/d74/f76 0 2024-09-13T22:08:58.004 INFO:tasks.workunit.client.1.smithi159.stdout:1/372: readlink dd/d11/d18/d49/d2d/l46 0 2024-09-13T22:08:58.005 INFO:tasks.workunit.client.1.smithi159.stdout:5/314: mkdir d1/d11/d64/d35/d6f 0 2024-09-13T22:08:58.008 INFO:tasks.workunit.client.1.smithi159.stdout:1/373: rename dd/d11/d13/f6d to dd/d11/d13/d4b/d52/f77 0 2024-09-13T22:08:58.010 INFO:tasks.workunit.client.1.smithi159.stdout:1/374: dread dd/d11/f4f [0,4194304] 0 2024-09-13T22:08:58.010 INFO:tasks.workunit.client.1.smithi159.stdout:5/315: dread d1/d11/d64/d35/f56 [0,4194304] 0 2024-09-13T22:08:58.012 INFO:tasks.workunit.client.1.smithi159.stdout:1/375: mknod dd/d11/d13/c78 0 2024-09-13T22:08:58.012 INFO:tasks.workunit.client.1.smithi159.stdout:1/376: dread - dd/d11/d34/d53/f70 zero size 2024-09-13T22:08:58.012 INFO:tasks.workunit.client.1.smithi159.stdout:1/377: dread - dd/d11/d18/d49/d2d/d62/f75 zero size 2024-09-13T22:08:58.013 INFO:tasks.workunit.client.1.smithi159.stdout:5/316: link d1/d11/d50/f62 d1/d11/d64/d35/d60/f70 0 2024-09-13T22:08:58.013 INFO:tasks.workunit.client.1.smithi159.stdout:5/317: chown d1/d11/d1c/d20/d53/f6a 82 1 2024-09-13T22:08:58.013 INFO:tasks.workunit.client.1.smithi159.stdout:5/318: readlink d1/d11/d64/l5b 0 2024-09-13T22:08:58.013 INFO:tasks.workunit.client.1.smithi159.stdout:5/319: creat d1/d11/f71 x:0 0 0 2024-09-13T22:08:58.014 INFO:tasks.workunit.client.1.smithi159.stdout:1/378: stat dd/d11/c12 0 2024-09-13T22:08:58.014 INFO:tasks.workunit.client.1.smithi159.stdout:1/379: chown dd/d11 30605108 1 2024-09-13T22:08:58.014 INFO:tasks.workunit.client.1.smithi159.stdout:7/307: getdents d3/d3f 0 2024-09-13T22:08:58.025 INFO:tasks.workunit.client.1.smithi159.stdout:6/259: rmdir d3/da/d29/d26 39 2024-09-13T22:08:58.025 INFO:tasks.workunit.client.1.smithi159.stdout:6/260: write d3/d2a/d3c/f48 [1014449,37577] 0 2024-09-13T22:08:58.025 INFO:tasks.workunit.client.1.smithi159.stdout:8/406: dwrite da/d22/d33/d66/f75 [0,4194304] 0 2024-09-13T22:08:58.025 INFO:tasks.workunit.client.1.smithi159.stdout:4/388: dwrite d13/d15/d26/d51/d65/f70 [0,4194304] 0 2024-09-13T22:08:58.027 INFO:tasks.workunit.client.1.smithi159.stdout:6/261: mkdir d3/d2a/d3c/d50 0 2024-09-13T22:08:58.027 INFO:tasks.workunit.client.1.smithi159.stdout:8/407: dread da/d22/d33/f59 [0,4194304] 0 2024-09-13T22:08:58.028 INFO:tasks.workunit.client.1.smithi159.stdout:8/408: creat da/d36/f79 x:0 0 0 2024-09-13T22:08:58.028 INFO:tasks.workunit.client.1.smithi159.stdout:8/409: chown da/d36/d48 814 1 2024-09-13T22:08:58.028 INFO:tasks.workunit.client.1.smithi159.stdout:8/410: chown da/d36/d57/f74 16 1 2024-09-13T22:08:58.028 INFO:tasks.workunit.client.1.smithi159.stdout:8/411: chown da/d22/d2a/d39/c64 1970236 1 2024-09-13T22:08:58.028 INFO:tasks.workunit.client.1.smithi159.stdout:8/412: write da/d36/f3d [193435,25229] 0 2024-09-13T22:08:58.036 INFO:tasks.workunit.client.1.smithi159.stdout:4/389: rename d13/d15/d26/d51/c71 to d13/d41/d5d/c7a 0 2024-09-13T22:08:58.043 INFO:tasks.workunit.client.1.smithi159.stdout:4/390: rename d13/l2c to d13/d20/l7b 0 2024-09-13T22:08:58.046 INFO:tasks.workunit.client.1.smithi159.stdout:5/320: dwrite d1/d11/d1c/d32/f4a [0,4194304] 0 2024-09-13T22:08:58.046 INFO:tasks.workunit.client.1.smithi159.stdout:5/321: creat d1/d15/f72 x:0 0 0 2024-09-13T22:08:58.046 INFO:tasks.workunit.client.1.smithi159.stdout:5/322: read - d1/d11/f4d zero size 2024-09-13T22:08:58.049 INFO:tasks.workunit.client.1.smithi159.stdout:7/308: dwrite d3/f2a [4194304,4194304] 0 2024-09-13T22:08:58.051 INFO:tasks.workunit.client.1.smithi159.stdout:5/323: link d1/fa d1/d11/d64/d35/f73 0 2024-09-13T22:08:58.051 INFO:tasks.workunit.client.1.smithi159.stdout:1/380: dwrite dd/d11/f4f [0,4194304] 0 2024-09-13T22:08:58.051 INFO:tasks.workunit.client.1.smithi159.stdout:1/381: truncate dd/d11/d18/f23 5156595 0 2024-09-13T22:08:58.051 INFO:tasks.workunit.client.1.smithi159.stdout:1/382: creat dd/d11/d13/f79 x:0 0 0 2024-09-13T22:08:58.059 INFO:tasks.workunit.client.1.smithi159.stdout:1/383: symlink dd/d11/d18/l7a 0 2024-09-13T22:08:58.060 INFO:tasks.workunit.client.1.smithi159.stdout:5/324: symlink d1/d49/l74 0 2024-09-13T22:08:58.060 INFO:tasks.workunit.client.1.smithi159.stdout:5/325: write d1/d11/f4d [1033804,2886] 0 2024-09-13T22:08:58.065 INFO:tasks.workunit.client.1.smithi159.stdout:7/309: read d3/d18/f32 [169073,85150] 0 2024-09-13T22:08:58.066 INFO:tasks.workunit.client.1.smithi159.stdout:4/391: fsync d13/d41/d5d/f78 0 2024-09-13T22:08:58.067 INFO:tasks.workunit.client.1.smithi159.stdout:8/413: rmdir da/d22/d26 39 2024-09-13T22:08:58.071 INFO:tasks.workunit.client.1.smithi159.stdout:4/392: rename d13/f5b to d13/d41/d79/f7c 0 2024-09-13T22:08:58.073 INFO:tasks.workunit.client.1.smithi159.stdout:8/414: symlink da/d36/d48/l7a 0 2024-09-13T22:08:58.075 INFO:tasks.workunit.client.1.smithi159.stdout:4/393: symlink d13/d41/d79/l7d 0 2024-09-13T22:08:58.076 INFO:tasks.workunit.client.1.smithi159.stdout:6/262: dwrite d3/da/d25/f2c [0,4194304] 0 2024-09-13T22:08:58.079 INFO:tasks.workunit.client.1.smithi159.stdout:8/415: rename da/f14 to da/d5d/d70/f7b 0 2024-09-13T22:08:58.079 INFO:tasks.workunit.client.1.smithi159.stdout:8/416: creat da/d22/d4a/f7c x:0 0 0 2024-09-13T22:08:58.082 INFO:tasks.workunit.client.1.smithi159.stdout:5/326: dwrite d1/d11/d1c/d32/f3a [0,4194304] 0 2024-09-13T22:08:58.085 INFO:tasks.workunit.client.1.smithi159.stdout:6/263: link d3/da/d29/d26/l2f d3/da/d29/d1a/l51 0 2024-09-13T22:08:58.092 INFO:tasks.workunit.client.1.smithi159.stdout:4/394: dread d13/d15/f3c [0,4194304] 0 2024-09-13T22:08:58.093 INFO:tasks.workunit.client.1.smithi159.stdout:8/417: write da/d36/f40 [2051490,72005] 0 2024-09-13T22:08:58.098 INFO:tasks.workunit.client.1.smithi159.stdout:5/327: dwrite d1/d11/d64/d35/f57 [0,4194304] 0 2024-09-13T22:08:58.098 INFO:tasks.workunit.client.1.smithi159.stdout:5/328: truncate d1/d11/f63 231067 0 2024-09-13T22:08:58.103 INFO:tasks.workunit.client.1.smithi159.stdout:1/384: rmdir dd/d11/d13 39 2024-09-13T22:08:58.106 INFO:tasks.workunit.client.1.smithi159.stdout:6/264: mkdir d3/da/d25/d52 0 2024-09-13T22:08:58.108 INFO:tasks.workunit.client.1.smithi159.stdout:5/329: write d1/d11/d64/d17/f2c [2295271,61442] 0 2024-09-13T22:08:58.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/265: dread d3/d2a/d3c/f48 [0,4194304] 0 2024-09-13T22:08:58.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/266: dread - d3/da/d29/f45 zero size 2024-09-13T22:08:58.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/267: write d3/da/d29/d1a/d3e/f43 [54508,26514] 0 2024-09-13T22:08:58.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/268: fdatasync d3/da/f4e 0 2024-09-13T22:08:58.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/269: getdents d3/d2a/d3c/d50 0 2024-09-13T22:08:58.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/270: readlink d3/da/d29/d1a/l51 0 2024-09-13T22:08:58.110 INFO:tasks.workunit.client.1.smithi159.stdout:4/395: mkdir d13/d41/d7e 0 2024-09-13T22:08:58.112 INFO:tasks.workunit.client.1.smithi159.stdout:6/271: write d3/f23 [3593944,65916] 0 2024-09-13T22:08:58.114 INFO:tasks.workunit.client.1.smithi159.stdout:8/418: creat da/f7d x:0 0 0 2024-09-13T22:08:58.114 INFO:tasks.workunit.client.1.smithi159.stdout:8/419: fdatasync da/f31 0 2024-09-13T22:08:58.114 INFO:tasks.workunit.client.1.smithi159.stdout:8/420: read - da/d36/f79 zero size 2024-09-13T22:08:58.121 INFO:tasks.workunit.client.1.smithi159.stdout:1/385: unlink dd/d1e/f28 0 2024-09-13T22:08:58.121 INFO:tasks.workunit.client.1.smithi159.stdout:1/386: creat dd/d11/d21/f7b x:0 0 0 2024-09-13T22:08:58.122 INFO:tasks.workunit.client.1.smithi159.stdout:4/396: unlink d13/d15/f36 0 2024-09-13T22:08:58.122 INFO:tasks.workunit.client.1.smithi159.stdout:4/397: write d13/d41/d5d/f78 [450732,118599] 0 2024-09-13T22:08:58.125 INFO:tasks.workunit.client.1.smithi159.stdout:6/272: mknod d3/da/d25/d52/c53 0 2024-09-13T22:08:58.126 INFO:tasks.workunit.client.1.smithi159.stdout:8/421: mkdir da/d7e 0 2024-09-13T22:08:58.126 INFO:tasks.workunit.client.1.smithi159.stdout:8/422: truncate da/d36/f79 957231 0 2024-09-13T22:08:58.126 INFO:tasks.workunit.client.1.smithi159.stdout:8/423: write da/d22/d4a/f7c [329170,7195] 0 2024-09-13T22:08:58.126 INFO:tasks.workunit.client.1.smithi159.stdout:8/424: fsync da/f18 0 2024-09-13T22:08:58.126 INFO:tasks.workunit.client.1.smithi159.stdout:8/425: write da/d36/f40 [3349067,116433] 0 2024-09-13T22:08:58.126 INFO:tasks.workunit.client.1.smithi159.stdout:8/426: readlink da/l1b 0 2024-09-13T22:08:58.128 INFO:tasks.workunit.client.1.smithi159.stdout:6/273: dread d3/da/d25/f41 [0,4194304] 0 2024-09-13T22:08:58.128 INFO:tasks.workunit.client.1.smithi159.stdout:6/274: chown d3/d2a/c31 64262 1 2024-09-13T22:08:58.130 INFO:tasks.workunit.client.1.smithi159.stdout:4/398: symlink d13/d15/d26/d29/d3b/d66/d6c/l7f 0 2024-09-13T22:08:58.130 INFO:tasks.workunit.client.1.smithi159.stdout:4/399: fdatasync d13/f19 0 2024-09-13T22:08:58.130 INFO:tasks.workunit.client.1.smithi159.stdout:4/400: readlink d13/d20/l7b 0 2024-09-13T22:08:58.130 INFO:tasks.workunit.client.1.smithi159.stdout:4/401: write d13/d15/d26/d51/f5f [124659,8192] 0 2024-09-13T22:08:58.131 INFO:tasks.workunit.client.1.smithi159.stdout:5/330: dwrite d1/d11/d64/d17/f2c [0,4194304] 0 2024-09-13T22:08:58.131 INFO:tasks.workunit.client.1.smithi159.stdout:5/331: read - d1/d11/d1c/d20/d53/f6a zero size 2024-09-13T22:08:58.132 INFO:tasks.workunit.client.1.smithi159.stdout:5/332: creat d1/d11/f75 x:0 0 0 2024-09-13T22:08:58.132 INFO:tasks.workunit.client.1.smithi159.stdout:5/333: write d1/d11/d64/d17/f68 [360089,104507] 0 2024-09-13T22:08:58.132 INFO:tasks.workunit.client.1.smithi159.stdout:5/334: fdatasync d1/d11/d1c/d20/d53/f6a 0 2024-09-13T22:08:58.132 INFO:tasks.workunit.client.1.smithi159.stdout:5/335: write d1/d11/d64/d35/f40 [479228,115916] 0 2024-09-13T22:08:58.132 INFO:tasks.workunit.client.1.smithi159.stdout:8/427: creat da/d7e/f7f x:0 0 0 2024-09-13T22:08:58.132 INFO:tasks.workunit.client.1.smithi159.stdout:6/275: getdents d3/d2a/d3c/d46 0 2024-09-13T22:08:58.135 INFO:tasks.workunit.client.1.smithi159.stdout:4/402: link d13/d41/f42 d13/d15/d26/d29/f80 0 2024-09-13T22:08:58.135 INFO:tasks.workunit.client.1.smithi159.stdout:4/403: chown d13/d15/d26/l76 597262680 1 2024-09-13T22:08:58.135 INFO:tasks.workunit.client.1.smithi159.stdout:1/387: dread dd/d11/d18/d2e/f43 [0,4194304] 0 2024-09-13T22:08:58.136 INFO:tasks.workunit.client.1.smithi159.stdout:1/388: creat dd/d1e/d58/d5f/f7c x:0 0 0 2024-09-13T22:08:58.136 INFO:tasks.workunit.client.1.smithi159.stdout:1/389: dread - dd/d11/d18/f57 zero size 2024-09-13T22:08:58.141 INFO:tasks.workunit.client.1.smithi159.stdout:5/336: creat d1/f76 x:0 0 0 2024-09-13T22:08:58.141 INFO:tasks.workunit.client.1.smithi159.stdout:5/337: chown d1/d11/d64/f47 320455 1 2024-09-13T22:08:58.141 INFO:tasks.workunit.client.1.smithi159.stdout:5/338: fdatasync d1/d11/d1c/d20/f5a 0 2024-09-13T22:08:58.143 INFO:tasks.workunit.client.1.smithi159.stdout:8/428: creat da/d22/d33/d49/f80 x:0 0 0 2024-09-13T22:08:58.143 INFO:tasks.workunit.client.1.smithi159.stdout:4/404: symlink d13/d41/d4d/d75/l81 0 2024-09-13T22:08:58.144 INFO:tasks.workunit.client.1.smithi159.stdout:4/405: dread - d13/d15/d5a/f69 zero size 2024-09-13T22:08:58.145 INFO:tasks.workunit.client.1.smithi159.stdout:1/390: truncate f7 7869006 0 2024-09-13T22:08:58.145 INFO:tasks.workunit.client.1.smithi159.stdout:8/429: getdents da/d22/d2a/d39 0 2024-09-13T22:08:58.145 INFO:tasks.workunit.client.1.smithi159.stdout:8/430: chown da/d22/d4a/f7c 27533190 1 2024-09-13T22:08:58.145 INFO:tasks.workunit.client.1.smithi159.stdout:8/431: dread - da/d22/d2a/d39/d3e/f51 zero size 2024-09-13T22:08:58.146 INFO:tasks.workunit.client.1.smithi159.stdout:4/406: mkdir d13/d15/d26/d51/d65/d67/d82 0 2024-09-13T22:08:58.148 INFO:tasks.workunit.client.1.smithi159.stdout:1/391: mkdir dd/d11/d18/d49/d2d/d62/d7d 0 2024-09-13T22:08:58.148 INFO:tasks.workunit.client.1.smithi159.stdout:1/392: dread - dd/d11/d18/d49/f5a zero size 2024-09-13T22:08:58.148 INFO:tasks.workunit.client.1.smithi159.stdout:6/276: dwrite d3/da/d29/d1a/f2e [0,4194304] 0 2024-09-13T22:08:58.149 INFO:tasks.workunit.client.1.smithi159.stdout:4/407: mknod d13/d41/d7e/c83 0 2024-09-13T22:08:58.151 INFO:tasks.workunit.client.1.smithi159.stdout:5/339: dread d1/d11/d1c/f6e [0,4194304] 0 2024-09-13T22:08:58.151 INFO:tasks.workunit.client.1.smithi159.stdout:5/340: dread - d1/d11/d64/d17/f4b zero size 2024-09-13T22:08:58.151 INFO:tasks.workunit.client.1.smithi159.stdout:5/341: stat d1/d11/d64/d35/d6f 0 2024-09-13T22:08:58.151 INFO:tasks.workunit.client.1.smithi159.stdout:5/342: chown d1/d11/d64/c34 18660097 1 2024-09-13T22:08:58.152 INFO:tasks.workunit.client.1.smithi159.stdout:8/432: write da/d22/d33/d66/f75 [1459312,68304] 0 2024-09-13T22:08:58.154 INFO:tasks.workunit.client.1.smithi159.stdout:6/277: unlink d3/da/d29/d1a/d3e/l44 0 2024-09-13T22:08:58.155 INFO:tasks.workunit.client.1.smithi159.stdout:4/408: truncate d13/d15/f3c 1887918 0 2024-09-13T22:08:58.156 INFO:tasks.workunit.client.1.smithi159.stdout:5/343: write d1/f8 [5184482,38051] 0 2024-09-13T22:08:58.157 INFO:tasks.workunit.client.1.smithi159.stdout:5/344: write d1/d11/d64/d35/d60/f70 [452827,25871] 0 2024-09-13T22:08:58.159 INFO:tasks.workunit.client.1.smithi159.stdout:8/433: rename f7 to da/d22/f81 0 2024-09-13T22:08:58.159 INFO:tasks.workunit.client.1.smithi159.stdout:8/434: chown da/d22/f34 102546918 1 2024-09-13T22:08:58.170 INFO:tasks.workunit.client.1.smithi159.stdout:5/345: dwrite d1/d11/f1e [4194304,4194304] 0 2024-09-13T22:08:58.170 INFO:tasks.workunit.client.1.smithi159.stdout:5/346: write d1/d11/d64/d17/f4b [825360,102652] 0 2024-09-13T22:08:58.170 INFO:tasks.workunit.client.1.smithi159.stdout:5/347: write d1/fa [9193121,117903] 0 2024-09-13T22:08:58.177 INFO:tasks.workunit.client.1.smithi159.stdout:5/348: symlink d1/d11/d64/d35/d60/l77 0 2024-09-13T22:08:58.177 INFO:tasks.workunit.client.1.smithi159.stdout:5/349: creat d1/d15/f78 x:0 0 0 2024-09-13T22:08:58.177 INFO:tasks.workunit.client.1.smithi159.stdout:5/350: creat d1/d49/f79 x:0 0 0 2024-09-13T22:08:58.180 INFO:tasks.workunit.client.1.smithi159.stdout:6/278: getdents d3/d2a/d3c 0 2024-09-13T22:08:58.180 INFO:tasks.workunit.client.1.smithi159.stdout:6/279: chown d3/da/f10 304656 1 2024-09-13T22:08:58.181 INFO:tasks.workunit.client.1.smithi159.stdout:4/409: rename d13/c28 to d13/d15/d5a/c84 0 2024-09-13T22:08:58.183 INFO:tasks.workunit.client.1.smithi159.stdout:6/280: symlink d3/da/d29/d26/l54 0 2024-09-13T22:08:58.187 INFO:tasks.workunit.client.1.smithi159.stdout:4/410: creat d13/d15/d26/d29/f85 x:0 0 0 2024-09-13T22:08:58.190 INFO:tasks.workunit.client.1.smithi159.stdout:6/281: truncate d3/da/d29/d1a/f2e 1274470 0 2024-09-13T22:08:58.190 INFO:tasks.workunit.client.1.smithi159.stdout:6/282: write d3/d2a/d3c/d46/f4c [1309150,102319] 0 2024-09-13T22:08:58.190 INFO:tasks.workunit.client.1.smithi159.stdout:6/283: creat d3/da/d29/d1a/d3e/f55 x:0 0 0 2024-09-13T22:08:58.193 INFO:tasks.workunit.client.1.smithi159.stdout:8/435: rename da/d22/d33/d49 to da/d7e/d82 0 2024-09-13T22:08:58.195 INFO:tasks.workunit.client.1.smithi159.stdout:4/411: dread d13/f14 [4194304,4194304] 0 2024-09-13T22:08:58.195 INFO:tasks.workunit.client.1.smithi159.stdout:4/412: truncate d13/d15/d5a/f69 730337 0 2024-09-13T22:08:58.196 INFO:tasks.workunit.client.1.smithi159.stdout:6/284: mkdir d3/da/d29/d1a/d3e/d56 0 2024-09-13T22:08:58.198 INFO:tasks.workunit.client.1.smithi159.stdout:4/413: dread d13/f14 [4194304,4194304] 0 2024-09-13T22:08:58.198 INFO:tasks.workunit.client.1.smithi159.stdout:6/285: rename d3/d2a/d3c/f48 to d3/d2a/f57 0 2024-09-13T22:08:58.198 INFO:tasks.workunit.client.1.smithi159.stdout:6/286: chown d3/d2a/d3c/d46 15 1 2024-09-13T22:08:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:4/414: unlink d13/f49 0 2024-09-13T22:08:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:4/415: write d13/f22 [955534,36572] 0 2024-09-13T22:08:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:4/416: write d13/f19 [4013729,119610] 0 2024-09-13T22:08:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:4/417: chown d13/d15/d26/l27 7221311 1 2024-09-13T22:08:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:4/418: getdents d13/d15/d26/d51/d65/d6d 0 2024-09-13T22:08:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:4/419: readlink d13/d15/d26/d29/d3b/l48 0 2024-09-13T22:08:58.202 INFO:tasks.workunit.client.1.smithi159.stdout:8/436: dread da/d22/f27 [0,4194304] 0 2024-09-13T22:08:58.203 INFO:tasks.workunit.client.1.smithi159.stdout:6/287: unlink d3/da/d25/f2c 0 2024-09-13T22:08:58.206 INFO:tasks.workunit.client.1.smithi159.stdout:4/420: mkdir d13/d15/d26/d51/d65/d67/d82/d86 0 2024-09-13T22:08:58.207 INFO:tasks.workunit.client.1.smithi159.stdout:6/288: mknod d3/da/d29/d1a/c58 0 2024-09-13T22:08:58.211 INFO:tasks.workunit.client.1.smithi159.stdout:8/437: write da/d22/f4f [2643992,84104] 0 2024-09-13T22:08:58.211 INFO:tasks.workunit.client.1.smithi159.stdout:4/421: creat d13/d15/d26/d29/d3b/d66/d6c/f87 x:0 0 0 2024-09-13T22:08:58.211 INFO:tasks.workunit.client.1.smithi159.stdout:4/422: write f10 [1613842,15134] 0 2024-09-13T22:08:58.211 INFO:tasks.workunit.client.1.smithi159.stdout:3/227: sync 2024-09-13T22:08:58.211 INFO:tasks.workunit.client.1.smithi159.stdout:9/349: sync 2024-09-13T22:08:58.212 INFO:tasks.workunit.client.1.smithi159.stdout:9/350: chown d1/d9/d2a/d74 125 1 2024-09-13T22:08:58.212 INFO:tasks.workunit.client.1.smithi159.stdout:6/289: unlink d3/da/d29/f2d 0 2024-09-13T22:08:58.212 INFO:tasks.workunit.client.1.smithi159.stdout:6/290: write d3/da/d29/d26/f4d [655642,119891] 0 2024-09-13T22:08:58.215 INFO:tasks.workunit.client.1.smithi159.stdout:4/423: unlink d13/d15/d26/d51/f54 0 2024-09-13T22:08:58.215 INFO:tasks.workunit.client.1.smithi159.stdout:4/424: stat d13/d41/l64 0 2024-09-13T22:08:58.216 INFO:tasks.workunit.client.1.smithi159.stdout:3/228: mknod d0/d1/d3/d5/c4a 0 2024-09-13T22:08:58.218 INFO:tasks.workunit.client.1.smithi159.stdout:6/291: rename d3/f2b to d3/da/d25/d52/f59 0 2024-09-13T22:08:58.220 INFO:tasks.workunit.client.1.smithi159.stdout:4/425: unlink d13/d15/d26/d29/l6f 0 2024-09-13T22:08:58.222 INFO:tasks.workunit.client.1.smithi159.stdout:3/229: symlink d0/l4b 0 2024-09-13T22:08:58.222 INFO:tasks.workunit.client.1.smithi159.stdout:3/230: read d0/d1/d34/f40 [2755595,95868] 0 2024-09-13T22:08:58.222 INFO:tasks.workunit.client.1.smithi159.stdout:3/231: fsync d0/d1/d3/f1c 0 2024-09-13T22:08:58.226 INFO:tasks.workunit.client.1.smithi159.stdout:8/438: read da/d22/f81 [2219771,17605] 0 2024-09-13T22:08:58.226 INFO:tasks.workunit.client.1.smithi159.stdout:8/439: readlink da/d5d/l5e 0 2024-09-13T22:08:58.229 INFO:tasks.workunit.client.1.smithi159.stdout:6/292: mkdir d3/da/d29/d1a/d3e/d5a 0 2024-09-13T22:08:58.230 INFO:tasks.workunit.client.1.smithi159.stdout:8/440: mkdir da/d7e/d82/d83 0 2024-09-13T22:08:58.232 INFO:tasks.workunit.client.1.smithi159.stdout:6/293: unlink d3/c8 0 2024-09-13T22:08:58.234 INFO:tasks.workunit.client.1.smithi159.stdout:6/294: truncate d3/da/d25/f38 174375 0 2024-09-13T22:08:58.234 INFO:tasks.workunit.client.1.smithi159.stdout:6/295: fdatasync d3/da/f42 0 2024-09-13T22:08:58.235 INFO:tasks.workunit.client.1.smithi159.stdout:6/296: link d3/da/f10 d3/da/d25/f5b 0 2024-09-13T22:08:58.237 INFO:tasks.workunit.client.1.smithi159.stdout:6/297: mkdir d3/d2a/d3c/d5c 0 2024-09-13T22:08:58.238 INFO:tasks.workunit.client.1.smithi159.stdout:6/298: mknod d3/d2a/c5d 0 2024-09-13T22:08:58.238 INFO:tasks.workunit.client.1.smithi159.stdout:6/299: fdatasync d3/da/f42 0 2024-09-13T22:08:58.239 INFO:tasks.workunit.client.1.smithi159.stdout:6/300: creat d3/d2a/d3c/d50/f5e x:0 0 0 2024-09-13T22:08:58.239 INFO:tasks.workunit.client.1.smithi159.stdout:6/301: chown d3/c1e 0 1 2024-09-13T22:08:58.239 INFO:tasks.workunit.client.1.smithi159.stdout:6/302: chown d3/da/d29/d26 4 1 2024-09-13T22:08:58.240 INFO:tasks.workunit.client.1.smithi159.stdout:6/303: stat d3/da/d29/d1a/l51 0 2024-09-13T22:08:58.240 INFO:tasks.workunit.client.1.smithi159.stdout:6/304: write d3/da/d29/d26/f37 [472308,93550] 0 2024-09-13T22:08:58.240 INFO:tasks.workunit.client.1.smithi159.stdout:6/305: chown d3/da/d29 1 1 2024-09-13T22:08:58.240 INFO:tasks.workunit.client.1.smithi159.stdout:6/306: write d3/da/d29/f45 [778676,111203] 0 2024-09-13T22:08:58.240 INFO:tasks.workunit.client.1.smithi159.stdout:8/441: write da/d22/d33/d66/f75 [3263690,22735] 0 2024-09-13T22:08:58.240 INFO:tasks.workunit.client.1.smithi159.stdout:8/442: chown f4 71348 1 2024-09-13T22:08:58.240 INFO:tasks.workunit.client.1.smithi159.stdout:9/351: dwrite d1/dc/d10/d6d/d4b/f6c [4194304,4194304] 0 2024-09-13T22:08:58.240 INFO:tasks.workunit.client.1.smithi159.stdout:9/352: fdatasync d1/d9/d1f/f77 0 2024-09-13T22:08:58.241 INFO:tasks.workunit.client.1.smithi159.stdout:4/426: dwrite d13/d15/d26/d29/d3b/f63 [0,4194304] 0 2024-09-13T22:08:58.241 INFO:tasks.workunit.client.1.smithi159.stdout:8/443: mknod da/d7e/d82/c84 0 2024-09-13T22:08:58.243 INFO:tasks.workunit.client.1.smithi159.stdout:4/427: dread d13/d15/d26/d51/d65/f6a [0,4194304] 0 2024-09-13T22:08:58.243 INFO:tasks.workunit.client.1.smithi159.stdout:9/353: truncate d1/f1c 1651070 0 2024-09-13T22:08:58.244 INFO:tasks.workunit.client.1.smithi159.stdout:6/307: getdents d3/da/d29/d1a 0 2024-09-13T22:08:58.245 INFO:tasks.workunit.client.1.smithi159.stdout:6/308: read d3/da/d29/d1a/d3e/f43 [15916,9481] 0 2024-09-13T22:08:58.248 INFO:tasks.workunit.client.1.smithi159.stdout:8/444: mknod da/d36/c85 0 2024-09-13T22:08:58.248 INFO:tasks.workunit.client.1.smithi159.stdout:8/445: write da/d22/d4a/f4e [1034763,57284] 0 2024-09-13T22:08:58.249 INFO:tasks.workunit.client.1.smithi159.stdout:4/428: truncate d13/d41/d50/f53 110034 0 2024-09-13T22:08:58.249 INFO:tasks.workunit.client.1.smithi159.stdout:4/429: fdatasync d13/d15/d26/d51/d65/f6a 0 2024-09-13T22:08:58.250 INFO:tasks.workunit.client.1.smithi159.stdout:6/309: symlink d3/d2a/d3c/d46/l5f 0 2024-09-13T22:08:58.251 INFO:tasks.workunit.client.1.smithi159.stdout:6/310: write d3/d2a/d3c/d50/f5e [186330,72934] 0 2024-09-13T22:08:58.252 INFO:tasks.workunit.client.1.smithi159.stdout:8/446: symlink da/d7e/d82/l86 0 2024-09-13T22:08:58.252 INFO:tasks.workunit.client.1.smithi159.stdout:8/447: chown da/d36/f6a 3365498 1 2024-09-13T22:08:58.252 INFO:tasks.workunit.client.1.smithi159.stdout:8/448: creat da/d5d/d70/f87 x:0 0 0 2024-09-13T22:08:58.252 INFO:tasks.workunit.client.1.smithi159.stdout:8/449: creat da/f88 x:0 0 0 2024-09-13T22:08:58.252 INFO:tasks.workunit.client.1.smithi159.stdout:8/450: creat da/d22/f89 x:0 0 0 2024-09-13T22:08:58.252 INFO:tasks.workunit.client.1.smithi159.stdout:9/354: dread d1/dc/d10/d6d/d2f/f37 [0,4194304] 0 2024-09-13T22:08:58.252 INFO:tasks.workunit.client.1.smithi159.stdout:8/451: write da/d5d/d70/f87 [80957,27558] 0 2024-09-13T22:08:58.252 INFO:tasks.workunit.client.1.smithi159.stdout:9/355: chown d1/dc/l15 6 1 2024-09-13T22:08:58.252 INFO:tasks.workunit.client.1.smithi159.stdout:9/356: chown d1/f53 913 1 2024-09-13T22:08:58.253 INFO:tasks.workunit.client.1.smithi159.stdout:4/430: symlink d13/d41/l88 0 2024-09-13T22:08:58.254 INFO:tasks.workunit.client.1.smithi159.stdout:6/311: rename d3/d2a/d3c/d46/c49 to d3/da/d29/d1a/d3e/d5a/c60 0 2024-09-13T22:08:58.254 INFO:tasks.workunit.client.1.smithi159.stdout:6/312: chown d3/da/d29/d1a/f2e 541635 1 2024-09-13T22:08:58.259 INFO:tasks.workunit.client.1.smithi159.stdout:8/452: creat da/d5d/f8a x:0 0 0 2024-09-13T22:08:58.260 INFO:tasks.workunit.client.1.smithi159.stdout:6/313: write d3/d2a/d3c/f4f [613443,53543] 0 2024-09-13T22:08:58.261 INFO:tasks.workunit.client.1.smithi159.stdout:4/431: dread d13/d15/f25 [0,4194304] 0 2024-09-13T22:08:58.261 INFO:tasks.workunit.client.1.smithi159.stdout:4/432: stat d13/d15/d26/d51/d65/f70 0 2024-09-13T22:08:58.263 INFO:tasks.workunit.client.1.smithi159.stdout:6/314: mknod d3/da/d29/d1a/d3e/d56/c61 0 2024-09-13T22:08:58.263 INFO:tasks.workunit.client.1.smithi159.stdout:6/315: fdatasync d3/da/f10 0 2024-09-13T22:08:58.264 INFO:tasks.workunit.client.1.smithi159.stdout:4/433: creat d13/f89 x:0 0 0 2024-09-13T22:08:58.266 INFO:tasks.workunit.client.1.smithi159.stdout:8/453: dread da/d22/f27 [0,4194304] 0 2024-09-13T22:08:58.268 INFO:tasks.workunit.client.1.smithi159.stdout:6/316: creat d3/da/d29/d1a/f62 x:0 0 0 2024-09-13T22:08:58.268 INFO:tasks.workunit.client.1.smithi159.stdout:6/317: truncate d3/da/f4e 1376422 0 2024-09-13T22:08:58.268 INFO:tasks.workunit.client.1.smithi159.stdout:6/318: chown d3/d2a/f57 44832633 1 2024-09-13T22:08:58.268 INFO:tasks.workunit.client.1.smithi159.stdout:6/319: chown d3/da/d29/f45 16264398 1 2024-09-13T22:08:58.268 INFO:tasks.workunit.client.1.smithi159.stdout:6/320: creat d3/da/d29/f63 x:0 0 0 2024-09-13T22:08:58.268 INFO:tasks.workunit.client.1.smithi159.stdout:6/321: chown d3/da/d25/d52 52358363 1 2024-09-13T22:08:58.270 INFO:tasks.workunit.client.1.smithi159.stdout:9/357: dwrite d1/dc/d10/d6d/d4b/f76 [0,4194304] 0 2024-09-13T22:08:58.270 INFO:tasks.workunit.client.1.smithi159.stdout:8/454: mknod da/d22/d2a/d39/d3e/c8b 0 2024-09-13T22:08:58.270 INFO:tasks.workunit.client.1.smithi159.stdout:8/455: creat da/d22/f8c x:0 0 0 2024-09-13T22:08:58.274 INFO:tasks.workunit.client.1.smithi159.stdout:6/322: mkdir d3/d64 0 2024-09-13T22:08:58.277 INFO:tasks.workunit.client.1.smithi159.stdout:9/358: truncate d1/dc/d10/f3b 839967 0 2024-09-13T22:08:58.277 INFO:tasks.workunit.client.1.smithi159.stdout:4/434: dread d13/d41/d50/f53 [0,4194304] 0 2024-09-13T22:08:58.278 INFO:tasks.workunit.client.1.smithi159.stdout:9/359: write d1/d9/ff [4454297,31040] 0 2024-09-13T22:08:58.279 INFO:tasks.workunit.client.1.smithi159.stdout:6/323: rename d3/da/d25/d52/c53 to d3/da/d29/d26/c65 0 2024-09-13T22:08:58.280 INFO:tasks.workunit.client.1.smithi159.stdout:8/456: dread da/d36/f47 [0,4194304] 0 2024-09-13T22:08:58.281 INFO:tasks.workunit.client.1.smithi159.stdout:9/360: dread d1/d9/f38 [0,4194304] 0 2024-09-13T22:08:58.282 INFO:tasks.workunit.client.1.smithi159.stdout:6/324: symlink d3/da/d25/d52/l66 0 2024-09-13T22:08:58.289 INFO:tasks.workunit.client.1.smithi159.stdout:8/457: dread da/d22/d2a/f5c [0,4194304] 0 2024-09-13T22:08:58.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/435: rmdir d13 39 2024-09-13T22:08:58.296 INFO:tasks.workunit.client.1.smithi159.stdout:9/361: dwrite d1/d9/f38 [0,4194304] 0 2024-09-13T22:08:58.299 INFO:tasks.workunit.client.1.smithi159.stdout:6/325: link d3/d2a/l30 d3/da/d29/d1a/d3e/l67 0 2024-09-13T22:08:58.299 INFO:tasks.workunit.client.1.smithi159.stdout:9/362: write d1/dc/d10/f3b [1125588,98958] 0 2024-09-13T22:08:58.300 INFO:tasks.workunit.client.1.smithi159.stdout:9/363: creat d1/f81 x:0 0 0 2024-09-13T22:08:58.300 INFO:tasks.workunit.client.1.smithi159.stdout:9/364: chown d1/d9/f38 5372 1 2024-09-13T22:08:58.301 INFO:tasks.workunit.client.1.smithi159.stdout:8/458: rename da/d36/f40 to da/d22/d2a/d39/d3e/f8d 0 2024-09-13T22:08:58.314 INFO:tasks.workunit.client.1.smithi159.stdout:4/436: creat d13/d15/d26/d29/d3b/d66/d6c/f8a x:0 0 0 2024-09-13T22:08:58.318 INFO:tasks.workunit.client.1.smithi159.stdout:6/326: rename d3/da/d29/d1a/c58 to d3/d2a/c68 0 2024-09-13T22:08:58.319 INFO:tasks.workunit.client.1.smithi159.stdout:8/459: mkdir da/d5d/d70/d8e 0 2024-09-13T22:08:58.322 INFO:tasks.workunit.client.1.smithi159.stdout:4/437: mkdir d13/d15/d26/d29/d8b 0 2024-09-13T22:08:58.324 INFO:tasks.workunit.client.1.smithi159.stdout:6/327: rename d3/da/d29/d1a/d3e/d56 to d3/da/d25/d69 0 2024-09-13T22:08:58.324 INFO:tasks.workunit.client.1.smithi159.stdout:4/438: dread f11 [0,4194304] 0 2024-09-13T22:08:58.324 INFO:tasks.workunit.client.1.smithi159.stdout:4/439: chown d13/d15/d5a 27818607 1 2024-09-13T22:08:58.324 INFO:tasks.workunit.client.1.smithi159.stdout:4/440: truncate d13/d41/d50/f53 826824 0 2024-09-13T22:08:58.326 INFO:tasks.workunit.client.1.smithi159.stdout:6/328: getdents d3/d2a 0 2024-09-13T22:08:58.328 INFO:tasks.workunit.client.1.smithi159.stdout:8/460: mkdir da/d22/d33/d8f 0 2024-09-13T22:08:58.331 INFO:tasks.workunit.client.1.smithi159.stdout:8/461: rename da/l21 to da/d5d/d70/l90 0 2024-09-13T22:08:58.333 INFO:tasks.workunit.client.1.smithi159.stdout:8/462: symlink da/d22/d33/d66/l91 0 2024-09-13T22:08:58.335 INFO:tasks.workunit.client.1.smithi159.stdout:6/329: dread d3/da/f42 [0,4194304] 0 2024-09-13T22:08:58.335 INFO:tasks.workunit.client.1.smithi159.stdout:6/330: write d3/da/d29/d1a/d3e/f43 [62418,12424] 0 2024-09-13T22:08:58.335 INFO:tasks.workunit.client.1.smithi159.stdout:8/463: symlink da/d7e/l92 0 2024-09-13T22:08:58.345 INFO:tasks.workunit.client.1.smithi159.stdout:6/331: dread d3/da/f16 [0,4194304] 0 2024-09-13T22:08:58.346 INFO:tasks.workunit.client.1.smithi159.stdout:6/332: mkdir d3/da/d29/d1a/d3e/d5a/d6a 0 2024-09-13T22:08:58.347 INFO:tasks.workunit.client.1.smithi159.stdout:6/333: truncate d3/da/d29/d1a/f2e 685831 0 2024-09-13T22:08:58.347 INFO:tasks.workunit.client.1.smithi159.stdout:4/441: dwrite d13/d15/d26/f34 [0,4194304] 0 2024-09-13T22:08:58.348 INFO:tasks.workunit.client.1.smithi159.stdout:6/334: creat d3/da/d29/d1a/d3e/d5a/d6a/f6b x:0 0 0 2024-09-13T22:08:58.348 INFO:tasks.workunit.client.1.smithi159.stdout:6/335: write d3/da/d25/f4b [732814,125379] 0 2024-09-13T22:08:58.348 INFO:tasks.workunit.client.1.smithi159.stdout:6/336: readlink d3/da/d29/d1a/l22 0 2024-09-13T22:08:58.349 INFO:tasks.workunit.client.1.smithi159.stdout:4/442: mkdir d13/d20/d8c 0 2024-09-13T22:08:58.355 INFO:tasks.workunit.client.1.smithi159.stdout:4/443: dread d13/f19 [0,4194304] 0 2024-09-13T22:08:58.355 INFO:tasks.workunit.client.1.smithi159.stdout:4/444: write d13/f19 [599452,51822] 0 2024-09-13T22:08:58.356 INFO:tasks.workunit.client.1.smithi159.stdout:4/445: rmdir d13/d15 39 2024-09-13T22:08:58.357 INFO:tasks.workunit.client.1.smithi159.stdout:4/446: rename d13/d20/l2a to d13/d15/d26/d29/d3b/l8d 0 2024-09-13T22:08:58.358 INFO:tasks.workunit.client.1.smithi159.stdout:8/464: dwrite da/d36/d48/f67 [0,4194304] 0 2024-09-13T22:08:58.358 INFO:tasks.workunit.client.1.smithi159.stdout:8/465: fsync da/d36/f79 0 2024-09-13T22:08:58.358 INFO:tasks.workunit.client.1.smithi159.stdout:4/447: mkdir d13/d15/d26/d29/d3b/d8e 0 2024-09-13T22:08:58.358 INFO:tasks.workunit.client.1.smithi159.stdout:4/448: chown d13/d15/d26/d29/d3b/c44 3681191 1 2024-09-13T22:08:58.358 INFO:tasks.workunit.client.1.smithi159.stdout:8/466: dread da/d36/f79 [0,4194304] 0 2024-09-13T22:08:58.362 INFO:tasks.workunit.client.1.smithi159.stdout:4/449: rmdir d13/d15/d26/d51/d65/d6d 0 2024-09-13T22:08:58.362 INFO:tasks.workunit.client.1.smithi159.stdout:4/450: fdatasync d13/d15/d26/d29/d3b/d66/f77 0 2024-09-13T22:08:58.363 INFO:tasks.workunit.client.1.smithi159.stdout:4/451: rmdir d13/d15/d26/d29 39 2024-09-13T22:08:58.374 INFO:tasks.workunit.client.1.smithi159.stdout:6/337: fsync d3/da/d29/d1a/d3e/d5a/d6a/f6b 0 2024-09-13T22:08:58.377 INFO:tasks.workunit.client.1.smithi159.stdout:6/338: dread d3/d2a/d3c/d46/f4c [0,4194304] 0 2024-09-13T22:08:58.377 INFO:tasks.workunit.client.1.smithi159.stdout:6/339: chown d3/da/d29/d1a/l51 312 1 2024-09-13T22:08:58.377 INFO:tasks.workunit.client.1.smithi159.stdout:6/340: stat d3/da/d29/d1a/d3e/d5a/d6a 0 2024-09-13T22:08:58.379 INFO:tasks.workunit.client.1.smithi159.stdout:6/341: mkdir d3/da/d29/d26/d6c 0 2024-09-13T22:08:58.379 INFO:tasks.workunit.client.1.smithi159.stdout:2/187: sync 2024-09-13T22:08:58.381 INFO:tasks.workunit.client.1.smithi159.stdout:6/342: mkdir d3/d6d 0 2024-09-13T22:08:58.382 INFO:tasks.workunit.client.1.smithi159.stdout:2/188: symlink d9/da/d25/l3e 0 2024-09-13T22:08:58.382 INFO:tasks.workunit.client.1.smithi159.stdout:2/189: symlink d9/da/d25/l3f 0 2024-09-13T22:08:58.383 INFO:tasks.workunit.client.1.smithi159.stdout:2/190: mkdir d9/da/d27/d40 0 2024-09-13T22:08:58.384 INFO:tasks.workunit.client.1.smithi159.stdout:2/191: mkdir d9/d2d/d41 0 2024-09-13T22:08:58.384 INFO:tasks.workunit.client.1.smithi159.stdout:2/192: write d9/da/f2a [556684,69640] 0 2024-09-13T22:08:58.385 INFO:tasks.workunit.client.1.smithi159.stdout:2/193: creat d9/da/d27/d40/f42 x:0 0 0 2024-09-13T22:08:58.385 INFO:tasks.workunit.client.1.smithi159.stdout:2/194: rmdir d9/d2d/d41 0 2024-09-13T22:08:58.386 INFO:tasks.workunit.client.1.smithi159.stdout:2/195: fdatasync d9/da/f14 0 2024-09-13T22:08:58.386 INFO:tasks.workunit.client.1.smithi159.stdout:2/196: write d9/da/f2a [864874,19820] 0 2024-09-13T22:08:58.389 INFO:tasks.workunit.client.1.smithi159.stdout:8/467: dwrite da/f15 [0,4194304] 0 2024-09-13T22:08:58.389 INFO:tasks.workunit.client.1.smithi159.stdout:8/468: chown da/d7e/d82 15177170 1 2024-09-13T22:08:58.389 INFO:tasks.workunit.client.1.smithi159.stdout:8/469: creat da/d36/d57/f93 x:0 0 0 2024-09-13T22:08:58.389 INFO:tasks.workunit.client.1.smithi159.stdout:4/452: dwrite d13/d15/d26/f33 [0,4194304] 0 2024-09-13T22:08:58.401 INFO:tasks.workunit.client.1.smithi159.stdout:8/470: mknod da/d22/d2a/d39/c94 0 2024-09-13T22:08:58.401 INFO:tasks.workunit.client.1.smithi159.stdout:8/471: creat da/d36/d57/f95 x:0 0 0 2024-09-13T22:08:58.401 INFO:tasks.workunit.client.1.smithi159.stdout:8/472: readlink da/d22/d26/l63 0 2024-09-13T22:08:58.401 INFO:tasks.workunit.client.1.smithi159.stdout:8/473: fdatasync da/d22/d33/f38 0 2024-09-13T22:08:58.401 INFO:tasks.workunit.client.1.smithi159.stdout:8/474: chown da/d22/d2a 0 1 2024-09-13T22:08:58.402 INFO:tasks.workunit.client.1.smithi159.stdout:2/197: dwrite d9/da/f18 [0,4194304] 0 2024-09-13T22:08:58.402 INFO:tasks.workunit.client.1.smithi159.stdout:2/198: readlink d9/da/l19 0 2024-09-13T22:08:58.402 INFO:tasks.workunit.client.1.smithi159.stdout:2/199: chown d9/f3d 2937423 1 2024-09-13T22:08:58.402 INFO:tasks.workunit.client.1.smithi159.stdout:4/453: rmdir d13/d15/d26/d51/d65/d67/d82/d86 0 2024-09-13T22:08:58.406 INFO:tasks.workunit.client.1.smithi159.stdout:8/475: rmdir da/d22/d26 39 2024-09-13T22:08:58.406 INFO:tasks.workunit.client.1.smithi159.stdout:8/476: dread - da/f7d zero size 2024-09-13T22:08:58.406 INFO:tasks.workunit.client.1.smithi159.stdout:8/477: stat da/d7e/d82/f80 0 2024-09-13T22:08:58.408 INFO:tasks.workunit.client.1.smithi159.stdout:4/454: mkdir d13/d20/d8f 0 2024-09-13T22:08:58.409 INFO:tasks.workunit.client.1.smithi159.stdout:4/455: write d13/d15/d26/d51/f5f [28715,130916] 0 2024-09-13T22:08:58.409 INFO:tasks.workunit.client.1.smithi159.stdout:4/456: read d13/d15/f17 [1918499,75621] 0 2024-09-13T22:08:58.410 INFO:tasks.workunit.client.1.smithi159.stdout:8/478: symlink da/d22/d26/l96 0 2024-09-13T22:08:58.410 INFO:tasks.workunit.client.1.smithi159.stdout:8/479: chown da/d7e 6 1 2024-09-13T22:08:58.412 INFO:tasks.workunit.client.1.smithi159.stdout:4/457: link d13/d15/d26/d51/d65/f70 d13/d15/d26/d29/f90 0 2024-09-13T22:08:58.414 INFO:tasks.workunit.client.1.smithi159.stdout:8/480: rename da/d36/d48/f6d to da/d22/f97 0 2024-09-13T22:08:58.417 INFO:tasks.workunit.client.1.smithi159.stdout:4/458: rename d13/d15/d26/d29/f85 to d13/d15/d26/d51/d65/f91 0 2024-09-13T22:08:58.419 INFO:tasks.workunit.client.1.smithi159.stdout:2/200: dwrite d9/da/d25/f35 [0,4194304] 0 2024-09-13T22:08:58.419 INFO:tasks.workunit.client.1.smithi159.stdout:2/201: dread - d9/d37/f3a zero size 2024-09-13T22:08:58.419 INFO:tasks.workunit.client.1.smithi159.stdout:4/459: creat d13/d15/d26/d51/d65/d67/f92 x:0 0 0 2024-09-13T22:08:58.420 INFO:tasks.workunit.client.1.smithi159.stdout:8/481: rename da/d22/d33/d66/f75 to da/d22/d33/f98 0 2024-09-13T22:08:58.423 INFO:tasks.workunit.client.1.smithi159.stdout:2/202: mkdir d9/d37/d43 0 2024-09-13T22:08:58.425 INFO:tasks.workunit.client.1.smithi159.stdout:8/482: dread f6 [0,4194304] 0 2024-09-13T22:08:58.425 INFO:tasks.workunit.client.1.smithi159.stdout:4/460: creat d13/d15/d26/f93 x:0 0 0 2024-09-13T22:08:58.427 INFO:tasks.workunit.client.1.smithi159.stdout:8/483: creat da/d22/d2a/d39/d3e/f99 x:0 0 0 2024-09-13T22:08:58.461 INFO:tasks.workunit.client.1.smithi159.stdout:4/461: link d13/d15/d26/d51/d65/f6a d13/d41/d79/f94 0 2024-09-13T22:08:58.466 INFO:tasks.workunit.client.1.smithi159.stdout:8/484: mkdir da/d7e/d82/d6f/d9a 0 2024-09-13T22:08:58.499 INFO:tasks.workunit.client.1.smithi159.stdout:4/462: mknod d13/d15/d26/d29/c95 0 2024-09-13T22:08:58.500 INFO:tasks.workunit.client.1.smithi159.stdout:8/485: creat da/d22/d33/d8f/f9b x:0 0 0 2024-09-13T22:08:58.505 INFO:tasks.workunit.client.1.smithi159.stdout:4/463: unlink d13/d15/d26/d51/d65/f6a 0 2024-09-13T22:08:58.506 INFO:tasks.workunit.client.1.smithi159.stdout:4/464: symlink d13/d20/l96 0 2024-09-13T22:08:58.509 INFO:tasks.workunit.client.1.smithi159.stdout:4/465: rename d13/d15/d26/f93 to d13/d15/d26/d29/d3b/d66/d6c/f97 0 2024-09-13T22:08:58.511 INFO:tasks.workunit.client.1.smithi159.stdout:4/466: truncate d13/d15/d26/f34 1079631 0 2024-09-13T22:08:58.512 INFO:tasks.workunit.client.1.smithi159.stdout:4/467: link cb d13/d15/d26/d29/d3b/d66/d6c/c98 0 2024-09-13T22:08:58.512 INFO:tasks.workunit.client.1.smithi159.stdout:4/468: dread - d13/d15/d26/d29/d3b/d66/d6c/f87 zero size 2024-09-13T22:08:58.520 INFO:tasks.workunit.client.1.smithi159.stdout:8/486: dwrite da/d36/f6a [0,4194304] 0 2024-09-13T22:08:58.523 INFO:tasks.workunit.client.1.smithi159.stdout:8/487: symlink da/d7e/d82/l9c 0 2024-09-13T22:08:58.524 INFO:tasks.workunit.client.1.smithi159.stdout:8/488: unlink da/d22/f89 0 2024-09-13T22:08:58.526 INFO:tasks.workunit.client.1.smithi159.stdout:8/489: rename da/d22/d26/l96 to da/d7e/l9d 0 2024-09-13T22:08:58.526 INFO:tasks.workunit.client.1.smithi159.stdout:8/490: truncate da/d22/d33/f46 5210431 0 2024-09-13T22:08:58.527 INFO:tasks.workunit.client.1.smithi159.stdout:8/491: mkdir da/d36/d48/d9e 0 2024-09-13T22:08:58.528 INFO:tasks.workunit.client.1.smithi159.stdout:4/469: dwrite d13/d15/d26/f61 [0,4194304] 0 2024-09-13T22:08:58.529 INFO:tasks.workunit.client.1.smithi159.stdout:8/492: creat da/d7e/d82/d6f/f9f x:0 0 0 2024-09-13T22:08:58.529 INFO:tasks.workunit.client.1.smithi159.stdout:8/493: stat da/c25 0 2024-09-13T22:08:58.535 INFO:tasks.workunit.client.1.smithi159.stdout:8/494: getdents da/d22/d2a/d39/d3e 0 2024-09-13T22:08:58.544 INFO:tasks.workunit.client.1.smithi159.stdout:4/470: dwrite d13/d15/d26/d29/d3b/d66/d6c/f87 [0,4194304] 0 2024-09-13T22:08:58.548 INFO:tasks.workunit.client.1.smithi159.stdout:4/471: symlink d13/d15/d26/d51/d65/l99 0 2024-09-13T22:08:58.548 INFO:tasks.workunit.client.1.smithi159.stdout:4/472: truncate d13/d15/d26/f72 278834 0 2024-09-13T22:08:58.551 INFO:tasks.workunit.client.1.smithi159.stdout:8/495: dwrite da/d22/d26/f5a [4194304,4194304] 0 2024-09-13T22:08:58.552 INFO:tasks.workunit.client.1.smithi159.stdout:8/496: truncate da/d36/d57/f74 251351 0 2024-09-13T22:08:58.575 INFO:tasks.workunit.client.1.smithi159.stdout:8/497: getdents da/d22 0 2024-09-13T22:08:58.576 INFO:tasks.workunit.client.1.smithi159.stdout:8/498: rmdir da/d22/d2a 39 2024-09-13T22:08:58.576 INFO:tasks.workunit.client.1.smithi159.stdout:8/499: read da/d5d/d70/f7b [291436,117561] 0 2024-09-13T22:08:58.577 INFO:tasks.workunit.client.1.smithi159.stdout:8/500: mkdir da/da0 0 2024-09-13T22:08:58.577 INFO:tasks.workunit.client.1.smithi159.stdout:8/501: write da/d22/d2a/d39/d3e/f8d [2088039,89092] 0 2024-09-13T22:08:58.583 INFO:tasks.workunit.client.1.smithi159.stdout:2/203: mkdir d9/d44 0 2024-09-13T22:08:58.583 INFO:tasks.workunit.client.1.smithi159.stdout:2/204: write d9/da/f2a [1209755,55394] 0 2024-09-13T22:08:58.583 INFO:tasks.workunit.client.1.smithi159.stdout:2/205: creat d9/da/d27/d40/f45 x:0 0 0 2024-09-13T22:08:58.585 INFO:tasks.workunit.client.1.smithi159.stdout:2/206: creat d9/d44/f46 x:0 0 0 2024-09-13T22:08:58.585 INFO:tasks.workunit.client.1.smithi159.stdout:2/207: write d9/f2b [2053021,123634] 0 2024-09-13T22:08:58.586 INFO:tasks.workunit.client.1.smithi159.stdout:2/208: mknod d9/d37/d43/c47 0 2024-09-13T22:08:58.587 INFO:tasks.workunit.client.1.smithi159.stdout:2/209: unlink d9/d2d/l3c 0 2024-09-13T22:08:58.590 INFO:tasks.workunit.client.1.smithi159.stdout:2/210: mkdir d9/d48 0 2024-09-13T22:08:58.594 INFO:tasks.workunit.client.1.smithi159.stdout:2/211: rename d9/da/l19 to d9/da/d27/d40/l49 0 2024-09-13T22:08:58.602 INFO:tasks.workunit.client.1.smithi159.stdout:0/343: sync 2024-09-13T22:08:58.602 INFO:tasks.workunit.client.1.smithi159.stdout:7/310: sync 2024-09-13T22:08:58.603 INFO:tasks.workunit.client.1.smithi159.stdout:7/311: truncate d3/d18/f20 4880188 0 2024-09-13T22:08:58.603 INFO:tasks.workunit.client.1.smithi159.stdout:8/502: dwrite da/d22/f27 [0,4194304] 0 2024-09-13T22:08:58.604 INFO:tasks.workunit.client.1.smithi159.stdout:0/344: creat d0/d48/d4f/d54/f6d x:0 0 0 2024-09-13T22:08:58.604 INFO:tasks.workunit.client.1.smithi159.stdout:0/345: stat d0/d48/d4f/c1f 0 2024-09-13T22:08:58.605 INFO:tasks.workunit.client.1.smithi159.stdout:7/312: mknod d3/d3f/c6a 0 2024-09-13T22:08:58.606 INFO:tasks.workunit.client.1.smithi159.stdout:8/503: mkdir da/d22/d2a/da1 0 2024-09-13T22:08:58.607 INFO:tasks.workunit.client.1.smithi159.stdout:0/346: mkdir d0/d48/d6e 0 2024-09-13T22:08:58.611 INFO:tasks.workunit.client.1.smithi159.stdout:0/347: creat d0/d5e/f6f x:0 0 0 2024-09-13T22:08:58.611 INFO:tasks.workunit.client.1.smithi159.stdout:0/348: creat d0/d48/f70 x:0 0 0 2024-09-13T22:08:58.612 INFO:tasks.workunit.client.1.smithi159.stdout:7/313: symlink d3/d4b/l6b 0 2024-09-13T22:08:58.616 INFO:tasks.workunit.client.1.smithi159.stdout:7/314: unlink d3/f15 0 2024-09-13T22:08:58.619 INFO:tasks.workunit.client.1.smithi159.stdout:7/315: mkdir d3/d31/d4d/d4e/d4f/d6c 0 2024-09-13T22:08:58.634 INFO:tasks.workunit.client.1.smithi159.stdout:2/212: dwrite d9/f2b [4194304,4194304] 0 2024-09-13T22:08:58.636 INFO:tasks.workunit.client.1.smithi159.stdout:8/504: dwrite da/d22/d33/f38 [4194304,4194304] 0 2024-09-13T22:08:58.639 INFO:tasks.workunit.client.1.smithi159.stdout:2/213: dread d9/da/f14 [0,4194304] 0 2024-09-13T22:08:58.640 INFO:tasks.workunit.client.1.smithi159.stdout:0/349: dwrite d0/d5e/f1a [0,4194304] 0 2024-09-13T22:08:58.642 INFO:tasks.workunit.client.1.smithi159.stdout:2/214: rename d9/d37/d43/c47 to d9/d44/c4a 0 2024-09-13T22:08:58.642 INFO:tasks.workunit.client.1.smithi159.stdout:7/316: dwrite d3/d31/d4d/d4e/f52 [0,4194304] 0 2024-09-13T22:08:58.642 INFO:tasks.workunit.client.1.smithi159.stdout:7/317: chown d3/d18/l1b 8281031 1 2024-09-13T22:08:58.643 INFO:tasks.workunit.client.1.smithi159.stdout:8/505: symlink da/d22/d33/la2 0 2024-09-13T22:08:58.643 INFO:tasks.workunit.client.1.smithi159.stdout:8/506: write da/d22/d2a/d39/d3e/f8d [1409574,107517] 0 2024-09-13T22:08:58.643 INFO:tasks.workunit.client.1.smithi159.stdout:0/350: dread d0/f52 [0,4194304] 0 2024-09-13T22:08:58.644 INFO:tasks.workunit.client.1.smithi159.stdout:2/215: mknod d9/d2d/c4b 0 2024-09-13T22:08:58.644 INFO:tasks.workunit.client.1.smithi159.stdout:2/216: write d9/da/d27/d40/f42 [807874,81359] 0 2024-09-13T22:08:58.646 INFO:tasks.workunit.client.1.smithi159.stdout:7/318: dread d3/f34 [0,4194304] 0 2024-09-13T22:08:58.648 INFO:tasks.workunit.client.1.smithi159.stdout:7/319: unlink d3/d4b/l6b 0 2024-09-13T22:08:58.649 INFO:tasks.workunit.client.1.smithi159.stdout:7/320: truncate d3/d18/f40 5183723 0 2024-09-13T22:08:58.652 INFO:tasks.workunit.client.1.smithi159.stdout:7/321: rename d3/f67 to d3/d4b/f6d 0 2024-09-13T22:08:58.652 INFO:tasks.workunit.client.1.smithi159.stdout:7/322: stat d3/ff 0 2024-09-13T22:08:58.652 INFO:tasks.workunit.client.1.smithi159.stdout:2/217: dread d9/f38 [0,4194304] 0 2024-09-13T22:08:58.652 INFO:tasks.workunit.client.1.smithi159.stdout:7/323: dread - d3/d4b/d5e/f64 zero size 2024-09-13T22:08:58.655 INFO:tasks.workunit.client.1.smithi159.stdout:8/507: dread da/d22/d2a/d39/d3e/f4c [0,4194304] 0 2024-09-13T22:08:58.656 INFO:tasks.workunit.client.1.smithi159.stdout:2/218: symlink d9/d2d/l4c 0 2024-09-13T22:08:58.657 INFO:tasks.workunit.client.1.smithi159.stdout:7/324: mkdir d3/d2e/d6e 0 2024-09-13T22:08:58.657 INFO:tasks.workunit.client.1.smithi159.stdout:7/325: chown d3/d31/l38 744121 1 2024-09-13T22:08:58.662 INFO:tasks.workunit.client.1.smithi159.stdout:2/219: creat d9/da/f4d x:0 0 0 2024-09-13T22:08:58.662 INFO:tasks.workunit.client.1.smithi159.stdout:2/220: creat d9/da/d25/f4e x:0 0 0 2024-09-13T22:08:58.662 INFO:tasks.workunit.client.1.smithi159.stdout:2/221: truncate d9/d37/f3a 373044 0 2024-09-13T22:08:58.662 INFO:tasks.workunit.client.1.smithi159.stdout:8/508: getdents da/d22/d26 0 2024-09-13T22:08:58.662 INFO:tasks.workunit.client.1.smithi159.stdout:8/509: truncate da/f88 620715 0 2024-09-13T22:08:58.672 INFO:tasks.workunit.client.1.smithi159.stdout:7/326: dwrite d3/d31/f66 [0,4194304] 0 2024-09-13T22:08:58.688 INFO:tasks.workunit.client.1.smithi159.stdout:7/327: unlink d3/d4b/c65 0 2024-09-13T22:08:58.689 INFO:tasks.workunit.client.1.smithi159.stdout:7/328: dread - d3/d31/d4d/d4e/f51 zero size 2024-09-13T22:08:58.691 INFO:tasks.workunit.client.1.smithi159.stdout:7/329: symlink d3/d2e/l6f 0 2024-09-13T22:08:58.710 INFO:tasks.workunit.client.1.smithi159.stdout:1/393: sync 2024-09-13T22:08:58.710 INFO:tasks.workunit.client.1.smithi159.stdout:5/351: sync 2024-09-13T22:08:58.710 INFO:tasks.workunit.client.1.smithi159.stdout:5/352: stat d1/d11/d50/c65 0 2024-09-13T22:08:58.710 INFO:tasks.workunit.client.1.smithi159.stdout:7/330: dwrite d3/d31/d4d/d4e/f52 [0,4194304] 0 2024-09-13T22:08:58.711 INFO:tasks.workunit.client.1.smithi159.stdout:1/394: link dd/d11/d13/c55 dd/d11/c7e 0 2024-09-13T22:08:58.713 INFO:tasks.workunit.client.1.smithi159.stdout:7/331: link d3/ca d3/d31/d4d/d4e/d4f/c70 0 2024-09-13T22:08:58.720 INFO:tasks.workunit.client.1.smithi159.stdout:1/395: write dd/f1b [1941867,42631] 0 2024-09-13T22:08:58.728 INFO:tasks.workunit.client.1.smithi159.stdout:7/332: rename d3/d18/f3d to d3/d31/d49/f71 0 2024-09-13T22:08:58.810 INFO:tasks.workunit.client.1.smithi159.stdout:1/396: creat dd/d11/d13/f7f x:0 0 0 2024-09-13T22:08:58.812 INFO:tasks.workunit.client.1.smithi159.stdout:7/333: mknod d3/d31/d4d/c72 0 2024-09-13T22:08:58.812 INFO:tasks.workunit.client.1.smithi159.stdout:7/334: dread - d3/d31/d4d/f57 zero size 2024-09-13T22:08:58.813 INFO:tasks.workunit.client.1.smithi159.stdout:1/397: rename dd/d11/d18/d2e/d3c/c3f to dd/c80 0 2024-09-13T22:08:58.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/398: symlink dd/d11/d18/d74/l81 0 2024-09-13T22:08:58.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/399: write dd/d11/d18/d49/d2d/f5d [1034543,118616] 0 2024-09-13T22:08:58.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/400: write dd/d1c/f25 [998059,38534] 0 2024-09-13T22:08:58.816 INFO:tasks.workunit.client.1.smithi159.stdout:7/335: dread d3/d18/f1d [0,4194304] 0 2024-09-13T22:08:58.816 INFO:tasks.workunit.client.1.smithi159.stdout:7/336: readlink d3/l39 0 2024-09-13T22:08:58.827 INFO:tasks.workunit.client.1.smithi159.stdout:1/401: truncate dd/d11/d18/d49/d2d/f5d 2389924 0 2024-09-13T22:08:58.828 INFO:tasks.workunit.client.1.smithi159.stdout:1/402: mkdir dd/d11/d18/d74/d82 0 2024-09-13T22:08:58.828 INFO:tasks.workunit.client.1.smithi159.stdout:1/403: write dd/d1e/d58/d5f/f7c [81593,60337] 0 2024-09-13T22:08:58.844 INFO:tasks.workunit.client.1.smithi159.stdout:3/232: sync 2024-09-13T22:08:58.844 INFO:tasks.workunit.client.1.smithi159.stdout:9/365: sync 2024-09-13T22:08:58.844 INFO:tasks.workunit.client.1.smithi159.stdout:3/233: creat d0/d1/d3/d5/d14/f4c x:0 0 0 2024-09-13T22:08:58.850 INFO:tasks.workunit.client.1.smithi159.stdout:3/234: rename d0/d1/d3/d35 to d0/d1/d3/d4d 0 2024-09-13T22:08:58.850 INFO:tasks.workunit.client.1.smithi159.stdout:3/235: chown d0/d1/d3/d5 16133967 1 2024-09-13T22:08:58.852 INFO:tasks.workunit.client.1.smithi159.stdout:3/236: dread d0/d1/f2a [0,4194304] 0 2024-09-13T22:08:58.854 INFO:tasks.workunit.client.1.smithi159.stdout:3/237: rmdir d0/d1/d3/d5/d44 0 2024-09-13T22:08:58.855 INFO:tasks.workunit.client.1.smithi159.stdout:3/238: mkdir d0/d1/d3/d5/d25/d4e 0 2024-09-13T22:08:58.855 INFO:tasks.workunit.client.1.smithi159.stdout:3/239: dread - d0/d1/d3/d5/d25/d2c/f33 zero size 2024-09-13T22:08:58.856 INFO:tasks.workunit.client.1.smithi159.stdout:3/240: dread d0/d1/d3/d5/f17 [0,4194304] 0 2024-09-13T22:08:58.856 INFO:tasks.workunit.client.1.smithi159.stdout:3/241: write d0/d1/d3/f24 [3402701,16318] 0 2024-09-13T22:08:58.856 INFO:tasks.workunit.client.1.smithi159.stdout:3/242: stat d0/d1/d15/l3c 0 2024-09-13T22:08:58.856 INFO:tasks.workunit.client.1.smithi159.stdout:3/243: truncate d0/d1/f2a 981892 0 2024-09-13T22:08:58.857 INFO:tasks.workunit.client.1.smithi159.stdout:3/244: creat d0/d1/d3/d5/d25/d4e/f4f x:0 0 0 2024-09-13T22:08:58.858 INFO:tasks.workunit.client.1.smithi159.stdout:3/245: symlink d0/d1/l50 0 2024-09-13T22:08:58.859 INFO:tasks.workunit.client.1.smithi159.stdout:3/246: creat d0/d1/d3/d5/d14/d42/d45/f51 x:0 0 0 2024-09-13T22:08:58.860 INFO:tasks.workunit.client.1.smithi159.stdout:3/247: rename d0/d1/d3/d4d/f38 to d0/d1/d3/d5/db/d39/f52 0 2024-09-13T22:08:58.860 INFO:tasks.workunit.client.1.smithi159.stdout:3/248: truncate d0/d1/d3/d5/f17 987800 0 2024-09-13T22:08:58.860 INFO:tasks.workunit.client.1.smithi159.stdout:3/249: write d0/d1/d3/dd/f10 [1723351,64187] 0 2024-09-13T22:08:58.861 INFO:tasks.workunit.client.1.smithi159.stdout:9/366: dwrite d1/dc/d10/d6d/d4b/d7a/f7f [0,4194304] 0 2024-09-13T22:08:58.866 INFO:tasks.workunit.client.1.smithi159.stdout:9/367: symlink d1/dc/d10/d6d/l82 0 2024-09-13T22:08:58.866 INFO:tasks.workunit.client.1.smithi159.stdout:9/368: stat d1/d9/d2a/d74/d7d 0 2024-09-13T22:08:58.868 INFO:tasks.workunit.client.1.smithi159.stdout:9/369: creat d1/dc/d10/d6d/d4b/d7a/f83 x:0 0 0 2024-09-13T22:08:58.870 INFO:tasks.workunit.client.1.smithi159.stdout:9/370: mknod d1/dc/d27/d40/c84 0 2024-09-13T22:08:58.878 INFO:tasks.workunit.client.1.smithi159.stdout:3/250: dwrite d0/d1/f2a [0,4194304] 0 2024-09-13T22:08:58.878 INFO:tasks.workunit.client.1.smithi159.stdout:3/251: readlink d0/l4b 0 2024-09-13T22:08:58.882 INFO:tasks.workunit.client.1.smithi159.stdout:3/252: link d0/d1/d3/f24 d0/d1/d3/d5/d14/d42/d45/f53 0 2024-09-13T22:08:58.882 INFO:tasks.workunit.client.1.smithi159.stdout:3/253: fsync d0/d1/d3/dd/f26 0 2024-09-13T22:08:58.882 INFO:tasks.workunit.client.1.smithi159.stdout:3/254: fdatasync d0/d1/d3/d5/d25/d4e/f4f 0 2024-09-13T22:08:58.886 INFO:tasks.workunit.client.1.smithi159.stdout:9/371: dwrite d1/dc/d27/d40/f5e [0,4194304] 0 2024-09-13T22:08:58.887 INFO:tasks.workunit.client.1.smithi159.stdout:9/372: chown d1/dc/d10/d6d/l46 0 1 2024-09-13T22:08:58.889 INFO:tasks.workunit.client.1.smithi159.stdout:9/373: link d1/dc/f3e d1/d9/d2a/d75/f85 0 2024-09-13T22:08:58.899 INFO:tasks.workunit.client.1.smithi159.stdout:9/374: dread d1/dc/f12 [0,4194304] 0 2024-09-13T22:08:58.899 INFO:tasks.workunit.client.1.smithi159.stdout:9/375: readlink d1/dc/d10/d6d/d2f/l71 0 2024-09-13T22:08:58.899 INFO:tasks.workunit.client.1.smithi159.stdout:9/376: fsync d1/f64 0 2024-09-13T22:08:58.899 INFO:tasks.workunit.client.1.smithi159.stdout:3/255: dwrite d0/d1/f47 [0,4194304] 0 2024-09-13T22:08:58.899 INFO:tasks.workunit.client.1.smithi159.stdout:3/256: write d0/d1/d3/d5/d25/d2c/f2d [4436456,92422] 0 2024-09-13T22:08:58.899 INFO:tasks.workunit.client.1.smithi159.stdout:3/257: truncate d0/d1/d3/d5/d25/d4e/f4f 773417 0 2024-09-13T22:08:58.899 INFO:tasks.workunit.client.1.smithi159.stdout:9/377: getdents d1/d9/d2a/d74 0 2024-09-13T22:08:58.899 INFO:tasks.workunit.client.1.smithi159.stdout:9/378: readlink d1/dc/d10/d6d/l6f 0 2024-09-13T22:08:58.908 INFO:tasks.workunit.client.1.smithi159.stdout:9/379: rename d1/d9/d2a/f4e to d1/dc/d10/d6d/f86 0 2024-09-13T22:08:58.910 INFO:tasks.workunit.client.1.smithi159.stdout:9/380: truncate d1/dc/d10/d6d/d2f/f68 3459721 0 2024-09-13T22:08:58.912 INFO:tasks.workunit.client.1.smithi159.stdout:3/258: dwrite d0/d1/d3/d5/d14/f4c [0,4194304] 0 2024-09-13T22:08:58.913 INFO:tasks.workunit.client.1.smithi159.stdout:3/259: write d0/d1/d3/d5/d25/f27 [336383,71359] 0 2024-09-13T22:08:58.921 INFO:tasks.workunit.client.1.smithi159.stdout:9/381: rename d1/dc/d10/d6d/d4b/d7a to d1/dc/d10/d6d/d87 0 2024-09-13T22:08:58.922 INFO:tasks.workunit.client.1.smithi159.stdout:9/382: truncate d1/dc/d10/d69/f79 237853 0 2024-09-13T22:08:58.929 INFO:tasks.workunit.client.1.smithi159.stdout:3/260: dwrite d0/d1/d34/f3e [0,4194304] 0 2024-09-13T22:08:58.935 INFO:tasks.workunit.client.1.smithi159.stdout:9/383: write d1/dc/d10/d6d/d87/f7f [1155077,112785] 0 2024-09-13T22:08:58.938 INFO:tasks.workunit.client.1.smithi159.stdout:9/384: write d1/f7b [628768,90702] 0 2024-09-13T22:08:58.940 INFO:tasks.workunit.client.1.smithi159.stdout:9/385: symlink d1/dc/d10/d6d/l88 0 2024-09-13T22:08:58.942 INFO:tasks.workunit.client.1.smithi159.stdout:9/386: dread d1/f53 [0,4194304] 0 2024-09-13T22:08:58.942 INFO:tasks.workunit.client.1.smithi159.stdout:9/387: fdatasync d1/dc/d10/f17 0 2024-09-13T22:08:58.950 INFO:tasks.workunit.client.1.smithi159.stdout:9/388: dread d1/fe [0,4194304] 0 2024-09-13T22:08:58.950 INFO:tasks.workunit.client.1.smithi159.stdout:3/261: dwrite d0/d1/d34/f3e [0,4194304] 0 2024-09-13T22:08:58.956 INFO:tasks.workunit.client.1.smithi159.stdout:9/389: creat d1/d9/d2a/d74/d7d/f89 x:0 0 0 2024-09-13T22:08:58.957 INFO:tasks.workunit.client.1.smithi159.stdout:9/390: symlink d1/dc/d10/d6d/d87/l8a 0 2024-09-13T22:08:58.962 INFO:tasks.workunit.client.1.smithi159.stdout:6/343: sync 2024-09-13T22:08:58.962 INFO:tasks.workunit.client.1.smithi159.stdout:4/473: sync 2024-09-13T22:08:58.962 INFO:tasks.workunit.client.1.smithi159.stdout:4/474: write d13/d15/d5a/f69 [127723,11280] 0 2024-09-13T22:08:58.962 INFO:tasks.workunit.client.1.smithi159.stdout:9/391: mkdir d1/dc/d10/d6d/d2f/d8b 0 2024-09-13T22:08:58.965 INFO:tasks.workunit.client.1.smithi159.stdout:4/475: mknod d13/d41/d5d/c9a 0 2024-09-13T22:08:58.966 INFO:tasks.workunit.client.1.smithi159.stdout:9/392: getdents d1 0 2024-09-13T22:08:58.968 INFO:tasks.workunit.client.1.smithi159.stdout:2/222: sync 2024-09-13T22:08:58.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/351: sync 2024-09-13T22:08:58.968 INFO:tasks.workunit.client.1.smithi159.stdout:5/353: sync 2024-09-13T22:08:58.968 INFO:tasks.workunit.client.1.smithi159.stdout:7/337: sync 2024-09-13T22:08:58.968 INFO:tasks.workunit.client.1.smithi159.stdout:8/510: sync 2024-09-13T22:08:58.968 INFO:tasks.workunit.client.1.smithi159.stdout:1/404: sync 2024-09-13T22:08:58.968 INFO:tasks.workunit.client.1.smithi159.stdout:8/511: chown f6 5 1 2024-09-13T22:08:58.968 INFO:tasks.workunit.client.1.smithi159.stdout:9/393: dread d1/dc/f3e [0,4194304] 0 2024-09-13T22:08:58.973 INFO:tasks.workunit.client.1.smithi159.stdout:7/338: rename d3/d31/l5d to d3/d2e/d6e/l73 0 2024-09-13T22:08:58.973 INFO:tasks.workunit.client.1.smithi159.stdout:7/339: write d3/f34 [880477,45670] 0 2024-09-13T22:08:58.973 INFO:tasks.workunit.client.1.smithi159.stdout:7/340: chown d3/d31/d4d/d4e 8 1 2024-09-13T22:08:58.975 INFO:tasks.workunit.client.1.smithi159.stdout:5/354: mknod d1/d11/c7a 0 2024-09-13T22:08:58.975 INFO:tasks.workunit.client.1.smithi159.stdout:5/355: read - d1/d11/f75 zero size 2024-09-13T22:08:58.976 INFO:tasks.workunit.client.1.smithi159.stdout:8/512: truncate da/d22/d33/f46 2334993 0 2024-09-13T22:08:58.980 INFO:tasks.workunit.client.1.smithi159.stdout:9/394: mknod d1/dc/d10/c8c 0 2024-09-13T22:08:58.981 INFO:tasks.workunit.client.1.smithi159.stdout:4/476: mkdir d13/d9b 0 2024-09-13T22:08:58.986 INFO:tasks.workunit.client.1.smithi159.stdout:6/344: dwrite d3/da/d29/d1a/f62 [0,4194304] 0 2024-09-13T22:08:58.987 INFO:tasks.workunit.client.1.smithi159.stdout:2/223: rmdir d9/da 39 2024-09-13T22:08:58.987 INFO:tasks.workunit.client.1.smithi159.stdout:2/224: chown d9/da/d25/c28 4 1 2024-09-13T22:08:58.990 INFO:tasks.workunit.client.1.smithi159.stdout:0/352: dwrite d0/f16 [0,4194304] 0 2024-09-13T22:08:58.990 INFO:tasks.workunit.client.1.smithi159.stdout:0/353: read d0/d48/d4f/d2b/f60 [93728,106856] 0 2024-09-13T22:08:58.990 INFO:tasks.workunit.client.1.smithi159.stdout:7/341: rename d3/d31/d68 to d3/d2e/d6e/d74 0 2024-09-13T22:08:58.993 INFO:tasks.workunit.client.1.smithi159.stdout:5/356: truncate d1/d11/f1e 2664233 0 2024-09-13T22:08:58.994 INFO:tasks.workunit.client.1.smithi159.stdout:8/513: creat da/d36/d48/d9e/fa3 x:0 0 0 2024-09-13T22:08:58.997 INFO:tasks.workunit.client.1.smithi159.stdout:9/395: creat d1/dc/d27/d40/f8d x:0 0 0 2024-09-13T22:08:58.998 INFO:tasks.workunit.client.1.smithi159.stdout:4/477: mknod d13/d41/d7e/c9c 0 2024-09-13T22:08:59.006 INFO:tasks.workunit.client.1.smithi159.stdout:0/354: dwrite d0/d48/f70 [0,4194304] 0 2024-09-13T22:08:59.006 INFO:tasks.workunit.client.1.smithi159.stdout:0/355: write d0/d48/f4d [4721642,124307] 0 2024-09-13T22:08:59.014 INFO:tasks.workunit.client.1.smithi159.stdout:7/342: dwrite d3/d31/d4d/d4e/f51 [0,4194304] 0 2024-09-13T22:08:59.014 INFO:tasks.workunit.client.1.smithi159.stdout:7/343: chown d3/f11 7931 1 2024-09-13T22:08:59.014 INFO:tasks.workunit.client.1.smithi159.stdout:7/344: readlink d3/d31/l38 0 2024-09-13T22:08:59.101 INFO:tasks.workunit.client.1.smithi159.stdout:2/225: rename d9/f29 to d9/d48/f4f 0 2024-09-13T22:08:59.102 INFO:tasks.workunit.client.1.smithi159.stdout:5/357: mkdir d1/d15/d7b 0 2024-09-13T22:08:59.103 INFO:tasks.workunit.client.1.smithi159.stdout:5/358: write d1/d11/d64/d35/f40 [255487,108817] 0 2024-09-13T22:08:59.104 INFO:tasks.workunit.client.1.smithi159.stdout:8/514: creat da/d22/d2a/fa4 x:0 0 0 2024-09-13T22:08:59.104 INFO:tasks.workunit.client.1.smithi159.stdout:8/515: fsync da/d7e/f7f 0 2024-09-13T22:08:59.105 INFO:tasks.workunit.client.1.smithi159.stdout:9/396: mknod d1/dc/d10/d69/c8e 0 2024-09-13T22:08:59.109 INFO:tasks.workunit.client.1.smithi159.stdout:4/478: mknod d13/d41/d4d/d75/c9d 0 2024-09-13T22:08:59.112 INFO:tasks.workunit.client.1.smithi159.stdout:0/356: mkdir d0/d2c/d71 0 2024-09-13T22:08:59.115 INFO:tasks.workunit.client.1.smithi159.stdout:7/345: mknod d3/d3f/c75 0 2024-09-13T22:08:59.116 INFO:tasks.workunit.client.1.smithi159.stdout:2/226: dwrite d9/da/d25/f35 [4194304,4194304] 0 2024-09-13T22:08:59.118 INFO:tasks.workunit.client.1.smithi159.stdout:5/359: mkdir d1/d11/d64/d35/d7c 0 2024-09-13T22:08:59.118 INFO:tasks.workunit.client.1.smithi159.stdout:5/360: fdatasync d1/d11/d64/d35/f4c 0 2024-09-13T22:08:59.121 INFO:tasks.workunit.client.1.smithi159.stdout:8/516: mkdir da/d5d/da5 0 2024-09-13T22:08:59.124 INFO:tasks.workunit.client.1.smithi159.stdout:4/479: creat d13/d15/d26/d29/d3b/d8e/f9e x:0 0 0 2024-09-13T22:08:59.124 INFO:tasks.workunit.client.1.smithi159.stdout:0/357: rmdir d0/d48/d4f 39 2024-09-13T22:08:59.128 INFO:tasks.workunit.client.1.smithi159.stdout:2/227: mknod d9/d48/c50 0 2024-09-13T22:08:59.129 INFO:tasks.workunit.client.1.smithi159.stdout:5/361: mkdir d1/d11/d64/d35/d7c/d7d 0 2024-09-13T22:08:59.129 INFO:tasks.workunit.client.1.smithi159.stdout:5/362: chown d1/d11/d64/d35/d60/l77 192916 1 2024-09-13T22:08:59.129 INFO:tasks.workunit.client.1.smithi159.stdout:5/363: chown d1/d11/l29 32955 1 2024-09-13T22:08:59.129 INFO:tasks.workunit.client.1.smithi159.stdout:5/364: chown d1/d11/d64/f25 826819878 1 2024-09-13T22:08:59.130 INFO:tasks.workunit.client.1.smithi159.stdout:7/346: dwrite d3/d31/d4d/f57 [0,4194304] 0 2024-09-13T22:08:59.131 INFO:tasks.workunit.client.1.smithi159.stdout:8/517: mknod da/d7e/d82/d6f/ca6 0 2024-09-13T22:08:59.132 INFO:tasks.workunit.client.1.smithi159.stdout:9/397: getdents d1/dc/d27/d40 0 2024-09-13T22:08:59.133 INFO:tasks.workunit.client.1.smithi159.stdout:4/480: creat d13/f9f x:0 0 0 2024-09-13T22:08:59.134 INFO:tasks.workunit.client.1.smithi159.stdout:4/481: write d13/f74 [621941,76944] 0 2024-09-13T22:08:59.135 INFO:tasks.workunit.client.1.smithi159.stdout:2/228: truncate d9/f1d 383483 0 2024-09-13T22:08:59.135 INFO:tasks.workunit.client.1.smithi159.stdout:2/229: chown d9/d44/c4a 7352 1 2024-09-13T22:08:59.137 INFO:tasks.workunit.client.1.smithi159.stdout:5/365: rename d1/f8 to d1/d11/d1c/d20/d44/f7e 0 2024-09-13T22:08:59.140 INFO:tasks.workunit.client.1.smithi159.stdout:4/482: creat d13/d15/d26/d51/d65/d67/d82/fa0 x:0 0 0 2024-09-13T22:08:59.143 INFO:tasks.workunit.client.1.smithi159.stdout:9/398: rename d1/dc/d10/d6d/d2f/d57 to d1/dc/d10/d6d/d2f/d8b/d8f 0 2024-09-13T22:08:59.144 INFO:tasks.workunit.client.1.smithi159.stdout:9/399: read d1/dc/f3e [5487,28483] 0 2024-09-13T22:08:59.144 INFO:tasks.workunit.client.1.smithi159.stdout:9/400: fdatasync d1/d5a/f6e 0 2024-09-13T22:08:59.144 INFO:tasks.workunit.client.1.smithi159.stdout:9/401: write d1/d9/d1f/f77 [912647,69084] 0 2024-09-13T22:08:59.144 INFO:tasks.workunit.client.1.smithi159.stdout:9/402: creat d1/dc/d10/d69/f90 x:0 0 0 2024-09-13T22:08:59.145 INFO:tasks.workunit.client.1.smithi159.stdout:0/358: dwrite d0/d5e/f51 [0,4194304] 0 2024-09-13T22:08:59.148 INFO:tasks.workunit.client.1.smithi159.stdout:2/230: rename d9/f2b to d9/d37/f51 0 2024-09-13T22:08:59.152 INFO:tasks.workunit.client.1.smithi159.stdout:5/366: dread d1/d11/d64/f10 [0,4194304] 0 2024-09-13T22:08:59.154 INFO:tasks.workunit.client.1.smithi159.stdout:8/518: dwrite da/d7e/d82/f62 [0,4194304] 0 2024-09-13T22:08:59.155 INFO:tasks.workunit.client.1.smithi159.stdout:8/519: write da/f88 [1020858,82810] 0 2024-09-13T22:08:59.155 INFO:tasks.workunit.client.1.smithi159.stdout:0/359: mkdir d0/d48/d72 0 2024-09-13T22:08:59.155 INFO:tasks.workunit.client.1.smithi159.stdout:2/231: link d9/c21 d9/da/d25/c52 0 2024-09-13T22:08:59.159 INFO:tasks.workunit.client.1.smithi159.stdout:4/483: rename d13/d15/d26/d51/d65/d67/f92 to d13/d15/fa1 0 2024-09-13T22:08:59.161 INFO:tasks.workunit.client.1.smithi159.stdout:8/520: mknod da/d22/d2a/da1/ca7 0 2024-09-13T22:08:59.163 INFO:tasks.workunit.client.1.smithi159.stdout:0/360: creat d0/d48/d72/f73 x:0 0 0 2024-09-13T22:08:59.163 INFO:tasks.workunit.client.1.smithi159.stdout:2/232: creat d9/f53 x:0 0 0 2024-09-13T22:08:59.165 INFO:tasks.workunit.client.1.smithi159.stdout:5/367: write d1/d11/d64/d35/f57 [4080965,21780] 0 2024-09-13T22:08:59.165 INFO:tasks.workunit.client.1.smithi159.stdout:5/368: fsync d1/d11/d64/d35/f73 0 2024-09-13T22:08:59.165 INFO:tasks.workunit.client.1.smithi159.stdout:7/347: dwrite d3/f2a [4194304,4194304] 0 2024-09-13T22:08:59.166 INFO:tasks.workunit.client.1.smithi159.stdout:7/348: creat d3/d31/f76 x:0 0 0 2024-09-13T22:08:59.166 INFO:tasks.workunit.client.1.smithi159.stdout:4/484: unlink d13/d15/d26/d29/d3b/d66/d6c/c98 0 2024-09-13T22:08:59.166 INFO:tasks.workunit.client.1.smithi159.stdout:4/485: creat d13/d15/d26/fa2 x:0 0 0 2024-09-13T22:08:59.166 INFO:tasks.workunit.client.1.smithi159.stdout:4/486: write d13/d15/d26/d29/f80 [3343450,82238] 0 2024-09-13T22:08:59.167 INFO:tasks.workunit.client.1.smithi159.stdout:8/521: symlink da/d22/d2a/da1/la8 0 2024-09-13T22:08:59.170 INFO:tasks.workunit.client.1.smithi159.stdout:7/349: dread d3/fe [0,4194304] 0 2024-09-13T22:08:59.170 INFO:tasks.workunit.client.1.smithi159.stdout:7/350: write d3/f11 [2430843,23940] 0 2024-09-13T22:08:59.170 INFO:tasks.workunit.client.1.smithi159.stdout:9/403: dwrite d1/dc/d10/d69/f80 [0,4194304] 0 2024-09-13T22:08:59.170 INFO:tasks.workunit.client.1.smithi159.stdout:9/404: dread - d1/f81 zero size 2024-09-13T22:08:59.170 INFO:tasks.workunit.client.1.smithi159.stdout:5/369: rmdir d1/d11/d50 39 2024-09-13T22:08:59.172 INFO:tasks.workunit.client.1.smithi159.stdout:9/405: dread d1/f53 [0,4194304] 0 2024-09-13T22:08:59.172 INFO:tasks.workunit.client.1.smithi159.stdout:9/406: creat d1/d9/d2a/f91 x:0 0 0 2024-09-13T22:08:59.172 INFO:tasks.workunit.client.1.smithi159.stdout:9/407: chown d1/dc/l2c 141049 1 2024-09-13T22:08:59.172 INFO:tasks.workunit.client.1.smithi159.stdout:9/408: fdatasync d1/dc/d10/f39 0 2024-09-13T22:08:59.174 INFO:tasks.workunit.client.1.smithi159.stdout:2/233: dread d9/da/f24 [0,4194304] 0 2024-09-13T22:08:59.183 INFO:tasks.workunit.client.1.smithi159.stdout:9/409: read d1/dc/d27/d40/f5e [1165925,70252] 0 2024-09-13T22:08:59.183 INFO:tasks.workunit.client.1.smithi159.stdout:9/410: stat d1/dc/l15 0 2024-09-13T22:08:59.188 INFO:tasks.workunit.client.1.smithi159.stdout:8/522: symlink da/da0/la9 0 2024-09-13T22:08:59.193 INFO:tasks.workunit.client.1.smithi159.stdout:2/234: dwrite f6 [0,4194304] 0 2024-09-13T22:08:59.193 INFO:tasks.workunit.client.1.smithi159.stdout:2/235: chown d9/d2d/c4b 212424 1 2024-09-13T22:08:59.195 INFO:tasks.workunit.client.1.smithi159.stdout:5/370: creat d1/d11/d64/d35/d6f/f7f x:0 0 0 2024-09-13T22:08:59.197 INFO:tasks.workunit.client.1.smithi159.stdout:8/523: creat da/d22/d2a/d39/faa x:0 0 0 2024-09-13T22:08:59.201 INFO:tasks.workunit.client.1.smithi159.stdout:0/361: rename d0/d48/d72 to d0/d48/d4f/d54/d74 0 2024-09-13T22:08:59.201 INFO:tasks.workunit.client.1.smithi159.stdout:0/362: write d0/d5e/f27 [1340226,35518] 0 2024-09-13T22:08:59.201 INFO:tasks.workunit.client.1.smithi159.stdout:0/363: write d0/d5e/f44 [1104706,13317] 0 2024-09-13T22:08:59.202 INFO:tasks.workunit.client.1.smithi159.stdout:2/236: symlink d9/da/l54 0 2024-09-13T22:08:59.204 INFO:tasks.workunit.client.1.smithi159.stdout:5/371: creat d1/d11/d64/d35/d60/f80 x:0 0 0 2024-09-13T22:08:59.206 INFO:tasks.workunit.client.1.smithi159.stdout:7/351: rename d3/d2e/l5b to d3/d31/d49/l77 0 2024-09-13T22:08:59.207 INFO:tasks.workunit.client.1.smithi159.stdout:7/352: dread d3/d31/f33 [0,4194304] 0 2024-09-13T22:08:59.209 INFO:tasks.workunit.client.1.smithi159.stdout:0/364: mkdir d0/d48/d4f/d66/d75 0 2024-09-13T22:08:59.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/237: mkdir d9/d44/d55 0 2024-09-13T22:08:59.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/238: write d9/da/d25/f3b [299004,92813] 0 2024-09-13T22:08:59.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/239: dread - d9/da/d25/f34 zero size 2024-09-13T22:08:59.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/240: dread - d9/da/f26 zero size 2024-09-13T22:08:59.211 INFO:tasks.workunit.client.1.smithi159.stdout:8/524: dwrite da/f88 [0,4194304] 0 2024-09-13T22:08:59.211 INFO:tasks.workunit.client.1.smithi159.stdout:2/241: dread d9/d37/f3a [0,4194304] 0 2024-09-13T22:08:59.211 INFO:tasks.workunit.client.1.smithi159.stdout:2/242: chown d9/da/c1f 12328 1 2024-09-13T22:08:59.213 INFO:tasks.workunit.client.1.smithi159.stdout:9/411: rename d1/dc/d27/d40/f8d to d1/dc/d10/f92 0 2024-09-13T22:08:59.217 INFO:tasks.workunit.client.1.smithi159.stdout:7/353: unlink d3/d3f/l69 0 2024-09-13T22:08:59.217 INFO:tasks.workunit.client.1.smithi159.stdout:7/354: readlink d3/d2e/d6e/l73 0 2024-09-13T22:08:59.218 INFO:tasks.workunit.client.1.smithi159.stdout:0/365: creat d0/d48/d4f/f76 x:0 0 0 2024-09-13T22:08:59.225 INFO:tasks.workunit.client.1.smithi159.stdout:0/366: dread d0/f16 [0,4194304] 0 2024-09-13T22:08:59.227 INFO:tasks.workunit.client.1.smithi159.stdout:7/355: write d3/d31/d4d/d4e/d4f/f58 [3362660,18789] 0 2024-09-13T22:08:59.227 INFO:tasks.workunit.client.1.smithi159.stdout:7/356: stat d3/d31/d49/l60 0 2024-09-13T22:08:59.227 INFO:tasks.workunit.client.1.smithi159.stdout:7/357: fsync d3/d4b/f6d 0 2024-09-13T22:08:59.229 INFO:tasks.workunit.client.1.smithi159.stdout:8/525: rename da/d22/d33/l5b to da/d22/d33/d66/lab 0 2024-09-13T22:08:59.230 INFO:tasks.workunit.client.1.smithi159.stdout:9/412: symlink d1/dc/d10/d6d/d2f/d8b/l93 0 2024-09-13T22:08:59.232 INFO:tasks.workunit.client.1.smithi159.stdout:7/358: write d3/f1e [1346320,98374] 0 2024-09-13T22:08:59.232 INFO:tasks.workunit.client.1.smithi159.stdout:0/367: creat d0/f77 x:0 0 0 2024-09-13T22:08:59.234 INFO:tasks.workunit.client.1.smithi159.stdout:2/243: rename d9/da/f14 to d9/d37/f56 0 2024-09-13T22:08:59.234 INFO:tasks.workunit.client.1.smithi159.stdout:8/526: symlink da/d22/d33/d8f/lac 0 2024-09-13T22:08:59.236 INFO:tasks.workunit.client.1.smithi159.stdout:9/413: symlink d1/dc/d10/d6d/d2f/d8b/l94 0 2024-09-13T22:08:59.236 INFO:tasks.workunit.client.1.smithi159.stdout:9/414: chown d1/f1c 7561 1 2024-09-13T22:08:59.237 INFO:tasks.workunit.client.1.smithi159.stdout:7/359: symlink d3/d31/d4d/d4e/d4f/d6c/l78 0 2024-09-13T22:08:59.238 INFO:tasks.workunit.client.1.smithi159.stdout:2/244: getdents d9/d37/d43 0 2024-09-13T22:08:59.240 INFO:tasks.workunit.client.1.smithi159.stdout:8/527: creat da/da0/fad x:0 0 0 2024-09-13T22:08:59.241 INFO:tasks.workunit.client.1.smithi159.stdout:8/528: stat da/d22/d33/la2 0 2024-09-13T22:08:59.241 INFO:tasks.workunit.client.1.smithi159.stdout:8/529: readlink da/da0/la9 0 2024-09-13T22:08:59.241 INFO:tasks.workunit.client.1.smithi159.stdout:8/530: write da/d22/d2a/fa4 [618488,10311] 0 2024-09-13T22:08:59.242 INFO:tasks.workunit.client.1.smithi159.stdout:2/245: symlink d9/d48/l57 0 2024-09-13T22:08:59.242 INFO:tasks.workunit.client.1.smithi159.stdout:2/246: dread - d9/da/d27/d40/f45 zero size 2024-09-13T22:08:59.244 INFO:tasks.workunit.client.1.smithi159.stdout:8/531: creat da/d22/d26/fae x:0 0 0 2024-09-13T22:08:59.244 INFO:tasks.workunit.client.1.smithi159.stdout:8/532: creat da/d36/d57/faf x:0 0 0 2024-09-13T22:08:59.249 INFO:tasks.workunit.client.1.smithi159.stdout:7/360: dread d3/f11 [0,4194304] 0 2024-09-13T22:08:59.249 INFO:tasks.workunit.client.1.smithi159.stdout:7/361: truncate d3/fe 3479301 0 2024-09-13T22:08:59.250 INFO:tasks.workunit.client.1.smithi159.stdout:7/362: read d3/d2e/f35 [1255568,93931] 0 2024-09-13T22:08:59.251 INFO:tasks.workunit.client.1.smithi159.stdout:7/363: write d3/d18/f54 [360758,13259] 0 2024-09-13T22:08:59.251 INFO:tasks.workunit.client.1.smithi159.stdout:7/364: stat d3/d18/l23 0 2024-09-13T22:08:59.257 INFO:tasks.workunit.client.1.smithi159.stdout:9/415: dwrite d1/d9/d2a/d74/d7d/f89 [0,4194304] 0 2024-09-13T22:08:59.258 INFO:tasks.workunit.client.1.smithi159.stdout:0/368: dwrite d0/d5e/f14 [4194304,4194304] 0 2024-09-13T22:08:59.264 INFO:tasks.workunit.client.1.smithi159.stdout:9/416: creat d1/d9/f95 x:0 0 0 2024-09-13T22:08:59.266 INFO:tasks.workunit.client.1.smithi159.stdout:9/417: dread d1/f53 [0,4194304] 0 2024-09-13T22:08:59.271 INFO:tasks.workunit.client.1.smithi159.stdout:0/369: dread d0/d48/f70 [0,4194304] 0 2024-09-13T22:08:59.272 INFO:tasks.workunit.client.1.smithi159.stdout:0/370: rmdir d0/d48/d6e 0 2024-09-13T22:08:59.274 INFO:tasks.workunit.client.1.smithi159.stdout:0/371: rename d0/d48/l5c to d0/d2c/d71/l78 0 2024-09-13T22:08:59.274 INFO:tasks.workunit.client.1.smithi159.stdout:0/372: readlink d0/d48/d4f/l28 0 2024-09-13T22:08:59.274 INFO:tasks.workunit.client.1.smithi159.stdout:0/373: chown d0/d48/d4f/l28 30 1 2024-09-13T22:08:59.274 INFO:tasks.workunit.client.1.smithi159.stdout:8/533: dwrite da/d22/d2a/d39/faa [0,4194304] 0 2024-09-13T22:08:59.275 INFO:tasks.workunit.client.1.smithi159.stdout:2/247: dwrite d9/da/d25/f4e [0,4194304] 0 2024-09-13T22:08:59.275 INFO:tasks.workunit.client.1.smithi159.stdout:0/374: mknod d0/d48/d4f/d2b/c79 0 2024-09-13T22:08:59.276 INFO:tasks.workunit.client.1.smithi159.stdout:0/375: dread - d0/d48/f6c zero size 2024-09-13T22:08:59.277 INFO:tasks.workunit.client.1.smithi159.stdout:9/418: write d1/dc/d10/d6d/d4b/f6c [1282259,34044] 0 2024-09-13T22:08:59.277 INFO:tasks.workunit.client.1.smithi159.stdout:7/365: dwrite d3/d4b/d5e/f64 [0,4194304] 0 2024-09-13T22:08:59.280 INFO:tasks.workunit.client.1.smithi159.stdout:8/534: rename da/d22/d2a/f5c to da/d5d/d70/d8e/fb0 0 2024-09-13T22:08:59.285 INFO:tasks.workunit.client.1.smithi159.stdout:2/248: symlink d9/d37/l58 0 2024-09-13T22:08:59.286 INFO:tasks.workunit.client.1.smithi159.stdout:0/376: link d0/d2c/f33 d0/d48/d4f/d54/d74/f7a 0 2024-09-13T22:08:59.287 INFO:tasks.workunit.client.1.smithi159.stdout:0/377: creat d0/d48/d4f/f7b x:0 0 0 2024-09-13T22:08:59.287 INFO:tasks.workunit.client.1.smithi159.stdout:0/378: chown d0/d2c/c30 505582 1 2024-09-13T22:08:59.295 INFO:tasks.workunit.client.1.smithi159.stdout:8/535: symlink da/d5d/d70/d8e/lb1 0 2024-09-13T22:08:59.301 INFO:tasks.workunit.client.1.smithi159.stdout:9/419: rmdir d1/d5a 39 2024-09-13T22:08:59.301 INFO:tasks.workunit.client.1.smithi159.stdout:9/420: truncate d1/d9/f95 224387 0 2024-09-13T22:08:59.303 INFO:tasks.workunit.client.1.smithi159.stdout:0/379: dwrite d0/d5e/f1a [4194304,4194304] 0 2024-09-13T22:08:59.303 INFO:tasks.workunit.client.1.smithi159.stdout:0/380: fdatasync d0/d5e/f4b 0 2024-09-13T22:08:59.303 INFO:tasks.workunit.client.1.smithi159.stdout:0/381: stat d0/d48/d4f/d66/c6b 0 2024-09-13T22:08:59.304 INFO:tasks.workunit.client.1.smithi159.stdout:0/382: read - d0/d2c/f65 zero size 2024-09-13T22:08:59.308 INFO:tasks.workunit.client.1.smithi159.stdout:0/383: link d0/d48/d4f/d2b/f3b d0/d48/d4f/d2b/f7c 0 2024-09-13T22:08:59.309 INFO:tasks.workunit.client.1.smithi159.stdout:2/249: rmdir d9/d37/d43 0 2024-09-13T22:08:59.310 INFO:tasks.workunit.client.1.smithi159.stdout:2/250: dread d9/d37/f3a [0,4194304] 0 2024-09-13T22:08:59.310 INFO:tasks.workunit.client.1.smithi159.stdout:0/384: mkdir d0/d48/d7d 0 2024-09-13T22:08:59.311 INFO:tasks.workunit.client.1.smithi159.stdout:7/366: truncate d3/d31/d4d/d4e/d4f/f58 4717093 0 2024-09-13T22:08:59.313 INFO:tasks.workunit.client.1.smithi159.stdout:2/251: getdents d9/da 0 2024-09-13T22:08:59.313 INFO:tasks.workunit.client.1.smithi159.stdout:2/252: truncate d9/da/d25/f2f 848897 0 2024-09-13T22:08:59.314 INFO:tasks.workunit.client.1.smithi159.stdout:0/385: rename d0/d48/f6c to d0/d48/d4f/d54/d74/f7e 0 2024-09-13T22:08:59.315 INFO:tasks.workunit.client.1.smithi159.stdout:7/367: mknod d3/d2e/d6e/c79 0 2024-09-13T22:08:59.316 INFO:tasks.workunit.client.1.smithi159.stdout:0/386: symlink d0/d48/d7d/l7f 0 2024-09-13T22:08:59.317 INFO:tasks.workunit.client.1.smithi159.stdout:3/262: sync 2024-09-13T22:08:59.317 INFO:tasks.workunit.client.1.smithi159.stdout:7/368: mkdir d3/d31/d4d/d4e/d7a 0 2024-09-13T22:08:59.318 INFO:tasks.workunit.client.1.smithi159.stdout:8/536: dwrite f6 [4194304,4194304] 0 2024-09-13T22:08:59.319 INFO:tasks.workunit.client.1.smithi159.stdout:2/253: rename d9/da/d27/l39 to d9/l59 0 2024-09-13T22:08:59.319 INFO:tasks.workunit.client.1.smithi159.stdout:9/421: dwrite d1/dc/f5f [0,4194304] 0 2024-09-13T22:08:59.319 INFO:tasks.workunit.client.1.smithi159.stdout:9/422: write d1/d9/f95 [1263520,67682] 0 2024-09-13T22:08:59.320 INFO:tasks.workunit.client.1.smithi159.stdout:7/369: symlink d3/d2e/d6e/l7b 0 2024-09-13T22:08:59.320 INFO:tasks.workunit.client.1.smithi159.stdout:7/370: chown d3/f11 849 1 2024-09-13T22:08:59.322 INFO:tasks.workunit.client.1.smithi159.stdout:8/537: mkdir da/d7e/db2 0 2024-09-13T22:08:59.322 INFO:tasks.workunit.client.1.smithi159.stdout:8/538: dread - da/d36/d57/f95 zero size 2024-09-13T22:08:59.322 INFO:tasks.workunit.client.1.smithi159.stdout:8/539: read da/d22/d2a/d39/d3e/f4c [162679,124711] 0 2024-09-13T22:08:59.323 INFO:tasks.workunit.client.1.smithi159.stdout:3/263: rename d0/d1/d3/d5/l11 to d0/d1/d3/d5/d25/l54 0 2024-09-13T22:08:59.328 INFO:tasks.workunit.client.1.smithi159.stdout:9/423: link d1/dc/c29 d1/dc/d10/d6d/d2f/d8b/c96 0 2024-09-13T22:08:59.329 INFO:tasks.workunit.client.1.smithi159.stdout:0/387: write d0/d2c/f3c [273495,24232] 0 2024-09-13T22:08:59.332 INFO:tasks.workunit.client.1.smithi159.stdout:7/371: rename d3/fe to d3/d18/f7c 0 2024-09-13T22:08:59.332 INFO:tasks.workunit.client.1.smithi159.stdout:7/372: fsync d3/d2e/f35 0 2024-09-13T22:08:59.332 INFO:tasks.workunit.client.1.smithi159.stdout:3/264: creat d0/d1/d3/d5/f55 x:0 0 0 2024-09-13T22:08:59.334 INFO:tasks.workunit.client.1.smithi159.stdout:0/388: link d0/d2c/f37 d0/d48/d4f/d54/f80 0 2024-09-13T22:08:59.334 INFO:tasks.workunit.client.1.smithi159.stdout:0/389: readlink d0/d5e/l13 0 2024-09-13T22:08:59.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/540: mkdir da/d22/db3 0 2024-09-13T22:08:59.337 INFO:tasks.workunit.client.1.smithi159.stdout:3/265: dread d0/d1/d3/d5/d25/d2c/f2d [0,4194304] 0 2024-09-13T22:08:59.338 INFO:tasks.workunit.client.1.smithi159.stdout:8/541: mknod da/d5d/cb4 0 2024-09-13T22:08:59.340 INFO:tasks.workunit.client.1.smithi159.stdout:3/266: getdents d0/d1/d3 0 2024-09-13T22:08:59.340 INFO:tasks.workunit.client.1.smithi159.stdout:3/267: chown d0/d1/d15 74 1 2024-09-13T22:08:59.342 INFO:tasks.workunit.client.1.smithi159.stdout:8/542: unlink da/d36/l69 0 2024-09-13T22:08:59.342 INFO:tasks.workunit.client.1.smithi159.stdout:8/543: creat da/d36/d48/d9e/fb5 x:0 0 0 2024-09-13T22:08:59.342 INFO:tasks.workunit.client.1.smithi159.stdout:0/390: dread d0/d5e/f1e [0,4194304] 0 2024-09-13T22:08:59.342 INFO:tasks.workunit.client.1.smithi159.stdout:0/391: write d0/d2c/f3c [3478478,113881] 0 2024-09-13T22:08:59.343 INFO:tasks.workunit.client.1.smithi159.stdout:3/268: symlink d0/d1/d3/l56 0 2024-09-13T22:08:59.347 INFO:tasks.workunit.client.1.smithi159.stdout:8/544: creat da/d22/d2a/da1/fb6 x:0 0 0 2024-09-13T22:08:59.347 INFO:tasks.workunit.client.1.smithi159.stdout:8/545: truncate da/d5d/f8a 688971 0 2024-09-13T22:08:59.347 INFO:tasks.workunit.client.1.smithi159.stdout:8/546: dread - da/d22/d2a/d39/d3e/f51 zero size 2024-09-13T22:08:59.348 INFO:tasks.workunit.client.1.smithi159.stdout:3/269: creat d0/f57 x:0 0 0 2024-09-13T22:08:59.349 INFO:tasks.workunit.client.1.smithi159.stdout:8/547: mkdir da/d36/d48/db7 0 2024-09-13T22:08:59.349 INFO:tasks.workunit.client.1.smithi159.stdout:8/548: creat da/fb8 x:0 0 0 2024-09-13T22:08:59.350 INFO:tasks.workunit.client.1.smithi159.stdout:0/392: dread d0/f6a [0,4194304] 0 2024-09-13T22:08:59.351 INFO:tasks.workunit.client.1.smithi159.stdout:0/393: readlink d0/d2c/l4a 0 2024-09-13T22:08:59.351 INFO:tasks.workunit.client.1.smithi159.stdout:0/394: chown d0/d5e/l12 391514 1 2024-09-13T22:08:59.351 INFO:tasks.workunit.client.1.smithi159.stdout:0/395: chown d0/d48/d4f/f7b 21116 1 2024-09-13T22:08:59.351 INFO:tasks.workunit.client.1.smithi159.stdout:0/396: write d0/d48/d4f/f53 [790545,130668] 0 2024-09-13T22:08:59.353 INFO:tasks.workunit.client.1.smithi159.stdout:8/549: truncate da/d22/d2a/d39/d3e/f4c 2234370 0 2024-09-13T22:08:59.355 INFO:tasks.workunit.client.1.smithi159.stdout:9/424: dwrite d1/d9/d2a/f41 [0,4194304] 0 2024-09-13T22:08:59.355 INFO:tasks.workunit.client.1.smithi159.stdout:3/270: write d0/d1/f2 [4091808,72835] 0 2024-09-13T22:08:59.355 INFO:tasks.workunit.client.1.smithi159.stdout:9/425: fsync d1/dc/d10/d6d/d2f/f37 0 2024-09-13T22:08:59.355 INFO:tasks.workunit.client.1.smithi159.stdout:8/550: mkdir da/d22/db3/db9 0 2024-09-13T22:08:59.355 INFO:tasks.workunit.client.1.smithi159.stdout:8/551: fdatasync da/d5d/d70/f72 0 2024-09-13T22:08:59.357 INFO:tasks.workunit.client.1.smithi159.stdout:0/397: dread d0/d48/d4f/f53 [0,4194304] 0 2024-09-13T22:08:59.358 INFO:tasks.workunit.client.1.smithi159.stdout:9/426: dread d1/f7b [0,4194304] 0 2024-09-13T22:08:59.363 INFO:tasks.workunit.client.1.smithi159.stdout:9/427: dread d1/dc/f12 [0,4194304] 0 2024-09-13T22:08:59.363 INFO:tasks.workunit.client.1.smithi159.stdout:9/428: chown d1/d9/d1f/f77 14043326 1 2024-09-13T22:08:59.372 INFO:tasks.workunit.client.1.smithi159.stdout:8/552: rmdir da/d5d/da5 0 2024-09-13T22:08:59.373 INFO:tasks.workunit.client.1.smithi159.stdout:3/271: mkdir d0/d1/d3/d5/db/d58 0 2024-09-13T22:08:59.373 INFO:tasks.workunit.client.1.smithi159.stdout:3/272: chown d0/d1/d3/d5/db/d39/l43 2042701 1 2024-09-13T22:08:59.377 INFO:tasks.workunit.client.1.smithi159.stdout:8/553: rename da/d7e/d82/f62 to da/d22/d33/fba 0 2024-09-13T22:08:59.378 INFO:tasks.workunit.client.1.smithi159.stdout:8/554: write da/d22/f97 [1014519,128146] 0 2024-09-13T22:08:59.378 INFO:tasks.workunit.client.1.smithi159.stdout:8/555: dread - da/d7e/d82/f80 zero size 2024-09-13T22:08:59.380 INFO:tasks.workunit.client.1.smithi159.stdout:8/556: write da/d22/f4f [1859535,97398] 0 2024-09-13T22:08:59.382 INFO:tasks.workunit.client.1.smithi159.stdout:8/557: dread da/d36/f3d [0,4194304] 0 2024-09-13T22:08:59.383 INFO:tasks.workunit.client.1.smithi159.stdout:9/429: dwrite d1/dc/d27/d40/f70 [0,4194304] 0 2024-09-13T22:08:59.383 INFO:tasks.workunit.client.1.smithi159.stdout:9/430: read - d1/d5a/f6e zero size 2024-09-13T22:08:59.383 INFO:tasks.workunit.client.1.smithi159.stdout:9/431: write d1/f1c [125208,113759] 0 2024-09-13T22:08:59.384 INFO:tasks.workunit.client.1.smithi159.stdout:0/398: dwrite d0/d48/d4f/d2b/f7c [0,4194304] 0 2024-09-13T22:08:59.384 INFO:tasks.workunit.client.1.smithi159.stdout:8/558: link da/ce da/d36/cbb 0 2024-09-13T22:08:59.387 INFO:tasks.workunit.client.1.smithi159.stdout:3/273: write d0/d1/f2a [4087599,115835] 0 2024-09-13T22:08:59.391 INFO:tasks.workunit.client.1.smithi159.stdout:9/432: creat d1/dc/d10/d6d/d2f/d8b/f97 x:0 0 0 2024-09-13T22:08:59.391 INFO:tasks.workunit.client.1.smithi159.stdout:9/433: write d1/f81 [874935,338] 0 2024-09-13T22:08:59.394 INFO:tasks.workunit.client.1.smithi159.stdout:9/434: dread d1/dc/d10/d6d/d2f/f37 [0,4194304] 0 2024-09-13T22:08:59.394 INFO:tasks.workunit.client.1.smithi159.stdout:9/435: chown d1/d9/l1b 296 1 2024-09-13T22:08:59.395 INFO:tasks.workunit.client.1.smithi159.stdout:0/399: rename d0/d5e/f4b to d0/d48/d4f/f81 0 2024-09-13T22:08:59.395 INFO:tasks.workunit.client.1.smithi159.stdout:0/400: readlink d0/l21 0 2024-09-13T22:08:59.395 INFO:tasks.workunit.client.1.smithi159.stdout:0/401: write d0/d48/d4f/d54/f6d [514364,111715] 0 2024-09-13T22:08:59.396 INFO:tasks.workunit.client.1.smithi159.stdout:0/402: write d0/f26 [590350,109871] 0 2024-09-13T22:08:59.396 INFO:tasks.workunit.client.1.smithi159.stdout:8/559: mkdir da/d5d/dbc 0 2024-09-13T22:08:59.396 INFO:tasks.workunit.client.1.smithi159.stdout:8/560: read - da/d22/d33/d8f/f9b zero size 2024-09-13T22:08:59.398 INFO:tasks.workunit.client.1.smithi159.stdout:3/274: write d0/d1/d3/dd/f26 [53326,128757] 0 2024-09-13T22:08:59.399 INFO:tasks.workunit.client.1.smithi159.stdout:9/436: mkdir d1/dc/d10/d6d/d4b/d98 0 2024-09-13T22:08:59.400 INFO:tasks.workunit.client.1.smithi159.stdout:0/403: mknod d0/d2c/c82 0 2024-09-13T22:08:59.402 INFO:tasks.workunit.client.1.smithi159.stdout:9/437: mkdir d1/d9/d1f/d99 0 2024-09-13T22:08:59.403 INFO:tasks.workunit.client.1.smithi159.stdout:0/404: symlink d0/d48/d4f/l83 0 2024-09-13T22:08:59.403 INFO:tasks.workunit.client.1.smithi159.stdout:0/405: creat d0/d48/d4f/f84 x:0 0 0 2024-09-13T22:08:59.405 INFO:tasks.workunit.client.1.smithi159.stdout:8/561: read da/d36/d48/f67 [1355572,24106] 0 2024-09-13T22:08:59.406 INFO:tasks.workunit.client.1.smithi159.stdout:8/562: readlink da/d22/d26/l63 0 2024-09-13T22:08:59.406 INFO:tasks.workunit.client.1.smithi159.stdout:8/563: creat da/d7e/d82/d6f/fbd x:0 0 0 2024-09-13T22:08:59.409 INFO:tasks.workunit.client.1.smithi159.stdout:8/564: mknod da/d22/d4a/cbe 0 2024-09-13T22:08:59.421 INFO:tasks.workunit.client.1.smithi159.stdout:8/565: write da/d22/d33/f46 [1492155,111111] 0 2024-09-13T22:08:59.421 INFO:tasks.workunit.client.1.smithi159.stdout:8/566: fsync da/d36/d57/f65 0 2024-09-13T22:08:59.425 INFO:tasks.workunit.client.1.smithi159.stdout:0/406: dwrite d0/d48/d4f/d54/d74/f73 [0,4194304] 0 2024-09-13T22:08:59.425 INFO:tasks.workunit.client.1.smithi159.stdout:3/275: dwrite d0/d1/d34/f41 [0,4194304] 0 2024-09-13T22:08:59.425 INFO:tasks.workunit.client.1.smithi159.stdout:8/567: dread da/f10 [0,4194304] 0 2024-09-13T22:08:59.425 INFO:tasks.workunit.client.1.smithi159.stdout:0/407: creat d0/d48/f85 x:0 0 0 2024-09-13T22:08:59.425 INFO:tasks.workunit.client.1.smithi159.stdout:0/408: fdatasync d0/f52 0 2024-09-13T22:08:59.431 INFO:tasks.workunit.client.1.smithi159.stdout:8/568: mknod da/d36/cbf 0 2024-09-13T22:08:59.432 INFO:tasks.workunit.client.1.smithi159.stdout:9/438: dwrite d1/dc/d10/d6d/d87/f83 [0,4194304] 0 2024-09-13T22:08:59.434 INFO:tasks.workunit.client.1.smithi159.stdout:0/409: creat d0/d2c/d71/f86 x:0 0 0 2024-09-13T22:08:59.434 INFO:tasks.workunit.client.1.smithi159.stdout:0/410: write d0/d2c/f3c [1405063,2148] 0 2024-09-13T22:08:59.434 INFO:tasks.workunit.client.1.smithi159.stdout:3/276: rmdir d0/d1/d3/d5/d25/d2c 39 2024-09-13T22:08:59.438 INFO:tasks.workunit.client.1.smithi159.stdout:3/277: symlink d0/d1/d15/l59 0 2024-09-13T22:08:59.439 INFO:tasks.workunit.client.1.smithi159.stdout:9/439: dread d1/dc/f13 [0,4194304] 0 2024-09-13T22:08:59.441 INFO:tasks.workunit.client.1.smithi159.stdout:0/411: dread d0/f26 [0,4194304] 0 2024-09-13T22:08:59.447 INFO:tasks.workunit.client.1.smithi159.stdout:0/412: write d0/d48/f70 [3240360,23527] 0 2024-09-13T22:08:59.450 INFO:tasks.workunit.client.1.smithi159.stdout:8/569: dwrite da/d22/d26/f5a [4194304,4194304] 0 2024-09-13T22:08:59.450 INFO:tasks.workunit.client.1.smithi159.stdout:8/570: truncate da/d22/d26/fae 753904 0 2024-09-13T22:08:59.450 INFO:tasks.workunit.client.1.smithi159.stdout:8/571: fdatasync da/d36/f47 0 2024-09-13T22:08:59.450 INFO:tasks.workunit.client.1.smithi159.stdout:4/487: sync 2024-09-13T22:08:59.450 INFO:tasks.workunit.client.1.smithi159.stdout:1/405: sync 2024-09-13T22:08:59.451 INFO:tasks.workunit.client.1.smithi159.stdout:6/345: sync 2024-09-13T22:08:59.451 INFO:tasks.workunit.client.1.smithi159.stdout:3/278: rmdir d0/d1/d15 39 2024-09-13T22:08:59.451 INFO:tasks.workunit.client.1.smithi159.stdout:1/406: truncate dd/d11/d21/f6f 977529 0 2024-09-13T22:08:59.451 INFO:tasks.workunit.client.1.smithi159.stdout:9/440: write d1/dc/d27/f65 [3499743,19855] 0 2024-09-13T22:08:59.452 INFO:tasks.workunit.client.1.smithi159.stdout:8/572: link da/d5d/l5e da/lc0 0 2024-09-13T22:08:59.453 INFO:tasks.workunit.client.1.smithi159.stdout:4/488: dread d13/d15/f3c [0,4194304] 0 2024-09-13T22:08:59.453 INFO:tasks.workunit.client.1.smithi159.stdout:4/489: creat d13/d15/d26/d51/d65/d67/d82/fa3 x:0 0 0 2024-09-13T22:08:59.457 INFO:tasks.workunit.client.1.smithi159.stdout:6/346: mkdir d3/da/d29/d26/d6c/d6e 0 2024-09-13T22:08:59.459 INFO:tasks.workunit.client.1.smithi159.stdout:9/441: creat d1/dc/f9a x:0 0 0 2024-09-13T22:08:59.462 INFO:tasks.workunit.client.1.smithi159.stdout:8/573: mkdir da/d5d/d70/d8e/dc1 0 2024-09-13T22:08:59.465 INFO:tasks.workunit.client.1.smithi159.stdout:9/442: mknod d1/dc/d27/c9b 0 2024-09-13T22:08:59.466 INFO:tasks.workunit.client.1.smithi159.stdout:9/443: fsync d1/dc/d10/d6d/d2f/d8b/f97 0 2024-09-13T22:08:59.468 INFO:tasks.workunit.client.1.smithi159.stdout:8/574: creat da/d7e/d82/d6f/d9a/fc2 x:0 0 0 2024-09-13T22:08:59.468 INFO:tasks.workunit.client.1.smithi159.stdout:8/575: truncate da/d22/d33/d8f/f9b 1037307 0 2024-09-13T22:08:59.469 INFO:tasks.workunit.client.1.smithi159.stdout:3/279: rename d0/d1/d3/d5/d14 to d0/d1/d3/d5/d25/d4e/d5a 0 2024-09-13T22:08:59.473 INFO:tasks.workunit.client.1.smithi159.stdout:9/444: mkdir d1/dc/d10/d9c 0 2024-09-13T22:08:59.473 INFO:tasks.workunit.client.1.smithi159.stdout:4/490: dwrite d13/d15/d26/d29/f80 [4194304,4194304] 0 2024-09-13T22:08:59.474 INFO:tasks.workunit.client.1.smithi159.stdout:0/413: dwrite d0/d48/f59 [0,4194304] 0 2024-09-13T22:08:59.474 INFO:tasks.workunit.client.1.smithi159.stdout:0/414: chown d0/f6a 182420094 1 2024-09-13T22:08:59.474 INFO:tasks.workunit.client.1.smithi159.stdout:1/407: rename dd/d11/d18/d49/f51 to dd/d11/f83 0 2024-09-13T22:08:59.474 INFO:tasks.workunit.client.1.smithi159.stdout:1/408: fdatasync dd/d11/d18/f23 0 2024-09-13T22:08:59.474 INFO:tasks.workunit.client.1.smithi159.stdout:1/409: dread - dd/d11/d18/d49/d2d/d62/f75 zero size 2024-09-13T22:08:59.478 INFO:tasks.workunit.client.1.smithi159.stdout:3/280: dread d0/d1/d3/d5/d25/d4e/d5a/d42/d45/f53 [0,4194304] 0 2024-09-13T22:08:59.478 INFO:tasks.workunit.client.1.smithi159.stdout:3/281: write d0/d1/d3/d5/d25/d2c/f33 [990628,110192] 0 2024-09-13T22:08:59.484 INFO:tasks.workunit.client.1.smithi159.stdout:3/282: rename d0/d1/d3/d5/d25/d4e/d5a/d42 to d0/d1/d3/d4d/d5b 0 2024-09-13T22:08:59.484 INFO:tasks.workunit.client.1.smithi159.stdout:6/347: dwrite d3/da/d29/d1a/d3e/f55 [0,4194304] 0 2024-09-13T22:08:59.487 INFO:tasks.workunit.client.1.smithi159.stdout:3/283: mknod d0/d1/d3/d5/d25/d2c/c5c 0 2024-09-13T22:08:59.488 INFO:tasks.workunit.client.1.smithi159.stdout:1/410: write dd/d11/d13/f45 [2796584,114635] 0 2024-09-13T22:08:59.490 INFO:tasks.workunit.client.1.smithi159.stdout:6/348: mkdir d3/d2a/d3c/d5c/d6f 0 2024-09-13T22:08:59.492 INFO:tasks.workunit.client.1.smithi159.stdout:0/415: read d0/d48/d4f/f81 [3333943,126409] 0 2024-09-13T22:08:59.495 INFO:tasks.workunit.client.1.smithi159.stdout:4/491: dwrite d13/f22 [0,4194304] 0 2024-09-13T22:08:59.495 INFO:tasks.workunit.client.1.smithi159.stdout:8/576: dwrite da/d36/f3d [0,4194304] 0 2024-09-13T22:08:59.495 INFO:tasks.workunit.client.1.smithi159.stdout:8/577: readlink da/d22/d33/d66/lab 0 2024-09-13T22:08:59.496 INFO:tasks.workunit.client.1.smithi159.stdout:0/416: dread d0/d48/d4f/d2b/f60 [0,4194304] 0 2024-09-13T22:08:59.499 INFO:tasks.workunit.client.1.smithi159.stdout:1/411: mkdir dd/d1e/d58/d5f/d84 0 2024-09-13T22:08:59.501 INFO:tasks.workunit.client.1.smithi159.stdout:6/349: rename d3/d2a/l30 to d3/da/d29/d1a/d3e/d5a/d6a/l70 0 2024-09-13T22:08:59.501 INFO:tasks.workunit.client.1.smithi159.stdout:6/350: fsync d3/da/d29/d1a/d3e/f43 0 2024-09-13T22:08:59.502 INFO:tasks.workunit.client.1.smithi159.stdout:1/412: dread f3 [0,4194304] 0 2024-09-13T22:08:59.502 INFO:tasks.workunit.client.1.smithi159.stdout:1/413: getdents dd/d11/d18/d74/d82 0 2024-09-13T22:08:59.504 INFO:tasks.workunit.client.1.smithi159.stdout:6/351: dread d3/da/d25/f4b [0,4194304] 0 2024-09-13T22:08:59.516 INFO:tasks.workunit.client.1.smithi159.stdout:3/284: dwrite d0/d1/d3/f48 [0,4194304] 0 2024-09-13T22:08:59.516 INFO:tasks.workunit.client.1.smithi159.stdout:3/285: stat d0/d1/d3/d5/d25/d2c/f33 0 2024-09-13T22:08:59.517 INFO:tasks.workunit.client.1.smithi159.stdout:8/578: truncate da/d22/d33/fba 3647136 0 2024-09-13T22:08:59.517 INFO:tasks.workunit.client.1.smithi159.stdout:8/579: write da/d22/d33/d8f/f9b [1199105,35078] 0 2024-09-13T22:08:59.519 INFO:tasks.workunit.client.1.smithi159.stdout:0/417: creat d0/d48/d4f/d66/f87 x:0 0 0 2024-09-13T22:08:59.519 INFO:tasks.workunit.client.1.smithi159.stdout:4/492: dwrite d13/d15/d26/f37 [0,4194304] 0 2024-09-13T22:08:59.519 INFO:tasks.workunit.client.1.smithi159.stdout:0/418: getdents d0/d48/d4f/d66/d75 0 2024-09-13T22:08:59.519 INFO:tasks.workunit.client.1.smithi159.stdout:0/419: creat d0/d48/d4f/d2b/f88 x:0 0 0 2024-09-13T22:08:59.520 INFO:tasks.workunit.client.1.smithi159.stdout:1/414: symlink dd/d1e/d58/d5f/d84/l85 0 2024-09-13T22:08:59.520 INFO:tasks.workunit.client.1.smithi159.stdout:1/415: dread - dd/d11/d18/d49/f69 zero size 2024-09-13T22:08:59.520 INFO:tasks.workunit.client.1.smithi159.stdout:1/416: creat dd/d1c/f86 x:0 0 0 2024-09-13T22:08:59.520 INFO:tasks.workunit.client.1.smithi159.stdout:1/417: creat dd/d11/f87 x:0 0 0 2024-09-13T22:08:59.521 INFO:tasks.workunit.client.1.smithi159.stdout:6/352: creat d3/d2a/f71 x:0 0 0 2024-09-13T22:08:59.521 INFO:tasks.workunit.client.1.smithi159.stdout:6/353: write d3/d2a/f71 [618252,11768] 0 2024-09-13T22:08:59.521 INFO:tasks.workunit.client.1.smithi159.stdout:6/354: chown d3/da/d29/d26/l34 265837 1 2024-09-13T22:08:59.521 INFO:tasks.workunit.client.1.smithi159.stdout:6/355: fdatasync d3/da/d25/d52/f59 0 2024-09-13T22:08:59.527 INFO:tasks.workunit.client.1.smithi159.stdout:8/580: rename da/d22/d33/f59 to da/d22/d2a/d39/d3e/fc3 0 2024-09-13T22:08:59.527 INFO:tasks.workunit.client.1.smithi159.stdout:8/581: chown da/d22/d4a/cbe 235 1 2024-09-13T22:08:59.527 INFO:tasks.workunit.client.1.smithi159.stdout:8/582: write da/da0/fad [769568,11258] 0 2024-09-13T22:08:59.527 INFO:tasks.workunit.client.1.smithi159.stdout:8/583: chown da/d36/f3d 8180 1 2024-09-13T22:08:59.531 INFO:tasks.workunit.client.1.smithi159.stdout:4/493: unlink d13/d15/d26/l27 0 2024-09-13T22:08:59.536 INFO:tasks.workunit.client.1.smithi159.stdout:6/356: rmdir d3/d2a/d3c/d5c/d6f 0 2024-09-13T22:08:59.536 INFO:tasks.workunit.client.1.smithi159.stdout:6/357: write d3/da/d29/f11 [3388854,74480] 0 2024-09-13T22:08:59.540 INFO:tasks.workunit.client.1.smithi159.stdout:4/494: truncate f8 1551947 0 2024-09-13T22:08:59.540 INFO:tasks.workunit.client.1.smithi159.stdout:6/358: creat d3/da/d25/d52/f72 x:0 0 0 2024-09-13T22:08:59.540 INFO:tasks.workunit.client.1.smithi159.stdout:6/359: chown d3/da/d29/d26 2 1 2024-09-13T22:08:59.542 INFO:tasks.workunit.client.1.smithi159.stdout:4/495: rename d13/d15/d26/f34 to d13/d41/d79/fa4 0 2024-09-13T22:08:59.542 INFO:tasks.workunit.client.1.smithi159.stdout:4/496: readlink d13/d41/d5d/l6b 0 2024-09-13T22:08:59.544 INFO:tasks.workunit.client.1.smithi159.stdout:0/420: dwrite d0/d48/d4f/f67 [0,4194304] 0 2024-09-13T22:08:59.544 INFO:tasks.workunit.client.1.smithi159.stdout:0/421: stat d0/d48/d4f/d2b/c39 0 2024-09-13T22:08:59.548 INFO:tasks.workunit.client.1.smithi159.stdout:1/418: dwrite dd/d1e/f44 [0,4194304] 0 2024-09-13T22:08:59.550 INFO:tasks.workunit.client.1.smithi159.stdout:0/422: creat d0/d48/d4f/d54/d74/f89 x:0 0 0 2024-09-13T22:08:59.552 INFO:tasks.workunit.client.1.smithi159.stdout:4/497: getdents d13/d15/d26/d51/d65/d67 0 2024-09-13T22:08:59.555 INFO:tasks.workunit.client.1.smithi159.stdout:4/498: readlink l4 0 2024-09-13T22:08:59.557 INFO:tasks.workunit.client.1.smithi159.stdout:3/286: dwrite d0/d1/d3/f1c [0,4194304] 0 2024-09-13T22:08:59.557 INFO:tasks.workunit.client.1.smithi159.stdout:3/287: fdatasync d0/d1/d34/f41 0 2024-09-13T22:08:59.559 INFO:tasks.workunit.client.1.smithi159.stdout:1/419: dread dd/d11/d18/d49/d2d/f5d [0,4194304] 0 2024-09-13T22:08:59.559 INFO:tasks.workunit.client.1.smithi159.stdout:1/420: fsync dd/f1b 0 2024-09-13T22:08:59.559 INFO:tasks.workunit.client.1.smithi159.stdout:1/421: write dd/f16 [3928670,95021] 0 2024-09-13T22:08:59.559 INFO:tasks.workunit.client.1.smithi159.stdout:1/422: creat dd/d1e/f88 x:0 0 0 2024-09-13T22:08:59.560 INFO:tasks.workunit.client.1.smithi159.stdout:8/584: dwrite da/d22/d2a/d39/d3e/f8d [0,4194304] 0 2024-09-13T22:08:59.562 INFO:tasks.workunit.client.1.smithi159.stdout:4/499: dread d13/f74 [0,4194304] 0 2024-09-13T22:08:59.562 INFO:tasks.workunit.client.1.smithi159.stdout:6/360: dread d3/da/d29/f11 [0,4194304] 0 2024-09-13T22:08:59.581 INFO:tasks.workunit.client.1.smithi159.stdout:6/361: mkdir d3/d2a/d3c/d46/d73 0 2024-09-13T22:08:59.582 INFO:tasks.workunit.client.1.smithi159.stdout:8/585: rmdir da/d7e/d82/d6f/d9a 39 2024-09-13T22:08:59.585 INFO:tasks.workunit.client.1.smithi159.stdout:6/362: truncate d3/f27 3620227 0 2024-09-13T22:08:59.589 INFO:tasks.workunit.client.1.smithi159.stdout:6/363: unlink d3/da/d29/d1a/d3e/d5a/d6a/f6b 0 2024-09-13T22:08:59.590 INFO:tasks.workunit.client.1.smithi159.stdout:8/586: rename da/d22/c60 to da/d22/d2a/da1/cc4 0 2024-09-13T22:08:59.590 INFO:tasks.workunit.client.1.smithi159.stdout:8/587: dread - da/d7e/d82/f80 zero size 2024-09-13T22:08:59.590 INFO:tasks.workunit.client.1.smithi159.stdout:0/423: dwrite d0/d48/f59 [0,4194304] 0 2024-09-13T22:08:59.592 INFO:tasks.workunit.client.1.smithi159.stdout:3/288: dwrite d0/d1/d3/f1c [0,4194304] 0 2024-09-13T22:08:59.592 INFO:tasks.workunit.client.1.smithi159.stdout:1/423: dwrite dd/d1c/f26 [0,4194304] 0 2024-09-13T22:08:59.593 INFO:tasks.workunit.client.1.smithi159.stdout:4/500: dwrite d13/d20/f59 [0,4194304] 0 2024-09-13T22:08:59.593 INFO:tasks.workunit.client.1.smithi159.stdout:4/501: readlink d13/l58 0 2024-09-13T22:08:59.594 INFO:tasks.workunit.client.1.smithi159.stdout:0/424: link d0/d48/d4f/l3a d0/l8a 0 2024-09-13T22:08:59.599 INFO:tasks.workunit.client.1.smithi159.stdout:3/289: unlink d0/l4b 0 2024-09-13T22:08:59.600 INFO:tasks.workunit.client.1.smithi159.stdout:3/290: readlink d0/d1/d15/l3c 0 2024-09-13T22:08:59.603 INFO:tasks.workunit.client.1.smithi159.stdout:1/424: symlink dd/d11/d13/d4b/l89 0 2024-09-13T22:08:59.603 INFO:tasks.workunit.client.1.smithi159.stdout:1/425: readlink dd/d11/d18/d2e/l35 0 2024-09-13T22:08:59.606 INFO:tasks.workunit.client.1.smithi159.stdout:0/425: mkdir d0/d48/d4f/d66/d75/d8b 0 2024-09-13T22:08:59.608 INFO:tasks.workunit.client.1.smithi159.stdout:0/426: rename d0/d48/d4f/f84 to d0/d2c/f8c 0 2024-09-13T22:08:59.608 INFO:tasks.workunit.client.1.smithi159.stdout:0/427: truncate d0/f45 301768 0 2024-09-13T22:08:59.608 INFO:tasks.workunit.client.1.smithi159.stdout:0/428: symlink d0/d48/d4f/d66/l8d 2 2024-09-13T22:08:59.610 INFO:tasks.workunit.client.1.smithi159.stdout:0/429: mknod d0/d48/d4f/c8e 0 2024-09-13T22:08:59.610 INFO:tasks.workunit.client.1.smithi159.stdout:0/430: stat d0/d2c/f36 0 2024-09-13T22:08:59.610 INFO:tasks.workunit.client.1.smithi159.stdout:0/431: read - d0/f77 zero size 2024-09-13T22:08:59.611 INFO:tasks.workunit.client.1.smithi159.stdout:0/432: rmdir d0/d48/d4f/d66/d75/d8b 0 2024-09-13T22:08:59.620 INFO:tasks.workunit.client.1.smithi159.stdout:6/364: dwrite d3/da/f4e [0,4194304] 0 2024-09-13T22:08:59.620 INFO:tasks.workunit.client.1.smithi159.stdout:4/502: dwrite d13/f24 [0,4194304] 0 2024-09-13T22:08:59.620 INFO:tasks.workunit.client.1.smithi159.stdout:8/588: dwrite da/d36/d48/d9e/fb5 [0,4194304] 0 2024-09-13T22:08:59.621 INFO:tasks.workunit.client.1.smithi159.stdout:5/372: sync 2024-09-13T22:08:59.621 INFO:tasks.workunit.client.1.smithi159.stdout:5/373: creat d1/d49/f81 x:0 0 0 2024-09-13T22:08:59.625 INFO:tasks.workunit.client.1.smithi159.stdout:4/503: creat d13/d15/d26/d51/d65/fa5 x:0 0 0 2024-09-13T22:08:59.626 INFO:tasks.workunit.client.1.smithi159.stdout:1/426: dwrite dd/d11/d13/f5c [0,4194304] 0 2024-09-13T22:08:59.627 INFO:tasks.workunit.client.1.smithi159.stdout:1/427: dread dd/d11/d21/f6f [0,4194304] 0 2024-09-13T22:08:59.632 INFO:tasks.workunit.client.1.smithi159.stdout:4/504: mknod d13/d15/d26/d29/d8b/ca6 0 2024-09-13T22:08:59.637 INFO:tasks.workunit.client.1.smithi159.stdout:0/433: getdents d0/d48/d4f 0 2024-09-13T22:08:59.638 INFO:tasks.workunit.client.1.smithi159.stdout:1/428: mkdir dd/d1e/d58/d8a 0 2024-09-13T22:08:59.641 INFO:tasks.workunit.client.1.smithi159.stdout:8/589: getdents da/d36/d48/d9e 0 2024-09-13T22:08:59.643 INFO:tasks.workunit.client.1.smithi159.stdout:8/590: dread da/d22/d4a/f7c [0,4194304] 0 2024-09-13T22:08:59.645 INFO:tasks.workunit.client.1.smithi159.stdout:4/505: link d13/d15/f1d d13/d15/fa7 0 2024-09-13T22:08:59.647 INFO:tasks.workunit.client.1.smithi159.stdout:0/434: link d0/d48/d4f/fb d0/d48/d4f/d2b/f8f 0 2024-09-13T22:08:59.650 INFO:tasks.workunit.client.1.smithi159.stdout:1/429: unlink dd/d1e/d58/d5f/d84/l85 0 2024-09-13T22:08:59.656 INFO:tasks.workunit.client.1.smithi159.stdout:1/430: creat dd/d11/d18/d2e/d3c/f8b x:0 0 0 2024-09-13T22:08:59.657 INFO:tasks.workunit.client.1.smithi159.stdout:8/591: rmdir da/d22/d33/d8f 39 2024-09-13T22:08:59.658 INFO:tasks.workunit.client.1.smithi159.stdout:8/592: chown da/d7e/d82/d6f/ca6 0 1 2024-09-13T22:08:59.658 INFO:tasks.workunit.client.1.smithi159.stdout:8/593: chown da/d22/d2a/d39/d3e/c8b 370384715 1 2024-09-13T22:08:59.660 INFO:tasks.workunit.client.1.smithi159.stdout:4/506: getdents d13/d15/d26/d51/d65 0 2024-09-13T22:08:59.661 INFO:tasks.workunit.client.1.smithi159.stdout:4/507: read - d13/d15/d26/d29/d3b/d66/d6c/f97 zero size 2024-09-13T22:08:59.661 INFO:tasks.workunit.client.1.smithi159.stdout:4/508: write d13/f89 [528935,26201] 0 2024-09-13T22:08:59.661 INFO:tasks.workunit.client.1.smithi159.stdout:4/509: chown d13/f74 14 1 2024-09-13T22:08:59.662 INFO:tasks.workunit.client.1.smithi159.stdout:1/431: creat dd/f8c x:0 0 0 2024-09-13T22:08:59.662 INFO:tasks.workunit.client.1.smithi159.stdout:1/432: dread - dd/d11/d34/d53/f70 zero size 2024-09-13T22:08:59.663 INFO:tasks.workunit.client.1.smithi159.stdout:0/435: dwrite d0/d48/d4f/d2b/f50 [0,4194304] 0 2024-09-13T22:08:59.663 INFO:tasks.workunit.client.1.smithi159.stdout:8/594: read - da/d22/f34 zero size 2024-09-13T22:08:59.665 INFO:tasks.workunit.client.1.smithi159.stdout:4/510: mknod d13/d15/d26/d29/d3b/d66/d6c/ca8 0 2024-09-13T22:08:59.671 INFO:tasks.workunit.client.1.smithi159.stdout:0/436: rename d0/c2e to d0/d2c/d71/c90 0 2024-09-13T22:08:59.671 INFO:tasks.workunit.client.1.smithi159.stdout:0/437: chown d0/d48/d4f/d2b/f88 4045522 1 2024-09-13T22:08:59.671 INFO:tasks.workunit.client.1.smithi159.stdout:0/438: readlink d0/d48/d7d/l7f 0 2024-09-13T22:08:59.671 INFO:tasks.workunit.client.1.smithi159.stdout:8/595: truncate da/d22/d33/f38 5451088 0 2024-09-13T22:08:59.673 INFO:tasks.workunit.client.1.smithi159.stdout:0/439: mkdir d0/d5e/d91 0 2024-09-13T22:08:59.673 INFO:tasks.workunit.client.1.smithi159.stdout:0/440: dread - d0/d5e/f6f zero size 2024-09-13T22:08:59.674 INFO:tasks.workunit.client.1.smithi159.stdout:1/433: read dd/d11/f4f [1971229,85445] 0 2024-09-13T22:08:59.676 INFO:tasks.workunit.client.1.smithi159.stdout:0/441: rename d0/d5e/l68 to d0/d2c/d71/l92 0 2024-09-13T22:08:59.677 INFO:tasks.workunit.client.1.smithi159.stdout:0/442: chown d0/d2c/c82 2 1 2024-09-13T22:08:59.677 INFO:tasks.workunit.client.1.smithi159.stdout:0/443: fsync d0/d5e/f3f 0 2024-09-13T22:08:59.680 INFO:tasks.workunit.client.1.smithi159.stdout:8/596: rmdir da/d36 39 2024-09-13T22:08:59.683 INFO:tasks.workunit.client.1.smithi159.stdout:4/511: dwrite d13/d15/d26/d51/d65/fa5 [0,4194304] 0 2024-09-13T22:08:59.684 INFO:tasks.workunit.client.1.smithi159.stdout:8/597: rename da/d22/d26/fae to da/d22/d33/d8f/fc5 0 2024-09-13T22:08:59.684 INFO:tasks.workunit.client.1.smithi159.stdout:8/598: chown da/d5d/d70/f7b 6908 1 2024-09-13T22:08:59.684 INFO:tasks.workunit.client.1.smithi159.stdout:8/599: creat da/da0/fc6 x:0 0 0 2024-09-13T22:08:59.684 INFO:tasks.workunit.client.1.smithi159.stdout:8/600: creat da/d22/d2a/d39/fc7 x:0 0 0 2024-09-13T22:08:59.687 INFO:tasks.workunit.client.1.smithi159.stdout:4/512: link d13/d15/f1f d13/d41/d5d/fa9 0 2024-09-13T22:08:59.689 INFO:tasks.workunit.client.1.smithi159.stdout:8/601: unlink da/d22/d26/l63 0 2024-09-13T22:08:59.690 INFO:tasks.workunit.client.1.smithi159.stdout:0/444: write d0/d48/d4f/d2b/f50 [3665492,62163] 0 2024-09-13T22:08:59.690 INFO:tasks.workunit.client.1.smithi159.stdout:4/513: symlink d13/d41/d50/laa 0 2024-09-13T22:08:59.691 INFO:tasks.workunit.client.1.smithi159.stdout:4/514: chown d13/d15/d26/d51/d65/f70 26 1 2024-09-13T22:08:59.693 INFO:tasks.workunit.client.1.smithi159.stdout:8/602: link da/ld da/d7e/db2/lc8 0 2024-09-13T22:08:59.693 INFO:tasks.workunit.client.1.smithi159.stdout:1/434: dwrite dd/d11/d18/d2e/f33 [4194304,4194304] 0 2024-09-13T22:08:59.693 INFO:tasks.workunit.client.1.smithi159.stdout:1/435: creat dd/d11/d13/f8d x:0 0 0 2024-09-13T22:08:59.693 INFO:tasks.workunit.client.1.smithi159.stdout:1/436: chown dd/d11/d34/l4a 832 1 2024-09-13T22:08:59.693 INFO:tasks.workunit.client.1.smithi159.stdout:1/437: chown dd/d1e/f22 26 1 2024-09-13T22:08:59.694 INFO:tasks.workunit.client.1.smithi159.stdout:0/445: rename d0/d48/d4f/d2b/f2f to d0/d48/d4f/d2b/f93 0 2024-09-13T22:08:59.694 INFO:tasks.workunit.client.1.smithi159.stdout:0/446: write d0/d48/d4f/f5d [65448,105085] 0 2024-09-13T22:08:59.697 INFO:tasks.workunit.client.1.smithi159.stdout:8/603: creat da/d7e/db2/fc9 x:0 0 0 2024-09-13T22:08:59.700 INFO:tasks.workunit.client.1.smithi159.stdout:1/438: symlink dd/d1e/d58/l8e 0 2024-09-13T22:08:59.700 INFO:tasks.workunit.client.1.smithi159.stdout:1/439: readlink dd/d1e/l2c 0 2024-09-13T22:08:59.703 INFO:tasks.workunit.client.1.smithi159.stdout:0/447: mknod d0/d48/d4f/d66/d75/c94 0 2024-09-13T22:08:59.703 INFO:tasks.workunit.client.1.smithi159.stdout:0/448: truncate d0/d48/d4f/d2b/f88 1028340 0 2024-09-13T22:08:59.703 INFO:tasks.workunit.client.1.smithi159.stdout:0/449: write d0/d2c/f36 [1640126,27663] 0 2024-09-13T22:08:59.704 INFO:tasks.workunit.client.1.smithi159.stdout:4/515: link d13/d15/c1b d13/cab 0 2024-09-13T22:08:59.704 INFO:tasks.workunit.client.1.smithi159.stdout:4/516: chown d13/f74 20 1 2024-09-13T22:08:59.708 INFO:tasks.workunit.client.1.smithi159.stdout:4/517: rmdir d13/d20/d8c 0 2024-09-13T22:08:59.711 INFO:tasks.workunit.client.1.smithi159.stdout:0/450: getdents d0 0 2024-09-13T22:08:59.716 INFO:tasks.workunit.client.1.smithi159.stdout:8/604: dwrite da/d7e/f7f [0,4194304] 0 2024-09-13T22:08:59.716 INFO:tasks.workunit.client.1.smithi159.stdout:8/605: truncate da/d22/d2a/da1/fb6 699624 0 2024-09-13T22:08:59.716 INFO:tasks.workunit.client.1.smithi159.stdout:8/606: write da/d36/f3d [4390427,2448] 0 2024-09-13T22:08:59.716 INFO:tasks.workunit.client.1.smithi159.stdout:8/607: truncate da/d22/d2a/d39/d3e/f99 133466 0 2024-09-13T22:08:59.717 INFO:tasks.workunit.client.1.smithi159.stdout:0/451: link d0/d5e/f61 d0/d2c/f95 0 2024-09-13T22:08:59.717 INFO:tasks.workunit.client.1.smithi159.stdout:0/452: write d0/d48/d4f/d54/f6d [173736,29295] 0 2024-09-13T22:08:59.718 INFO:tasks.workunit.client.1.smithi159.stdout:0/453: chown d0/d48/d4f/f5d 33024791 1 2024-09-13T22:08:59.723 INFO:tasks.workunit.client.1.smithi159.stdout:0/454: mkdir d0/d2c/d96 0 2024-09-13T22:08:59.723 INFO:tasks.workunit.client.1.smithi159.stdout:0/455: chown d0/d2c/f37 200759 1 2024-09-13T22:08:59.724 INFO:tasks.workunit.client.1.smithi159.stdout:0/456: truncate d0/d48/d4f/d2b/f93 2515488 0 2024-09-13T22:08:59.724 INFO:tasks.workunit.client.1.smithi159.stdout:0/457: mkdir d0/d2c/d71/d97 0 2024-09-13T22:08:59.726 INFO:tasks.workunit.client.1.smithi159.stdout:0/458: rename d0/cf to d0/d48/c98 0 2024-09-13T22:08:59.726 INFO:tasks.workunit.client.1.smithi159.stdout:0/459: chown d0/d48/d4f/d54/d74/f7e 17 1 2024-09-13T22:08:59.727 INFO:tasks.workunit.client.1.smithi159.stdout:0/460: rename d0/d5e/f19 to d0/d2c/d71/f99 0 2024-09-13T22:08:59.728 INFO:tasks.workunit.client.1.smithi159.stdout:0/461: mknod d0/d2c/d71/d97/c9a 0 2024-09-13T22:08:59.728 INFO:tasks.workunit.client.1.smithi159.stdout:0/462: write d0/d2c/d71/f99 [1608372,62238] 0 2024-09-13T22:08:59.729 INFO:tasks.workunit.client.1.smithi159.stdout:8/608: write da/d36/f3d [1110676,114402] 0 2024-09-13T22:08:59.730 INFO:tasks.workunit.client.1.smithi159.stdout:4/518: dwrite d13/d15/d26/f61 [0,4194304] 0 2024-09-13T22:08:59.730 INFO:tasks.workunit.client.1.smithi159.stdout:4/519: chown d13/f22 0 1 2024-09-13T22:08:59.731 INFO:tasks.workunit.client.1.smithi159.stdout:8/609: creat da/d22/db3/db9/fca x:0 0 0 2024-09-13T22:08:59.732 INFO:tasks.workunit.client.1.smithi159.stdout:4/520: mknod d13/d15/d26/d29/cac 0 2024-09-13T22:08:59.732 INFO:tasks.workunit.client.1.smithi159.stdout:4/521: fsync d13/d15/f3c 0 2024-09-13T22:08:59.732 INFO:tasks.workunit.client.1.smithi159.stdout:1/440: dwrite dd/d11/d18/f2b [4194304,4194304] 0 2024-09-13T22:08:59.733 INFO:tasks.workunit.client.1.smithi159.stdout:1/441: readlink dd/d1e/l2c 0 2024-09-13T22:08:59.734 INFO:tasks.workunit.client.1.smithi159.stdout:8/610: rename da/d36/f3d to da/d22/d2a/d39/d3e/fcb 0 2024-09-13T22:08:59.736 INFO:tasks.workunit.client.1.smithi159.stdout:4/522: link d13/d15/d26/f33 d13/d41/d79/fad 0 2024-09-13T22:08:59.740 INFO:tasks.workunit.client.1.smithi159.stdout:0/463: write d0/d48/f4d [2677580,5720] 0 2024-09-13T22:08:59.742 INFO:tasks.workunit.client.1.smithi159.stdout:4/523: getdents d13/d15/d26/d51/d65/d67/d82 0 2024-09-13T22:08:59.743 INFO:tasks.workunit.client.1.smithi159.stdout:1/442: dread dd/d11/d18/f2b [0,4194304] 0 2024-09-13T22:08:59.745 INFO:tasks.workunit.client.1.smithi159.stdout:1/443: rename dd/d11/d13/f7f to dd/d11/d18/d49/f8f 0 2024-09-13T22:08:59.748 INFO:tasks.workunit.client.1.smithi159.stdout:1/444: creat dd/d1e/d58/d5f/d84/f90 x:0 0 0 2024-09-13T22:08:59.748 INFO:tasks.workunit.client.1.smithi159.stdout:1/445: chown c5 27507360 1 2024-09-13T22:08:59.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:08:59 smithi089 ceph-mon[27921]: pgmap v261: 65 pgs: 65 active+clean; 1.8 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 160 MiB/s rd, 204 MiB/s wr, 377 op/s 2024-09-13T22:08:59.750 INFO:tasks.workunit.client.1.smithi159.stdout:1/446: rmdir dd/d11/d34/d53 39 2024-09-13T22:08:59.750 INFO:tasks.workunit.client.1.smithi159.stdout:1/447: truncate dd/d11/d18/d49/f69 826638 0 2024-09-13T22:08:59.750 INFO:tasks.workunit.client.1.smithi159.stdout:1/448: fdatasync dd/d1e/f88 0 2024-09-13T22:08:59.750 INFO:tasks.workunit.client.1.smithi159.stdout:1/449: dread - dd/d11/d13/f8d zero size 2024-09-13T22:08:59.757 INFO:tasks.workunit.client.1.smithi159.stdout:0/464: dread d0/d48/f4d [0,4194304] 0 2024-09-13T22:08:59.759 INFO:tasks.workunit.client.1.smithi159.stdout:4/524: dread d13/d15/d26/d29/d3b/f63 [0,4194304] 0 2024-09-13T22:08:59.759 INFO:tasks.workunit.client.1.smithi159.stdout:8/611: dwrite da/d22/d2a/fa4 [0,4194304] 0 2024-09-13T22:08:59.759 INFO:tasks.workunit.client.1.smithi159.stdout:0/465: write d0/d5e/f3f [11730,39856] 0 2024-09-13T22:08:59.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:08:59 smithi159 ceph-mon[35348]: pgmap v261: 65 pgs: 65 active+clean; 1.8 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 160 MiB/s rd, 204 MiB/s wr, 377 op/s 2024-09-13T22:08:59.762 INFO:tasks.workunit.client.1.smithi159.stdout:0/466: rename d0/d2c/d71/f86 to d0/d2c/d71/d97/f9b 0 2024-09-13T22:08:59.763 INFO:tasks.workunit.client.1.smithi159.stdout:0/467: mknod d0/d48/d4f/c9c 0 2024-09-13T22:08:59.769 INFO:tasks.workunit.client.1.smithi159.stdout:8/612: write da/d36/d48/d9e/fb5 [269118,71148] 0 2024-09-13T22:08:59.769 INFO:tasks.workunit.client.1.smithi159.stdout:2/254: sync 2024-09-13T22:08:59.769 INFO:tasks.workunit.client.1.smithi159.stdout:7/373: sync 2024-09-13T22:08:59.772 INFO:tasks.workunit.client.1.smithi159.stdout:8/613: mkdir da/d22/d4a/dcc 0 2024-09-13T22:08:59.773 INFO:tasks.workunit.client.1.smithi159.stdout:8/614: dread da/d22/d33/d8f/fc5 [0,4194304] 0 2024-09-13T22:08:59.775 INFO:tasks.workunit.client.1.smithi159.stdout:2/255: rmdir d9/d48 39 2024-09-13T22:08:59.776 INFO:tasks.workunit.client.1.smithi159.stdout:0/468: dread d0/d2c/f37 [0,4194304] 0 2024-09-13T22:08:59.776 INFO:tasks.workunit.client.1.smithi159.stdout:7/374: symlink d3/d2e/l7d 0 2024-09-13T22:08:59.779 INFO:tasks.workunit.client.1.smithi159.stdout:0/469: creat d0/d48/d7d/f9d x:0 0 0 2024-09-13T22:08:59.780 INFO:tasks.workunit.client.1.smithi159.stdout:7/375: mknod d3/d2e/d6e/c7e 0 2024-09-13T22:08:59.781 INFO:tasks.workunit.client.1.smithi159.stdout:0/470: mknod d0/d5e/d91/c9e 0 2024-09-13T22:08:59.783 INFO:tasks.workunit.client.1.smithi159.stdout:7/376: mknod d3/d31/d4d/d4e/d4f/d6c/c7f 0 2024-09-13T22:08:59.785 INFO:tasks.workunit.client.1.smithi159.stdout:0/471: dread d0/d2c/f37 [0,4194304] 0 2024-09-13T22:08:59.785 INFO:tasks.workunit.client.1.smithi159.stdout:1/450: dwrite dd/d11/d18/f2b [0,4194304] 0 2024-09-13T22:08:59.785 INFO:tasks.workunit.client.1.smithi159.stdout:4/525: dwrite d13/d41/f42 [8388608,4194304] 0 2024-09-13T22:08:59.790 INFO:tasks.workunit.client.1.smithi159.stdout:8/615: dread da/d36/f6a [0,4194304] 0 2024-09-13T22:08:59.790 INFO:tasks.workunit.client.1.smithi159.stdout:8/616: creat da/da0/fcd x:0 0 0 2024-09-13T22:08:59.795 INFO:tasks.workunit.client.1.smithi159.stdout:1/451: link dd/d11/d18/d2e/c39 dd/d11/d34/c91 0 2024-09-13T22:08:59.796 INFO:tasks.workunit.client.1.smithi159.stdout:4/526: creat d13/d15/d5a/fae x:0 0 0 2024-09-13T22:08:59.797 INFO:tasks.workunit.client.1.smithi159.stdout:7/377: dread d3/d18/f32 [0,4194304] 0 2024-09-13T22:08:59.798 INFO:tasks.workunit.client.1.smithi159.stdout:8/617: mkdir da/d5d/d70/d8e/dc1/dce 0 2024-09-13T22:08:59.798 INFO:tasks.workunit.client.1.smithi159.stdout:8/618: getdents da/d5d/dbc 0 2024-09-13T22:08:59.802 INFO:tasks.workunit.client.1.smithi159.stdout:4/527: mkdir d13/d15/d26/d29/d3b/daf 0 2024-09-13T22:08:59.803 INFO:tasks.workunit.client.1.smithi159.stdout:2/256: dwrite d9/da/f26 [0,4194304] 0 2024-09-13T22:08:59.803 INFO:tasks.workunit.client.1.smithi159.stdout:8/619: creat da/d36/d48/d9e/fcf x:0 0 0 2024-09-13T22:08:59.805 INFO:tasks.workunit.client.1.smithi159.stdout:4/528: creat d13/d41/d50/fb0 x:0 0 0 2024-09-13T22:08:59.808 INFO:tasks.workunit.client.1.smithi159.stdout:7/378: read d3/d31/d4d/f57 [3841843,21239] 0 2024-09-13T22:08:59.808 INFO:tasks.workunit.client.1.smithi159.stdout:0/472: dwrite d0/d48/d4f/f7b [0,4194304] 0 2024-09-13T22:08:59.809 INFO:tasks.workunit.client.1.smithi159.stdout:2/257: mkdir d9/da/d5a 0 2024-09-13T22:08:59.810 INFO:tasks.workunit.client.1.smithi159.stdout:2/258: read d9/da/f2a [1036006,97194] 0 2024-09-13T22:08:59.812 INFO:tasks.workunit.client.1.smithi159.stdout:7/379: dread d3/d31/d49/f71 [0,4194304] 0 2024-09-13T22:08:59.812 INFO:tasks.workunit.client.1.smithi159.stdout:1/452: dwrite dd/d1e/d58/d5f/d84/f90 [0,4194304] 0 2024-09-13T22:08:59.818 INFO:tasks.workunit.client.1.smithi159.stdout:8/620: symlink da/d7e/ld0 0 2024-09-13T22:08:59.820 INFO:tasks.workunit.client.1.smithi159.stdout:4/529: link d13/d41/d4d/d75/l81 d13/d15/d26/d29/d3b/d66/d6c/lb1 0 2024-09-13T22:08:59.820 INFO:tasks.workunit.client.1.smithi159.stdout:4/530: write d13/d15/f39 [3583801,105930] 0 2024-09-13T22:08:59.820 INFO:tasks.workunit.client.1.smithi159.stdout:4/531: chown d13/d15/c2b 21 1 2024-09-13T22:08:59.824 INFO:tasks.workunit.client.1.smithi159.stdout:2/259: dwrite d9/da/d27/f2e [4194304,4194304] 0 2024-09-13T22:08:59.824 INFO:tasks.workunit.client.1.smithi159.stdout:2/260: stat d9/da/lc 0 2024-09-13T22:08:59.824 INFO:tasks.workunit.client.1.smithi159.stdout:0/473: truncate d0/d5e/f55 572119 0 2024-09-13T22:08:59.826 INFO:tasks.workunit.client.1.smithi159.stdout:7/380: link d3/c30 d3/d3f/c80 0 2024-09-13T22:08:59.832 INFO:tasks.workunit.client.1.smithi159.stdout:1/453: rename f9 to dd/d11/d34/d59/f92 0 2024-09-13T22:08:59.832 INFO:tasks.workunit.client.1.smithi159.stdout:1/454: read dd/d1e/f22 [195558,92446] 0 2024-09-13T22:08:59.834 INFO:tasks.workunit.client.1.smithi159.stdout:8/621: creat da/d36/d57/fd1 x:0 0 0 2024-09-13T22:08:59.834 INFO:tasks.workunit.client.1.smithi159.stdout:8/622: fdatasync da/d7e/d82/d6f/fbd 0 2024-09-13T22:08:59.835 INFO:tasks.workunit.client.1.smithi159.stdout:2/261: write d9/f38 [4089469,70298] 0 2024-09-13T22:08:59.835 INFO:tasks.workunit.client.1.smithi159.stdout:2/262: stat d9/d37/f51 0 2024-09-13T22:08:59.835 INFO:tasks.workunit.client.1.smithi159.stdout:2/263: creat d9/d37/f5b x:0 0 0 2024-09-13T22:08:59.836 INFO:tasks.workunit.client.1.smithi159.stdout:4/532: mkdir d13/d41/d79/db2 0 2024-09-13T22:08:59.837 INFO:tasks.workunit.client.1.smithi159.stdout:4/533: chown d13/d15/d26/d29/d3b/d66/d6c/f8a 2827785 1 2024-09-13T22:08:59.837 INFO:tasks.workunit.client.1.smithi159.stdout:4/534: fdatasync d13/d15/d26/d29/d3b/d66/d6c/f87 0 2024-09-13T22:08:59.837 INFO:tasks.workunit.client.1.smithi159.stdout:4/535: write d13/d15/f3c [2692609,59074] 0 2024-09-13T22:08:59.837 INFO:tasks.workunit.client.1.smithi159.stdout:7/381: dread d3/d31/d4d/d4e/d4f/f58 [0,4194304] 0 2024-09-13T22:08:59.837 INFO:tasks.workunit.client.1.smithi159.stdout:7/382: chown d3/ff 1687387967 1 2024-09-13T22:08:59.838 INFO:tasks.workunit.client.1.smithi159.stdout:0/474: symlink d0/d2c/d96/l9f 0 2024-09-13T22:08:59.839 INFO:tasks.workunit.client.1.smithi159.stdout:0/475: creat d0/d48/d7d/fa0 x:0 0 0 2024-09-13T22:08:59.841 INFO:tasks.workunit.client.1.smithi159.stdout:1/455: rename dd/d1e/d58/d5f/f60 to dd/d11/d34/d53/f93 0 2024-09-13T22:08:59.842 INFO:tasks.workunit.client.1.smithi159.stdout:2/264: rename d9 to d9/d48/d5c 22 2024-09-13T22:08:59.843 INFO:tasks.workunit.client.1.smithi159.stdout:8/623: unlink da/d36/f6a 0 2024-09-13T22:08:59.848 INFO:tasks.workunit.client.1.smithi159.stdout:4/536: mknod d13/d41/d5d/cb3 0 2024-09-13T22:08:59.848 INFO:tasks.workunit.client.1.smithi159.stdout:4/537: chown d13/d15/d26/d29/d8b 0 1 2024-09-13T22:08:59.848 INFO:tasks.workunit.client.1.smithi159.stdout:4/538: dread - d13/d41/d50/fb0 zero size 2024-09-13T22:08:59.856 INFO:tasks.workunit.client.1.smithi159.stdout:0/476: mkdir d0/d2c/d96/da1 0 2024-09-13T22:08:59.856 INFO:tasks.workunit.client.1.smithi159.stdout:0/477: chown d0/d48/d4f/d2b/f8f 7224 1 2024-09-13T22:08:59.856 INFO:tasks.workunit.client.1.smithi159.stdout:0/478: chown d0/d48/d4f/d66 24854 1 2024-09-13T22:08:59.857 INFO:tasks.workunit.client.1.smithi159.stdout:7/383: rename d3/f34 to d3/d2e/f81 0 2024-09-13T22:08:59.859 INFO:tasks.workunit.client.1.smithi159.stdout:2/265: symlink d9/da/l5d 0 2024-09-13T22:08:59.860 INFO:tasks.workunit.client.1.smithi159.stdout:2/266: truncate d9/da/f18 4693789 0 2024-09-13T22:08:59.862 INFO:tasks.workunit.client.1.smithi159.stdout:1/456: dwrite dd/d1e/f1f [0,4194304] 0 2024-09-13T22:08:59.862 INFO:tasks.workunit.client.1.smithi159.stdout:8/624: mknod da/d22/d4a/dcc/cd2 0 2024-09-13T22:08:59.863 INFO:tasks.workunit.client.1.smithi159.stdout:4/539: unlink d13/d15/d26/d29/f80 0 2024-09-13T22:08:59.866 INFO:tasks.workunit.client.1.smithi159.stdout:0/479: write d0/f10 [824895,4929] 0 2024-09-13T22:08:59.866 INFO:tasks.workunit.client.1.smithi159.stdout:7/384: read d3/d31/d4d/d4e/f51 [569655,25812] 0 2024-09-13T22:08:59.866 INFO:tasks.workunit.client.1.smithi159.stdout:7/385: creat d3/d2e/f82 x:0 0 0 2024-09-13T22:08:59.866 INFO:tasks.workunit.client.1.smithi159.stdout:7/386: chown d3/d2e/d6e/l7b 94866659 1 2024-09-13T22:08:59.867 INFO:tasks.workunit.client.1.smithi159.stdout:2/267: creat d9/f5e x:0 0 0 2024-09-13T22:08:59.872 INFO:tasks.workunit.client.1.smithi159.stdout:7/387: dread d3/d18/f32 [0,4194304] 0 2024-09-13T22:08:59.872 INFO:tasks.workunit.client.1.smithi159.stdout:7/388: write d3/d31/d4d/d4e/d4f/f58 [3516084,54465] 0 2024-09-13T22:08:59.873 INFO:tasks.workunit.client.1.smithi159.stdout:2/268: dread d9/fe [0,4194304] 0 2024-09-13T22:08:59.878 INFO:tasks.workunit.client.1.smithi159.stdout:1/457: unlink dd/d11/d18/f2b 0 2024-09-13T22:08:59.881 INFO:tasks.workunit.client.1.smithi159.stdout:8/625: mkdir da/d22/d33/d66/dd3 0 2024-09-13T22:08:59.883 INFO:tasks.workunit.client.1.smithi159.stdout:4/540: creat d13/d15/d26/d29/d3b/fb4 x:0 0 0 2024-09-13T22:08:59.883 INFO:tasks.workunit.client.1.smithi159.stdout:4/541: fdatasync d13/f22 0 2024-09-13T22:08:59.886 INFO:tasks.workunit.client.1.smithi159.stdout:0/480: dwrite d0/d48/f4d [0,4194304] 0 2024-09-13T22:08:59.886 INFO:tasks.workunit.client.1.smithi159.stdout:0/481: chown d0/d48/d4f/f7b 24 1 2024-09-13T22:08:59.887 INFO:tasks.workunit.client.1.smithi159.stdout:7/389: symlink d3/d31/d4d/d4e/d4f/l83 0 2024-09-13T22:08:59.889 INFO:tasks.workunit.client.1.smithi159.stdout:2/269: rename d9/d44/c4a to d9/d2d/c5f 0 2024-09-13T22:08:59.889 INFO:tasks.workunit.client.1.smithi159.stdout:2/270: fdatasync d9/da/d25/f4e 0 2024-09-13T22:08:59.890 INFO:tasks.workunit.client.1.smithi159.stdout:8/626: fsync da/d22/f8c 0 2024-09-13T22:08:59.890 INFO:tasks.workunit.client.1.smithi159.stdout:8/627: truncate da/d7e/d82/d6f/f9f 586876 0 2024-09-13T22:08:59.890 INFO:tasks.workunit.client.1.smithi159.stdout:0/482: truncate d0/d48/d4f/d2b/f7c 3418577 0 2024-09-13T22:08:59.891 INFO:tasks.workunit.client.1.smithi159.stdout:0/483: write d0/d5e/f14 [3396079,116853] 0 2024-09-13T22:08:59.893 INFO:tasks.workunit.client.1.smithi159.stdout:7/390: truncate d3/d31/f33 150061 0 2024-09-13T22:08:59.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/271: creat d9/da/d27/f60 x:0 0 0 2024-09-13T22:08:59.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/272: creat d9/d44/f61 x:0 0 0 2024-09-13T22:08:59.897 INFO:tasks.workunit.client.1.smithi159.stdout:8/628: mkdir da/d5d/d70/d8e/dc1/dce/dd4 0 2024-09-13T22:08:59.897 INFO:tasks.workunit.client.1.smithi159.stdout:8/629: dread - da/d22/db3/db9/fca zero size 2024-09-13T22:08:59.897 INFO:tasks.workunit.client.1.smithi159.stdout:8/630: truncate da/d36/d57/f95 491376 0 2024-09-13T22:08:59.897 INFO:tasks.workunit.client.1.smithi159.stdout:8/631: dread - da/d36/d48/d9e/fa3 zero size 2024-09-13T22:08:59.897 INFO:tasks.workunit.client.1.smithi159.stdout:4/542: dread d13/d15/d26/f33 [0,4194304] 0 2024-09-13T22:08:59.897 INFO:tasks.workunit.client.1.smithi159.stdout:1/458: dwrite dd/d1e/d58/d5f/f7c [0,4194304] 0 2024-09-13T22:08:59.897 INFO:tasks.workunit.client.1.smithi159.stdout:0/484: mknod d0/d2c/d71/d97/ca2 0 2024-09-13T22:08:59.899 INFO:tasks.workunit.client.1.smithi159.stdout:7/391: rename d3/f14 to d3/d31/d4d/d4e/d4f/d6c/f84 0 2024-09-13T22:08:59.899 INFO:tasks.workunit.client.1.smithi159.stdout:7/392: write d3/d18/f32 [4300010,122374] 0 2024-09-13T22:08:59.900 INFO:tasks.workunit.client.1.smithi159.stdout:2/273: mknod d9/da/d27/d40/c62 0 2024-09-13T22:08:59.901 INFO:tasks.workunit.client.1.smithi159.stdout:2/274: chown d9/da/d27/d40 27241444 1 2024-09-13T22:08:59.901 INFO:tasks.workunit.client.1.smithi159.stdout:7/393: dread d3/d2e/f35 [0,4194304] 0 2024-09-13T22:08:59.902 INFO:tasks.workunit.client.1.smithi159.stdout:8/632: mkdir da/d7e/d82/d6f/d9a/dd5 0 2024-09-13T22:08:59.902 INFO:tasks.workunit.client.1.smithi159.stdout:8/633: chown da/d22/f34 7 1 2024-09-13T22:08:59.902 INFO:tasks.workunit.client.1.smithi159.stdout:8/634: chown da/d22/d2a/d39/f6e 61930415 1 2024-09-13T22:08:59.902 INFO:tasks.workunit.client.1.smithi159.stdout:8/635: chown da/f18 4243736 1 2024-09-13T22:08:59.905 INFO:tasks.workunit.client.1.smithi159.stdout:4/543: link d13/d15/d26/d29/d3b/d66/d6c/ca8 d13/d15/d26/d29/cb5 0 2024-09-13T22:08:59.906 INFO:tasks.workunit.client.1.smithi159.stdout:1/459: stat dd/d11/d34/c91 0 2024-09-13T22:08:59.906 INFO:tasks.workunit.client.1.smithi159.stdout:1/460: write f3 [229875,65147] 0 2024-09-13T22:08:59.907 INFO:tasks.workunit.client.1.smithi159.stdout:0/485: mkdir d0/d48/d4f/d2b/da3 0 2024-09-13T22:08:59.909 INFO:tasks.workunit.client.1.smithi159.stdout:2/275: truncate d9/da/d25/f35 1436365 0 2024-09-13T22:08:59.911 INFO:tasks.workunit.client.1.smithi159.stdout:7/394: rename d3/d18/f32 to d3/d2e/d6e/d74/f85 0 2024-09-13T22:08:59.912 INFO:tasks.workunit.client.1.smithi159.stdout:8/636: symlink da/da0/ld6 0 2024-09-13T22:08:59.913 INFO:tasks.workunit.client.1.smithi159.stdout:4/544: dread d13/d15/f1d [0,4194304] 0 2024-09-13T22:08:59.913 INFO:tasks.workunit.client.1.smithi159.stdout:4/545: stat d13/d15/d5a 0 2024-09-13T22:08:59.913 INFO:tasks.workunit.client.1.smithi159.stdout:8/637: read da/d36/d48/d9e/fb5 [3214982,131010] 0 2024-09-13T22:08:59.913 INFO:tasks.workunit.client.1.smithi159.stdout:8/638: chown da/d5d/f8a 490 1 2024-09-13T22:08:59.914 INFO:tasks.workunit.client.1.smithi159.stdout:1/461: truncate dd/d11/d13/f45 1329636 0 2024-09-13T22:08:59.917 INFO:tasks.workunit.client.1.smithi159.stdout:0/486: symlink d0/d2c/d96/da1/la4 0 2024-09-13T22:08:59.917 INFO:tasks.workunit.client.1.smithi159.stdout:0/487: chown d0/d5e/f9 6914 1 2024-09-13T22:08:59.918 INFO:tasks.workunit.client.1.smithi159.stdout:0/488: chown d0 1821160 1 2024-09-13T22:08:59.918 INFO:tasks.workunit.client.1.smithi159.stdout:0/489: read - d0/d2c/f65 zero size 2024-09-13T22:08:59.918 INFO:tasks.workunit.client.1.smithi159.stdout:0/490: chown d0/d48/d4f/d54/d74/f89 63790230 1 2024-09-13T22:08:59.919 INFO:tasks.workunit.client.1.smithi159.stdout:7/395: creat d3/d2e/d6e/f86 x:0 0 0 2024-09-13T22:08:59.921 INFO:tasks.workunit.client.1.smithi159.stdout:2/276: write d9/da/f24 [210203,71560] 0 2024-09-13T22:08:59.922 INFO:tasks.workunit.client.1.smithi159.stdout:0/491: mknod d0/d48/d4f/d54/ca5 0 2024-09-13T22:08:59.923 INFO:tasks.workunit.client.1.smithi159.stdout:7/396: symlink d3/d2e/l87 0 2024-09-13T22:08:59.923 INFO:tasks.workunit.client.1.smithi159.stdout:7/397: readlink d3/d31/d4d/l53 0 2024-09-13T22:08:59.925 INFO:tasks.workunit.client.1.smithi159.stdout:1/462: rmdir dd/d1e/d58/d5f/d84 39 2024-09-13T22:08:59.925 INFO:tasks.workunit.client.1.smithi159.stdout:1/463: readlink dd/d11/d18/d49/d2d/l46 0 2024-09-13T22:08:59.926 INFO:tasks.workunit.client.1.smithi159.stdout:0/492: rmdir d0/d48/d4f/d66/d75 39 2024-09-13T22:08:59.928 INFO:tasks.workunit.client.1.smithi159.stdout:1/464: creat dd/d11/d13/d4b/d52/f94 x:0 0 0 2024-09-13T22:08:59.928 INFO:tasks.workunit.client.1.smithi159.stdout:1/465: fdatasync dd/d11/d18/d2e/f66 0 2024-09-13T22:08:59.929 INFO:tasks.workunit.client.1.smithi159.stdout:0/493: rmdir d0/d2c/d96 39 2024-09-13T22:08:59.932 INFO:tasks.workunit.client.1.smithi159.stdout:0/494: getdents d0/d48/d7d 0 2024-09-13T22:08:59.932 INFO:tasks.workunit.client.1.smithi159.stdout:7/398: dread d3/ff [0,4194304] 0 2024-09-13T22:08:59.932 INFO:tasks.workunit.client.1.smithi159.stdout:7/399: read - d3/d2e/f82 zero size 2024-09-13T22:08:59.932 INFO:tasks.workunit.client.1.smithi159.stdout:7/400: readlink d3/d2e/l87 0 2024-09-13T22:08:59.933 INFO:tasks.workunit.client.1.smithi159.stdout:0/495: rename d0/d2c/d96/l9f to d0/d48/d4f/d2b/la6 0 2024-09-13T22:08:59.933 INFO:tasks.workunit.client.1.smithi159.stdout:0/496: fdatasync d0/d48/d4f/d2b/f93 0 2024-09-13T22:08:59.934 INFO:tasks.workunit.client.1.smithi159.stdout:7/401: symlink d3/d3f/l88 0 2024-09-13T22:08:59.934 INFO:tasks.workunit.client.1.smithi159.stdout:7/402: read d3/d31/d4d/d4e/d4f/f58 [2362035,64855] 0 2024-09-13T22:08:59.937 INFO:tasks.workunit.client.1.smithi159.stdout:8/639: dwrite da/d5d/d70/f7b [0,4194304] 0 2024-09-13T22:08:59.937 INFO:tasks.workunit.client.1.smithi159.stdout:4/546: dwrite d13/d15/f62 [0,4194304] 0 2024-09-13T22:08:59.937 INFO:tasks.workunit.client.1.smithi159.stdout:4/547: chown d13/l31 17 1 2024-09-13T22:08:59.937 INFO:tasks.workunit.client.1.smithi159.stdout:9/445: sync 2024-09-13T22:08:59.937 INFO:tasks.workunit.client.1.smithi159.stdout:9/446: truncate d1/dc/f3e 529889 0 2024-09-13T22:08:59.937 INFO:tasks.workunit.client.1.smithi159.stdout:9/447: truncate d1/f48 218994 0 2024-09-13T22:08:59.937 INFO:tasks.workunit.client.1.smithi159.stdout:0/497: rename d0/d48/f59 to d0/d48/d4f/d66/d75/fa7 0 2024-09-13T22:08:59.939 INFO:tasks.workunit.client.1.smithi159.stdout:7/403: link d3/lc d3/d31/d4d/d4e/d7a/l89 0 2024-09-13T22:08:59.939 INFO:tasks.workunit.client.1.smithi159.stdout:7/404: fdatasync d3/d31/d4d/d4e/f52 0 2024-09-13T22:08:59.940 INFO:tasks.workunit.client.1.smithi159.stdout:8/640: link da/d22/d33/d66/l91 da/d5d/d70/ld7 0 2024-09-13T22:08:59.940 INFO:tasks.workunit.client.1.smithi159.stdout:8/641: write da/f31 [4903153,86460] 0 2024-09-13T22:08:59.942 INFO:tasks.workunit.client.1.smithi159.stdout:4/548: creat d13/fb6 x:0 0 0 2024-09-13T22:08:59.943 INFO:tasks.workunit.client.1.smithi159.stdout:9/448: rename d1/dc/f13 to d1/d9/d1f/d99/f9d 0 2024-09-13T22:08:59.944 INFO:tasks.workunit.client.1.smithi159.stdout:0/498: mknod d0/d2c/d71/d97/ca8 0 2024-09-13T22:08:59.944 INFO:tasks.workunit.client.1.smithi159.stdout:1/466: dwrite dd/d1c/f26 [4194304,4194304] 0 2024-09-13T22:08:59.947 INFO:tasks.workunit.client.1.smithi159.stdout:7/405: rmdir d3/d31/d4d/d4e/d7a 39 2024-09-13T22:08:59.948 INFO:tasks.workunit.client.1.smithi159.stdout:8/642: mkdir da/d7e/d82/dd8 0 2024-09-13T22:08:59.950 INFO:tasks.workunit.client.1.smithi159.stdout:4/549: creat d13/d15/fb7 x:0 0 0 2024-09-13T22:08:59.950 INFO:tasks.workunit.client.1.smithi159.stdout:4/550: truncate d13/d15/d26/d29/d3b/d66/f77 165516 0 2024-09-13T22:08:59.950 INFO:tasks.workunit.client.1.smithi159.stdout:4/551: readlink d13/d15/d26/d29/d3b/l48 0 2024-09-13T22:08:59.951 INFO:tasks.workunit.client.1.smithi159.stdout:6/365: sync 2024-09-13T22:08:59.951 INFO:tasks.workunit.client.1.smithi159.stdout:3/291: sync 2024-09-13T22:08:59.951 INFO:tasks.workunit.client.1.smithi159.stdout:5/374: sync 2024-09-13T22:08:59.951 INFO:tasks.workunit.client.1.smithi159.stdout:6/366: fdatasync d3/da/d29/f45 0 2024-09-13T22:08:59.951 INFO:tasks.workunit.client.1.smithi159.stdout:5/375: chown d1/d11/d1c/d20/d44/f7e 1606 1 2024-09-13T22:08:59.955 INFO:tasks.workunit.client.1.smithi159.stdout:9/449: rename d1/dc/d10/d69/f80 to d1/dc/d10/d6d/d4b/f9e 0 2024-09-13T22:08:59.956 INFO:tasks.workunit.client.1.smithi159.stdout:9/450: stat d1/dc/l15 0 2024-09-13T22:08:59.956 INFO:tasks.workunit.client.1.smithi159.stdout:3/292: dread d0/d1/d3/d5/d25/d4e/d5a/f19 [0,4194304] 0 2024-09-13T22:08:59.956 INFO:tasks.workunit.client.1.smithi159.stdout:3/293: chown d0/d1/d3/d5/c8 309 1 2024-09-13T22:08:59.956 INFO:tasks.workunit.client.1.smithi159.stdout:3/294: readlink d0/d1/d3/d5/d25/d4e/d5a/l37 0 2024-09-13T22:08:59.956 INFO:tasks.workunit.client.1.smithi159.stdout:0/499: mknod d0/d2c/d71/ca9 0 2024-09-13T22:08:59.957 INFO:tasks.workunit.client.1.smithi159.stdout:7/406: rmdir d3/d31/d4d/d4e/d4f 39 2024-09-13T22:08:59.957 INFO:tasks.workunit.client.1.smithi159.stdout:7/407: chown d3/d2e/d6e/c79 1 1 2024-09-13T22:08:59.957 INFO:tasks.workunit.client.1.smithi159.stdout:7/408: read d3/d2e/f35 [818529,49236] 0 2024-09-13T22:08:59.959 INFO:tasks.workunit.client.1.smithi159.stdout:8/643: creat da/d5d/d70/d8e/dc1/fd9 x:0 0 0 2024-09-13T22:08:59.964 INFO:tasks.workunit.client.1.smithi159.stdout:6/367: mknod d3/da/d29/d1a/c74 0 2024-09-13T22:08:59.965 INFO:tasks.workunit.client.1.smithi159.stdout:5/376: mkdir d1/d11/d64/d82 0 2024-09-13T22:08:59.966 INFO:tasks.workunit.client.1.smithi159.stdout:3/295: symlink d0/d1/d3/d5/db/l5d 0 2024-09-13T22:08:59.967 INFO:tasks.workunit.client.1.smithi159.stdout:0/500: mkdir d0/d48/d4f/daa 0 2024-09-13T22:08:59.969 INFO:tasks.workunit.client.1.smithi159.stdout:7/409: rename d3/d18/f40 to d3/d18/f8a 0 2024-09-13T22:08:59.969 INFO:tasks.workunit.client.1.smithi159.stdout:7/410: chown d3/d18/f54 35551 1 2024-09-13T22:08:59.970 INFO:tasks.workunit.client.1.smithi159.stdout:5/377: mknod d1/d15/d7b/c83 0 2024-09-13T22:08:59.971 INFO:tasks.workunit.client.1.smithi159.stdout:7/411: creat d3/d31/d49/f8b x:0 0 0 2024-09-13T22:08:59.972 INFO:tasks.workunit.client.1.smithi159.stdout:5/378: mknod d1/d11/c84 0 2024-09-13T22:08:59.973 INFO:tasks.workunit.client.1.smithi159.stdout:5/379: mkdir d1/d11/d1c/d20/d44/d85 0 2024-09-13T22:08:59.975 INFO:tasks.workunit.client.1.smithi159.stdout:7/412: dread d3/d18/f54 [0,4194304] 0 2024-09-13T22:08:59.975 INFO:tasks.workunit.client.1.smithi159.stdout:7/413: dread - d3/d4b/f6d zero size 2024-09-13T22:08:59.977 INFO:tasks.workunit.client.1.smithi159.stdout:9/451: dwrite d1/d9/d2a/d75/f85 [0,4194304] 0 2024-09-13T22:08:59.977 INFO:tasks.workunit.client.1.smithi159.stdout:9/452: creat d1/dc/f9f x:0 0 0 2024-09-13T22:08:59.977 INFO:tasks.workunit.client.1.smithi159.stdout:3/296: dread d0/d1/d3/d5/f17 [0,4194304] 0 2024-09-13T22:08:59.977 INFO:tasks.workunit.client.1.smithi159.stdout:3/297: write d0/d1/d3/dd/f26 [943594,16613] 0 2024-09-13T22:08:59.977 INFO:tasks.workunit.client.1.smithi159.stdout:3/298: write d0/d1/d3/d5/f17 [1542653,110520] 0 2024-09-13T22:08:59.977 INFO:tasks.workunit.client.1.smithi159.stdout:4/552: dwrite d13/f89 [0,4194304] 0 2024-09-13T22:08:59.978 INFO:tasks.workunit.client.1.smithi159.stdout:8/644: dwrite da/d22/db3/db9/fca [0,4194304] 0 2024-09-13T22:08:59.979 INFO:tasks.workunit.client.1.smithi159.stdout:2/277: rmdir d9/d2d 39 2024-09-13T22:08:59.980 INFO:tasks.workunit.client.1.smithi159.stdout:0/501: dread d0/d48/d4f/d54/d74/f73 [0,4194304] 0 2024-09-13T22:08:59.980 INFO:tasks.workunit.client.1.smithi159.stdout:2/278: write d9/d48/f4f [549096,121261] 0 2024-09-13T22:08:59.982 INFO:tasks.workunit.client.1.smithi159.stdout:5/380: dread d1/d11/f37 [0,4194304] 0 2024-09-13T22:08:59.982 INFO:tasks.workunit.client.1.smithi159.stdout:5/381: readlink d1/d11/d64/d17/l22 0 2024-09-13T22:08:59.982 INFO:tasks.workunit.client.1.smithi159.stdout:5/382: chown d1/d11/d64/d17/f4b 1290 1 2024-09-13T22:08:59.982 INFO:tasks.workunit.client.1.smithi159.stdout:3/299: creat d0/d1/d15/f5e x:0 0 0 2024-09-13T22:08:59.982 INFO:tasks.workunit.client.1.smithi159.stdout:7/414: dread d3/f1e [0,4194304] 0 2024-09-13T22:08:59.992 INFO:tasks.workunit.client.1.smithi159.stdout:7/415: write d3/d18/f8a [489872,62011] 0 2024-09-13T22:08:59.994 INFO:tasks.workunit.client.1.smithi159.stdout:8/645: rename da/d7e/d82/d6f/d9a/fc2 to da/d7e/d82/dd8/fda 0 2024-09-13T22:08:59.994 INFO:tasks.workunit.client.1.smithi159.stdout:8/646: chown da/d22/d4a/cbe 25957749 1 2024-09-13T22:08:59.994 INFO:tasks.workunit.client.1.smithi159.stdout:0/502: creat d0/d48/d4f/daa/fab x:0 0 0 2024-09-13T22:08:59.996 INFO:tasks.workunit.client.1.smithi159.stdout:2/279: link d9/d44/f61 d9/da/d5a/f63 0 2024-09-13T22:08:59.999 INFO:tasks.workunit.client.1.smithi159.stdout:5/383: creat d1/d11/d50/f86 x:0 0 0 2024-09-13T22:08:59.999 INFO:tasks.workunit.client.1.smithi159.stdout:5/384: write d1/d11/d64/f3f [1379832,42076] 0 2024-09-13T22:08:59.999 INFO:tasks.workunit.client.1.smithi159.stdout:5/385: dread - d1/d49/f81 zero size 2024-09-13T22:08:59.999 INFO:tasks.workunit.client.1.smithi159.stdout:5/386: chown d1/d11/d64/d17/f4b 0 1 2024-09-13T22:09:00.004 INFO:tasks.workunit.client.1.smithi159.stdout:4/553: getdents d13/d15/d26/d29/d3b/d8e 0 2024-09-13T22:09:00.009 INFO:tasks.workunit.client.1.smithi159.stdout:7/416: symlink d3/d31/d4d/d4e/d4f/d6c/l8c 0 2024-09-13T22:09:00.014 INFO:tasks.workunit.client.1.smithi159.stdout:3/300: rename d0/d1/d3/d5/db/l5d to d0/d1/d3/d5/l5f 0 2024-09-13T22:09:00.014 INFO:tasks.workunit.client.1.smithi159.stdout:3/301: write d0/d1/d3/d5/d25/d4e/f4f [1029160,66148] 0 2024-09-13T22:09:00.014 INFO:tasks.workunit.client.1.smithi159.stdout:0/503: mkdir d0/d48/d4f/d54/dac 0 2024-09-13T22:09:00.014 INFO:tasks.workunit.client.1.smithi159.stdout:0/504: stat d0/d2c/d71/d97/f9b 0 2024-09-13T22:09:00.014 INFO:tasks.workunit.client.1.smithi159.stdout:0/505: readlink d0/d2c/d71/l92 0 2024-09-13T22:09:00.016 INFO:tasks.workunit.client.1.smithi159.stdout:2/280: mknod d9/da/d5a/c64 0 2024-09-13T22:09:00.020 INFO:tasks.workunit.client.1.smithi159.stdout:7/417: rmdir d3/d31/d4d/d4e/d7a 39 2024-09-13T22:09:00.021 INFO:tasks.workunit.client.1.smithi159.stdout:4/554: dwrite d13/d15/d26/d51/d65/d67/d82/fa3 [0,4194304] 0 2024-09-13T22:09:00.022 INFO:tasks.workunit.client.1.smithi159.stdout:3/302: rename d0/d1/d3/d5/d25/d2c/f2d to d0/d1/d3/d5/db/f60 0 2024-09-13T22:09:00.023 INFO:tasks.workunit.client.1.smithi159.stdout:8/647: symlink da/d22/ldb 0 2024-09-13T22:09:00.024 INFO:tasks.workunit.client.1.smithi159.stdout:0/506: creat d0/d2c/d71/d97/fad x:0 0 0 2024-09-13T22:09:00.027 INFO:tasks.workunit.client.1.smithi159.stdout:5/387: unlink d1/ce 0 2024-09-13T22:09:00.029 INFO:tasks.workunit.client.1.smithi159.stdout:7/418: link d3/d2e/c41 d3/d31/d4d/c8d 0 2024-09-13T22:09:00.034 INFO:tasks.workunit.client.1.smithi159.stdout:4/555: stat d13/d15/c1b 0 2024-09-13T22:09:00.036 INFO:tasks.workunit.client.1.smithi159.stdout:8/648: write da/d22/d33/fba [2845021,112653] 0 2024-09-13T22:09:00.037 INFO:tasks.workunit.client.1.smithi159.stdout:3/303: getdents d0/d1/d3/d4d 0 2024-09-13T22:09:00.040 INFO:tasks.workunit.client.1.smithi159.stdout:0/507: link d0/d2c/d71/f99 d0/d5e/d91/fae 0 2024-09-13T22:09:00.042 INFO:tasks.workunit.client.1.smithi159.stdout:7/419: link d3/d4b/f6d d3/d31/d4d/f8e 0 2024-09-13T22:09:00.043 INFO:tasks.workunit.client.1.smithi159.stdout:4/556: mknod d13/d15/d26/d29/d3b/d66/cb8 0 2024-09-13T22:09:00.043 INFO:tasks.workunit.client.1.smithi159.stdout:4/557: stat d13/d15/c2b 0 2024-09-13T22:09:00.043 INFO:tasks.workunit.client.1.smithi159.stdout:4/558: write d13/d15/f17 [3792695,117079] 0 2024-09-13T22:09:00.049 INFO:tasks.workunit.client.1.smithi159.stdout:0/508: mkdir d0/d48/d4f/daf 0 2024-09-13T22:09:00.050 INFO:tasks.workunit.client.1.smithi159.stdout:2/281: dwrite d9/d37/f56 [0,4194304] 0 2024-09-13T22:09:00.051 INFO:tasks.workunit.client.1.smithi159.stdout:4/559: creat d13/d9b/fb9 x:0 0 0 2024-09-13T22:09:00.052 INFO:tasks.workunit.client.1.smithi159.stdout:4/560: chown d13/d41/d79/l7d 1057771495 1 2024-09-13T22:09:00.052 INFO:tasks.workunit.client.1.smithi159.stdout:3/304: getdents d0/d1/d34 0 2024-09-13T22:09:00.053 INFO:tasks.workunit.client.1.smithi159.stdout:3/305: readlink d0/d1/d3/d5/db/d39/l43 0 2024-09-13T22:09:00.055 INFO:tasks.workunit.client.1.smithi159.stdout:0/509: symlink d0/d48/d4f/d66/d75/lb0 0 2024-09-13T22:09:00.057 INFO:tasks.workunit.client.1.smithi159.stdout:8/649: write da/f88 [448479,75481] 0 2024-09-13T22:09:00.062 INFO:tasks.workunit.client.1.smithi159.stdout:0/510: rename d0/d48/d4f/d54/d74/f89 to d0/d5e/d91/fb1 0 2024-09-13T22:09:00.062 INFO:tasks.workunit.client.1.smithi159.stdout:8/650: mknod da/d22/d4a/cdc 0 2024-09-13T22:09:00.062 INFO:tasks.workunit.client.1.smithi159.stdout:8/651: chown da/d22/d2a/d39/d3e/f99 900 1 2024-09-13T22:09:00.064 INFO:tasks.workunit.client.1.smithi159.stdout:5/388: dwrite d1/d11/f37 [4194304,4194304] 0 2024-09-13T22:09:00.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/420: dwrite d3/d31/d4d/d4e/d4f/f58 [4194304,4194304] 0 2024-09-13T22:09:00.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/421: fsync d3/d2e/f82 0 2024-09-13T22:09:00.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/422: fdatasync d3/d31/d49/f71 0 2024-09-13T22:09:00.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/423: chown d3/d18/c50 11 1 2024-09-13T22:09:00.070 INFO:tasks.workunit.client.1.smithi159.stdout:7/424: chown d3/d18/f7c 135396 1 2024-09-13T22:09:00.073 INFO:tasks.workunit.client.1.smithi159.stdout:8/652: creat da/d7e/d82/d6f/d9a/fdd x:0 0 0 2024-09-13T22:09:00.073 INFO:tasks.workunit.client.1.smithi159.stdout:8/653: readlink da/d22/d33/la2 0 2024-09-13T22:09:00.080 INFO:tasks.workunit.client.1.smithi159.stdout:5/389: dread d1/d11/d1c/f51 [0,4194304] 0 2024-09-13T22:09:00.084 INFO:tasks.workunit.client.1.smithi159.stdout:3/306: dwrite d0/d1/f47 [0,4194304] 0 2024-09-13T22:09:00.085 INFO:tasks.workunit.client.1.smithi159.stdout:7/425: dread d3/d3f/f4a [0,4194304] 0 2024-09-13T22:09:00.086 INFO:tasks.workunit.client.1.smithi159.stdout:3/307: symlink d0/d1/d3/d5/db/d58/l61 0 2024-09-13T22:09:00.086 INFO:tasks.workunit.client.1.smithi159.stdout:3/308: write d0/d1/d3/dd/f26 [1039133,75431] 0 2024-09-13T22:09:00.087 INFO:tasks.workunit.client.1.smithi159.stdout:8/654: rmdir da/d7e/db2 39 2024-09-13T22:09:00.093 INFO:tasks.workunit.client.1.smithi159.stdout:0/511: dwrite d0/d5e/f27 [0,4194304] 0 2024-09-13T22:09:00.099 INFO:tasks.workunit.client.1.smithi159.stdout:8/655: creat da/d7e/d82/dd8/fde x:0 0 0 2024-09-13T22:09:00.099 INFO:tasks.workunit.client.1.smithi159.stdout:8/656: write da/d7e/db2/fc9 [164526,64265] 0 2024-09-13T22:09:00.101 INFO:tasks.workunit.client.1.smithi159.stdout:3/309: rename d0/d1/c23 to d0/d1/d3/c62 0 2024-09-13T22:09:00.104 INFO:tasks.workunit.client.1.smithi159.stdout:5/390: dwrite d1/d11/d64/d35/f4c [0,4194304] 0 2024-09-13T22:09:00.104 INFO:tasks.workunit.client.1.smithi159.stdout:5/391: fsync d1/d11/d64/d35/f4c 0 2024-09-13T22:09:00.104 INFO:tasks.workunit.client.1.smithi159.stdout:5/392: truncate d1/d11/d1c/d20/d53/f6a 240604 0 2024-09-13T22:09:00.105 INFO:tasks.workunit.client.1.smithi159.stdout:5/393: creat d1/d11/d1c/d20/d53/f87 x:0 0 0 2024-09-13T22:09:00.105 INFO:tasks.workunit.client.1.smithi159.stdout:5/394: chown d1/d11/d64/d17/f6d 6 1 2024-09-13T22:09:00.105 INFO:tasks.workunit.client.1.smithi159.stdout:0/512: mkdir d0/d48/d4f/d54/d74/db2 0 2024-09-13T22:09:00.105 INFO:tasks.workunit.client.1.smithi159.stdout:0/513: creat d0/d2c/d71/d97/fb3 x:0 0 0 2024-09-13T22:09:00.106 INFO:tasks.workunit.client.1.smithi159.stdout:8/657: creat da/d22/fdf x:0 0 0 2024-09-13T22:09:00.106 INFO:tasks.workunit.client.1.smithi159.stdout:8/658: chown da/d5d/cb4 9 1 2024-09-13T22:09:00.106 INFO:tasks.workunit.client.1.smithi159.stdout:8/659: fsync da/d22/d33/f38 0 2024-09-13T22:09:00.106 INFO:tasks.workunit.client.1.smithi159.stdout:8/660: dread - da/d36/d57/faf zero size 2024-09-13T22:09:00.113 INFO:tasks.workunit.client.1.smithi159.stdout:3/310: dread d0/d1/d3/dd/f13 [4194304,4194304] 0 2024-09-13T22:09:00.114 INFO:tasks.workunit.client.1.smithi159.stdout:0/514: mknod d0/d2c/d96/da1/cb4 0 2024-09-13T22:09:00.114 INFO:tasks.workunit.client.1.smithi159.stdout:0/515: creat d0/d5e/fb5 x:0 0 0 2024-09-13T22:09:00.116 INFO:tasks.workunit.client.1.smithi159.stdout:8/661: unlink da/f15 0 2024-09-13T22:09:00.121 INFO:tasks.workunit.client.1.smithi159.stdout:0/516: write d0/f6a [1834337,119925] 0 2024-09-13T22:09:00.125 INFO:tasks.workunit.client.1.smithi159.stdout:3/311: dread d0/d1/d3/f48 [0,4194304] 0 2024-09-13T22:09:00.127 INFO:tasks.workunit.client.1.smithi159.stdout:5/395: dwrite d1/d11/d64/d35/f57 [0,4194304] 0 2024-09-13T22:09:00.127 INFO:tasks.workunit.client.1.smithi159.stdout:5/396: creat d1/d11/d1c/d20/f88 x:0 0 0 2024-09-13T22:09:00.134 INFO:tasks.workunit.client.1.smithi159.stdout:5/397: rmdir d1/d11/d64/d35/d6f 39 2024-09-13T22:09:00.134 INFO:tasks.workunit.client.1.smithi159.stdout:5/398: chown d1/d11/d50/c65 78583 1 2024-09-13T22:09:00.137 INFO:tasks.workunit.client.1.smithi159.stdout:5/399: mkdir d1/d11/d1c/d20/d44/d89 0 2024-09-13T22:09:00.141 INFO:tasks.workunit.client.1.smithi159.stdout:8/662: dwrite da/d22/f97 [0,4194304] 0 2024-09-13T22:09:00.141 INFO:tasks.workunit.client.1.smithi159.stdout:8/663: chown da/d36/cbf 5717 1 2024-09-13T22:09:00.141 INFO:tasks.workunit.client.1.smithi159.stdout:3/312: fdatasync d0/d1/d3/dd/f26 0 2024-09-13T22:09:00.141 INFO:tasks.workunit.client.1.smithi159.stdout:3/313: creat d0/d1/d3/dd/f63 x:0 0 0 2024-09-13T22:09:00.142 INFO:tasks.workunit.client.1.smithi159.stdout:5/400: dread d1/d11/d1c/d20/d44/f7e [4194304,4194304] 0 2024-09-13T22:09:00.142 INFO:tasks.workunit.client.1.smithi159.stdout:0/517: dwrite d0/d2c/f33 [0,4194304] 0 2024-09-13T22:09:00.144 INFO:tasks.workunit.client.1.smithi159.stdout:8/664: mkdir da/d5d/d70/d8e/de0 0 2024-09-13T22:09:00.145 INFO:tasks.workunit.client.1.smithi159.stdout:8/665: write da/d22/fdf [982216,98980] 0 2024-09-13T22:09:00.147 INFO:tasks.workunit.client.1.smithi159.stdout:4/561: rmdir d13/d15/d26 39 2024-09-13T22:09:00.148 INFO:tasks.workunit.client.1.smithi159.stdout:3/314: truncate d0/d1/d3/f1f 4855418 0 2024-09-13T22:09:00.155 INFO:tasks.workunit.client.1.smithi159.stdout:5/401: creat d1/d15/d7b/f8a x:0 0 0 2024-09-13T22:09:00.157 INFO:tasks.workunit.client.1.smithi159.stdout:0/518: mknod d0/d48/d4f/cb6 0 2024-09-13T22:09:00.157 INFO:tasks.workunit.client.1.smithi159.stdout:0/519: fsync d0/f77 0 2024-09-13T22:09:00.157 INFO:tasks.workunit.client.1.smithi159.stdout:0/520: readlink d0/d48/d4f/d2b/la6 0 2024-09-13T22:09:00.160 INFO:tasks.workunit.client.1.smithi159.stdout:8/666: creat da/d5d/d70/d8e/dc1/dce/fe1 x:0 0 0 2024-09-13T22:09:00.160 INFO:tasks.workunit.client.1.smithi159.stdout:8/667: write da/f7d [69010,31966] 0 2024-09-13T22:09:00.160 INFO:tasks.workunit.client.1.smithi159.stdout:8/668: truncate da/d22/d4a/f7c 577920 0 2024-09-13T22:09:00.164 INFO:tasks.workunit.client.1.smithi159.stdout:4/562: unlink l5 0 2024-09-13T22:09:00.165 INFO:tasks.workunit.client.1.smithi159.stdout:8/669: creat da/d5d/dbc/fe2 x:0 0 0 2024-09-13T22:09:00.167 INFO:tasks.workunit.client.1.smithi159.stdout:8/670: rmdir da/d22/d4a/dcc 39 2024-09-13T22:09:00.167 INFO:tasks.workunit.client.1.smithi159.stdout:8/671: write da/d22/d4a/f7c [1441862,45233] 0 2024-09-13T22:09:00.167 INFO:tasks.workunit.client.1.smithi159.stdout:3/315: dwrite d0/d1/d3/d5/d25/d4e/d5a/f19 [0,4194304] 0 2024-09-13T22:09:00.170 INFO:tasks.workunit.client.1.smithi159.stdout:8/672: rmdir da/d22/d2a/d39/d3e 39 2024-09-13T22:09:00.175 INFO:tasks.workunit.client.1.smithi159.stdout:3/316: rename d0/d1/d3/d5/d25/d4e/f4f to d0/d1/d3/dd/f64 0 2024-09-13T22:09:00.175 INFO:tasks.workunit.client.1.smithi159.stdout:3/317: chown d0/d1/d3/d5/db 16 1 2024-09-13T22:09:00.175 INFO:tasks.workunit.client.1.smithi159.stdout:4/563: write d13/d15/d26/f61 [1572954,75861] 0 2024-09-13T22:09:00.175 INFO:tasks.workunit.client.1.smithi159.stdout:4/564: chown d13/f89 0 1 2024-09-13T22:09:00.176 INFO:tasks.workunit.client.1.smithi159.stdout:8/673: mkdir da/d36/de3 0 2024-09-13T22:09:00.181 INFO:tasks.workunit.client.1.smithi159.stdout:4/565: creat d13/d15/d26/d29/d3b/d66/fba x:0 0 0 2024-09-13T22:09:00.188 INFO:tasks.workunit.client.1.smithi159.stdout:4/566: link d13/d15/d26/d51/d65/f91 d13/d15/fbb 0 2024-09-13T22:09:00.193 INFO:tasks.workunit.client.1.smithi159.stdout:4/567: dread d13/d41/d5d/f78 [0,4194304] 0 2024-09-13T22:09:00.194 INFO:tasks.workunit.client.1.smithi159.stdout:5/402: dwrite d1/d11/d64/f25 [0,4194304] 0 2024-09-13T22:09:00.194 INFO:tasks.workunit.client.1.smithi159.stdout:5/403: creat d1/d15/d7b/f8b x:0 0 0 2024-09-13T22:09:00.194 INFO:tasks.workunit.client.1.smithi159.stdout:8/674: dwrite da/d7e/d82/d6f/d9a/fdd [0,4194304] 0 2024-09-13T22:09:00.194 INFO:tasks.workunit.client.1.smithi159.stdout:8/675: fdatasync da/d5d/dbc/fe2 0 2024-09-13T22:09:00.195 INFO:tasks.workunit.client.1.smithi159.stdout:0/521: dwrite d0/d5e/f3f [0,4194304] 0 2024-09-13T22:09:00.199 INFO:tasks.workunit.client.1.smithi159.stdout:5/404: dread d1/d11/d1c/f6e [0,4194304] 0 2024-09-13T22:09:00.201 INFO:tasks.workunit.client.1.smithi159.stdout:8/676: mkdir da/d7e/d82/d6f/d9a/de4 0 2024-09-13T22:09:00.204 INFO:tasks.workunit.client.1.smithi159.stdout:4/568: dread d13/d15/f62 [0,4194304] 0 2024-09-13T22:09:00.205 INFO:tasks.workunit.client.1.smithi159.stdout:0/522: rename d0/d2c/d71/l92 to d0/d48/d7d/lb7 0 2024-09-13T22:09:00.207 INFO:tasks.workunit.client.1.smithi159.stdout:5/405: mkdir d1/d11/d64/d82/d8c 0 2024-09-13T22:09:00.209 INFO:tasks.workunit.client.1.smithi159.stdout:4/569: rename d13/d15/fa1 to d13/d15/d26/d29/d3b/fbc 0 2024-09-13T22:09:00.210 INFO:tasks.workunit.client.1.smithi159.stdout:5/406: rename d1/d49/l59 to d1/d11/d64/d82/l8d 0 2024-09-13T22:09:00.212 INFO:tasks.workunit.client.1.smithi159.stdout:5/407: rename d1/d15/d7b/f8b to d1/d11/d64/d35/d7c/d7d/f8e 0 2024-09-13T22:09:00.217 INFO:tasks.workunit.client.1.smithi159.stdout:8/677: dwrite da/d36/d57/fd1 [0,4194304] 0 2024-09-13T22:09:00.217 INFO:tasks.workunit.client.1.smithi159.stdout:8/678: truncate da/d5d/d70/d8e/dc1/dce/fe1 217245 0 2024-09-13T22:09:00.217 INFO:tasks.workunit.client.1.smithi159.stdout:8/679: chown da/d36/d57 15398255 1 2024-09-13T22:09:00.227 INFO:tasks.workunit.client.1.smithi159.stdout:8/680: dread da/d22/d33/d8f/f9b [0,4194304] 0 2024-09-13T22:09:00.233 INFO:tasks.workunit.client.1.smithi159.stdout:0/523: dwrite d0/d48/d4f/d2b/f7c [0,4194304] 0 2024-09-13T22:09:00.233 INFO:tasks.workunit.client.1.smithi159.stdout:0/524: chown d0/d5e/l1d 18141804 1 2024-09-13T22:09:00.234 INFO:tasks.workunit.client.1.smithi159.stdout:4/570: dwrite d13/f89 [0,4194304] 0 2024-09-13T22:09:00.254 INFO:tasks.workunit.client.1.smithi159.stdout:0/525: dwrite d0/d48/d4f/d2b/f8f [0,4194304] 0 2024-09-13T22:09:00.271 INFO:tasks.workunit.client.1.smithi159.stdout:0/526: dwrite d0/d48/d4f/d66/f87 [0,4194304] 0 2024-09-13T22:09:00.271 INFO:tasks.workunit.client.1.smithi159.stdout:0/527: fdatasync d0/d5e/d91/fb1 0 2024-09-13T22:09:00.271 INFO:tasks.workunit.client.1.smithi159.stdout:0/528: fsync d0/d48/d4f/d2b/f3b 0 2024-09-13T22:09:00.272 INFO:tasks.workunit.client.1.smithi159.stdout:0/529: chown d0/d2c/d71/d97/f9b 7496 1 2024-09-13T22:09:00.279 INFO:tasks.workunit.client.1.smithi159.stdout:0/530: write d0/d48/d4f/d2b/f7c [905094,47295] 0 2024-09-13T22:09:00.310 INFO:tasks.workunit.client.1.smithi159.stdout:4/571: creat d13/d41/d4d/d75/fbd x:0 0 0 2024-09-13T22:09:00.310 INFO:tasks.workunit.client.1.smithi159.stdout:3/318: rmdir d0/d1/d3/d5 39 2024-09-13T22:09:00.312 INFO:tasks.workunit.client.1.smithi159.stdout:3/319: read d0/d1/d3/d5/d25/d2c/f33 [728697,33937] 0 2024-09-13T22:09:00.312 INFO:tasks.workunit.client.1.smithi159.stdout:3/320: write d0/d1/d3/d5/d25/d2c/f33 [1815725,76222] 0 2024-09-13T22:09:00.322 INFO:tasks.workunit.client.1.smithi159.stdout:0/531: link d0/d48/c4c d0/d2c/cb8 0 2024-09-13T22:09:00.325 INFO:tasks.workunit.client.1.smithi159.stdout:3/321: mkdir d0/d1/d3/d5/d25/d2c/d65 0 2024-09-13T22:09:00.329 INFO:tasks.workunit.client.1.smithi159.stdout:5/408: rename d1/d49 to d1/d11/d64/d82/d8f 0 2024-09-13T22:09:00.330 INFO:tasks.workunit.client.1.smithi159.stdout:5/409: readlink d1/d11/d64/l5b 0 2024-09-13T22:09:00.330 INFO:tasks.workunit.client.1.smithi159.stdout:5/410: write d1/d11/d64/d35/d60/f80 [748932,19633] 0 2024-09-13T22:09:00.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/681: rename da/d36/d57/fd1 to da/d36/d48/fe5 0 2024-09-13T22:09:00.339 INFO:tasks.workunit.client.1.smithi159.stdout:4/572: rename d13/d15/d26/d29/d3b/d66/d6c/f87 to d13/d15/d26/d51/fbe 0 2024-09-13T22:09:00.340 INFO:tasks.workunit.client.1.smithi159.stdout:8/682: symlink da/d36/d48/le6 0 2024-09-13T22:09:00.342 INFO:tasks.workunit.client.1.smithi159.stdout:0/532: rename d0/d48/d4f/l83 to d0/d48/d4f/d2b/lb9 0 2024-09-13T22:09:00.342 INFO:tasks.workunit.client.1.smithi159.stdout:0/533: stat d0/d5e/f61 0 2024-09-13T22:09:00.342 INFO:tasks.workunit.client.1.smithi159.stdout:0/534: write d0/d2c/f65 [94597,129728] 0 2024-09-13T22:09:00.342 INFO:tasks.workunit.client.1.smithi159.stdout:0/535: stat d0/d48/d4f/d54/d74/f73 0 2024-09-13T22:09:00.342 INFO:tasks.workunit.client.1.smithi159.stdout:0/536: read - d0/d48/d4f/daa/fab zero size 2024-09-13T22:09:00.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/573: mkdir d13/d41/dbf 0 2024-09-13T22:09:00.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/574: read d13/d15/fa7 [890020,68750] 0 2024-09-13T22:09:00.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/575: dread - d13/d9b/fb9 zero size 2024-09-13T22:09:00.343 INFO:tasks.workunit.client.1.smithi159.stdout:4/576: fsync d13/f19 0 2024-09-13T22:09:00.344 INFO:tasks.workunit.client.1.smithi159.stdout:8/683: mkdir da/d7e/d82/dd8/de7 0 2024-09-13T22:09:00.345 INFO:tasks.workunit.client.1.smithi159.stdout:8/684: chown da/d36/d48/fe5 800965395 1 2024-09-13T22:09:00.345 INFO:tasks.workunit.client.1.smithi159.stdout:8/685: readlink da/da0/la9 0 2024-09-13T22:09:00.345 INFO:tasks.workunit.client.1.smithi159.stdout:8/686: chown da/d7e/d82/f80 3746494 1 2024-09-13T22:09:00.345 INFO:tasks.workunit.client.1.smithi159.stdout:8/687: fsync da/d36/d48/d9e/fa3 0 2024-09-13T22:09:00.346 INFO:tasks.workunit.client.1.smithi159.stdout:0/537: rename d0/d2c/f95 to d0/d48/d7d/fba 0 2024-09-13T22:09:00.350 INFO:tasks.workunit.client.1.smithi159.stdout:4/577: rename d13/d15/d26/d29/d8b/ca6 to d13/d15/d26/d51/d65/d67/d82/cc0 0 2024-09-13T22:09:00.351 INFO:tasks.workunit.client.1.smithi159.stdout:4/578: mknod d13/d9b/cc1 0 2024-09-13T22:09:00.360 INFO:tasks.workunit.client.1.smithi159.stdout:3/322: dwrite d0/d1/d34/f40 [0,4194304] 0 2024-09-13T22:09:00.360 INFO:tasks.workunit.client.1.smithi159.stdout:3/323: read - d0/d1/d3/d4d/d5b/d45/f51 zero size 2024-09-13T22:09:00.360 INFO:tasks.workunit.client.1.smithi159.stdout:3/324: fdatasync d0/d1/d3/dd/f10 0 2024-09-13T22:09:00.367 INFO:tasks.workunit.client.1.smithi159.stdout:5/411: dwrite d1/d11/d64/d35/d6f/f7f [0,4194304] 0 2024-09-13T22:09:00.368 INFO:tasks.workunit.client.1.smithi159.stdout:8/688: dwrite da/d7e/d82/d6f/f9f [0,4194304] 0 2024-09-13T22:09:00.372 INFO:tasks.workunit.client.1.smithi159.stdout:5/412: symlink d1/d11/d64/d35/d60/l90 0 2024-09-13T22:09:00.373 INFO:tasks.workunit.client.1.smithi159.stdout:3/325: dread d0/d1/d3/f1c [0,4194304] 0 2024-09-13T22:09:00.375 INFO:tasks.workunit.client.1.smithi159.stdout:8/689: getdents da/d5d/d70/d8e 0 2024-09-13T22:09:00.375 INFO:tasks.workunit.client.1.smithi159.stdout:8/690: creat da/d7e/d82/dd8/fe8 x:0 0 0 2024-09-13T22:09:00.375 INFO:tasks.workunit.client.1.smithi159.stdout:8/691: readlink da/l1b 0 2024-09-13T22:09:00.379 INFO:tasks.workunit.client.1.smithi159.stdout:4/579: dwrite d13/d15/d26/d29/d3b/fb4 [0,4194304] 0 2024-09-13T22:09:00.379 INFO:tasks.workunit.client.1.smithi159.stdout:4/580: fdatasync d13/d15/d26/f72 0 2024-09-13T22:09:00.379 INFO:tasks.workunit.client.1.smithi159.stdout:4/581: getdents d13/d41/dbf 0 2024-09-13T22:09:00.380 INFO:tasks.workunit.client.1.smithi159.stdout:5/413: symlink d1/d11/d64/d35/l91 0 2024-09-13T22:09:00.387 INFO:tasks.workunit.client.1.smithi159.stdout:4/582: link d13/d15/d26/f37 d13/d9b/fc2 0 2024-09-13T22:09:00.388 INFO:tasks.workunit.client.1.smithi159.stdout:3/326: dwrite d0/d1/d3/f48 [0,4194304] 0 2024-09-13T22:09:00.390 INFO:tasks.workunit.client.1.smithi159.stdout:5/414: creat d1/d11/d1c/d20/d44/d89/f92 x:0 0 0 2024-09-13T22:09:00.390 INFO:tasks.workunit.client.1.smithi159.stdout:5/415: write d1/d11/d64/d35/f57 [5227357,108837] 0 2024-09-13T22:09:00.390 INFO:tasks.workunit.client.1.smithi159.stdout:5/416: creat d1/d11/d1c/d20/d44/d89/f93 x:0 0 0 2024-09-13T22:09:00.391 INFO:tasks.workunit.client.1.smithi159.stdout:4/583: creat d13/d15/d26/fc3 x:0 0 0 2024-09-13T22:09:00.393 INFO:tasks.workunit.client.1.smithi159.stdout:5/417: symlink d1/d11/d64/d82/d8f/l94 0 2024-09-13T22:09:00.393 INFO:tasks.workunit.client.1.smithi159.stdout:5/418: write d1/d11/d64/d35/f40 [1050009,83481] 0 2024-09-13T22:09:00.395 INFO:tasks.workunit.client.1.smithi159.stdout:4/584: link d13/d15/d26/d51/d65/fa5 d13/d41/d4d/fc4 0 2024-09-13T22:09:00.396 INFO:tasks.workunit.client.1.smithi159.stdout:5/419: truncate d1/d11/d1c/f6e 2729240 0 2024-09-13T22:09:00.397 INFO:tasks.workunit.client.1.smithi159.stdout:4/585: symlink d13/d15/d26/d29/d3b/d66/d6c/lc5 0 2024-09-13T22:09:00.400 INFO:tasks.workunit.client.1.smithi159.stdout:5/420: symlink d1/d11/d64/d35/l95 0 2024-09-13T22:09:00.400 INFO:tasks.workunit.client.1.smithi159.stdout:5/421: stat d1/d11/d1c/d20/d44/d85 0 2024-09-13T22:09:00.400 INFO:tasks.workunit.client.1.smithi159.stdout:4/586: mknod d13/d15/d26/d29/cc6 0 2024-09-13T22:09:00.402 INFO:tasks.workunit.client.1.smithi159.stdout:5/422: creat d1/f96 x:0 0 0 2024-09-13T22:09:00.403 INFO:tasks.workunit.client.1.smithi159.stdout:4/587: unlink d13/d9b/fb9 0 2024-09-13T22:09:00.405 INFO:tasks.workunit.client.1.smithi159.stdout:5/423: creat d1/f97 x:0 0 0 2024-09-13T22:09:00.405 INFO:tasks.workunit.client.1.smithi159.stdout:5/424: stat d1/d11/d1c/d32 0 2024-09-13T22:09:00.406 INFO:tasks.workunit.client.1.smithi159.stdout:4/588: mknod d13/d15/d26/d51/d65/cc7 0 2024-09-13T22:09:00.408 INFO:tasks.workunit.client.1.smithi159.stdout:5/425: symlink d1/d11/d50/l98 0 2024-09-13T22:09:00.408 INFO:tasks.workunit.client.1.smithi159.stdout:5/426: creat d1/d11/d1c/d20/d44/d89/f99 x:0 0 0 2024-09-13T22:09:00.408 INFO:tasks.workunit.client.1.smithi159.stdout:5/427: creat d1/d11/d1c/d20/f9a x:0 0 0 2024-09-13T22:09:00.409 INFO:tasks.workunit.client.1.smithi159.stdout:5/428: write d1/d11/d1c/d20/f5a [725981,100883] 0 2024-09-13T22:09:00.412 INFO:tasks.workunit.client.1.smithi159.stdout:5/429: getdents d1/d11/d64/d35/d7c 0 2024-09-13T22:09:00.415 INFO:tasks.workunit.client.1.smithi159.stdout:5/430: rename d1/d11/d64/d17/l1d to d1/d11/d50/l9b 0 2024-09-13T22:09:00.416 INFO:tasks.workunit.client.1.smithi159.stdout:4/589: dread d13/f89 [0,4194304] 0 2024-09-13T22:09:00.416 INFO:tasks.workunit.client.1.smithi159.stdout:4/590: chown d13/l58 35 1 2024-09-13T22:09:00.417 INFO:tasks.workunit.client.1.smithi159.stdout:5/431: truncate d1/d11/d64/d35/f56 6316965 0 2024-09-13T22:09:00.418 INFO:tasks.workunit.client.1.smithi159.stdout:4/591: mkdir d13/d15/d26/d51/dc8 0 2024-09-13T22:09:00.418 INFO:tasks.workunit.client.1.smithi159.stdout:4/592: truncate d13/d15/d26/d29/f90 4210560 0 2024-09-13T22:09:00.418 INFO:tasks.workunit.client.1.smithi159.stdout:4/593: write f8 [2557709,44000] 0 2024-09-13T22:09:00.422 INFO:tasks.workunit.client.1.smithi159.stdout:5/432: mkdir d1/d11/d1c/d9c 0 2024-09-13T22:09:00.422 INFO:tasks.workunit.client.1.smithi159.stdout:5/433: chown d1/d11/c7a 3 1 2024-09-13T22:09:00.434 INFO:tasks.workunit.client.1.smithi159.stdout:4/594: mkdir d13/d9b/dc9 0 2024-09-13T22:09:00.437 INFO:tasks.workunit.client.1.smithi159.stdout:5/434: rename d1/d11/d1c/l6c to d1/d11/d1c/d20/d44/l9d 0 2024-09-13T22:09:00.444 INFO:tasks.workunit.client.1.smithi159.stdout:1/467: sync 2024-09-13T22:09:00.446 INFO:tasks.workunit.client.1.smithi159.stdout:4/595: write d13/d15/d26/d51/d65/f70 [3609305,22403] 0 2024-09-13T22:09:00.446 INFO:tasks.workunit.client.1.smithi159.stdout:4/596: dread - d13/d15/d26/d51/d65/f91 zero size 2024-09-13T22:09:00.449 INFO:tasks.workunit.client.1.smithi159.stdout:1/468: mkdir dd/d11/d18/d2e/d3c/d95 0 2024-09-13T22:09:00.450 INFO:tasks.workunit.client.1.smithi159.stdout:4/597: unlink d13/d41/d79/f94 0 2024-09-13T22:09:00.453 INFO:tasks.workunit.client.1.smithi159.stdout:5/435: rename d1/d15 to d1/d11/d9e 0 2024-09-13T22:09:00.454 INFO:tasks.workunit.client.1.smithi159.stdout:5/436: symlink d1/d11/d64/d35/l9f 0 2024-09-13T22:09:00.454 INFO:tasks.workunit.client.1.smithi159.stdout:5/437: write d1/d11/d64/d35/d7c/d7d/f8e [734300,72033] 0 2024-09-13T22:09:00.454 INFO:tasks.workunit.client.1.smithi159.stdout:5/438: truncate d1/d11/f75 741878 0 2024-09-13T22:09:00.455 INFO:tasks.workunit.client.1.smithi159.stdout:5/439: dread - d1/d11/d50/f86 zero size 2024-09-13T22:09:00.455 INFO:tasks.workunit.client.1.smithi159.stdout:5/440: fdatasync d1/d11/f4d 0 2024-09-13T22:09:00.459 INFO:tasks.workunit.client.1.smithi159.stdout:1/469: write dd/d11/d18/d2e/f33 [6584023,79714] 0 2024-09-13T22:09:00.459 INFO:tasks.workunit.client.1.smithi159.stdout:1/470: getdents dd/d1e/d58/d8a 0 2024-09-13T22:09:00.459 INFO:tasks.workunit.client.1.smithi159.stdout:1/471: chown dd/d11/f4f 251 1 2024-09-13T22:09:00.462 INFO:tasks.workunit.client.1.smithi159.stdout:4/598: write d13/d41/f42 [6023988,91032] 0 2024-09-13T22:09:00.485 INFO:tasks.workunit.client.1.smithi159.stdout:1/472: dwrite dd/d11/d18/d49/f5a [0,4194304] 0 2024-09-13T22:09:00.532 INFO:tasks.workunit.client.1.smithi159.stdout:4/599: write d13/d15/d26/d51/f5f [409277,44386] 0 2024-09-13T22:09:00.534 INFO:tasks.workunit.client.1.smithi159.stdout:1/473: mknod dd/d11/d13/d4b/d52/d63/c96 0 2024-09-13T22:09:00.537 INFO:tasks.workunit.client.1.smithi159.stdout:4/600: creat d13/d15/d26/d29/d3b/d8e/fca x:0 0 0 2024-09-13T22:09:00.542 INFO:tasks.workunit.client.1.smithi159.stdout:1/474: rename dd/d11/d34/d53 to dd/d11/d18/d49/d2d/d97 0 2024-09-13T22:09:00.542 INFO:tasks.workunit.client.1.smithi159.stdout:1/475: write dd/f1b [3932043,8304] 0 2024-09-13T22:09:00.544 INFO:tasks.workunit.client.1.smithi159.stdout:4/601: symlink d13/d20/lcb 0 2024-09-13T22:09:00.550 INFO:tasks.workunit.client.1.smithi159.stdout:1/476: dread dd/d11/f24 [0,4194304] 0 2024-09-13T22:09:00.550 INFO:tasks.workunit.client.1.smithi159.stdout:1/477: fsync dd/f16 0 2024-09-13T22:09:00.551 INFO:tasks.workunit.client.1.smithi159.stdout:4/602: rmdir d13/d15/d26/d29/d8b 0 2024-09-13T22:09:00.559 INFO:tasks.workunit.client.1.smithi159.stdout:4/603: dread d13/d15/d26/f37 [0,4194304] 0 2024-09-13T22:09:00.560 INFO:tasks.workunit.client.1.smithi159.stdout:4/604: link d13/d41/d5d/c9a d13/d41/d50/ccc 0 2024-09-13T22:09:00.561 INFO:tasks.workunit.client.1.smithi159.stdout:4/605: write d13/d15/d26/d51/d65/f91 [184466,25327] 0 2024-09-13T22:09:00.568 INFO:tasks.workunit.client.1.smithi159.stdout:1/478: dwrite dd/d11/d34/d59/f92 [0,4194304] 0 2024-09-13T22:09:00.568 INFO:tasks.workunit.client.1.smithi159.stdout:1/479: dread - dd/d11/d18/d2e/f65 zero size 2024-09-13T22:09:00.569 INFO:tasks.workunit.client.1.smithi159.stdout:4/606: dread d13/d15/d26/d29/d3b/fb4 [0,4194304] 0 2024-09-13T22:09:00.570 INFO:tasks.workunit.client.1.smithi159.stdout:1/480: link dd/d1c/f25 dd/d11/d34/d59/f98 0 2024-09-13T22:09:00.572 INFO:tasks.workunit.client.1.smithi159.stdout:4/607: creat d13/d41/dbf/fcd x:0 0 0 2024-09-13T22:09:00.580 INFO:tasks.workunit.client.1.smithi159.stdout:4/608: dread d13/d41/d5d/fa9 [0,4194304] 0 2024-09-13T22:09:00.582 INFO:tasks.workunit.client.1.smithi159.stdout:4/609: creat d13/d15/d26/d51/d65/d67/d82/fce x:0 0 0 2024-09-13T22:09:00.584 INFO:tasks.workunit.client.1.smithi159.stdout:1/481: dwrite dd/d1c/f86 [0,4194304] 0 2024-09-13T22:09:00.587 INFO:tasks.workunit.client.1.smithi159.stdout:4/610: dread d13/d41/d79/fa4 [0,4194304] 0 2024-09-13T22:09:00.587 INFO:tasks.workunit.client.1.smithi159.stdout:4/611: stat d13/d9b/fc2 0 2024-09-13T22:09:00.587 INFO:tasks.workunit.client.1.smithi159.stdout:4/612: write d13/d15/d26/d51/f5f [855119,31799] 0 2024-09-13T22:09:00.587 INFO:tasks.workunit.client.1.smithi159.stdout:4/613: creat d13/d15/d26/d51/d65/d67/d82/fcf x:0 0 0 2024-09-13T22:09:00.587 INFO:tasks.workunit.client.1.smithi159.stdout:4/614: readlink d13/d15/l35 0 2024-09-13T22:09:00.588 INFO:tasks.workunit.client.1.smithi159.stdout:1/482: creat dd/d11/d34/f99 x:0 0 0 2024-09-13T22:09:00.593 INFO:tasks.workunit.client.1.smithi159.stdout:4/615: dread d13/d15/d26/d51/d65/f70 [0,4194304] 0 2024-09-13T22:09:00.593 INFO:tasks.workunit.client.1.smithi159.stdout:1/483: rmdir dd/d1c 39 2024-09-13T22:09:00.595 INFO:tasks.workunit.client.1.smithi159.stdout:4/616: rename d13/d15/fb7 to d13/d15/d26/d29/d3b/d8e/fd0 0 2024-09-13T22:09:00.597 INFO:tasks.workunit.client.1.smithi159.stdout:1/484: unlink dd/d11/d18/d49/f5a 0 2024-09-13T22:09:00.599 INFO:tasks.workunit.client.1.smithi159.stdout:1/485: getdents dd/d11/d18/d49/d2d/d97 0 2024-09-13T22:09:00.601 INFO:tasks.workunit.client.1.smithi159.stdout:1/486: mkdir dd/d11/d18/d74/d82/d9a 0 2024-09-13T22:09:00.603 INFO:tasks.workunit.client.1.smithi159.stdout:4/617: read d13/d20/f59 [3798414,30919] 0 2024-09-13T22:09:00.605 INFO:tasks.workunit.client.1.smithi159.stdout:4/618: mkdir d13/d15/d26/d51/d65/d67/dd1 0 2024-09-13T22:09:00.606 INFO:tasks.workunit.client.1.smithi159.stdout:4/619: symlink d13/d9b/ld2 0 2024-09-13T22:09:00.607 INFO:tasks.workunit.client.1.smithi159.stdout:6/368: sync 2024-09-13T22:09:00.608 INFO:tasks.workunit.client.1.smithi159.stdout:9/453: sync 2024-09-13T22:09:00.616 INFO:tasks.workunit.client.1.smithi159.stdout:4/620: dread d13/d15/f1f [4194304,4194304] 0 2024-09-13T22:09:00.629 INFO:tasks.workunit.client.1.smithi159.stdout:9/454: dwrite d1/dc/f9f [0,4194304] 0 2024-09-13T22:09:00.629 INFO:tasks.workunit.client.1.smithi159.stdout:6/369: dwrite d3/d2a/d3c/d46/f4c [0,4194304] 0 2024-09-13T22:09:00.632 INFO:tasks.workunit.client.1.smithi159.stdout:9/455: rename d1/dc/d10/c32 to d1/d5a/ca0 0 2024-09-13T22:09:00.633 INFO:tasks.workunit.client.1.smithi159.stdout:9/456: fsync d1/dc/d10/d6d/d2f/f37 0 2024-09-13T22:09:00.633 INFO:tasks.workunit.client.1.smithi159.stdout:6/370: mknod d3/da/d25/d69/c75 0 2024-09-13T22:09:00.635 INFO:tasks.workunit.client.1.smithi159.stdout:9/457: mkdir d1/dc/d10/d6d/d2f/d8b/da1 0 2024-09-13T22:09:00.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/458: rename d1/dc/d10/d6d/d2f/d8b/c96 to d1/d9/d2a/ca2 0 2024-09-13T22:09:00.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/459: chown d1/l5c 3 1 2024-09-13T22:09:00.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/460: write d1/dc/d10/d6d/d2f/d8b/f97 [990769,30555] 0 2024-09-13T22:09:00.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/461: creat d1/dc/d10/fa3 x:0 0 0 2024-09-13T22:09:00.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/462: chown d1/d9/c35 7 1 2024-09-13T22:09:00.640 INFO:tasks.workunit.client.1.smithi159.stdout:9/463: unlink d1/dc/d10/d69/c7c 0 2024-09-13T22:09:00.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/371: dwrite d3/da/d29/f17 [0,4194304] 0 2024-09-13T22:09:00.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/372: write d3/f27 [2023976,84382] 0 2024-09-13T22:09:00.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/373: chown d3/c4 8841547 1 2024-09-13T22:09:00.651 INFO:tasks.workunit.client.1.smithi159.stdout:6/374: creat d3/da/d29/d26/d6c/f76 x:0 0 0 2024-09-13T22:09:00.654 INFO:tasks.workunit.client.1.smithi159.stdout:6/375: dread d3/d2a/d3c/d50/f5e [0,4194304] 0 2024-09-13T22:09:00.669 INFO:tasks.workunit.client.1.smithi159.stdout:9/464: dwrite d1/f64 [0,4194304] 0 2024-09-13T22:09:00.669 INFO:tasks.workunit.client.1.smithi159.stdout:6/376: dwrite d3/da/d25/f5b [0,4194304] 0 2024-09-13T22:09:00.669 INFO:tasks.workunit.client.1.smithi159.stdout:6/377: dread - d3/da/d29/f63 zero size 2024-09-13T22:09:00.678 INFO:tasks.workunit.client.1.smithi159.stdout:9/465: write d1/dc/d10/d6d/d4b/f76 [4000513,95154] 0 2024-09-13T22:09:00.678 INFO:tasks.workunit.client.1.smithi159.stdout:9/466: chown d1/dc/d10/l59 2330671 1 2024-09-13T22:09:00.681 INFO:tasks.workunit.client.1.smithi159.stdout:9/467: mkdir d1/dc/d27/da4 0 2024-09-13T22:09:00.683 INFO:tasks.workunit.client.1.smithi159.stdout:9/468: creat d1/d5a/fa5 x:0 0 0 2024-09-13T22:09:00.683 INFO:tasks.workunit.client.1.smithi159.stdout:6/378: dwrite d3/da/d29/d26/f37 [0,4194304] 0 2024-09-13T22:09:00.684 INFO:tasks.workunit.client.1.smithi159.stdout:9/469: creat d1/d9/d2a/d75/fa6 x:0 0 0 2024-09-13T22:09:00.685 INFO:tasks.workunit.client.1.smithi159.stdout:6/379: creat d3/d2a/d3c/d46/d73/f77 x:0 0 0 2024-09-13T22:09:00.686 INFO:tasks.workunit.client.1.smithi159.stdout:9/470: rename d1/dc/d10/d6d/d87/l8a to d1/dc/d10/d6d/d87/la7 0 2024-09-13T22:09:00.692 INFO:tasks.workunit.client.1.smithi159.stdout:6/380: creat d3/da/d29/d1a/d3e/d5a/f78 x:0 0 0 2024-09-13T22:09:00.694 INFO:tasks.workunit.client.1.smithi159.stdout:9/471: mkdir d1/dc/d10/d6d/d4b/d98/da8 0 2024-09-13T22:09:00.695 INFO:tasks.workunit.client.1.smithi159.stdout:6/381: mknod d3/d2a/d3c/d46/c79 0 2024-09-13T22:09:00.697 INFO:tasks.workunit.client.1.smithi159.stdout:9/472: mknod d1/dc/d27/da4/ca9 0 2024-09-13T22:09:00.697 INFO:tasks.workunit.client.1.smithi159.stdout:9/473: dread - d1/dc/f9a zero size 2024-09-13T22:09:00.697 INFO:tasks.workunit.client.1.smithi159.stdout:9/474: chown d1/dc/d10/d6d/d4b/d98 2 1 2024-09-13T22:09:00.706 INFO:tasks.workunit.client.1.smithi159.stdout:9/475: write d1/f64 [3269685,61652] 0 2024-09-13T22:09:00.706 INFO:tasks.workunit.client.1.smithi159.stdout:9/476: creat d1/dc/d10/faa x:0 0 0 2024-09-13T22:09:00.706 INFO:tasks.workunit.client.1.smithi159.stdout:9/477: chown d1/dc/d10/d6d/l4d 69751 1 2024-09-13T22:09:00.707 INFO:tasks.workunit.client.1.smithi159.stdout:6/382: dwrite d3/da/d25/f4b [0,4194304] 0 2024-09-13T22:09:00.713 INFO:tasks.workunit.client.1.smithi159.stdout:6/383: mknod d3/d64/c7a 0 2024-09-13T22:09:00.714 INFO:tasks.workunit.client.1.smithi159.stdout:9/478: getdents d1/d9/d2a/d75 0 2024-09-13T22:09:00.714 INFO:tasks.workunit.client.1.smithi159.stdout:9/479: readlink d1/dc/d10/d6d/d2f/l71 0 2024-09-13T22:09:00.719 INFO:tasks.workunit.client.1.smithi159.stdout:6/384: getdents d3/da/d29/d1a/d3e/d5a 0 2024-09-13T22:09:00.719 INFO:tasks.workunit.client.1.smithi159.stdout:6/385: stat d3/da/d25 0 2024-09-13T22:09:00.721 INFO:tasks.workunit.client.1.smithi159.stdout:9/480: dread d1/dc/f12 [0,4194304] 0 2024-09-13T22:09:00.722 INFO:tasks.workunit.client.1.smithi159.stdout:6/386: mknod d3/da/d25/c7b 0 2024-09-13T22:09:00.724 INFO:tasks.workunit.client.1.smithi159.stdout:9/481: mkdir d1/d9/dab 0 2024-09-13T22:09:00.727 INFO:tasks.workunit.client.1.smithi159.stdout:6/387: truncate d3/da/d29/f11 1325534 0 2024-09-13T22:09:00.729 INFO:tasks.workunit.client.1.smithi159.stdout:6/388: dread d3/da/d29/f45 [0,4194304] 0 2024-09-13T22:09:00.729 INFO:tasks.workunit.client.1.smithi159.stdout:6/389: getdents d3/d6d 0 2024-09-13T22:09:00.731 INFO:tasks.workunit.client.1.smithi159.stdout:6/390: link c0 d3/da/d29/d26/d6c/c7c 0 2024-09-13T22:09:00.732 INFO:tasks.workunit.client.1.smithi159.stdout:6/391: dread d3/da/d29/d26/f4d [0,4194304] 0 2024-09-13T22:09:00.737 INFO:tasks.workunit.client.1.smithi159.stdout:6/392: rmdir d3/da/d29/d1a/d3e/d5a/d6a 39 2024-09-13T22:09:00.739 INFO:tasks.workunit.client.1.smithi159.stdout:6/393: rename d3/da/d25/d52/f59 to d3/da/d29/d1a/d3e/d5a/f7d 0 2024-09-13T22:09:00.741 INFO:tasks.workunit.client.1.smithi159.stdout:9/482: dwrite d1/dc/d10/d6d/f86 [0,4194304] 0 2024-09-13T22:09:00.745 INFO:tasks.workunit.client.1.smithi159.stdout:2/282: sync 2024-09-13T22:09:00.745 INFO:tasks.workunit.client.1.smithi159.stdout:7/426: sync 2024-09-13T22:09:00.749 INFO:tasks.workunit.client.1.smithi159.stdout:7/427: creat d3/d3f/f8f x:0 0 0 2024-09-13T22:09:00.752 INFO:tasks.workunit.client.1.smithi159.stdout:7/428: creat d3/d31/d4d/d4e/d4f/d6c/f90 x:0 0 0 2024-09-13T22:09:00.754 INFO:tasks.workunit.client.1.smithi159.stdout:7/429: getdents d3/d2e/d6e 0 2024-09-13T22:09:00.754 INFO:tasks.workunit.client.1.smithi159.stdout:7/430: stat d3/d18/f54 0 2024-09-13T22:09:00.764 INFO:tasks.workunit.client.1.smithi159.stdout:6/394: dwrite d3/da/d29/d1a/d3e/d5a/f78 [0,4194304] 0 2024-09-13T22:09:00.764 INFO:tasks.workunit.client.1.smithi159.stdout:6/395: chown d3/da/d25/d52/f72 477 1 2024-09-13T22:09:00.766 INFO:tasks.workunit.client.1.smithi159.stdout:7/431: read d3/d31/d4d/d4e/f52 [7611917,127817] 0 2024-09-13T22:09:00.767 INFO:tasks.workunit.client.1.smithi159.stdout:9/483: dwrite d1/dc/f12 [0,4194304] 0 2024-09-13T22:09:00.768 INFO:tasks.workunit.client.1.smithi159.stdout:6/396: unlink d3/da/cb 0 2024-09-13T22:09:00.769 INFO:tasks.workunit.client.1.smithi159.stdout:2/283: dwrite d9/da/f24 [0,4194304] 0 2024-09-13T22:09:00.769 INFO:tasks.workunit.client.1.smithi159.stdout:2/284: dread - d9/da/d27/d40/f45 zero size 2024-09-13T22:09:00.772 INFO:tasks.workunit.client.1.smithi159.stdout:9/484: creat d1/dc/d10/d6d/fac x:0 0 0 2024-09-13T22:09:00.773 INFO:tasks.workunit.client.1.smithi159.stdout:6/397: creat d3/f7e x:0 0 0 2024-09-13T22:09:00.786 INFO:tasks.workunit.client.1.smithi159.stdout:7/432: dwrite d3/d18/f20 [0,4194304] 0 2024-09-13T22:09:00.793 INFO:tasks.workunit.client.1.smithi159.stdout:9/485: creat d1/dc/d10/d9c/fad x:0 0 0 2024-09-13T22:09:00.793 INFO:tasks.workunit.client.1.smithi159.stdout:9/486: creat d1/dc/d10/fae x:0 0 0 2024-09-13T22:09:00.798 INFO:tasks.workunit.client.1.smithi159.stdout:7/433: truncate d3/d31/d4d/d4e/f52 824755 0 2024-09-13T22:09:00.799 INFO:tasks.workunit.client.1.smithi159.stdout:7/434: truncate d3/f62 186903 0 2024-09-13T22:09:00.799 INFO:tasks.workunit.client.1.smithi159.stdout:7/435: write d3/d31/d4d/d4e/d4f/d6c/f84 [1393473,99968] 0 2024-09-13T22:09:00.799 INFO:tasks.workunit.client.1.smithi159.stdout:7/436: chown d3/d18/f7c 53563 1 2024-09-13T22:09:00.799 INFO:tasks.workunit.client.1.smithi159.stdout:7/437: creat d3/d3f/f91 x:0 0 0 2024-09-13T22:09:00.801 INFO:tasks.workunit.client.1.smithi159.stdout:9/487: dread d1/dc/d27/f65 [0,4194304] 0 2024-09-13T22:09:00.803 INFO:tasks.workunit.client.1.smithi159.stdout:1/487: sync 2024-09-13T22:09:00.803 INFO:tasks.workunit.client.1.smithi159.stdout:8/692: sync 2024-09-13T22:09:00.803 INFO:tasks.workunit.client.1.smithi159.stdout:0/538: sync 2024-09-13T22:09:00.804 INFO:tasks.workunit.client.1.smithi159.stdout:0/539: chown d0/d2c/f8c 142202 1 2024-09-13T22:09:00.804 INFO:tasks.workunit.client.1.smithi159.stdout:0/540: dread - d0/d48/d4f/f69 zero size 2024-09-13T22:09:00.804 INFO:tasks.workunit.client.1.smithi159.stdout:3/327: sync 2024-09-13T22:09:00.804 INFO:tasks.workunit.client.1.smithi159.stdout:5/441: sync 2024-09-13T22:09:00.807 INFO:tasks.workunit.client.1.smithi159.stdout:9/488: dread d1/f7b [0,4194304] 0 2024-09-13T22:09:00.807 INFO:tasks.workunit.client.1.smithi159.stdout:9/489: fdatasync d1/dc/d10/d6d/d2f/f68 0 2024-09-13T22:09:00.815 INFO:tasks.workunit.client.1.smithi159.stdout:6/398: rmdir d3 39 2024-09-13T22:09:00.818 INFO:tasks.workunit.client.1.smithi159.stdout:4/621: sync 2024-09-13T22:09:00.819 INFO:tasks.workunit.client.1.smithi159.stdout:4/622: readlink d13/d20/l56 0 2024-09-13T22:09:00.819 INFO:tasks.workunit.client.1.smithi159.stdout:1/488: creat dd/d11/d18/f9b x:0 0 0 2024-09-13T22:09:00.819 INFO:tasks.workunit.client.1.smithi159.stdout:1/489: fsync dd/d11/d13/f5c 0 2024-09-13T22:09:00.821 INFO:tasks.workunit.client.1.smithi159.stdout:0/541: link d0/d48/d4f/d54/c64 d0/d2c/cbb 0 2024-09-13T22:09:00.822 INFO:tasks.workunit.client.1.smithi159.stdout:3/328: unlink d0/d1/d3/d5/c49 0 2024-09-13T22:09:00.822 INFO:tasks.workunit.client.1.smithi159.stdout:0/542: write d0/d2c/d71/f99 [1220299,130892] 0 2024-09-13T22:09:00.823 INFO:tasks.workunit.client.1.smithi159.stdout:6/399: creat d3/da/d25/d69/f7f x:0 0 0 2024-09-13T22:09:00.824 INFO:tasks.workunit.client.1.smithi159.stdout:2/285: rename d9/da/d27 to d9/d65 0 2024-09-13T22:09:00.825 INFO:tasks.workunit.client.1.smithi159.stdout:4/623: truncate d13/d15/f16 6384562 0 2024-09-13T22:09:00.825 INFO:tasks.workunit.client.1.smithi159.stdout:4/624: creat d13/d15/d26/d29/d3b/d66/fd3 x:0 0 0 2024-09-13T22:09:00.827 INFO:tasks.workunit.client.1.smithi159.stdout:0/543: mknod d0/d48/d4f/d54/cbc 0 2024-09-13T22:09:00.828 INFO:tasks.workunit.client.1.smithi159.stdout:6/400: dread d3/da/d25/f38 [0,4194304] 0 2024-09-13T22:09:00.828 INFO:tasks.workunit.client.1.smithi159.stdout:6/401: read d3/da/d25/f41 [64875,51000] 0 2024-09-13T22:09:00.828 INFO:tasks.workunit.client.1.smithi159.stdout:6/402: chown d3/da/d29/d1a/d3e/d5a/f78 0 1 2024-09-13T22:09:00.829 INFO:tasks.workunit.client.1.smithi159.stdout:6/403: chown d3/da/d29/f45 110121375 1 2024-09-13T22:09:00.829 INFO:tasks.workunit.client.1.smithi159.stdout:2/286: mkdir d9/d44/d55/d66 0 2024-09-13T22:09:00.829 INFO:tasks.workunit.client.1.smithi159.stdout:2/287: fdatasync d9/da/f24 0 2024-09-13T22:09:00.829 INFO:tasks.workunit.client.1.smithi159.stdout:2/288: truncate d9/da/f2a 1647240 0 2024-09-13T22:09:00.829 INFO:tasks.workunit.client.1.smithi159.stdout:2/289: stat d9/da/d25/f2c 0 2024-09-13T22:09:00.834 INFO:tasks.workunit.client.1.smithi159.stdout:7/438: dwrite d3/d18/f54 [0,4194304] 0 2024-09-13T22:09:00.834 INFO:tasks.workunit.client.1.smithi159.stdout:7/439: write d3/d3f/f8f [927786,46788] 0 2024-09-13T22:09:00.834 INFO:tasks.workunit.client.1.smithi159.stdout:7/440: dread - d3/d3f/f91 zero size 2024-09-13T22:09:00.834 INFO:tasks.workunit.client.1.smithi159.stdout:7/441: write d3/d31/f76 [988740,89728] 0 2024-09-13T22:09:00.834 INFO:tasks.workunit.client.1.smithi159.stdout:7/442: write d3/d31/f66 [4889863,101889] 0 2024-09-13T22:09:00.834 INFO:tasks.workunit.client.1.smithi159.stdout:7/443: write d3/d31/d4d/d4e/d4f/d6c/f90 [392942,109948] 0 2024-09-13T22:09:00.834 INFO:tasks.workunit.client.1.smithi159.stdout:9/490: dwrite d1/f48 [0,4194304] 0 2024-09-13T22:09:00.835 INFO:tasks.workunit.client.1.smithi159.stdout:4/625: link d13/d41/d50/fb0 d13/d41/d50/fd4 0 2024-09-13T22:09:00.835 INFO:tasks.workunit.client.1.smithi159.stdout:0/544: creat d0/d48/d7d/fbd x:0 0 0 2024-09-13T22:09:00.837 INFO:tasks.workunit.client.1.smithi159.stdout:6/404: symlink d3/d2a/d3c/l80 0 2024-09-13T22:09:00.837 INFO:tasks.workunit.client.1.smithi159.stdout:6/405: write d3/da/d29/d26/d6c/f76 [1015403,59279] 0 2024-09-13T22:09:00.839 INFO:tasks.workunit.client.1.smithi159.stdout:5/442: dwrite d1/d11/d64/d35/f40 [0,4194304] 0 2024-09-13T22:09:00.846 INFO:tasks.workunit.client.1.smithi159.stdout:9/491: unlink d1/dc/d27/l33 0 2024-09-13T22:09:00.846 INFO:tasks.workunit.client.1.smithi159.stdout:9/492: chown d1/dc/c45 12185 1 2024-09-13T22:09:00.846 INFO:tasks.workunit.client.1.smithi159.stdout:9/493: chown d1/dc/d10/d6d/d87 25 1 2024-09-13T22:09:00.846 INFO:tasks.workunit.client.1.smithi159.stdout:9/494: read d1/f30 [75766,40858] 0 2024-09-13T22:09:00.847 INFO:tasks.workunit.client.1.smithi159.stdout:4/626: truncate d13/d15/f1f 1645414 0 2024-09-13T22:09:00.848 INFO:tasks.workunit.client.1.smithi159.stdout:0/545: mkdir d0/d48/d4f/d54/d74/dbe 0 2024-09-13T22:09:00.848 INFO:tasks.workunit.client.1.smithi159.stdout:0/546: dread - d0/d48/d4f/f69 zero size 2024-09-13T22:09:00.851 INFO:tasks.workunit.client.1.smithi159.stdout:6/406: dread d3/da/d25/f5b [0,4194304] 0 2024-09-13T22:09:00.854 INFO:tasks.workunit.client.1.smithi159.stdout:5/443: unlink d1/d11/d1c/d20/f9a 0 2024-09-13T22:09:00.854 INFO:tasks.workunit.client.1.smithi159.stdout:5/444: chown d1/d11/d64/d82/d8f/f79 50228458 1 2024-09-13T22:09:00.858 INFO:tasks.workunit.client.1.smithi159.stdout:4/627: mkdir d13/d41/d79/db2/dd5 0 2024-09-13T22:09:00.858 INFO:tasks.workunit.client.1.smithi159.stdout:4/628: creat d13/d15/d5a/fd6 x:0 0 0 2024-09-13T22:09:00.858 INFO:tasks.workunit.client.1.smithi159.stdout:3/329: dwrite d0/d1/d3/f48 [0,4194304] 0 2024-09-13T22:09:00.858 INFO:tasks.workunit.client.1.smithi159.stdout:0/547: mknod d0/d5e/cbf 0 2024-09-13T22:09:00.860 INFO:tasks.workunit.client.1.smithi159.stdout:9/495: write d1/dc/d10/d6d/d87/f83 [3097945,36333] 0 2024-09-13T22:09:00.861 INFO:tasks.workunit.client.1.smithi159.stdout:4/629: creat d13/d15/d26/d29/fd7 x:0 0 0 2024-09-13T22:09:00.863 INFO:tasks.workunit.client.1.smithi159.stdout:3/330: symlink d0/d1/d3/dd/l66 0 2024-09-13T22:09:00.863 INFO:tasks.workunit.client.1.smithi159.stdout:3/331: chown d0/d1/d3/d5 0 1 2024-09-13T22:09:00.863 INFO:tasks.workunit.client.1.smithi159.stdout:4/630: creat d13/d15/d26/d51/fd8 x:0 0 0 2024-09-13T22:09:00.865 INFO:tasks.workunit.client.1.smithi159.stdout:3/332: creat d0/d1/d3/d5/d25/d4e/d5a/f67 x:0 0 0 2024-09-13T22:09:00.868 INFO:tasks.workunit.client.1.smithi159.stdout:1/490: dwrite dd/f8c [0,4194304] 0 2024-09-13T22:09:00.868 INFO:tasks.workunit.client.1.smithi159.stdout:1/491: read - dd/d11/d18/f9b zero size 2024-09-13T22:09:00.868 INFO:tasks.workunit.client.1.smithi159.stdout:1/492: readlink dd/d11/d18/l1a 0 2024-09-13T22:09:00.868 INFO:tasks.workunit.client.1.smithi159.stdout:1/493: fsync dd/d11/d18/d74/f76 0 2024-09-13T22:09:00.868 INFO:tasks.workunit.client.1.smithi159.stdout:2/290: dwrite d9/da/f2a [0,4194304] 0 2024-09-13T22:09:00.868 INFO:tasks.workunit.client.1.smithi159.stdout:4/631: write d13/d41/d79/fad [1411313,59596] 0 2024-09-13T22:09:00.869 INFO:tasks.workunit.client.1.smithi159.stdout:7/444: dwrite d3/d18/f1d [0,4194304] 0 2024-09-13T22:09:00.872 INFO:tasks.workunit.client.1.smithi159.stdout:5/445: write d1/d11/d1c/d20/d44/f7e [2316848,103710] 0 2024-09-13T22:09:00.872 INFO:tasks.workunit.client.1.smithi159.stdout:5/446: chown d1/d11/d64/d35/f56 2026965406 1 2024-09-13T22:09:00.872 INFO:tasks.workunit.client.1.smithi159.stdout:0/548: fsync d0/d5e/d91/fae 0 2024-09-13T22:09:00.875 INFO:tasks.workunit.client.1.smithi159.stdout:9/496: read d1/d9/d2a/d74/d7d/f89 [2787881,78190] 0 2024-09-13T22:09:00.875 INFO:tasks.workunit.client.1.smithi159.stdout:6/407: dwrite d3/da/d29/f45 [0,4194304] 0 2024-09-13T22:09:00.883 INFO:tasks.workunit.client.1.smithi159.stdout:2/291: link d9/d2d/c5f d9/d44/c67 0 2024-09-13T22:09:00.884 INFO:tasks.workunit.client.1.smithi159.stdout:1/494: write dd/d11/d18/d2e/f43 [2263593,45894] 0 2024-09-13T22:09:00.886 INFO:tasks.workunit.client.1.smithi159.stdout:4/632: creat d13/d15/d26/d51/d65/d67/dd1/fd9 x:0 0 0 2024-09-13T22:09:00.887 INFO:tasks.workunit.client.1.smithi159.stdout:7/445: creat d3/d31/d4d/d4e/d4f/f92 x:0 0 0 2024-09-13T22:09:00.893 INFO:tasks.workunit.client.1.smithi159.stdout:5/447: rename d1/d11/c7a to d1/d11/d1c/d20/d53/ca0 0 2024-09-13T22:09:00.893 INFO:tasks.workunit.client.1.smithi159.stdout:5/448: write d1/d11/f63 [81121,103905] 0 2024-09-13T22:09:00.894 INFO:tasks.workunit.client.1.smithi159.stdout:3/333: dwrite d0/d1/d3/d5/d25/d4e/d5a/f19 [0,4194304] 0 2024-09-13T22:09:00.895 INFO:tasks.workunit.client.1.smithi159.stdout:6/408: dwrite d3/da/d25/d69/f7f [0,4194304] 0 2024-09-13T22:09:00.895 INFO:tasks.workunit.client.1.smithi159.stdout:0/549: creat d0/d48/d4f/d54/dac/fc0 x:0 0 0 2024-09-13T22:09:00.902 INFO:tasks.workunit.client.1.smithi159.stdout:1/495: truncate dd/f1b 326116 0 2024-09-13T22:09:00.906 INFO:tasks.workunit.client.1.smithi159.stdout:4/633: dwrite d13/d15/d26/f61 [0,4194304] 0 2024-09-13T22:09:00.906 INFO:tasks.workunit.client.1.smithi159.stdout:4/634: truncate d13/d15/fbb 978515 0 2024-09-13T22:09:00.908 INFO:tasks.workunit.client.1.smithi159.stdout:6/409: write d3/da/d25/f4b [2542005,55763] 0 2024-09-13T22:09:00.908 INFO:tasks.workunit.client.1.smithi159.stdout:6/410: readlink d3/d2a/d3c/l80 0 2024-09-13T22:09:00.908 INFO:tasks.workunit.client.1.smithi159.stdout:6/411: fdatasync d3/d2a/f71 0 2024-09-13T22:09:00.916 INFO:tasks.workunit.client.1.smithi159.stdout:5/449: symlink d1/d11/d9e/d7b/la1 0 2024-09-13T22:09:00.921 INFO:tasks.workunit.client.1.smithi159.stdout:3/334: unlink d0/d1/d3/dd/f13 0 2024-09-13T22:09:00.921 INFO:tasks.workunit.client.1.smithi159.stdout:6/412: dread d3/da/f4e [0,4194304] 0 2024-09-13T22:09:00.925 INFO:tasks.workunit.client.1.smithi159.stdout:0/550: unlink d0/d48/d7d/lb7 0 2024-09-13T22:09:00.925 INFO:tasks.workunit.client.1.smithi159.stdout:0/551: write d0/d48/f85 [229222,65272] 0 2024-09-13T22:09:00.926 INFO:tasks.workunit.client.1.smithi159.stdout:0/552: write d0/d48/d4f/f81 [482326,83557] 0 2024-09-13T22:09:00.926 INFO:tasks.workunit.client.1.smithi159.stdout:2/292: getdents d9/d37 0 2024-09-13T22:09:00.926 INFO:tasks.workunit.client.1.smithi159.stdout:2/293: fsync d9/da/d25/f4e 0 2024-09-13T22:09:00.926 INFO:tasks.workunit.client.1.smithi159.stdout:2/294: write d9/fe [2164600,342] 0 2024-09-13T22:09:00.927 INFO:tasks.workunit.client.1.smithi159.stdout:1/496: creat dd/d11/d13/d4b/d52/d63/f9c x:0 0 0 2024-09-13T22:09:00.927 INFO:tasks.workunit.client.1.smithi159.stdout:1/497: truncate f3 1107042 0 2024-09-13T22:09:00.928 INFO:tasks.workunit.client.1.smithi159.stdout:4/635: symlink d13/d15/d26/d29/d3b/daf/lda 0 2024-09-13T22:09:00.928 INFO:tasks.workunit.client.1.smithi159.stdout:4/636: read - d13/d15/d26/d51/d65/d67/dd1/fd9 zero size 2024-09-13T22:09:00.929 INFO:tasks.workunit.client.1.smithi159.stdout:4/637: creat d13/d15/d26/d29/d3b/d8e/fdb x:0 0 0 2024-09-13T22:09:00.929 INFO:tasks.workunit.client.1.smithi159.stdout:7/446: mknod d3/d4b/c93 0 2024-09-13T22:09:00.931 INFO:tasks.workunit.client.1.smithi159.stdout:6/413: dread d3/da/d29/f45 [0,4194304] 0 2024-09-13T22:09:00.933 INFO:tasks.workunit.client.1.smithi159.stdout:3/335: mkdir d0/d68 0 2024-09-13T22:09:00.938 INFO:tasks.workunit.client.1.smithi159.stdout:0/553: getdents d0/d48/d4f 0 2024-09-13T22:09:00.938 INFO:tasks.workunit.client.1.smithi159.stdout:0/554: write d0/d48/d4f/d54/f6d [1654639,30581] 0 2024-09-13T22:09:00.938 INFO:tasks.workunit.client.1.smithi159.stdout:2/295: mknod d9/d44/d55/c68 0 2024-09-13T22:09:00.940 INFO:tasks.workunit.client.1.smithi159.stdout:4/638: rmdir d13/d15/d26/d29/d3b 39 2024-09-13T22:09:00.942 INFO:tasks.workunit.client.1.smithi159.stdout:6/414: symlink d3/d6d/l81 0 2024-09-13T22:09:00.942 INFO:tasks.workunit.client.1.smithi159.stdout:3/336: truncate d0/d1/d34/f3e 2070321 0 2024-09-13T22:09:00.948 INFO:tasks.workunit.client.1.smithi159.stdout:4/639: truncate d13/d15/f3c 1582243 0 2024-09-13T22:09:00.948 INFO:tasks.workunit.client.1.smithi159.stdout:1/498: dwrite dd/d1e/f44 [0,4194304] 0 2024-09-13T22:09:00.948 INFO:tasks.workunit.client.1.smithi159.stdout:1/499: chown dd/f16 63374527 1 2024-09-13T22:09:00.950 INFO:tasks.workunit.client.1.smithi159.stdout:6/415: truncate d3/da/d29/d26/d6c/f76 277269 0 2024-09-13T22:09:00.952 INFO:tasks.workunit.client.1.smithi159.stdout:3/337: mknod d0/d1/d3/dd/c69 0 2024-09-13T22:09:00.952 INFO:tasks.workunit.client.1.smithi159.stdout:3/338: truncate d0/d1/d3/dd/f1b 1067793 0 2024-09-13T22:09:00.952 INFO:tasks.workunit.client.1.smithi159.stdout:0/555: write d0/d48/d4f/f7b [2258131,64944] 0 2024-09-13T22:09:00.952 INFO:tasks.workunit.client.1.smithi159.stdout:0/556: dread - d0/d2c/d71/d97/fad zero size 2024-09-13T22:09:00.952 INFO:tasks.workunit.client.1.smithi159.stdout:0/557: fdatasync d0/d48/f4d 0 2024-09-13T22:09:00.955 INFO:tasks.workunit.client.1.smithi159.stdout:4/640: mknod d13/d15/d26/d51/d65/cdc 0 2024-09-13T22:09:00.955 INFO:tasks.workunit.client.1.smithi159.stdout:4/641: creat d13/d15/d26/d29/d3b/d8e/fdd x:0 0 0 2024-09-13T22:09:00.958 INFO:tasks.workunit.client.1.smithi159.stdout:3/339: dread d0/d1/d3/dd/f26 [0,4194304] 0 2024-09-13T22:09:00.958 INFO:tasks.workunit.client.1.smithi159.stdout:1/500: mkdir dd/d11/d13/d4b/d52/d63/d9d 0 2024-09-13T22:09:00.958 INFO:tasks.workunit.client.1.smithi159.stdout:3/340: fdatasync d0/d1/d3/dd/f64 0 2024-09-13T22:09:00.959 INFO:tasks.workunit.client.1.smithi159.stdout:6/416: mknod d3/da/d29/d1a/d3e/d5a/d6a/c82 0 2024-09-13T22:09:00.959 INFO:tasks.workunit.client.1.smithi159.stdout:6/417: fsync d3/da/d25/f4b 0 2024-09-13T22:09:00.962 INFO:tasks.workunit.client.1.smithi159.stdout:4/642: mknod d13/d15/d5a/cde 0 2024-09-13T22:09:00.963 INFO:tasks.workunit.client.1.smithi159.stdout:2/296: rename d9/d44/d55 to d9/d65/d40/d69 0 2024-09-13T22:09:00.965 INFO:tasks.workunit.client.1.smithi159.stdout:3/341: creat d0/d1/d3/d5/db/d39/f6a x:0 0 0 2024-09-13T22:09:00.966 INFO:tasks.workunit.client.1.smithi159.stdout:6/418: creat d3/da/d29/d26/d6c/d6e/f83 x:0 0 0 2024-09-13T22:09:00.969 INFO:tasks.workunit.client.1.smithi159.stdout:4/643: mknod d13/d15/d26/d29/d3b/d66/cdf 0 2024-09-13T22:09:00.970 INFO:tasks.workunit.client.1.smithi159.stdout:4/644: fdatasync d13/d15/d26/f72 0 2024-09-13T22:09:00.970 INFO:tasks.workunit.client.1.smithi159.stdout:4/645: write d13/f74 [1034304,126717] 0 2024-09-13T22:09:00.988 INFO:tasks.workunit.client.1.smithi159.stdout:1/501: dwrite dd/d11/d13/d4b/d52/f77 [0,4194304] 0 2024-09-13T22:09:00.989 INFO:tasks.workunit.client.1.smithi159.stdout:2/297: read d9/d37/f56 [3776369,15818] 0 2024-09-13T22:09:00.989 INFO:tasks.workunit.client.1.smithi159.stdout:0/558: dwrite d0/d2c/f3c [0,4194304] 0 2024-09-13T22:09:00.993 INFO:tasks.workunit.client.1.smithi159.stdout:2/298: symlink d9/d44/l6a 0 2024-09-13T22:09:00.995 INFO:tasks.workunit.client.1.smithi159.stdout:0/559: link d0/d5e/c38 d0/d48/cc1 0 2024-09-13T22:09:00.997 INFO:tasks.workunit.client.1.smithi159.stdout:0/560: symlink d0/d48/d7d/lc2 0 2024-09-13T22:09:00.997 INFO:tasks.workunit.client.1.smithi159.stdout:0/561: stat d0/d5e/f14 0 2024-09-13T22:09:01.000 INFO:tasks.workunit.client.1.smithi159.stdout:0/562: mkdir d0/d2c/d71/dc3 0 2024-09-13T22:09:01.001 INFO:tasks.workunit.client.1.smithi159.stdout:0/563: mkdir d0/d48/dc4 0 2024-09-13T22:09:01.003 INFO:tasks.workunit.client.1.smithi159.stdout:0/564: link d0/d2c/f33 d0/d2c/d71/d97/fc5 0 2024-09-13T22:09:01.003 INFO:tasks.workunit.client.1.smithi159.stdout:2/299: dread d9/f38 [0,4194304] 0 2024-09-13T22:09:01.004 INFO:tasks.workunit.client.1.smithi159.stdout:2/300: chown d9/f1d 2 1 2024-09-13T22:09:01.004 INFO:tasks.workunit.client.1.smithi159.stdout:4/646: dwrite d13/d15/d26/d51/fd8 [0,4194304] 0 2024-09-13T22:09:01.007 INFO:tasks.workunit.client.1.smithi159.stdout:2/301: creat d9/f6b x:0 0 0 2024-09-13T22:09:01.007 INFO:tasks.workunit.client.1.smithi159.stdout:2/302: write d9/da/d5a/f63 [807634,103085] 0 2024-09-13T22:09:01.007 INFO:tasks.workunit.client.1.smithi159.stdout:6/419: dwrite d3/da/d29/d1a/d3e/d5a/f7d [4194304,4194304] 0 2024-09-13T22:09:01.007 INFO:tasks.workunit.client.1.smithi159.stdout:6/420: chown d3/da/d29/d26/c65 2 1 2024-09-13T22:09:01.020 INFO:tasks.workunit.client.1.smithi159.stdout:6/421: getdents d3/da/d29/d26/d6c 0 2024-09-13T22:09:01.023 INFO:tasks.workunit.client.1.smithi159.stdout:6/422: rename c1 to d3/da/d29/d1a/d3e/d5a/c84 0 2024-09-13T22:09:01.063 INFO:tasks.workunit.client.1.smithi159.stdout:3/342: dwrite d0/d1/d3/d5/d25/d4e/d5a/f67 [0,4194304] 0 2024-09-13T22:09:01.067 INFO:tasks.workunit.client.1.smithi159.stdout:3/343: symlink d0/d1/d3/d5/db/d58/l6b 0 2024-09-13T22:09:01.067 INFO:tasks.workunit.client.1.smithi159.stdout:2/303: dread d9/d44/f61 [0,4194304] 0 2024-09-13T22:09:01.073 INFO:tasks.workunit.client.1.smithi159.stdout:0/565: rmdir d0/d48 39 2024-09-13T22:09:01.075 INFO:tasks.workunit.client.1.smithi159.stdout:6/423: dwrite d3/da/d25/f5b [4194304,4194304] 0 2024-09-13T22:09:01.075 INFO:tasks.workunit.client.1.smithi159.stdout:6/424: truncate d3/f27 4342756 0 2024-09-13T22:09:01.075 INFO:tasks.workunit.client.1.smithi159.stdout:6/425: chown d3/da/d25/d52/f72 928101669 1 2024-09-13T22:09:01.076 INFO:tasks.workunit.client.1.smithi159.stdout:3/344: rename d0/d1/d34/f41 to d0/d1/d3/d5/db/d58/f6c 0 2024-09-13T22:09:01.077 INFO:tasks.workunit.client.1.smithi159.stdout:2/304: truncate d9/da/d25/f4e 2413587 0 2024-09-13T22:09:01.077 INFO:tasks.workunit.client.1.smithi159.stdout:0/566: mknod d0/d48/d4f/d2b/da3/cc6 0 2024-09-13T22:09:01.094 INFO:tasks.workunit.client.1.smithi159.stdout:6/426: dwrite d3/da/d25/f38 [0,4194304] 0 2024-09-13T22:09:01.098 INFO:tasks.workunit.client.1.smithi159.stdout:3/345: unlink d0/d1/d3/f1c 0 2024-09-13T22:09:01.099 INFO:tasks.workunit.client.1.smithi159.stdout:0/567: stat d0/d48/d4f/d2b/lb9 0 2024-09-13T22:09:01.101 INFO:tasks.workunit.client.1.smithi159.stdout:2/305: dwrite d9/da/d5a/f63 [0,4194304] 0 2024-09-13T22:09:01.101 INFO:tasks.workunit.client.1.smithi159.stdout:2/306: write d9/d65/d40/f45 [11413,26296] 0 2024-09-13T22:09:01.114 INFO:tasks.workunit.client.1.smithi159.stdout:2/307: dwrite d9/da/d25/f2c [0,4194304] 0 2024-09-13T22:09:01.202 INFO:tasks.workunit.client.1.smithi159.stdout:3/346: link d0/d1/d3/d5/d25/f27 d0/d1/d15/f6d 0 2024-09-13T22:09:01.202 INFO:tasks.workunit.client.1.smithi159.stdout:3/347: chown d0/d1/d3/d5/d25/d2c/f33 0 1 2024-09-13T22:09:01.203 INFO:tasks.workunit.client.1.smithi159.stdout:0/568: stat d0/d48/cc1 0 2024-09-13T22:09:01.203 INFO:tasks.workunit.client.1.smithi159.stdout:0/569: fsync d0/d48/d4f/f76 0 2024-09-13T22:09:01.203 INFO:tasks.workunit.client.1.smithi159.stdout:0/570: chown d0/d2c/f5a 21 1 2024-09-13T22:09:01.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/308: rename d9/da/d25/f3b to d9/d65/f6c 0 2024-09-13T22:09:01.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/309: dread - d9/d65/f60 zero size 2024-09-13T22:09:01.211 INFO:tasks.workunit.client.1.smithi159.stdout:3/348: mknod d0/d1/d34/c6e 0 2024-09-13T22:09:01.217 INFO:tasks.workunit.client.1.smithi159.stdout:2/310: mknod d9/da/c6d 0 2024-09-13T22:09:01.227 INFO:tasks.workunit.client.1.smithi159.stdout:6/427: truncate d3/f27 25738 0 2024-09-13T22:09:01.227 INFO:tasks.workunit.client.1.smithi159.stdout:6/428: creat d3/da/d29/d26/d6c/d6e/f85 x:0 0 0 2024-09-13T22:09:01.229 INFO:tasks.workunit.client.1.smithi159.stdout:0/571: dwrite d0/d5e/f27 [0,4194304] 0 2024-09-13T22:09:01.229 INFO:tasks.workunit.client.1.smithi159.stdout:0/572: dread - d0/d2c/f8c zero size 2024-09-13T22:09:01.230 INFO:tasks.workunit.client.1.smithi159.stdout:6/429: truncate d3/da/d29/d1a/f62 2995995 0 2024-09-13T22:09:01.231 INFO:tasks.workunit.client.1.smithi159.stdout:0/573: creat d0/d2c/d96/da1/fc7 x:0 0 0 2024-09-13T22:09:01.233 INFO:tasks.workunit.client.1.smithi159.stdout:6/430: link d3/da/l19 d3/da/d29/d1a/l86 0 2024-09-13T22:09:01.234 INFO:tasks.workunit.client.1.smithi159.stdout:0/574: creat d0/d2c/d96/fc8 x:0 0 0 2024-09-13T22:09:01.234 INFO:tasks.workunit.client.1.smithi159.stdout:0/575: getdents d0/d48/d4f/d54/d74/db2 0 2024-09-13T22:09:01.234 INFO:tasks.workunit.client.1.smithi159.stdout:0/576: stat d0/d5e/l12 0 2024-09-13T22:09:01.235 INFO:tasks.workunit.client.1.smithi159.stdout:0/577: chown d0/f16 1042 1 2024-09-13T22:09:01.240 INFO:tasks.workunit.client.1.smithi159.stdout:2/311: dwrite d9/d65/f60 [0,4194304] 0 2024-09-13T22:09:01.240 INFO:tasks.workunit.client.1.smithi159.stdout:2/312: fsync d9/f3d 0 2024-09-13T22:09:01.240 INFO:tasks.workunit.client.1.smithi159.stdout:2/313: fsync d9/da/f4d 0 2024-09-13T22:09:01.259 INFO:tasks.workunit.client.1.smithi159.stdout:0/578: creat d0/d48/fc9 x:0 0 0 2024-09-13T22:09:01.259 INFO:tasks.workunit.client.1.smithi159.stdout:0/579: fdatasync d0/d2c/d71/d97/f9b 0 2024-09-13T22:09:01.263 INFO:tasks.workunit.client.1.smithi159.stdout:2/314: dwrite d9/d48/f4f [0,4194304] 0 2024-09-13T22:09:01.265 INFO:tasks.workunit.client.1.smithi159.stdout:0/580: unlink d0/d2c/d71/d97/ca8 0 2024-09-13T22:09:01.270 INFO:tasks.workunit.client.1.smithi159.stdout:8/693: sync 2024-09-13T22:09:01.271 INFO:tasks.workunit.client.1.smithi159.stdout:8/694: fsync da/d7e/f7f 0 2024-09-13T22:09:01.276 INFO:tasks.workunit.client.1.smithi159.stdout:2/315: write f5 [4485156,73258] 0 2024-09-13T22:09:01.282 INFO:tasks.workunit.client.1.smithi159.stdout:0/581: dwrite d0/d5e/f61 [0,4194304] 0 2024-09-13T22:09:01.287 INFO:tasks.workunit.client.1.smithi159.stdout:2/316: read d9/d48/f4f [2113747,42668] 0 2024-09-13T22:09:01.290 INFO:tasks.workunit.client.1.smithi159.stdout:2/317: symlink d9/d48/l6e 0 2024-09-13T22:09:01.295 INFO:tasks.workunit.client.1.smithi159.stdout:2/318: symlink d9/l6f 0 2024-09-13T22:09:01.295 INFO:tasks.workunit.client.1.smithi159.stdout:2/319: chown d9/c21 26101 1 2024-09-13T22:09:01.297 INFO:tasks.workunit.client.1.smithi159.stdout:2/320: symlink d9/d44/l70 0 2024-09-13T22:09:01.299 INFO:tasks.workunit.client.1.smithi159.stdout:2/321: symlink d9/d65/d40/d69/d66/l71 0 2024-09-13T22:09:01.299 INFO:tasks.workunit.client.1.smithi159.stdout:2/322: truncate d9/da/d25/f35 1997725 0 2024-09-13T22:09:01.301 INFO:tasks.workunit.client.1.smithi159.stdout:2/323: rename d9/d48/f4f to d9/d37/f72 0 2024-09-13T22:09:01.301 INFO:tasks.workunit.client.1.smithi159.stdout:2/324: rmdir d9/d65/d40/d69/d66 39 2024-09-13T22:09:01.308 INFO:tasks.workunit.client.1.smithi159.stdout:0/582: dwrite d0/d2c/f36 [0,4194304] 0 2024-09-13T22:09:01.310 INFO:tasks.workunit.client.1.smithi159.stdout:2/325: dread d9/da/d25/f4e [0,4194304] 0 2024-09-13T22:09:01.328 INFO:tasks.workunit.client.1.smithi159.stdout:0/583: mkdir d0/d48/d7d/dca 0 2024-09-13T22:09:01.328 INFO:tasks.workunit.client.1.smithi159.stdout:0/584: chown d0/d48/l57 77540930 1 2024-09-13T22:09:01.328 INFO:tasks.workunit.client.1.smithi159.stdout:0/585: chown d0/d2c/d71/d97/ca2 123 1 2024-09-13T22:09:01.334 INFO:tasks.workunit.client.1.smithi159.stdout:0/586: getdents d0 0 2024-09-13T22:09:01.338 INFO:tasks.workunit.client.1.smithi159.stdout:0/587: creat d0/d48/d4f/d54/d74/dbe/fcb x:0 0 0 2024-09-13T22:09:01.338 INFO:tasks.workunit.client.1.smithi159.stdout:0/588: stat d0/d5e/f6f 0 2024-09-13T22:09:01.345 INFO:tasks.workunit.client.1.smithi159.stdout:0/589: write d0/f16 [586108,36495] 0 2024-09-13T22:09:01.346 INFO:tasks.workunit.client.1.smithi159.stdout:0/590: creat d0/d48/d7d/fcc x:0 0 0 2024-09-13T22:09:01.347 INFO:tasks.workunit.client.1.smithi159.stdout:0/591: fsync d0/d48/fc9 0 2024-09-13T22:09:01.348 INFO:tasks.workunit.client.1.smithi159.stdout:0/592: dread d0/d48/d4f/f5d [0,4194304] 0 2024-09-13T22:09:01.349 INFO:tasks.workunit.client.1.smithi159.stdout:0/593: write d0/d2c/f65 [765828,85384] 0 2024-09-13T22:09:01.349 INFO:tasks.workunit.client.1.smithi159.stdout:0/594: dread - d0/d2c/f8c zero size 2024-09-13T22:09:01.349 INFO:tasks.workunit.client.1.smithi159.stdout:0/595: chown d0/d48/dc4 0 1 2024-09-13T22:09:01.349 INFO:tasks.workunit.client.1.smithi159.stdout:0/596: mkdir d0/d48/d7d/dca/dcd 0 2024-09-13T22:09:01.349 INFO:tasks.workunit.client.1.smithi159.stdout:0/597: read - d0/d2c/d96/da1/fc7 zero size 2024-09-13T22:09:01.349 INFO:tasks.workunit.client.1.smithi159.stdout:9/497: sync 2024-09-13T22:09:01.355 INFO:tasks.workunit.client.1.smithi159.stdout:9/498: dread d1/f1c [0,4194304] 0 2024-09-13T22:09:01.375 INFO:tasks.workunit.client.1.smithi159.stdout:0/598: dwrite d0/d5e/f14 [0,4194304] 0 2024-09-13T22:09:01.376 INFO:tasks.workunit.client.1.smithi159.stdout:9/499: dwrite d1/dc/d10/d6d/d2f/f68 [0,4194304] 0 2024-09-13T22:09:01.376 INFO:tasks.workunit.client.1.smithi159.stdout:9/500: dread - d1/d5a/f6e zero size 2024-09-13T22:09:01.377 INFO:tasks.workunit.client.1.smithi159.stdout:0/599: link d0/d2c/f3c d0/d48/d4f/daa/fce 0 2024-09-13T22:09:01.377 INFO:tasks.workunit.client.1.smithi159.stdout:0/600: fsync d0/f10 0 2024-09-13T22:09:01.377 INFO:tasks.workunit.client.1.smithi159.stdout:0/601: chown d0/d48/d4f/d54/d74 15312134 1 2024-09-13T22:09:01.380 INFO:tasks.workunit.client.1.smithi159.stdout:0/602: creat d0/d48/dc4/fcf x:0 0 0 2024-09-13T22:09:01.380 INFO:tasks.workunit.client.1.smithi159.stdout:0/603: write d0/d5e/f1e [2502510,97174] 0 2024-09-13T22:09:01.380 INFO:tasks.workunit.client.1.smithi159.stdout:9/501: rmdir d1/dc/d10/d6d/d2f/d8b 39 2024-09-13T22:09:01.383 INFO:tasks.workunit.client.1.smithi159.stdout:0/604: creat d0/d5e/d91/fd0 x:0 0 0 2024-09-13T22:09:01.385 INFO:tasks.workunit.client.1.smithi159.stdout:9/502: symlink d1/dc/d10/d6d/laf 0 2024-09-13T22:09:01.385 INFO:tasks.workunit.client.1.smithi159.stdout:9/503: truncate d1/f53 1030405 0 2024-09-13T22:09:01.389 INFO:tasks.workunit.client.1.smithi159.stdout:0/605: dread d0/d48/d4f/d2b/f50 [0,4194304] 0 2024-09-13T22:09:01.392 INFO:tasks.workunit.client.1.smithi159.stdout:0/606: fdatasync d0/d5e/f1e 0 2024-09-13T22:09:01.392 INFO:tasks.workunit.client.1.smithi159.stdout:0/607: stat d0/d2c/c63 0 2024-09-13T22:09:01.392 INFO:tasks.workunit.client.1.smithi159.stdout:9/504: dread d1/fe [0,4194304] 0 2024-09-13T22:09:01.393 INFO:tasks.workunit.client.1.smithi159.stdout:0/608: truncate d0/d48/d4f/f76 627664 0 2024-09-13T22:09:01.393 INFO:tasks.workunit.client.1.smithi159.stdout:0/609: creat d0/d48/fd1 x:0 0 0 2024-09-13T22:09:01.393 INFO:tasks.workunit.client.1.smithi159.stdout:0/610: stat d0/d48/d4f/daa/fce 0 2024-09-13T22:09:01.393 INFO:tasks.workunit.client.1.smithi159.stdout:9/505: creat d1/dc/d10/d6d/d4b/fb0 x:0 0 0 2024-09-13T22:09:01.393 INFO:tasks.workunit.client.1.smithi159.stdout:9/506: fsync d1/f1c 0 2024-09-13T22:09:01.400 INFO:tasks.workunit.client.1.smithi159.stdout:0/611: dread d0/d48/d4f/d66/f87 [0,4194304] 0 2024-09-13T22:09:01.402 INFO:tasks.workunit.client.1.smithi159.stdout:0/612: rename d0/d48/d4f/d2b/f3b to d0/d2c/fd2 0 2024-09-13T22:09:01.404 INFO:tasks.workunit.client.1.smithi159.stdout:0/613: getdents d0/d48/d4f/d66 0 2024-09-13T22:09:01.410 INFO:tasks.workunit.client.1.smithi159.stdout:0/614: mkdir d0/d48/d7d/dd3 0 2024-09-13T22:09:01.410 INFO:tasks.workunit.client.1.smithi159.stdout:0/615: chown d0/d5e/f6f 280 1 2024-09-13T22:09:01.411 INFO:tasks.workunit.client.1.smithi159.stdout:9/507: dwrite d1/dc/d10/d6d/f86 [0,4194304] 0 2024-09-13T22:09:01.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/616: rmdir d0/d48/d7d/dd3 0 2024-09-13T22:09:01.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/617: fsync d0/d48/f70 0 2024-09-13T22:09:01.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/618: readlink d0/d48/d4f/d2b/l62 0 2024-09-13T22:09:01.412 INFO:tasks.workunit.client.1.smithi159.stdout:0/619: write d0/d48/fd1 [1043970,8711] 0 2024-09-13T22:09:01.414 INFO:tasks.workunit.client.1.smithi159.stdout:9/508: creat d1/dc/d27/d40/fb1 x:0 0 0 2024-09-13T22:09:01.416 INFO:tasks.workunit.client.1.smithi159.stdout:9/509: symlink d1/d9/d2a/d75/lb2 0 2024-09-13T22:09:01.418 INFO:tasks.workunit.client.1.smithi159.stdout:9/510: creat d1/dc/d10/d6d/d4b/d98/da8/fb3 x:0 0 0 2024-09-13T22:09:01.437 INFO:tasks.workunit.client.1.smithi159.stdout:0/620: dwrite d0/d5e/f27 [0,4194304] 0 2024-09-13T22:09:01.448 INFO:tasks.workunit.client.1.smithi159.stdout:0/621: write d0/d5e/f1a [1287858,72589] 0 2024-09-13T22:09:01.448 INFO:tasks.workunit.client.1.smithi159.stdout:0/622: fsync d0/d5e/f6f 0 2024-09-13T22:09:01.452 INFO:tasks.workunit.client.1.smithi159.stdout:0/623: rename d0/d48/dc4 to d0/d48/d4f/daf/dd4 0 2024-09-13T22:09:01.459 INFO:tasks.workunit.client.1.smithi159.stdout:0/624: write d0/d48/f4d [3810383,74348] 0 2024-09-13T22:09:01.459 INFO:tasks.workunit.client.1.smithi159.stdout:0/625: stat d0/d48/d4f/d54/d74/db2 0 2024-09-13T22:09:01.502 INFO:tasks.workunit.client.1.smithi159.stdout:5/450: sync 2024-09-13T22:09:01.502 INFO:tasks.workunit.client.1.smithi159.stdout:5/451: fsync d1/d11/d64/d35/f4c 0 2024-09-13T22:09:01.502 INFO:tasks.workunit.client.1.smithi159.stdout:5/452: rmdir d1/d11/d64 39 2024-09-13T22:09:01.503 INFO:tasks.workunit.client.1.smithi159.stdout:5/453: symlink d1/d11/d64/d35/la2 0 2024-09-13T22:09:01.504 INFO:tasks.workunit.client.1.smithi159.stdout:5/454: creat d1/d11/d64/d35/d60/fa3 x:0 0 0 2024-09-13T22:09:01.504 INFO:tasks.workunit.client.1.smithi159.stdout:5/455: chown d1/d11/d1c/d20/d44/d89 456448 1 2024-09-13T22:09:01.561 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:01 smithi159 ceph-mon[35348]: pgmap v262: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 147 MiB/s rd, 184 MiB/s wr, 388 op/s 2024-09-13T22:09:01.580 INFO:tasks.workunit.client.1.smithi159.stdout:7/447: sync 2024-09-13T22:09:01.580 INFO:tasks.workunit.client.1.smithi159.stdout:7/448: write d3/d31/d4d/f57 [4806476,120370] 0 2024-09-13T22:09:01.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:01 smithi089 ceph-mon[27921]: pgmap v262: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 147 MiB/s rd, 184 MiB/s wr, 388 op/s 2024-09-13T22:09:01.776 INFO:tasks.workunit.client.1.smithi159.stdout:1/502: sync 2024-09-13T22:09:01.776 INFO:tasks.workunit.client.1.smithi159.stdout:4/647: sync 2024-09-13T22:09:01.777 INFO:tasks.workunit.client.1.smithi159.stdout:4/648: write d13/d15/d26/d51/f5f [669622,58412] 0 2024-09-13T22:09:01.788 INFO:tasks.workunit.client.1.smithi159.stdout:4/649: dread d13/d15/d26/d29/d3b/f3d [0,4194304] 0 2024-09-13T22:09:01.796 INFO:tasks.workunit.client.1.smithi159.stdout:1/503: dwrite dd/d1c/f26 [4194304,4194304] 0 2024-09-13T22:09:01.810 INFO:tasks.workunit.client.1.smithi159.stdout:1/504: read dd/d1e/d58/d5f/d84/f90 [3985574,20595] 0 2024-09-13T22:09:01.811 INFO:tasks.workunit.client.1.smithi159.stdout:4/650: dwrite d13/d41/d4d/d75/fbd [0,4194304] 0 2024-09-13T22:09:01.811 INFO:tasks.workunit.client.1.smithi159.stdout:4/651: write f11 [91588,87110] 0 2024-09-13T22:09:01.811 INFO:tasks.workunit.client.1.smithi159.stdout:4/652: stat d13/d15/d26/f61 0 2024-09-13T22:09:01.811 INFO:tasks.workunit.client.1.smithi159.stdout:4/653: readlink d13/l55 0 2024-09-13T22:09:01.812 INFO:tasks.workunit.client.1.smithi159.stdout:1/505: symlink dd/d11/d34/d59/l9e 0 2024-09-13T22:09:01.812 INFO:tasks.workunit.client.1.smithi159.stdout:1/506: truncate f3 1315649 0 2024-09-13T22:09:01.815 INFO:tasks.workunit.client.1.smithi159.stdout:4/654: mknod d13/d20/ce0 0 2024-09-13T22:09:01.821 INFO:tasks.workunit.client.1.smithi159.stdout:1/507: write dd/d11/d13/d4b/d52/f77 [3267608,107559] 0 2024-09-13T22:09:01.829 INFO:tasks.workunit.client.1.smithi159.stdout:1/508: creat dd/d11/d34/d59/f9f x:0 0 0 2024-09-13T22:09:01.830 INFO:tasks.workunit.client.1.smithi159.stdout:1/509: read - dd/d11/d18/d49/d2d/d97/f70 zero size 2024-09-13T22:09:01.841 INFO:tasks.workunit.client.1.smithi159.stdout:4/655: truncate f11 81276 0 2024-09-13T22:09:01.845 INFO:tasks.workunit.client.1.smithi159.stdout:4/656: rename d13/d20/d8f to d13/d15/d26/d29/d3b/de1 0 2024-09-13T22:09:01.845 INFO:tasks.workunit.client.1.smithi159.stdout:4/657: chown d13/d20/lcb 6466 1 2024-09-13T22:09:01.847 INFO:tasks.workunit.client.1.smithi159.stdout:1/510: dwrite dd/d11/d13/d4b/d52/f94 [0,4194304] 0 2024-09-13T22:09:01.847 INFO:tasks.workunit.client.1.smithi159.stdout:1/511: getdents dd/d11/d18/d49/d2d/d62/d7d 0 2024-09-13T22:09:01.847 INFO:tasks.workunit.client.1.smithi159.stdout:1/512: stat dd/d11/d13/d4b/l89 0 2024-09-13T22:09:01.847 INFO:tasks.workunit.client.1.smithi159.stdout:1/513: readlink dd/d1e/d58/l8e 0 2024-09-13T22:09:01.847 INFO:tasks.workunit.client.1.smithi159.stdout:1/514: fsync dd/f16 0 2024-09-13T22:09:01.847 INFO:tasks.workunit.client.1.smithi159.stdout:1/515: stat dd/d11/d18/d74 0 2024-09-13T22:09:01.849 INFO:tasks.workunit.client.1.smithi159.stdout:4/658: creat d13/d41/fe2 x:0 0 0 2024-09-13T22:09:01.849 INFO:tasks.workunit.client.1.smithi159.stdout:4/659: chown d13/d41/d4d/d75/l81 8082874 1 2024-09-13T22:09:01.849 INFO:tasks.workunit.client.1.smithi159.stdout:4/660: readlink d13/d15/l52 0 2024-09-13T22:09:01.851 INFO:tasks.workunit.client.1.smithi159.stdout:1/516: mknod dd/d1e/d58/ca0 0 2024-09-13T22:09:01.853 INFO:tasks.workunit.client.1.smithi159.stdout:4/661: truncate f8 956433 0 2024-09-13T22:09:01.854 INFO:tasks.workunit.client.1.smithi159.stdout:1/517: unlink dd/d11/d34/d59/f9f 0 2024-09-13T22:09:01.871 INFO:tasks.workunit.client.1.smithi159.stdout:4/662: dwrite d13/d41/fe2 [0,4194304] 0 2024-09-13T22:09:01.871 INFO:tasks.workunit.client.1.smithi159.stdout:4/663: dread - d13/d15/d5a/fd6 zero size 2024-09-13T22:09:01.876 INFO:tasks.workunit.client.1.smithi159.stdout:4/664: dread d13/d15/f17 [0,4194304] 0 2024-09-13T22:09:01.876 INFO:tasks.workunit.client.1.smithi159.stdout:4/665: chown d13/d15/d26/l4a 22798 1 2024-09-13T22:09:01.878 INFO:tasks.workunit.client.1.smithi159.stdout:4/666: rename d13/d15/d26/d29/cac to d13/d15/d26/d29/d3b/daf/ce3 0 2024-09-13T22:09:01.879 INFO:tasks.workunit.client.1.smithi159.stdout:4/667: mknod d13/d15/d5a/ce4 0 2024-09-13T22:09:02.035 INFO:tasks.workunit.client.1.smithi159.stdout:3/349: sync 2024-09-13T22:09:02.037 INFO:tasks.workunit.client.1.smithi159.stdout:3/350: creat d0/d1/d3/d5/d25/f6f x:0 0 0 2024-09-13T22:09:02.110 INFO:tasks.workunit.client.1.smithi159.stdout:2/326: sync 2024-09-13T22:09:02.110 INFO:tasks.workunit.client.1.smithi159.stdout:8/695: sync 2024-09-13T22:09:02.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/431: sync 2024-09-13T22:09:02.110 INFO:tasks.workunit.client.1.smithi159.stdout:8/696: write da/d22/d2a/d39/d3e/fc3 [1575450,6453] 0 2024-09-13T22:09:02.110 INFO:tasks.workunit.client.1.smithi159.stdout:6/432: readlink d3/da/d29/d1a/d3e/d5a/d6a/l70 0 2024-09-13T22:09:02.111 INFO:tasks.workunit.client.1.smithi159.stdout:2/327: getdents d9/d65/d40/d69/d66 0 2024-09-13T22:09:02.111 INFO:tasks.workunit.client.1.smithi159.stdout:2/328: write d9/da/d25/f34 [24771,129105] 0 2024-09-13T22:09:02.113 INFO:tasks.workunit.client.1.smithi159.stdout:8/697: mkdir da/da0/de9 0 2024-09-13T22:09:02.113 INFO:tasks.workunit.client.1.smithi159.stdout:8/698: fdatasync da/d36/d48/d9e/fcf 0 2024-09-13T22:09:02.113 INFO:tasks.workunit.client.1.smithi159.stdout:8/699: write da/d7e/d82/dd8/fda [138956,63385] 0 2024-09-13T22:09:02.114 INFO:tasks.workunit.client.1.smithi159.stdout:6/433: mknod d3/da/d29/d1a/d3e/d5a/d6a/c87 0 2024-09-13T22:09:02.114 INFO:tasks.workunit.client.1.smithi159.stdout:6/434: chown d3/da/d29/d1a/d3e/d5a/f78 66861 1 2024-09-13T22:09:02.114 INFO:tasks.workunit.client.1.smithi159.stdout:6/435: write d3/da/d25/f41 [603295,25547] 0 2024-09-13T22:09:02.116 INFO:tasks.workunit.client.1.smithi159.stdout:2/329: symlink d9/d44/l73 0 2024-09-13T22:09:02.117 INFO:tasks.workunit.client.1.smithi159.stdout:2/330: write d9/da/d25/f34 [665213,109053] 0 2024-09-13T22:09:02.117 INFO:tasks.workunit.client.1.smithi159.stdout:2/331: chown d9/d37/f72 0 1 2024-09-13T22:09:02.118 INFO:tasks.workunit.client.1.smithi159.stdout:8/700: creat da/d7e/d82/dd8/de7/fea x:0 0 0 2024-09-13T22:09:02.118 INFO:tasks.workunit.client.1.smithi159.stdout:8/701: getdents da/d7e/d82/d83 0 2024-09-13T22:09:02.118 INFO:tasks.workunit.client.1.smithi159.stdout:8/702: creat da/d5d/dbc/feb x:0 0 0 2024-09-13T22:09:02.120 INFO:tasks.workunit.client.1.smithi159.stdout:6/436: rename d3/da/d29/f47 to d3/da/d29/d1a/d3e/d5a/f88 0 2024-09-13T22:09:02.121 INFO:tasks.workunit.client.1.smithi159.stdout:2/332: unlink d9/d44/c67 0 2024-09-13T22:09:02.121 INFO:tasks.workunit.client.1.smithi159.stdout:2/333: getdents d9/d65/d40/d69/d66 0 2024-09-13T22:09:02.121 INFO:tasks.workunit.client.1.smithi159.stdout:2/334: read d9/d37/f72 [3898982,1102] 0 2024-09-13T22:09:02.125 INFO:tasks.workunit.client.1.smithi159.stdout:6/437: mkdir d3/da/d29/d26/d6c/d6e/d89 0 2024-09-13T22:09:02.130 INFO:tasks.workunit.client.1.smithi159.stdout:8/703: rmdir da/d22/d4a 39 2024-09-13T22:09:02.130 INFO:tasks.workunit.client.1.smithi159.stdout:8/704: creat da/d5d/dbc/fec x:0 0 0 2024-09-13T22:09:02.132 INFO:tasks.workunit.client.1.smithi159.stdout:6/438: creat d3/d6d/f8a x:0 0 0 2024-09-13T22:09:02.139 INFO:tasks.workunit.client.1.smithi159.stdout:8/705: write da/d22/f27 [1952728,30903] 0 2024-09-13T22:09:02.140 INFO:tasks.workunit.client.1.smithi159.stdout:6/439: write d3/da/d29/d1a/d3e/f55 [1636220,114884] 0 2024-09-13T22:09:02.141 INFO:tasks.workunit.client.1.smithi159.stdout:6/440: fsync d3/da/d29/f17 0 2024-09-13T22:09:02.141 INFO:tasks.workunit.client.1.smithi159.stdout:6/441: fdatasync d3/d2a/f57 0 2024-09-13T22:09:02.143 INFO:tasks.workunit.client.1.smithi159.stdout:6/442: write d3/da/d29/f11 [1213991,29721] 0 2024-09-13T22:09:02.143 INFO:tasks.workunit.client.1.smithi159.stdout:6/443: write d3/da/d25/f4b [4878525,25316] 0 2024-09-13T22:09:02.143 INFO:tasks.workunit.client.1.smithi159.stdout:6/444: stat d3/da/d25/d69/c61 0 2024-09-13T22:09:02.144 INFO:tasks.workunit.client.1.smithi159.stdout:6/445: link d3/da/d25/d69/c75 d3/da/d29/d1a/d3e/d5a/d6a/c8b 0 2024-09-13T22:09:02.145 INFO:tasks.workunit.client.1.smithi159.stdout:6/446: creat d3/da/d29/d1a/d3e/f8c x:0 0 0 2024-09-13T22:09:02.162 INFO:tasks.workunit.client.1.smithi159.stdout:8/706: dwrite da/d5d/dbc/fec [0,4194304] 0 2024-09-13T22:09:02.162 INFO:tasks.workunit.client.1.smithi159.stdout:6/447: dwrite d3/da/d29/d1a/d3e/f8c [0,4194304] 0 2024-09-13T22:09:02.170 INFO:tasks.workunit.client.1.smithi159.stdout:8/707: truncate da/d22/f81 4337410 0 2024-09-13T22:09:02.177 INFO:tasks.workunit.client.1.smithi159.stdout:6/448: dwrite d3/da/d29/d26/d6c/d6e/f85 [0,4194304] 0 2024-09-13T22:09:02.178 INFO:tasks.workunit.client.1.smithi159.stdout:6/449: chown d3/d2a/d3c/d46/l5f 1 1 2024-09-13T22:09:02.180 INFO:tasks.workunit.client.1.smithi159.stdout:6/450: truncate d3/da/d25/f38 917348 0 2024-09-13T22:09:02.193 INFO:tasks.workunit.client.1.smithi159.stdout:8/708: dwrite da/d36/d57/f95 [0,4194304] 0 2024-09-13T22:09:02.196 INFO:tasks.workunit.client.1.smithi159.stdout:8/709: rename da/d36/d57/f93 to da/d7e/d82/d6f/d9a/fed 0 2024-09-13T22:09:02.204 INFO:tasks.workunit.client.1.smithi159.stdout:8/710: dread da/d7e/d82/d6f/d9a/fdd [0,4194304] 0 2024-09-13T22:09:02.205 INFO:tasks.workunit.client.1.smithi159.stdout:8/711: rename da/d36/cbf to da/d36/de3/cee 0 2024-09-13T22:09:02.205 INFO:tasks.workunit.client.1.smithi159.stdout:8/712: write da/d36/d57/faf [717841,13848] 0 2024-09-13T22:09:02.205 INFO:tasks.workunit.client.1.smithi159.stdout:8/713: truncate da/d36/d48/d9e/fa3 777880 0 2024-09-13T22:09:02.205 INFO:tasks.workunit.client.1.smithi159.stdout:8/714: creat da/fef x:0 0 0 2024-09-13T22:09:02.205 INFO:tasks.workunit.client.1.smithi159.stdout:8/715: write da/d22/d33/fba [4195847,20022] 0 2024-09-13T22:09:02.207 INFO:tasks.workunit.client.1.smithi159.stdout:8/716: mknod da/d5d/d70/d8e/cf0 0 2024-09-13T22:09:02.209 INFO:tasks.workunit.client.1.smithi159.stdout:8/717: symlink da/d22/d33/d66/lf1 0 2024-09-13T22:09:02.209 INFO:tasks.workunit.client.1.smithi159.stdout:8/718: write da/d22/d2a/d39/d3e/fcb [5046507,90042] 0 2024-09-13T22:09:02.210 INFO:tasks.workunit.client.1.smithi159.stdout:8/719: creat da/d22/d4a/ff2 x:0 0 0 2024-09-13T22:09:02.210 INFO:tasks.workunit.client.1.smithi159.stdout:8/720: chown da/d5d/d70/d8e/dc1/dce/dd4 272 1 2024-09-13T22:09:02.217 INFO:tasks.workunit.client.1.smithi159.stdout:8/721: write da/d22/d2a/fa4 [3936466,35881] 0 2024-09-13T22:09:02.217 INFO:tasks.workunit.client.1.smithi159.stdout:8/722: chown da/d36/d57/f74 192 1 2024-09-13T22:09:02.219 INFO:tasks.workunit.client.1.smithi159.stdout:8/723: rmdir da/d22/d2a/da1 39 2024-09-13T22:09:02.221 INFO:tasks.workunit.client.1.smithi159.stdout:8/724: symlink da/d36/d48/d9e/lf3 0 2024-09-13T22:09:02.222 INFO:tasks.workunit.client.1.smithi159.stdout:8/725: write da/d22/d33/f46 [3106108,23880] 0 2024-09-13T22:09:02.225 INFO:tasks.workunit.client.1.smithi159.stdout:8/726: rename da/l16 to da/d7e/d82/d83/lf4 0 2024-09-13T22:09:02.227 INFO:tasks.workunit.client.1.smithi159.stdout:8/727: symlink da/d7e/d82/d6f/d9a/de4/lf5 0 2024-09-13T22:09:02.227 INFO:tasks.workunit.client.1.smithi159.stdout:8/728: write da/d36/d57/faf [903982,129075] 0 2024-09-13T22:09:02.229 INFO:tasks.workunit.client.1.smithi159.stdout:8/729: dread da/d22/d4a/f4e [0,4194304] 0 2024-09-13T22:09:02.230 INFO:tasks.workunit.client.1.smithi159.stdout:8/730: write da/d7e/d82/dd8/fe8 [694363,107144] 0 2024-09-13T22:09:02.230 INFO:tasks.workunit.client.1.smithi159.stdout:8/731: creat da/d22/db3/ff6 x:0 0 0 2024-09-13T22:09:02.231 INFO:tasks.workunit.client.1.smithi159.stdout:8/732: rmdir da/d7e/d82/d6f/d9a/de4 39 2024-09-13T22:09:02.234 INFO:tasks.workunit.client.1.smithi159.stdout:8/733: dread da/f10 [0,4194304] 0 2024-09-13T22:09:02.243 INFO:tasks.workunit.client.1.smithi159.stdout:8/734: write da/d22/d2a/d39/faa [2588647,115699] 0 2024-09-13T22:09:02.244 INFO:tasks.workunit.client.1.smithi159.stdout:8/735: rename da/d5d/f8a to da/da0/de9/ff7 0 2024-09-13T22:09:02.260 INFO:tasks.workunit.client.1.smithi159.stdout:8/736: dwrite da/d7e/d82/d6f/fbd [0,4194304] 0 2024-09-13T22:09:02.262 INFO:tasks.workunit.client.1.smithi159.stdout:8/737: creat da/d22/d33/ff8 x:0 0 0 2024-09-13T22:09:02.265 INFO:tasks.workunit.client.1.smithi159.stdout:8/738: rename da/f10 to da/d5d/dbc/ff9 0 2024-09-13T22:09:02.268 INFO:tasks.workunit.client.1.smithi159.stdout:8/739: rename da/d22/d33/d8f/lac to da/d5d/d70/d8e/dc1/dce/lfa 0 2024-09-13T22:09:02.269 INFO:tasks.workunit.client.1.smithi159.stdout:8/740: read da/da0/fad [555814,68617] 0 2024-09-13T22:09:02.285 INFO:tasks.workunit.client.1.smithi159.stdout:8/741: dwrite da/d22/db3/db9/fca [0,4194304] 0 2024-09-13T22:09:02.285 INFO:tasks.workunit.client.1.smithi159.stdout:8/742: fsync da/d7e/d82/d6f/fbd 0 2024-09-13T22:09:02.285 INFO:tasks.workunit.client.1.smithi159.stdout:8/743: truncate da/da0/fcd 745389 0 2024-09-13T22:09:02.286 INFO:tasks.workunit.client.1.smithi159.stdout:8/744: fsync da/d22/d26/f5a 0 2024-09-13T22:09:02.288 INFO:tasks.workunit.client.1.smithi159.stdout:8/745: link c3 da/d22/d4a/cfb 0 2024-09-13T22:09:02.288 INFO:tasks.workunit.client.1.smithi159.stdout:8/746: fsync da/d22/d4a/f7c 0 2024-09-13T22:09:02.288 INFO:tasks.workunit.client.1.smithi159.stdout:8/747: fsync da/d22/d2a/d39/f6e 0 2024-09-13T22:09:02.289 INFO:tasks.workunit.client.1.smithi159.stdout:8/748: mknod da/d7e/d82/d6f/cfc 0 2024-09-13T22:09:02.289 INFO:tasks.workunit.client.1.smithi159.stdout:8/749: chown da/d7e/d82/dd8/de7 3520719 1 2024-09-13T22:09:02.290 INFO:tasks.workunit.client.1.smithi159.stdout:8/750: mkdir da/d36/d48/dfd 0 2024-09-13T22:09:02.290 INFO:tasks.workunit.client.1.smithi159.stdout:8/751: truncate da/d22/d2a/d39/fc7 316886 0 2024-09-13T22:09:02.290 INFO:tasks.workunit.client.1.smithi159.stdout:8/752: readlink da/d7e/d82/d83/lf4 0 2024-09-13T22:09:02.291 INFO:tasks.workunit.client.1.smithi159.stdout:8/753: creat da/d22/d2a/da1/ffe x:0 0 0 2024-09-13T22:09:02.305 INFO:tasks.workunit.client.1.smithi159.stdout:8/754: dwrite da/d22/d33/f38 [4194304,4194304] 0 2024-09-13T22:09:02.307 INFO:tasks.workunit.client.1.smithi159.stdout:8/755: mknod da/d36/d48/d9e/cff 0 2024-09-13T22:09:02.310 INFO:tasks.workunit.client.1.smithi159.stdout:8/756: unlink da/f31 0 2024-09-13T22:09:02.311 INFO:tasks.workunit.client.1.smithi159.stdout:8/757: fdatasync da/d22/d2a/d39/d3e/f99 0 2024-09-13T22:09:02.314 INFO:tasks.workunit.client.1.smithi159.stdout:8/758: getdents da/d36 0 2024-09-13T22:09:02.334 INFO:tasks.workunit.client.1.smithi159.stdout:8/759: dwrite da/d36/d48/f67 [0,4194304] 0 2024-09-13T22:09:02.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/760: link da/d36/d57/f74 da/d7e/d82/d6f/f100 0 2024-09-13T22:09:02.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/761: chown da/da0/de9/ff7 0 1 2024-09-13T22:09:02.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/762: write da/d36/d48/d9e/fa3 [1265422,35462] 0 2024-09-13T22:09:02.336 INFO:tasks.workunit.client.1.smithi159.stdout:8/763: creat da/d22/d2a/da1/f101 x:0 0 0 2024-09-13T22:09:02.353 INFO:tasks.workunit.client.1.smithi159.stdout:8/764: dwrite da/d22/d2a/fa4 [0,4194304] 0 2024-09-13T22:09:02.363 INFO:tasks.workunit.client.1.smithi159.stdout:8/765: mknod da/d7e/d82/d6f/d9a/dd5/c102 0 2024-09-13T22:09:02.364 INFO:tasks.workunit.client.1.smithi159.stdout:8/766: mkdir da/d7e/d82/d83/d103 0 2024-09-13T22:09:02.364 INFO:tasks.workunit.client.1.smithi159.stdout:8/767: creat da/d5d/dbc/f104 x:0 0 0 2024-09-13T22:09:02.372 INFO:tasks.workunit.client.1.smithi159.stdout:8/768: write da/d5d/d70/f7b [1403632,9313] 0 2024-09-13T22:09:02.377 INFO:tasks.workunit.client.1.smithi159.stdout:8/769: unlink da/d22/d33/l55 0 2024-09-13T22:09:02.378 INFO:tasks.workunit.client.1.smithi159.stdout:8/770: symlink da/d5d/d70/d8e/dc1/dce/dd4/l105 0 2024-09-13T22:09:02.393 INFO:tasks.workunit.client.1.smithi159.stdout:1/518: sync 2024-09-13T22:09:02.394 INFO:tasks.workunit.client.1.smithi159.stdout:1/519: fdatasync dd/d11/d18/d49/d2d/d97/f6e 0 2024-09-13T22:09:02.394 INFO:tasks.workunit.client.1.smithi159.stdout:1/520: read - dd/d11/d18/d2e/f66 zero size 2024-09-13T22:09:02.394 INFO:tasks.workunit.client.1.smithi159.stdout:1/521: dread - dd/d1e/f88 zero size 2024-09-13T22:09:02.394 INFO:tasks.workunit.client.1.smithi159.stdout:1/522: write dd/d11/f40 [962625,26038] 0 2024-09-13T22:09:02.399 INFO:tasks.workunit.client.1.smithi159.stdout:1/523: write fb [129691,86515] 0 2024-09-13T22:09:02.421 INFO:tasks.workunit.client.1.smithi159.stdout:8/771: truncate da/d22/f4d 173424 0 2024-09-13T22:09:02.424 INFO:tasks.workunit.client.1.smithi159.stdout:1/524: truncate dd/d11/d18/d49/f69 670027 0 2024-09-13T22:09:02.426 INFO:tasks.workunit.client.1.smithi159.stdout:8/772: mknod da/d22/d33/d8f/c106 0 2024-09-13T22:09:02.430 INFO:tasks.workunit.client.1.smithi159.stdout:1/525: mkdir dd/d11/d18/d74/d82/da1 0 2024-09-13T22:09:02.430 INFO:tasks.workunit.client.1.smithi159.stdout:1/526: write dd/d11/d18/d2e/f66 [907362,55371] 0 2024-09-13T22:09:02.430 INFO:tasks.workunit.client.1.smithi159.stdout:1/527: truncate dd/d11/d13/d4b/d52/d63/f9c 15863 0 2024-09-13T22:09:02.430 INFO:tasks.workunit.client.1.smithi159.stdout:1/528: fdatasync dd/d11/d18/d2e/f65 0 2024-09-13T22:09:02.431 INFO:tasks.workunit.client.1.smithi159.stdout:1/529: chown dd/d11/d18/d74/f76 3 1 2024-09-13T22:09:02.433 INFO:tasks.workunit.client.1.smithi159.stdout:8/773: creat da/da0/de9/f107 x:0 0 0 2024-09-13T22:09:02.433 INFO:tasks.workunit.client.1.smithi159.stdout:8/774: creat da/d7e/d82/d6f/f108 x:0 0 0 2024-09-13T22:09:02.436 INFO:tasks.workunit.client.1.smithi159.stdout:1/530: symlink dd/d11/d18/d2e/d3c/d95/la2 0 2024-09-13T22:09:02.436 INFO:tasks.workunit.client.1.smithi159.stdout:1/531: fdatasync dd/d11/d18/d49/d2d/d62/f75 0 2024-09-13T22:09:02.436 INFO:tasks.workunit.client.1.smithi159.stdout:1/532: chown dd/d11/d18/d49/d2d/c71 9990 1 2024-09-13T22:09:02.438 INFO:tasks.workunit.client.1.smithi159.stdout:8/775: rename da/d22/d2a/fa4 to da/d22/d2a/d39/d3e/f109 0 2024-09-13T22:09:02.440 INFO:tasks.workunit.client.1.smithi159.stdout:8/776: write da/d36/d48/d9e/fa3 [916333,38642] 0 2024-09-13T22:09:02.440 INFO:tasks.workunit.client.1.smithi159.stdout:1/533: rename dd/d1e/f61 to dd/d11/d18/d74/d82/d9a/fa3 0 2024-09-13T22:09:02.440 INFO:tasks.workunit.client.1.smithi159.stdout:1/534: read f3 [1098354,95695] 0 2024-09-13T22:09:02.444 INFO:tasks.workunit.client.1.smithi159.stdout:1/535: mkdir dd/d11/d18/d2e/da4 0 2024-09-13T22:09:02.444 INFO:tasks.workunit.client.1.smithi159.stdout:1/536: stat dd/d11/d13/d4b/f5b 0 2024-09-13T22:09:02.453 INFO:tasks.workunit.client.1.smithi159.stdout:8/777: rmdir da/d22 39 2024-09-13T22:09:02.453 INFO:tasks.workunit.client.1.smithi159.stdout:8/778: write da/d7e/d82/dd8/fde [904247,98477] 0 2024-09-13T22:09:02.453 INFO:tasks.workunit.client.1.smithi159.stdout:8/779: fsync da/f88 0 2024-09-13T22:09:02.454 INFO:tasks.workunit.client.1.smithi159.stdout:1/537: creat dd/d11/d18/d2e/da4/fa5 x:0 0 0 2024-09-13T22:09:02.479 INFO:tasks.workunit.client.1.smithi159.stdout:8/780: dwrite da/f7d [0,4194304] 0 2024-09-13T22:09:02.479 INFO:tasks.workunit.client.1.smithi159.stdout:1/538: dwrite dd/d11/d18/f9b [0,4194304] 0 2024-09-13T22:09:02.479 INFO:tasks.workunit.client.1.smithi159.stdout:1/539: chown dd/d1c/f25 498164 1 2024-09-13T22:09:02.479 INFO:tasks.workunit.client.1.smithi159.stdout:1/540: stat dd/d11/d34 0 2024-09-13T22:09:02.481 INFO:tasks.workunit.client.1.smithi159.stdout:8/781: creat da/d22/d4a/f10a x:0 0 0 2024-09-13T22:09:02.482 INFO:tasks.workunit.client.1.smithi159.stdout:8/782: dread - da/d7e/d82/f80 zero size 2024-09-13T22:09:02.485 INFO:tasks.workunit.client.1.smithi159.stdout:8/783: rmdir da/d36/d48/dfd 0 2024-09-13T22:09:02.490 INFO:tasks.workunit.client.1.smithi159.stdout:1/541: write dd/f8c [573109,99244] 0 2024-09-13T22:09:02.490 INFO:tasks.workunit.client.1.smithi159.stdout:1/542: creat dd/d11/d18/fa6 x:0 0 0 2024-09-13T22:09:02.490 INFO:tasks.workunit.client.1.smithi159.stdout:8/784: rmdir da/d36/d48 39 2024-09-13T22:09:02.500 INFO:tasks.workunit.client.1.smithi159.stdout:1/543: mkdir dd/d1e/d58/da7 0 2024-09-13T22:09:02.500 INFO:tasks.workunit.client.1.smithi159.stdout:1/544: write dd/d11/d18/d49/d2d/d62/f6a [293915,62754] 0 2024-09-13T22:09:02.500 INFO:tasks.workunit.client.1.smithi159.stdout:1/545: read f7 [2107201,24456] 0 2024-09-13T22:09:02.501 INFO:tasks.workunit.client.1.smithi159.stdout:8/785: creat da/d5d/d70/d8e/de0/f10b x:0 0 0 2024-09-13T22:09:02.503 INFO:tasks.workunit.client.1.smithi159.stdout:1/546: rename dd/d11/d13/d4b/d72 to dd/d11/d34/da8 0 2024-09-13T22:09:02.503 INFO:tasks.workunit.client.1.smithi159.stdout:1/547: truncate dd/d11/d13/d4b/d52/d63/f9c 894377 0 2024-09-13T22:09:02.504 INFO:tasks.workunit.client.1.smithi159.stdout:8/786: unlink da/d36/d48/fe5 0 2024-09-13T22:09:02.506 INFO:tasks.workunit.client.1.smithi159.stdout:1/548: mknod dd/d11/d13/d4b/d52/ca9 0 2024-09-13T22:09:02.507 INFO:tasks.workunit.client.1.smithi159.stdout:1/549: chown dd/d11/d18/d74 54516487 1 2024-09-13T22:09:02.509 INFO:tasks.workunit.client.1.smithi159.stdout:8/787: symlink da/d36/l10c 0 2024-09-13T22:09:02.512 INFO:tasks.workunit.client.1.smithi159.stdout:8/788: rename da/d36/d48/c78 to da/d36/d48/c10d 0 2024-09-13T22:09:02.525 INFO:tasks.workunit.client.1.smithi159.stdout:1/550: dwrite dd/f16 [0,4194304] 0 2024-09-13T22:09:02.537 INFO:tasks.workunit.client.1.smithi159.stdout:8/789: dwrite da/d36/d48/f67 [0,4194304] 0 2024-09-13T22:09:02.539 INFO:tasks.workunit.client.1.smithi159.stdout:8/790: rename da/d22/d2a/d39/d3e/fc3 to da/da0/de9/f10e 0 2024-09-13T22:09:02.539 INFO:tasks.workunit.client.1.smithi159.stdout:8/791: write da/d5d/dbc/fe2 [967030,34529] 0 2024-09-13T22:09:02.539 INFO:tasks.workunit.client.1.smithi159.stdout:8/792: chown da/d22/f27 15 1 2024-09-13T22:09:02.540 INFO:tasks.workunit.client.1.smithi159.stdout:8/793: mknod da/d5d/c10f 0 2024-09-13T22:09:02.541 INFO:tasks.workunit.client.1.smithi159.stdout:8/794: truncate da/d22/d33/f98 2510109 0 2024-09-13T22:09:02.543 INFO:tasks.workunit.client.1.smithi159.stdout:8/795: rename da/d36/de3 to da/d22/d26/d110 0 2024-09-13T22:09:02.565 INFO:tasks.workunit.client.1.smithi159.stdout:8/796: dwrite da/d22/d4a/ff2 [0,4194304] 0 2024-09-13T22:09:02.566 INFO:tasks.workunit.client.1.smithi159.stdout:8/797: fdatasync da/d22/d33/d8f/f9b 0 2024-09-13T22:09:02.772 INFO:tasks.workunit.client.1.smithi159.stdout:6/451: sync 2024-09-13T22:09:02.772 INFO:tasks.workunit.client.1.smithi159.stdout:3/351: sync 2024-09-13T22:09:02.772 INFO:tasks.workunit.client.1.smithi159.stdout:5/456: sync 2024-09-13T22:09:02.772 INFO:tasks.workunit.client.1.smithi159.stdout:4/668: sync 2024-09-13T22:09:02.772 INFO:tasks.workunit.client.1.smithi159.stdout:7/449: sync 2024-09-13T22:09:02.772 INFO:tasks.workunit.client.1.smithi159.stdout:7/450: fsync d3/d2e/f81 0 2024-09-13T22:09:02.772 INFO:tasks.workunit.client.1.smithi159.stdout:4/669: write d13/d15/d26/d51/d65/d67/d82/fce [700577,53328] 0 2024-09-13T22:09:02.774 INFO:tasks.workunit.client.1.smithi159.stdout:0/626: sync 2024-09-13T22:09:02.775 INFO:tasks.workunit.client.1.smithi159.stdout:9/511: sync 2024-09-13T22:09:02.775 INFO:tasks.workunit.client.1.smithi159.stdout:2/335: sync 2024-09-13T22:09:02.775 INFO:tasks.workunit.client.1.smithi159.stdout:2/336: write d9/d37/f51 [677243,9073] 0 2024-09-13T22:09:02.775 INFO:tasks.workunit.client.1.smithi159.stdout:7/451: creat d3/d18/f94 x:0 0 0 2024-09-13T22:09:02.775 INFO:tasks.workunit.client.1.smithi159.stdout:7/452: dread - d3/d2e/d6e/f86 zero size 2024-09-13T22:09:02.778 INFO:tasks.workunit.client.1.smithi159.stdout:4/670: rename d13/d15/f3c to d13/d15/d26/d29/d3b/d8e/fe5 0 2024-09-13T22:09:02.778 INFO:tasks.workunit.client.1.smithi159.stdout:4/671: stat d13/d41/d79/f7c 0 2024-09-13T22:09:02.778 INFO:tasks.workunit.client.1.smithi159.stdout:4/672: stat d13/d15/d26/d29/d3b/de1 0 2024-09-13T22:09:02.784 INFO:tasks.workunit.client.1.smithi159.stdout:2/337: creat d9/d65/d40/d69/f74 x:0 0 0 2024-09-13T22:09:02.784 INFO:tasks.workunit.client.1.smithi159.stdout:2/338: readlink d9/l6f 0 2024-09-13T22:09:02.785 INFO:tasks.workunit.client.1.smithi159.stdout:2/339: fsync d9/f38 0 2024-09-13T22:09:02.785 INFO:tasks.workunit.client.1.smithi159.stdout:7/453: truncate d3/d31/f76 543696 0 2024-09-13T22:09:02.785 INFO:tasks.workunit.client.1.smithi159.stdout:7/454: stat d3/d2e/d6e/d74/f85 0 2024-09-13T22:09:02.789 INFO:tasks.workunit.client.1.smithi159.stdout:2/340: mknod d9/da/d5a/c75 0 2024-09-13T22:09:02.789 INFO:tasks.workunit.client.1.smithi159.stdout:2/341: fsync d9/f31 0 2024-09-13T22:09:02.790 INFO:tasks.workunit.client.1.smithi159.stdout:4/673: dread d13/d15/d26/d51/d65/d67/d82/fce [0,4194304] 0 2024-09-13T22:09:02.791 INFO:tasks.workunit.client.1.smithi159.stdout:7/455: rename d3/d2e/d6e/l73 to d3/d31/d4d/d4e/d7a/l95 0 2024-09-13T22:09:02.791 INFO:tasks.workunit.client.1.smithi159.stdout:7/456: fdatasync d3/d2e/f35 0 2024-09-13T22:09:02.793 INFO:tasks.workunit.client.1.smithi159.stdout:2/342: truncate d9/da/f24 8690 0 2024-09-13T22:09:02.794 INFO:tasks.workunit.client.1.smithi159.stdout:4/674: mknod d13/d15/d26/d29/d3b/d8e/ce6 0 2024-09-13T22:09:02.794 INFO:tasks.workunit.client.1.smithi159.stdout:2/343: dread d9/d37/f3a [0,4194304] 0 2024-09-13T22:09:02.796 INFO:tasks.workunit.client.1.smithi159.stdout:7/457: truncate d3/f1e 1436089 0 2024-09-13T22:09:02.796 INFO:tasks.workunit.client.1.smithi159.stdout:6/452: write d3/da/d29/d1a/d3e/d5a/f78 [3686774,123440] 0 2024-09-13T22:09:02.796 INFO:tasks.workunit.client.1.smithi159.stdout:6/453: stat d3/d2a/d3c/d46/d73 0 2024-09-13T22:09:02.796 INFO:tasks.workunit.client.1.smithi159.stdout:6/454: chown d3/d2a/l3b 241925243 1 2024-09-13T22:09:02.797 INFO:tasks.workunit.client.1.smithi159.stdout:6/455: dread d3/da/d29/d1a/d3e/f43 [0,4194304] 0 2024-09-13T22:09:02.797 INFO:tasks.workunit.client.1.smithi159.stdout:4/675: rename d13/l55 to d13/d15/d26/d29/d3b/d8e/le7 0 2024-09-13T22:09:02.798 INFO:tasks.workunit.client.1.smithi159.stdout:2/344: truncate d9/d65/d40/f42 312596 0 2024-09-13T22:09:02.798 INFO:tasks.workunit.client.1.smithi159.stdout:2/345: readlink d9/d65/d40/l49 0 2024-09-13T22:09:02.799 INFO:tasks.workunit.client.1.smithi159.stdout:6/456: mknod d3/da/c8d 0 2024-09-13T22:09:02.800 INFO:tasks.workunit.client.1.smithi159.stdout:4/676: symlink d13/d41/d79/le8 0 2024-09-13T22:09:02.801 INFO:tasks.workunit.client.1.smithi159.stdout:2/346: getdents d9/d44 0 2024-09-13T22:09:02.801 INFO:tasks.workunit.client.1.smithi159.stdout:2/347: write d9/d37/f72 [5007786,84158] 0 2024-09-13T22:09:02.803 INFO:tasks.workunit.client.1.smithi159.stdout:6/457: dread d3/da/d25/f41 [0,4194304] 0 2024-09-13T22:09:02.803 INFO:tasks.workunit.client.1.smithi159.stdout:6/458: write d3/da/d29/d26/d6c/d6e/f85 [4896892,122612] 0 2024-09-13T22:09:02.815 INFO:tasks.workunit.client.1.smithi159.stdout:7/458: write d3/d31/d4d/d4e/d4f/f58 [7882991,32997] 0 2024-09-13T22:09:02.824 INFO:tasks.workunit.client.1.smithi159.stdout:9/512: dwrite d1/d5a/f6e [0,4194304] 0 2024-09-13T22:09:02.825 INFO:tasks.workunit.client.1.smithi159.stdout:3/352: dwrite d0/d1/d3/d4d/d5b/d45/f53 [4194304,4194304] 0 2024-09-13T22:09:02.825 INFO:tasks.workunit.client.1.smithi159.stdout:3/353: getdents d0/d1/d3/d5/d25/d2c/d65 0 2024-09-13T22:09:02.833 INFO:tasks.workunit.client.1.smithi159.stdout:7/459: read d3/d18/f54 [3142525,78002] 0 2024-09-13T22:09:02.833 INFO:tasks.workunit.client.1.smithi159.stdout:7/460: chown d3/d31/d4d/d4e/d4f/d6c/c7f 421 1 2024-09-13T22:09:02.833 INFO:tasks.workunit.client.1.smithi159.stdout:7/461: dread - d3/d3f/f91 zero size 2024-09-13T22:09:02.837 INFO:tasks.workunit.client.1.smithi159.stdout:5/457: dwrite d1/d11/d50/f62 [0,4194304] 0 2024-09-13T22:09:02.837 INFO:tasks.workunit.client.1.smithi159.stdout:5/458: fsync d1/d11/d1c/d20/d44/d89/f99 0 2024-09-13T22:09:02.837 INFO:tasks.workunit.client.1.smithi159.stdout:5/459: chown d1/d11/d64/d35/l91 3073 1 2024-09-13T22:09:02.838 INFO:tasks.workunit.client.1.smithi159.stdout:0/627: dwrite d0/d48/d4f/f53 [0,4194304] 0 2024-09-13T22:09:02.838 INFO:tasks.workunit.client.1.smithi159.stdout:5/460: write d1/d11/d64/d17/f4b [890443,118315] 0 2024-09-13T22:09:02.842 INFO:tasks.workunit.client.1.smithi159.stdout:2/348: dwrite d9/da/f18 [0,4194304] 0 2024-09-13T22:09:02.842 INFO:tasks.workunit.client.1.smithi159.stdout:2/349: chown d9/d44/f46 125506 1 2024-09-13T22:09:02.843 INFO:tasks.workunit.client.1.smithi159.stdout:7/462: rename d3/d31/d4d/d4e/f59 to d3/d2e/d6e/f96 0 2024-09-13T22:09:02.851 INFO:tasks.workunit.client.1.smithi159.stdout:3/354: dwrite d0/d1/d3/d5/db/f60 [0,4194304] 0 2024-09-13T22:09:02.852 INFO:tasks.workunit.client.1.smithi159.stdout:4/677: rmdir d13/d15/d26/d29 39 2024-09-13T22:09:02.852 INFO:tasks.workunit.client.1.smithi159.stdout:4/678: read - d13/f9f zero size 2024-09-13T22:09:02.860 INFO:tasks.workunit.client.1.smithi159.stdout:5/461: mknod d1/d11/d1c/d20/d44/d89/ca4 0 2024-09-13T22:09:02.861 INFO:tasks.workunit.client.1.smithi159.stdout:0/628: dwrite d0/d48/d7d/fbd [0,4194304] 0 2024-09-13T22:09:02.861 INFO:tasks.workunit.client.1.smithi159.stdout:5/462: dread d1/d11/d64/d17/f54 [0,4194304] 0 2024-09-13T22:09:02.861 INFO:tasks.workunit.client.1.smithi159.stdout:5/463: write d1/d11/d64/d82/d8f/f81 [402091,82533] 0 2024-09-13T22:09:02.871 INFO:tasks.workunit.client.1.smithi159.stdout:2/350: rename d9/da/c23 to d9/d44/c76 0 2024-09-13T22:09:02.871 INFO:tasks.workunit.client.1.smithi159.stdout:3/355: dwrite d0/d1/f47 [0,4194304] 0 2024-09-13T22:09:02.880 INFO:tasks.workunit.client.1.smithi159.stdout:0/629: unlink d0/f3e 0 2024-09-13T22:09:02.880 INFO:tasks.workunit.client.1.smithi159.stdout:5/464: truncate d1/d11/d9e/f26 3968709 0 2024-09-13T22:09:02.881 INFO:tasks.workunit.client.1.smithi159.stdout:5/465: fdatasync d1/d11/d64/d82/d8f/f79 0 2024-09-13T22:09:02.881 INFO:tasks.workunit.client.1.smithi159.stdout:2/351: truncate d9/fe 635387 0 2024-09-13T22:09:02.881 INFO:tasks.workunit.client.1.smithi159.stdout:2/352: readlink d9/d44/l6a 0 2024-09-13T22:09:02.884 INFO:tasks.workunit.client.1.smithi159.stdout:3/356: creat d0/d1/d34/f70 x:0 0 0 2024-09-13T22:09:02.886 INFO:tasks.workunit.client.1.smithi159.stdout:2/353: read d9/da/d25/f35 [11547,85483] 0 2024-09-13T22:09:02.886 INFO:tasks.workunit.client.1.smithi159.stdout:7/463: getdents d3/d31 0 2024-09-13T22:09:02.887 INFO:tasks.workunit.client.1.smithi159.stdout:7/464: stat d3/d4b 0 2024-09-13T22:09:02.887 INFO:tasks.workunit.client.1.smithi159.stdout:7/465: dread - d3/f2f zero size 2024-09-13T22:09:02.887 INFO:tasks.workunit.client.1.smithi159.stdout:7/466: write d3/d31/d4d/d4e/f51 [4422107,28267] 0 2024-09-13T22:09:02.887 INFO:tasks.workunit.client.1.smithi159.stdout:7/467: dread - d3/d31/d4d/f8e zero size 2024-09-13T22:09:02.887 INFO:tasks.workunit.client.1.smithi159.stdout:4/679: rmdir d13/d41/d4d/d75 39 2024-09-13T22:09:02.887 INFO:tasks.workunit.client.1.smithi159.stdout:5/466: dread d1/d11/f1e [0,4194304] 0 2024-09-13T22:09:02.888 INFO:tasks.workunit.client.1.smithi159.stdout:5/467: chown d1/d11/d50 115363161 1 2024-09-13T22:09:02.888 INFO:tasks.workunit.client.1.smithi159.stdout:0/630: symlink d0/d48/d4f/daa/ld5 0 2024-09-13T22:09:02.889 INFO:tasks.workunit.client.1.smithi159.stdout:0/631: write d0/d48/d4f/d66/f87 [4512827,16683] 0 2024-09-13T22:09:02.889 INFO:tasks.workunit.client.1.smithi159.stdout:3/357: mkdir d0/d1/d3/d5/d25/d2c/d71 0 2024-09-13T22:09:02.889 INFO:tasks.workunit.client.1.smithi159.stdout:3/358: fdatasync d0/d1/d3/dd/f63 0 2024-09-13T22:09:02.890 INFO:tasks.workunit.client.1.smithi159.stdout:3/359: read - d0/d1/d3/d5/d25/f6f zero size 2024-09-13T22:09:02.902 INFO:tasks.workunit.client.1.smithi159.stdout:3/360: dwrite d0/d1/d3/d5/db/d39/f52 [0,4194304] 0 2024-09-13T22:09:02.903 INFO:tasks.workunit.client.1.smithi159.stdout:3/361: chown d0/d1/d3/d5/d25/d4e/d5a 251212107 1 2024-09-13T22:09:02.910 INFO:tasks.workunit.client.1.smithi159.stdout:4/680: dwrite d13/d15/f17 [4194304,4194304] 0 2024-09-13T22:09:02.919 INFO:tasks.workunit.client.1.smithi159.stdout:4/681: write d13/d41/d50/f60 [4177946,9790] 0 2024-09-13T22:09:02.953 INFO:tasks.workunit.client.1.smithi159.stdout:2/354: mkdir d9/d48/d77 0 2024-09-13T22:09:02.954 INFO:tasks.workunit.client.1.smithi159.stdout:7/468: mknod d3/d31/d4d/d4e/c97 0 2024-09-13T22:09:02.954 INFO:tasks.workunit.client.1.smithi159.stdout:7/469: readlink d3/l45 0 2024-09-13T22:09:02.956 INFO:tasks.workunit.client.1.smithi159.stdout:5/468: creat d1/d11/d9e/fa5 x:0 0 0 2024-09-13T22:09:02.960 INFO:tasks.workunit.client.1.smithi159.stdout:0/632: unlink d0/d48/d4f/d66/d75/fa7 0 2024-09-13T22:09:02.960 INFO:tasks.workunit.client.1.smithi159.stdout:0/633: write d0/d48/d4f/f81 [121309,79175] 0 2024-09-13T22:09:02.964 INFO:tasks.workunit.client.1.smithi159.stdout:3/362: creat d0/d1/d3/d5/d25/d2c/d65/f72 x:0 0 0 2024-09-13T22:09:02.967 INFO:tasks.workunit.client.1.smithi159.stdout:4/682: creat d13/d15/d26/d51/dc8/fe9 x:0 0 0 2024-09-13T22:09:02.967 INFO:tasks.workunit.client.1.smithi159.stdout:4/683: creat d13/d41/d50/fea x:0 0 0 2024-09-13T22:09:02.967 INFO:tasks.workunit.client.1.smithi159.stdout:4/684: truncate d13/f74 1402017 0 2024-09-13T22:09:02.968 INFO:tasks.workunit.client.1.smithi159.stdout:2/355: creat d9/d2d/f78 x:0 0 0 2024-09-13T22:09:02.968 INFO:tasks.workunit.client.1.smithi159.stdout:2/356: chown d9/d44 364569301 1 2024-09-13T22:09:02.968 INFO:tasks.workunit.client.1.smithi159.stdout:2/357: chown d9/d2d/l4c 341014383 1 2024-09-13T22:09:02.970 INFO:tasks.workunit.client.1.smithi159.stdout:0/634: link d0/d48/d4f/f7b d0/d48/d4f/d54/d74/db2/fd6 0 2024-09-13T22:09:02.970 INFO:tasks.workunit.client.1.smithi159.stdout:0/635: chown d0/d5e/c38 0 1 2024-09-13T22:09:02.971 INFO:tasks.workunit.client.1.smithi159.stdout:3/363: mkdir d0/d1/d34/d73 0 2024-09-13T22:09:02.972 INFO:tasks.workunit.client.1.smithi159.stdout:4/685: mkdir d13/d41/d5d/deb 0 2024-09-13T22:09:02.972 INFO:tasks.workunit.client.1.smithi159.stdout:4/686: stat d13/f19 0 2024-09-13T22:09:02.973 INFO:tasks.workunit.client.1.smithi159.stdout:2/358: symlink d9/d48/d77/l79 0 2024-09-13T22:09:02.974 INFO:tasks.workunit.client.1.smithi159.stdout:3/364: truncate d0/d1/d3/d5/f31 3985681 0 2024-09-13T22:09:02.975 INFO:tasks.workunit.client.1.smithi159.stdout:3/365: chown d0/d1/d3/d5/d25/d4e/d5a 33269 1 2024-09-13T22:09:02.975 INFO:tasks.workunit.client.1.smithi159.stdout:3/366: truncate d0/d1/d3/dd/f64 1116166 0 2024-09-13T22:09:02.975 INFO:tasks.workunit.client.1.smithi159.stdout:4/687: creat d13/fec x:0 0 0 2024-09-13T22:09:02.977 INFO:tasks.workunit.client.1.smithi159.stdout:2/359: unlink d9/da/l54 0 2024-09-13T22:09:02.977 INFO:tasks.workunit.client.1.smithi159.stdout:7/470: dwrite d3/d31/d4d/f8e [0,4194304] 0 2024-09-13T22:09:02.979 INFO:tasks.workunit.client.1.smithi159.stdout:5/469: dwrite d1/d11/f1e [0,4194304] 0 2024-09-13T22:09:02.979 INFO:tasks.workunit.client.1.smithi159.stdout:5/470: creat d1/d11/fa6 x:0 0 0 2024-09-13T22:09:02.980 INFO:tasks.workunit.client.1.smithi159.stdout:3/367: creat d0/d1/f74 x:0 0 0 2024-09-13T22:09:02.983 INFO:tasks.workunit.client.1.smithi159.stdout:2/360: symlink d9/d65/d40/l7a 0 2024-09-13T22:09:02.985 INFO:tasks.workunit.client.1.smithi159.stdout:0/636: write d0/d2c/f5a [2857871,93386] 0 2024-09-13T22:09:02.985 INFO:tasks.workunit.client.1.smithi159.stdout:0/637: readlink d0/d48/d7d/l7f 0 2024-09-13T22:09:02.989 INFO:tasks.workunit.client.1.smithi159.stdout:4/688: write d13/d15/d26/d51/d65/d67/d82/fa3 [2394760,97064] 0 2024-09-13T22:09:02.989 INFO:tasks.workunit.client.1.smithi159.stdout:4/689: fsync d13/d15/d5a/f69 0 2024-09-13T22:09:02.990 INFO:tasks.workunit.client.1.smithi159.stdout:5/471: link d1/d11/d1c/d20/d53/f87 d1/d11/d9e/fa7 0 2024-09-13T22:09:02.994 INFO:tasks.workunit.client.1.smithi159.stdout:4/690: rename d13/d41/d50/fea to d13/d41/d5d/fed 0 2024-09-13T22:09:02.996 INFO:tasks.workunit.client.1.smithi159.stdout:0/638: fdatasync d0/d48/d4f/d66/f87 0 2024-09-13T22:09:02.996 INFO:tasks.workunit.client.1.smithi159.stdout:5/472: mknod d1/d11/d1c/d32/ca8 0 2024-09-13T22:09:02.998 INFO:tasks.workunit.client.1.smithi159.stdout:4/691: link d13/d15/d26/fa2 d13/d15/d26/d51/d65/d67/d82/fee 0 2024-09-13T22:09:03.010 INFO:tasks.workunit.client.1.smithi159.stdout:4/692: dread d13/d15/f1f [0,4194304] 0 2024-09-13T22:09:03.010 INFO:tasks.workunit.client.1.smithi159.stdout:4/693: fsync d13/d15/d26/d29/f90 0 2024-09-13T22:09:03.010 INFO:tasks.workunit.client.1.smithi159.stdout:4/694: truncate d13/d41/d50/fb0 852436 0 2024-09-13T22:09:03.012 INFO:tasks.workunit.client.1.smithi159.stdout:4/695: rename d13/d15/d26/d29/d3b/d8e/fd0 to d13/d15/d26/d29/d3b/de1/fef 0 2024-09-13T22:09:03.016 INFO:tasks.workunit.client.1.smithi159.stdout:0/639: write d0/d5e/f1a [6497923,125251] 0 2024-09-13T22:09:03.018 INFO:tasks.workunit.client.1.smithi159.stdout:7/471: dwrite d3/f1e [0,4194304] 0 2024-09-13T22:09:03.018 INFO:tasks.workunit.client.1.smithi159.stdout:7/472: stat d3/d31/d4d/d4e 0 2024-09-13T22:09:03.018 INFO:tasks.workunit.client.1.smithi159.stdout:3/368: dwrite d0/d1/f74 [0,4194304] 0 2024-09-13T22:09:03.020 INFO:tasks.workunit.client.1.smithi159.stdout:5/473: dread d1/f3e [0,4194304] 0 2024-09-13T22:09:03.020 INFO:tasks.workunit.client.1.smithi159.stdout:2/361: dwrite d9/da/d25/f34 [0,4194304] 0 2024-09-13T22:09:03.020 INFO:tasks.workunit.client.1.smithi159.stdout:5/474: stat d1/d11/d64/f43 0 2024-09-13T22:09:03.025 INFO:tasks.workunit.client.1.smithi159.stdout:0/640: truncate d0/d48/d4f/d54/f80 1588626 0 2024-09-13T22:09:03.030 INFO:tasks.workunit.client.1.smithi159.stdout:7/473: dread d3/d3f/f4a [0,4194304] 0 2024-09-13T22:09:03.031 INFO:tasks.workunit.client.1.smithi159.stdout:7/474: chown d3/d31/d4d/d4e/f51 0 1 2024-09-13T22:09:03.031 INFO:tasks.workunit.client.1.smithi159.stdout:2/362: creat d9/da/f7b x:0 0 0 2024-09-13T22:09:03.031 INFO:tasks.workunit.client.1.smithi159.stdout:5/475: mknod d1/d11/d64/d35/d60/ca9 0 2024-09-13T22:09:03.033 INFO:tasks.workunit.client.1.smithi159.stdout:0/641: mknod d0/d48/d4f/d54/dac/cd7 0 2024-09-13T22:09:03.034 INFO:tasks.workunit.client.1.smithi159.stdout:7/475: symlink d3/d31/d49/l98 0 2024-09-13T22:09:03.035 INFO:tasks.workunit.client.1.smithi159.stdout:2/363: truncate d9/f1b 2215944 0 2024-09-13T22:09:03.037 INFO:tasks.workunit.client.1.smithi159.stdout:5/476: rename d1/d11/d64/d35/d60/f70 to d1/d11/d64/d82/d8c/faa 0 2024-09-13T22:09:03.037 INFO:tasks.workunit.client.1.smithi159.stdout:4/696: dwrite d13/d20/f59 [0,4194304] 0 2024-09-13T22:09:03.041 INFO:tasks.workunit.client.1.smithi159.stdout:0/642: symlink d0/d2c/d71/ld8 0 2024-09-13T22:09:03.041 INFO:tasks.workunit.client.1.smithi159.stdout:3/369: dwrite d0/d1/d3/d5/db/f60 [0,4194304] 0 2024-09-13T22:09:03.042 INFO:tasks.workunit.client.1.smithi159.stdout:7/476: creat d3/d31/d4d/f99 x:0 0 0 2024-09-13T22:09:03.045 INFO:tasks.workunit.client.1.smithi159.stdout:5/477: symlink d1/d11/d64/d82/d8c/lab 0 2024-09-13T22:09:03.045 INFO:tasks.workunit.client.1.smithi159.stdout:5/478: write d1/d11/d64/d35/f56 [898783,9448] 0 2024-09-13T22:09:03.045 INFO:tasks.workunit.client.1.smithi159.stdout:5/479: creat d1/d11/d1c/d20/fac x:0 0 0 2024-09-13T22:09:03.045 INFO:tasks.workunit.client.1.smithi159.stdout:5/480: stat d1/d11/d9e/f31 0 2024-09-13T22:09:03.047 INFO:tasks.workunit.client.1.smithi159.stdout:4/697: mknod d13/d15/d5a/cf0 0 2024-09-13T22:09:03.048 INFO:tasks.workunit.client.1.smithi159.stdout:0/643: mkdir d0/d48/dd9 0 2024-09-13T22:09:03.052 INFO:tasks.workunit.client.1.smithi159.stdout:7/477: rename d3/d2e/l7d to d3/d31/d4d/d4e/l9a 0 2024-09-13T22:09:03.059 INFO:tasks.workunit.client.1.smithi159.stdout:0/644: mknod d0/d48/d4f/daf/cda 0 2024-09-13T22:09:03.061 INFO:tasks.workunit.client.1.smithi159.stdout:0/645: symlink d0/d48/d4f/d54/d74/ldb 0 2024-09-13T22:09:03.062 INFO:tasks.workunit.client.1.smithi159.stdout:0/646: rmdir d0/d48/d4f/d2b/da3 39 2024-09-13T22:09:03.063 INFO:tasks.workunit.client.1.smithi159.stdout:0/647: mknod d0/d2c/d71/d97/cdc 0 2024-09-13T22:09:03.064 INFO:tasks.workunit.client.1.smithi159.stdout:0/648: stat d0/d48/d4f/d2b/c34 0 2024-09-13T22:09:03.064 INFO:tasks.workunit.client.1.smithi159.stdout:0/649: readlink d0/d48/d7d/l7f 0 2024-09-13T22:09:03.064 INFO:tasks.workunit.client.1.smithi159.stdout:0/650: stat d0/d2c/d71/d97/fc5 0 2024-09-13T22:09:03.065 INFO:tasks.workunit.client.1.smithi159.stdout:2/364: dwrite d9/da/f24 [0,4194304] 0 2024-09-13T22:09:03.068 INFO:tasks.workunit.client.1.smithi159.stdout:0/651: write d0/d48/d4f/d66/f87 [3600658,85351] 0 2024-09-13T22:09:03.074 INFO:tasks.workunit.client.1.smithi159.stdout:5/481: dwrite d1/d11/d1c/d20/f88 [0,4194304] 0 2024-09-13T22:09:03.074 INFO:tasks.workunit.client.1.smithi159.stdout:7/478: dwrite d3/d18/f94 [0,4194304] 0 2024-09-13T22:09:03.074 INFO:tasks.workunit.client.1.smithi159.stdout:7/479: write d3/d2e/d6e/f96 [43762,89543] 0 2024-09-13T22:09:03.074 INFO:tasks.workunit.client.1.smithi159.stdout:7/480: write d3/d2e/f82 [210869,11497] 0 2024-09-13T22:09:03.074 INFO:tasks.workunit.client.1.smithi159.stdout:4/698: dwrite d13/d41/d5d/fa9 [0,4194304] 0 2024-09-13T22:09:03.075 INFO:tasks.workunit.client.1.smithi159.stdout:2/365: creat d9/d48/f7c x:0 0 0 2024-09-13T22:09:03.077 INFO:tasks.workunit.client.1.smithi159.stdout:0/652: symlink d0/d48/d7d/dca/dcd/ldd 0 2024-09-13T22:09:03.079 INFO:tasks.workunit.client.1.smithi159.stdout:5/482: getdents d1/d11/d64 0 2024-09-13T22:09:03.084 INFO:tasks.workunit.client.1.smithi159.stdout:7/481: creat d3/d31/d4d/d4e/d7a/f9b x:0 0 0 2024-09-13T22:09:03.084 INFO:tasks.workunit.client.1.smithi159.stdout:7/482: chown d3/d3f/c80 3705099 1 2024-09-13T22:09:03.086 INFO:tasks.workunit.client.1.smithi159.stdout:0/653: dread d0/d5e/f14 [4194304,4194304] 0 2024-09-13T22:09:03.088 INFO:tasks.workunit.client.1.smithi159.stdout:4/699: unlink d13/d41/d50/fb0 0 2024-09-13T22:09:03.090 INFO:tasks.workunit.client.1.smithi159.stdout:2/366: rename d9/d65/d40/f42 to d9/da/f7d 0 2024-09-13T22:09:03.092 INFO:tasks.workunit.client.1.smithi159.stdout:7/483: link d3/d31/d4d/f57 d3/d18/f9c 0 2024-09-13T22:09:03.093 INFO:tasks.workunit.client.1.smithi159.stdout:4/700: symlink d13/d15/d26/d29/d3b/d8e/lf1 0 2024-09-13T22:09:03.095 INFO:tasks.workunit.client.1.smithi159.stdout:0/654: rename d0/d5e/f9 to d0/d2c/fde 0 2024-09-13T22:09:03.097 INFO:tasks.workunit.client.1.smithi159.stdout:4/701: stat d13/d41/d5d/c9a 0 2024-09-13T22:09:03.098 INFO:tasks.workunit.client.1.smithi159.stdout:4/702: chown d13/d15/f21 810409 1 2024-09-13T22:09:03.098 INFO:tasks.workunit.client.1.smithi159.stdout:4/703: getdents d13/d9b/dc9 0 2024-09-13T22:09:03.101 INFO:tasks.workunit.client.1.smithi159.stdout:0/655: dread d0/d48/f85 [0,4194304] 0 2024-09-13T22:09:03.101 INFO:tasks.workunit.client.1.smithi159.stdout:4/704: getdents d13/d15/d26/d51/d65/d67/dd1 0 2024-09-13T22:09:03.101 INFO:tasks.workunit.client.1.smithi159.stdout:0/656: creat d0/d2c/d96/da1/fdf x:0 0 0 2024-09-13T22:09:03.101 INFO:tasks.workunit.client.1.smithi159.stdout:5/483: dwrite d1/d11/d64/f25 [0,4194304] 0 2024-09-13T22:09:03.101 INFO:tasks.workunit.client.1.smithi159.stdout:5/484: fsync d1/d11/d1c/d20/d44/d89/f93 0 2024-09-13T22:09:03.101 INFO:tasks.workunit.client.1.smithi159.stdout:5/485: fsync d1/d11/d9e/fa7 0 2024-09-13T22:09:03.102 INFO:tasks.workunit.client.1.smithi159.stdout:7/484: dread d3/d2e/f82 [0,4194304] 0 2024-09-13T22:09:03.103 INFO:tasks.workunit.client.1.smithi159.stdout:4/705: mkdir d13/d15/d26/d29/d3b/d66/df2 0 2024-09-13T22:09:03.103 INFO:tasks.workunit.client.1.smithi159.stdout:4/706: readlink d13/d15/d26/d29/d3b/daf/lda 0 2024-09-13T22:09:03.103 INFO:tasks.workunit.client.1.smithi159.stdout:4/707: dread - d13/d15/d26/d29/d3b/d66/d6c/f8a zero size 2024-09-13T22:09:03.106 INFO:tasks.workunit.client.1.smithi159.stdout:7/485: dread d3/d31/d4d/d4e/f51 [0,4194304] 0 2024-09-13T22:09:03.107 INFO:tasks.workunit.client.1.smithi159.stdout:5/486: creat d1/fad x:0 0 0 2024-09-13T22:09:03.107 INFO:tasks.workunit.client.1.smithi159.stdout:5/487: stat d1/d11/d64/d82/d8f/f81 0 2024-09-13T22:09:03.109 INFO:tasks.workunit.client.1.smithi159.stdout:4/708: link f10 d13/d41/d5d/deb/ff3 0 2024-09-13T22:09:03.112 INFO:tasks.workunit.client.1.smithi159.stdout:7/486: symlink d3/d31/d4d/d4e/d4f/d6c/l9d 0 2024-09-13T22:09:03.115 INFO:tasks.workunit.client.1.smithi159.stdout:4/709: symlink d13/d15/d26/d29/d3b/daf/lf4 0 2024-09-13T22:09:03.145 INFO:tasks.workunit.client.1.smithi159.stdout:2/367: read d9/f38 [2142498,125883] 0 2024-09-13T22:09:03.146 INFO:tasks.workunit.client.1.smithi159.stdout:2/368: fsync d9/da/d25/f35 0 2024-09-13T22:09:03.146 INFO:tasks.workunit.client.1.smithi159.stdout:2/369: creat d9/d48/f7e x:0 0 0 2024-09-13T22:09:03.150 INFO:tasks.workunit.client.1.smithi159.stdout:7/487: rename d3/d31/d49 to d3/d31/d4d/d9e 0 2024-09-13T22:09:03.155 INFO:tasks.workunit.client.1.smithi159.stdout:4/710: rename d13/d41/d50/ccc to d13/d41/dbf/cf5 0 2024-09-13T22:09:03.155 INFO:tasks.workunit.client.1.smithi159.stdout:4/711: write d13/d15/d26/d51/d65/f70 [3270222,28552] 0 2024-09-13T22:09:03.156 INFO:tasks.workunit.client.1.smithi159.stdout:4/712: mkdir d13/d15/d26/d29/d3b/de1/df6 0 2024-09-13T22:09:03.156 INFO:tasks.workunit.client.1.smithi159.stdout:4/713: truncate d13/d15/d26/d51/d65/d67/d82/fcf 516723 0 2024-09-13T22:09:03.158 INFO:tasks.workunit.client.1.smithi159.stdout:4/714: symlink d13/d15/d26/d29/d3b/daf/lf7 0 2024-09-13T22:09:03.158 INFO:tasks.workunit.client.1.smithi159.stdout:4/715: write d13/d41/f42 [6401043,60363] 0 2024-09-13T22:09:03.162 INFO:tasks.workunit.client.1.smithi159.stdout:4/716: mknod d13/d15/d26/d29/d3b/d66/df2/cf8 0 2024-09-13T22:09:03.162 INFO:tasks.workunit.client.1.smithi159.stdout:4/717: write f10 [2644915,106861] 0 2024-09-13T22:09:03.162 INFO:tasks.workunit.client.1.smithi159.stdout:4/718: stat d13/d15/d26/d29/d3b/de1 0 2024-09-13T22:09:03.164 INFO:tasks.workunit.client.1.smithi159.stdout:4/719: creat d13/d41/d79/ff9 x:0 0 0 2024-09-13T22:09:03.164 INFO:tasks.workunit.client.1.smithi159.stdout:4/720: readlink d13/d15/d26/d29/d3b/l48 0 2024-09-13T22:09:03.164 INFO:tasks.workunit.client.1.smithi159.stdout:4/721: readlink d13/d15/d26/d29/d3b/d66/d6c/lc5 0 2024-09-13T22:09:03.167 INFO:tasks.workunit.client.1.smithi159.stdout:4/722: mknod d13/cfa 0 2024-09-13T22:09:03.174 INFO:tasks.workunit.client.1.smithi159.stdout:7/488: dwrite d3/d31/d4d/d4e/d4f/d6c/f90 [0,4194304] 0 2024-09-13T22:09:03.191 INFO:tasks.workunit.client.1.smithi159.stdout:7/489: dread d3/d31/d4d/f57 [0,4194304] 0 2024-09-13T22:09:03.194 INFO:tasks.workunit.client.1.smithi159.stdout:7/490: rename d3/d2e/c5a to d3/d31/d4d/d4e/d7a/c9f 0 2024-09-13T22:09:03.194 INFO:tasks.workunit.client.1.smithi159.stdout:7/491: chown d3/d4b 158278106 1 2024-09-13T22:09:03.194 INFO:tasks.workunit.client.1.smithi159.stdout:7/492: creat d3/d2e/fa0 x:0 0 0 2024-09-13T22:09:03.194 INFO:tasks.workunit.client.1.smithi159.stdout:7/493: creat d3/d3f/fa1 x:0 0 0 2024-09-13T22:09:03.197 INFO:tasks.workunit.client.1.smithi159.stdout:4/723: dwrite d13/d41/d79/fa4 [0,4194304] 0 2024-09-13T22:09:03.200 INFO:tasks.workunit.client.1.smithi159.stdout:4/724: rename d13/f9f to d13/d9b/ffb 0 2024-09-13T22:09:03.200 INFO:tasks.workunit.client.1.smithi159.stdout:4/725: write d13/d15/f39 [157682,44616] 0 2024-09-13T22:09:03.201 INFO:tasks.workunit.client.1.smithi159.stdout:4/726: getdents d13/d15/d26/d51/d65 0 2024-09-13T22:09:03.203 INFO:tasks.workunit.client.1.smithi159.stdout:4/727: mknod d13/d15/d26/d29/d3b/de1/cfc 0 2024-09-13T22:09:03.203 INFO:tasks.workunit.client.1.smithi159.stdout:5/488: getdents d1 0 2024-09-13T22:09:03.205 INFO:tasks.workunit.client.1.smithi159.stdout:4/728: creat d13/ffd x:0 0 0 2024-09-13T22:09:03.218 INFO:tasks.workunit.client.1.smithi159.stdout:5/489: dread d1/d11/d9e/f26 [0,4194304] 0 2024-09-13T22:09:03.218 INFO:tasks.workunit.client.1.smithi159.stdout:5/490: write d1/d11/d64/fd [947365,79951] 0 2024-09-13T22:09:03.218 INFO:tasks.workunit.client.1.smithi159.stdout:5/491: write d1/d11/d9e/f78 [141040,25402] 0 2024-09-13T22:09:03.222 INFO:tasks.workunit.client.1.smithi159.stdout:5/492: rename d1/d11/d50/f86 to d1/d11/d1c/fae 0 2024-09-13T22:09:03.225 INFO:tasks.workunit.client.1.smithi159.stdout:7/494: dwrite d3/d18/f1d [0,4194304] 0 2024-09-13T22:09:03.244 INFO:tasks.workunit.client.1.smithi159.stdout:4/729: dwrite d13/d15/f1f [0,4194304] 0 2024-09-13T22:09:03.244 INFO:tasks.workunit.client.1.smithi159.stdout:4/730: write d13/d15/d26/d29/d3b/d8e/f9e [862898,12183] 0 2024-09-13T22:09:03.245 INFO:tasks.workunit.client.1.smithi159.stdout:4/731: creat d13/d15/d26/d51/d65/d67/d82/ffe x:0 0 0 2024-09-13T22:09:03.245 INFO:tasks.workunit.client.1.smithi159.stdout:4/732: fdatasync d13/d15/d26/f37 0 2024-09-13T22:09:03.245 INFO:tasks.workunit.client.1.smithi159.stdout:4/733: readlink d13/d15/d26/d29/d3b/d66/d6c/l7f 0 2024-09-13T22:09:03.246 INFO:tasks.workunit.client.1.smithi159.stdout:5/493: dwrite d1/d11/d1c/d20/d44/f7e [0,4194304] 0 2024-09-13T22:09:03.248 INFO:tasks.workunit.client.1.smithi159.stdout:5/494: unlink d1/d11/f63 0 2024-09-13T22:09:03.249 INFO:tasks.workunit.client.1.smithi159.stdout:1/551: sync 2024-09-13T22:09:03.249 INFO:tasks.workunit.client.1.smithi159.stdout:8/798: sync 2024-09-13T22:09:03.249 INFO:tasks.workunit.client.1.smithi159.stdout:8/799: chown da/d22/d2a/d39/faa 21725563 1 2024-09-13T22:09:03.250 INFO:tasks.workunit.client.1.smithi159.stdout:4/734: mknod d13/d41/d50/cff 0 2024-09-13T22:09:03.250 INFO:tasks.workunit.client.1.smithi159.stdout:8/800: dread da/d36/d57/f74 [0,4194304] 0 2024-09-13T22:09:03.250 INFO:tasks.workunit.client.1.smithi159.stdout:5/495: truncate d1/d11/d64/d35/f56 2698609 0 2024-09-13T22:09:03.250 INFO:tasks.workunit.client.1.smithi159.stdout:5/496: read - d1/d11/d1c/d20/d44/d89/f93 zero size 2024-09-13T22:09:03.254 INFO:tasks.workunit.client.1.smithi159.stdout:8/801: link da/da0/fad da/d7e/db2/f111 0 2024-09-13T22:09:03.254 INFO:tasks.workunit.client.1.smithi159.stdout:8/802: read da/d22/d2a/d39/d3e/fcb [2936912,58834] 0 2024-09-13T22:09:03.254 INFO:tasks.workunit.client.1.smithi159.stdout:8/803: readlink da/da0/ld6 0 2024-09-13T22:09:03.258 INFO:tasks.workunit.client.1.smithi159.stdout:5/497: rename d1/d11/d1c/d20/d44/d89/f92 to d1/d11/d50/faf 0 2024-09-13T22:09:03.258 INFO:tasks.workunit.client.1.smithi159.stdout:5/498: write d1/d11/d9e/fa7 [605205,99140] 0 2024-09-13T22:09:03.259 INFO:tasks.workunit.client.1.smithi159.stdout:4/735: symlink d13/d41/d50/l100 0 2024-09-13T22:09:03.259 INFO:tasks.workunit.client.1.smithi159.stdout:4/736: fsync d13/d15/d26/d51/d65/f91 0 2024-09-13T22:09:03.261 INFO:tasks.workunit.client.1.smithi159.stdout:8/804: link c2 da/d7e/d82/dd8/de7/c112 0 2024-09-13T22:09:03.262 INFO:tasks.workunit.client.1.smithi159.stdout:4/737: getdents d13/d41/d4d 0 2024-09-13T22:09:03.263 INFO:tasks.workunit.client.1.smithi159.stdout:4/738: mknod d13/d15/d26/d51/d65/c101 0 2024-09-13T22:09:03.264 INFO:tasks.workunit.client.1.smithi159.stdout:4/739: readlink d13/d41/d50/laa 0 2024-09-13T22:09:03.265 INFO:tasks.workunit.client.1.smithi159.stdout:4/740: creat d13/d15/d26/d51/dc8/f102 x:0 0 0 2024-09-13T22:09:03.265 INFO:tasks.workunit.client.1.smithi159.stdout:1/552: dwrite dd/d11/d18/fa6 [0,4194304] 0 2024-09-13T22:09:03.265 INFO:tasks.workunit.client.1.smithi159.stdout:4/741: write d13/d41/d5d/f78 [139862,2433] 0 2024-09-13T22:09:03.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/553: rmdir dd/d1c 39 2024-09-13T22:09:03.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/554: fsync dd/d11/d18/d49/d2d/d97/f70 0 2024-09-13T22:09:03.270 INFO:tasks.workunit.client.1.smithi159.stdout:4/742: mkdir d13/d15/d26/d29/d3b/de1/df6/d103 0 2024-09-13T22:09:03.270 INFO:tasks.workunit.client.1.smithi159.stdout:4/743: truncate d13/fec 113308 0 2024-09-13T22:09:03.270 INFO:tasks.workunit.client.1.smithi159.stdout:1/555: write dd/d1c/f25 [390310,111528] 0 2024-09-13T22:09:03.273 INFO:tasks.workunit.client.1.smithi159.stdout:4/744: creat d13/d41/d4d/f104 x:0 0 0 2024-09-13T22:09:03.274 INFO:tasks.workunit.client.1.smithi159.stdout:1/556: mknod dd/caa 0 2024-09-13T22:09:03.276 INFO:tasks.workunit.client.1.smithi159.stdout:4/745: mknod d13/d41/c105 0 2024-09-13T22:09:03.276 INFO:tasks.workunit.client.1.smithi159.stdout:4/746: creat d13/d15/d26/f106 x:0 0 0 2024-09-13T22:09:03.281 INFO:tasks.workunit.client.1.smithi159.stdout:4/747: mkdir d13/d15/d26/d51/dc8/d107 0 2024-09-13T22:09:03.283 INFO:tasks.workunit.client.1.smithi159.stdout:1/557: dread dd/d11/d18/f3d [0,4194304] 0 2024-09-13T22:09:03.283 INFO:tasks.workunit.client.1.smithi159.stdout:1/558: chown dd/d1e/d58/d5f 5 1 2024-09-13T22:09:03.305 INFO:tasks.workunit.client.1.smithi159.stdout:4/748: dwrite d13/d15/d26/d29/d3b/f63 [0,4194304] 0 2024-09-13T22:09:03.307 INFO:tasks.workunit.client.1.smithi159.stdout:4/749: creat d13/d15/d26/d29/d3b/daf/f108 x:0 0 0 2024-09-13T22:09:03.307 INFO:tasks.workunit.client.1.smithi159.stdout:1/559: dwrite dd/d11/d18/d49/d2d/d97/f6e [0,4194304] 0 2024-09-13T22:09:03.309 INFO:tasks.workunit.client.1.smithi159.stdout:4/750: mknod d13/d15/d26/d29/d3b/d66/d6c/c109 0 2024-09-13T22:09:03.312 INFO:tasks.workunit.client.1.smithi159.stdout:4/751: rename d13/d15/d26/l4a to d13/d41/d5d/l10a 0 2024-09-13T22:09:03.332 INFO:tasks.workunit.client.1.smithi159.stdout:4/752: dwrite d13/d41/d50/f60 [0,4194304] 0 2024-09-13T22:09:03.334 INFO:tasks.workunit.client.1.smithi159.stdout:4/753: link l4 d13/d15/d5a/l10b 0 2024-09-13T22:09:03.340 INFO:tasks.workunit.client.1.smithi159.stdout:6/459: sync 2024-09-13T22:09:03.340 INFO:tasks.workunit.client.1.smithi159.stdout:9/513: sync 2024-09-13T22:09:03.340 INFO:tasks.workunit.client.1.smithi159.stdout:6/460: stat d3/d2a 0 2024-09-13T22:09:03.341 INFO:tasks.workunit.client.1.smithi159.stdout:9/514: fdatasync d1/d5a/fa5 0 2024-09-13T22:09:03.341 INFO:tasks.workunit.client.1.smithi159.stdout:9/515: dread - d1/d9/d2a/d75/fa6 zero size 2024-09-13T22:09:03.341 INFO:tasks.workunit.client.1.smithi159.stdout:6/461: chown d3/d2a/d3c/d46/l5f 142065 1 2024-09-13T22:09:03.341 INFO:tasks.workunit.client.1.smithi159.stdout:9/516: readlink d1/dc/d10/l59 0 2024-09-13T22:09:03.341 INFO:tasks.workunit.client.1.smithi159.stdout:4/754: dread d13/d15/d26/d29/d3b/d8e/fe5 [0,4194304] 0 2024-09-13T22:09:03.342 INFO:tasks.workunit.client.1.smithi159.stdout:9/517: rename d1/d9/d2a/c3a to d1/dc/d10/d69/cb4 0 2024-09-13T22:09:03.345 INFO:tasks.workunit.client.1.smithi159.stdout:4/755: getdents d13/d15/d26/d51 0 2024-09-13T22:09:03.349 INFO:tasks.workunit.client.1.smithi159.stdout:6/462: dread d3/f35 [0,4194304] 0 2024-09-13T22:09:03.350 INFO:tasks.workunit.client.1.smithi159.stdout:4/756: creat d13/d15/d26/d29/d3b/de1/df6/d103/f10c x:0 0 0 2024-09-13T22:09:03.350 INFO:tasks.workunit.client.1.smithi159.stdout:4/757: creat d13/d41/d79/f10d x:0 0 0 2024-09-13T22:09:03.352 INFO:tasks.workunit.client.1.smithi159.stdout:6/463: dread d3/da/f10 [0,4194304] 0 2024-09-13T22:09:03.353 INFO:tasks.workunit.client.1.smithi159.stdout:4/758: mknod d13/d15/d26/d29/d3b/d8e/c10e 0 2024-09-13T22:09:03.355 INFO:tasks.workunit.client.1.smithi159.stdout:6/464: mknod d3/da/d29/d26/d6c/d6e/c8e 0 2024-09-13T22:09:03.356 INFO:tasks.workunit.client.1.smithi159.stdout:4/759: symlink d13/d15/d26/d51/d65/d67/l10f 0 2024-09-13T22:09:03.356 INFO:tasks.workunit.client.1.smithi159.stdout:9/518: dwrite d1/f30 [0,4194304] 0 2024-09-13T22:09:03.356 INFO:tasks.workunit.client.1.smithi159.stdout:9/519: write d1/dc/d27/d40/fb1 [84997,108250] 0 2024-09-13T22:09:03.357 INFO:tasks.workunit.client.1.smithi159.stdout:6/465: mknod d3/d6d/c8f 0 2024-09-13T22:09:03.358 INFO:tasks.workunit.client.1.smithi159.stdout:4/760: mknod d13/d15/d26/c110 0 2024-09-13T22:09:03.358 INFO:tasks.workunit.client.1.smithi159.stdout:4/761: fsync d13/d15/f1f 0 2024-09-13T22:09:03.361 INFO:tasks.workunit.client.1.smithi159.stdout:9/520: mkdir d1/dc/d27/da4/db5 0 2024-09-13T22:09:03.361 INFO:tasks.workunit.client.1.smithi159.stdout:9/521: chown d1/l5c 3141258 1 2024-09-13T22:09:03.362 INFO:tasks.workunit.client.1.smithi159.stdout:6/466: creat d3/da/d29/d1a/f90 x:0 0 0 2024-09-13T22:09:03.365 INFO:tasks.workunit.client.1.smithi159.stdout:4/762: creat d13/d15/d26/d29/d3b/d66/f111 x:0 0 0 2024-09-13T22:09:03.365 INFO:tasks.workunit.client.1.smithi159.stdout:4/763: write d13/d15/d26/d51/d65/d67/d82/fcf [1326486,12106] 0 2024-09-13T22:09:03.365 INFO:tasks.workunit.client.1.smithi159.stdout:6/467: mknod d3/da/d29/c91 0 2024-09-13T22:09:03.368 INFO:tasks.workunit.client.1.smithi159.stdout:4/764: creat d13/d41/d7e/f112 x:0 0 0 2024-09-13T22:09:03.373 INFO:tasks.workunit.client.1.smithi159.stdout:4/765: symlink d13/d15/d26/d51/dc8/d107/l113 0 2024-09-13T22:09:03.377 INFO:tasks.workunit.client.1.smithi159.stdout:4/766: rename d13/d15/d26/d51/d65/d67/d82/ffe to d13/d15/d26/d29/f114 0 2024-09-13T22:09:03.377 INFO:tasks.workunit.client.1.smithi159.stdout:4/767: write d13/d15/d26/d29/d3b/d8e/fe5 [2524982,2158] 0 2024-09-13T22:09:03.384 INFO:tasks.workunit.client.1.smithi159.stdout:9/522: dwrite d1/dc/d10/d6d/d4b/d98/da8/fb3 [0,4194304] 0 2024-09-13T22:09:03.385 INFO:tasks.workunit.client.1.smithi159.stdout:9/523: write d1/dc/d10/d69/f90 [141686,27245] 0 2024-09-13T22:09:03.385 INFO:tasks.workunit.client.1.smithi159.stdout:6/468: dwrite d3/da/d29/f45 [0,4194304] 0 2024-09-13T22:09:03.385 INFO:tasks.workunit.client.1.smithi159.stdout:6/469: creat d3/da/d29/d1a/f92 x:0 0 0 2024-09-13T22:09:03.388 INFO:tasks.workunit.client.1.smithi159.stdout:4/768: dread d13/f89 [0,4194304] 0 2024-09-13T22:09:03.388 INFO:tasks.workunit.client.1.smithi159.stdout:4/769: dread - d13/d15/d26/d29/d3b/d66/fba zero size 2024-09-13T22:09:03.388 INFO:tasks.workunit.client.1.smithi159.stdout:4/770: write d13/d15/d26/d29/d3b/d8e/fdd [272637,1699] 0 2024-09-13T22:09:03.393 INFO:tasks.workunit.client.1.smithi159.stdout:6/470: rename d3/da/d29/d1a/d3e/d5a/d6a/c82 to d3/d2a/c93 0 2024-09-13T22:09:03.396 INFO:tasks.workunit.client.1.smithi159.stdout:6/471: link d3/da/d29/d26/f4d d3/da/d29/d1a/f94 0 2024-09-13T22:09:03.397 INFO:tasks.workunit.client.1.smithi159.stdout:9/524: dread d1/f48 [0,4194304] 0 2024-09-13T22:09:03.400 INFO:tasks.workunit.client.1.smithi159.stdout:6/472: getdents d3/d2a/d3c/d46/d73 0 2024-09-13T22:09:03.400 INFO:tasks.workunit.client.1.smithi159.stdout:6/473: creat d3/da/d29/d26/d6c/d6e/f95 x:0 0 0 2024-09-13T22:09:03.401 INFO:tasks.workunit.client.1.smithi159.stdout:6/474: write d3/da/d25/f4b [4859380,4783] 0 2024-09-13T22:09:03.401 INFO:tasks.workunit.client.1.smithi159.stdout:6/475: truncate d3/da/d29/d1a/f94 1570285 0 2024-09-13T22:09:03.405 INFO:tasks.workunit.client.1.smithi159.stdout:6/476: rename d3/d2a/d3c/d50 to d3/da/d25/d69/d96 0 2024-09-13T22:09:03.405 INFO:tasks.workunit.client.1.smithi159.stdout:4/771: dwrite d13/d15/d26/d51/d65/d67/d82/fa3 [0,4194304] 0 2024-09-13T22:09:03.413 INFO:tasks.workunit.client.1.smithi159.stdout:4/772: mkdir d13/d15/d26/d29/d3b/de1/d115 0 2024-09-13T22:09:03.414 INFO:tasks.workunit.client.1.smithi159.stdout:4/773: chown d13/d15/d26/d29/d3b/d66/fba 2411179 1 2024-09-13T22:09:03.414 INFO:tasks.workunit.client.1.smithi159.stdout:6/477: dread d3/da/f10 [4194304,4194304] 0 2024-09-13T22:09:03.419 INFO:tasks.workunit.client.1.smithi159.stdout:4/774: unlink d13/d15/d26/d51/dc8/d107/l113 0 2024-09-13T22:09:03.421 INFO:tasks.workunit.client.1.smithi159.stdout:6/478: creat d3/da/d25/d69/d96/f97 x:0 0 0 2024-09-13T22:09:03.423 INFO:tasks.workunit.client.1.smithi159.stdout:6/479: mknod d3/d2a/d3c/d46/c98 0 2024-09-13T22:09:03.425 INFO:tasks.workunit.client.1.smithi159.stdout:4/775: rename f10 to d13/d41/d50/f116 0 2024-09-13T22:09:03.427 INFO:tasks.workunit.client.1.smithi159.stdout:6/480: creat d3/da/d25/d52/f99 x:0 0 0 2024-09-13T22:09:03.427 INFO:tasks.workunit.client.1.smithi159.stdout:6/481: dread - d3/da/d25/d52/f72 zero size 2024-09-13T22:09:03.427 INFO:tasks.workunit.client.1.smithi159.stdout:6/482: fsync d3/da/d29/d26/f37 0 2024-09-13T22:09:03.428 INFO:tasks.workunit.client.1.smithi159.stdout:4/776: truncate d13/d15/d26/d51/f5f 346634 0 2024-09-13T22:09:03.442 INFO:tasks.workunit.client.1.smithi159.stdout:4/777: dwrite d13/d15/d26/d29/d3b/d66/f111 [0,4194304] 0 2024-09-13T22:09:03.462 INFO:tasks.workunit.client.1.smithi159.stdout:4/778: dwrite d13/d15/f39 [0,4194304] 0 2024-09-13T22:09:03.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:03 smithi159 ceph-mon[35348]: pgmap v263: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 143 MiB/s rd, 172 MiB/s wr, 336 op/s 2024-09-13T22:09:03.512 INFO:tasks.workunit.client.1.smithi159.stdout:4/779: dwrite d13/d41/d4d/d75/fbd [0,4194304] 0 2024-09-13T22:09:03.523 INFO:tasks.workunit.client.1.smithi159.stdout:4/780: symlink d13/d15/d26/d29/d3b/de1/d115/l117 0 2024-09-13T22:09:03.524 INFO:tasks.workunit.client.1.smithi159.stdout:4/781: mkdir d13/d15/d26/d29/d3b/de1/d118 0 2024-09-13T22:09:03.533 INFO:tasks.workunit.client.1.smithi159.stdout:4/782: write d13/d15/d26/f61 [1946103,123791] 0 2024-09-13T22:09:03.533 INFO:tasks.workunit.client.1.smithi159.stdout:4/783: truncate d13/d15/d26/f47 1002791 0 2024-09-13T22:09:03.534 INFO:tasks.workunit.client.1.smithi159.stdout:4/784: symlink d13/d15/d26/d29/d3b/de1/d118/l119 0 2024-09-13T22:09:03.551 INFO:tasks.workunit.client.1.smithi159.stdout:4/785: dwrite d13/f14 [8388608,4194304] 0 2024-09-13T22:09:03.566 INFO:tasks.workunit.client.1.smithi159.stdout:4/786: link d13/d15/d26/l57 d13/d41/d50/l11a 0 2024-09-13T22:09:03.669 INFO:tasks.workunit.client.1.smithi159.stdout:4/787: dwrite d13/d15/d26/d51/dc8/f102 [0,4194304] 0 2024-09-13T22:09:03.672 INFO:tasks.workunit.client.1.smithi159.stdout:4/788: dread d13/d15/d26/f47 [0,4194304] 0 2024-09-13T22:09:03.672 INFO:tasks.workunit.client.1.smithi159.stdout:4/789: write d13/d15/d26/d29/d3b/d66/f77 [502055,99747] 0 2024-09-13T22:09:03.672 INFO:tasks.workunit.client.1.smithi159.stdout:4/790: readlink d13/d15/l35 0 2024-09-13T22:09:03.674 INFO:tasks.workunit.client.1.smithi159.stdout:4/791: write d13/d41/d50/fd4 [946405,118983] 0 2024-09-13T22:09:03.675 INFO:tasks.workunit.client.1.smithi159.stdout:4/792: mknod d13/d41/d5d/deb/c11b 0 2024-09-13T22:09:03.677 INFO:tasks.workunit.client.1.smithi159.stdout:4/793: creat d13/d15/d26/d51/d65/d67/f11c x:0 0 0 2024-09-13T22:09:03.693 INFO:tasks.workunit.client.1.smithi159.stdout:4/794: dwrite d13/d15/d26/f61 [0,4194304] 0 2024-09-13T22:09:03.694 INFO:tasks.workunit.client.1.smithi159.stdout:4/795: rmdir d13/d15/d26/d29/d3b/d66/df2 39 2024-09-13T22:09:03.695 INFO:tasks.workunit.client.1.smithi159.stdout:4/796: mknod d13/d15/d26/d29/d3b/de1/c11d 0 2024-09-13T22:09:03.696 INFO:tasks.workunit.client.1.smithi159.stdout:4/797: dread d13/fec [0,4194304] 0 2024-09-13T22:09:03.697 INFO:tasks.workunit.client.1.smithi159.stdout:4/798: unlink d13/d41/d7e/c9c 0 2024-09-13T22:09:03.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:03 smithi089 ceph-mon[27921]: pgmap v263: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 143 MiB/s rd, 172 MiB/s wr, 336 op/s 2024-09-13T22:09:03.780 INFO:tasks.workunit.client.1.smithi159.stdout:3/370: sync 2024-09-13T22:09:03.788 INFO:tasks.workunit.client.1.smithi159.stdout:3/371: write d0/d1/d3/d5/d25/d2c/f3d [2920260,74476] 0 2024-09-13T22:09:03.789 INFO:tasks.workunit.client.1.smithi159.stdout:3/372: read d0/d1/d3/d5/d25/f27 [317427,55766] 0 2024-09-13T22:09:03.789 INFO:tasks.workunit.client.1.smithi159.stdout:3/373: chown d0/d1/d3/dd/f64 112206373 1 2024-09-13T22:09:03.789 INFO:tasks.workunit.client.1.smithi159.stdout:3/374: write d0/d1/d3/dd/f63 [703606,78264] 0 2024-09-13T22:09:03.789 INFO:tasks.workunit.client.1.smithi159.stdout:3/375: chown d0/d1/d3/d5/db/d58/l6b 2301449 1 2024-09-13T22:09:03.927 INFO:tasks.workunit.client.1.smithi159.stdout:2/370: sync 2024-09-13T22:09:03.928 INFO:tasks.workunit.client.1.smithi159.stdout:0/657: sync 2024-09-13T22:09:03.928 INFO:tasks.workunit.client.1.smithi159.stdout:0/658: fdatasync d0/d2c/f33 0 2024-09-13T22:09:03.928 INFO:tasks.workunit.client.1.smithi159.stdout:0/659: dread - d0/d5e/fb5 zero size 2024-09-13T22:09:03.928 INFO:tasks.workunit.client.1.smithi159.stdout:2/371: write d9/d48/f7e [527457,21159] 0 2024-09-13T22:09:03.928 INFO:tasks.workunit.client.1.smithi159.stdout:2/372: dread - d9/f5e zero size 2024-09-13T22:09:03.929 INFO:tasks.workunit.client.1.smithi159.stdout:2/373: creat d9/d37/f7f x:0 0 0 2024-09-13T22:09:03.929 INFO:tasks.workunit.client.1.smithi159.stdout:2/374: truncate d9/d65/f60 5020501 0 2024-09-13T22:09:03.930 INFO:tasks.workunit.client.1.smithi159.stdout:2/375: read d9/f1d [113631,93802] 0 2024-09-13T22:09:03.952 INFO:tasks.workunit.client.1.smithi159.stdout:0/660: dwrite d0/d2c/f5a [4194304,4194304] 0 2024-09-13T22:09:04.056 INFO:tasks.workunit.client.1.smithi159.stdout:7/495: sync 2024-09-13T22:09:04.056 INFO:tasks.workunit.client.1.smithi159.stdout:5/499: sync 2024-09-13T22:09:04.057 INFO:tasks.workunit.client.1.smithi159.stdout:7/496: creat d3/d4b/d5e/fa2 x:0 0 0 2024-09-13T22:09:04.059 INFO:tasks.workunit.client.1.smithi159.stdout:5/500: symlink d1/d11/d64/d35/d6f/lb0 0 2024-09-13T22:09:04.061 INFO:tasks.workunit.client.1.smithi159.stdout:7/497: mknod d3/d2e/d6e/ca3 0 2024-09-13T22:09:04.061 INFO:tasks.workunit.client.1.smithi159.stdout:7/498: chown d3/d31/f76 18361833 1 2024-09-13T22:09:04.063 INFO:tasks.workunit.client.1.smithi159.stdout:5/501: creat d1/d11/d64/d35/fb1 x:0 0 0 2024-09-13T22:09:04.064 INFO:tasks.workunit.client.1.smithi159.stdout:7/499: stat d3/d31/d4d/c8d 0 2024-09-13T22:09:04.064 INFO:tasks.workunit.client.1.smithi159.stdout:7/500: fsync d3/d31/d4d/f99 0 2024-09-13T22:09:04.064 INFO:tasks.workunit.client.1.smithi159.stdout:7/501: readlink d3/d2e/l61 0 2024-09-13T22:09:04.065 INFO:tasks.workunit.client.1.smithi159.stdout:5/502: mkdir d1/d11/d64/d35/d60/db2 0 2024-09-13T22:09:04.070 INFO:tasks.workunit.client.1.smithi159.stdout:5/503: unlink d1/d11/d64/d35/c58 0 2024-09-13T22:09:04.070 INFO:tasks.workunit.client.1.smithi159.stdout:5/504: fdatasync d1/d11/d64/d35/d60/f80 0 2024-09-13T22:09:04.078 INFO:tasks.workunit.client.1.smithi159.stdout:7/502: rmdir d3 39 2024-09-13T22:09:04.079 INFO:tasks.workunit.client.1.smithi159.stdout:7/503: truncate d3/d18/f1d 1308521 0 2024-09-13T22:09:04.081 INFO:tasks.workunit.client.1.smithi159.stdout:7/504: creat d3/d18/fa4 x:0 0 0 2024-09-13T22:09:04.083 INFO:tasks.workunit.client.1.smithi159.stdout:7/505: write d3/f2a [559177,11767] 0 2024-09-13T22:09:04.083 INFO:tasks.workunit.client.1.smithi159.stdout:7/506: chown d3/d18/l28 62 1 2024-09-13T22:09:04.084 INFO:tasks.workunit.client.1.smithi159.stdout:7/507: readlink d3/d18/l55 0 2024-09-13T22:09:04.084 INFO:tasks.workunit.client.1.smithi159.stdout:7/508: write d3/d2e/fa0 [627866,32335] 0 2024-09-13T22:09:04.090 INFO:tasks.workunit.client.1.smithi159.stdout:5/505: dwrite d1/d11/d1c/d20/f88 [0,4194304] 0 2024-09-13T22:09:04.091 INFO:tasks.workunit.client.1.smithi159.stdout:5/506: truncate d1/d11/d64/d17/f6d 958508 0 2024-09-13T22:09:04.097 INFO:tasks.workunit.client.1.smithi159.stdout:7/509: rmdir d3/d18 39 2024-09-13T22:09:04.100 INFO:tasks.workunit.client.1.smithi159.stdout:3/376: sync 2024-09-13T22:09:04.101 INFO:tasks.workunit.client.1.smithi159.stdout:8/805: sync 2024-09-13T22:09:04.101 INFO:tasks.workunit.client.1.smithi159.stdout:6/483: sync 2024-09-13T22:09:04.101 INFO:tasks.workunit.client.1.smithi159.stdout:1/560: sync 2024-09-13T22:09:04.101 INFO:tasks.workunit.client.1.smithi159.stdout:3/377: truncate d0/d1/d34/f70 782594 0 2024-09-13T22:09:04.101 INFO:tasks.workunit.client.1.smithi159.stdout:3/378: chown d0/d1/d3/d5/c4a 767 1 2024-09-13T22:09:04.101 INFO:tasks.workunit.client.1.smithi159.stdout:9/525: sync 2024-09-13T22:09:04.105 INFO:tasks.workunit.client.1.smithi159.stdout:5/507: link d1/d11/d1c/d20/l52 d1/d11/d1c/d20/lb3 0 2024-09-13T22:09:04.110 INFO:tasks.workunit.client.1.smithi159.stdout:9/526: dread d1/f30 [0,4194304] 0 2024-09-13T22:09:04.111 INFO:tasks.workunit.client.1.smithi159.stdout:7/510: chown d3/d4b/l4c 15467126 1 2024-09-13T22:09:04.111 INFO:tasks.workunit.client.1.smithi159.stdout:6/484: mknod d3/da/d29/d26/d6c/c9a 0 2024-09-13T22:09:04.111 INFO:tasks.workunit.client.1.smithi159.stdout:6/485: chown d3/da/d25/f38 0 1 2024-09-13T22:09:04.111 INFO:tasks.workunit.client.1.smithi159.stdout:6/486: chown d3/da/d29/d1a/d3e/d5a/f88 2 1 2024-09-13T22:09:04.114 INFO:tasks.workunit.client.1.smithi159.stdout:3/379: rename d0/d1/d3/d4d to d0/d1/d3/d5/d25/d75 0 2024-09-13T22:09:04.114 INFO:tasks.workunit.client.1.smithi159.stdout:9/527: mknod d1/dc/d10/d69/cb6 0 2024-09-13T22:09:04.114 INFO:tasks.workunit.client.1.smithi159.stdout:9/528: readlink d1/dc/d10/d6d/l82 0 2024-09-13T22:09:04.116 INFO:tasks.workunit.client.1.smithi159.stdout:8/806: getdents da/d7e/d82/dd8/de7 0 2024-09-13T22:09:04.118 INFO:tasks.workunit.client.1.smithi159.stdout:6/487: truncate d3/da/d29/d26/d6c/f76 13116 0 2024-09-13T22:09:04.121 INFO:tasks.workunit.client.1.smithi159.stdout:5/508: rename d1/d11/l55 to d1/d11/d64/d35/d7c/lb4 0 2024-09-13T22:09:04.121 INFO:tasks.workunit.client.1.smithi159.stdout:5/509: truncate d1/d11/d9e/f31 292628 0 2024-09-13T22:09:04.122 INFO:tasks.workunit.client.1.smithi159.stdout:5/510: write d1/d11/d9e/fa7 [881906,33954] 0 2024-09-13T22:09:04.122 INFO:tasks.workunit.client.1.smithi159.stdout:5/511: readlink d1/l6 0 2024-09-13T22:09:04.124 INFO:tasks.workunit.client.1.smithi159.stdout:8/807: mkdir da/d5d/d113 0 2024-09-13T22:09:04.124 INFO:tasks.workunit.client.1.smithi159.stdout:3/380: dread d0/d1/f47 [0,4194304] 0 2024-09-13T22:09:04.129 INFO:tasks.workunit.client.1.smithi159.stdout:1/561: dwrite dd/d11/d21/f7b [0,4194304] 0 2024-09-13T22:09:04.129 INFO:tasks.workunit.client.1.smithi159.stdout:1/562: write dd/d11/d18/d2e/f43 [4558990,116678] 0 2024-09-13T22:09:04.130 INFO:tasks.workunit.client.1.smithi159.stdout:5/512: truncate d1/d11/d64/d82/d8c/faa 58204 0 2024-09-13T22:09:04.131 INFO:tasks.workunit.client.1.smithi159.stdout:4/799: sync 2024-09-13T22:09:04.131 INFO:tasks.workunit.client.1.smithi159.stdout:2/376: sync 2024-09-13T22:09:04.131 INFO:tasks.workunit.client.1.smithi159.stdout:0/661: sync 2024-09-13T22:09:04.131 INFO:tasks.workunit.client.1.smithi159.stdout:0/662: fdatasync d0/d2c/d71/d97/f9b 0 2024-09-13T22:09:04.135 INFO:tasks.workunit.client.1.smithi159.stdout:8/808: unlink da/d7e/d82/l9c 0 2024-09-13T22:09:04.142 INFO:tasks.workunit.client.1.smithi159.stdout:1/563: creat dd/d11/d18/d2e/fab x:0 0 0 2024-09-13T22:09:04.142 INFO:tasks.workunit.client.1.smithi159.stdout:1/564: readlink dd/d11/d13/l2a 0 2024-09-13T22:09:04.144 INFO:tasks.workunit.client.1.smithi159.stdout:2/377: link d9/d65/d40/d69/f74 d9/d65/d40/f80 0 2024-09-13T22:09:04.146 INFO:tasks.workunit.client.1.smithi159.stdout:1/565: creat dd/d11/d13/d4b/fac x:0 0 0 2024-09-13T22:09:04.147 INFO:tasks.workunit.client.1.smithi159.stdout:2/378: symlink d9/d65/l81 0 2024-09-13T22:09:04.147 INFO:tasks.workunit.client.1.smithi159.stdout:1/566: mknod dd/d11/d34/da8/cad 0 2024-09-13T22:09:04.148 INFO:tasks.workunit.client.1.smithi159.stdout:0/663: dread d0/d48/d4f/d54/f80 [0,4194304] 0 2024-09-13T22:09:04.148 INFO:tasks.workunit.client.1.smithi159.stdout:2/379: dread d9/da/d25/f2f [0,4194304] 0 2024-09-13T22:09:04.148 INFO:tasks.workunit.client.1.smithi159.stdout:0/664: fsync d0/d2c/f36 0 2024-09-13T22:09:04.149 INFO:tasks.workunit.client.1.smithi159.stdout:1/567: link dd/d11/d34/da8/cad dd/d11/d18/d49/cae 0 2024-09-13T22:09:04.150 INFO:tasks.workunit.client.1.smithi159.stdout:7/511: dwrite d3/d3f/fa1 [0,4194304] 0 2024-09-13T22:09:04.150 INFO:tasks.workunit.client.1.smithi159.stdout:7/512: fsync d3/d31/d4d/d4e/d7a/f9b 0 2024-09-13T22:09:04.155 INFO:tasks.workunit.client.1.smithi159.stdout:7/513: creat d3/d31/d4d/d4e/d4f/fa5 x:0 0 0 2024-09-13T22:09:04.155 INFO:tasks.workunit.client.1.smithi159.stdout:1/568: getdents dd/d1e/d58/d5f 0 2024-09-13T22:09:04.157 INFO:tasks.workunit.client.1.smithi159.stdout:7/514: truncate d3/d31/f66 3218093 0 2024-09-13T22:09:04.159 INFO:tasks.workunit.client.1.smithi159.stdout:1/569: creat dd/d1e/d58/d5f/d84/faf x:0 0 0 2024-09-13T22:09:04.159 INFO:tasks.workunit.client.1.smithi159.stdout:1/570: chown dd/d11/d34 42360152 1 2024-09-13T22:09:04.159 INFO:tasks.workunit.client.1.smithi159.stdout:1/571: readlink dd/d1e/d58/l8e 0 2024-09-13T22:09:04.161 INFO:tasks.workunit.client.1.smithi159.stdout:2/380: dread d9/d65/f60 [0,4194304] 0 2024-09-13T22:09:04.162 INFO:tasks.workunit.client.1.smithi159.stdout:9/529: dwrite d1/dc/d10/f39 [0,4194304] 0 2024-09-13T22:09:04.162 INFO:tasks.workunit.client.1.smithi159.stdout:3/381: dwrite d0/d1/d3/d5/db/d58/f6c [4194304,4194304] 0 2024-09-13T22:09:04.162 INFO:tasks.workunit.client.1.smithi159.stdout:3/382: truncate d0/d1/d15/f5e 97591 0 2024-09-13T22:09:04.163 INFO:tasks.workunit.client.1.smithi159.stdout:7/515: truncate d3/d31/d4d/d9e/f71 1008731 0 2024-09-13T22:09:04.163 INFO:tasks.workunit.client.1.smithi159.stdout:0/665: dread d0/d48/d4f/d54/d74/db2/fd6 [0,4194304] 0 2024-09-13T22:09:04.163 INFO:tasks.workunit.client.1.smithi159.stdout:5/513: dwrite d1/d11/d64/d17/f4b [0,4194304] 0 2024-09-13T22:09:04.164 INFO:tasks.workunit.client.1.smithi159.stdout:2/381: mkdir d9/da/d82 0 2024-09-13T22:09:04.165 INFO:tasks.workunit.client.1.smithi159.stdout:4/800: dwrite d13/d15/d26/d51/d65/d67/d82/fcf [0,4194304] 0 2024-09-13T22:09:04.165 INFO:tasks.workunit.client.1.smithi159.stdout:4/801: write d13/d15/d26/d29/d3b/fbc [705125,29469] 0 2024-09-13T22:09:04.165 INFO:tasks.workunit.client.1.smithi159.stdout:4/802: fsync d13/d15/d26/d29/d3b/d66/d6c/f8a 0 2024-09-13T22:09:04.166 INFO:tasks.workunit.client.1.smithi159.stdout:9/530: creat d1/dc/d10/d6d/d2f/fb7 x:0 0 0 2024-09-13T22:09:04.166 INFO:tasks.workunit.client.1.smithi159.stdout:9/531: readlink d1/dc/d10/d6d/l62 0 2024-09-13T22:09:04.166 INFO:tasks.workunit.client.1.smithi159.stdout:9/532: write d1/dc/d10/d6d/fac [471208,87036] 0 2024-09-13T22:09:04.166 INFO:tasks.workunit.client.1.smithi159.stdout:9/533: chown d1/dc/d10/d6d/fac 0 1 2024-09-13T22:09:04.167 INFO:tasks.workunit.client.1.smithi159.stdout:1/572: dread dd/d11/d18/d74/f76 [0,4194304] 0 2024-09-13T22:09:04.167 INFO:tasks.workunit.client.1.smithi159.stdout:1/573: write dd/d11/f87 [601678,37719] 0 2024-09-13T22:09:04.167 INFO:tasks.workunit.client.1.smithi159.stdout:1/574: truncate dd/d11/d13/d4b/f5b 1532789 0 2024-09-13T22:09:04.167 INFO:tasks.workunit.client.1.smithi159.stdout:1/575: stat dd/d11/d18/d49/c38 0 2024-09-13T22:09:04.172 INFO:tasks.workunit.client.1.smithi159.stdout:3/383: link d0/d1/d3/dd/l1e d0/d1/d3/d5/db/d39/l76 0 2024-09-13T22:09:04.173 INFO:tasks.workunit.client.1.smithi159.stdout:9/534: write d1/f30 [1760944,36528] 0 2024-09-13T22:09:04.173 INFO:tasks.workunit.client.1.smithi159.stdout:9/535: write d1/dc/d10/f3b [1931857,57975] 0 2024-09-13T22:09:04.173 INFO:tasks.workunit.client.1.smithi159.stdout:9/536: chown d1/dc/d27/d40/fb1 32508009 1 2024-09-13T22:09:04.173 INFO:tasks.workunit.client.1.smithi159.stdout:9/537: write d1/f30 [3156727,21696] 0 2024-09-13T22:09:04.176 INFO:tasks.workunit.client.1.smithi159.stdout:7/516: rename d3/d31/d4d/f57 to d3/d31/d4d/fa6 0 2024-09-13T22:09:04.180 INFO:tasks.workunit.client.1.smithi159.stdout:0/666: dwrite d0/d5e/f44 [0,4194304] 0 2024-09-13T22:09:04.180 INFO:tasks.workunit.client.1.smithi159.stdout:0/667: chown d0/d48/d4f/d54/dac 5 1 2024-09-13T22:09:04.186 INFO:tasks.workunit.client.1.smithi159.stdout:4/803: creat d13/d41/d79/db2/f11e x:0 0 0 2024-09-13T22:09:04.189 INFO:tasks.workunit.client.1.smithi159.stdout:9/538: dwrite d1/dc/d10/d6d/d4b/f76 [4194304,4194304] 0 2024-09-13T22:09:04.192 INFO:tasks.workunit.client.1.smithi159.stdout:1/576: symlink dd/lb0 0 2024-09-13T22:09:04.192 INFO:tasks.workunit.client.1.smithi159.stdout:1/577: write dd/d11/d34/d59/f92 [6061102,94782] 0 2024-09-13T22:09:04.193 INFO:tasks.workunit.client.1.smithi159.stdout:3/384: creat d0/d1/d34/d73/f77 x:0 0 0 2024-09-13T22:09:04.198 INFO:tasks.workunit.client.1.smithi159.stdout:9/539: dread d1/dc/d10/d6d/d4b/f76 [0,4194304] 0 2024-09-13T22:09:04.198 INFO:tasks.workunit.client.1.smithi159.stdout:1/578: dread f3 [0,4194304] 0 2024-09-13T22:09:04.202 INFO:tasks.workunit.client.1.smithi159.stdout:3/385: dread d0/d1/d3/d5/d25/d4e/d5a/f21 [0,4194304] 0 2024-09-13T22:09:04.213 INFO:tasks.workunit.client.1.smithi159.stdout:9/540: mknod d1/dc/d10/d6d/d2f/d8b/cb8 0 2024-09-13T22:09:04.215 INFO:tasks.workunit.client.1.smithi159.stdout:1/579: link dd/d11/d13/f79 dd/d11/d34/fb1 0 2024-09-13T22:09:04.218 INFO:tasks.workunit.client.1.smithi159.stdout:0/668: getdents d0/d2c/d71/d97 0 2024-09-13T22:09:04.219 INFO:tasks.workunit.client.1.smithi159.stdout:4/804: mkdir d13/d11f 0 2024-09-13T22:09:04.222 INFO:tasks.workunit.client.1.smithi159.stdout:9/541: creat d1/dc/d10/fb9 x:0 0 0 2024-09-13T22:09:04.225 INFO:tasks.workunit.client.1.smithi159.stdout:7/517: dwrite d3/d31/f66 [0,4194304] 0 2024-09-13T22:09:04.226 INFO:tasks.workunit.client.1.smithi159.stdout:7/518: write d3/d31/f76 [635383,76336] 0 2024-09-13T22:09:04.226 INFO:tasks.workunit.client.1.smithi159.stdout:7/519: truncate d3/d4b/f6d 4612198 0 2024-09-13T22:09:04.226 INFO:tasks.workunit.client.1.smithi159.stdout:7/520: write d3/d31/d4d/fa6 [3046053,114307] 0 2024-09-13T22:09:04.231 INFO:tasks.workunit.client.1.smithi159.stdout:1/580: creat dd/d11/fb2 x:0 0 0 2024-09-13T22:09:04.232 INFO:tasks.workunit.client.1.smithi159.stdout:3/386: dwrite d0/d1/d3/d5/f17 [4194304,4194304] 0 2024-09-13T22:09:04.240 INFO:tasks.workunit.client.1.smithi159.stdout:0/669: rename d0/l29 to d0/d48/d7d/dca/le0 0 2024-09-13T22:09:04.240 INFO:tasks.workunit.client.1.smithi159.stdout:5/514: dwrite d1/d11/d64/d17/f6d [0,4194304] 0 2024-09-13T22:09:04.240 INFO:tasks.workunit.client.1.smithi159.stdout:5/515: chown d1/f76 122153996 1 2024-09-13T22:09:04.242 INFO:tasks.workunit.client.1.smithi159.stdout:4/805: link d13/cfa d13/d15/d26/d51/dc8/c120 0 2024-09-13T22:09:04.242 INFO:tasks.workunit.client.1.smithi159.stdout:1/581: dread dd/d11/d18/fa6 [0,4194304] 0 2024-09-13T22:09:04.244 INFO:tasks.workunit.client.1.smithi159.stdout:7/521: creat d3/d31/d4d/fa7 x:0 0 0 2024-09-13T22:09:04.249 INFO:tasks.workunit.client.1.smithi159.stdout:5/516: symlink d1/d11/d1c/d20/d44/d89/lb5 0 2024-09-13T22:09:04.251 INFO:tasks.workunit.client.1.smithi159.stdout:1/582: mkdir dd/d11/d18/d74/d82/d9a/db3 0 2024-09-13T22:09:04.251 INFO:tasks.workunit.client.1.smithi159.stdout:1/583: chown dd/d11/d18/d74/d82/da1 165122622 1 2024-09-13T22:09:04.251 INFO:tasks.workunit.client.1.smithi159.stdout:4/806: dread d13/f14 [4194304,4194304] 0 2024-09-13T22:09:04.254 INFO:tasks.workunit.client.1.smithi159.stdout:7/522: link d3/d31/d4d/d4e/d4f/d6c/c7f d3/d2e/d6e/d74/ca8 0 2024-09-13T22:09:04.255 INFO:tasks.workunit.client.1.smithi159.stdout:3/387: rmdir d0/d1/d34/d73 39 2024-09-13T22:09:04.257 INFO:tasks.workunit.client.1.smithi159.stdout:1/584: mkdir dd/d1e/d58/db4 0 2024-09-13T22:09:04.258 INFO:tasks.workunit.client.1.smithi159.stdout:4/807: creat d13/d15/d26/d29/d3b/f121 x:0 0 0 2024-09-13T22:09:04.259 INFO:tasks.workunit.client.1.smithi159.stdout:4/808: creat d13/d15/d26/d51/dc8/f122 x:0 0 0 2024-09-13T22:09:04.261 INFO:tasks.workunit.client.1.smithi159.stdout:3/388: mkdir d0/d78 0 2024-09-13T22:09:04.261 INFO:tasks.workunit.client.1.smithi159.stdout:3/389: write d0/d1/d3/dd/f64 [1600290,56584] 0 2024-09-13T22:09:04.264 INFO:tasks.workunit.client.1.smithi159.stdout:1/585: link dd/d11/d18/d2e/c39 dd/d11/d18/d49/d2d/d62/d7d/cb5 0 2024-09-13T22:09:04.264 INFO:tasks.workunit.client.1.smithi159.stdout:1/586: fsync dd/d11/d18/d49/d2d/d97/f93 0 2024-09-13T22:09:04.264 INFO:tasks.workunit.client.1.smithi159.stdout:1/587: write dd/d11/d18/d2e/f33 [7005078,104057] 0 2024-09-13T22:09:04.264 INFO:tasks.workunit.client.1.smithi159.stdout:1/588: fsync dd/d11/d18/d2e/f43 0 2024-09-13T22:09:04.264 INFO:tasks.workunit.client.1.smithi159.stdout:1/589: chown dd/d1e/f88 6547467 1 2024-09-13T22:09:04.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/590: rmdir dd/d11/d34 39 2024-09-13T22:09:04.270 INFO:tasks.workunit.client.1.smithi159.stdout:0/670: dwrite d0/d48/d7d/f9d [0,4194304] 0 2024-09-13T22:09:04.270 INFO:tasks.workunit.client.1.smithi159.stdout:0/671: readlink d0/d5e/l5b 0 2024-09-13T22:09:04.272 INFO:tasks.workunit.client.1.smithi159.stdout:1/591: link dd/d11/d18/d49/d2d/d97/f6e dd/d11/d18/d49/fb6 0 2024-09-13T22:09:04.272 INFO:tasks.workunit.client.1.smithi159.stdout:1/592: write dd/d11/d13/d4b/d52/d63/f9c [1286892,101335] 0 2024-09-13T22:09:04.272 INFO:tasks.workunit.client.1.smithi159.stdout:1/593: stat dd/d11/d18/d49/d2d/d97/f70 0 2024-09-13T22:09:04.276 INFO:tasks.workunit.client.1.smithi159.stdout:1/594: symlink dd/d1e/lb7 0 2024-09-13T22:09:04.300 INFO:tasks.workunit.client.1.smithi159.stdout:1/595: dread dd/d1e/f1f [0,4194304] 0 2024-09-13T22:09:04.301 INFO:tasks.workunit.client.1.smithi159.stdout:1/596: rmdir dd/d11/d18/d49/d2d 39 2024-09-13T22:09:04.301 INFO:tasks.workunit.client.1.smithi159.stdout:1/597: fsync dd/d11/d18/d49/d2d/d62/f75 0 2024-09-13T22:09:04.301 INFO:tasks.workunit.client.1.smithi159.stdout:5/517: dwrite d1/fad [0,4194304] 0 2024-09-13T22:09:04.301 INFO:tasks.workunit.client.1.smithi159.stdout:7/523: dwrite d3/d2e/f82 [0,4194304] 0 2024-09-13T22:09:04.302 INFO:tasks.workunit.client.1.smithi159.stdout:7/524: write d3/d18/f1d [1448860,55437] 0 2024-09-13T22:09:04.302 INFO:tasks.workunit.client.1.smithi159.stdout:4/809: dwrite d13/f74 [0,4194304] 0 2024-09-13T22:09:04.302 INFO:tasks.workunit.client.1.smithi159.stdout:3/390: dwrite d0/d1/f47 [0,4194304] 0 2024-09-13T22:09:04.302 INFO:tasks.workunit.client.1.smithi159.stdout:3/391: write d0/d1/d3/d5/d25/d2c/d65/f72 [285470,91847] 0 2024-09-13T22:09:04.302 INFO:tasks.workunit.client.1.smithi159.stdout:1/598: unlink dd/d1e/f88 0 2024-09-13T22:09:04.304 INFO:tasks.workunit.client.1.smithi159.stdout:0/672: dwrite d0/d48/d4f/f46 [0,4194304] 0 2024-09-13T22:09:04.305 INFO:tasks.workunit.client.1.smithi159.stdout:0/673: write d0/d5e/f55 [1198546,104306] 0 2024-09-13T22:09:04.305 INFO:tasks.workunit.client.1.smithi159.stdout:0/674: read d0/d2c/f37 [821764,87489] 0 2024-09-13T22:09:04.315 INFO:tasks.workunit.client.1.smithi159.stdout:5/518: rename d1/d11/d64/d35/d60/l90 to d1/d11/d1c/d20/lb6 0 2024-09-13T22:09:04.316 INFO:tasks.workunit.client.1.smithi159.stdout:7/525: getdents d3/d31/d4d/d4e 0 2024-09-13T22:09:04.316 INFO:tasks.workunit.client.1.smithi159.stdout:7/526: write d3/d2e/fa0 [1387616,2250] 0 2024-09-13T22:09:04.316 INFO:tasks.workunit.client.1.smithi159.stdout:4/810: dwrite d13/d15/f39 [0,4194304] 0 2024-09-13T22:09:04.317 INFO:tasks.workunit.client.1.smithi159.stdout:7/527: dread d3/d31/f33 [0,4194304] 0 2024-09-13T22:09:04.317 INFO:tasks.workunit.client.1.smithi159.stdout:7/528: stat d3/d31/f33 0 2024-09-13T22:09:04.323 INFO:tasks.workunit.client.1.smithi159.stdout:1/599: mknod dd/d1e/d58/db4/cb8 0 2024-09-13T22:09:04.330 INFO:tasks.workunit.client.1.smithi159.stdout:0/675: mknod d0/d2c/ce1 0 2024-09-13T22:09:04.330 INFO:tasks.workunit.client.1.smithi159.stdout:0/676: read d0/d48/d4f/d54/d74/db2/fd6 [1147069,113804] 0 2024-09-13T22:09:04.332 INFO:tasks.workunit.client.1.smithi159.stdout:3/392: rename d0/d1/d15/f6d to d0/d1/d34/f79 0 2024-09-13T22:09:04.334 INFO:tasks.workunit.client.1.smithi159.stdout:5/519: dwrite d1/f97 [0,4194304] 0 2024-09-13T22:09:04.334 INFO:tasks.workunit.client.1.smithi159.stdout:5/520: creat d1/d11/d50/fb7 x:0 0 0 2024-09-13T22:09:04.337 INFO:tasks.workunit.client.1.smithi159.stdout:4/811: creat d13/d15/d26/d51/f123 x:0 0 0 2024-09-13T22:09:04.339 INFO:tasks.workunit.client.1.smithi159.stdout:7/529: mknod d3/d31/ca9 0 2024-09-13T22:09:04.345 INFO:tasks.workunit.client.1.smithi159.stdout:3/393: dwrite d0/d1/d3/d5/db/d39/f52 [0,4194304] 0 2024-09-13T22:09:04.345 INFO:tasks.workunit.client.1.smithi159.stdout:3/394: chown d0/d1/d3/d5/d25/d4e/d5a/f19 36 1 2024-09-13T22:09:04.350 INFO:tasks.workunit.client.1.smithi159.stdout:1/600: creat dd/d11/d18/d74/d82/da1/fb9 x:0 0 0 2024-09-13T22:09:04.354 INFO:tasks.workunit.client.1.smithi159.stdout:0/677: mknod d0/d48/d7d/dca/dcd/ce2 0 2024-09-13T22:09:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:5/521: rename d1/d11/d64/d17/f4b to d1/d11/d64/d35/d60/fb8 0 2024-09-13T22:09:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:5/522: truncate d1/d11/d9e/f72 960211 0 2024-09-13T22:09:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:3/395: dwrite d0/d1/f47 [0,4194304] 0 2024-09-13T22:09:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:3/396: stat d0/d1/d3/d5/d25/l2b 0 2024-09-13T22:09:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:3/397: chown d0/d1/d3/d5/d25/l2b 37 1 2024-09-13T22:09:04.364 INFO:tasks.workunit.client.1.smithi159.stdout:3/398: fdatasync d0/d1/d3/dd/f64 0 2024-09-13T22:09:04.365 INFO:tasks.workunit.client.1.smithi159.stdout:7/530: mknod d3/d31/d4d/d9e/caa 0 2024-09-13T22:09:04.365 INFO:tasks.workunit.client.1.smithi159.stdout:0/678: dread d0/d48/d4f/d2b/f7c [0,4194304] 0 2024-09-13T22:09:04.369 INFO:tasks.workunit.client.1.smithi159.stdout:1/601: link dd/d11/d18/d74/l81 dd/d1c/lba 0 2024-09-13T22:09:04.370 INFO:tasks.workunit.client.1.smithi159.stdout:5/523: rmdir d1/d11 39 2024-09-13T22:09:04.372 INFO:tasks.workunit.client.1.smithi159.stdout:4/812: mkdir d13/d124 0 2024-09-13T22:09:04.373 INFO:tasks.workunit.client.1.smithi159.stdout:0/679: symlink d0/d5e/le3 0 2024-09-13T22:09:04.375 INFO:tasks.workunit.client.1.smithi159.stdout:5/524: dread d1/d11/d1c/f51 [0,4194304] 0 2024-09-13T22:09:04.376 INFO:tasks.workunit.client.1.smithi159.stdout:4/813: mkdir d13/d15/d26/d29/d3b/d66/d6c/d125 0 2024-09-13T22:09:04.376 INFO:tasks.workunit.client.1.smithi159.stdout:4/814: write d13/d15/d26/d51/f123 [351533,124772] 0 2024-09-13T22:09:04.377 INFO:tasks.workunit.client.1.smithi159.stdout:0/680: rmdir d0/d48/d4f/d54/dac 39 2024-09-13T22:09:04.384 INFO:tasks.workunit.client.1.smithi159.stdout:5/525: symlink d1/d11/d9e/lb9 0 2024-09-13T22:09:04.385 INFO:tasks.workunit.client.1.smithi159.stdout:5/526: chown d1/d11/d9e/c3b 0 1 2024-09-13T22:09:04.385 INFO:tasks.workunit.client.1.smithi159.stdout:1/602: rename dd/d11/d18/d2e to dd/d1e/d58/d8a/dbb 0 2024-09-13T22:09:04.387 INFO:tasks.workunit.client.1.smithi159.stdout:3/399: dwrite d0/d1/d3/d5/d25/d4e/d5a/f19 [0,4194304] 0 2024-09-13T22:09:04.393 INFO:tasks.workunit.client.1.smithi159.stdout:5/527: dread d1/f3e [0,4194304] 0 2024-09-13T22:09:04.394 INFO:tasks.workunit.client.1.smithi159.stdout:0/681: dwrite d0/d48/d7d/fcc [0,4194304] 0 2024-09-13T22:09:04.394 INFO:tasks.workunit.client.1.smithi159.stdout:7/531: dwrite d3/d4b/d5e/f64 [0,4194304] 0 2024-09-13T22:09:04.394 INFO:tasks.workunit.client.1.smithi159.stdout:7/532: stat d3/d31/d4d/d4e/d4f/f92 0 2024-09-13T22:09:04.394 INFO:tasks.workunit.client.1.smithi159.stdout:0/682: write d0/d48/d4f/d66/f87 [3489179,52874] 0 2024-09-13T22:09:04.394 INFO:tasks.workunit.client.1.smithi159.stdout:0/683: creat d0/d48/d4f/d54/d74/dbe/fe4 x:0 0 0 2024-09-13T22:09:04.394 INFO:tasks.workunit.client.1.smithi159.stdout:5/528: mkdir d1/d11/d64/d82/d8f/dba 0 2024-09-13T22:09:04.395 INFO:tasks.workunit.client.1.smithi159.stdout:5/529: fsync d1/d11/d1c/d20/d44/f5d 0 2024-09-13T22:09:04.403 INFO:tasks.workunit.client.1.smithi159.stdout:0/684: rename d0/d48/d4f/d54/c64 to d0/d48/d4f/d54/dac/ce5 0 2024-09-13T22:09:04.404 INFO:tasks.workunit.client.1.smithi159.stdout:5/530: symlink d1/d11/d1c/d9c/lbb 0 2024-09-13T22:09:04.404 INFO:tasks.workunit.client.1.smithi159.stdout:5/531: write d1/d11/d64/fd [1966377,48438] 0 2024-09-13T22:09:04.405 INFO:tasks.workunit.client.1.smithi159.stdout:1/603: dwrite dd/d11/d18/d49/d2d/d97/f6e [0,4194304] 0 2024-09-13T22:09:04.405 INFO:tasks.workunit.client.1.smithi159.stdout:1/604: chown dd/d11/d18/d49/d2d/d62/d7d/cb5 6644656 1 2024-09-13T22:09:04.406 INFO:tasks.workunit.client.1.smithi159.stdout:0/685: creat d0/d48/d7d/dca/fe6 x:0 0 0 2024-09-13T22:09:04.415 INFO:tasks.workunit.client.1.smithi159.stdout:5/532: dread d1/d11/d1c/d20/d44/f5d [0,4194304] 0 2024-09-13T22:09:04.417 INFO:tasks.workunit.client.1.smithi159.stdout:5/533: dread d1/d11/d9e/f78 [0,4194304] 0 2024-09-13T22:09:04.419 INFO:tasks.workunit.client.1.smithi159.stdout:5/534: creat d1/d11/fbc x:0 0 0 2024-09-13T22:09:04.419 INFO:tasks.workunit.client.1.smithi159.stdout:5/535: creat d1/d11/d50/fbd x:0 0 0 2024-09-13T22:09:04.422 INFO:tasks.workunit.client.1.smithi159.stdout:5/536: creat d1/d11/d64/d82/d8f/fbe x:0 0 0 2024-09-13T22:09:04.422 INFO:tasks.workunit.client.1.smithi159.stdout:5/537: truncate d1/d11/d9e/fa5 505351 0 2024-09-13T22:09:04.435 INFO:tasks.workunit.client.1.smithi159.stdout:3/400: dwrite d0/d1/d3/d5/d25/d4e/d5a/f67 [0,4194304] 0 2024-09-13T22:09:04.435 INFO:tasks.workunit.client.1.smithi159.stdout:3/401: chown d0/d1/d3/d5/d25/f27 14002 1 2024-09-13T22:09:04.436 INFO:tasks.workunit.client.1.smithi159.stdout:3/402: stat d0/d1/d3/d5/db/d39/f3f 0 2024-09-13T22:09:04.436 INFO:tasks.workunit.client.1.smithi159.stdout:3/403: chown d0/d1/d3/dd/f64 297 1 2024-09-13T22:09:04.437 INFO:tasks.workunit.client.1.smithi159.stdout:3/404: symlink d0/d68/l7a 0 2024-09-13T22:09:04.439 INFO:tasks.workunit.client.1.smithi159.stdout:3/405: link d0/d1/d3/dd/f10 d0/d68/f7b 0 2024-09-13T22:09:04.441 INFO:tasks.workunit.client.1.smithi159.stdout:3/406: rename d0/d1/d3/dd/f1b to d0/d78/f7c 0 2024-09-13T22:09:04.441 INFO:tasks.workunit.client.1.smithi159.stdout:3/407: chown d0/d1/d3/d5/d25/d75/d5b/d45/f53 7384769 1 2024-09-13T22:09:04.441 INFO:tasks.workunit.client.1.smithi159.stdout:3/408: chown d0/d1/d3/d5/d25/d4e/d5a/f4c 3 1 2024-09-13T22:09:04.441 INFO:tasks.workunit.client.1.smithi159.stdout:3/409: write d0/d1/d3/d5/db/f60 [5378618,71656] 0 2024-09-13T22:09:04.443 INFO:tasks.workunit.client.1.smithi159.stdout:3/410: rename d0/d1/d3/d5/d25/d2c/f3d to d0/d1/d3/d5/d25/d75/d5b/d45/f7d 0 2024-09-13T22:09:04.443 INFO:tasks.workunit.client.1.smithi159.stdout:3/411: fdatasync d0/d1/d3/dd/f63 0 2024-09-13T22:09:04.449 INFO:tasks.workunit.client.1.smithi159.stdout:7/533: dwrite d3/d2e/f82 [0,4194304] 0 2024-09-13T22:09:04.449 INFO:tasks.workunit.client.1.smithi159.stdout:7/534: truncate d3/d18/f54 4271203 0 2024-09-13T22:09:04.449 INFO:tasks.workunit.client.1.smithi159.stdout:0/686: dwrite d0/d48/d4f/d66/f87 [0,4194304] 0 2024-09-13T22:09:04.449 INFO:tasks.workunit.client.1.smithi159.stdout:1/605: dwrite dd/d11/d13/d4b/d52/d63/f9c [0,4194304] 0 2024-09-13T22:09:04.449 INFO:tasks.workunit.client.1.smithi159.stdout:0/687: getdents d0/d2c/d71/d97 0 2024-09-13T22:09:04.450 INFO:tasks.workunit.client.1.smithi159.stdout:0/688: write d0/d2c/d71/d97/f9b [299506,129097] 0 2024-09-13T22:09:04.450 INFO:tasks.workunit.client.1.smithi159.stdout:5/538: dwrite d1/d11/d9e/fa7 [0,4194304] 0 2024-09-13T22:09:04.453 INFO:tasks.workunit.client.1.smithi159.stdout:3/412: dread d0/d1/d34/f40 [0,4194304] 0 2024-09-13T22:09:04.453 INFO:tasks.workunit.client.1.smithi159.stdout:3/413: chown d0/d68 0 1 2024-09-13T22:09:04.453 INFO:tasks.workunit.client.1.smithi159.stdout:3/414: stat d0/d1/c4 0 2024-09-13T22:09:04.454 INFO:tasks.workunit.client.1.smithi159.stdout:0/689: symlink d0/d48/d4f/d54/d74/le7 0 2024-09-13T22:09:04.455 INFO:tasks.workunit.client.1.smithi159.stdout:0/690: getdents d0/d2c/d71/dc3 0 2024-09-13T22:09:04.455 INFO:tasks.workunit.client.1.smithi159.stdout:0/691: readlink d0/d48/d7d/l7f 0 2024-09-13T22:09:04.459 INFO:tasks.workunit.client.1.smithi159.stdout:3/415: mkdir d0/d1/d3/d5/d25/d7e 0 2024-09-13T22:09:04.459 INFO:tasks.workunit.client.1.smithi159.stdout:7/535: dread d3/d3f/f48 [0,4194304] 0 2024-09-13T22:09:04.461 INFO:tasks.workunit.client.1.smithi159.stdout:5/539: write d1/d11/d1c/d20/d44/f7e [621294,71640] 0 2024-09-13T22:09:04.461 INFO:tasks.workunit.client.1.smithi159.stdout:0/692: rename d0/d2c/d71/d97 to d0/d48/dd9/de8 0 2024-09-13T22:09:04.461 INFO:tasks.workunit.client.1.smithi159.stdout:0/693: creat d0/d2c/fe9 x:0 0 0 2024-09-13T22:09:04.463 INFO:tasks.workunit.client.1.smithi159.stdout:7/536: truncate d3/d18/f20 582870 0 2024-09-13T22:09:04.469 INFO:tasks.workunit.client.1.smithi159.stdout:5/540: rmdir d1/d11/d64/d82 39 2024-09-13T22:09:04.472 INFO:tasks.workunit.client.1.smithi159.stdout:0/694: mknod d0/d48/d4f/d2b/da3/cea 0 2024-09-13T22:09:04.472 INFO:tasks.workunit.client.1.smithi159.stdout:0/695: readlink d0/d5e/le3 0 2024-09-13T22:09:04.477 INFO:tasks.workunit.client.1.smithi159.stdout:5/541: mknod d1/d11/d64/cbf 0 2024-09-13T22:09:04.477 INFO:tasks.workunit.client.1.smithi159.stdout:1/606: dwrite dd/d11/d34/d59/f98 [0,4194304] 0 2024-09-13T22:09:04.477 INFO:tasks.workunit.client.1.smithi159.stdout:1/607: chown dd/d1c/lba 330155454 1 2024-09-13T22:09:04.477 INFO:tasks.workunit.client.1.smithi159.stdout:1/608: creat dd/d11/d13/d4b/d52/fbc x:0 0 0 2024-09-13T22:09:04.477 INFO:tasks.workunit.client.1.smithi159.stdout:5/542: link d1/d11/d64/d17/f54 d1/d11/d64/d17/fc0 0 2024-09-13T22:09:04.477 INFO:tasks.workunit.client.1.smithi159.stdout:3/416: fsync d0/d1/d3/dd/f10 0 2024-09-13T22:09:04.481 INFO:tasks.workunit.client.1.smithi159.stdout:1/609: creat dd/d1e/d58/d8a/dbb/d3c/fbd x:0 0 0 2024-09-13T22:09:04.483 INFO:tasks.workunit.client.1.smithi159.stdout:5/543: creat d1/d11/d64/d82/fc1 x:0 0 0 2024-09-13T22:09:04.484 INFO:tasks.workunit.client.1.smithi159.stdout:5/544: truncate d1/d11/d64/d35/f40 4503929 0 2024-09-13T22:09:04.484 INFO:tasks.workunit.client.1.smithi159.stdout:5/545: chown d1/d11/d64/d35/f4c 943 1 2024-09-13T22:09:04.484 INFO:tasks.workunit.client.1.smithi159.stdout:5/546: write d1/d11/d64/d82/fc1 [333189,12993] 0 2024-09-13T22:09:04.484 INFO:tasks.workunit.client.1.smithi159.stdout:5/547: fdatasync d1/d11/d1c/f6e 0 2024-09-13T22:09:04.484 INFO:tasks.workunit.client.1.smithi159.stdout:5/548: stat d1/d11/d64/d35/l95 0 2024-09-13T22:09:04.484 INFO:tasks.workunit.client.1.smithi159.stdout:3/417: mkdir d0/d1/d3/d5/d25/d2c/d7f 0 2024-09-13T22:09:04.485 INFO:tasks.workunit.client.1.smithi159.stdout:5/549: creat d1/d11/d64/d82/d8c/fc2 x:0 0 0 2024-09-13T22:09:04.487 INFO:tasks.workunit.client.1.smithi159.stdout:5/550: creat d1/d11/d1c/d20/fc3 x:0 0 0 2024-09-13T22:09:04.492 INFO:tasks.workunit.client.1.smithi159.stdout:7/537: dwrite d3/d3f/f48 [0,4194304] 0 2024-09-13T22:09:04.492 INFO:tasks.workunit.client.1.smithi159.stdout:7/538: stat d3/d4b 0 2024-09-13T22:09:04.494 INFO:tasks.workunit.client.1.smithi159.stdout:1/610: dread dd/d1e/d58/d5f/f7c [0,4194304] 0 2024-09-13T22:09:04.494 INFO:tasks.workunit.client.1.smithi159.stdout:0/696: dwrite d0/d48/d7d/fba [0,4194304] 0 2024-09-13T22:09:04.494 INFO:tasks.workunit.client.1.smithi159.stdout:1/611: dread - dd/d1e/d58/d8a/dbb/f65 zero size 2024-09-13T22:09:04.496 INFO:tasks.workunit.client.1.smithi159.stdout:7/539: mkdir d3/dab 0 2024-09-13T22:09:04.502 INFO:tasks.workunit.client.1.smithi159.stdout:1/612: creat dd/d11/d18/d74/d82/d9a/fbe x:0 0 0 2024-09-13T22:09:04.502 INFO:tasks.workunit.client.1.smithi159.stdout:3/418: write d0/d1/d34/f40 [8120790,57251] 0 2024-09-13T22:09:04.503 INFO:tasks.workunit.client.1.smithi159.stdout:7/540: mknod d3/d31/d4d/d4e/cac 0 2024-09-13T22:09:04.507 INFO:tasks.workunit.client.1.smithi159.stdout:1/613: mknod dd/d11/d13/d4b/d52/cbf 0 2024-09-13T22:09:04.507 INFO:tasks.workunit.client.1.smithi159.stdout:1/614: chown dd/d11/d18/l7a 58 1 2024-09-13T22:09:04.508 INFO:tasks.workunit.client.1.smithi159.stdout:3/419: creat d0/d1/d3/d5/db/d58/f80 x:0 0 0 2024-09-13T22:09:04.509 INFO:tasks.workunit.client.1.smithi159.stdout:5/551: dwrite d1/d11/d64/d35/d60/fa3 [0,4194304] 0 2024-09-13T22:09:04.518 INFO:tasks.workunit.client.1.smithi159.stdout:2/382: sync 2024-09-13T22:09:04.518 INFO:tasks.workunit.client.1.smithi159.stdout:9/542: sync 2024-09-13T22:09:04.518 INFO:tasks.workunit.client.1.smithi159.stdout:2/383: readlink d9/da/lc 0 2024-09-13T22:09:04.518 INFO:tasks.workunit.client.1.smithi159.stdout:9/543: creat d1/dc/d10/d6d/d4b/d98/da8/fba x:0 0 0 2024-09-13T22:09:04.518 INFO:tasks.workunit.client.1.smithi159.stdout:8/809: sync 2024-09-13T22:09:04.518 INFO:tasks.workunit.client.1.smithi159.stdout:6/488: sync 2024-09-13T22:09:04.525 INFO:tasks.workunit.client.1.smithi159.stdout:2/384: symlink d9/d37/l83 0 2024-09-13T22:09:04.525 INFO:tasks.workunit.client.1.smithi159.stdout:2/385: dread - d9/d2d/f78 zero size 2024-09-13T22:09:04.528 INFO:tasks.workunit.client.1.smithi159.stdout:8/810: mkdir da/d7e/d82/dd8/de7/d114 0 2024-09-13T22:09:04.528 INFO:tasks.workunit.client.1.smithi159.stdout:8/811: fsync da/d36/d57/f65 0 2024-09-13T22:09:04.528 INFO:tasks.workunit.client.1.smithi159.stdout:8/812: chown da 36057255 1 2024-09-13T22:09:04.530 INFO:tasks.workunit.client.1.smithi159.stdout:6/489: mkdir d3/d2a/d9b 0 2024-09-13T22:09:04.530 INFO:tasks.workunit.client.1.smithi159.stdout:6/490: chown d3/d2a/c68 26236325 1 2024-09-13T22:09:04.531 INFO:tasks.workunit.client.1.smithi159.stdout:2/386: truncate d9/f3d 2402916 0 2024-09-13T22:09:04.535 INFO:tasks.workunit.client.1.smithi159.stdout:9/544: symlink d1/dc/d10/d6d/d2f/lbb 0 2024-09-13T22:09:04.537 INFO:tasks.workunit.client.1.smithi159.stdout:6/491: creat d3/da/d29/d1a/d3e/d5a/f9c x:0 0 0 2024-09-13T22:09:04.540 INFO:tasks.workunit.client.1.smithi159.stdout:1/615: dwrite dd/d1e/d58/d5f/f7c [0,4194304] 0 2024-09-13T22:09:04.540 INFO:tasks.workunit.client.1.smithi159.stdout:7/541: dwrite d3/f2a [0,4194304] 0 2024-09-13T22:09:04.540 INFO:tasks.workunit.client.1.smithi159.stdout:2/387: mknod d9/d65/d40/c84 0 2024-09-13T22:09:04.540 INFO:tasks.workunit.client.1.smithi159.stdout:7/542: fdatasync d3/d31/d4d/fa6 0 2024-09-13T22:09:04.540 INFO:tasks.workunit.client.1.smithi159.stdout:7/543: dread - d3/d31/d4d/d9e/f8b zero size 2024-09-13T22:09:04.543 INFO:tasks.workunit.client.1.smithi159.stdout:6/492: dread d3/d2a/d3c/f4f [0,4194304] 0 2024-09-13T22:09:04.544 INFO:tasks.workunit.client.1.smithi159.stdout:1/616: truncate dd/d11/d13/d4b/d52/d63/f9c 2082060 0 2024-09-13T22:09:04.547 INFO:tasks.workunit.client.1.smithi159.stdout:2/388: rename d9/d65/f2e to d9/d65/f85 0 2024-09-13T22:09:04.548 INFO:tasks.workunit.client.1.smithi159.stdout:2/389: write d9/da/f7b [608456,117130] 0 2024-09-13T22:09:04.549 INFO:tasks.workunit.client.1.smithi159.stdout:1/617: mkdir dd/d11/d18/d74/d82/da1/dc0 0 2024-09-13T22:09:04.549 INFO:tasks.workunit.client.1.smithi159.stdout:1/618: dread - dd/d11/d13/f8d zero size 2024-09-13T22:09:04.549 INFO:tasks.workunit.client.1.smithi159.stdout:1/619: truncate dd/d11/d34/d59/f98 4783641 0 2024-09-13T22:09:04.551 INFO:tasks.workunit.client.1.smithi159.stdout:1/620: symlink dd/d11/d13/d4b/d52/lc1 0 2024-09-13T22:09:04.551 INFO:tasks.workunit.client.1.smithi159.stdout:3/420: dwrite d0/d1/d3/dd/f10 [0,4194304] 0 2024-09-13T22:09:04.552 INFO:tasks.workunit.client.1.smithi159.stdout:3/421: mkdir d0/d1/d81 0 2024-09-13T22:09:04.553 INFO:tasks.workunit.client.1.smithi159.stdout:3/422: rmdir d0/d1/d3/d5/d25/d2c 39 2024-09-13T22:09:04.554 INFO:tasks.workunit.client.1.smithi159.stdout:3/423: creat d0/d1/d3/f82 x:0 0 0 2024-09-13T22:09:04.554 INFO:tasks.workunit.client.1.smithi159.stdout:3/424: getdents d0/d78 0 2024-09-13T22:09:04.554 INFO:tasks.workunit.client.1.smithi159.stdout:3/425: mknod d0/d1/d3/d5/d25/d2c/d65/c83 0 2024-09-13T22:09:04.555 INFO:tasks.workunit.client.1.smithi159.stdout:3/426: link d0/d1/c4 d0/d1/d3/d5/db/c84 0 2024-09-13T22:09:04.556 INFO:tasks.workunit.client.1.smithi159.stdout:3/427: stat d0/l16 0 2024-09-13T22:09:04.556 INFO:tasks.workunit.client.1.smithi159.stdout:7/544: dread d3/d18/f54 [0,4194304] 0 2024-09-13T22:09:04.556 INFO:tasks.workunit.client.1.smithi159.stdout:3/428: mknod d0/d1/d34/c85 0 2024-09-13T22:09:04.557 INFO:tasks.workunit.client.1.smithi159.stdout:7/545: rename d3/d31/d4d/d4e/d4f/d6c/f84 to d3/d3f/fad 0 2024-09-13T22:09:04.558 INFO:tasks.workunit.client.1.smithi159.stdout:3/429: rename d0/d1/d3/d5/c2e to d0/d1/d3/d5/d25/d75/c86 0 2024-09-13T22:09:04.559 INFO:tasks.workunit.client.1.smithi159.stdout:7/546: link d3/d31/d4d/f99 d3/d31/fae 0 2024-09-13T22:09:04.560 INFO:tasks.workunit.client.1.smithi159.stdout:3/430: unlink d0/d1/d15/l3c 0 2024-09-13T22:09:04.561 INFO:tasks.workunit.client.1.smithi159.stdout:7/547: symlink d3/d31/d4d/laf 0 2024-09-13T22:09:04.562 INFO:tasks.workunit.client.1.smithi159.stdout:7/548: read d3/d31/d4d/d9e/f71 [919006,45099] 0 2024-09-13T22:09:04.563 INFO:tasks.workunit.client.1.smithi159.stdout:7/549: rename d3/d18/f94 to d3/d2e/fb0 0 2024-09-13T22:09:04.566 INFO:tasks.workunit.client.1.smithi159.stdout:1/621: dread dd/d11/d13/d4b/d52/f94 [0,4194304] 0 2024-09-13T22:09:04.566 INFO:tasks.workunit.client.1.smithi159.stdout:7/550: write d3/d31/f76 [59292,31015] 0 2024-09-13T22:09:04.567 INFO:tasks.workunit.client.1.smithi159.stdout:7/551: rename d3/d2e/fa0 to d3/d3f/fb1 0 2024-09-13T22:09:04.568 INFO:tasks.workunit.client.1.smithi159.stdout:7/552: write d3/d31/d4d/d9e/f8b [344364,41028] 0 2024-09-13T22:09:04.570 INFO:tasks.workunit.client.1.smithi159.stdout:5/552: dwrite d1/d11/d64/d35/fb1 [0,4194304] 0 2024-09-13T22:09:04.570 INFO:tasks.workunit.client.1.smithi159.stdout:5/553: chown d1/d11/d64/f3f 9 1 2024-09-13T22:09:04.570 INFO:tasks.workunit.client.1.smithi159.stdout:5/554: chown d1/f97 25555 1 2024-09-13T22:09:04.570 INFO:tasks.workunit.client.1.smithi159.stdout:1/622: rmdir dd/d1e/d58/d5f/d84 39 2024-09-13T22:09:04.570 INFO:tasks.workunit.client.1.smithi159.stdout:1/623: write dd/f8c [3747307,101744] 0 2024-09-13T22:09:04.571 INFO:tasks.workunit.client.1.smithi159.stdout:8/813: dwrite da/d22/f4d [0,4194304] 0 2024-09-13T22:09:04.571 INFO:tasks.workunit.client.1.smithi159.stdout:9/545: dwrite d1/dc/d10/fae [0,4194304] 0 2024-09-13T22:09:04.571 INFO:tasks.workunit.client.1.smithi159.stdout:6/493: dwrite d3/da/f4e [0,4194304] 0 2024-09-13T22:09:04.571 INFO:tasks.workunit.client.1.smithi159.stdout:6/494: readlink d3/da/d25/d52/l66 0 2024-09-13T22:09:04.571 INFO:tasks.workunit.client.1.smithi159.stdout:7/553: mkdir d3/d31/d4d/d4e/d4f/d6c/db2 0 2024-09-13T22:09:04.572 INFO:tasks.workunit.client.1.smithi159.stdout:5/555: rmdir d1/d11/d9e/d7b 39 2024-09-13T22:09:04.574 INFO:tasks.workunit.client.1.smithi159.stdout:1/624: mkdir dd/d11/d13/d4b/d52/d63/dc2 0 2024-09-13T22:09:04.574 INFO:tasks.workunit.client.1.smithi159.stdout:1/625: readlink dd/d11/d18/l1a 0 2024-09-13T22:09:04.575 INFO:tasks.workunit.client.1.smithi159.stdout:6/495: dread d3/da/d29/d1a/d3e/d5a/f78 [0,4194304] 0 2024-09-13T22:09:04.577 INFO:tasks.workunit.client.1.smithi159.stdout:9/546: mkdir d1/dc/d10/d6d/d87/dbc 0 2024-09-13T22:09:04.595 INFO:tasks.workunit.client.1.smithi159.stdout:7/554: dwrite d3/d31/d4d/d4e/d4f/d6c/f90 [0,4194304] 0 2024-09-13T22:09:04.596 INFO:tasks.workunit.client.1.smithi159.stdout:7/555: stat d3/d31/d4d/d4e/d4f/d6c/db2 0 2024-09-13T22:09:04.599 INFO:tasks.workunit.client.1.smithi159.stdout:5/556: symlink d1/d11/d1c/d20/d53/lc4 0 2024-09-13T22:09:04.599 INFO:tasks.workunit.client.1.smithi159.stdout:5/557: truncate d1/d11/d1c/d20/fac 775261 0 2024-09-13T22:09:04.600 INFO:tasks.workunit.client.1.smithi159.stdout:1/626: mknod dd/d11/d21/cc3 0 2024-09-13T22:09:04.600 INFO:tasks.workunit.client.1.smithi159.stdout:1/627: creat dd/d11/d13/d4b/fc4 x:0 0 0 2024-09-13T22:09:04.602 INFO:tasks.workunit.client.1.smithi159.stdout:8/814: rmdir da/d7e/d82/d6f/d9a 39 2024-09-13T22:09:04.602 INFO:tasks.workunit.client.1.smithi159.stdout:8/815: write da/f88 [4487389,51281] 0 2024-09-13T22:09:04.603 INFO:tasks.workunit.client.1.smithi159.stdout:9/547: dwrite d1/dc/f12 [4194304,4194304] 0 2024-09-13T22:09:04.609 INFO:tasks.workunit.client.1.smithi159.stdout:2/390: dwrite d9/da/f26 [0,4194304] 0 2024-09-13T22:09:04.609 INFO:tasks.workunit.client.1.smithi159.stdout:2/391: readlink d9/d48/d77/l79 0 2024-09-13T22:09:04.611 INFO:tasks.workunit.client.1.smithi159.stdout:7/556: symlink d3/d18/lb3 0 2024-09-13T22:09:04.614 INFO:tasks.workunit.client.1.smithi159.stdout:5/558: rmdir d1/d11/d1c/d9c 39 2024-09-13T22:09:04.614 INFO:tasks.workunit.client.1.smithi159.stdout:1/628: read dd/d11/d34/d59/f92 [1613010,70732] 0 2024-09-13T22:09:04.614 INFO:tasks.workunit.client.1.smithi159.stdout:1/629: fdatasync dd/d11/d18/d74/d82/da1/fb9 0 2024-09-13T22:09:04.614 INFO:tasks.workunit.client.1.smithi159.stdout:1/630: chown dd/d11/d13/d4b/d52/d63/d9d 134314 1 2024-09-13T22:09:04.618 INFO:tasks.workunit.client.1.smithi159.stdout:8/816: creat da/d7e/d82/dd8/de7/d114/f115 x:0 0 0 2024-09-13T22:09:04.623 INFO:tasks.workunit.client.1.smithi159.stdout:2/392: rename d9/da/d25/c28 to d9/d2d/c86 0 2024-09-13T22:09:04.623 INFO:tasks.workunit.client.1.smithi159.stdout:2/393: dread - d9/d37/f7f zero size 2024-09-13T22:09:04.623 INFO:tasks.workunit.client.1.smithi159.stdout:2/394: write d9/d2d/f78 [161024,99063] 0 2024-09-13T22:09:04.626 INFO:tasks.workunit.client.1.smithi159.stdout:2/395: dread d9/d65/d40/f45 [0,4194304] 0 2024-09-13T22:09:04.626 INFO:tasks.workunit.client.1.smithi159.stdout:5/559: dread d1/d11/d64/d35/d6f/f7f [0,4194304] 0 2024-09-13T22:09:04.626 INFO:tasks.workunit.client.1.smithi159.stdout:9/548: dwrite d1/dc/d10/d6d/d2f/f68 [4194304,4194304] 0 2024-09-13T22:09:04.627 INFO:tasks.workunit.client.1.smithi159.stdout:3/431: dwrite d0/d1/d3/d5/f31 [0,4194304] 0 2024-09-13T22:09:04.627 INFO:tasks.workunit.client.1.smithi159.stdout:3/432: fsync d0/d1/d3/d5/f31 0 2024-09-13T22:09:04.627 INFO:tasks.workunit.client.1.smithi159.stdout:7/557: mknod d3/d18/cb4 0 2024-09-13T22:09:04.629 INFO:tasks.workunit.client.1.smithi159.stdout:1/631: creat dd/fc5 x:0 0 0 2024-09-13T22:09:04.629 INFO:tasks.workunit.client.1.smithi159.stdout:1/632: dread dd/d11/d21/f6f [0,4194304] 0 2024-09-13T22:09:04.630 INFO:tasks.workunit.client.1.smithi159.stdout:8/817: mknod da/d7e/d82/d6f/d9a/de4/c116 0 2024-09-13T22:09:04.630 INFO:tasks.workunit.client.1.smithi159.stdout:2/396: mknod d9/d48/c87 0 2024-09-13T22:09:04.631 INFO:tasks.workunit.client.1.smithi159.stdout:5/560: truncate d1/d11/d64/d35/d7c/d7d/f8e 31554 0 2024-09-13T22:09:04.632 INFO:tasks.workunit.client.1.smithi159.stdout:9/549: rmdir d1 39 2024-09-13T22:09:04.635 INFO:tasks.workunit.client.1.smithi159.stdout:5/561: read d1/d11/d1c/f51 [1191453,57520] 0 2024-09-13T22:09:04.635 INFO:tasks.workunit.client.1.smithi159.stdout:7/558: dread d3/d3f/fa1 [0,4194304] 0 2024-09-13T22:09:04.635 INFO:tasks.workunit.client.1.smithi159.stdout:3/433: creat d0/d1/d3/d5/d25/d2c/d7f/f87 x:0 0 0 2024-09-13T22:09:04.636 INFO:tasks.workunit.client.1.smithi159.stdout:6/496: truncate d3/da/f4e 391041 0 2024-09-13T22:09:04.638 INFO:tasks.workunit.client.1.smithi159.stdout:1/633: mkdir dd/d11/d13/d4b/d52/d63/dc2/dc6 0 2024-09-13T22:09:04.638 INFO:tasks.workunit.client.1.smithi159.stdout:1/634: stat dd/d1e/d58/d8a/dbb/l54 0 2024-09-13T22:09:04.641 INFO:tasks.workunit.client.1.smithi159.stdout:8/818: truncate da/d22/d33/f46 1085828 0 2024-09-13T22:09:04.644 INFO:tasks.workunit.client.1.smithi159.stdout:2/397: rename d9/da/d25/f2c to d9/da/d82/f88 0 2024-09-13T22:09:04.644 INFO:tasks.workunit.client.1.smithi159.stdout:2/398: write d9/d48/f7c [104977,6626] 0 2024-09-13T22:09:04.646 INFO:tasks.workunit.client.1.smithi159.stdout:2/399: unlink f6 0 2024-09-13T22:09:04.650 INFO:tasks.workunit.client.1.smithi159.stdout:9/550: rename d1/d9/l1b to d1/d9/d1f/lbd 0 2024-09-13T22:09:04.650 INFO:tasks.workunit.client.1.smithi159.stdout:9/551: stat d1/dc/d27/d40/f70 0 2024-09-13T22:09:04.650 INFO:tasks.workunit.client.1.smithi159.stdout:2/400: unlink d9/da/c1f 0 2024-09-13T22:09:04.651 INFO:tasks.workunit.client.1.smithi159.stdout:2/401: mkdir d9/da/d82/d89 0 2024-09-13T22:09:04.652 INFO:tasks.workunit.client.1.smithi159.stdout:2/402: creat d9/d44/f8a x:0 0 0 2024-09-13T22:09:04.659 INFO:tasks.workunit.client.1.smithi159.stdout:2/403: dread d9/da/d25/f35 [0,4194304] 0 2024-09-13T22:09:04.661 INFO:tasks.workunit.client.1.smithi159.stdout:2/404: creat d9/da/d82/d89/f8b x:0 0 0 2024-09-13T22:09:04.692 INFO:tasks.workunit.client.1.smithi159.stdout:6/497: dwrite d3/da/f10 [0,4194304] 0 2024-09-13T22:09:04.693 INFO:tasks.workunit.client.1.smithi159.stdout:6/498: mknod d3/d2a/d9b/c9d 0 2024-09-13T22:09:04.693 INFO:tasks.workunit.client.1.smithi159.stdout:6/499: stat d3/d2a/f57 0 2024-09-13T22:09:04.694 INFO:tasks.workunit.client.1.smithi159.stdout:6/500: creat d3/da/d29/d1a/d3e/d5a/d6a/f9e x:0 0 0 2024-09-13T22:09:04.694 INFO:tasks.workunit.client.1.smithi159.stdout:6/501: fsync d3/da/d25/f4b 0 2024-09-13T22:09:04.694 INFO:tasks.workunit.client.1.smithi159.stdout:6/502: write d3/da/d29/d1a/f92 [206034,41859] 0 2024-09-13T22:09:04.695 INFO:tasks.workunit.client.1.smithi159.stdout:6/503: dread - d3/d6d/f8a zero size 2024-09-13T22:09:04.695 INFO:tasks.workunit.client.1.smithi159.stdout:6/504: creat d3/da/d29/d26/f9f x:0 0 0 2024-09-13T22:09:04.695 INFO:tasks.workunit.client.1.smithi159.stdout:6/505: write d3/da/d29/d1a/f1c [3437888,2860] 0 2024-09-13T22:09:04.695 INFO:tasks.workunit.client.1.smithi159.stdout:6/506: readlink d3/d2a/d3c/d46/l5f 0 2024-09-13T22:09:04.703 INFO:tasks.workunit.client.1.smithi159.stdout:5/562: dwrite d1/d11/d1c/d20/f88 [0,4194304] 0 2024-09-13T22:09:04.703 INFO:tasks.workunit.client.1.smithi159.stdout:5/563: creat d1/d11/d1c/d20/fc5 x:0 0 0 2024-09-13T22:09:04.704 INFO:tasks.workunit.client.1.smithi159.stdout:2/405: dwrite d9/da/d82/f88 [0,4194304] 0 2024-09-13T22:09:04.704 INFO:tasks.workunit.client.1.smithi159.stdout:7/559: dwrite d3/d2e/d6e/f96 [0,4194304] 0 2024-09-13T22:09:04.704 INFO:tasks.workunit.client.1.smithi159.stdout:3/434: dwrite d0/d1/d3/d5/d25/d4e/d5a/f21 [0,4194304] 0 2024-09-13T22:09:04.705 INFO:tasks.workunit.client.1.smithi159.stdout:5/564: rename d1/d11/d64/c34 to d1/d11/d1c/d20/d44/d89/cc6 0 2024-09-13T22:09:04.707 INFO:tasks.workunit.client.1.smithi159.stdout:9/552: dwrite d1/dc/d10/d6d/d2f/f68 [8388608,4194304] 0 2024-09-13T22:09:04.712 INFO:tasks.workunit.client.1.smithi159.stdout:7/560: unlink d3/d2e/d6e/d74/ca8 0 2024-09-13T22:09:04.714 INFO:tasks.workunit.client.1.smithi159.stdout:2/406: symlink d9/d65/d40/d69/d66/l8c 0 2024-09-13T22:09:04.715 INFO:tasks.workunit.client.1.smithi159.stdout:3/435: truncate d0/d1/d34/f70 481162 0 2024-09-13T22:09:04.718 INFO:tasks.workunit.client.1.smithi159.stdout:9/553: truncate d1/dc/d10/d6d/d4b/f9e 3667801 0 2024-09-13T22:09:04.718 INFO:tasks.workunit.client.1.smithi159.stdout:9/554: creat d1/dc/d10/d6d/d4b/d98/da8/fbe x:0 0 0 2024-09-13T22:09:04.723 INFO:tasks.workunit.client.1.smithi159.stdout:6/507: dwrite d3/da/d29/d1a/d3e/f55 [0,4194304] 0 2024-09-13T22:09:04.725 INFO:tasks.workunit.client.1.smithi159.stdout:7/561: creat d3/d2e/d6e/fb5 x:0 0 0 2024-09-13T22:09:04.726 INFO:tasks.workunit.client.1.smithi159.stdout:7/562: read d3/d3f/fad [715352,41851] 0 2024-09-13T22:09:04.726 INFO:tasks.workunit.client.1.smithi159.stdout:5/565: dwrite d1/d11/d64/d17/f2c [0,4194304] 0 2024-09-13T22:09:04.729 INFO:tasks.workunit.client.1.smithi159.stdout:2/407: getdents d9/d65/d40/d69/d66 0 2024-09-13T22:09:04.729 INFO:tasks.workunit.client.1.smithi159.stdout:2/408: dread - d9/f53 zero size 2024-09-13T22:09:04.730 INFO:tasks.workunit.client.1.smithi159.stdout:9/555: creat d1/dc/d10/d6d/d4b/fbf x:0 0 0 2024-09-13T22:09:04.730 INFO:tasks.workunit.client.1.smithi159.stdout:2/409: write d9/da/d25/f2f [523877,104138] 0 2024-09-13T22:09:04.733 INFO:tasks.workunit.client.1.smithi159.stdout:6/508: mkdir d3/da/d29/d1a/d3e/da0 0 2024-09-13T22:09:04.733 INFO:tasks.workunit.client.1.smithi159.stdout:6/509: chown d3/f35 0 1 2024-09-13T22:09:04.733 INFO:tasks.workunit.client.1.smithi159.stdout:6/510: write d3/da/d25/f41 [813551,40546] 0 2024-09-13T22:09:04.735 INFO:tasks.workunit.client.1.smithi159.stdout:5/566: mknod d1/d11/d9e/cc7 0 2024-09-13T22:09:04.738 INFO:tasks.workunit.client.1.smithi159.stdout:9/556: mknod d1/dc/d10/d6d/d4b/d98/da8/cc0 0 2024-09-13T22:09:04.738 INFO:tasks.workunit.client.1.smithi159.stdout:2/410: truncate d9/d48/f7e 216649 0 2024-09-13T22:09:04.741 INFO:tasks.workunit.client.1.smithi159.stdout:6/511: rmdir d3/da/d29/d1a/d3e/da0 0 2024-09-13T22:09:04.745 INFO:tasks.workunit.client.1.smithi159.stdout:2/411: mkdir d9/d65/d8d 0 2024-09-13T22:09:04.745 INFO:tasks.workunit.client.1.smithi159.stdout:2/412: chown d9/d37/f7f 0 1 2024-09-13T22:09:04.746 INFO:tasks.workunit.client.1.smithi159.stdout:6/512: truncate d3/da/f42 2344601 0 2024-09-13T22:09:04.746 INFO:tasks.workunit.client.1.smithi159.stdout:6/513: chown d3/da/d29/c36 2707 1 2024-09-13T22:09:04.749 INFO:tasks.workunit.client.1.smithi159.stdout:7/563: rename d3/d31/d4d/d4e/d4f to d3/d2e/db6 0 2024-09-13T22:09:04.749 INFO:tasks.workunit.client.1.smithi159.stdout:7/564: dread - d3/d2e/d6e/fb5 zero size 2024-09-13T22:09:04.749 INFO:tasks.workunit.client.1.smithi159.stdout:7/565: stat d3/d2e/d6e/ca3 0 2024-09-13T22:09:04.749 INFO:tasks.workunit.client.1.smithi159.stdout:7/566: truncate d3/d2e/d6e/f86 1028086 0 2024-09-13T22:09:04.749 INFO:tasks.workunit.client.1.smithi159.stdout:7/567: chown d3/d31/l38 113480 1 2024-09-13T22:09:04.750 INFO:tasks.workunit.client.1.smithi159.stdout:9/557: dread d1/dc/f3e [0,4194304] 0 2024-09-13T22:09:04.750 INFO:tasks.workunit.client.1.smithi159.stdout:9/558: getdents d1/dc/d27/da4/db5 0 2024-09-13T22:09:04.754 INFO:tasks.workunit.client.1.smithi159.stdout:5/567: rename d1/d11/d64/f25 to d1/d11/d64/d35/d60/fc8 0 2024-09-13T22:09:04.758 INFO:tasks.workunit.client.1.smithi159.stdout:7/568: link d3/d31/d4d/d9e/f71 d3/fb7 0 2024-09-13T22:09:04.758 INFO:tasks.workunit.client.1.smithi159.stdout:7/569: chown d3/d2e/db6/d6c/l8c 5 1 2024-09-13T22:09:04.758 INFO:tasks.workunit.client.1.smithi159.stdout:7/570: read d3/d2e/d6e/f86 [501103,113804] 0 2024-09-13T22:09:04.758 INFO:tasks.workunit.client.1.smithi159.stdout:9/559: symlink d1/d9/d2a/lc1 0 2024-09-13T22:09:04.758 INFO:tasks.workunit.client.1.smithi159.stdout:9/560: creat d1/dc/d27/d40/fc2 x:0 0 0 2024-09-13T22:09:04.759 INFO:tasks.workunit.client.1.smithi159.stdout:2/413: rmdir d9/d2d 39 2024-09-13T22:09:04.761 INFO:tasks.workunit.client.1.smithi159.stdout:5/568: creat d1/d11/d64/fc9 x:0 0 0 2024-09-13T22:09:04.764 INFO:tasks.workunit.client.1.smithi159.stdout:7/571: mknod d3/d31/cb8 0 2024-09-13T22:09:04.769 INFO:tasks.workunit.client.1.smithi159.stdout:9/561: getdents d1/d9/d1f 0 2024-09-13T22:09:04.769 INFO:tasks.workunit.client.1.smithi159.stdout:6/514: dwrite d3/da/d29/d1a/d3e/f55 [0,4194304] 0 2024-09-13T22:09:04.769 INFO:tasks.workunit.client.1.smithi159.stdout:6/515: write d3/da/d29/d1a/d3e/f8c [4823909,10788] 0 2024-09-13T22:09:04.769 INFO:tasks.workunit.client.1.smithi159.stdout:6/516: stat d3/f7e 0 2024-09-13T22:09:04.772 INFO:tasks.workunit.client.1.smithi159.stdout:2/414: rmdir d9/d2d 39 2024-09-13T22:09:04.776 INFO:tasks.workunit.client.1.smithi159.stdout:5/569: unlink d1/d11/d64/d35/l9f 0 2024-09-13T22:09:04.778 INFO:tasks.workunit.client.1.smithi159.stdout:6/517: symlink d3/da/d25/d52/la1 0 2024-09-13T22:09:04.780 INFO:tasks.workunit.client.1.smithi159.stdout:7/572: dwrite d3/d3f/f4a [4194304,4194304] 0 2024-09-13T22:09:04.783 INFO:tasks.workunit.client.1.smithi159.stdout:7/573: mkdir d3/d2e/d6e/db9 0 2024-09-13T22:09:04.791 INFO:tasks.workunit.client.1.smithi159.stdout:2/415: dread d9/f31 [0,4194304] 0 2024-09-13T22:09:04.792 INFO:tasks.workunit.client.1.smithi159.stdout:2/416: symlink d9/d44/l8e 0 2024-09-13T22:09:04.793 INFO:tasks.workunit.client.1.smithi159.stdout:6/518: dread d3/da/d29/d1a/d3e/d5a/f7d [4194304,4194304] 0 2024-09-13T22:09:04.796 INFO:tasks.workunit.client.1.smithi159.stdout:6/519: rename d3/d2a/d3c/d46/l5f to d3/d2a/d9b/la2 0 2024-09-13T22:09:04.798 INFO:tasks.workunit.client.1.smithi159.stdout:5/570: dwrite d1/d11/d64/d17/f6d [0,4194304] 0 2024-09-13T22:09:04.798 INFO:tasks.workunit.client.1.smithi159.stdout:5/571: stat d1/d11/d64/fc9 0 2024-09-13T22:09:04.799 INFO:tasks.workunit.client.1.smithi159.stdout:6/520: mkdir d3/da/d29/d1a/da3 0 2024-09-13T22:09:04.806 INFO:tasks.workunit.client.1.smithi159.stdout:7/574: dwrite d3/d31/d4d/fa6 [4194304,4194304] 0 2024-09-13T22:09:04.809 INFO:tasks.workunit.client.1.smithi159.stdout:7/575: rename d3/d4b to d3/d2e/d6e/d74/dba 0 2024-09-13T22:09:04.810 INFO:tasks.workunit.client.1.smithi159.stdout:7/576: symlink d3/d2e/d6e/d74/lbb 0 2024-09-13T22:09:04.812 INFO:tasks.workunit.client.1.smithi159.stdout:2/417: dread d9/f3d [0,4194304] 0 2024-09-13T22:09:04.812 INFO:tasks.workunit.client.1.smithi159.stdout:7/577: mkdir d3/d2e/db6/d6c/db2/dbc 0 2024-09-13T22:09:04.812 INFO:tasks.workunit.client.1.smithi159.stdout:2/418: rmdir d9/da/d5a 39 2024-09-13T22:09:04.813 INFO:tasks.workunit.client.1.smithi159.stdout:7/578: creat d3/d2e/d6e/d74/dba/d5e/fbd x:0 0 0 2024-09-13T22:09:04.813 INFO:tasks.workunit.client.1.smithi159.stdout:7/579: rmdir d3/d2e/d6e/d74/dba/d5e 39 2024-09-13T22:09:04.819 INFO:tasks.workunit.client.1.smithi159.stdout:5/572: dwrite d1/f97 [0,4194304] 0 2024-09-13T22:09:04.822 INFO:tasks.workunit.client.1.smithi159.stdout:6/521: dwrite d3/da/d29/f17 [0,4194304] 0 2024-09-13T22:09:04.822 INFO:tasks.workunit.client.1.smithi159.stdout:6/522: truncate d3/f27 210935 0 2024-09-13T22:09:04.822 INFO:tasks.workunit.client.1.smithi159.stdout:6/523: fdatasync d3/da/d29/d1a/d3e/d5a/f7d 0 2024-09-13T22:09:04.822 INFO:tasks.workunit.client.1.smithi159.stdout:6/524: chown d3/d2a/l3b 100 1 2024-09-13T22:09:04.822 INFO:tasks.workunit.client.1.smithi159.stdout:6/525: chown d3/da/d29/d1a/f62 457 1 2024-09-13T22:09:04.822 INFO:tasks.workunit.client.1.smithi159.stdout:5/573: getdents d1/d11/d64/d17 0 2024-09-13T22:09:04.822 INFO:tasks.workunit.client.1.smithi159.stdout:5/574: chown d1/d11/d9e/f72 8302725 1 2024-09-13T22:09:04.825 INFO:tasks.workunit.client.1.smithi159.stdout:6/526: mknod d3/ca4 0 2024-09-13T22:09:04.826 INFO:tasks.workunit.client.1.smithi159.stdout:6/527: mkdir d3/da/d29/d1a/da3/da5 0 2024-09-13T22:09:04.826 INFO:tasks.workunit.client.1.smithi159.stdout:6/528: write d3/da/d29/d1a/d3e/d5a/f78 [3174520,120498] 0 2024-09-13T22:09:04.827 INFO:tasks.workunit.client.1.smithi159.stdout:6/529: truncate d3/da/f42 601520 0 2024-09-13T22:09:04.827 INFO:tasks.workunit.client.1.smithi159.stdout:6/530: readlink d3/d2a/d3c/l80 0 2024-09-13T22:09:04.835 INFO:tasks.workunit.client.1.smithi159.stdout:5/575: dread d1/fad [0,4194304] 0 2024-09-13T22:09:04.837 INFO:tasks.workunit.client.1.smithi159.stdout:5/576: rename d1/d11/d64/d35/d60/db2 to d1/d11/d50/dca 0 2024-09-13T22:09:04.838 INFO:tasks.workunit.client.1.smithi159.stdout:5/577: rmdir d1/d11/d1c/d9c 39 2024-09-13T22:09:04.839 INFO:tasks.workunit.client.1.smithi159.stdout:5/578: truncate d1/d11/d64/d35/f57 729277 0 2024-09-13T22:09:04.840 INFO:tasks.workunit.client.1.smithi159.stdout:5/579: mkdir d1/d11/d1c/d20/d44/d89/dcb 0 2024-09-13T22:09:04.846 INFO:tasks.workunit.client.1.smithi159.stdout:6/531: dwrite d3/da/d29/d1a/d3e/d5a/d6a/f9e [0,4194304] 0 2024-09-13T22:09:04.861 INFO:tasks.workunit.client.1.smithi159.stdout:5/580: dwrite d1/d11/d1c/d20/f5a [0,4194304] 0 2024-09-13T22:09:04.861 INFO:tasks.workunit.client.1.smithi159.stdout:5/581: write d1/d11/d64/d82/d8f/fbe [970862,23864] 0 2024-09-13T22:09:04.865 INFO:tasks.workunit.client.1.smithi159.stdout:6/532: dwrite d3/da/d29/d26/d6c/f76 [0,4194304] 0 2024-09-13T22:09:04.874 INFO:tasks.workunit.client.1.smithi159.stdout:5/582: dwrite d1/d11/d64/d17/f54 [0,4194304] 0 2024-09-13T22:09:04.877 INFO:tasks.workunit.client.1.smithi159.stdout:5/583: dread d1/d11/d64/d82/fc1 [0,4194304] 0 2024-09-13T22:09:04.878 INFO:tasks.workunit.client.1.smithi159.stdout:5/584: chown d1/d11/d64/d35/d60/l77 6656717 1 2024-09-13T22:09:04.880 INFO:tasks.workunit.client.1.smithi159.stdout:5/585: read d1/d11/d64/d35/d6f/f7f [303453,53056] 0 2024-09-13T22:09:04.886 INFO:tasks.workunit.client.1.smithi159.stdout:5/586: dread d1/d11/d1c/d20/fac [0,4194304] 0 2024-09-13T22:09:04.886 INFO:tasks.workunit.client.1.smithi159.stdout:5/587: stat d1/d11/d9e/d7b/la1 0 2024-09-13T22:09:04.890 INFO:tasks.workunit.client.1.smithi159.stdout:5/588: read d1/d11/d64/d35/d60/fa3 [2477436,81309] 0 2024-09-13T22:09:04.890 INFO:tasks.workunit.client.1.smithi159.stdout:5/589: chown d1/d11/d64/l18 2172 1 2024-09-13T22:09:04.958 INFO:tasks.workunit.client.1.smithi159.stdout:6/533: rename d3/da/d25/d52/la1 to d3/da/d25/d69/la6 0 2024-09-13T22:09:04.958 INFO:tasks.workunit.client.1.smithi159.stdout:6/534: readlink d3/da/d29/d26/l34 0 2024-09-13T22:09:04.960 INFO:tasks.workunit.client.1.smithi159.stdout:5/590: unlink d1/d11/c14 0 2024-09-13T22:09:04.960 INFO:tasks.workunit.client.1.smithi159.stdout:5/591: chown d1/d11 1598 1 2024-09-13T22:09:04.971 INFO:tasks.workunit.client.1.smithi159.stdout:6/535: mknod d3/d2a/d9b/ca7 0 2024-09-13T22:09:04.972 INFO:tasks.workunit.client.1.smithi159.stdout:6/536: rename d3/d2a/c5d to d3/d2a/d3c/d46/d73/ca8 0 2024-09-13T22:09:04.972 INFO:tasks.workunit.client.1.smithi159.stdout:6/537: readlink d3/da/d29/d1a/d3e/d5a/d6a/l70 0 2024-09-13T22:09:04.979 INFO:tasks.workunit.client.1.smithi159.stdout:5/592: dwrite d1/fa [0,4194304] 0 2024-09-13T22:09:04.984 INFO:tasks.workunit.client.1.smithi159.stdout:6/538: dread d3/da/d29/f17 [0,4194304] 0 2024-09-13T22:09:04.986 INFO:tasks.workunit.client.1.smithi159.stdout:6/539: mkdir d3/da/d29/d26/d6c/d6e/da9 0 2024-09-13T22:09:04.986 INFO:tasks.workunit.client.1.smithi159.stdout:6/540: dread - d3/da/d29/d1a/d3e/d5a/f9c zero size 2024-09-13T22:09:04.990 INFO:tasks.workunit.client.1.smithi159.stdout:6/541: write d3/da/d29/f17 [1341529,95470] 0 2024-09-13T22:09:04.990 INFO:tasks.workunit.client.1.smithi159.stdout:6/542: fsync d3/da/d29/f63 0 2024-09-13T22:09:04.992 INFO:tasks.workunit.client.1.smithi159.stdout:6/543: rename d3/da/d25/f38 to d3/da/faa 0 2024-09-13T22:09:04.994 INFO:tasks.workunit.client.1.smithi159.stdout:6/544: creat d3/da/d29/d1a/da3/da5/fab x:0 0 0 2024-09-13T22:09:04.994 INFO:tasks.workunit.client.1.smithi159.stdout:6/545: chown d3/ca4 222 1 2024-09-13T22:09:04.998 INFO:tasks.workunit.client.1.smithi159.stdout:5/593: dwrite d1/d11/d64/d35/d60/fa3 [0,4194304] 0 2024-09-13T22:09:05.000 INFO:tasks.workunit.client.1.smithi159.stdout:5/594: rmdir d1/d11/d64/d35 39 2024-09-13T22:09:05.003 INFO:tasks.workunit.client.1.smithi159.stdout:5/595: rmdir d1/d11/d1c/d20/d53 39 2024-09-13T22:09:05.009 INFO:tasks.workunit.client.1.smithi159.stdout:6/546: dwrite d3/d6d/f8a [0,4194304] 0 2024-09-13T22:09:05.012 INFO:tasks.workunit.client.1.smithi159.stdout:6/547: symlink d3/da/d29/d1a/da3/da5/lac 0 2024-09-13T22:09:05.012 INFO:tasks.workunit.client.1.smithi159.stdout:6/548: read d3/da/d29/d1a/f1c [2694349,105274] 0 2024-09-13T22:09:05.012 INFO:tasks.workunit.client.1.smithi159.stdout:6/549: fdatasync d3/da/d29/d1a/f62 0 2024-09-13T22:09:05.015 INFO:tasks.workunit.client.1.smithi159.stdout:0/697: sync 2024-09-13T22:09:05.015 INFO:tasks.workunit.client.1.smithi159.stdout:4/815: sync 2024-09-13T22:09:05.015 INFO:tasks.workunit.client.1.smithi159.stdout:1/635: sync 2024-09-13T22:09:05.015 INFO:tasks.workunit.client.1.smithi159.stdout:0/698: creat d0/d2c/d96/feb x:0 0 0 2024-09-13T22:09:05.015 INFO:tasks.workunit.client.1.smithi159.stdout:0/699: creat d0/d2c/d96/da1/fec x:0 0 0 2024-09-13T22:09:05.016 INFO:tasks.workunit.client.1.smithi159.stdout:4/816: rename d13/d41/d5d to d13/d41/d7e/d126 0 2024-09-13T22:09:05.017 INFO:tasks.workunit.client.1.smithi159.stdout:1/636: symlink dd/d1c/lc7 0 2024-09-13T22:09:05.019 INFO:tasks.workunit.client.1.smithi159.stdout:6/550: dread d3/da/f42 [0,4194304] 0 2024-09-13T22:09:05.019 INFO:tasks.workunit.client.1.smithi159.stdout:6/551: write d3/da/d25/d52/f99 [186206,18962] 0 2024-09-13T22:09:05.021 INFO:tasks.workunit.client.1.smithi159.stdout:5/596: dwrite d1/d11/d64/d17/fc0 [0,4194304] 0 2024-09-13T22:09:05.022 INFO:tasks.workunit.client.1.smithi159.stdout:0/700: creat d0/d48/d4f/d66/fed x:0 0 0 2024-09-13T22:09:05.023 INFO:tasks.workunit.client.1.smithi159.stdout:0/701: stat d0/d2c/f3c 0 2024-09-13T22:09:05.025 INFO:tasks.workunit.client.1.smithi159.stdout:4/817: link d13/d15/d26/d29/d3b/daf/ce3 d13/d15/d26/d51/d65/d67/dd1/c127 0 2024-09-13T22:09:05.030 INFO:tasks.workunit.client.1.smithi159.stdout:5/597: mknod d1/d11/d1c/d20/d53/ccc 0 2024-09-13T22:09:05.030 INFO:tasks.workunit.client.1.smithi159.stdout:5/598: creat d1/d11/d64/d82/d8c/fcd x:0 0 0 2024-09-13T22:09:05.030 INFO:tasks.workunit.client.1.smithi159.stdout:5/599: truncate d1/d11/d1c/d20/fc5 784297 0 2024-09-13T22:09:05.030 INFO:tasks.workunit.client.1.smithi159.stdout:5/600: readlink d1/d11/l29 0 2024-09-13T22:09:05.030 INFO:tasks.workunit.client.1.smithi159.stdout:5/601: getdents d1/d11/d1c/d20/d44/d89/dcb 0 2024-09-13T22:09:05.030 INFO:tasks.workunit.client.1.smithi159.stdout:4/818: mknod d13/d41/dbf/c128 0 2024-09-13T22:09:05.033 INFO:tasks.workunit.client.1.smithi159.stdout:5/602: creat d1/d11/d9e/d7b/fce x:0 0 0 2024-09-13T22:09:05.033 INFO:tasks.workunit.client.1.smithi159.stdout:5/603: dread - d1/d11/d64/d82/d8c/fcd zero size 2024-09-13T22:09:05.034 INFO:tasks.workunit.client.1.smithi159.stdout:4/819: truncate d13/f74 2082866 0 2024-09-13T22:09:05.043 INFO:tasks.workunit.client.1.smithi159.stdout:1/637: dwrite dd/d11/d13/f79 [0,4194304] 0 2024-09-13T22:09:05.046 INFO:tasks.workunit.client.1.smithi159.stdout:1/638: rename dd/c50 to dd/d1e/d58/d5f/d84/cc8 0 2024-09-13T22:09:05.049 INFO:tasks.workunit.client.1.smithi159.stdout:5/604: write d1/d11/d1c/d32/f3a [3424611,78682] 0 2024-09-13T22:09:05.049 INFO:tasks.workunit.client.1.smithi159.stdout:5/605: write d1/d11/f4d [1046238,71401] 0 2024-09-13T22:09:05.049 INFO:tasks.workunit.client.1.smithi159.stdout:1/639: rename dd/d1e/d58/d5f/d84/f90 to dd/d11/d13/fc9 0 2024-09-13T22:09:05.049 INFO:tasks.workunit.client.1.smithi159.stdout:1/640: fdatasync dd/d1e/d58/d8a/dbb/f33 0 2024-09-13T22:09:05.049 INFO:tasks.workunit.client.1.smithi159.stdout:1/641: stat dd/d1e/f44 0 2024-09-13T22:09:05.050 INFO:tasks.workunit.client.1.smithi159.stdout:1/642: rmdir dd/d1c 39 2024-09-13T22:09:05.051 INFO:tasks.workunit.client.1.smithi159.stdout:1/643: rmdir dd/d11/d18/d49/d2d/d62/d7d 39 2024-09-13T22:09:05.052 INFO:tasks.workunit.client.1.smithi159.stdout:1/644: dread - dd/d1e/d58/d8a/dbb/d3c/f8b zero size 2024-09-13T22:09:05.052 INFO:tasks.workunit.client.1.smithi159.stdout:1/645: symlink dd/d11/d18/d49/d2d/d97/lca 0 2024-09-13T22:09:05.052 INFO:tasks.workunit.client.1.smithi159.stdout:1/646: dread - dd/d11/d18/d49/f8f zero size 2024-09-13T22:09:05.052 INFO:tasks.workunit.client.1.smithi159.stdout:1/647: chown dd/d11 379285 1 2024-09-13T22:09:05.053 INFO:tasks.workunit.client.1.smithi159.stdout:1/648: mknod dd/d1e/d58/d5f/d84/ccb 0 2024-09-13T22:09:05.053 INFO:tasks.workunit.client.1.smithi159.stdout:1/649: fdatasync dd/d11/d13/f8d 0 2024-09-13T22:09:05.055 INFO:tasks.workunit.client.1.smithi159.stdout:1/650: truncate f7 5908474 0 2024-09-13T22:09:05.057 INFO:tasks.workunit.client.1.smithi159.stdout:0/702: dwrite d0/d2c/d96/da1/fdf [0,4194304] 0 2024-09-13T22:09:05.058 INFO:tasks.workunit.client.1.smithi159.stdout:1/651: mkdir dd/dcc 0 2024-09-13T22:09:05.058 INFO:tasks.workunit.client.1.smithi159.stdout:1/652: creat dd/d11/d18/d49/d2d/d62/fcd x:0 0 0 2024-09-13T22:09:05.064 INFO:tasks.workunit.client.1.smithi159.stdout:0/703: mknod d0/d5e/cee 0 2024-09-13T22:09:05.065 INFO:tasks.workunit.client.1.smithi159.stdout:1/653: unlink dd/d11/d18/f9b 0 2024-09-13T22:09:05.065 INFO:tasks.workunit.client.1.smithi159.stdout:1/654: chown dd/d11/d13/l14 50 1 2024-09-13T22:09:05.068 INFO:tasks.workunit.client.1.smithi159.stdout:1/655: symlink dd/d1e/d58/d8a/dbb/d3c/lce 0 2024-09-13T22:09:05.068 INFO:tasks.workunit.client.1.smithi159.stdout:1/656: creat dd/d11/d34/d59/fcf x:0 0 0 2024-09-13T22:09:05.069 INFO:tasks.workunit.client.1.smithi159.stdout:1/657: chown dd/d11/d18/f3d 1457161 1 2024-09-13T22:09:05.069 INFO:tasks.workunit.client.1.smithi159.stdout:1/658: chown dd/d1e/d58/d8a/dbb/f33 7690 1 2024-09-13T22:09:05.073 INFO:tasks.workunit.client.1.smithi159.stdout:1/659: mknod dd/d1c/cd0 0 2024-09-13T22:09:05.084 INFO:tasks.workunit.client.1.smithi159.stdout:8/819: sync 2024-09-13T22:09:05.085 INFO:tasks.workunit.client.1.smithi159.stdout:0/704: dwrite d0/d48/d4f/d2b/f8f [0,4194304] 0 2024-09-13T22:09:05.086 INFO:tasks.workunit.client.1.smithi159.stdout:5/606: getdents d1/d11/d64/d82/d8c 0 2024-09-13T22:09:05.092 INFO:tasks.workunit.client.1.smithi159.stdout:1/660: read dd/f16 [4146306,33650] 0 2024-09-13T22:09:05.092 INFO:tasks.workunit.client.1.smithi159.stdout:0/705: link d0/d48/d7d/dca/le0 d0/d48/d4f/daf/lef 0 2024-09-13T22:09:05.094 INFO:tasks.workunit.client.1.smithi159.stdout:5/607: unlink d1/d11/f4d 0 2024-09-13T22:09:05.094 INFO:tasks.workunit.client.1.smithi159.stdout:5/608: write d1/d11/d50/fbd [828375,103820] 0 2024-09-13T22:09:05.097 INFO:tasks.workunit.client.1.smithi159.stdout:1/661: creat dd/d1e/d58/d5f/fd1 x:0 0 0 2024-09-13T22:09:05.097 INFO:tasks.workunit.client.1.smithi159.stdout:1/662: write dd/d1e/d58/d8a/dbb/d3c/f8b [30287,42028] 0 2024-09-13T22:09:05.097 INFO:tasks.workunit.client.1.smithi159.stdout:1/663: chown dd/d11/d18/d49/d2d/d97/f93 493586525 1 2024-09-13T22:09:05.097 INFO:tasks.workunit.client.1.smithi159.stdout:1/664: fdatasync dd/d1e/d58/d5f/d84/faf 0 2024-09-13T22:09:05.097 INFO:tasks.workunit.client.1.smithi159.stdout:5/609: truncate d1/d11/d1c/d20/f88 1979154 0 2024-09-13T22:09:05.100 INFO:tasks.workunit.client.1.smithi159.stdout:1/665: getdents dd/d1e/d58/d8a/dbb/d3c/d95 0 2024-09-13T22:09:05.102 INFO:tasks.workunit.client.1.smithi159.stdout:1/666: creat dd/d1e/d58/d8a/dbb/fd2 x:0 0 0 2024-09-13T22:09:05.107 INFO:tasks.workunit.client.1.smithi159.stdout:8/820: dwrite da/d5d/d70/d8e/dc1/fd9 [0,4194304] 0 2024-09-13T22:09:05.112 INFO:tasks.workunit.client.1.smithi159.stdout:0/706: read d0/d2c/fde [544504,79439] 0 2024-09-13T22:09:05.115 INFO:tasks.workunit.client.1.smithi159.stdout:0/707: link d0/d48/d4f/d54/dac/fc0 d0/d48/d4f/d2b/da3/ff0 0 2024-09-13T22:09:05.119 INFO:tasks.workunit.client.1.smithi159.stdout:5/610: dwrite d1/d11/d64/d82/d8f/fbe [0,4194304] 0 2024-09-13T22:09:05.120 INFO:tasks.workunit.client.1.smithi159.stdout:5/611: dread - d1/d11/d50/fb7 zero size 2024-09-13T22:09:05.120 INFO:tasks.workunit.client.1.smithi159.stdout:5/612: write d1/d11/f71 [655120,53031] 0 2024-09-13T22:09:05.120 INFO:tasks.workunit.client.1.smithi159.stdout:0/708: mknod d0/d48/d7d/dca/cf1 0 2024-09-13T22:09:05.120 INFO:tasks.workunit.client.1.smithi159.stdout:0/709: stat d0/d48/d7d/dca/cf1 0 2024-09-13T22:09:05.124 INFO:tasks.workunit.client.1.smithi159.stdout:5/613: symlink d1/d11/d1c/d20/d44/d89/dcb/lcf 0 2024-09-13T22:09:05.127 INFO:tasks.workunit.client.1.smithi159.stdout:1/667: dwrite dd/d1c/f26 [0,4194304] 0 2024-09-13T22:09:05.127 INFO:tasks.workunit.client.1.smithi159.stdout:5/614: truncate d1/f3e 3839477 0 2024-09-13T22:09:05.128 INFO:tasks.workunit.client.1.smithi159.stdout:1/668: dread dd/d1e/d58/d8a/dbb/d3c/f8b [0,4194304] 0 2024-09-13T22:09:05.130 INFO:tasks.workunit.client.1.smithi159.stdout:5/615: write d1/d11/d64/d35/d60/f80 [594088,69523] 0 2024-09-13T22:09:05.131 INFO:tasks.workunit.client.1.smithi159.stdout:0/710: getdents d0/d48/d4f/d54/d74/dbe 0 2024-09-13T22:09:05.132 INFO:tasks.workunit.client.1.smithi159.stdout:0/711: chown d0/d48/d4f/d54/dac/cd7 101404128 1 2024-09-13T22:09:05.132 INFO:tasks.workunit.client.1.smithi159.stdout:0/712: chown d0/d48/d4f/f53 1381116 1 2024-09-13T22:09:05.139 INFO:tasks.workunit.client.1.smithi159.stdout:5/616: rename d1/d11/d1c/d20/d44/d89/cc6 to d1/d11/d64/cd0 0 2024-09-13T22:09:05.143 INFO:tasks.workunit.client.1.smithi159.stdout:5/617: mknod d1/d11/d1c/d20/cd1 0 2024-09-13T22:09:05.145 INFO:tasks.workunit.client.1.smithi159.stdout:1/669: dread dd/d11/d34/fb1 [0,4194304] 0 2024-09-13T22:09:05.146 INFO:tasks.workunit.client.1.smithi159.stdout:0/713: write d0/d2c/d96/da1/fdf [2264361,28740] 0 2024-09-13T22:09:05.159 INFO:tasks.workunit.client.1.smithi159.stdout:5/618: readlink d1/d11/d64/d35/d7c/lb4 0 2024-09-13T22:09:05.160 INFO:tasks.workunit.client.1.smithi159.stdout:0/714: truncate d0/d5e/d91/fae 818879 0 2024-09-13T22:09:05.160 INFO:tasks.workunit.client.1.smithi159.stdout:0/715: creat d0/d2c/d96/ff2 x:0 0 0 2024-09-13T22:09:05.161 INFO:tasks.workunit.client.1.smithi159.stdout:1/670: dread dd/d1e/d58/d5f/f7c [0,4194304] 0 2024-09-13T22:09:05.164 INFO:tasks.workunit.client.1.smithi159.stdout:0/716: mknod d0/d48/dd9/de8/cf3 0 2024-09-13T22:09:05.165 INFO:tasks.workunit.client.1.smithi159.stdout:0/717: dread d0/f45 [0,4194304] 0 2024-09-13T22:09:05.165 INFO:tasks.workunit.client.1.smithi159.stdout:1/671: creat dd/d1e/fd3 x:0 0 0 2024-09-13T22:09:05.168 INFO:tasks.workunit.client.1.smithi159.stdout:0/718: unlink d0/d48/d4f/c9c 0 2024-09-13T22:09:05.174 INFO:tasks.workunit.client.1.smithi159.stdout:1/672: link dd/d11/d18/d49/d2d/l46 dd/d1e/d58/d8a/dbb/ld4 0 2024-09-13T22:09:05.176 INFO:tasks.workunit.client.1.smithi159.stdout:1/673: mknod dd/d11/d13/d4b/d52/d63/dc2/dc6/cd5 0 2024-09-13T22:09:05.182 INFO:tasks.workunit.client.1.smithi159.stdout:1/674: rename dd/d11/d34/c64 to dd/d1e/d58/d8a/dbb/d3c/cd6 0 2024-09-13T22:09:05.182 INFO:tasks.workunit.client.1.smithi159.stdout:1/675: truncate dd/d1e/d58/d8a/dbb/fab 173006 0 2024-09-13T22:09:05.182 INFO:tasks.workunit.client.1.smithi159.stdout:0/719: dwrite d0/d48/d4f/d2b/f88 [0,4194304] 0 2024-09-13T22:09:05.187 INFO:tasks.workunit.client.1.smithi159.stdout:1/676: dread dd/d11/d34/fb1 [0,4194304] 0 2024-09-13T22:09:05.187 INFO:tasks.workunit.client.1.smithi159.stdout:1/677: fsync dd/d11/d18/d49/fb6 0 2024-09-13T22:09:05.187 INFO:tasks.workunit.client.1.smithi159.stdout:1/678: dread - dd/d11/d13/d4b/fac zero size 2024-09-13T22:09:05.187 INFO:tasks.workunit.client.1.smithi159.stdout:1/679: fsync dd/d1e/d58/d8a/dbb/f4e 0 2024-09-13T22:09:05.187 INFO:tasks.workunit.client.1.smithi159.stdout:1/680: readlink dd/d1e/d58/d8a/dbb/d3c/lce 0 2024-09-13T22:09:05.188 INFO:tasks.workunit.client.1.smithi159.stdout:0/720: mknod d0/d2c/d71/cf4 0 2024-09-13T22:09:05.188 INFO:tasks.workunit.client.1.smithi159.stdout:0/721: fdatasync d0/d48/d4f/d54/d74/f7a 0 2024-09-13T22:09:05.189 INFO:tasks.workunit.client.1.smithi159.stdout:1/681: symlink dd/d1e/d58/ld7 0 2024-09-13T22:09:05.201 INFO:tasks.workunit.client.1.smithi159.stdout:0/722: rmdir d0/d5e 39 2024-09-13T22:09:05.204 INFO:tasks.workunit.client.1.smithi159.stdout:0/723: getdents d0/d48/d4f/d2b/da3 0 2024-09-13T22:09:05.205 INFO:tasks.workunit.client.1.smithi159.stdout:1/682: dwrite dd/d11/f4f [0,4194304] 0 2024-09-13T22:09:05.207 INFO:tasks.workunit.client.1.smithi159.stdout:0/724: link d0/d2c/l2d d0/d48/dd9/lf5 0 2024-09-13T22:09:05.208 INFO:tasks.workunit.client.1.smithi159.stdout:0/725: chown d0/l21 9668444 1 2024-09-13T22:09:05.208 INFO:tasks.workunit.client.1.smithi159.stdout:0/726: read d0/d48/d4f/f76 [366065,83321] 0 2024-09-13T22:09:05.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/683: truncate dd/d11/d13/d4b/d52/f77 2990600 0 2024-09-13T22:09:05.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/684: rename dd/d11 to dd/d11/d18/d49/d2d/d97/dd8 22 2024-09-13T22:09:05.216 INFO:tasks.workunit.client.1.smithi159.stdout:0/727: stat d0/d48/d4f/d2b/la6 0 2024-09-13T22:09:05.218 INFO:tasks.workunit.client.1.smithi159.stdout:1/685: link dd/d11/d21/f6f dd/d1e/d58/d5f/d84/fd9 0 2024-09-13T22:09:05.220 INFO:tasks.workunit.client.1.smithi159.stdout:5/619: truncate d1/f3e 1615517 0 2024-09-13T22:09:05.221 INFO:tasks.workunit.client.1.smithi159.stdout:9/562: sync 2024-09-13T22:09:05.221 INFO:tasks.workunit.client.1.smithi159.stdout:2/419: sync 2024-09-13T22:09:05.221 INFO:tasks.workunit.client.1.smithi159.stdout:3/436: sync 2024-09-13T22:09:05.221 INFO:tasks.workunit.client.1.smithi159.stdout:3/437: chown d0/d1/l50 8 1 2024-09-13T22:09:05.221 INFO:tasks.workunit.client.1.smithi159.stdout:9/563: write d1/dc/d10/fb9 [418201,4820] 0 2024-09-13T22:09:05.221 INFO:tasks.workunit.client.1.smithi159.stdout:7/580: sync 2024-09-13T22:09:05.221 INFO:tasks.workunit.client.1.smithi159.stdout:7/581: stat d3/d2e/db6/fa5 0 2024-09-13T22:09:05.222 INFO:tasks.workunit.client.1.smithi159.stdout:0/728: rename d0/d48/dd9/de8/cdc to d0/d48/d4f/cf6 0 2024-09-13T22:09:05.224 INFO:tasks.workunit.client.1.smithi159.stdout:0/729: dread d0/d48/d4f/d2b/f60 [0,4194304] 0 2024-09-13T22:09:05.224 INFO:tasks.workunit.client.1.smithi159.stdout:3/438: dread d0/d1/d3/d5/d25/d75/d5b/d45/f53 [0,4194304] 0 2024-09-13T22:09:05.227 INFO:tasks.workunit.client.1.smithi159.stdout:2/420: creat d9/da/f8f x:0 0 0 2024-09-13T22:09:05.227 INFO:tasks.workunit.client.1.smithi159.stdout:2/421: creat d9/d65/d40/d69/f90 x:0 0 0 2024-09-13T22:09:05.230 INFO:tasks.workunit.client.1.smithi159.stdout:9/564: symlink d1/dc/d10/d6d/d4b/d98/lc3 0 2024-09-13T22:09:05.231 INFO:tasks.workunit.client.1.smithi159.stdout:7/582: mkdir d3/d31/d4d/d9e/dbe 0 2024-09-13T22:09:05.231 INFO:tasks.workunit.client.1.smithi159.stdout:7/583: write d3/d2e/d6e/d74/dba/d5e/fbd [165233,100941] 0 2024-09-13T22:09:05.232 INFO:tasks.workunit.client.1.smithi159.stdout:7/584: dread - d3/d2e/db6/f92 zero size 2024-09-13T22:09:05.234 INFO:tasks.workunit.client.1.smithi159.stdout:1/686: rename dd/d11/f4f to dd/d1e/d58/d5f/fda 0 2024-09-13T22:09:05.235 INFO:tasks.workunit.client.1.smithi159.stdout:0/730: truncate d0/d5e/f51 1725692 0 2024-09-13T22:09:05.235 INFO:tasks.workunit.client.1.smithi159.stdout:0/731: write d0/d48/d4f/d54/d74/dbe/fe4 [575429,89112] 0 2024-09-13T22:09:05.237 INFO:tasks.workunit.client.1.smithi159.stdout:3/439: link d0/d1/d3/d5/d25/d75/d5b/d45/f7d d0/d1/d3/d5/f88 0 2024-09-13T22:09:05.237 INFO:tasks.workunit.client.1.smithi159.stdout:3/440: chown d0/d1/d3/d5/d25/f6f 10 1 2024-09-13T22:09:05.242 INFO:tasks.workunit.client.1.smithi159.stdout:9/565: rmdir d1/d9/d1f 39 2024-09-13T22:09:05.244 INFO:tasks.workunit.client.1.smithi159.stdout:1/687: creat dd/d1e/d58/d5f/d84/fdb x:0 0 0 2024-09-13T22:09:05.247 INFO:tasks.workunit.client.1.smithi159.stdout:0/732: mkdir d0/d48/d4f/d54/dac/df7 0 2024-09-13T22:09:05.247 INFO:tasks.workunit.client.1.smithi159.stdout:0/733: chown d0/d48/d4f/d54/dac/ce5 308053 1 2024-09-13T22:09:05.250 INFO:tasks.workunit.client.1.smithi159.stdout:1/688: rename dd/d1e/d58/d8a/dbb/da4/fa5 to dd/d1e/d58/d5f/fdc 0 2024-09-13T22:09:05.250 INFO:tasks.workunit.client.1.smithi159.stdout:1/689: readlink dd/d11/d13/d4b/l89 0 2024-09-13T22:09:05.250 INFO:tasks.workunit.client.1.smithi159.stdout:1/690: write dd/d1e/d58/d8a/dbb/fab [326075,6418] 0 2024-09-13T22:09:05.250 INFO:tasks.workunit.client.1.smithi159.stdout:1/691: getdents dd/dcc 0 2024-09-13T22:09:05.261 INFO:tasks.workunit.client.1.smithi159.stdout:7/585: dwrite d3/d2e/fb0 [0,4194304] 0 2024-09-13T22:09:05.261 INFO:tasks.workunit.client.1.smithi159.stdout:7/586: fsync d3/f11 0 2024-09-13T22:09:05.262 INFO:tasks.workunit.client.1.smithi159.stdout:7/587: mknod d3/cbf 0 2024-09-13T22:09:05.262 INFO:tasks.workunit.client.1.smithi159.stdout:7/588: chown d3/f1e 1088601 1 2024-09-13T22:09:05.262 INFO:tasks.workunit.client.1.smithi159.stdout:7/589: fsync d3/d3f/f4a 0 2024-09-13T22:09:05.263 INFO:tasks.workunit.client.1.smithi159.stdout:7/590: getdents d3/d2e/db6/d6c 0 2024-09-13T22:09:05.263 INFO:tasks.workunit.client.1.smithi159.stdout:0/734: dread d0/d48/f70 [0,4194304] 0 2024-09-13T22:09:05.264 INFO:tasks.workunit.client.1.smithi159.stdout:0/735: dread d0/d48/d4f/d2b/f60 [0,4194304] 0 2024-09-13T22:09:05.264 INFO:tasks.workunit.client.1.smithi159.stdout:0/736: fdatasync d0/d48/d4f/d54/f80 0 2024-09-13T22:09:05.264 INFO:tasks.workunit.client.1.smithi159.stdout:0/737: write d0/d48/d4f/d54/dac/fc0 [875715,46107] 0 2024-09-13T22:09:05.265 INFO:tasks.workunit.client.1.smithi159.stdout:0/738: write d0/d48/f4d [630227,55208] 0 2024-09-13T22:09:05.266 INFO:tasks.workunit.client.1.smithi159.stdout:1/692: write dd/d11/d18/d49/fb6 [185486,61881] 0 2024-09-13T22:09:05.270 INFO:tasks.workunit.client.1.smithi159.stdout:7/591: dread d3/d3f/fa1 [0,4194304] 0 2024-09-13T22:09:05.275 INFO:tasks.workunit.client.1.smithi159.stdout:7/592: dread d3/f1e [0,4194304] 0 2024-09-13T22:09:05.287 INFO:tasks.workunit.client.1.smithi159.stdout:7/593: dread d3/d31/d4d/d9e/f8b [0,4194304] 0 2024-09-13T22:09:05.287 INFO:tasks.workunit.client.1.smithi159.stdout:7/594: chown d3/d2e 104 1 2024-09-13T22:09:05.288 INFO:tasks.workunit.client.1.smithi159.stdout:7/595: fsync d3/d3f/f8f 0 2024-09-13T22:09:05.289 INFO:tasks.workunit.client.1.smithi159.stdout:7/596: rename d3/d2e/d6e/d74/dba/d5e/f64 to d3/dab/fc0 0 2024-09-13T22:09:05.291 INFO:tasks.workunit.client.1.smithi159.stdout:7/597: creat d3/d2e/fc1 x:0 0 0 2024-09-13T22:09:05.291 INFO:tasks.workunit.client.1.smithi159.stdout:7/598: fdatasync d3/f2a 0 2024-09-13T22:09:05.292 INFO:tasks.workunit.client.1.smithi159.stdout:7/599: dread d3/d31/d4d/d9e/f8b [0,4194304] 0 2024-09-13T22:09:05.297 INFO:tasks.workunit.client.1.smithi159.stdout:7/600: creat d3/fc2 x:0 0 0 2024-09-13T22:09:05.297 INFO:tasks.workunit.client.1.smithi159.stdout:7/601: symlink d3/dab/lc3 0 2024-09-13T22:09:05.297 INFO:tasks.workunit.client.1.smithi159.stdout:7/602: symlink d3/d31/d4d/d9e/dbe/lc4 0 2024-09-13T22:09:05.297 INFO:tasks.workunit.client.1.smithi159.stdout:7/603: rmdir d3/d2e/db6/d6c 39 2024-09-13T22:09:05.298 INFO:tasks.workunit.client.1.smithi159.stdout:7/604: unlink d3/d2e/d6e/d74/dba/d5e/fbd 0 2024-09-13T22:09:05.298 INFO:tasks.workunit.client.1.smithi159.stdout:7/605: fdatasync d3/ff 0 2024-09-13T22:09:05.304 INFO:tasks.workunit.client.1.smithi159.stdout:0/739: dwrite d0/d48/d7d/f9d [0,4194304] 0 2024-09-13T22:09:05.304 INFO:tasks.workunit.client.1.smithi159.stdout:0/740: chown d0/d48/d4f/f69 737 1 2024-09-13T22:09:05.304 INFO:tasks.workunit.client.1.smithi159.stdout:0/741: fdatasync d0/d2c/f8c 0 2024-09-13T22:09:05.305 INFO:tasks.workunit.client.1.smithi159.stdout:1/693: dwrite dd/d11/d34/f99 [0,4194304] 0 2024-09-13T22:09:05.307 INFO:tasks.workunit.client.1.smithi159.stdout:1/694: mknod dd/d11/cdd 0 2024-09-13T22:09:05.336 INFO:tasks.workunit.client.1.smithi159.stdout:5/620: dwrite d1/d11/d64/f10 [4194304,4194304] 0 2024-09-13T22:09:05.336 INFO:tasks.workunit.client.1.smithi159.stdout:3/441: dwrite d0/d1/d34/f79 [0,4194304] 0 2024-09-13T22:09:05.336 INFO:tasks.workunit.client.1.smithi159.stdout:3/442: write d0/d1/d3/d5/d25/d75/d5b/d45/f51 [370463,95417] 0 2024-09-13T22:09:05.336 INFO:tasks.workunit.client.1.smithi159.stdout:9/566: dwrite d1/dc/f5f [0,4194304] 0 2024-09-13T22:09:05.338 INFO:tasks.workunit.client.1.smithi159.stdout:7/606: dwrite d3/d2e/db6/f92 [0,4194304] 0 2024-09-13T22:09:05.338 INFO:tasks.workunit.client.1.smithi159.stdout:7/607: fsync d3/f2f 0 2024-09-13T22:09:05.339 INFO:tasks.workunit.client.1.smithi159.stdout:1/695: dwrite f3 [0,4194304] 0 2024-09-13T22:09:05.345 INFO:tasks.workunit.client.1.smithi159.stdout:5/621: fdatasync d1/d11/d64/d35/f57 0 2024-09-13T22:09:05.345 INFO:tasks.workunit.client.1.smithi159.stdout:5/622: fdatasync d1/d11/f1e 0 2024-09-13T22:09:05.346 INFO:tasks.workunit.client.1.smithi159.stdout:3/443: unlink d0/d1/f2a 0 2024-09-13T22:09:05.352 INFO:tasks.workunit.client.1.smithi159.stdout:9/567: dwrite d1/f53 [0,4194304] 0 2024-09-13T22:09:05.352 INFO:tasks.workunit.client.1.smithi159.stdout:9/568: truncate d1/f1c 2578496 0 2024-09-13T22:09:05.359 INFO:tasks.workunit.client.1.smithi159.stdout:7/608: creat d3/d18/fc5 x:0 0 0 2024-09-13T22:09:05.362 INFO:tasks.workunit.client.1.smithi159.stdout:1/696: rename f3 to dd/d11/d13/d4b/d52/d63/dc2/dc6/fde 0 2024-09-13T22:09:05.362 INFO:tasks.workunit.client.1.smithi159.stdout:9/569: write d1/d9/d2a/f41 [1273406,18972] 0 2024-09-13T22:09:05.362 INFO:tasks.workunit.client.1.smithi159.stdout:9/570: truncate d1/dc/d10/d6d/d87/f7f 4462304 0 2024-09-13T22:09:05.362 INFO:tasks.workunit.client.1.smithi159.stdout:5/623: rmdir d1/d11/d64/d35 39 2024-09-13T22:09:05.365 INFO:tasks.workunit.client.1.smithi159.stdout:3/444: mknod d0/d1/d3/d5/d25/d2c/c89 0 2024-09-13T22:09:05.367 INFO:tasks.workunit.client.1.smithi159.stdout:7/609: write d3/d31/d4d/f8e [6084,127392] 0 2024-09-13T22:09:05.368 INFO:tasks.workunit.client.1.smithi159.stdout:7/610: truncate d3/d18/fc5 491784 0 2024-09-13T22:09:05.369 INFO:tasks.workunit.client.1.smithi159.stdout:1/697: symlink dd/d1e/d58/d8a/dbb/ldf 0 2024-09-13T22:09:05.371 INFO:tasks.workunit.client.1.smithi159.stdout:5/624: rmdir d1/d11/d64/d35/d7c 39 2024-09-13T22:09:05.371 INFO:tasks.workunit.client.1.smithi159.stdout:5/625: chown d1/d11/d50/faf 5550 1 2024-09-13T22:09:05.373 INFO:tasks.workunit.client.1.smithi159.stdout:7/611: creat d3/d2e/db6/d6c/db2/fc6 x:0 0 0 2024-09-13T22:09:05.373 INFO:tasks.workunit.client.1.smithi159.stdout:6/552: sync 2024-09-13T22:09:05.374 INFO:tasks.workunit.client.1.smithi159.stdout:6/553: chown d3/da/d29/d26/d6c 17 1 2024-09-13T22:09:05.374 INFO:tasks.workunit.client.1.smithi159.stdout:6/554: dread - d3/da/d29/d26/d6c/d6e/f95 zero size 2024-09-13T22:09:05.374 INFO:tasks.workunit.client.1.smithi159.stdout:6/555: chown d3/da/d29/f11 30 1 2024-09-13T22:09:05.375 INFO:tasks.workunit.client.1.smithi159.stdout:1/698: rmdir dd/d11/d13/d4b/d52/d63/d9d 0 2024-09-13T22:09:05.379 INFO:tasks.workunit.client.1.smithi159.stdout:9/571: getdents d1/dc 0 2024-09-13T22:09:05.382 INFO:tasks.workunit.client.1.smithi159.stdout:7/612: creat d3/d31/d4d/d4e/d7a/fc7 x:0 0 0 2024-09-13T22:09:05.383 INFO:tasks.workunit.client.1.smithi159.stdout:6/556: dread d3/da/d29/d1a/f1c [0,4194304] 0 2024-09-13T22:09:05.384 INFO:tasks.workunit.client.1.smithi159.stdout:1/699: mkdir dd/d11/d18/d74/d82/d9a/de0 0 2024-09-13T22:09:05.387 INFO:tasks.workunit.client.1.smithi159.stdout:9/572: link d1/dc/d10/d6d/d4b/f55 d1/dc/d27/fc4 0 2024-09-13T22:09:05.389 INFO:tasks.workunit.client.1.smithi159.stdout:7/613: link d3/d31/d4d/l53 d3/d31/d4d/lc8 0 2024-09-13T22:09:05.390 INFO:tasks.workunit.client.1.smithi159.stdout:6/557: rename d3/d6d/c8f to d3/d2a/d3c/d46/cad 0 2024-09-13T22:09:05.390 INFO:tasks.workunit.client.1.smithi159.stdout:6/558: creat d3/da/d29/d26/d6c/d6e/fae x:0 0 0 2024-09-13T22:09:05.392 INFO:tasks.workunit.client.1.smithi159.stdout:7/614: unlink d3/d31/d4d/d4e/cac 0 2024-09-13T22:09:05.393 INFO:tasks.workunit.client.1.smithi159.stdout:5/626: dwrite d1/d11/d64/d17/f54 [0,4194304] 0 2024-09-13T22:09:05.393 INFO:tasks.workunit.client.1.smithi159.stdout:6/559: creat d3/d2a/d3c/d5c/faf x:0 0 0 2024-09-13T22:09:05.394 INFO:tasks.workunit.client.1.smithi159.stdout:7/615: mknod d3/d2e/d6e/d74/dba/d5e/cc9 0 2024-09-13T22:09:05.394 INFO:tasks.workunit.client.1.smithi159.stdout:7/616: write d3/d31/d4d/d4e/d7a/f9b [246891,46554] 0 2024-09-13T22:09:05.395 INFO:tasks.workunit.client.1.smithi159.stdout:3/445: dwrite d0/d1/d3/d5/d25/d75/d5b/d45/f51 [0,4194304] 0 2024-09-13T22:09:05.396 INFO:tasks.workunit.client.1.smithi159.stdout:5/627: fdatasync d1/d11/d64/d35/f56 0 2024-09-13T22:09:05.397 INFO:tasks.workunit.client.1.smithi159.stdout:7/617: truncate d3/d18/f7c 1149211 0 2024-09-13T22:09:05.404 INFO:tasks.workunit.client.1.smithi159.stdout:6/560: dread d3/da/d25/f41 [0,4194304] 0 2024-09-13T22:09:05.405 INFO:tasks.workunit.client.1.smithi159.stdout:6/561: unlink d3/da/d29/f63 0 2024-09-13T22:09:05.407 INFO:tasks.workunit.client.1.smithi159.stdout:7/618: dread d3/d3f/fb1 [0,4194304] 0 2024-09-13T22:09:05.408 INFO:tasks.workunit.client.1.smithi159.stdout:6/562: rename d3/da/d29/f11 to d3/d2a/d3c/fb0 0 2024-09-13T22:09:05.408 INFO:tasks.workunit.client.1.smithi159.stdout:6/563: readlink d3/l14 0 2024-09-13T22:09:05.411 INFO:tasks.workunit.client.1.smithi159.stdout:6/564: mknod d3/d2a/d3c/cb1 0 2024-09-13T22:09:05.411 INFO:tasks.workunit.client.1.smithi159.stdout:1/700: dwrite dd/d11/d13/d4b/d52/f77 [0,4194304] 0 2024-09-13T22:09:05.414 INFO:tasks.workunit.client.1.smithi159.stdout:1/701: mkdir dd/d1e/d58/da7/de1 0 2024-09-13T22:09:05.415 INFO:tasks.workunit.client.1.smithi159.stdout:6/565: dread d3/da/d29/d1a/f1c [0,4194304] 0 2024-09-13T22:09:05.421 INFO:tasks.workunit.client.1.smithi159.stdout:5/628: dwrite d1/d11/d64/d82/d8c/fc2 [0,4194304] 0 2024-09-13T22:09:05.424 INFO:tasks.workunit.client.1.smithi159.stdout:9/573: dwrite d1/dc/d10/d6d/d4b/d98/da8/fb3 [0,4194304] 0 2024-09-13T22:09:05.430 INFO:tasks.workunit.client.1.smithi159.stdout:9/574: link d1/dc/d10/d6d/d4b/f76 d1/dc/d27/da4/db5/fc5 0 2024-09-13T22:09:05.432 INFO:tasks.workunit.client.1.smithi159.stdout:3/446: dwrite d0/d1/d3/d5/f55 [0,4194304] 0 2024-09-13T22:09:05.433 INFO:tasks.workunit.client.1.smithi159.stdout:5/629: rename d1/d11/d1c/d20 to d1/d11/d1c/dd2 0 2024-09-13T22:09:05.434 INFO:tasks.workunit.client.1.smithi159.stdout:9/575: symlink d1/dc/d10/d6d/d4b/lc6 0 2024-09-13T22:09:05.440 INFO:tasks.workunit.client.1.smithi159.stdout:7/619: dwrite d3/f2a [0,4194304] 0 2024-09-13T22:09:05.442 INFO:tasks.workunit.client.1.smithi159.stdout:6/566: dwrite d3/d2a/d3c/d5c/faf [0,4194304] 0 2024-09-13T22:09:05.442 INFO:tasks.workunit.client.1.smithi159.stdout:6/567: fdatasync d3/da/d29/d1a/f2e 0 2024-09-13T22:09:05.443 INFO:tasks.workunit.client.1.smithi159.stdout:7/620: creat d3/d2e/d6e/d74/fca x:0 0 0 2024-09-13T22:09:05.443 INFO:tasks.workunit.client.1.smithi159.stdout:7/621: truncate d3/d3f/fad 1416219 0 2024-09-13T22:09:05.443 INFO:tasks.workunit.client.1.smithi159.stdout:7/622: fdatasync d3/d18/fc5 0 2024-09-13T22:09:05.446 INFO:tasks.workunit.client.1.smithi159.stdout:7/623: write d3/d3f/f8f [855061,101064] 0 2024-09-13T22:09:05.455 INFO:tasks.workunit.client.1.smithi159.stdout:9/576: dread d1/dc/d10/f17 [0,4194304] 0 2024-09-13T22:09:05.455 INFO:tasks.workunit.client.1.smithi159.stdout:9/577: chown d1/l5c 983558804 1 2024-09-13T22:09:05.459 INFO:tasks.workunit.client.1.smithi159.stdout:3/447: dwrite d0/d1/d3/d5/d25/d2c/d7f/f87 [0,4194304] 0 2024-09-13T22:09:05.465 INFO:tasks.workunit.client.1.smithi159.stdout:3/448: mknod d0/d1/d3/d5/d25/d2c/d71/c8a 0 2024-09-13T22:09:05.465 INFO:tasks.workunit.client.1.smithi159.stdout:3/449: getdents d0/d78 0 2024-09-13T22:09:05.465 INFO:tasks.workunit.client.1.smithi159.stdout:6/568: dwrite d3/d2a/d3c/fb0 [0,4194304] 0 2024-09-13T22:09:05.466 INFO:tasks.workunit.client.1.smithi159.stdout:5/630: write d1/d11/d9e/f31 [795510,53726] 0 2024-09-13T22:09:05.466 INFO:tasks.workunit.client.1.smithi159.stdout:3/450: mknod d0/d1/d3/dd/c8b 0 2024-09-13T22:09:05.467 INFO:tasks.workunit.client.1.smithi159.stdout:5/631: truncate d1/fad 4094022 0 2024-09-13T22:09:05.468 INFO:tasks.workunit.client.1.smithi159.stdout:3/451: mkdir d0/d1/d3/d5/d25/d75/d5b/d45/d8c 0 2024-09-13T22:09:05.469 INFO:tasks.workunit.client.1.smithi159.stdout:3/452: stat d0/d1/d3/d5/db/d39/l43 0 2024-09-13T22:09:05.469 INFO:tasks.workunit.client.1.smithi159.stdout:3/453: write d0/d1/d34/f3e [2163404,80496] 0 2024-09-13T22:09:05.469 INFO:tasks.workunit.client.1.smithi159.stdout:5/632: creat d1/d11/d64/d82/d8c/fd3 x:0 0 0 2024-09-13T22:09:05.470 INFO:tasks.workunit.client.1.smithi159.stdout:3/454: symlink d0/d1/d3/d5/l8d 0 2024-09-13T22:09:05.472 INFO:tasks.workunit.client.1.smithi159.stdout:3/455: truncate d0/d1/d3/d5/f88 482943 0 2024-09-13T22:09:05.473 INFO:tasks.workunit.client.1.smithi159.stdout:3/456: truncate d0/d1/d3/d5/f55 2919635 0 2024-09-13T22:09:05.473 INFO:tasks.workunit.client.1.smithi159.stdout:3/457: chown d0/d1/d3/d5/d25/d75 3031 1 2024-09-13T22:09:05.474 INFO:tasks.workunit.client.1.smithi159.stdout:7/624: dwrite d3/dab/fc0 [0,4194304] 0 2024-09-13T22:09:05.474 INFO:tasks.workunit.client.1.smithi159.stdout:9/578: dwrite d1/d9/d2a/f91 [0,4194304] 0 2024-09-13T22:09:05.476 INFO:tasks.workunit.client.1.smithi159.stdout:7/625: symlink d3/d2e/db6/d6c/lcb 0 2024-09-13T22:09:05.476 INFO:tasks.workunit.client.1.smithi159.stdout:7/626: chown d3/d3f/c80 4639846 1 2024-09-13T22:09:05.479 INFO:tasks.workunit.client.1.smithi159.stdout:9/579: symlink d1/dc/d10/d6d/d2f/d8b/da1/lc7 0 2024-09-13T22:09:05.479 INFO:tasks.workunit.client.1.smithi159.stdout:9/580: write d1/dc/d10/d6d/d4b/fbf [472519,125226] 0 2024-09-13T22:09:05.479 INFO:tasks.workunit.client.1.smithi159.stdout:7/627: getdents d3/d3f 0 2024-09-13T22:09:05.481 INFO:tasks.workunit.client.1.smithi159.stdout:9/581: rmdir d1/dc/d10/d6d/d87/dbc 0 2024-09-13T22:09:05.482 INFO:tasks.workunit.client.1.smithi159.stdout:9/582: write d1/dc/d10/fb9 [1101535,106617] 0 2024-09-13T22:09:05.482 INFO:tasks.workunit.client.1.smithi159.stdout:6/569: dread d3/d2a/d3c/d46/f4c [0,4194304] 0 2024-09-13T22:09:05.483 INFO:tasks.workunit.client.1.smithi159.stdout:9/583: creat d1/dc/d10/d6d/fc8 x:0 0 0 2024-09-13T22:09:05.486 INFO:tasks.workunit.client.1.smithi159.stdout:3/458: write d0/d1/d3/f48 [1620701,83033] 0 2024-09-13T22:09:05.488 INFO:tasks.workunit.client.1.smithi159.stdout:3/459: link d0/d1/d3/d5/d25/d2c/c89 d0/d1/d3/d5/d25/c8e 0 2024-09-13T22:09:05.491 INFO:tasks.workunit.client.1.smithi159.stdout:6/570: write d3/da/d29/d1a/d3e/f55 [2389914,25393] 0 2024-09-13T22:09:05.492 INFO:tasks.workunit.client.1.smithi159.stdout:5/633: dwrite d1/d11/f75 [0,4194304] 0 2024-09-13T22:09:05.494 INFO:tasks.workunit.client.1.smithi159.stdout:6/571: rename d3/da/d29/d1a/d3e/f8c to d3/da/d25/d52/fb2 0 2024-09-13T22:09:05.495 INFO:tasks.workunit.client.1.smithi159.stdout:9/584: read d1/dc/f5f [3207319,129830] 0 2024-09-13T22:09:05.497 INFO:tasks.workunit.client.1.smithi159.stdout:6/572: dread d3/d2a/f71 [0,4194304] 0 2024-09-13T22:09:05.500 INFO:tasks.workunit.client.1.smithi159.stdout:9/585: rename d1/dc/l43 to d1/dc/d10/d6d/d2f/d8b/d8f/lc9 0 2024-09-13T22:09:05.501 INFO:tasks.workunit.client.1.smithi159.stdout:7/628: dwrite d3/d2e/db6/d6c/f90 [4194304,4194304] 0 2024-09-13T22:09:05.501 INFO:tasks.workunit.client.1.smithi159.stdout:7/629: chown d3/d18/f1d 265645 1 2024-09-13T22:09:05.505 INFO:tasks.workunit.client.1.smithi159.stdout:7/630: dread d3/d3f/fb1 [0,4194304] 0 2024-09-13T22:09:05.516 INFO:tasks.workunit.client.1.smithi159.stdout:3/460: dwrite d0/f57 [0,4194304] 0 2024-09-13T22:09:05.516 INFO:tasks.workunit.client.1.smithi159.stdout:3/461: chown d0/d1/c4 2217068 1 2024-09-13T22:09:05.516 INFO:tasks.workunit.client.1.smithi159.stdout:5/634: dwrite d1/d11/d64/d35/d7c/d7d/f8e [0,4194304] 0 2024-09-13T22:09:05.516 INFO:tasks.workunit.client.1.smithi159.stdout:5/635: creat d1/d11/d9e/d7b/fd4 x:0 0 0 2024-09-13T22:09:05.523 INFO:tasks.workunit.client.1.smithi159.stdout:3/462: dread d0/d1/d3/d5/db/d39/f3f [0,4194304] 0 2024-09-13T22:09:05.523 INFO:tasks.workunit.client.1.smithi159.stdout:3/463: write d0/d1/d3/d5/d25/d75/d5b/d45/f7d [517717,18667] 0 2024-09-13T22:09:05.533 INFO:tasks.workunit.client.1.smithi159.stdout:5/636: dwrite d1/d11/d1c/dd2/fc3 [0,4194304] 0 2024-09-13T22:09:05.540 INFO:tasks.workunit.client.1.smithi159.stdout:6/573: mkdir d3/da/d25/d69/db3 0 2024-09-13T22:09:05.540 INFO:tasks.workunit.client.1.smithi159.stdout:6/574: chown d3/d2a/d9b/la2 526960834 1 2024-09-13T22:09:05.541 INFO:tasks.workunit.client.1.smithi159.stdout:9/586: symlink d1/dc/d27/d40/lca 0 2024-09-13T22:09:05.556 INFO:tasks.workunit.client.1.smithi159.stdout:5/637: dwrite d1/d11/d9e/fa7 [0,4194304] 0 2024-09-13T22:09:05.557 INFO:tasks.workunit.client.1.smithi159.stdout:6/575: dwrite d3/da/d29/f45 [0,4194304] 0 2024-09-13T22:09:05.557 INFO:tasks.workunit.client.1.smithi159.stdout:6/576: fsync d3/d2a/d3c/fb0 0 2024-09-13T22:09:05.571 INFO:tasks.workunit.client.1.smithi159.stdout:7/631: mkdir d3/dab/dcc 0 2024-09-13T22:09:05.571 INFO:tasks.workunit.client.1.smithi159.stdout:7/632: truncate d3/d2e/d6e/f86 1432965 0 2024-09-13T22:09:05.581 INFO:tasks.workunit.client.1.smithi159.stdout:6/577: dwrite d3/da/d29/d1a/f90 [0,4194304] 0 2024-09-13T22:09:05.581 INFO:tasks.workunit.client.1.smithi159.stdout:6/578: creat d3/da/d29/d1a/da3/da5/fb4 x:0 0 0 2024-09-13T22:09:05.582 INFO:tasks.workunit.client.1.smithi159.stdout:3/464: mkdir d0/d1/d3/d5/d25/d2c/d71/d8f 0 2024-09-13T22:09:05.582 INFO:tasks.workunit.client.1.smithi159.stdout:3/465: fdatasync d0/d1/d3/f1f 0 2024-09-13T22:09:05.582 INFO:tasks.workunit.client.1.smithi159.stdout:3/466: creat d0/d1/d3/d5/d25/d2c/d7f/f90 x:0 0 0 2024-09-13T22:09:05.584 INFO:tasks.workunit.client.1.smithi159.stdout:9/587: rmdir d1/dc/d27/da4/db5 39 2024-09-13T22:09:05.588 INFO:tasks.workunit.client.1.smithi159.stdout:7/633: mknod d3/d2e/d6e/db9/ccd 0 2024-09-13T22:09:05.591 INFO:tasks.workunit.client.1.smithi159.stdout:7/634: dread d3/ff [0,4194304] 0 2024-09-13T22:09:05.591 INFO:tasks.workunit.client.1.smithi159.stdout:7/635: write d3/d2e/d6e/d74/fca [475938,119041] 0 2024-09-13T22:09:05.591 INFO:tasks.workunit.client.1.smithi159.stdout:7/636: write d3/d2e/f81 [1958958,72849] 0 2024-09-13T22:09:05.598 INFO:tasks.workunit.client.1.smithi159.stdout:3/467: mkdir d0/d91 0 2024-09-13T22:09:05.601 INFO:tasks.workunit.client.1.smithi159.stdout:3/468: mkdir d0/d1/d3/d5/d25/d4e/d92 0 2024-09-13T22:09:05.603 INFO:tasks.workunit.client.1.smithi159.stdout:9/588: rename d1/d9/d2a to d1/dc/d10/d6d/d4b/dcb 0 2024-09-13T22:09:05.603 INFO:tasks.workunit.client.1.smithi159.stdout:3/469: symlink d0/d1/d3/d5/d25/d2c/l93 0 2024-09-13T22:09:05.605 INFO:tasks.workunit.client.1.smithi159.stdout:9/589: symlink d1/dc/d10/d9c/lcc 0 2024-09-13T22:09:05.605 INFO:tasks.workunit.client.1.smithi159.stdout:9/590: fdatasync d1/dc/d10/d69/f79 0 2024-09-13T22:09:05.605 INFO:tasks.workunit.client.1.smithi159.stdout:9/591: fdatasync d1/dc/d27/d40/f5e 0 2024-09-13T22:09:05.607 INFO:tasks.workunit.client.1.smithi159.stdout:9/592: mknod d1/dc/d10/d6d/d4b/dcb/d75/ccd 0 2024-09-13T22:09:05.609 INFO:tasks.workunit.client.1.smithi159.stdout:5/638: dwrite d1/d11/d64/d35/d6f/f7f [0,4194304] 0 2024-09-13T22:09:05.609 INFO:tasks.workunit.client.1.smithi159.stdout:5/639: truncate d1/d11/d1c/dd2/d53/f6a 535448 0 2024-09-13T22:09:05.609 INFO:tasks.workunit.client.1.smithi159.stdout:5/640: fdatasync d1/d11/d1c/dd2/fc3 0 2024-09-13T22:09:05.609 INFO:tasks.workunit.client.1.smithi159.stdout:9/593: rmdir d1/dc/d10/d6d/d2f/d8b/da1 39 2024-09-13T22:09:05.611 INFO:tasks.workunit.client.1.smithi159.stdout:7/637: dwrite d3/d18/f7c [0,4194304] 0 2024-09-13T22:09:05.611 INFO:tasks.workunit.client.1.smithi159.stdout:7/638: dread - d3/f2f zero size 2024-09-13T22:09:05.611 INFO:tasks.workunit.client.1.smithi159.stdout:7/639: fdatasync d3/d3f/fa1 0 2024-09-13T22:09:05.611 INFO:tasks.workunit.client.1.smithi159.stdout:7/640: write d3/f62 [983461,97954] 0 2024-09-13T22:09:05.612 INFO:tasks.workunit.client.1.smithi159.stdout:5/641: link d1/d11/d64/d17/f54 d1/d11/d64/d17/fd5 0 2024-09-13T22:09:05.614 INFO:tasks.workunit.client.1.smithi159.stdout:9/594: rename d1/dc/d10/d6d/d4b/dcb/f41 to d1/dc/d27/d40/fce 0 2024-09-13T22:09:05.614 INFO:tasks.workunit.client.1.smithi159.stdout:9/595: dread - d1/dc/d27/d40/fc2 zero size 2024-09-13T22:09:05.616 INFO:tasks.workunit.client.1.smithi159.stdout:7/641: mkdir d3/d2e/db6/d6c/db2/dce 0 2024-09-13T22:09:05.616 INFO:tasks.workunit.client.1.smithi159.stdout:7/642: creat d3/d31/d4d/d4e/d7a/fcf x:0 0 0 2024-09-13T22:09:05.616 INFO:tasks.workunit.client.1.smithi159.stdout:7/643: write d3/d31/d4d/d4e/f51 [2272517,47086] 0 2024-09-13T22:09:05.616 INFO:tasks.workunit.client.1.smithi159.stdout:5/642: mkdir d1/d11/d1c/dd2/dd6 0 2024-09-13T22:09:05.618 INFO:tasks.workunit.client.1.smithi159.stdout:7/644: creat d3/d2e/d6e/d74/fd0 x:0 0 0 2024-09-13T22:09:05.619 INFO:tasks.workunit.client.1.smithi159.stdout:5/643: creat d1/d11/d64/d35/d6f/fd7 x:0 0 0 2024-09-13T22:09:05.620 INFO:tasks.workunit.client.1.smithi159.stdout:7/645: creat d3/d31/fd1 x:0 0 0 2024-09-13T22:09:05.620 INFO:tasks.workunit.client.1.smithi159.stdout:7/646: write d3/fc2 [237872,15336] 0 2024-09-13T22:09:05.620 INFO:tasks.workunit.client.1.smithi159.stdout:3/470: dwrite d0/d1/d3/d5/d25/d2c/d7f/f87 [0,4194304] 0 2024-09-13T22:09:05.621 INFO:tasks.workunit.client.1.smithi159.stdout:5/644: rename d1/d11/d1c/d9c to d1/d11/d1c/dd2/d44/dd8 0 2024-09-13T22:09:05.622 INFO:tasks.workunit.client.1.smithi159.stdout:3/471: mkdir d0/d1/d3/d5/d25/d94 0 2024-09-13T22:09:05.622 INFO:tasks.workunit.client.1.smithi159.stdout:3/472: chown d0/d1/d3/d5/db/d58/f6c 160 1 2024-09-13T22:09:05.622 INFO:tasks.workunit.client.1.smithi159.stdout:3/473: chown d0/d1/d3/d5/d25/d2c/d7f/f87 49403269 1 2024-09-13T22:09:05.624 INFO:tasks.workunit.client.1.smithi159.stdout:7/647: rename d3/d2e/d6e/l7b to d3/d2e/db6/d6c/db2/dbc/ld2 0 2024-09-13T22:09:05.625 INFO:tasks.workunit.client.1.smithi159.stdout:9/596: rmdir d1/d9 39 2024-09-13T22:09:05.627 INFO:tasks.workunit.client.1.smithi159.stdout:5/645: symlink d1/d11/d1c/dd2/d44/d89/dcb/ld9 0 2024-09-13T22:09:05.627 INFO:tasks.workunit.client.1.smithi159.stdout:5/646: chown d1/l13 490551 1 2024-09-13T22:09:05.628 INFO:tasks.workunit.client.1.smithi159.stdout:5/647: write d1/d11/d50/f62 [124816,46577] 0 2024-09-13T22:09:05.631 INFO:tasks.workunit.client.1.smithi159.stdout:5/648: symlink d1/d11/d64/lda 0 2024-09-13T22:09:05.632 INFO:tasks.workunit.client.1.smithi159.stdout:7/648: mknod d3/d2e/d6e/d74/dba/cd3 0 2024-09-13T22:09:05.633 INFO:tasks.workunit.client.1.smithi159.stdout:8/821: sync 2024-09-13T22:09:05.633 INFO:tasks.workunit.client.1.smithi159.stdout:8/822: fdatasync da/d7e/d82/dd8/de7/fea 0 2024-09-13T22:09:05.633 INFO:tasks.workunit.client.1.smithi159.stdout:8/823: read da/d22/d33/f98 [2416436,108766] 0 2024-09-13T22:09:05.633 INFO:tasks.workunit.client.1.smithi159.stdout:8/824: chown da/d22/d2a/d39/l71 25871140 1 2024-09-13T22:09:05.634 INFO:tasks.workunit.client.1.smithi159.stdout:7/649: symlink d3/d2e/ld4 0 2024-09-13T22:09:05.637 INFO:tasks.workunit.client.1.smithi159.stdout:4/820: sync 2024-09-13T22:09:05.637 INFO:tasks.workunit.client.1.smithi159.stdout:4/821: chown d13/d15/d26/d29/d3b/d66/f111 64848888 1 2024-09-13T22:09:05.638 INFO:tasks.workunit.client.1.smithi159.stdout:3/474: dwrite d0/d1/d15/f5e [0,4194304] 0 2024-09-13T22:09:05.638 INFO:tasks.workunit.client.1.smithi159.stdout:3/475: stat d0/d1/d3/d5/d25/d75/d5b 0 2024-09-13T22:09:05.638 INFO:tasks.workunit.client.1.smithi159.stdout:3/476: fsync d0/d1/d34/d73/f77 0 2024-09-13T22:09:05.641 INFO:tasks.workunit.client.1.smithi159.stdout:8/825: rename da/d36/d48/d9e/fcf to da/d7e/d82/d6f/f117 0 2024-09-13T22:09:05.643 INFO:tasks.workunit.client.1.smithi159.stdout:4/822: link d13/d15/d5a/c84 d13/d41/c129 0 2024-09-13T22:09:05.649 INFO:tasks.workunit.client.1.smithi159.stdout:9/597: dwrite d1/d9/d1f/d99/f9d [4194304,4194304] 0 2024-09-13T22:09:05.650 INFO:tasks.workunit.client.1.smithi159.stdout:5/649: dwrite d1/d11/d1c/fae [0,4194304] 0 2024-09-13T22:09:05.651 INFO:tasks.workunit.client.1.smithi159.stdout:3/477: mknod d0/d1/d3/d5/d25/d75/d5b/d45/c95 0 2024-09-13T22:09:05.651 INFO:tasks.workunit.client.1.smithi159.stdout:3/478: creat d0/d1/d3/dd/f96 x:0 0 0 2024-09-13T22:09:05.651 INFO:tasks.workunit.client.1.smithi159.stdout:3/479: chown d0/d68 16368783 1 2024-09-13T22:09:05.655 INFO:tasks.workunit.client.1.smithi159.stdout:5/650: dread d1/d11/d1c/dd2/f88 [0,4194304] 0 2024-09-13T22:09:05.662 INFO:tasks.workunit.client.1.smithi159.stdout:3/480: dread d0/d1/d34/f79 [0,4194304] 0 2024-09-13T22:09:05.662 INFO:tasks.workunit.client.1.smithi159.stdout:3/481: fdatasync d0/d1/d3/d5/db/d39/f3f 0 2024-09-13T22:09:05.663 INFO:tasks.workunit.client.1.smithi159.stdout:5/651: dread d1/d11/d64/d35/d6f/f7f [0,4194304] 0 2024-09-13T22:09:05.665 INFO:tasks.workunit.client.1.smithi159.stdout:7/650: rename d3/d18/l55 to d3/d2e/db6/d6c/db2/dbc/ld5 0 2024-09-13T22:09:05.668 INFO:tasks.workunit.client.1.smithi159.stdout:8/826: truncate da/d22/f27 383756 0 2024-09-13T22:09:05.670 INFO:tasks.workunit.client.1.smithi159.stdout:5/652: dread d1/d11/d64/d82/d8f/fbe [0,4194304] 0 2024-09-13T22:09:05.670 INFO:tasks.workunit.client.1.smithi159.stdout:5/653: fsync d1/d11/d64/d35/f57 0 2024-09-13T22:09:05.671 INFO:tasks.workunit.client.1.smithi159.stdout:4/823: symlink d13/d124/l12a 0 2024-09-13T22:09:05.680 INFO:tasks.workunit.client.1.smithi159.stdout:9/598: rename d1/dc/d10/fa3 to d1/dc/d27/fcf 0 2024-09-13T22:09:05.681 INFO:tasks.workunit.client.1.smithi159.stdout:7/651: mknod d3/d2e/db6/d6c/db2/cd6 0 2024-09-13T22:09:05.686 INFO:tasks.workunit.client.1.smithi159.stdout:3/482: rename d0/d1/d3/d5/db/d58/l6b to d0/d1/d3/d5/d25/d94/l97 0 2024-09-13T22:09:05.686 INFO:tasks.workunit.client.1.smithi159.stdout:3/483: fdatasync d0/d1/d3/d5/d25/d2c/d7f/f87 0 2024-09-13T22:09:05.688 INFO:tasks.workunit.client.1.smithi159.stdout:9/599: creat d1/dc/d27/da4/fd0 x:0 0 0 2024-09-13T22:09:05.689 INFO:tasks.workunit.client.1.smithi159.stdout:5/654: truncate d1/d11/d9e/fa7 1961480 0 2024-09-13T22:09:05.690 INFO:tasks.workunit.client.1.smithi159.stdout:5/655: write d1/d11/d64/d82/d8c/faa [32570,111688] 0 2024-09-13T22:09:05.693 INFO:tasks.workunit.client.1.smithi159.stdout:8/827: rename da/f88 to da/d7e/d82/d6f/d9a/f118 0 2024-09-13T22:09:05.693 INFO:tasks.workunit.client.1.smithi159.stdout:8/828: creat da/d5d/dbc/f119 x:0 0 0 2024-09-13T22:09:05.693 INFO:tasks.workunit.client.1.smithi159.stdout:8/829: chown da/d5d/d70/f7b 1780822086 1 2024-09-13T22:09:05.694 INFO:tasks.workunit.client.1.smithi159.stdout:4/824: getdents d13/d124 0 2024-09-13T22:09:05.696 INFO:tasks.workunit.client.1.smithi159.stdout:9/600: truncate d1/dc/d10/d6d/d2f/f37 1071535 0 2024-09-13T22:09:05.696 INFO:tasks.workunit.client.1.smithi159.stdout:9/601: chown d1/dc/d10/d6d/d4b/f76 8400 1 2024-09-13T22:09:05.696 INFO:tasks.workunit.client.1.smithi159.stdout:9/602: chown d1/dc/d10/d6d/d4b/dcb/d74/d7d 39057 1 2024-09-13T22:09:05.697 INFO:tasks.workunit.client.1.smithi159.stdout:5/656: symlink d1/d11/d50/ldb 0 2024-09-13T22:09:05.700 INFO:tasks.workunit.client.1.smithi159.stdout:9/603: write d1/f48 [87964,117263] 0 2024-09-13T22:09:05.700 INFO:tasks.workunit.client.1.smithi159.stdout:7/652: rename d3/d2e/db6/d6c/db2/dbc/ld5 to d3/d2e/ld7 0 2024-09-13T22:09:05.704 INFO:tasks.workunit.client.1.smithi159.stdout:8/830: unlink da/d7e/d82/d83/lf4 0 2024-09-13T22:09:05.705 INFO:tasks.workunit.client.1.smithi159.stdout:8/831: read da/d22/d33/fba [4013649,118796] 0 2024-09-13T22:09:05.713 INFO:tasks.workunit.client.1.smithi159.stdout:7/653: dread d3/d2e/db6/f58 [0,4194304] 0 2024-09-13T22:09:05.713 INFO:tasks.workunit.client.1.smithi159.stdout:7/654: fdatasync d3/d3f/fad 0 2024-09-13T22:09:05.713 INFO:tasks.workunit.client.1.smithi159.stdout:7/655: chown d3/d2e/db6/d6c/db2/dbc 0 1 2024-09-13T22:09:05.713 INFO:tasks.workunit.client.1.smithi159.stdout:9/604: getdents d1/dc/d10/d6d/d4b/dcb/d75 0 2024-09-13T22:09:05.713 INFO:tasks.workunit.client.1.smithi159.stdout:9/605: readlink d1/d9/d1f/l44 0 2024-09-13T22:09:05.713 INFO:tasks.workunit.client.1.smithi159.stdout:8/832: unlink da/d36/d48/d9e/fb5 0 2024-09-13T22:09:05.713 INFO:tasks.workunit.client.1.smithi159.stdout:8/833: write da/d7e/d82/d6f/d9a/fed [742843,75181] 0 2024-09-13T22:09:05.713 INFO:tasks.workunit.client.1.smithi159.stdout:7/656: getdents d3/d2e/d6e/db9 0 2024-09-13T22:09:05.721 INFO:tasks.workunit.client.1.smithi159.stdout:5/657: dwrite d1/d11/d50/fbd [0,4194304] 0 2024-09-13T22:09:05.721 INFO:tasks.workunit.client.1.smithi159.stdout:5/658: read - d1/d11/d64/d82/d8c/fd3 zero size 2024-09-13T22:09:05.724 INFO:tasks.workunit.client.1.smithi159.stdout:9/606: dread d1/dc/d10/d6d/d4b/f9e [0,4194304] 0 2024-09-13T22:09:05.724 INFO:tasks.workunit.client.1.smithi159.stdout:9/607: chown d1/dc/d10/d69/f79 2013510 1 2024-09-13T22:09:05.724 INFO:tasks.workunit.client.1.smithi159.stdout:9/608: write d1/f48 [604873,97357] 0 2024-09-13T22:09:05.730 INFO:tasks.workunit.client.1.smithi159.stdout:8/834: dread da/d22/f4f [0,4194304] 0 2024-09-13T22:09:05.732 INFO:tasks.workunit.client.1.smithi159.stdout:9/609: read d1/dc/f12 [5560374,44976] 0 2024-09-13T22:09:05.732 INFO:tasks.workunit.client.1.smithi159.stdout:9/610: readlink d1/d9/d1f/l44 0 2024-09-13T22:09:05.740 INFO:tasks.workunit.client.1.smithi159.stdout:7/657: dwrite d3/d3f/fb1 [0,4194304] 0 2024-09-13T22:09:05.741 INFO:tasks.workunit.client.1.smithi159.stdout:7/658: chown d3/c17 11 1 2024-09-13T22:09:05.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:05 smithi089 ceph-mon[27921]: pgmap v264: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 128 MiB/s rd, 158 MiB/s wr, 329 op/s 2024-09-13T22:09:05.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:05 smithi159 ceph-mon[35348]: pgmap v264: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 128 MiB/s rd, 158 MiB/s wr, 329 op/s 2024-09-13T22:09:05.765 INFO:tasks.workunit.client.1.smithi159.stdout:7/659: dwrite d3/d2e/d6e/d74/dba/d5e/fa2 [0,4194304] 0 2024-09-13T22:09:05.781 INFO:tasks.workunit.client.1.smithi159.stdout:7/660: dwrite d3/f62 [0,4194304] 0 2024-09-13T22:09:05.781 INFO:tasks.workunit.client.1.smithi159.stdout:7/661: fsync d3/d3f/f8f 0 2024-09-13T22:09:05.810 INFO:tasks.workunit.client.1.smithi159.stdout:9/611: symlink d1/dc/d27/da4/db5/ld1 0 2024-09-13T22:09:05.815 INFO:tasks.workunit.client.1.smithi159.stdout:5/659: write d1/d11/d64/d35/f4c [1065589,81173] 0 2024-09-13T22:09:05.818 INFO:tasks.workunit.client.1.smithi159.stdout:9/612: dread d1/dc/d10/fae [0,4194304] 0 2024-09-13T22:09:05.818 INFO:tasks.workunit.client.1.smithi159.stdout:9/613: fsync d1/dc/d10/d6d/d2f/fb7 0 2024-09-13T22:09:05.819 INFO:tasks.workunit.client.1.smithi159.stdout:7/662: mkdir d3/d31/dd8 0 2024-09-13T22:09:05.827 INFO:tasks.workunit.client.1.smithi159.stdout:9/614: creat d1/dc/d10/d6d/d4b/dcb/d75/fd2 x:0 0 0 2024-09-13T22:09:05.828 INFO:tasks.workunit.client.1.smithi159.stdout:9/615: stat d1/dc/d10/d6d/d4b/fbf 0 2024-09-13T22:09:05.830 INFO:tasks.workunit.client.1.smithi159.stdout:7/663: link d3/d2e/d6e/c79 d3/d31/d4d/d9e/dbe/cd9 0 2024-09-13T22:09:05.830 INFO:tasks.workunit.client.1.smithi159.stdout:7/664: stat d3/d2e/c41 0 2024-09-13T22:09:05.832 INFO:tasks.workunit.client.1.smithi159.stdout:8/835: rename da/d7e/l92 to da/d36/d48/l11a 0 2024-09-13T22:09:05.833 INFO:tasks.workunit.client.1.smithi159.stdout:8/836: chown da/d22/d4a 353 1 2024-09-13T22:09:05.835 INFO:tasks.workunit.client.1.smithi159.stdout:9/616: mkdir d1/dc/d10/d6d/d2f/dd3 0 2024-09-13T22:09:05.835 INFO:tasks.workunit.client.1.smithi159.stdout:9/617: stat d1/dc/d27/d40/c54 0 2024-09-13T22:09:05.835 INFO:tasks.workunit.client.1.smithi159.stdout:9/618: read - d1/dc/f9a zero size 2024-09-13T22:09:05.836 INFO:tasks.workunit.client.1.smithi159.stdout:8/837: mkdir da/d7e/db2/d11b 0 2024-09-13T22:09:05.836 INFO:tasks.workunit.client.1.smithi159.stdout:8/838: dread - da/d22/d2a/da1/ffe zero size 2024-09-13T22:09:05.836 INFO:tasks.workunit.client.1.smithi159.stdout:8/839: write da/d36/f79 [1243126,77281] 0 2024-09-13T22:09:05.838 INFO:tasks.workunit.client.1.smithi159.stdout:8/840: rename da/d5d/d70 to da/d5d/d70/d8e/dc1/dce/d11c 22 2024-09-13T22:09:05.838 INFO:tasks.workunit.client.1.smithi159.stdout:8/841: dread - da/d22/d33/ff8 zero size 2024-09-13T22:09:05.839 INFO:tasks.workunit.client.1.smithi159.stdout:8/842: rmdir da/d22/d33/d66 39 2024-09-13T22:09:05.842 INFO:tasks.workunit.client.1.smithi159.stdout:8/843: creat da/d22/d2a/da1/f11d x:0 0 0 2024-09-13T22:09:05.842 INFO:tasks.workunit.client.1.smithi159.stdout:7/665: write d3/d18/f7c [563985,40333] 0 2024-09-13T22:09:05.845 INFO:tasks.workunit.client.1.smithi159.stdout:7/666: creat d3/d2e/db6/d6c/db2/dce/fda x:0 0 0 2024-09-13T22:09:05.845 INFO:tasks.workunit.client.1.smithi159.stdout:7/667: creat d3/d31/fdb x:0 0 0 2024-09-13T22:09:05.847 INFO:tasks.workunit.client.1.smithi159.stdout:7/668: creat d3/d31/d4d/d9e/fdc x:0 0 0 2024-09-13T22:09:05.847 INFO:tasks.workunit.client.1.smithi159.stdout:7/669: read d3/d31/d4d/d9e/f71 [773327,6297] 0 2024-09-13T22:09:05.848 INFO:tasks.workunit.client.1.smithi159.stdout:7/670: rename d3/d2e/f35 to d3/dab/dcc/fdd 0 2024-09-13T22:09:05.849 INFO:tasks.workunit.client.1.smithi159.stdout:8/844: dread da/da0/de9/f10e [0,4194304] 0 2024-09-13T22:09:05.849 INFO:tasks.workunit.client.1.smithi159.stdout:8/845: fdatasync da/d5d/dbc/ff9 0 2024-09-13T22:09:05.852 INFO:tasks.workunit.client.1.smithi159.stdout:5/660: dwrite d1/d11/d64/d35/f73 [4194304,4194304] 0 2024-09-13T22:09:05.852 INFO:tasks.workunit.client.1.smithi159.stdout:5/661: write d1/f2 [10147917,102818] 0 2024-09-13T22:09:05.852 INFO:tasks.workunit.client.1.smithi159.stdout:5/662: write d1/d11/f71 [1188793,25441] 0 2024-09-13T22:09:05.852 INFO:tasks.workunit.client.1.smithi159.stdout:8/846: unlink da/d36/d48/le6 0 2024-09-13T22:09:05.852 INFO:tasks.workunit.client.1.smithi159.stdout:8/847: creat da/d5d/d70/d8e/dc1/dce/f11e x:0 0 0 2024-09-13T22:09:05.858 INFO:tasks.workunit.client.1.smithi159.stdout:8/848: mkdir da/d22/d4a/dcc/d11f 0 2024-09-13T22:09:05.861 INFO:tasks.workunit.client.1.smithi159.stdout:8/849: read da/d22/d4a/f7c [1339800,73865] 0 2024-09-13T22:09:05.861 INFO:tasks.workunit.client.1.smithi159.stdout:8/850: creat da/da0/f120 x:0 0 0 2024-09-13T22:09:05.861 INFO:tasks.workunit.client.1.smithi159.stdout:8/851: creat da/d22/d2a/da1/f121 x:0 0 0 2024-09-13T22:09:05.861 INFO:tasks.workunit.client.1.smithi159.stdout:8/852: readlink da/d7e/ld0 0 2024-09-13T22:09:05.861 INFO:tasks.workunit.client.1.smithi159.stdout:8/853: truncate da/d22/d2a/da1/ffe 485169 0 2024-09-13T22:09:05.862 INFO:tasks.workunit.client.1.smithi159.stdout:9/619: dwrite d1/f48 [0,4194304] 0 2024-09-13T22:09:05.865 INFO:tasks.workunit.client.1.smithi159.stdout:5/663: write d1/d11/d64/d82/d8f/f4f [4081618,23254] 0 2024-09-13T22:09:05.866 INFO:tasks.workunit.client.1.smithi159.stdout:8/854: dread da/d7e/db2/f111 [0,4194304] 0 2024-09-13T22:09:05.867 INFO:tasks.workunit.client.1.smithi159.stdout:9/620: creat d1/dc/d10/d6d/d87/fd4 x:0 0 0 2024-09-13T22:09:05.870 INFO:tasks.workunit.client.1.smithi159.stdout:8/855: truncate da/d36/d48/f67 1043231 0 2024-09-13T22:09:05.870 INFO:tasks.workunit.client.1.smithi159.stdout:8/856: chown da/d22/d33/d8f/fc5 1916 1 2024-09-13T22:09:05.871 INFO:tasks.workunit.client.1.smithi159.stdout:8/857: dread da/d36/d57/f74 [0,4194304] 0 2024-09-13T22:09:05.871 INFO:tasks.workunit.client.1.smithi159.stdout:8/858: truncate da/d22/d2a/da1/f121 535826 0 2024-09-13T22:09:05.872 INFO:tasks.workunit.client.1.smithi159.stdout:8/859: creat da/d22/d2a/d39/f122 x:0 0 0 2024-09-13T22:09:05.873 INFO:tasks.workunit.client.1.smithi159.stdout:8/860: getdents da/d36 0 2024-09-13T22:09:05.876 INFO:tasks.workunit.client.1.smithi159.stdout:8/861: mkdir da/d22/db3/db9/d123 0 2024-09-13T22:09:05.876 INFO:tasks.workunit.client.1.smithi159.stdout:8/862: chown da/d7e/d82/d6f/d9a/dd5/c102 1509 1 2024-09-13T22:09:05.878 INFO:tasks.workunit.client.1.smithi159.stdout:5/664: write d1/f2 [1901624,33730] 0 2024-09-13T22:09:05.878 INFO:tasks.workunit.client.1.smithi159.stdout:5/665: chown d1/d11/d64/d35/d6f 50240 1 2024-09-13T22:09:05.879 INFO:tasks.workunit.client.1.smithi159.stdout:8/863: rename da/d22/f81 to da/da0/f124 0 2024-09-13T22:09:05.879 INFO:tasks.workunit.client.1.smithi159.stdout:7/671: dwrite d3/d18/f7c [0,4194304] 0 2024-09-13T22:09:05.881 INFO:tasks.workunit.client.1.smithi159.stdout:5/666: truncate d1/d11/d1c/fae 3046079 0 2024-09-13T22:09:05.882 INFO:tasks.workunit.client.1.smithi159.stdout:2/422: sync 2024-09-13T22:09:05.882 INFO:tasks.workunit.client.1.smithi159.stdout:0/742: sync 2024-09-13T22:09:05.882 INFO:tasks.workunit.client.1.smithi159.stdout:2/423: dread - d9/d65/d40/d69/f74 zero size 2024-09-13T22:09:05.883 INFO:tasks.workunit.client.1.smithi159.stdout:9/621: dread d1/f53 [0,4194304] 0 2024-09-13T22:09:05.884 INFO:tasks.workunit.client.1.smithi159.stdout:8/864: mknod da/d22/d33/d66/dd3/c125 0 2024-09-13T22:09:05.885 INFO:tasks.workunit.client.1.smithi159.stdout:8/865: write da/d5d/d70/f7b [936237,130937] 0 2024-09-13T22:09:05.899 INFO:tasks.workunit.client.1.smithi159.stdout:7/672: mknod d3/d3f/cde 0 2024-09-13T22:09:05.899 INFO:tasks.workunit.client.1.smithi159.stdout:5/667: creat d1/d11/d1c/dd2/d44/d85/fdc x:0 0 0 2024-09-13T22:09:05.903 INFO:tasks.workunit.client.1.smithi159.stdout:0/743: mkdir d0/d2c/d71/dc3/df8 0 2024-09-13T22:09:05.903 INFO:tasks.workunit.client.1.smithi159.stdout:0/744: chown d0/d48/dd9/de8/cf3 1 1 2024-09-13T22:09:05.903 INFO:tasks.workunit.client.1.smithi159.stdout:0/745: read d0/d2c/fd2 [2152847,84150] 0 2024-09-13T22:09:05.904 INFO:tasks.workunit.client.1.smithi159.stdout:9/622: mknod d1/dc/d10/d6d/d4b/dcb/d75/cd5 0 2024-09-13T22:09:05.909 INFO:tasks.workunit.client.1.smithi159.stdout:8/866: rename da/d22/d33/d66/dd3 to da/d22/d26/d126 0 2024-09-13T22:09:05.909 INFO:tasks.workunit.client.1.smithi159.stdout:2/424: dwrite d9/f5e [0,4194304] 0 2024-09-13T22:09:05.911 INFO:tasks.workunit.client.1.smithi159.stdout:4/825: sync 2024-09-13T22:09:05.911 INFO:tasks.workunit.client.1.smithi159.stdout:3/484: sync 2024-09-13T22:09:05.911 INFO:tasks.workunit.client.1.smithi159.stdout:6/579: sync 2024-09-13T22:09:05.911 INFO:tasks.workunit.client.1.smithi159.stdout:1/702: sync 2024-09-13T22:09:05.912 INFO:tasks.workunit.client.1.smithi159.stdout:1/703: fdatasync dd/d11/fb2 0 2024-09-13T22:09:05.919 INFO:tasks.workunit.client.1.smithi159.stdout:2/425: mkdir d9/da/d25/d91 0 2024-09-13T22:09:05.923 INFO:tasks.workunit.client.1.smithi159.stdout:8/867: write da/d5d/dbc/fec [1384148,53425] 0 2024-09-13T22:09:05.923 INFO:tasks.workunit.client.1.smithi159.stdout:6/580: stat d3/da/d25/d69/c75 0 2024-09-13T22:09:05.923 INFO:tasks.workunit.client.1.smithi159.stdout:8/868: write da/d7e/d82/dd8/de7/fea [624047,126437] 0 2024-09-13T22:09:05.925 INFO:tasks.workunit.client.1.smithi159.stdout:4/826: getdents d13/d15/d26/d29/d3b/de1/d118 0 2024-09-13T22:09:05.926 INFO:tasks.workunit.client.1.smithi159.stdout:2/426: rmdir d9/da/d25 39 2024-09-13T22:09:05.926 INFO:tasks.workunit.client.1.smithi159.stdout:2/427: dread - d9/d65/d40/f80 zero size 2024-09-13T22:09:05.927 INFO:tasks.workunit.client.1.smithi159.stdout:5/668: dwrite d1/d11/d9e/fa7 [0,4194304] 0 2024-09-13T22:09:05.927 INFO:tasks.workunit.client.1.smithi159.stdout:5/669: chown d1/d11/d64/d35/d60 115134 1 2024-09-13T22:09:05.928 INFO:tasks.workunit.client.1.smithi159.stdout:7/673: rename d3/d3f/c6a to d3/d2e/d6e/d74/dba/cdf 0 2024-09-13T22:09:05.930 INFO:tasks.workunit.client.1.smithi159.stdout:6/581: mkdir d3/d2a/db5 0 2024-09-13T22:09:05.931 INFO:tasks.workunit.client.1.smithi159.stdout:0/746: dwrite d0/d48/d4f/d54/d74/f7a [0,4194304] 0 2024-09-13T22:09:05.931 INFO:tasks.workunit.client.1.smithi159.stdout:0/747: dread - d0/d48/d4f/d54/d74/dbe/fcb zero size 2024-09-13T22:09:05.931 INFO:tasks.workunit.client.1.smithi159.stdout:0/748: write d0/f26 [1382310,6759] 0 2024-09-13T22:09:05.932 INFO:tasks.workunit.client.1.smithi159.stdout:0/749: stat d0/d2c/c63 0 2024-09-13T22:09:05.936 INFO:tasks.workunit.client.1.smithi159.stdout:1/704: dwrite dd/d1e/d58/d8a/dbb/fab [0,4194304] 0 2024-09-13T22:09:05.936 INFO:tasks.workunit.client.1.smithi159.stdout:8/869: creat da/d36/d48/f127 x:0 0 0 2024-09-13T22:09:05.937 INFO:tasks.workunit.client.1.smithi159.stdout:3/485: getdents d0/d1/d3 0 2024-09-13T22:09:05.938 INFO:tasks.workunit.client.1.smithi159.stdout:1/705: read dd/d11/f24 [3743403,43424] 0 2024-09-13T22:09:05.945 INFO:tasks.workunit.client.1.smithi159.stdout:0/750: mkdir d0/d48/d4f/d2b/da3/df9 0 2024-09-13T22:09:05.950 INFO:tasks.workunit.client.1.smithi159.stdout:8/870: mkdir da/d7e/d82/d83/d103/d128 0 2024-09-13T22:09:05.951 INFO:tasks.workunit.client.1.smithi159.stdout:4/827: dwrite d13/d15/d26/d29/d3b/d66/d6c/f97 [0,4194304] 0 2024-09-13T22:09:05.951 INFO:tasks.workunit.client.1.smithi159.stdout:4/828: truncate d13/d41/d79/db2/f11e 494931 0 2024-09-13T22:09:05.951 INFO:tasks.workunit.client.1.smithi159.stdout:4/829: write d13/d15/d5a/fae [878755,36927] 0 2024-09-13T22:09:05.960 INFO:tasks.workunit.client.1.smithi159.stdout:2/428: dwrite d9/d37/f72 [0,4194304] 0 2024-09-13T22:09:05.960 INFO:tasks.workunit.client.1.smithi159.stdout:3/486: unlink d0/d1/d3/dd/f96 0 2024-09-13T22:09:05.960 INFO:tasks.workunit.client.1.smithi159.stdout:3/487: readlink d0/d1/d3/d5/d25/d4e/d5a/l37 0 2024-09-13T22:09:05.960 INFO:tasks.workunit.client.1.smithi159.stdout:3/488: stat d0/d1/d3/dd/l66 0 2024-09-13T22:09:05.961 INFO:tasks.workunit.client.1.smithi159.stdout:7/674: dwrite d3/d31/fd1 [0,4194304] 0 2024-09-13T22:09:05.961 INFO:tasks.workunit.client.1.smithi159.stdout:1/706: creat dd/d1e/d58/d8a/dbb/d3c/d95/fe2 x:0 0 0 2024-09-13T22:09:05.962 INFO:tasks.workunit.client.1.smithi159.stdout:7/675: dread d3/fb7 [0,4194304] 0 2024-09-13T22:09:05.963 INFO:tasks.workunit.client.1.smithi159.stdout:7/676: creat d3/d2e/fe0 x:0 0 0 2024-09-13T22:09:05.963 INFO:tasks.workunit.client.1.smithi159.stdout:7/677: stat d3/d31/d4d/d4e/f52 0 2024-09-13T22:09:05.963 INFO:tasks.workunit.client.1.smithi159.stdout:5/670: dwrite d1/d11/d64/d35/fb1 [0,4194304] 0 2024-09-13T22:09:05.964 INFO:tasks.workunit.client.1.smithi159.stdout:6/582: getdents d3/da/d25/d69 0 2024-09-13T22:09:05.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/751: symlink d0/d48/dd9/de8/lfa 0 2024-09-13T22:09:05.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/752: creat d0/d48/d7d/ffb x:0 0 0 2024-09-13T22:09:05.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/753: creat d0/d48/d7d/ffc x:0 0 0 2024-09-13T22:09:05.968 INFO:tasks.workunit.client.1.smithi159.stdout:0/754: write d0/d2c/d71/f99 [1388603,91826] 0 2024-09-13T22:09:05.970 INFO:tasks.workunit.client.1.smithi159.stdout:8/871: chown da/l1f 12617 1 2024-09-13T22:09:05.972 INFO:tasks.workunit.client.1.smithi159.stdout:8/872: dread da/d7e/db2/f111 [0,4194304] 0 2024-09-13T22:09:05.977 INFO:tasks.workunit.client.1.smithi159.stdout:4/830: symlink d13/d15/d26/d29/d3b/d66/l12b 0 2024-09-13T22:09:05.980 INFO:tasks.workunit.client.1.smithi159.stdout:3/489: unlink d0/d1/d3/dd/f10 0 2024-09-13T22:09:05.986 INFO:tasks.workunit.client.1.smithi159.stdout:6/583: dwrite d3/da/d29/d26/d6c/f76 [4194304,4194304] 0 2024-09-13T22:09:05.986 INFO:tasks.workunit.client.1.smithi159.stdout:7/678: dwrite d3/d31/d4d/d4e/d7a/f9b [0,4194304] 0 2024-09-13T22:09:05.997 INFO:tasks.workunit.client.1.smithi159.stdout:7/679: dread d3/d3f/fb1 [0,4194304] 0 2024-09-13T22:09:05.997 INFO:tasks.workunit.client.1.smithi159.stdout:7/680: stat d3/d2e/d6e/fb5 0 2024-09-13T22:09:06.000 INFO:tasks.workunit.client.1.smithi159.stdout:6/584: dwrite d3/da/d29/d26/d6c/d6e/f85 [0,4194304] 0 2024-09-13T22:09:06.000 INFO:tasks.workunit.client.1.smithi159.stdout:6/585: write d3/da/d29/d26/d6c/d6e/f95 [1045410,123481] 0 2024-09-13T22:09:06.051 INFO:tasks.workunit.client.1.smithi159.stdout:1/707: truncate dd/d1c/f86 1531957 0 2024-09-13T22:09:06.066 INFO:tasks.workunit.client.1.smithi159.stdout:1/708: dwrite dd/d1e/d58/d8a/dbb/d3c/fbd [0,4194304] 0 2024-09-13T22:09:06.067 INFO:tasks.workunit.client.1.smithi159.stdout:5/671: symlink d1/d11/d64/d82/d8f/ldd 0 2024-09-13T22:09:06.071 INFO:tasks.workunit.client.1.smithi159.stdout:0/755: stat d0/d5e/c1b 0 2024-09-13T22:09:06.071 INFO:tasks.workunit.client.1.smithi159.stdout:0/756: write d0/d2c/d71/f99 [1874038,66605] 0 2024-09-13T22:09:06.072 INFO:tasks.workunit.client.1.smithi159.stdout:8/873: rename da/d36/d48/d9e/cff to da/d7e/d82/dd8/de7/c129 0 2024-09-13T22:09:06.073 INFO:tasks.workunit.client.1.smithi159.stdout:2/429: mkdir d9/d92 0 2024-09-13T22:09:06.073 INFO:tasks.workunit.client.1.smithi159.stdout:2/430: readlink d9/d65/d40/l49 0 2024-09-13T22:09:06.073 INFO:tasks.workunit.client.1.smithi159.stdout:2/431: stat d9/d48/d77 0 2024-09-13T22:09:06.081 INFO:tasks.workunit.client.1.smithi159.stdout:6/586: symlink d3/d64/lb6 0 2024-09-13T22:09:06.082 INFO:tasks.workunit.client.1.smithi159.stdout:6/587: write d3/da/d25/d52/fb2 [4763784,123619] 0 2024-09-13T22:09:06.084 INFO:tasks.workunit.client.1.smithi159.stdout:1/709: unlink dd/d11/d21/f6f 0 2024-09-13T22:09:06.084 INFO:tasks.workunit.client.1.smithi159.stdout:1/710: write dd/fc5 [660585,105759] 0 2024-09-13T22:09:06.085 INFO:tasks.workunit.client.1.smithi159.stdout:5/672: symlink d1/lde 0 2024-09-13T22:09:06.086 INFO:tasks.workunit.client.1.smithi159.stdout:5/673: chown d1/d11/d64/d17/l3c 4149 1 2024-09-13T22:09:06.086 INFO:tasks.workunit.client.1.smithi159.stdout:5/674: truncate d1/d11/d1c/dd2/d44/d89/f93 833287 0 2024-09-13T22:09:06.087 INFO:tasks.workunit.client.1.smithi159.stdout:0/757: mknod d0/d5e/d91/cfd 0 2024-09-13T22:09:06.088 INFO:tasks.workunit.client.1.smithi159.stdout:8/874: dwrite da/d7e/d82/dd8/fda [0,4194304] 0 2024-09-13T22:09:06.091 INFO:tasks.workunit.client.1.smithi159.stdout:4/831: rename d13/d41/d4d/fc4 to d13/d15/d26/d51/d65/d67/d82/f12c 0 2024-09-13T22:09:06.091 INFO:tasks.workunit.client.1.smithi159.stdout:4/832: chown d13/d41/d79/fad 2048 1 2024-09-13T22:09:06.094 INFO:tasks.workunit.client.1.smithi159.stdout:2/432: link d9/d44/f61 d9/da/d82/f93 0 2024-09-13T22:09:06.094 INFO:tasks.workunit.client.1.smithi159.stdout:2/433: read d9/d2d/f78 [200861,67518] 0 2024-09-13T22:09:06.095 INFO:tasks.workunit.client.1.smithi159.stdout:2/434: dread d9/da/f7d [0,4194304] 0 2024-09-13T22:09:06.095 INFO:tasks.workunit.client.1.smithi159.stdout:2/435: dread - d9/d44/f46 zero size 2024-09-13T22:09:06.096 INFO:tasks.workunit.client.1.smithi159.stdout:1/711: read dd/d11/d13/f5c [2028835,34321] 0 2024-09-13T22:09:06.098 INFO:tasks.workunit.client.1.smithi159.stdout:5/675: creat d1/d11/d64/d35/d7c/fdf x:0 0 0 2024-09-13T22:09:06.098 INFO:tasks.workunit.client.1.smithi159.stdout:1/712: dread dd/d11/d18/d49/d2d/d97/f93 [0,4194304] 0 2024-09-13T22:09:06.099 INFO:tasks.workunit.client.1.smithi159.stdout:0/758: mkdir d0/dfe 0 2024-09-13T22:09:06.100 INFO:tasks.workunit.client.1.smithi159.stdout:0/759: chown d0/d5e/fb5 17315738 1 2024-09-13T22:09:06.104 INFO:tasks.workunit.client.1.smithi159.stdout:0/760: write d0/d48/fd1 [166600,124634] 0 2024-09-13T22:09:06.104 INFO:tasks.workunit.client.1.smithi159.stdout:0/761: write d0/d48/d4f/f7b [417788,9569] 0 2024-09-13T22:09:06.105 INFO:tasks.workunit.client.1.smithi159.stdout:8/875: mkdir da/d22/d2a/d39/d12a 0 2024-09-13T22:09:06.107 INFO:tasks.workunit.client.1.smithi159.stdout:1/713: read dd/d1e/d58/d8a/dbb/d3c/fbd [1078834,56885] 0 2024-09-13T22:09:06.107 INFO:tasks.workunit.client.1.smithi159.stdout:1/714: dread - dd/d1e/d58/d8a/dbb/f65 zero size 2024-09-13T22:09:06.107 INFO:tasks.workunit.client.1.smithi159.stdout:1/715: write dd/fc5 [801758,90392] 0 2024-09-13T22:09:06.109 INFO:tasks.workunit.client.1.smithi159.stdout:7/681: rename d3/d2e/d6e/d74/dba/cd3 to d3/dab/dcc/ce1 0 2024-09-13T22:09:06.111 INFO:tasks.workunit.client.1.smithi159.stdout:4/833: getdents d13/d41/d4d/d75 0 2024-09-13T22:09:06.116 INFO:tasks.workunit.client.1.smithi159.stdout:2/436: link d9/d44/f8a d9/da/d5a/f94 0 2024-09-13T22:09:06.121 INFO:tasks.workunit.client.1.smithi159.stdout:4/834: write d13/d15/f21 [1037852,116936] 0 2024-09-13T22:09:06.123 INFO:tasks.workunit.client.1.smithi159.stdout:5/676: dwrite d1/d11/d64/d82/d8c/faa [0,4194304] 0 2024-09-13T22:09:06.123 INFO:tasks.workunit.client.1.smithi159.stdout:5/677: creat d1/d11/d64/d35/d7c/fe0 x:0 0 0 2024-09-13T22:09:06.123 INFO:tasks.workunit.client.1.smithi159.stdout:5/678: creat d1/d11/d64/d35/d7c/fe1 x:0 0 0 2024-09-13T22:09:06.123 INFO:tasks.workunit.client.1.smithi159.stdout:6/588: getdents d3/da/d29/d1a/d3e/d5a 0 2024-09-13T22:09:06.127 INFO:tasks.workunit.client.1.smithi159.stdout:1/716: dwrite dd/d1c/f26 [8388608,4194304] 0 2024-09-13T22:09:06.128 INFO:tasks.workunit.client.1.smithi159.stdout:8/876: symlink da/d7e/d82/d6f/d9a/de4/l12b 0 2024-09-13T22:09:06.137 INFO:tasks.workunit.client.1.smithi159.stdout:5/679: rename d1/l6 to d1/d11/d1c/d32/le2 0 2024-09-13T22:09:06.143 INFO:tasks.workunit.client.1.smithi159.stdout:4/835: dwrite d13/d41/f42 [4194304,4194304] 0 2024-09-13T22:09:06.143 INFO:tasks.workunit.client.1.smithi159.stdout:1/717: dwrite dd/d11/d21/f42 [0,4194304] 0 2024-09-13T22:09:06.143 INFO:tasks.workunit.client.1.smithi159.stdout:1/718: chown dd/d11/cdd 38924393 1 2024-09-13T22:09:06.144 INFO:tasks.workunit.client.1.smithi159.stdout:0/762: rmdir d0/d2c 39 2024-09-13T22:09:06.150 INFO:tasks.workunit.client.1.smithi159.stdout:8/877: link da/d22/d2a/d39/d3e/f8d da/d7e/d82/dd8/f12c 0 2024-09-13T22:09:06.150 INFO:tasks.workunit.client.1.smithi159.stdout:2/437: getdents d9/d65/d40/d69 0 2024-09-13T22:09:06.152 INFO:tasks.workunit.client.1.smithi159.stdout:5/680: readlink d1/d11/d64/d35/la2 0 2024-09-13T22:09:06.152 INFO:tasks.workunit.client.1.smithi159.stdout:5/681: chown d1/d11/d1c/dd2/d53/ccc 258 1 2024-09-13T22:09:06.152 INFO:tasks.workunit.client.1.smithi159.stdout:6/589: rmdir d3/d2a/d3c/d5c 39 2024-09-13T22:09:06.154 INFO:tasks.workunit.client.1.smithi159.stdout:4/836: symlink d13/d15/d26/d29/d3b/daf/l12d 0 2024-09-13T22:09:06.157 INFO:tasks.workunit.client.1.smithi159.stdout:1/719: rename dd/d11/f87 to dd/d1e/d58/d8a/fe3 0 2024-09-13T22:09:06.157 INFO:tasks.workunit.client.1.smithi159.stdout:8/878: dread da/d22/d33/fba [0,4194304] 0 2024-09-13T22:09:06.158 INFO:tasks.workunit.client.1.smithi159.stdout:1/720: dread dd/d1e/f22 [0,4194304] 0 2024-09-13T22:09:06.158 INFO:tasks.workunit.client.1.smithi159.stdout:1/721: fdatasync dd/d1e/d58/d8a/dbb/fab 0 2024-09-13T22:09:06.160 INFO:tasks.workunit.client.1.smithi159.stdout:0/763: mkdir d0/d48/d4f/daf/dd4/dff 0 2024-09-13T22:09:06.160 INFO:tasks.workunit.client.1.smithi159.stdout:0/764: chown d0/d5e/c1b 1900 1 2024-09-13T22:09:06.162 INFO:tasks.workunit.client.1.smithi159.stdout:4/837: dread d13/d15/d26/f33 [0,4194304] 0 2024-09-13T22:09:06.162 INFO:tasks.workunit.client.1.smithi159.stdout:4/838: chown d13/d41/d79/l7d 7098 1 2024-09-13T22:09:06.163 INFO:tasks.workunit.client.1.smithi159.stdout:4/839: chown d13/d15/fa7 149299 1 2024-09-13T22:09:06.163 INFO:tasks.workunit.client.1.smithi159.stdout:5/682: unlink d1/d11/d64/d35/d7c/d7d/f8e 0 2024-09-13T22:09:06.164 INFO:tasks.workunit.client.1.smithi159.stdout:6/590: getdents d3/da/d25 0 2024-09-13T22:09:06.164 INFO:tasks.workunit.client.1.smithi159.stdout:5/683: dread d1/d11/d1c/dd2/fac [0,4194304] 0 2024-09-13T22:09:06.165 INFO:tasks.workunit.client.1.smithi159.stdout:5/684: chown d1/d11/d9e/cc7 14423327 1 2024-09-13T22:09:06.165 INFO:tasks.workunit.client.1.smithi159.stdout:5/685: chown d1/d11/d9e/f78 872082267 1 2024-09-13T22:09:06.166 INFO:tasks.workunit.client.1.smithi159.stdout:0/765: mkdir d0/d48/d4f/d2b/da3/df9/d100 0 2024-09-13T22:09:06.167 INFO:tasks.workunit.client.1.smithi159.stdout:2/438: rmdir d9/d48 39 2024-09-13T22:09:06.167 INFO:tasks.workunit.client.1.smithi159.stdout:2/439: chown d9/da/d25/f34 32022 1 2024-09-13T22:09:06.168 INFO:tasks.workunit.client.1.smithi159.stdout:5/686: mknod d1/d11/d1c/d32/ce3 0 2024-09-13T22:09:06.168 INFO:tasks.workunit.client.1.smithi159.stdout:5/687: stat d1/d11 0 2024-09-13T22:09:06.169 INFO:tasks.workunit.client.1.smithi159.stdout:0/766: dread d0/d48/dd9/de8/f9b [0,4194304] 0 2024-09-13T22:09:06.169 INFO:tasks.workunit.client.1.smithi159.stdout:0/767: chown d0/d48/d4f/d2b/f60 0 1 2024-09-13T22:09:06.169 INFO:tasks.workunit.client.1.smithi159.stdout:0/768: dread - d0/d48/d7d/ffb zero size 2024-09-13T22:09:06.169 INFO:tasks.workunit.client.1.smithi159.stdout:1/722: dread dd/d11/d18/d49/fb6 [0,4194304] 0 2024-09-13T22:09:06.170 INFO:tasks.workunit.client.1.smithi159.stdout:8/879: link da/ce da/d7e/db2/d11b/c12d 0 2024-09-13T22:09:06.172 INFO:tasks.workunit.client.1.smithi159.stdout:2/440: creat d9/d92/f95 x:0 0 0 2024-09-13T22:09:06.172 INFO:tasks.workunit.client.1.smithi159.stdout:2/441: dread - d9/d37/f5b zero size 2024-09-13T22:09:06.176 INFO:tasks.workunit.client.1.smithi159.stdout:0/769: rename d0/d2c/l4a to d0/d2c/d71/l101 0 2024-09-13T22:09:06.176 INFO:tasks.workunit.client.1.smithi159.stdout:0/770: creat d0/d48/d4f/d66/f102 x:0 0 0 2024-09-13T22:09:06.176 INFO:tasks.workunit.client.1.smithi159.stdout:0/771: chown d0/d48/d7d/fba 3462150 1 2024-09-13T22:09:06.180 INFO:tasks.workunit.client.1.smithi159.stdout:8/880: unlink da/d22/d4a/cdc 0 2024-09-13T22:09:06.180 INFO:tasks.workunit.client.1.smithi159.stdout:8/881: write da/d22/f34 [941232,127874] 0 2024-09-13T22:09:06.181 INFO:tasks.workunit.client.1.smithi159.stdout:2/442: truncate f5 4990929 0 2024-09-13T22:09:06.185 INFO:tasks.workunit.client.1.smithi159.stdout:1/723: dwrite dd/d1e/d58/d8a/dbb/f33 [0,4194304] 0 2024-09-13T22:09:06.189 INFO:tasks.workunit.client.1.smithi159.stdout:0/772: mkdir d0/d48/d4f/d2b/d103 0 2024-09-13T22:09:06.189 INFO:tasks.workunit.client.1.smithi159.stdout:8/882: rmdir da/d7e/d82/dd8/de7 39 2024-09-13T22:09:06.192 INFO:tasks.workunit.client.1.smithi159.stdout:1/724: rename dd/d11/d34/c91 to dd/d11/d18/d74/ce4 0 2024-09-13T22:09:06.192 INFO:tasks.workunit.client.1.smithi159.stdout:1/725: truncate dd/d11/d18/d74/d82/d9a/fbe 590505 0 2024-09-13T22:09:06.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/773: mkdir d0/d48/d4f/daf/d104 0 2024-09-13T22:09:06.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/774: stat d0/d48/d4f 0 2024-09-13T22:09:06.194 INFO:tasks.workunit.client.1.smithi159.stdout:8/883: truncate da/d22/db3/db9/fca 3806717 0 2024-09-13T22:09:06.195 INFO:tasks.workunit.client.1.smithi159.stdout:1/726: truncate dd/d1e/d58/d5f/fda 3005501 0 2024-09-13T22:09:06.197 INFO:tasks.workunit.client.1.smithi159.stdout:1/727: symlink dd/d11/d18/le5 0 2024-09-13T22:09:06.198 INFO:tasks.workunit.client.1.smithi159.stdout:8/884: rename da/ce to da/c12e 0 2024-09-13T22:09:06.200 INFO:tasks.workunit.client.1.smithi159.stdout:2/443: dwrite d9/da/f7d [0,4194304] 0 2024-09-13T22:09:06.200 INFO:tasks.workunit.client.1.smithi159.stdout:1/728: rmdir dd/d11/d18/d49/d2d/d62 39 2024-09-13T22:09:06.203 INFO:tasks.workunit.client.1.smithi159.stdout:0/775: dread d0/d48/d4f/f53 [0,4194304] 0 2024-09-13T22:09:06.204 INFO:tasks.workunit.client.1.smithi159.stdout:2/444: unlink d9/da/d82/f88 0 2024-09-13T22:09:06.206 INFO:tasks.workunit.client.1.smithi159.stdout:1/729: rename dd/d11/d13/d4b/l89 to dd/d11/d18/d49/d2d/d62/le6 0 2024-09-13T22:09:06.209 INFO:tasks.workunit.client.1.smithi159.stdout:0/776: write d0/d48/d4f/f53 [73014,34789] 0 2024-09-13T22:09:06.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/730: creat dd/d11/d34/da8/fe7 x:0 0 0 2024-09-13T22:09:06.211 INFO:tasks.workunit.client.1.smithi159.stdout:1/731: fdatasync dd/d11/d34/da8/fe7 0 2024-09-13T22:09:06.223 INFO:tasks.workunit.client.1.smithi159.stdout:2/445: dwrite d9/f6b [0,4194304] 0 2024-09-13T22:09:06.229 INFO:tasks.workunit.client.1.smithi159.stdout:2/446: rmdir d9/d37 39 2024-09-13T22:09:06.230 INFO:tasks.workunit.client.1.smithi159.stdout:2/447: getdents d9/da/d25 0 2024-09-13T22:09:06.230 INFO:tasks.workunit.client.1.smithi159.stdout:2/448: read - d9/da/f4d zero size 2024-09-13T22:09:06.232 INFO:tasks.workunit.client.1.smithi159.stdout:2/449: mkdir d9/d48/d77/d96 0 2024-09-13T22:09:06.234 INFO:tasks.workunit.client.1.smithi159.stdout:2/450: symlink d9/d2d/l97 0 2024-09-13T22:09:06.238 INFO:tasks.workunit.client.1.smithi159.stdout:2/451: unlink d9/d65/d40/d69/c68 0 2024-09-13T22:09:06.239 INFO:tasks.workunit.client.1.smithi159.stdout:2/452: truncate d9/da/f4d 301988 0 2024-09-13T22:09:06.239 INFO:tasks.workunit.client.1.smithi159.stdout:0/777: dwrite d0/d2c/fde [0,4194304] 0 2024-09-13T22:09:06.239 INFO:tasks.workunit.client.1.smithi159.stdout:1/732: dwrite dd/d1e/d58/d8a/dbb/d3c/fbd [4194304,4194304] 0 2024-09-13T22:09:06.241 INFO:tasks.workunit.client.1.smithi159.stdout:1/733: read dd/d1e/d58/d8a/fe3 [519839,64057] 0 2024-09-13T22:09:06.246 INFO:tasks.workunit.client.1.smithi159.stdout:2/453: symlink d9/l98 0 2024-09-13T22:09:06.247 INFO:tasks.workunit.client.1.smithi159.stdout:1/734: dread dd/d11/d18/d49/d2d/d97/f6e [0,4194304] 0 2024-09-13T22:09:06.247 INFO:tasks.workunit.client.1.smithi159.stdout:9/623: sync 2024-09-13T22:09:06.255 INFO:tasks.workunit.client.1.smithi159.stdout:1/735: rename dd/d11/d13/d4b/d52/d63/dc2 to dd/d11/d18/d49/d2d/d62/d7d/de8 0 2024-09-13T22:09:06.256 INFO:tasks.workunit.client.1.smithi159.stdout:1/736: chown dd/d1e/d58/d8a/dbb/l35 0 1 2024-09-13T22:09:06.256 INFO:tasks.workunit.client.1.smithi159.stdout:1/737: readlink dd/d11/d13/d4b/l6b 0 2024-09-13T22:09:06.258 INFO:tasks.workunit.client.1.smithi159.stdout:1/738: creat dd/d11/d18/d74/fe9 x:0 0 0 2024-09-13T22:09:06.258 INFO:tasks.workunit.client.1.smithi159.stdout:1/739: chown dd/d11/d18/d74/ce4 0 1 2024-09-13T22:09:06.260 INFO:tasks.workunit.client.1.smithi159.stdout:5/688: rmdir d1/d11/d64 39 2024-09-13T22:09:06.263 INFO:tasks.workunit.client.1.smithi159.stdout:5/689: symlink d1/d11/d50/le4 0 2024-09-13T22:09:06.265 INFO:tasks.workunit.client.1.smithi159.stdout:0/778: dwrite d0/d48/dd9/de8/fad [0,4194304] 0 2024-09-13T22:09:06.268 INFO:tasks.workunit.client.1.smithi159.stdout:1/740: dread dd/fc5 [0,4194304] 0 2024-09-13T22:09:06.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/741: truncate dd/d11/d34/da8/fe7 254645 0 2024-09-13T22:09:06.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/742: chown dd/d11/d13/d4b/d52 73 1 2024-09-13T22:09:06.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/743: creat dd/d11/d21/fea x:0 0 0 2024-09-13T22:09:06.277 INFO:tasks.workunit.client.1.smithi159.stdout:0/779: getdents d0/d48/d7d 0 2024-09-13T22:09:06.287 INFO:tasks.workunit.client.1.smithi159.stdout:2/454: truncate d9/da/f7d 304321 0 2024-09-13T22:09:06.287 INFO:tasks.workunit.client.1.smithi159.stdout:2/455: write d9/d48/f7e [386288,37106] 0 2024-09-13T22:09:06.296 INFO:tasks.workunit.client.1.smithi159.stdout:2/456: dread d9/f31 [0,4194304] 0 2024-09-13T22:09:06.297 INFO:tasks.workunit.client.1.smithi159.stdout:2/457: creat d9/d48/f99 x:0 0 0 2024-09-13T22:09:06.298 INFO:tasks.workunit.client.1.smithi159.stdout:2/458: mknod d9/da/c9a 0 2024-09-13T22:09:06.303 INFO:tasks.workunit.client.1.smithi159.stdout:1/744: dwrite dd/d11/d18/d49/d2d/d62/f75 [0,4194304] 0 2024-09-13T22:09:06.303 INFO:tasks.workunit.client.1.smithi159.stdout:1/745: truncate dd/d11/d13/d4b/fc4 101917 0 2024-09-13T22:09:06.304 INFO:tasks.workunit.client.1.smithi159.stdout:5/690: dwrite d1/d11/d9e/f31 [0,4194304] 0 2024-09-13T22:09:06.304 INFO:tasks.workunit.client.1.smithi159.stdout:5/691: creat d1/d11/d50/fe5 x:0 0 0 2024-09-13T22:09:06.305 INFO:tasks.workunit.client.1.smithi159.stdout:0/780: dwrite d0/d2c/d96/da1/fec [0,4194304] 0 2024-09-13T22:09:06.393 INFO:tasks.workunit.client.1.smithi159.stdout:1/746: mknod dd/d1e/d58/da7/de1/ceb 0 2024-09-13T22:09:06.393 INFO:tasks.workunit.client.1.smithi159.stdout:1/747: chown dd/d11/d13/c55 1 1 2024-09-13T22:09:06.393 INFO:tasks.workunit.client.1.smithi159.stdout:1/748: chown dd/d11/d18/d49/d2d/d97/f70 224 1 2024-09-13T22:09:06.395 INFO:tasks.workunit.client.1.smithi159.stdout:1/749: write dd/d11/d18/d49/d2d/d97/f93 [272608,20141] 0 2024-09-13T22:09:06.395 INFO:tasks.workunit.client.1.smithi159.stdout:1/750: creat dd/d11/d18/d74/d82/d9a/fec x:0 0 0 2024-09-13T22:09:06.395 INFO:tasks.workunit.client.1.smithi159.stdout:1/751: write f7 [2292949,60374] 0 2024-09-13T22:09:06.395 INFO:tasks.workunit.client.1.smithi159.stdout:1/752: dread - dd/d11/d18/d49/f8f zero size 2024-09-13T22:09:06.403 INFO:tasks.workunit.client.1.smithi159.stdout:5/692: rmdir d1/d11/d1c/dd2/d44/d89/dcb 39 2024-09-13T22:09:06.403 INFO:tasks.workunit.client.1.smithi159.stdout:5/693: stat d1/d11 0 2024-09-13T22:09:06.410 INFO:tasks.workunit.client.1.smithi159.stdout:0/781: mknod d0/d2c/c105 0 2024-09-13T22:09:06.413 INFO:tasks.workunit.client.1.smithi159.stdout:1/753: mkdir dd/d1e/d58/da7/de1/ded 0 2024-09-13T22:09:06.414 INFO:tasks.workunit.client.1.smithi159.stdout:0/782: creat d0/d2c/d71/dc3/f106 x:0 0 0 2024-09-13T22:09:06.414 INFO:tasks.workunit.client.1.smithi159.stdout:1/754: dread dd/d11/d34/da8/fe7 [0,4194304] 0 2024-09-13T22:09:06.418 INFO:tasks.workunit.client.1.smithi159.stdout:1/755: creat dd/d11/d13/fee x:0 0 0 2024-09-13T22:09:06.420 INFO:tasks.workunit.client.1.smithi159.stdout:1/756: mkdir dd/d11/d18/d74/def 0 2024-09-13T22:09:06.420 INFO:tasks.workunit.client.1.smithi159.stdout:1/757: fsync dd/d11/f40 0 2024-09-13T22:09:06.423 INFO:tasks.workunit.client.1.smithi159.stdout:1/758: link dd/d11/d18/d49/fb6 dd/d1e/d58/da7/de1/ff0 0 2024-09-13T22:09:06.424 INFO:tasks.workunit.client.1.smithi159.stdout:5/694: dwrite d1/d11/d64/f3f [0,4194304] 0 2024-09-13T22:09:06.426 INFO:tasks.workunit.client.1.smithi159.stdout:3/490: sync 2024-09-13T22:09:06.430 INFO:tasks.workunit.client.1.smithi159.stdout:1/759: dread dd/d11/d13/d4b/d52/f94 [0,4194304] 0 2024-09-13T22:09:06.434 INFO:tasks.workunit.client.1.smithi159.stdout:3/491: mknod d0/d1/d3/d5/d25/d75/d5b/c98 0 2024-09-13T22:09:06.434 INFO:tasks.workunit.client.1.smithi159.stdout:3/492: creat d0/d1/d15/f99 x:0 0 0 2024-09-13T22:09:06.434 INFO:tasks.workunit.client.1.smithi159.stdout:3/493: fdatasync d0/d1/d3/d5/f88 0 2024-09-13T22:09:06.435 INFO:tasks.workunit.client.1.smithi159.stdout:1/760: getdents dd/d1e/d58/da7 0 2024-09-13T22:09:06.435 INFO:tasks.workunit.client.1.smithi159.stdout:1/761: write dd/d11/d18/d49/d2d/d62/f75 [4989706,39644] 0 2024-09-13T22:09:06.436 INFO:tasks.workunit.client.1.smithi159.stdout:5/695: rmdir d1/d11/d9e/d7b 39 2024-09-13T22:09:06.436 INFO:tasks.workunit.client.1.smithi159.stdout:5/696: write d1/d11/d64/d35/d60/f80 [485157,103162] 0 2024-09-13T22:09:06.441 INFO:tasks.workunit.client.1.smithi159.stdout:1/762: mknod dd/d1e/d58/cf1 0 2024-09-13T22:09:06.441 INFO:tasks.workunit.client.1.smithi159.stdout:1/763: readlink dd/d11/d18/d49/d2d/d97/lca 0 2024-09-13T22:09:06.444 INFO:tasks.workunit.client.1.smithi159.stdout:1/764: symlink dd/d11/d13/d4b/lf2 0 2024-09-13T22:09:06.461 INFO:tasks.workunit.client.1.smithi159.stdout:5/697: dwrite d1/d11/d64/d35/d60/fa3 [0,4194304] 0 2024-09-13T22:09:06.461 INFO:tasks.workunit.client.1.smithi159.stdout:5/698: creat d1/d11/d9e/fe6 x:0 0 0 2024-09-13T22:09:06.464 INFO:tasks.workunit.client.1.smithi159.stdout:5/699: unlink d1/d11/d50/faf 0 2024-09-13T22:09:06.471 INFO:tasks.workunit.client.1.smithi159.stdout:1/765: dwrite dd/d1e/d58/d8a/dbb/fd2 [0,4194304] 0 2024-09-13T22:09:06.471 INFO:tasks.workunit.client.1.smithi159.stdout:1/766: chown dd/d1e/d58 14 1 2024-09-13T22:09:06.471 INFO:tasks.workunit.client.1.smithi159.stdout:3/494: dwrite d0/d1/d3/d5/f17 [8388608,4194304] 0 2024-09-13T22:09:06.474 INFO:tasks.workunit.client.1.smithi159.stdout:3/495: creat d0/d1/d3/d5/d25/d2c/f9a x:0 0 0 2024-09-13T22:09:06.477 INFO:tasks.workunit.client.1.smithi159.stdout:1/767: getdents dd/d11 0 2024-09-13T22:09:06.478 INFO:tasks.workunit.client.1.smithi159.stdout:1/768: chown dd/d1e 0 1 2024-09-13T22:09:06.479 INFO:tasks.workunit.client.1.smithi159.stdout:3/496: mkdir d0/d1/d3/d5/d25/d4e/d5a/d9b 0 2024-09-13T22:09:06.479 INFO:tasks.workunit.client.1.smithi159.stdout:3/497: fsync d0/d1/d3/f82 0 2024-09-13T22:09:06.480 INFO:tasks.workunit.client.1.smithi159.stdout:1/769: creat dd/d1e/d58/da7/de1/ded/ff3 x:0 0 0 2024-09-13T22:09:06.482 INFO:tasks.workunit.client.1.smithi159.stdout:3/498: mknod d0/c9c 0 2024-09-13T22:09:06.482 INFO:tasks.workunit.client.1.smithi159.stdout:3/499: truncate d0/d1/d3/dd/f20 4654171 0 2024-09-13T22:09:06.482 INFO:tasks.workunit.client.1.smithi159.stdout:3/500: dread - d0/d1/d3/d5/d25/d2c/f9a zero size 2024-09-13T22:09:06.489 INFO:tasks.workunit.client.1.smithi159.stdout:1/770: write dd/d11/d18/d49/d2d/d62/d7d/de8/dc6/fde [1549837,117906] 0 2024-09-13T22:09:06.493 INFO:tasks.workunit.client.1.smithi159.stdout:3/501: dread d0/d68/f7b [0,4194304] 0 2024-09-13T22:09:06.493 INFO:tasks.workunit.client.1.smithi159.stdout:3/502: fsync d0/d1/d3/d5/d25/d75/d5b/d45/f51 0 2024-09-13T22:09:06.494 INFO:tasks.workunit.client.1.smithi159.stdout:3/503: symlink d0/d91/l9d 0 2024-09-13T22:09:06.494 INFO:tasks.workunit.client.1.smithi159.stdout:3/504: creat d0/d1/d15/f9e x:0 0 0 2024-09-13T22:09:06.495 INFO:tasks.workunit.client.1.smithi159.stdout:3/505: mkdir d0/d1/d3/d5/d25/d4e/d9f 0 2024-09-13T22:09:06.496 INFO:tasks.workunit.client.1.smithi159.stdout:1/771: dread dd/d1e/d58/d8a/dbb/fab [0,4194304] 0 2024-09-13T22:09:06.497 INFO:tasks.workunit.client.1.smithi159.stdout:3/506: rename d0/d1/d3/d5/db/d39/l76 to d0/d1/d3/d5/d25/d4e/d9f/la0 0 2024-09-13T22:09:06.498 INFO:tasks.workunit.client.1.smithi159.stdout:1/772: creat dd/d11/d18/d74/d82/d9a/de0/ff4 x:0 0 0 2024-09-13T22:09:06.499 INFO:tasks.workunit.client.1.smithi159.stdout:3/507: symlink d0/d1/d3/la1 0 2024-09-13T22:09:06.500 INFO:tasks.workunit.client.1.smithi159.stdout:1/773: mkdir dd/d1e/d58/d8a/dbb/d3c/d95/df5 0 2024-09-13T22:09:06.502 INFO:tasks.workunit.client.1.smithi159.stdout:3/508: mkdir d0/d1/d81/da2 0 2024-09-13T22:09:06.502 INFO:tasks.workunit.client.1.smithi159.stdout:3/509: chown d0/d1/d3/d5/d25/d94 44 1 2024-09-13T22:09:06.503 INFO:tasks.workunit.client.1.smithi159.stdout:3/510: rename d0/d1/d3/d5/d25/f6f to d0/d1/d3/d5/d25/d2c/d71/d8f/fa3 0 2024-09-13T22:09:06.504 INFO:tasks.workunit.client.1.smithi159.stdout:1/774: dread dd/d1e/d58/d8a/dbb/fab [0,4194304] 0 2024-09-13T22:09:06.505 INFO:tasks.workunit.client.1.smithi159.stdout:3/511: truncate d0/d1/d3/d5/d25/d2c/f33 1634408 0 2024-09-13T22:09:06.505 INFO:tasks.workunit.client.1.smithi159.stdout:3/512: chown d0/d1/d3/d5/l5f 38 1 2024-09-13T22:09:06.505 INFO:tasks.workunit.client.1.smithi159.stdout:3/513: write d0/d1/d3/d5/d25/d2c/f9a [288797,96265] 0 2024-09-13T22:09:06.506 INFO:tasks.workunit.client.1.smithi159.stdout:1/775: mkdir dd/d11/d18/d49/d2d/d62/d7d/df6 0 2024-09-13T22:09:06.506 INFO:tasks.workunit.client.1.smithi159.stdout:1/776: stat dd/d11/d21/f42 0 2024-09-13T22:09:06.511 INFO:tasks.workunit.client.1.smithi159.stdout:1/777: unlink dd/ce 0 2024-09-13T22:09:06.517 INFO:tasks.workunit.client.1.smithi159.stdout:1/778: dread dd/f16 [0,4194304] 0 2024-09-13T22:09:06.517 INFO:tasks.workunit.client.1.smithi159.stdout:1/779: write dd/d11/d18/d49/d2d/d97/f6e [1228780,82360] 0 2024-09-13T22:09:06.522 INFO:tasks.workunit.client.1.smithi159.stdout:1/780: getdents dd/d1e/d58/d8a/dbb 0 2024-09-13T22:09:06.522 INFO:tasks.workunit.client.1.smithi159.stdout:1/781: readlink dd/d11/d34/l4a 0 2024-09-13T22:09:06.523 INFO:tasks.workunit.client.1.smithi159.stdout:1/782: chown dd/d1e/d58/d8a/dbb/c39 918460 1 2024-09-13T22:09:06.524 INFO:tasks.workunit.client.1.smithi159.stdout:1/783: mknod dd/d1e/d58/d8a/dbb/d3c/d95/cf7 0 2024-09-13T22:09:06.590 INFO:tasks.workunit.client.1.smithi159.stdout:7/682: sync 2024-09-13T22:09:06.592 INFO:tasks.workunit.client.1.smithi159.stdout:7/683: mkdir d3/de2 0 2024-09-13T22:09:06.592 INFO:tasks.workunit.client.1.smithi159.stdout:7/684: write d3/d2e/db6/fa5 [322157,68285] 0 2024-09-13T22:09:06.592 INFO:tasks.workunit.client.1.smithi159.stdout:7/685: chown d3/d3f 13 1 2024-09-13T22:09:06.593 INFO:tasks.workunit.client.1.smithi159.stdout:7/686: mknod d3/d3f/ce3 0 2024-09-13T22:09:06.593 INFO:tasks.workunit.client.1.smithi159.stdout:7/687: dread - d3/d2e/d6e/d74/fd0 zero size 2024-09-13T22:09:06.593 INFO:tasks.workunit.client.1.smithi159.stdout:7/688: truncate d3/d2e/d6e/d74/fd0 1043216 0 2024-09-13T22:09:06.593 INFO:tasks.workunit.client.1.smithi159.stdout:7/689: creat d3/d31/d4d/d4e/d7a/fe4 x:0 0 0 2024-09-13T22:09:06.596 INFO:tasks.workunit.client.1.smithi159.stdout:7/690: creat d3/d31/d4d/d4e/fe5 x:0 0 0 2024-09-13T22:09:06.599 INFO:tasks.workunit.client.1.smithi159.stdout:7/691: rename d3/d2e/d6e/d74/dba/l4c to d3/d2e/d6e/db9/le6 0 2024-09-13T22:09:06.599 INFO:tasks.workunit.client.1.smithi159.stdout:7/692: chown d3/d2e/d6e/d74/lbb 2 1 2024-09-13T22:09:06.599 INFO:tasks.workunit.client.1.smithi159.stdout:7/693: creat d3/d31/d4d/d9e/fe7 x:0 0 0 2024-09-13T22:09:06.602 INFO:tasks.workunit.client.1.smithi159.stdout:4/840: sync 2024-09-13T22:09:06.619 INFO:tasks.workunit.client.1.smithi159.stdout:4/841: dwrite d13/d15/d26/d51/f123 [0,4194304] 0 2024-09-13T22:09:06.622 INFO:tasks.workunit.client.1.smithi159.stdout:4/842: rename d13/d15/d26/f106 to d13/d15/d26/d51/d65/f12e 0 2024-09-13T22:09:06.623 INFO:tasks.workunit.client.1.smithi159.stdout:4/843: rmdir d13/d15 39 2024-09-13T22:09:06.625 INFO:tasks.workunit.client.1.smithi159.stdout:4/844: rmdir d13/d15/d26/d29/d3b/d66/d6c/d125 0 2024-09-13T22:09:06.626 INFO:tasks.workunit.client.1.smithi159.stdout:4/845: truncate d13/d15/f17 1530635 0 2024-09-13T22:09:06.626 INFO:tasks.workunit.client.1.smithi159.stdout:4/846: creat d13/d15/d26/d51/f12f x:0 0 0 2024-09-13T22:09:06.629 INFO:tasks.workunit.client.1.smithi159.stdout:4/847: creat d13/d11f/f130 x:0 0 0 2024-09-13T22:09:06.631 INFO:tasks.workunit.client.1.smithi159.stdout:4/848: chown d13/c1a 2 1 2024-09-13T22:09:06.631 INFO:tasks.workunit.client.1.smithi159.stdout:4/849: read - d13/d15/d26/d51/d65/d67/d82/fee zero size 2024-09-13T22:09:06.631 INFO:tasks.workunit.client.1.smithi159.stdout:4/850: fdatasync f8 0 2024-09-13T22:09:06.633 INFO:tasks.workunit.client.1.smithi159.stdout:4/851: creat d13/d15/d26/d29/d3b/de1/d115/f131 x:0 0 0 2024-09-13T22:09:06.641 INFO:tasks.workunit.client.1.smithi159.stdout:4/852: dread d13/f19 [0,4194304] 0 2024-09-13T22:09:06.809 INFO:tasks.workunit.client.1.smithi159.stdout:6/591: sync 2024-09-13T22:09:06.809 INFO:tasks.workunit.client.1.smithi159.stdout:6/592: mkdir d3/d2a/db7 0 2024-09-13T22:09:06.810 INFO:tasks.workunit.client.1.smithi159.stdout:6/593: mknod d3/da/d29/d1a/d3e/d5a/cb8 0 2024-09-13T22:09:06.819 INFO:tasks.workunit.client.1.smithi159.stdout:6/594: dread d3/da/d29/d1a/d3e/d5a/d6a/f9e [0,4194304] 0 2024-09-13T22:09:06.842 INFO:tasks.workunit.client.1.smithi159.stdout:6/595: getdents d3/da/d29/d26/d6c/d6e 0 2024-09-13T22:09:06.844 INFO:tasks.workunit.client.1.smithi159.stdout:6/596: creat d3/d2a/fb9 x:0 0 0 2024-09-13T22:09:06.844 INFO:tasks.workunit.client.1.smithi159.stdout:6/597: write d3/da/d29/d1a/da3/da5/fab [834025,8270] 0 2024-09-13T22:09:06.862 INFO:tasks.workunit.client.1.smithi159.stdout:6/598: dwrite d3/d2a/f57 [0,4194304] 0 2024-09-13T22:09:06.862 INFO:tasks.workunit.client.1.smithi159.stdout:6/599: write d3/da/d29/d1a/f2e [952823,8184] 0 2024-09-13T22:09:06.866 INFO:tasks.workunit.client.1.smithi159.stdout:6/600: creat d3/da/d29/d1a/d3e/d5a/fba x:0 0 0 2024-09-13T22:09:06.884 INFO:tasks.workunit.client.1.smithi159.stdout:6/601: dwrite d3/da/d25/d69/d96/f97 [0,4194304] 0 2024-09-13T22:09:06.942 INFO:tasks.workunit.client.1.smithi159.stdout:6/602: write d3/da/d29/d26/d6c/d6e/f83 [550587,90605] 0 2024-09-13T22:09:06.944 INFO:tasks.workunit.client.1.smithi159.stdout:6/603: mkdir d3/da/d29/d1a/d3e/d5a/dbb 0 2024-09-13T22:09:06.944 INFO:tasks.workunit.client.1.smithi159.stdout:6/604: dwrite d3/f35 [4194304,4194304] 0 2024-09-13T22:09:06.944 INFO:tasks.workunit.client.1.smithi159.stdout:6/605: rename d3/c4 to d3/d64/cbc 0 2024-09-13T22:09:06.944 INFO:tasks.workunit.client.1.smithi159.stdout:6/606: symlink d3/da/d29/d26/d6c/d6e/d89/lbd 0 2024-09-13T22:09:06.944 INFO:tasks.workunit.client.1.smithi159.stdout:6/607: creat d3/d2a/d3c/d46/d73/fbe x:0 0 0 2024-09-13T22:09:06.944 INFO:tasks.workunit.client.1.smithi159.stdout:6/608: dread d3/da/d29/f45 [0,4194304] 0 2024-09-13T22:09:06.944 INFO:tasks.workunit.client.1.smithi159.stdout:6/609: creat d3/da/d29/d1a/d3e/d5a/dbb/fbf x:0 0 0 2024-09-13T22:09:06.944 INFO:tasks.workunit.client.1.smithi159.stdout:6/610: fdatasync d3/da/d29/d1a/f2e 0 2024-09-13T22:09:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/611: rename d3/da/d25/d52/f72 to d3/da/d29/d1a/da3/da5/fc0 0 2024-09-13T22:09:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/612: dread d3/da/d29/d1a/f1c [0,4194304] 0 2024-09-13T22:09:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/613: stat d3/da/d29/d26/f37 0 2024-09-13T22:09:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/614: write d3/da/d25/d52/f99 [700694,8954] 0 2024-09-13T22:09:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/615: chown d3/da/d29/d26/d6c/d6e/d89/lbd 42474936 1 2024-09-13T22:09:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/616: rename d3/da/d29/d26/d6c/d6e/d89 to d3/d64/dc1 0 2024-09-13T22:09:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/617: write d3/da/d29/d26/d6c/d6e/f83 [140604,47933] 0 2024-09-13T22:09:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/618: truncate d3/da/d29/d1a/d3e/f55 421860 0 2024-09-13T22:09:06.945 INFO:tasks.workunit.client.1.smithi159.stdout:6/619: fsync d3/f35 0 2024-09-13T22:09:06.959 INFO:tasks.workunit.client.1.smithi159.stdout:6/620: dwrite d3/da/f4e [0,4194304] 0 2024-09-13T22:09:06.964 INFO:tasks.workunit.client.1.smithi159.stdout:6/621: mknod d3/da/cc2 0 2024-09-13T22:09:06.970 INFO:tasks.workunit.client.1.smithi159.stdout:6/622: dread d3/da/d29/d1a/da3/da5/fab [0,4194304] 0 2024-09-13T22:09:06.977 INFO:tasks.workunit.client.1.smithi159.stdout:6/623: write d3/da/d25/f5b [33132,11748] 0 2024-09-13T22:09:06.977 INFO:tasks.workunit.client.1.smithi159.stdout:6/624: fsync d3/da/d29/d1a/d3e/f43 0 2024-09-13T22:09:06.979 INFO:tasks.workunit.client.1.smithi159.stdout:6/625: creat d3/d2a/d3c/fc3 x:0 0 0 2024-09-13T22:09:06.979 INFO:tasks.workunit.client.1.smithi159.stdout:6/626: readlink d3/da/d29/l40 0 2024-09-13T22:09:06.979 INFO:tasks.workunit.client.1.smithi159.stdout:6/627: chown d3/da/d25/f41 12439 1 2024-09-13T22:09:06.979 INFO:tasks.workunit.client.1.smithi159.stdout:6/628: truncate d3/da/d29/d1a/f1c 4365219 0 2024-09-13T22:09:06.979 INFO:tasks.workunit.client.1.smithi159.stdout:6/629: write d3/d2a/fb9 [972636,16610] 0 2024-09-13T22:09:06.980 INFO:tasks.workunit.client.1.smithi159.stdout:6/630: link d3/d2a/d3c/d46/cad d3/da/d29/d1a/da3/cc4 0 2024-09-13T22:09:06.982 INFO:tasks.workunit.client.1.smithi159.stdout:6/631: rename d3/d2a/d9b/ca7 to d3/da/d29/cc5 0 2024-09-13T22:09:06.982 INFO:tasks.workunit.client.1.smithi159.stdout:6/632: chown d3/f35 3066293 1 2024-09-13T22:09:06.983 INFO:tasks.workunit.client.1.smithi159.stdout:6/633: creat d3/fc6 x:0 0 0 2024-09-13T22:09:06.992 INFO:tasks.workunit.client.1.smithi159.stdout:6/634: write d3/d2a/d3c/d46/f4c [6844372,4845] 0 2024-09-13T22:09:06.992 INFO:tasks.workunit.client.1.smithi159.stdout:6/635: chown d3/da/d29/d1a/f92 15093399 1 2024-09-13T22:09:06.993 INFO:tasks.workunit.client.1.smithi159.stdout:6/636: symlink d3/da/d25/d69/db3/lc7 0 2024-09-13T22:09:07.000 INFO:tasks.workunit.client.1.smithi159.stdout:6/637: write d3/da/f10 [4774380,126352] 0 2024-09-13T22:09:07.003 INFO:tasks.workunit.client.1.smithi159.stdout:6/638: creat d3/da/d29/d1a/fc8 x:0 0 0 2024-09-13T22:09:07.004 INFO:tasks.workunit.client.1.smithi159.stdout:6/639: symlink d3/da/d29/d26/d6c/d6e/da9/lc9 0 2024-09-13T22:09:07.005 INFO:tasks.workunit.client.1.smithi159.stdout:6/640: creat d3/da/d29/fca x:0 0 0 2024-09-13T22:09:07.005 INFO:tasks.workunit.client.1.smithi159.stdout:6/641: chown d3/d2a/d3c/fb0 111405 1 2024-09-13T22:09:07.007 INFO:tasks.workunit.client.1.smithi159.stdout:6/642: rmdir d3/da/d29/d1a/da3/da5 39 2024-09-13T22:09:07.009 INFO:tasks.workunit.client.1.smithi159.stdout:6/643: dread d3/da/d29/d1a/d3e/f55 [0,4194304] 0 2024-09-13T22:09:07.010 INFO:tasks.workunit.client.1.smithi159.stdout:6/644: truncate d3/d6d/f8a 1088321 0 2024-09-13T22:09:07.010 INFO:tasks.workunit.client.1.smithi159.stdout:6/645: stat d3/d2a/f57 0 2024-09-13T22:09:07.033 INFO:tasks.workunit.client.1.smithi159.stdout:6/646: dwrite d3/da/d29/d1a/f92 [0,4194304] 0 2024-09-13T22:09:07.053 INFO:tasks.workunit.client.1.smithi159.stdout:6/647: rmdir d3/d2a/d3c/d46/d73 39 2024-09-13T22:09:07.056 INFO:tasks.workunit.client.1.smithi159.stdout:6/648: write d3/da/d29/d1a/f94 [1476882,29134] 0 2024-09-13T22:09:07.060 INFO:tasks.workunit.client.1.smithi159.stdout:6/649: rmdir d3/d2a/d9b 39 2024-09-13T22:09:07.073 INFO:tasks.workunit.client.1.smithi159.stdout:6/650: write d3/d2a/f57 [2946246,34647] 0 2024-09-13T22:09:07.077 INFO:tasks.workunit.client.1.smithi159.stdout:6/651: unlink d3/da/d25/d52/f99 0 2024-09-13T22:09:07.079 INFO:tasks.workunit.client.1.smithi159.stdout:6/652: rename d3/da/d25/c39 to d3/da/d29/d1a/ccb 0 2024-09-13T22:09:07.080 INFO:tasks.workunit.client.1.smithi159.stdout:6/653: write d3/f35 [5952906,66152] 0 2024-09-13T22:09:07.080 INFO:tasks.workunit.client.1.smithi159.stdout:6/654: write d3/da/d29/d1a/d3e/f55 [315181,123307] 0 2024-09-13T22:09:07.083 INFO:tasks.workunit.client.1.smithi159.stdout:6/655: unlink d3/da/l19 0 2024-09-13T22:09:07.114 INFO:tasks.workunit.client.1.smithi159.stdout:6/656: dwrite d3/da/d29/d26/f4d [0,4194304] 0 2024-09-13T22:09:07.117 INFO:tasks.workunit.client.1.smithi159.stdout:6/657: creat d3/da/d25/d69/fcc x:0 0 0 2024-09-13T22:09:07.130 INFO:tasks.workunit.client.1.smithi159.stdout:6/658: write d3/da/f28 [240815,65046] 0 2024-09-13T22:09:07.131 INFO:tasks.workunit.client.1.smithi159.stdout:6/659: write d3/da/d29/d1a/da3/da5/fab [824972,19521] 0 2024-09-13T22:09:07.134 INFO:tasks.workunit.client.1.smithi159.stdout:6/660: mknod d3/da/d25/d52/ccd 0 2024-09-13T22:09:07.135 INFO:tasks.workunit.client.1.smithi159.stdout:6/661: write d3/da/d29/d1a/d3e/f55 [716687,25309] 0 2024-09-13T22:09:07.135 INFO:tasks.workunit.client.1.smithi159.stdout:6/662: write d3/d2a/d3c/d46/d73/f77 [88632,30327] 0 2024-09-13T22:09:07.136 INFO:tasks.workunit.client.1.smithi159.stdout:6/663: symlink d3/da/d25/d52/lce 0 2024-09-13T22:09:07.145 INFO:tasks.workunit.client.1.smithi159.stdout:6/664: rmdir d3/da 39 2024-09-13T22:09:07.145 INFO:tasks.workunit.client.1.smithi159.stdout:6/665: read d3/da/d29/d26/d6c/d6e/f95 [1074238,64480] 0 2024-09-13T22:09:07.151 INFO:tasks.workunit.client.1.smithi159.stdout:6/666: creat d3/d2a/d3c/d46/fcf x:0 0 0 2024-09-13T22:09:07.152 INFO:tasks.workunit.client.1.smithi159.stdout:6/667: symlink d3/d2a/d3c/d46/d73/ld0 0 2024-09-13T22:09:07.152 INFO:tasks.workunit.client.1.smithi159.stdout:6/668: chown d3/da/d29/d1a/d3e/l67 1025569 1 2024-09-13T22:09:07.154 INFO:tasks.workunit.client.1.smithi159.stdout:6/669: unlink d3/da/d29/d1a/d3e/l67 0 2024-09-13T22:09:07.154 INFO:tasks.workunit.client.1.smithi159.stdout:6/670: write d3/da/d25/d69/fcc [968904,119650] 0 2024-09-13T22:09:07.154 INFO:tasks.workunit.client.1.smithi159.stdout:6/671: write d3/d2a/d3c/d46/d73/f77 [1053369,119820] 0 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:7/694: sync 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:3/514: sync 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:8/885: sync 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:4/853: sync 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:0/783: sync 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:3/515: fdatasync d0/d1/f2 0 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:2/459: sync 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:5/700: sync 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:9/624: sync 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:1/784: sync 2024-09-13T22:09:07.171 INFO:tasks.workunit.client.1.smithi159.stdout:1/785: fsync dd/d11/d13/f8d 0 2024-09-13T22:09:07.172 INFO:tasks.workunit.client.1.smithi159.stdout:6/672: dwrite d3/da/d29/d1a/f62 [0,4194304] 0 2024-09-13T22:09:07.172 INFO:tasks.workunit.client.1.smithi159.stdout:5/701: dread d1/d11/d1c/dd2/d44/d89/f93 [0,4194304] 0 2024-09-13T22:09:07.172 INFO:tasks.workunit.client.1.smithi159.stdout:4/854: getdents d13/d15/d26/d51/d65 0 2024-09-13T22:09:07.172 INFO:tasks.workunit.client.1.smithi159.stdout:4/855: fdatasync d13/fec 0 2024-09-13T22:09:07.172 INFO:tasks.workunit.client.1.smithi159.stdout:4/856: stat d13/d41/d50 0 2024-09-13T22:09:07.174 INFO:tasks.workunit.client.1.smithi159.stdout:0/784: mknod d0/d48/d4f/d54/d74/dbe/c107 0 2024-09-13T22:09:07.176 INFO:tasks.workunit.client.1.smithi159.stdout:8/886: creat da/d22/d4a/dcc/f12f x:0 0 0 2024-09-13T22:09:07.178 INFO:tasks.workunit.client.1.smithi159.stdout:3/516: creat d0/d1/d3/d5/d25/d75/d5b/d45/d8c/fa4 x:0 0 0 2024-09-13T22:09:07.179 INFO:tasks.workunit.client.1.smithi159.stdout:3/517: write d0/d1/d3/d5/f88 [1564083,43768] 0 2024-09-13T22:09:07.183 INFO:tasks.workunit.client.1.smithi159.stdout:2/460: rename d9/da/f8f to d9/d48/d77/f9b 0 2024-09-13T22:09:07.186 INFO:tasks.workunit.client.1.smithi159.stdout:9/625: getdents d1/dc/d10/d6d/d4b/dcb/d74/d7d 0 2024-09-13T22:09:07.187 INFO:tasks.workunit.client.1.smithi159.stdout:3/518: dread d0/d1/d3/d5/db/f60 [0,4194304] 0 2024-09-13T22:09:07.187 INFO:tasks.workunit.client.1.smithi159.stdout:3/519: fsync d0/d1/d3/d5/d25/d4e/d5a/f67 0 2024-09-13T22:09:07.188 INFO:tasks.workunit.client.1.smithi159.stdout:1/786: mknod dd/d11/d18/d49/d2d/d62/d7d/df6/cf8 0 2024-09-13T22:09:07.190 INFO:tasks.workunit.client.1.smithi159.stdout:8/887: dwrite da/d36/d57/faf [0,4194304] 0 2024-09-13T22:09:07.190 INFO:tasks.workunit.client.1.smithi159.stdout:8/888: fsync da/d5d/dbc/f119 0 2024-09-13T22:09:07.190 INFO:tasks.workunit.client.1.smithi159.stdout:6/673: mknod d3/d2a/d3c/d5c/cd1 0 2024-09-13T22:09:07.191 INFO:tasks.workunit.client.1.smithi159.stdout:7/695: getdents d3 0 2024-09-13T22:09:07.191 INFO:tasks.workunit.client.1.smithi159.stdout:7/696: readlink d3/d2e/l6f 0 2024-09-13T22:09:07.193 INFO:tasks.workunit.client.1.smithi159.stdout:4/857: creat d13/d15/d26/d51/dc8/d107/f132 x:0 0 0 2024-09-13T22:09:07.194 INFO:tasks.workunit.client.1.smithi159.stdout:0/785: link d0/d48/d4f/fb d0/d2c/d71/dc3/df8/f108 0 2024-09-13T22:09:07.195 INFO:tasks.workunit.client.1.smithi159.stdout:0/786: stat d0/d48/d7d/fa0 0 2024-09-13T22:09:07.199 INFO:tasks.workunit.client.1.smithi159.stdout:2/461: rename d9/l59 to d9/d65/d40/d69/l9c 0 2024-09-13T22:09:07.202 INFO:tasks.workunit.client.1.smithi159.stdout:9/626: mknod d1/dc/d10/d6d/d2f/d8b/cd6 0 2024-09-13T22:09:07.203 INFO:tasks.workunit.client.1.smithi159.stdout:3/520: creat d0/d1/d3/fa5 x:0 0 0 2024-09-13T22:09:07.209 INFO:tasks.workunit.client.1.smithi159.stdout:2/462: dread d9/f31 [0,4194304] 0 2024-09-13T22:09:07.209 INFO:tasks.workunit.client.1.smithi159.stdout:2/463: fdatasync d9/f1d 0 2024-09-13T22:09:07.209 INFO:tasks.workunit.client.1.smithi159.stdout:8/889: dwrite da/d22/d2a/d39/d3e/f8d [0,4194304] 0 2024-09-13T22:09:07.209 INFO:tasks.workunit.client.1.smithi159.stdout:8/890: dread da/d22/d2a/da1/fb6 [0,4194304] 0 2024-09-13T22:09:07.210 INFO:tasks.workunit.client.1.smithi159.stdout:6/674: creat d3/da/d29/d26/d6c/fd2 x:0 0 0 2024-09-13T22:09:07.213 INFO:tasks.workunit.client.1.smithi159.stdout:8/891: dread da/d5d/dbc/ff9 [0,4194304] 0 2024-09-13T22:09:07.213 INFO:tasks.workunit.client.1.smithi159.stdout:8/892: write da/d22/d2a/d39/d3e/fcb [388725,772] 0 2024-09-13T22:09:07.213 INFO:tasks.workunit.client.1.smithi159.stdout:8/893: read - da/d5d/d70/d8e/de0/f10b zero size 2024-09-13T22:09:07.213 INFO:tasks.workunit.client.1.smithi159.stdout:7/697: mknod d3/d31/d4d/ce8 0 2024-09-13T22:09:07.216 INFO:tasks.workunit.client.1.smithi159.stdout:4/858: unlink d13/d15/d26/d29/f114 0 2024-09-13T22:09:07.218 INFO:tasks.workunit.client.1.smithi159.stdout:0/787: truncate d0/d48/d4f/f76 299169 0 2024-09-13T22:09:07.218 INFO:tasks.workunit.client.1.smithi159.stdout:0/788: chown d0/d48/d4f/f5d 115 1 2024-09-13T22:09:07.220 INFO:tasks.workunit.client.1.smithi159.stdout:1/787: rename dd/d1e/fd3 to dd/d11/d13/ff9 0 2024-09-13T22:09:07.223 INFO:tasks.workunit.client.1.smithi159.stdout:3/521: mknod d0/ca6 0 2024-09-13T22:09:07.223 INFO:tasks.workunit.client.1.smithi159.stdout:3/522: fdatasync d0/d1/d3/d5/d25/d2c/d65/f72 0 2024-09-13T22:09:07.223 INFO:tasks.workunit.client.1.smithi159.stdout:3/523: write d0/d1/d3/d5/d25/d2c/d65/f72 [1164307,106199] 0 2024-09-13T22:09:07.224 INFO:tasks.workunit.client.1.smithi159.stdout:4/859: write d13/d15/d26/f61 [4069283,70813] 0 2024-09-13T22:09:07.224 INFO:tasks.workunit.client.1.smithi159.stdout:2/464: rmdir d9/d48/d77/d96 0 2024-09-13T22:09:07.225 INFO:tasks.workunit.client.1.smithi159.stdout:6/675: truncate d3/da/f28 3493075 0 2024-09-13T22:09:07.227 INFO:tasks.workunit.client.1.smithi159.stdout:8/894: truncate da/d22/d2a/da1/ffe 161702 0 2024-09-13T22:09:07.230 INFO:tasks.workunit.client.1.smithi159.stdout:0/789: mknod d0/d48/dd9/c109 0 2024-09-13T22:09:07.232 INFO:tasks.workunit.client.1.smithi159.stdout:7/698: dwrite d3/d2e/d6e/d74/fca [0,4194304] 0 2024-09-13T22:09:07.232 INFO:tasks.workunit.client.1.smithi159.stdout:7/699: write d3/d31/d4d/d9e/fe7 [860685,45787] 0 2024-09-13T22:09:07.233 INFO:tasks.workunit.client.1.smithi159.stdout:9/627: rename d1/dc/d10/d6d/d4b/dcb/d74/d7d to d1/d9/dab/dd7 0 2024-09-13T22:09:07.234 INFO:tasks.workunit.client.1.smithi159.stdout:1/788: mkdir dd/d11/d18/d74/def/dfa 0 2024-09-13T22:09:07.237 INFO:tasks.workunit.client.1.smithi159.stdout:1/789: dread dd/d11/f83 [0,4194304] 0 2024-09-13T22:09:07.237 INFO:tasks.workunit.client.1.smithi159.stdout:3/524: mknod d0/d1/d3/d5/d25/d2c/ca7 0 2024-09-13T22:09:07.237 INFO:tasks.workunit.client.1.smithi159.stdout:1/790: truncate dd/d11/d18/d74/d82/d9a/fbe 945904 0 2024-09-13T22:09:07.239 INFO:tasks.workunit.client.1.smithi159.stdout:2/465: symlink d9/d48/l9d 0 2024-09-13T22:09:07.241 INFO:tasks.workunit.client.1.smithi159.stdout:0/790: mkdir d0/d48/d4f/d54/d74/db2/d10a 0 2024-09-13T22:09:07.250 INFO:tasks.workunit.client.1.smithi159.stdout:6/676: dwrite d3/da/f10 [0,4194304] 0 2024-09-13T22:09:07.250 INFO:tasks.workunit.client.1.smithi159.stdout:6/677: chown d3/da/d29/d1a/da3/da5 29 1 2024-09-13T22:09:07.250 INFO:tasks.workunit.client.1.smithi159.stdout:4/860: rename d13/d9b/dc9 to d13/d11f/d133 0 2024-09-13T22:09:07.252 INFO:tasks.workunit.client.1.smithi159.stdout:7/700: dwrite d3/dab/fc0 [4194304,4194304] 0 2024-09-13T22:09:07.252 INFO:tasks.workunit.client.1.smithi159.stdout:7/701: dread - d3/d31/d4d/d4e/d7a/fc7 zero size 2024-09-13T22:09:07.252 INFO:tasks.workunit.client.1.smithi159.stdout:7/702: chown d3/d31/d4d/d9e/l98 13 1 2024-09-13T22:09:07.254 INFO:tasks.workunit.client.1.smithi159.stdout:9/628: unlink d1/dc/d10/d6d/l46 0 2024-09-13T22:09:07.254 INFO:tasks.workunit.client.1.smithi159.stdout:9/629: getdents d1/dc/d10/d6d/d2f/dd3 0 2024-09-13T22:09:07.254 INFO:tasks.workunit.client.1.smithi159.stdout:9/630: chown d1/d9/d1f 2301 1 2024-09-13T22:09:07.254 INFO:tasks.workunit.client.1.smithi159.stdout:9/631: chown d1/dc/d10/d6d/d2f/fb7 33441684 1 2024-09-13T22:09:07.255 INFO:tasks.workunit.client.1.smithi159.stdout:9/632: dread d1/dc/d10/d69/f79 [0,4194304] 0 2024-09-13T22:09:07.256 INFO:tasks.workunit.client.1.smithi159.stdout:9/633: write d1/dc/d10/d6d/d4b/dcb/d75/fa6 [819468,77692] 0 2024-09-13T22:09:07.256 INFO:tasks.workunit.client.1.smithi159.stdout:9/634: fdatasync d1/dc/d27/d40/fce 0 2024-09-13T22:09:07.256 INFO:tasks.workunit.client.1.smithi159.stdout:3/525: link d0/d1/d3/d5/d25/d2c/l93 d0/d1/d34/la8 0 2024-09-13T22:09:07.256 INFO:tasks.workunit.client.1.smithi159.stdout:0/791: dread d0/d48/d7d/fbd [0,4194304] 0 2024-09-13T22:09:07.259 INFO:tasks.workunit.client.1.smithi159.stdout:1/791: link dd/d1e/d58/d8a/dbb/f4e dd/d1e/d58/d8a/ffb 0 2024-09-13T22:09:07.259 INFO:tasks.workunit.client.1.smithi159.stdout:1/792: truncate dd/d11/d18/d74/d82/da1/fb9 648801 0 2024-09-13T22:09:07.261 INFO:tasks.workunit.client.1.smithi159.stdout:6/678: link d3/da/d29/d1a/d3e/f55 d3/fd3 0 2024-09-13T22:09:07.263 INFO:tasks.workunit.client.1.smithi159.stdout:4/861: write d13/d15/f39 [2213055,116326] 0 2024-09-13T22:09:07.264 INFO:tasks.workunit.client.1.smithi159.stdout:8/895: rename da/d22/d2a/l42 to da/d22/d33/d66/l130 0 2024-09-13T22:09:07.264 INFO:tasks.workunit.client.1.smithi159.stdout:8/896: creat da/d22/d2a/da1/f131 x:0 0 0 2024-09-13T22:09:07.264 INFO:tasks.workunit.client.1.smithi159.stdout:8/897: creat da/d36/d48/d9e/f132 x:0 0 0 2024-09-13T22:09:07.265 INFO:tasks.workunit.client.1.smithi159.stdout:2/466: dwrite d9/d65/f60 [0,4194304] 0 2024-09-13T22:09:07.266 INFO:tasks.workunit.client.1.smithi159.stdout:8/898: dread da/d36/d57/f65 [0,4194304] 0 2024-09-13T22:09:07.266 INFO:tasks.workunit.client.1.smithi159.stdout:9/635: rmdir d1/dc/d10/d6d/d2f/d8b 39 2024-09-13T22:09:07.266 INFO:tasks.workunit.client.1.smithi159.stdout:9/636: creat d1/dc/d10/fd8 x:0 0 0 2024-09-13T22:09:07.267 INFO:tasks.workunit.client.1.smithi159.stdout:9/637: write d1/dc/d10/d6d/d4b/d98/da8/fbe [169473,73592] 0 2024-09-13T22:09:07.268 INFO:tasks.workunit.client.1.smithi159.stdout:0/792: mknod d0/d48/d4f/d2b/da3/df9/c10b 0 2024-09-13T22:09:07.268 INFO:tasks.workunit.client.1.smithi159.stdout:0/793: read - d0/d48/d4f/d54/d74/f7e zero size 2024-09-13T22:09:07.269 INFO:tasks.workunit.client.1.smithi159.stdout:1/793: creat dd/d11/d18/d49/ffc x:0 0 0 2024-09-13T22:09:07.270 INFO:tasks.workunit.client.1.smithi159.stdout:1/794: fsync dd/d11/d18/d49/d2d/d62/d7d/de8/dc6/fde 0 2024-09-13T22:09:07.270 INFO:tasks.workunit.client.1.smithi159.stdout:7/703: dwrite d3/d2e/db6/d6c/f90 [0,4194304] 0 2024-09-13T22:09:07.270 INFO:tasks.workunit.client.1.smithi159.stdout:7/704: write d3/d31/d4d/d4e/d7a/fcf [26093,2790] 0 2024-09-13T22:09:07.273 INFO:tasks.workunit.client.1.smithi159.stdout:6/679: creat d3/da/d29/d1a/d3e/d5a/d6a/fd4 x:0 0 0 2024-09-13T22:09:07.273 INFO:tasks.workunit.client.1.smithi159.stdout:6/680: chown d3/da/d29/d1a/d3e/d5a/d6a/fd4 8713 1 2024-09-13T22:09:07.273 INFO:tasks.workunit.client.1.smithi159.stdout:6/681: chown d3/da/d29/d1a/d3e/d5a/d6a/fd4 3 1 2024-09-13T22:09:07.275 INFO:tasks.workunit.client.1.smithi159.stdout:3/526: rename d0/d1/d3/d5/d25/d2c/d7f/f87 to d0/d1/d3/d5/fa9 0 2024-09-13T22:09:07.278 INFO:tasks.workunit.client.1.smithi159.stdout:8/899: symlink da/d22/d4a/dcc/l133 0 2024-09-13T22:09:07.280 INFO:tasks.workunit.client.1.smithi159.stdout:1/795: dread dd/d11/d21/f42 [0,4194304] 0 2024-09-13T22:09:07.281 INFO:tasks.workunit.client.1.smithi159.stdout:9/638: creat d1/d9/dab/fd9 x:0 0 0 2024-09-13T22:09:07.281 INFO:tasks.workunit.client.1.smithi159.stdout:9/639: write d1/dc/d10/d6d/d4b/dcb/d75/fd2 [883861,4598] 0 2024-09-13T22:09:07.282 INFO:tasks.workunit.client.1.smithi159.stdout:7/705: mkdir d3/d2e/db6/d6c/db2/de9 0 2024-09-13T22:09:07.284 INFO:tasks.workunit.client.1.smithi159.stdout:6/682: mkdir d3/d2a/dd5 0 2024-09-13T22:09:07.284 INFO:tasks.workunit.client.1.smithi159.stdout:6/683: chown d3/da/d29/d1a/f2e 197 1 2024-09-13T22:09:07.284 INFO:tasks.workunit.client.1.smithi159.stdout:1/796: dread dd/d1e/d58/d5f/f7c [0,4194304] 0 2024-09-13T22:09:07.286 INFO:tasks.workunit.client.1.smithi159.stdout:7/706: write d3/d18/f1d [881374,103484] 0 2024-09-13T22:09:07.286 INFO:tasks.workunit.client.1.smithi159.stdout:8/900: write da/d5d/d70/d8e/dc1/fd9 [3153454,37462] 0 2024-09-13T22:09:07.288 INFO:tasks.workunit.client.1.smithi159.stdout:4/862: rename d13/f74 to d13/d41/d79/db2/dd5/f134 0 2024-09-13T22:09:07.288 INFO:tasks.workunit.client.1.smithi159.stdout:4/863: dread - d13/d15/d26/d29/d3b/daf/f108 zero size 2024-09-13T22:09:07.288 INFO:tasks.workunit.client.1.smithi159.stdout:4/864: truncate d13/d41/d50/fd4 1867318 0 2024-09-13T22:09:07.289 INFO:tasks.workunit.client.1.smithi159.stdout:1/797: dread dd/d11/d13/f5c [0,4194304] 0 2024-09-13T22:09:07.289 INFO:tasks.workunit.client.1.smithi159.stdout:1/798: dread - dd/d11/d13/f8d zero size 2024-09-13T22:09:07.291 INFO:tasks.workunit.client.1.smithi159.stdout:0/794: dwrite d0/d48/d4f/d66/fed [0,4194304] 0 2024-09-13T22:09:07.291 INFO:tasks.workunit.client.1.smithi159.stdout:0/795: fdatasync d0/d48/d7d/fbd 0 2024-09-13T22:09:07.291 INFO:tasks.workunit.client.1.smithi159.stdout:0/796: dread - d0/d5e/fb5 zero size 2024-09-13T22:09:07.296 INFO:tasks.workunit.client.1.smithi159.stdout:3/527: mknod d0/d1/d3/d5/d25/d4e/d5a/d9b/caa 0 2024-09-13T22:09:07.298 INFO:tasks.workunit.client.1.smithi159.stdout:7/707: mkdir d3/d3f/dea 0 2024-09-13T22:09:07.300 INFO:tasks.workunit.client.1.smithi159.stdout:2/467: rename d9/d37/f72 to d9/d92/f9e 0 2024-09-13T22:09:07.300 INFO:tasks.workunit.client.1.smithi159.stdout:1/799: write dd/d1e/d58/d5f/d84/fdb [194326,36825] 0 2024-09-13T22:09:07.304 INFO:tasks.workunit.client.1.smithi159.stdout:0/797: link d0/d2c/f5a d0/d48/d7d/dca/f10c 0 2024-09-13T22:09:07.304 INFO:tasks.workunit.client.1.smithi159.stdout:0/798: stat d0/f6a 0 2024-09-13T22:09:07.304 INFO:tasks.workunit.client.1.smithi159.stdout:0/799: read d0/d2c/f5a [101090,23907] 0 2024-09-13T22:09:07.306 INFO:tasks.workunit.client.1.smithi159.stdout:4/865: dwrite d13/f22 [0,4194304] 0 2024-09-13T22:09:07.306 INFO:tasks.workunit.client.1.smithi159.stdout:4/866: dread - d13/d15/d26/d29/d3b/d66/fba zero size 2024-09-13T22:09:07.312 INFO:tasks.workunit.client.1.smithi159.stdout:3/528: creat d0/d1/d3/d5/d25/d75/fab x:0 0 0 2024-09-13T22:09:07.320 INFO:tasks.workunit.client.1.smithi159.stdout:7/708: symlink d3/d2e/db6/d6c/db2/dbc/leb 0 2024-09-13T22:09:07.320 INFO:tasks.workunit.client.1.smithi159.stdout:7/709: fsync d3/d3f/f91 0 2024-09-13T22:09:07.323 INFO:tasks.workunit.client.1.smithi159.stdout:9/640: rename d1/dc/d10/d6d/d2f/d8b/da1/lc7 to d1/dc/d10/d6d/d4b/dcb/d75/lda 0 2024-09-13T22:09:07.323 INFO:tasks.workunit.client.1.smithi159.stdout:9/641: truncate d1/dc/d10/faa 875712 0 2024-09-13T22:09:07.326 INFO:tasks.workunit.client.1.smithi159.stdout:1/800: getdents dd/d11/d18/d49/d2d 0 2024-09-13T22:09:07.327 INFO:tasks.workunit.client.1.smithi159.stdout:4/867: dwrite f11 [0,4194304] 0 2024-09-13T22:09:07.328 INFO:tasks.workunit.client.1.smithi159.stdout:4/868: chown d13/d41/d50/f60 1000228 1 2024-09-13T22:09:07.328 INFO:tasks.workunit.client.1.smithi159.stdout:0/800: mkdir d0/d2c/d10d 0 2024-09-13T22:09:07.328 INFO:tasks.workunit.client.1.smithi159.stdout:3/529: dwrite d0/d1/d3/d5/db/d58/f80 [0,4194304] 0 2024-09-13T22:09:07.328 INFO:tasks.workunit.client.1.smithi159.stdout:3/530: creat d0/d1/d3/d5/d25/d4e/d5a/fac x:0 0 0 2024-09-13T22:09:07.328 INFO:tasks.workunit.client.1.smithi159.stdout:3/531: dread - d0/d1/d3/d5/db/d39/f6a zero size 2024-09-13T22:09:07.331 INFO:tasks.workunit.client.1.smithi159.stdout:7/710: mkdir d3/d31/d4d/d9e/dec 0 2024-09-13T22:09:07.332 INFO:tasks.workunit.client.1.smithi159.stdout:6/684: rename d3/da/f4e to d3/da/d25/d69/fd6 0 2024-09-13T22:09:07.332 INFO:tasks.workunit.client.1.smithi159.stdout:6/685: write d3/d2a/d3c/fc3 [34240,104452] 0 2024-09-13T22:09:07.332 INFO:tasks.workunit.client.1.smithi159.stdout:9/642: symlink d1/dc/d10/d6d/d87/ldb 0 2024-09-13T22:09:07.333 INFO:tasks.workunit.client.1.smithi159.stdout:2/468: truncate d9/d65/f60 4725428 0 2024-09-13T22:09:07.333 INFO:tasks.workunit.client.1.smithi159.stdout:2/469: write d9/f38 [2001408,54480] 0 2024-09-13T22:09:07.334 INFO:tasks.workunit.client.1.smithi159.stdout:1/801: mkdir dd/d1e/d58/d8a/dbb/d3c/d95/df5/dfd 0 2024-09-13T22:09:07.334 INFO:tasks.workunit.client.1.smithi159.stdout:1/802: truncate dd/d1e/d58/d5f/fdc 943876 0 2024-09-13T22:09:07.338 INFO:tasks.workunit.client.1.smithi159.stdout:4/869: unlink d13/d15/d26/d51/d65/d67/d82/cc0 0 2024-09-13T22:09:07.341 INFO:tasks.workunit.client.1.smithi159.stdout:6/686: write d3/da/d29/d26/f37 [3984616,55238] 0 2024-09-13T22:09:07.342 INFO:tasks.workunit.client.1.smithi159.stdout:7/711: write d3/d31/d4d/d4e/f52 [2900570,92181] 0 2024-09-13T22:09:07.342 INFO:tasks.workunit.client.1.smithi159.stdout:7/712: write d3/d2e/d6e/d74/f85 [263293,12296] 0 2024-09-13T22:09:07.342 INFO:tasks.workunit.client.1.smithi159.stdout:7/713: write d3/d31/d4d/f8e [1286439,53609] 0 2024-09-13T22:09:07.343 INFO:tasks.workunit.client.1.smithi159.stdout:3/532: link d0/d68/f7b d0/d1/d34/fad 0 2024-09-13T22:09:07.344 INFO:tasks.workunit.client.1.smithi159.stdout:3/533: truncate d0/d1/d3/d5/d25/d2c/f9a 962293 0 2024-09-13T22:09:07.345 INFO:tasks.workunit.client.1.smithi159.stdout:1/803: symlink dd/d1e/d58/d8a/lfe 0 2024-09-13T22:09:07.345 INFO:tasks.workunit.client.1.smithi159.stdout:1/804: chown dd/d11/f40 3908 1 2024-09-13T22:09:07.350 INFO:tasks.workunit.client.1.smithi159.stdout:7/714: link d3/d31/d4d/d9e/l60 d3/d2e/db6/d6c/db2/dbc/led 0 2024-09-13T22:09:07.352 INFO:tasks.workunit.client.1.smithi159.stdout:3/534: creat d0/d1/d3/d5/d25/d4e/d92/fae x:0 0 0 2024-09-13T22:09:07.352 INFO:tasks.workunit.client.1.smithi159.stdout:0/801: dwrite d0/d48/d4f/f81 [4194304,4194304] 0 2024-09-13T22:09:07.352 INFO:tasks.workunit.client.1.smithi159.stdout:0/802: readlink d0/d2c/d71/ld8 0 2024-09-13T22:09:07.356 INFO:tasks.workunit.client.1.smithi159.stdout:9/643: dwrite d1/dc/d10/d6d/d4b/d98/da8/fb3 [0,4194304] 0 2024-09-13T22:09:07.357 INFO:tasks.workunit.client.1.smithi159.stdout:9/644: fdatasync d1/dc/d10/f92 0 2024-09-13T22:09:07.357 INFO:tasks.workunit.client.1.smithi159.stdout:2/470: link d9/c12 d9/d65/c9f 0 2024-09-13T22:09:07.359 INFO:tasks.workunit.client.1.smithi159.stdout:6/687: getdents d3/d2a 0 2024-09-13T22:09:07.362 INFO:tasks.workunit.client.1.smithi159.stdout:7/715: getdents d3/d2e/d6e/d74 0 2024-09-13T22:09:07.362 INFO:tasks.workunit.client.1.smithi159.stdout:7/716: write d3/d2e/d6e/d74/fd0 [806192,13784] 0 2024-09-13T22:09:07.362 INFO:tasks.workunit.client.1.smithi159.stdout:7/717: truncate d3/d31/d4d/d9e/fe7 925577 0 2024-09-13T22:09:07.364 INFO:tasks.workunit.client.1.smithi159.stdout:9/645: mkdir d1/dc/d10/d6d/d4b/dcb/d74/ddc 0 2024-09-13T22:09:07.366 INFO:tasks.workunit.client.1.smithi159.stdout:2/471: rmdir d9/d2d 39 2024-09-13T22:09:07.367 INFO:tasks.workunit.client.1.smithi159.stdout:2/472: readlink d9/d44/l6a 0 2024-09-13T22:09:07.370 INFO:tasks.workunit.client.1.smithi159.stdout:4/870: rename d13/d15/d26/d51/dc8 to d13/d41/d135 0 2024-09-13T22:09:07.372 INFO:tasks.workunit.client.1.smithi159.stdout:6/688: mknod d3/da/d29/d26/cd7 0 2024-09-13T22:09:07.372 INFO:tasks.workunit.client.1.smithi159.stdout:6/689: write d3/f23 [904016,97619] 0 2024-09-13T22:09:07.374 INFO:tasks.workunit.client.1.smithi159.stdout:1/805: dwrite dd/d11/d18/f23 [4194304,4194304] 0 2024-09-13T22:09:07.374 INFO:tasks.workunit.client.1.smithi159.stdout:7/718: mkdir d3/d2e/dee 0 2024-09-13T22:09:07.375 INFO:tasks.workunit.client.1.smithi159.stdout:2/473: mknod d9/d65/d8d/ca0 0 2024-09-13T22:09:07.375 INFO:tasks.workunit.client.1.smithi159.stdout:2/474: fsync d9/d37/f51 0 2024-09-13T22:09:07.379 INFO:tasks.workunit.client.1.smithi159.stdout:4/871: creat d13/d41/d79/db2/dd5/f136 x:0 0 0 2024-09-13T22:09:07.380 INFO:tasks.workunit.client.1.smithi159.stdout:3/535: dwrite d0/d1/d34/d73/f77 [0,4194304] 0 2024-09-13T22:09:07.380 INFO:tasks.workunit.client.1.smithi159.stdout:0/803: dwrite d0/d48/d4f/d2b/f7c [0,4194304] 0 2024-09-13T22:09:07.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/690: creat d3/da/d29/d26/d6c/d6e/fd8 x:0 0 0 2024-09-13T22:09:07.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/691: fdatasync d3/da/d29/d1a/d3e/d5a/f88 0 2024-09-13T22:09:07.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/692: getdents d3/d2a/db7 0 2024-09-13T22:09:07.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/693: dread - d3/da/d29/d1a/d3e/d5a/f9c zero size 2024-09-13T22:09:07.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/694: chown d3/d64/c7a 77 1 2024-09-13T22:09:07.384 INFO:tasks.workunit.client.1.smithi159.stdout:6/695: dread d3/d2a/fb9 [0,4194304] 0 2024-09-13T22:09:07.384 INFO:tasks.workunit.client.1.smithi159.stdout:1/806: symlink dd/d11/d34/d59/lff 0 2024-09-13T22:09:07.389 INFO:tasks.workunit.client.1.smithi159.stdout:2/475: unlink d9/c12 0 2024-09-13T22:09:07.389 INFO:tasks.workunit.client.1.smithi159.stdout:2/476: fsync d9/d65/f60 0 2024-09-13T22:09:07.393 INFO:tasks.workunit.client.1.smithi159.stdout:4/872: dwrite d13/d15/d26/d29/d3b/f121 [0,4194304] 0 2024-09-13T22:09:07.402 INFO:tasks.workunit.client.1.smithi159.stdout:4/873: read d13/d15/f62 [3907884,18892] 0 2024-09-13T22:09:07.402 INFO:tasks.workunit.client.1.smithi159.stdout:3/536: symlink d0/d1/d15/laf 0 2024-09-13T22:09:07.402 INFO:tasks.workunit.client.1.smithi159.stdout:3/537: fsync d0/d1/d3/d5/db/f60 0 2024-09-13T22:09:07.404 INFO:tasks.workunit.client.1.smithi159.stdout:0/804: creat d0/d48/d4f/daf/dd4/dff/f10e x:0 0 0 2024-09-13T22:09:07.404 INFO:tasks.workunit.client.1.smithi159.stdout:0/805: getdents d0/d48/d4f/daf/d104 0 2024-09-13T22:09:07.409 INFO:tasks.workunit.client.1.smithi159.stdout:6/696: rmdir d3/da/d29/d26 39 2024-09-13T22:09:07.410 INFO:tasks.workunit.client.1.smithi159.stdout:1/807: mkdir dd/d11/d18/d74/def/d100 0 2024-09-13T22:09:07.412 INFO:tasks.workunit.client.1.smithi159.stdout:7/719: symlink d3/d2e/d6e/d74/dba/lef 0 2024-09-13T22:09:07.413 INFO:tasks.workunit.client.1.smithi159.stdout:7/720: write d3/d2e/d6e/d74/dba/f6d [5328799,98480] 0 2024-09-13T22:09:07.417 INFO:tasks.workunit.client.1.smithi159.stdout:1/808: mknod dd/d11/d18/d49/d2d/d62/d7d/c101 0 2024-09-13T22:09:07.417 INFO:tasks.workunit.client.1.smithi159.stdout:1/809: fsync dd/d1c/f86 0 2024-09-13T22:09:07.419 INFO:tasks.workunit.client.1.smithi159.stdout:7/721: rename d3/d31/d4d/fa7 to d3/d2e/db6/d6c/db2/dce/ff0 0 2024-09-13T22:09:07.427 INFO:tasks.workunit.client.1.smithi159.stdout:2/477: rmdir d9 39 2024-09-13T22:09:07.430 INFO:tasks.workunit.client.1.smithi159.stdout:2/478: creat d9/da/d82/fa1 x:0 0 0 2024-09-13T22:09:07.435 INFO:tasks.workunit.client.1.smithi159.stdout:6/697: dread d3/da/d29/d1a/f62 [0,4194304] 0 2024-09-13T22:09:07.435 INFO:tasks.workunit.client.1.smithi159.stdout:4/874: dwrite d13/d15/d26/d51/d65/d67/d82/fee [0,4194304] 0 2024-09-13T22:09:07.438 INFO:tasks.workunit.client.1.smithi159.stdout:4/875: mknod d13/d15/d26/d51/d65/d67/dd1/c137 0 2024-09-13T22:09:07.439 INFO:tasks.workunit.client.1.smithi159.stdout:4/876: mknod d13/d41/d79/db2/c138 0 2024-09-13T22:09:07.441 INFO:tasks.workunit.client.1.smithi159.stdout:1/810: dwrite dd/d1e/f22 [0,4194304] 0 2024-09-13T22:09:07.441 INFO:tasks.workunit.client.1.smithi159.stdout:1/811: creat dd/d11/d13/d4b/d52/d63/f102 x:0 0 0 2024-09-13T22:09:07.441 INFO:tasks.workunit.client.1.smithi159.stdout:1/812: chown dd/dcc 1890 1 2024-09-13T22:09:07.441 INFO:tasks.workunit.client.1.smithi159.stdout:3/538: dwrite d0/d1/d3/d5/d25/d4e/d5a/f4c [0,4194304] 0 2024-09-13T22:09:07.442 INFO:tasks.workunit.client.1.smithi159.stdout:4/877: rename d13/d15/d26/d29/d3b/fbc to d13/d41/d79/db2/dd5/f139 0 2024-09-13T22:09:07.450 INFO:tasks.workunit.client.1.smithi159.stdout:1/813: creat dd/d11/d18/d74/def/d100/f103 x:0 0 0 2024-09-13T22:09:07.451 INFO:tasks.workunit.client.1.smithi159.stdout:3/539: getdents d0/d1/d3/d5/d25/d75/d5b/d45 0 2024-09-13T22:09:07.451 INFO:tasks.workunit.client.1.smithi159.stdout:6/698: dread d3/da/d29/d1a/d3e/d5a/d6a/f9e [0,4194304] 0 2024-09-13T22:09:07.451 INFO:tasks.workunit.client.1.smithi159.stdout:0/806: dwrite d0/d48/d7d/dca/f10c [0,4194304] 0 2024-09-13T22:09:07.451 INFO:tasks.workunit.client.1.smithi159.stdout:2/479: dwrite d9/d37/f3a [0,4194304] 0 2024-09-13T22:09:07.452 INFO:tasks.workunit.client.1.smithi159.stdout:3/540: write d0/d1/d3/dd/f64 [557260,54303] 0 2024-09-13T22:09:07.452 INFO:tasks.workunit.client.1.smithi159.stdout:3/541: write d0/d1/d3/d5/d25/f27 [4873338,92137] 0 2024-09-13T22:09:07.454 INFO:tasks.workunit.client.1.smithi159.stdout:4/878: rename d13/d15/f1f to d13/d41/d79/f13a 0 2024-09-13T22:09:07.454 INFO:tasks.workunit.client.1.smithi159.stdout:4/879: write d13/d41/d50/f116 [3463601,16450] 0 2024-09-13T22:09:07.454 INFO:tasks.workunit.client.1.smithi159.stdout:4/880: stat d13/d41/dbf/c128 0 2024-09-13T22:09:07.455 INFO:tasks.workunit.client.1.smithi159.stdout:1/814: mkdir dd/d11/d34/d59/d104 0 2024-09-13T22:09:07.455 INFO:tasks.workunit.client.1.smithi159.stdout:1/815: write dd/d11/d34/d59/fcf [377549,3890] 0 2024-09-13T22:09:07.455 INFO:tasks.workunit.client.1.smithi159.stdout:1/816: write dd/d11/d18/d74/d82/d9a/fec [743338,107818] 0 2024-09-13T22:09:07.457 INFO:tasks.workunit.client.1.smithi159.stdout:0/807: mknod d0/d48/d4f/d54/d74/c10f 0 2024-09-13T22:09:07.463 INFO:tasks.workunit.client.1.smithi159.stdout:2/480: symlink d9/d37/la2 0 2024-09-13T22:09:07.463 INFO:tasks.workunit.client.1.smithi159.stdout:2/481: write d9/f1b [1585785,30099] 0 2024-09-13T22:09:07.464 INFO:tasks.workunit.client.1.smithi159.stdout:3/542: mkdir d0/db0 0 2024-09-13T22:09:07.468 INFO:tasks.workunit.client.1.smithi159.stdout:6/699: rename d3/da/d25/d69/f7f to d3/da/d29/d1a/d3e/d5a/d6a/fd9 0 2024-09-13T22:09:07.470 INFO:tasks.workunit.client.1.smithi159.stdout:4/881: mkdir d13/d124/d13b 0 2024-09-13T22:09:07.471 INFO:tasks.workunit.client.1.smithi159.stdout:4/882: readlink d13/d15/l18 0 2024-09-13T22:09:07.471 INFO:tasks.workunit.client.1.smithi159.stdout:4/883: dread - d13/d15/d26/d29/d3b/d66/fba zero size 2024-09-13T22:09:07.471 INFO:tasks.workunit.client.1.smithi159.stdout:4/884: fsync d13/d15/d26/d51/f12f 0 2024-09-13T22:09:07.471 INFO:tasks.workunit.client.1.smithi159.stdout:4/885: creat d13/d15/d26/d51/d65/d67/f13c x:0 0 0 2024-09-13T22:09:07.473 INFO:tasks.workunit.client.1.smithi159.stdout:1/817: creat dd/d1e/d58/d8a/dbb/da4/f105 x:0 0 0 2024-09-13T22:09:07.473 INFO:tasks.workunit.client.1.smithi159.stdout:1/818: fdatasync dd/d11/d34/f99 0 2024-09-13T22:09:07.478 INFO:tasks.workunit.client.1.smithi159.stdout:3/543: dwrite d0/d1/d3/d5/db/d39/f52 [4194304,4194304] 0 2024-09-13T22:09:07.480 INFO:tasks.workunit.client.1.smithi159.stdout:6/700: rename c0 to d3/d2a/d3c/cda 0 2024-09-13T22:09:07.480 INFO:tasks.workunit.client.1.smithi159.stdout:6/701: creat d3/da/d29/d1a/d3e/d5a/d6a/fdb x:0 0 0 2024-09-13T22:09:07.482 INFO:tasks.workunit.client.1.smithi159.stdout:1/819: creat dd/d11/d18/d74/def/dfa/f106 x:0 0 0 2024-09-13T22:09:07.484 INFO:tasks.workunit.client.1.smithi159.stdout:3/544: mknod d0/d1/d3/d5/db/cb1 0 2024-09-13T22:09:07.484 INFO:tasks.workunit.client.1.smithi159.stdout:3/545: write d0/d1/d3/d5/f88 [2552631,118941] 0 2024-09-13T22:09:07.484 INFO:tasks.workunit.client.1.smithi159.stdout:3/546: chown d0/d68 79696100 1 2024-09-13T22:09:07.484 INFO:tasks.workunit.client.1.smithi159.stdout:2/482: symlink d9/d65/d40/d69/d66/la3 0 2024-09-13T22:09:07.485 INFO:tasks.workunit.client.1.smithi159.stdout:2/483: write d9/d37/f7f [223963,51185] 0 2024-09-13T22:09:07.486 INFO:tasks.workunit.client.1.smithi159.stdout:6/702: mkdir d3/da/d29/d1a/d3e/ddc 0 2024-09-13T22:09:07.486 INFO:tasks.workunit.client.1.smithi159.stdout:6/703: truncate d3/da/d29/d1a/d3e/d5a/d6a/fdb 819620 0 2024-09-13T22:09:07.486 INFO:tasks.workunit.client.1.smithi159.stdout:6/704: fsync d3/d2a/d3c/d5c/faf 0 2024-09-13T22:09:07.486 INFO:tasks.workunit.client.1.smithi159.stdout:6/705: dread - d3/da/d29/d26/f9f zero size 2024-09-13T22:09:07.486 INFO:tasks.workunit.client.1.smithi159.stdout:6/706: rename d3/da/d29/d1a/d3e to d3/da/d29/d1a/d3e/d5a/ddd 22 2024-09-13T22:09:07.487 INFO:tasks.workunit.client.1.smithi159.stdout:6/707: write d3/da/d29/d1a/d3e/d5a/f9c [749682,26760] 0 2024-09-13T22:09:07.487 INFO:tasks.workunit.client.1.smithi159.stdout:3/547: mknod d0/d1/d3/dd/cb2 0 2024-09-13T22:09:07.487 INFO:tasks.workunit.client.1.smithi159.stdout:3/548: creat d0/d1/d34/fb3 x:0 0 0 2024-09-13T22:09:07.488 INFO:tasks.workunit.client.1.smithi159.stdout:4/886: dwrite d13/f19 [4194304,4194304] 0 2024-09-13T22:09:07.488 INFO:tasks.workunit.client.1.smithi159.stdout:4/887: fdatasync d13/d15/d26/d29/d3b/f63 0 2024-09-13T22:09:07.489 INFO:tasks.workunit.client.1.smithi159.stdout:2/484: unlink d9/d37/la2 0 2024-09-13T22:09:07.496 INFO:tasks.workunit.client.1.smithi159.stdout:6/708: write d3/da/d29/d26/f4d [2881671,108501] 0 2024-09-13T22:09:07.497 INFO:tasks.workunit.client.1.smithi159.stdout:3/549: dread d0/d1/d34/d73/f77 [0,4194304] 0 2024-09-13T22:09:07.497 INFO:tasks.workunit.client.1.smithi159.stdout:3/550: fsync d0/d1/f74 0 2024-09-13T22:09:07.497 INFO:tasks.workunit.client.1.smithi159.stdout:3/551: fsync d0/d1/d15/f9e 0 2024-09-13T22:09:07.500 INFO:tasks.workunit.client.1.smithi159.stdout:1/820: dwrite dd/d11/d34/d59/fcf [0,4194304] 0 2024-09-13T22:09:07.516 INFO:tasks.workunit.client.1.smithi159.stdout:4/888: mknod d13/d15/d26/d29/d3b/d8e/c13d 0 2024-09-13T22:09:07.517 INFO:tasks.workunit.client.1.smithi159.stdout:2/485: rename d9/da/d25/f2f to d9/da/d25/d91/fa4 0 2024-09-13T22:09:07.518 INFO:tasks.workunit.client.1.smithi159.stdout:6/709: mkdir d3/d2a/d3c/d46/dde 0 2024-09-13T22:09:07.521 INFO:tasks.workunit.client.1.smithi159.stdout:6/710: dread d3/da/d29/d1a/f2e [0,4194304] 0 2024-09-13T22:09:07.521 INFO:tasks.workunit.client.1.smithi159.stdout:1/821: getdents dd/d1e/d58/db4 0 2024-09-13T22:09:07.523 INFO:tasks.workunit.client.1.smithi159.stdout:4/889: symlink d13/d41/d79/db2/l13e 0 2024-09-13T22:09:07.525 INFO:tasks.workunit.client.1.smithi159.stdout:3/552: rename d0/d1/d3/d5/d25/d75/d5b/d45/f51 to d0/d78/fb4 0 2024-09-13T22:09:07.526 INFO:tasks.workunit.client.1.smithi159.stdout:2/486: mknod d9/da/d82/d89/ca5 0 2024-09-13T22:09:07.527 INFO:tasks.workunit.client.1.smithi159.stdout:2/487: fsync d9/f5e 0 2024-09-13T22:09:07.527 INFO:tasks.workunit.client.1.smithi159.stdout:2/488: fdatasync d9/d2d/f78 0 2024-09-13T22:09:07.529 INFO:tasks.workunit.client.1.smithi159.stdout:6/711: mknod d3/da/d29/d1a/d3e/cdf 0 2024-09-13T22:09:07.530 INFO:tasks.workunit.client.1.smithi159.stdout:4/890: getdents d13/d15/d26/d29/d3b/d66/df2 0 2024-09-13T22:09:07.530 INFO:tasks.workunit.client.1.smithi159.stdout:4/891: fdatasync d13/d41/d135/f102 0 2024-09-13T22:09:07.531 INFO:tasks.workunit.client.1.smithi159.stdout:1/822: write dd/d11/d18/f23 [5015984,51499] 0 2024-09-13T22:09:07.531 INFO:tasks.workunit.client.1.smithi159.stdout:1/823: creat dd/d11/d34/d59/f107 x:0 0 0 2024-09-13T22:09:07.533 INFO:tasks.workunit.client.1.smithi159.stdout:4/892: symlink d13/d15/d26/d51/l13f 0 2024-09-13T22:09:07.536 INFO:tasks.workunit.client.1.smithi159.stdout:4/893: link d13/d15/d26/d51/f12f d13/d124/f140 0 2024-09-13T22:09:07.538 INFO:tasks.workunit.client.1.smithi159.stdout:4/894: symlink d13/d15/d26/d29/d3b/de1/d115/l141 0 2024-09-13T22:09:07.542 INFO:tasks.workunit.client.1.smithi159.stdout:4/895: rename d13/d15/d26/d29/d3b/d8e/lf1 to d13/d11f/d133/l142 0 2024-09-13T22:09:07.546 INFO:tasks.workunit.client.1.smithi159.stdout:4/896: dread d13/d41/d7e/d126/f78 [0,4194304] 0 2024-09-13T22:09:07.548 INFO:tasks.workunit.client.1.smithi159.stdout:4/897: truncate f8 63667 0 2024-09-13T22:09:07.548 INFO:tasks.workunit.client.1.smithi159.stdout:4/898: chown d13/d41/d79/fa4 18165941 1 2024-09-13T22:09:07.565 INFO:tasks.workunit.client.1.smithi159.stdout:3/553: dwrite d0/d1/d3/d5/db/d58/f6c [0,4194304] 0 2024-09-13T22:09:07.565 INFO:tasks.workunit.client.1.smithi159.stdout:2/489: dwrite d9/fe [0,4194304] 0 2024-09-13T22:09:07.565 INFO:tasks.workunit.client.1.smithi159.stdout:6/712: dwrite d3/da/d25/f41 [0,4194304] 0 2024-09-13T22:09:07.565 INFO:tasks.workunit.client.1.smithi159.stdout:1/824: dwrite dd/d11/d18/f23 [0,4194304] 0 2024-09-13T22:09:07.566 INFO:tasks.workunit.client.1.smithi159.stdout:1/825: chown dd/d1e/d58/d8a/dbb/d3c/d95/df5 143 1 2024-09-13T22:09:07.566 INFO:tasks.workunit.client.1.smithi159.stdout:3/554: unlink d0/d1/d3/dd/f63 0 2024-09-13T22:09:07.567 INFO:tasks.workunit.client.1.smithi159.stdout:2/490: mkdir d9/d48/d77/da6 0 2024-09-13T22:09:07.571 INFO:tasks.workunit.client.1.smithi159.stdout:4/899: getdents d13/d15/d26/d29/d3b/de1/d115 0 2024-09-13T22:09:07.571 INFO:tasks.workunit.client.1.smithi159.stdout:4/900: chown d13/d41/d79/fa4 377 1 2024-09-13T22:09:07.572 INFO:tasks.workunit.client.1.smithi159.stdout:1/826: creat dd/d11/d34/da8/f108 x:0 0 0 2024-09-13T22:09:07.574 INFO:tasks.workunit.client.1.smithi159.stdout:3/555: truncate d0/d1/d3/d5/d25/d4e/d5a/f21 350423 0 2024-09-13T22:09:07.574 INFO:tasks.workunit.client.1.smithi159.stdout:3/556: fdatasync d0/d1/d34/f40 0 2024-09-13T22:09:07.574 INFO:tasks.workunit.client.1.smithi159.stdout:3/557: chown d0/d1/d3/d5/db/cb1 7330 1 2024-09-13T22:09:07.575 INFO:tasks.workunit.client.1.smithi159.stdout:2/491: creat d9/d65/d40/d69/fa7 x:0 0 0 2024-09-13T22:09:07.577 INFO:tasks.workunit.client.1.smithi159.stdout:1/827: mkdir dd/d11/d109 0 2024-09-13T22:09:07.578 INFO:tasks.workunit.client.1.smithi159.stdout:3/558: rename d0/d1/d15/l59 to d0/d1/d3/d5/d25/d4e/d9f/lb5 0 2024-09-13T22:09:07.579 INFO:tasks.workunit.client.1.smithi159.stdout:3/559: dread - d0/d1/d15/f9e zero size 2024-09-13T22:09:07.579 INFO:tasks.workunit.client.1.smithi159.stdout:3/560: chown d0/d1/l50 2 1 2024-09-13T22:09:07.579 INFO:tasks.workunit.client.1.smithi159.stdout:3/561: write d0/d1/d15/f5e [4355339,40499] 0 2024-09-13T22:09:07.579 INFO:tasks.workunit.client.1.smithi159.stdout:3/562: write d0/d1/d3/d5/db/d39/f6a [812291,27558] 0 2024-09-13T22:09:07.580 INFO:tasks.workunit.client.1.smithi159.stdout:2/492: creat d9/d37/fa8 x:0 0 0 2024-09-13T22:09:07.582 INFO:tasks.workunit.client.1.smithi159.stdout:1/828: mknod dd/d11/d18/d74/c10a 0 2024-09-13T22:09:07.582 INFO:tasks.workunit.client.1.smithi159.stdout:1/829: chown dd/d1e/d58/db4/cb8 126 1 2024-09-13T22:09:07.583 INFO:tasks.workunit.client.1.smithi159.stdout:2/493: dread d9/d48/f7e [0,4194304] 0 2024-09-13T22:09:07.587 INFO:tasks.workunit.client.1.smithi159.stdout:4/901: dread d13/d41/d50/f116 [0,4194304] 0 2024-09-13T22:09:07.587 INFO:tasks.workunit.client.1.smithi159.stdout:4/902: write d13/d15/f62 [4253706,22241] 0 2024-09-13T22:09:07.587 INFO:tasks.workunit.client.1.smithi159.stdout:6/713: dwrite d3/da/d29/d26/d6c/d6e/f85 [4194304,4194304] 0 2024-09-13T22:09:07.587 INFO:tasks.workunit.client.1.smithi159.stdout:6/714: stat d3/da/d29/d1a/d3e/d5a/f9c 0 2024-09-13T22:09:07.587 INFO:tasks.workunit.client.1.smithi159.stdout:4/903: read d13/fec [23815,13336] 0 2024-09-13T22:09:07.593 INFO:tasks.workunit.client.1.smithi159.stdout:4/904: creat d13/d41/d7e/d126/f143 x:0 0 0 2024-09-13T22:09:07.594 INFO:tasks.workunit.client.1.smithi159.stdout:1/830: write dd/d1e/f44 [479905,15255] 0 2024-09-13T22:09:07.595 INFO:tasks.workunit.client.1.smithi159.stdout:2/494: dread d9/d65/f60 [0,4194304] 0 2024-09-13T22:09:07.596 INFO:tasks.workunit.client.1.smithi159.stdout:2/495: readlink d9/d44/l70 0 2024-09-13T22:09:07.596 INFO:tasks.workunit.client.1.smithi159.stdout:4/905: rmdir d13/d15/d26/d29/d3b/de1/df6 39 2024-09-13T22:09:07.600 INFO:tasks.workunit.client.1.smithi159.stdout:4/906: mknod d13/d41/d79/db2/c144 0 2024-09-13T22:09:07.601 INFO:tasks.workunit.client.1.smithi159.stdout:3/563: dwrite d0/d1/d3/dd/f26 [0,4194304] 0 2024-09-13T22:09:07.602 INFO:tasks.workunit.client.1.smithi159.stdout:3/564: write d0/d1/d3/d5/d25/d2c/f9a [841755,11136] 0 2024-09-13T22:09:07.605 INFO:tasks.workunit.client.1.smithi159.stdout:6/715: dwrite d3/d2a/d3c/d46/fcf [0,4194304] 0 2024-09-13T22:09:07.605 INFO:tasks.workunit.client.1.smithi159.stdout:6/716: truncate d3/da/d29/d1a/d3e/d5a/dbb/fbf 177506 0 2024-09-13T22:09:07.605 INFO:tasks.workunit.client.1.smithi159.stdout:4/907: link d13/d41/d7e/d126/c7a d13/d15/d26/d29/d3b/d66/df2/c145 0 2024-09-13T22:09:07.606 INFO:tasks.workunit.client.1.smithi159.stdout:4/908: chown d13/d20/f59 12411186 1 2024-09-13T22:09:07.609 INFO:tasks.workunit.client.1.smithi159.stdout:3/565: symlink d0/d1/d3/d5/d25/d75/lb6 0 2024-09-13T22:09:07.611 INFO:tasks.workunit.client.1.smithi159.stdout:1/831: rename dd/d11/d34/d59 to dd/d11/d13/d10b 0 2024-09-13T22:09:07.613 INFO:tasks.workunit.client.1.smithi159.stdout:4/909: mknod d13/d15/d26/c146 0 2024-09-13T22:09:07.613 INFO:tasks.workunit.client.1.smithi159.stdout:4/910: write d13/d41/d79/f7c [1428760,80441] 0 2024-09-13T22:09:07.614 INFO:tasks.workunit.client.1.smithi159.stdout:3/566: rmdir d0/d1/d3/d5/d25/d2c/d71/d8f 39 2024-09-13T22:09:07.615 INFO:tasks.workunit.client.1.smithi159.stdout:2/496: dwrite d9/d44/f8a [0,4194304] 0 2024-09-13T22:09:07.615 INFO:tasks.workunit.client.1.smithi159.stdout:2/497: fsync d9/d48/d77/f9b 0 2024-09-13T22:09:07.616 INFO:tasks.workunit.client.1.smithi159.stdout:2/498: fsync d9/da/f7b 0 2024-09-13T22:09:07.617 INFO:tasks.workunit.client.1.smithi159.stdout:4/911: dread d13/d15/d26/f33 [0,4194304] 0 2024-09-13T22:09:07.618 INFO:tasks.workunit.client.1.smithi159.stdout:4/912: chown d13/d15/d26/d29/d3b/l48 7 1 2024-09-13T22:09:07.618 INFO:tasks.workunit.client.1.smithi159.stdout:6/717: rename d3/da/d29/d26/d6c/d6e/f83 to d3/da/d29/d1a/d3e/fe0 0 2024-09-13T22:09:07.619 INFO:tasks.workunit.client.1.smithi159.stdout:1/832: mknod dd/d11/d18/d74/d82/da1/dc0/c10c 0 2024-09-13T22:09:07.622 INFO:tasks.workunit.client.1.smithi159.stdout:3/567: creat d0/d78/fb7 x:0 0 0 2024-09-13T22:09:07.628 INFO:tasks.workunit.client.1.smithi159.stdout:4/913: rename d13/d41/d79/f13a to d13/d15/d26/d29/d3b/de1/d118/f147 0 2024-09-13T22:09:07.629 INFO:tasks.workunit.client.1.smithi159.stdout:1/833: mkdir dd/d11/d18/d74/d82/da1/d10d 0 2024-09-13T22:09:07.629 INFO:tasks.workunit.client.1.smithi159.stdout:1/834: chown dd/d11/d18/d49/f69 31166 1 2024-09-13T22:09:07.633 INFO:tasks.workunit.client.1.smithi159.stdout:3/568: mknod d0/cb8 0 2024-09-13T22:09:07.634 INFO:tasks.workunit.client.1.smithi159.stdout:4/914: dread d13/d15/f1d [0,4194304] 0 2024-09-13T22:09:07.635 INFO:tasks.workunit.client.1.smithi159.stdout:2/499: dwrite d9/da/d25/f4e [0,4194304] 0 2024-09-13T22:09:07.636 INFO:tasks.workunit.client.1.smithi159.stdout:6/718: rename d3/d6d/f8a to d3/da/d25/d52/fe1 0 2024-09-13T22:09:07.638 INFO:tasks.workunit.client.1.smithi159.stdout:1/835: mknod dd/d11/d18/d49/c10e 0 2024-09-13T22:09:07.638 INFO:tasks.workunit.client.1.smithi159.stdout:1/836: write dd/d1e/d58/d8a/dbb/d3c/fbd [1010236,107472] 0 2024-09-13T22:09:07.639 INFO:tasks.workunit.client.1.smithi159.stdout:4/915: unlink d13/c4e 0 2024-09-13T22:09:07.645 INFO:tasks.workunit.client.1.smithi159.stdout:2/500: dread d9/f1b [0,4194304] 0 2024-09-13T22:09:07.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/719: dread d3/da/f16 [0,4194304] 0 2024-09-13T22:09:07.650 INFO:tasks.workunit.client.1.smithi159.stdout:6/720: write d3/da/d29/d26/f4d [495689,87068] 0 2024-09-13T22:09:07.653 INFO:tasks.workunit.client.1.smithi159.stdout:1/837: creat dd/d1e/d58/d5f/d84/f10f x:0 0 0 2024-09-13T22:09:07.656 INFO:tasks.workunit.client.1.smithi159.stdout:2/501: symlink d9/d65/d8d/la9 0 2024-09-13T22:09:07.657 INFO:tasks.workunit.client.1.smithi159.stdout:3/569: dwrite d0/d78/fb4 [4194304,4194304] 0 2024-09-13T22:09:07.658 INFO:tasks.workunit.client.1.smithi159.stdout:2/502: symlink d9/da/d5a/laa 0 2024-09-13T22:09:07.661 INFO:tasks.workunit.client.1.smithi159.stdout:3/570: symlink d0/d1/d3/d5/d25/d4e/d9f/lb9 0 2024-09-13T22:09:07.662 INFO:tasks.workunit.client.1.smithi159.stdout:6/721: write d3/da/d25/d52/fb2 [3107735,62264] 0 2024-09-13T22:09:07.662 INFO:tasks.workunit.client.1.smithi159.stdout:6/722: chown d3/d2a/d3c/d46/d73/f77 1 1 2024-09-13T22:09:07.662 INFO:tasks.workunit.client.1.smithi159.stdout:4/916: dwrite d13/d41/d79/f10d [0,4194304] 0 2024-09-13T22:09:07.663 INFO:tasks.workunit.client.1.smithi159.stdout:2/503: mkdir d9/d65/d40/d69/dab 0 2024-09-13T22:09:07.664 INFO:tasks.workunit.client.1.smithi159.stdout:6/723: mknod d3/d2a/d9b/ce2 0 2024-09-13T22:09:07.669 INFO:tasks.workunit.client.1.smithi159.stdout:2/504: unlink d9/da/d25/l32 0 2024-09-13T22:09:07.670 INFO:tasks.workunit.client.1.smithi159.stdout:6/724: symlink d3/d2a/le3 0 2024-09-13T22:09:07.670 INFO:tasks.workunit.client.1.smithi159.stdout:6/725: creat d3/fe4 x:0 0 0 2024-09-13T22:09:07.670 INFO:tasks.workunit.client.1.smithi159.stdout:6/726: readlink d3/da/d29/d1a/l22 0 2024-09-13T22:09:07.672 INFO:tasks.workunit.client.1.smithi159.stdout:6/727: unlink d3/d2a/d3c/d46/d73/fbe 0 2024-09-13T22:09:07.673 INFO:tasks.workunit.client.1.smithi159.stdout:6/728: write d3/da/d29/d1a/d3e/d5a/d6a/fdb [548484,89528] 0 2024-09-13T22:09:07.673 INFO:tasks.workunit.client.1.smithi159.stdout:6/729: stat d3/d64/c7a 0 2024-09-13T22:09:07.673 INFO:tasks.workunit.client.1.smithi159.stdout:6/730: readlink d3/da/d25/d52/lce 0 2024-09-13T22:09:07.673 INFO:tasks.workunit.client.1.smithi159.stdout:6/731: fdatasync d3/da/d29/d26/d6c/d6e/fae 0 2024-09-13T22:09:07.675 INFO:tasks.workunit.client.1.smithi159.stdout:4/917: write d13/d41/d79/f10d [1967897,30173] 0 2024-09-13T22:09:07.675 INFO:tasks.workunit.client.1.smithi159.stdout:1/838: dwrite dd/d1e/d58/d8a/dbb/f4e [0,4194304] 0 2024-09-13T22:09:07.675 INFO:tasks.workunit.client.1.smithi159.stdout:1/839: readlink dd/d1c/l30 0 2024-09-13T22:09:07.675 INFO:tasks.workunit.client.1.smithi159.stdout:1/840: stat dd/d11/c73 0 2024-09-13T22:09:07.681 INFO:tasks.workunit.client.1.smithi159.stdout:1/841: unlink dd/d11/d13/d4b/d52/d63/f102 0 2024-09-13T22:09:07.682 INFO:tasks.workunit.client.1.smithi159.stdout:1/842: write dd/d1e/d58/d5f/d84/f10f [908536,129793] 0 2024-09-13T22:09:07.682 INFO:tasks.workunit.client.1.smithi159.stdout:2/505: write d9/d44/f61 [1435290,94366] 0 2024-09-13T22:09:07.682 INFO:tasks.workunit.client.1.smithi159.stdout:2/506: readlink d9/d48/l9d 0 2024-09-13T22:09:07.683 INFO:tasks.workunit.client.1.smithi159.stdout:1/843: mknod dd/d1e/d58/db4/c110 0 2024-09-13T22:09:07.684 INFO:tasks.workunit.client.1.smithi159.stdout:1/844: rename dd/d11/d13/d10b to dd/d11/d13/d10b/d111 22 2024-09-13T22:09:07.685 INFO:tasks.workunit.client.1.smithi159.stdout:3/571: dwrite d0/d1/d15/f99 [0,4194304] 0 2024-09-13T22:09:07.685 INFO:tasks.workunit.client.1.smithi159.stdout:2/507: creat d9/d65/d40/fac x:0 0 0 2024-09-13T22:09:07.688 INFO:tasks.workunit.client.1.smithi159.stdout:1/845: mkdir dd/d11/d18/d49/d2d/d112 0 2024-09-13T22:09:07.694 INFO:tasks.workunit.client.1.smithi159.stdout:2/508: creat d9/d65/d40/d69/dab/fad x:0 0 0 2024-09-13T22:09:07.694 INFO:tasks.workunit.client.1.smithi159.stdout:2/509: truncate d9/f6b 4342515 0 2024-09-13T22:09:07.696 INFO:tasks.workunit.client.1.smithi159.stdout:1/846: rename dd/d11/d13/d4b/d52/fbc to dd/d1e/d58/d8a/dbb/d3c/d95/df5/f113 0 2024-09-13T22:09:07.698 INFO:tasks.workunit.client.1.smithi159.stdout:2/510: rmdir d9/da/d5a 39 2024-09-13T22:09:07.699 INFO:tasks.workunit.client.1.smithi159.stdout:2/511: mknod d9/d65/d40/d69/d66/cae 0 2024-09-13T22:09:07.703 INFO:tasks.workunit.client.1.smithi159.stdout:6/732: dwrite d3/d2a/d3c/d46/fcf [0,4194304] 0 2024-09-13T22:09:07.703 INFO:tasks.workunit.client.1.smithi159.stdout:2/512: truncate d9/d65/f85 5145707 0 2024-09-13T22:09:07.703 INFO:tasks.workunit.client.1.smithi159.stdout:2/513: truncate d9/d92/f95 667289 0 2024-09-13T22:09:07.704 INFO:tasks.workunit.client.1.smithi159.stdout:3/572: dwrite d0/d1/d3/d5/db/f60 [0,4194304] 0 2024-09-13T22:09:07.704 INFO:tasks.workunit.client.1.smithi159.stdout:3/573: creat d0/d1/d3/d5/db/d39/fba x:0 0 0 2024-09-13T22:09:07.704 INFO:tasks.workunit.client.1.smithi159.stdout:3/574: fdatasync d0/f57 0 2024-09-13T22:09:07.706 INFO:tasks.workunit.client.1.smithi159.stdout:4/918: truncate d13/d41/d79/f10d 1139884 0 2024-09-13T22:09:07.707 INFO:tasks.workunit.client.1.smithi159.stdout:2/514: rename d9/d65/d40/f80 to d9/d65/d40/faf 0 2024-09-13T22:09:07.710 INFO:tasks.workunit.client.1.smithi159.stdout:4/919: symlink d13/d15/d26/d29/d3b/de1/l148 0 2024-09-13T22:09:07.711 INFO:tasks.workunit.client.1.smithi159.stdout:2/515: mkdir d9/d48/d77/da6/db0 0 2024-09-13T22:09:07.713 INFO:tasks.workunit.client.1.smithi159.stdout:3/575: rmdir d0/d1/d15 39 2024-09-13T22:09:07.714 INFO:tasks.workunit.client.1.smithi159.stdout:4/920: symlink d13/d15/d26/d29/d3b/de1/df6/d103/l149 0 2024-09-13T22:09:07.719 INFO:tasks.workunit.client.1.smithi159.stdout:6/733: dread d3/da/d25/f5b [4194304,4194304] 0 2024-09-13T22:09:07.720 INFO:tasks.workunit.client.1.smithi159.stdout:1/847: dwrite dd/f1b [0,4194304] 0 2024-09-13T22:09:07.724 INFO:tasks.workunit.client.1.smithi159.stdout:6/734: symlink d3/d2a/dd5/le5 0 2024-09-13T22:09:07.729 INFO:tasks.workunit.client.1.smithi159.stdout:1/848: truncate dd/d11/d18/d49/d2d/d97/f6e 1277682 0 2024-09-13T22:09:07.729 INFO:tasks.workunit.client.1.smithi159.stdout:1/849: write dd/d1e/d58/d8a/dbb/d3c/d95/fe2 [204493,34854] 0 2024-09-13T22:09:07.729 INFO:tasks.workunit.client.1.smithi159.stdout:1/850: truncate dd/d1e/d58/da7/de1/ded/ff3 850318 0 2024-09-13T22:09:07.729 INFO:tasks.workunit.client.1.smithi159.stdout:1/851: creat dd/d11/d18/d74/f114 x:0 0 0 2024-09-13T22:09:07.730 INFO:tasks.workunit.client.1.smithi159.stdout:1/852: write dd/d1e/d58/d8a/dbb/f33 [8171010,13762] 0 2024-09-13T22:09:07.730 INFO:tasks.workunit.client.1.smithi159.stdout:1/853: chown dd/d11/d21/c3e 486 1 2024-09-13T22:09:07.730 INFO:tasks.workunit.client.1.smithi159.stdout:1/854: write dd/d11/d18/d49/f69 [736643,49708] 0 2024-09-13T22:09:07.730 INFO:tasks.workunit.client.1.smithi159.stdout:1/855: mknod dd/dcc/c115 0 2024-09-13T22:09:07.736 INFO:tasks.workunit.client.1.smithi159.stdout:6/735: dread d3/d2a/d3c/d5c/faf [0,4194304] 0 2024-09-13T22:09:07.737 INFO:tasks.workunit.client.1.smithi159.stdout:6/736: mknod d3/d2a/dd5/ce6 0 2024-09-13T22:09:07.737 INFO:tasks.workunit.client.1.smithi159.stdout:6/737: fsync d3/d2a/d3c/f4f 0 2024-09-13T22:09:07.738 INFO:tasks.workunit.client.1.smithi159.stdout:6/738: rename d3/da/d25/d52/fe1 to d3/d2a/d9b/fe7 0 2024-09-13T22:09:07.738 INFO:tasks.workunit.client.1.smithi159.stdout:6/739: fdatasync d3/da/d29/d26/d6c/d6e/f95 0 2024-09-13T22:09:07.739 INFO:tasks.workunit.client.1.smithi159.stdout:6/740: creat d3/da/d29/d1a/d3e/fe8 x:0 0 0 2024-09-13T22:09:07.739 INFO:tasks.workunit.client.1.smithi159.stdout:6/741: write d3/d2a/f71 [1411809,25778] 0 2024-09-13T22:09:07.739 INFO:tasks.workunit.client.1.smithi159.stdout:6/742: write d3/da/d29/d1a/f2e [2008727,97764] 0 2024-09-13T22:09:07.744 INFO:tasks.workunit.client.1.smithi159.stdout:6/743: dread d3/da/d29/d1a/da3/da5/fab [0,4194304] 0 2024-09-13T22:09:07.744 INFO:tasks.workunit.client.1.smithi159.stdout:6/744: write d3/da/d29/d1a/d3e/fe8 [137528,117883] 0 2024-09-13T22:09:07.744 INFO:tasks.workunit.client.1.smithi159.stdout:6/745: mknod d3/d2a/d3c/d46/dde/ce9 0 2024-09-13T22:09:07.744 INFO:tasks.workunit.client.1.smithi159.stdout:6/746: fsync d3/fe4 0 2024-09-13T22:09:07.745 INFO:tasks.workunit.client.1.smithi159.stdout:6/747: unlink d3/da/d29/d1a/d3e/d5a/d6a/f9e 0 2024-09-13T22:09:07.746 INFO:tasks.workunit.client.1.smithi159.stdout:6/748: creat d3/da/d25/d69/fea x:0 0 0 2024-09-13T22:09:07.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:07 smithi089 ceph-mon[27921]: pgmap v265: 65 pgs: 65 active+clean; 1.9 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 131 MiB/s rd, 157 MiB/s wr, 289 op/s 2024-09-13T22:09:07.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:07 smithi159 ceph-mon[35348]: pgmap v265: 65 pgs: 65 active+clean; 1.9 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 131 MiB/s rd, 157 MiB/s wr, 289 op/s 2024-09-13T22:09:07.783 INFO:tasks.workunit.client.1.smithi159.stdout:3/576: dwrite d0/d1/d3/d5/d25/d75/d5b/d45/f7d [0,4194304] 0 2024-09-13T22:09:07.807 INFO:tasks.workunit.client.1.smithi159.stdout:1/856: dwrite dd/d1e/d58/da7/de1/ded/ff3 [0,4194304] 0 2024-09-13T22:09:07.807 INFO:tasks.workunit.client.1.smithi159.stdout:4/921: dwrite d13/f38 [0,4194304] 0 2024-09-13T22:09:07.808 INFO:tasks.workunit.client.1.smithi159.stdout:3/577: dwrite d0/d1/d3/d5/db/d58/f80 [0,4194304] 0 2024-09-13T22:09:07.808 INFO:tasks.workunit.client.1.smithi159.stdout:3/578: creat d0/d1/d3/d5/d25/d2c/fbb x:0 0 0 2024-09-13T22:09:07.808 INFO:tasks.workunit.client.1.smithi159.stdout:3/579: chown d0/d1/d3/d5/d25/d2c/fbb 13427117 1 2024-09-13T22:09:07.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/857: symlink dd/d1e/d58/d5f/d84/l116 0 2024-09-13T22:09:07.815 INFO:tasks.workunit.client.1.smithi159.stdout:1/858: truncate dd/d11/d13/d4b/fac 688367 0 2024-09-13T22:09:07.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/516: truncate d9/da/d82/f93 3495666 0 2024-09-13T22:09:07.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/517: write d9/d37/f5b [852015,74321] 0 2024-09-13T22:09:07.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/518: truncate d9/f31 5138319 0 2024-09-13T22:09:07.816 INFO:tasks.workunit.client.1.smithi159.stdout:2/519: dread d9/d92/f95 [0,4194304] 0 2024-09-13T22:09:07.817 INFO:tasks.workunit.client.1.smithi159.stdout:1/859: mknod dd/dcc/c117 0 2024-09-13T22:09:07.817 INFO:tasks.workunit.client.1.smithi159.stdout:1/860: write dd/d11/d18/d74/d82/d9a/fec [1618446,73483] 0 2024-09-13T22:09:07.817 INFO:tasks.workunit.client.1.smithi159.stdout:3/580: dread d0/d1/d34/f40 [4194304,4194304] 0 2024-09-13T22:09:07.819 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T22:09:07.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T22:09:07.820 INFO:tasks.workunit.client.1.smithi159.stdout:1/861: creat dd/d1e/d58/db4/f118 x:0 0 0 2024-09-13T22:09:07.821 INFO:tasks.workunit.client.1.smithi159.stdout:3/581: creat d0/d68/fbc x:0 0 0 2024-09-13T22:09:07.821 INFO:tasks.workunit.client.1.smithi159.stdout:3/582: creat d0/d1/d34/fbd x:0 0 0 2024-09-13T22:09:07.821 INFO:tasks.workunit.client.1.smithi159.stdout:3/583: chown d0/d1/d34/f70 427 1 2024-09-13T22:09:07.823 INFO:tasks.workunit.client.1.smithi159.stdout:6/749: rename d3/da/d25/d52 to d3/da/d25/d69/d96/deb 0 2024-09-13T22:09:07.825 INFO:tasks.workunit.client.1.smithi159.stdout:3/584: mkdir d0/d1/d3/d5/db/d39/dbe 0 2024-09-13T22:09:07.827 INFO:tasks.workunit.client.1.smithi159.stdout:6/750: rename d3/da/d29/d1a/da3/da5/fb4 to d3/da/d29/d26/fec 0 2024-09-13T22:09:07.827 INFO:tasks.workunit.client.1.smithi159.stdout:6/751: chown d3/da 19613708 1 2024-09-13T22:09:07.828 INFO:tasks.workunit.client.1.smithi159.stdout:1/862: dread dd/d11/d18/d74/d82/d9a/fa3 [0,4194304] 0 2024-09-13T22:09:07.828 INFO:tasks.workunit.client.1.smithi159.stdout:3/585: symlink d0/d1/d3/d5/db/lbf 0 2024-09-13T22:09:07.828 INFO:tasks.workunit.client.1.smithi159.stdout:3/586: write d0/d1/d3/d5/d25/d2c/fbb [569331,79192] 0 2024-09-13T22:09:07.828 INFO:tasks.workunit.client.1.smithi159.stdout:3/587: write d0/d1/d3/d5/d25/d2c/f9a [1817117,49024] 0 2024-09-13T22:09:07.829 INFO:tasks.workunit.client.1.smithi159.stdout:6/752: rmdir d3/da/d29/d1a 39 2024-09-13T22:09:07.829 INFO:tasks.workunit.client.1.smithi159.stdout:6/753: fdatasync d3/da/d29/d1a/d3e/d5a/f78 0 2024-09-13T22:09:07.830 INFO:tasks.workunit.client.1.smithi159.stdout:1/863: creat dd/d1e/d58/da7/f119 x:0 0 0 2024-09-13T22:09:07.833 INFO:tasks.workunit.client.1.smithi159.stdout:6/754: creat d3/d2a/d9b/fed x:0 0 0 2024-09-13T22:09:07.833 INFO:tasks.workunit.client.1.smithi159.stdout:2/520: dwrite d9/d37/f5b [0,4194304] 0 2024-09-13T22:09:07.833 INFO:tasks.workunit.client.1.smithi159.stdout:3/588: dread d0/d1/d3/d5/d25/d2c/d65/f72 [0,4194304] 0 2024-09-13T22:09:07.834 INFO:tasks.workunit.client.1.smithi159.stdout:1/864: unlink dd/d1e/d58/d5f/fd1 0 2024-09-13T22:09:07.834 INFO:tasks.workunit.client.1.smithi159.stdout:1/865: write dd/d11/d18/d74/d82/d9a/fec [1246983,125921] 0 2024-09-13T22:09:07.836 INFO:tasks.workunit.client.1.smithi159.stdout:6/755: link d3/da/d29/d1a/da3/da5/lac d3/lee 0 2024-09-13T22:09:07.836 INFO:tasks.workunit.client.1.smithi159.stdout:6/756: chown d3/d2a/d3c/d46/d73 0 1 2024-09-13T22:09:07.838 INFO:tasks.workunit.client.1.smithi159.stdout:2/521: creat d9/d48/d77/da6/db0/fb1 x:0 0 0 2024-09-13T22:09:07.839 INFO:tasks.workunit.client.1.smithi159.stdout:6/757: rmdir d3/da 39 2024-09-13T22:09:07.839 INFO:tasks.workunit.client.1.smithi159.stdout:6/758: creat d3/da/d29/d1a/d3e/d5a/d6a/fef x:0 0 0 2024-09-13T22:09:07.841 INFO:tasks.workunit.client.1.smithi159.stdout:2/522: truncate d9/d37/f51 409951 0 2024-09-13T22:09:07.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/589: write d0/d1/d3/d5/f31 [2204768,27464] 0 2024-09-13T22:09:07.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/590: fsync d0/f57 0 2024-09-13T22:09:07.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/591: stat d0/cb8 0 2024-09-13T22:09:07.844 INFO:tasks.workunit.client.1.smithi159.stdout:6/759: unlink d3/fd3 0 2024-09-13T22:09:07.845 INFO:tasks.workunit.client.1.smithi159.stdout:2/523: symlink d9/da/d25/d91/lb2 0 2024-09-13T22:09:07.849 INFO:tasks.workunit.client.1.smithi159.stdout:2/524: creat d9/d92/fb3 x:0 0 0 2024-09-13T22:09:07.851 INFO:tasks.workunit.client.1.smithi159.stdout:1/866: dwrite dd/d11/d18/d49/ffc [0,4194304] 0 2024-09-13T22:09:07.854 INFO:tasks.workunit.client.1.smithi159.stdout:3/592: getdents d0/d78 0 2024-09-13T22:09:07.854 INFO:tasks.workunit.client.1.smithi159.stdout:3/593: fsync d0/d1/d3/f24 0 2024-09-13T22:09:07.855 INFO:tasks.workunit.client.1.smithi159.stdout:6/760: dread d3/da/d29/d26/d6c/d6e/f85 [0,4194304] 0 2024-09-13T22:09:07.857 INFO:tasks.workunit.client.1.smithi159.stdout:2/525: mknod d9/d65/cb4 0 2024-09-13T22:09:07.861 INFO:tasks.workunit.client.1.smithi159.stdout:6/761: rmdir d3/da/d29/d26/d6c/d6e 39 2024-09-13T22:09:07.865 INFO:tasks.workunit.client.1.smithi159.stdout:5/702: sync 2024-09-13T22:09:07.871 INFO:tasks.workunit.client.1.smithi159.stdout:2/526: write d9/f5e [3503053,90449] 0 2024-09-13T22:09:07.871 INFO:tasks.workunit.client.1.smithi159.stdout:2/527: chown d9/d65/d40/d69/d66/l71 5621983 1 2024-09-13T22:09:07.872 INFO:tasks.workunit.client.1.smithi159.stdout:2/528: mkdir d9/d2d/db5 0 2024-09-13T22:09:07.876 INFO:tasks.workunit.client.1.smithi159.stdout:2/529: rename d9/f31 to d9/d48/d77/da6/db0/fb6 0 2024-09-13T22:09:07.876 INFO:tasks.workunit.client.1.smithi159.stdout:2/530: stat d9/d2d/c86 0 2024-09-13T22:09:07.877 INFO:tasks.workunit.client.1.smithi159.stdout:2/531: creat d9/d48/d77/fb7 x:0 0 0 2024-09-13T22:09:07.878 INFO:tasks.workunit.client.1.smithi159.stdout:2/532: symlink d9/d48/d77/da6/db0/lb8 0 2024-09-13T22:09:07.903 INFO:tasks.workunit.client.1.smithi159.stdout:5/703: dwrite d1/d11/d64/d35/d6f/f7f [0,4194304] 0 2024-09-13T22:09:07.903 INFO:tasks.workunit.client.1.smithi159.stdout:3/594: dwrite d0/d1/d34/fb3 [0,4194304] 0 2024-09-13T22:09:07.904 INFO:tasks.workunit.client.1.smithi159.stdout:1/867: dwrite dd/d1e/d58/da7/f119 [0,4194304] 0 2024-09-13T22:09:07.904 INFO:tasks.workunit.client.1.smithi159.stdout:6/762: dwrite d3/fe4 [0,4194304] 0 2024-09-13T22:09:07.904 INFO:tasks.workunit.client.1.smithi159.stdout:2/533: dwrite d9/d37/f51 [0,4194304] 0 2024-09-13T22:09:07.904 INFO:tasks.workunit.client.1.smithi159.stdout:2/534: truncate d9/d65/d40/d69/fa7 785146 0 2024-09-13T22:09:07.904 INFO:tasks.workunit.client.1.smithi159.stdout:6/763: creat d3/da/d29/d1a/d3e/d5a/d6a/ff0 x:0 0 0 2024-09-13T22:09:07.904 INFO:tasks.workunit.client.1.smithi159.stdout:6/764: write d3/da/d25/d69/d96/f5e [302211,42010] 0 2024-09-13T22:09:07.904 INFO:tasks.workunit.client.1.smithi159.stdout:6/765: write d3/fc6 [30252,13534] 0 2024-09-13T22:09:07.904 INFO:tasks.workunit.client.1.smithi159.stdout:6/766: getdents d3/d2a/db7 0 2024-09-13T22:09:07.905 INFO:tasks.workunit.client.1.smithi159.stdout:1/868: read dd/d11/d18/d49/d2d/d97/f93 [740715,29924] 0 2024-09-13T22:09:07.916 INFO:tasks.workunit.client.1.smithi159.stdout:3/595: write d0/d1/d3/d5/f88 [1762296,90019] 0 2024-09-13T22:09:07.917 INFO:tasks.workunit.client.1.smithi159.stdout:3/596: write d0/d1/d3/d5/f88 [1692832,87235] 0 2024-09-13T22:09:07.917 INFO:tasks.workunit.client.1.smithi159.stdout:5/704: write d1/d11/d50/f62 [146018,72729] 0 2024-09-13T22:09:07.917 INFO:tasks.workunit.client.1.smithi159.stdout:5/705: creat d1/d11/d50/fe7 x:0 0 0 2024-09-13T22:09:07.923 INFO:tasks.workunit.client.1.smithi159.stdout:6/767: dwrite d3/da/d29/d26/f37 [0,4194304] 0 2024-09-13T22:09:07.923 INFO:tasks.workunit.client.1.smithi159.stdout:6/768: fsync d3/da/d29/d26/f4d 0 2024-09-13T22:09:07.923 INFO:tasks.workunit.client.1.smithi159.stdout:2/535: rename d9/d2d/l4c to d9/d37/lb9 0 2024-09-13T22:09:07.926 INFO:tasks.workunit.client.1.smithi159.stdout:1/869: creat dd/d11/d109/f11a x:0 0 0 2024-09-13T22:09:07.926 INFO:tasks.workunit.client.1.smithi159.stdout:1/870: truncate dd/d11/d18/d49/d2d/d62/f6a 1207934 0 2024-09-13T22:09:07.928 INFO:tasks.workunit.client.1.smithi159.stdout:3/597: write d0/d1/d3/d5/f17 [6043110,101350] 0 2024-09-13T22:09:07.935 INFO:tasks.workunit.client.1.smithi159.stdout:2/536: rename d9/d2d/c86 to d9/d65/d40/d69/dab/cba 0 2024-09-13T22:09:07.937 INFO:tasks.workunit.client.1.smithi159.stdout:1/871: mkdir dd/d11/d13/d4b/d11b 0 2024-09-13T22:09:07.937 INFO:tasks.workunit.client.1.smithi159.stdout:3/598: read d0/d1/d3/d5/d25/d4e/d5a/f19 [2911706,89263] 0 2024-09-13T22:09:07.940 INFO:tasks.workunit.client.1.smithi159.stdout:5/706: rename d1/d11/d64/d35/d6f to d1/d11/d64/de8 0 2024-09-13T22:09:07.940 INFO:tasks.workunit.client.1.smithi159.stdout:5/707: chown d1/d11/d64/f43 92119626 1 2024-09-13T22:09:07.940 INFO:tasks.workunit.client.1.smithi159.stdout:5/708: chown d1/d11/d64/d35/d7c/fdf 18163904 1 2024-09-13T22:09:07.940 INFO:tasks.workunit.client.1.smithi159.stdout:5/709: readlink d1/d11/d64/l5c 0 2024-09-13T22:09:07.940 INFO:tasks.workunit.client.1.smithi159.stdout:2/537: stat d9/d65/d40/l49 0 2024-09-13T22:09:07.942 INFO:tasks.workunit.client.1.smithi159.stdout:1/872: creat dd/d11/d18/d49/d2d/d62/d7d/f11c x:0 0 0 2024-09-13T22:09:07.943 INFO:tasks.workunit.client.1.smithi159.stdout:8/901: sync 2024-09-13T22:09:07.943 INFO:tasks.workunit.client.1.smithi159.stdout:0/808: sync 2024-09-13T22:09:07.943 INFO:tasks.workunit.client.1.smithi159.stdout:0/809: fdatasync d0/d5e/f1a 0 2024-09-13T22:09:07.943 INFO:tasks.workunit.client.1.smithi159.stdout:9/646: sync 2024-09-13T22:09:07.943 INFO:tasks.workunit.client.1.smithi159.stdout:9/647: chown d1/dc/d10/d6d/fc8 15 1 2024-09-13T22:09:07.943 INFO:tasks.workunit.client.1.smithi159.stdout:4/922: sync 2024-09-13T22:09:07.944 INFO:tasks.workunit.client.1.smithi159.stdout:7/722: sync 2024-09-13T22:09:07.945 INFO:tasks.workunit.client.1.smithi159.stdout:7/723: dread d3/d2e/d6e/f86 [0,4194304] 0 2024-09-13T22:09:07.945 INFO:tasks.workunit.client.1.smithi159.stdout:7/724: fsync d3/d31/f66 0 2024-09-13T22:09:07.945 INFO:tasks.workunit.client.1.smithi159.stdout:3/599: creat d0/d1/d3/d5/d25/fc0 x:0 0 0 2024-09-13T22:09:07.947 INFO:tasks.workunit.client.1.smithi159.stdout:5/710: dread d1/d11/d1c/fae [0,4194304] 0 2024-09-13T22:09:07.947 INFO:tasks.workunit.client.1.smithi159.stdout:5/711: chown d1/fad 1388 1 2024-09-13T22:09:07.948 INFO:tasks.workunit.client.1.smithi159.stdout:5/712: write d1/d11/d50/fbd [4258089,70029] 0 2024-09-13T22:09:07.950 INFO:tasks.workunit.client.1.smithi159.stdout:6/769: rename d3/d2a/dd5 to d3/d2a/d3c/d46/d73/df1 0 2024-09-13T22:09:07.978 INFO:tasks.workunit.client.1.smithi159.stdout:1/873: dwrite dd/d11/d13/fc9 [4194304,4194304] 0 2024-09-13T22:09:07.988 INFO:tasks.workunit.client.1.smithi159.stdout:8/902: dwrite da/d22/d2a/da1/f121 [0,4194304] 0 2024-09-13T22:09:07.988 INFO:tasks.workunit.client.1.smithi159.stdout:8/903: truncate da/d36/d57/f65 1482353 0 2024-09-13T22:09:07.989 INFO:tasks.workunit.client.1.smithi159.stdout:3/600: dwrite d0/f57 [0,4194304] 0 2024-09-13T22:09:07.989 INFO:tasks.workunit.client.1.smithi159.stdout:9/648: dwrite d1/f1c [0,4194304] 0 2024-09-13T22:09:07.989 INFO:tasks.workunit.client.1.smithi159.stdout:6/770: dwrite d3/d2a/fb9 [0,4194304] 0 2024-09-13T22:09:07.989 INFO:tasks.workunit.client.1.smithi159.stdout:6/771: write d3/da/d29/d1a/d3e/fe0 [830044,75231] 0 2024-09-13T22:09:08.024 INFO:tasks.workunit.client.1.smithi159.stdout:0/810: link d0/d5e/cee d0/d48/d4f/d2b/da3/c110 0 2024-09-13T22:09:08.025 INFO:tasks.workunit.client.1.smithi159.stdout:7/725: mknod d3/d18/cf1 0 2024-09-13T22:09:08.027 INFO:tasks.workunit.client.1.smithi159.stdout:0/811: dread d0/d5e/f55 [0,4194304] 0 2024-09-13T22:09:08.029 INFO:tasks.workunit.client.1.smithi159.stdout:5/713: mkdir d1/d11/d64/d82/d8c/de9 0 2024-09-13T22:09:08.029 INFO:tasks.workunit.client.1.smithi159.stdout:5/714: stat d1/d11/d64/f10 0 2024-09-13T22:09:08.030 INFO:tasks.workunit.client.1.smithi159.stdout:5/715: readlink d1/d11/d1c/d32/le2 0 2024-09-13T22:09:08.031 INFO:tasks.workunit.client.1.smithi159.stdout:2/538: rename d9/d65/d40/c84 to d9/da/d25/cbb 0 2024-09-13T22:09:08.033 INFO:tasks.workunit.client.1.smithi159.stdout:7/726: write d3/d3f/fa1 [3736676,123423] 0 2024-09-13T22:09:08.034 INFO:tasks.workunit.client.1.smithi159.stdout:1/874: mknod dd/d11/d18/d49/d2d/c11d 0 2024-09-13T22:09:08.037 INFO:tasks.workunit.client.1.smithi159.stdout:8/904: creat da/d22/db3/f134 x:0 0 0 2024-09-13T22:09:08.038 INFO:tasks.workunit.client.1.smithi159.stdout:8/905: chown da/d7e/d82/c84 12230235 1 2024-09-13T22:09:08.041 INFO:tasks.workunit.client.1.smithi159.stdout:3/601: mkdir d0/d1/d3/d5/db/d58/dc1 0 2024-09-13T22:09:08.043 INFO:tasks.workunit.client.1.smithi159.stdout:0/812: dwrite d0/d2c/d96/da1/fdf [4194304,4194304] 0 2024-09-13T22:09:08.044 INFO:tasks.workunit.client.1.smithi159.stdout:0/813: chown d0/d2c/d96/da1/fdf 7 1 2024-09-13T22:09:08.044 INFO:tasks.workunit.client.1.smithi159.stdout:0/814: readlink d0/d2c/l2d 0 2024-09-13T22:09:08.045 INFO:tasks.workunit.client.1.smithi159.stdout:9/649: mkdir d1/dc/d10/d6d/d2f/d8b/ddd 0 2024-09-13T22:09:08.047 INFO:tasks.workunit.client.1.smithi159.stdout:5/716: mknod d1/d11/d64/de8/cea 0 2024-09-13T22:09:08.050 INFO:tasks.workunit.client.1.smithi159.stdout:6/772: rename d3/da/f16 to d3/da/d29/d1a/d3e/d5a/dbb/ff2 0 2024-09-13T22:09:08.053 INFO:tasks.workunit.client.1.smithi159.stdout:7/727: unlink d3/d31/d4d/d9e/l60 0 2024-09-13T22:09:08.053 INFO:tasks.workunit.client.1.smithi159.stdout:7/728: readlink d3/d31/d4d/d9e/l77 0 2024-09-13T22:09:08.054 INFO:tasks.workunit.client.1.smithi159.stdout:1/875: link dd/d11/d13/fee dd/d11/d18/d74/def/dfa/f11e 0 2024-09-13T22:09:08.057 INFO:tasks.workunit.client.1.smithi159.stdout:5/717: write d1/d11/f75 [364894,45489] 0 2024-09-13T22:09:08.057 INFO:tasks.workunit.client.1.smithi159.stdout:2/539: rename d9/f6b to d9/d92/fbc 0 2024-09-13T22:09:08.058 INFO:tasks.workunit.client.1.smithi159.stdout:2/540: write d9/d65/d40/d69/f90 [430428,53457] 0 2024-09-13T22:09:08.059 INFO:tasks.workunit.client.1.smithi159.stdout:7/729: rmdir d3/d2e/db6/d6c/db2/de9 0 2024-09-13T22:09:08.062 INFO:tasks.workunit.client.1.smithi159.stdout:5/718: creat d1/d11/d1c/dd2/d53/feb x:0 0 0 2024-09-13T22:09:08.067 INFO:tasks.workunit.client.1.smithi159.stdout:6/773: read d3/da/d29/d26/f37 [4124759,32854] 0 2024-09-13T22:09:08.067 INFO:tasks.workunit.client.1.smithi159.stdout:6/774: stat d3/d2a/d3c/f4f 0 2024-09-13T22:09:08.067 INFO:tasks.workunit.client.1.smithi159.stdout:8/906: rename da/d22/d33/d66/l130 to da/d7e/d82/dd8/de7/l135 0 2024-09-13T22:09:08.069 INFO:tasks.workunit.client.1.smithi159.stdout:1/876: getdents dd/d1e/d58/d8a/dbb/da4 0 2024-09-13T22:09:08.069 INFO:tasks.workunit.client.1.smithi159.stdout:1/877: getdents dd/d1e/d58/d8a/dbb/da4 0 2024-09-13T22:09:08.071 INFO:tasks.workunit.client.1.smithi159.stdout:5/719: symlink d1/d11/d1c/dd2/d44/d85/lec 0 2024-09-13T22:09:08.071 INFO:tasks.workunit.client.1.smithi159.stdout:5/720: truncate d1/d11/d50/fe7 663399 0 2024-09-13T22:09:08.072 INFO:tasks.workunit.client.1.smithi159.stdout:5/721: dread - d1/f76 zero size 2024-09-13T22:09:08.074 INFO:tasks.workunit.client.1.smithi159.stdout:9/650: rename d1/dc/d10/f17 to d1/dc/d10/d6d/d2f/d8b/da1/fde 0 2024-09-13T22:09:08.075 INFO:tasks.workunit.client.1.smithi159.stdout:8/907: mknod da/d7e/d82/dd8/de7/c136 0 2024-09-13T22:09:08.077 INFO:tasks.workunit.client.1.smithi159.stdout:5/722: creat d1/d11/d64/d35/d7c/d7d/fed x:0 0 0 2024-09-13T22:09:08.078 INFO:tasks.workunit.client.1.smithi159.stdout:9/651: mknod d1/d5a/cdf 0 2024-09-13T22:09:08.079 INFO:tasks.workunit.client.1.smithi159.stdout:3/602: dwrite d0/d1/d3/d5/db/f60 [4194304,4194304] 0 2024-09-13T22:09:08.079 INFO:tasks.workunit.client.1.smithi159.stdout:3/603: dread - d0/d68/fbc zero size 2024-09-13T22:09:08.079 INFO:tasks.workunit.client.1.smithi159.stdout:8/908: mknod da/d22/d33/d66/c137 0 2024-09-13T22:09:08.080 INFO:tasks.workunit.client.1.smithi159.stdout:5/723: mknod d1/d11/d64/d35/d7c/cee 0 2024-09-13T22:09:08.080 INFO:tasks.workunit.client.1.smithi159.stdout:5/724: chown d1/d11/d1c/l2e 4126172 1 2024-09-13T22:09:08.080 INFO:tasks.workunit.client.1.smithi159.stdout:5/725: rename d1/d11 to d1/d11/d1c/dd2/d44/d89/def 22 2024-09-13T22:09:08.080 INFO:tasks.workunit.client.1.smithi159.stdout:5/726: chown d1/d11/d64/d82/d8c/de9 14126917 1 2024-09-13T22:09:08.082 INFO:tasks.workunit.client.1.smithi159.stdout:9/652: symlink d1/dc/d10/d6d/d4b/dcb/le0 0 2024-09-13T22:09:08.085 INFO:tasks.workunit.client.1.smithi159.stdout:8/909: unlink da/d22/d4a/ff2 0 2024-09-13T22:09:08.087 INFO:tasks.workunit.client.1.smithi159.stdout:5/727: creat d1/d11/d64/d35/d7c/ff0 x:0 0 0 2024-09-13T22:09:08.087 INFO:tasks.workunit.client.1.smithi159.stdout:3/604: rmdir d0/d1/d3/d5/d25/d2c/d7f 39 2024-09-13T22:09:08.088 INFO:tasks.workunit.client.1.smithi159.stdout:8/910: chown da/lc0 11 1 2024-09-13T22:09:08.088 INFO:tasks.workunit.client.1.smithi159.stdout:8/911: creat da/d7e/d82/dd8/de7/d114/f138 x:0 0 0 2024-09-13T22:09:08.089 INFO:tasks.workunit.client.1.smithi159.stdout:5/728: mkdir d1/d11/d64/df1 0 2024-09-13T22:09:08.089 INFO:tasks.workunit.client.1.smithi159.stdout:5/729: write d1/d11/d64/d35/d60/f80 [159179,53303] 0 2024-09-13T22:09:08.090 INFO:tasks.workunit.client.1.smithi159.stdout:3/605: unlink d0/d1/d3/d5/d25/d4e/d5a/l37 0 2024-09-13T22:09:08.091 INFO:tasks.workunit.client.1.smithi159.stdout:3/606: dread - d0/d1/d3/d5/d25/fc0 zero size 2024-09-13T22:09:08.091 INFO:tasks.workunit.client.1.smithi159.stdout:3/607: getdents d0/db0 0 2024-09-13T22:09:08.094 INFO:tasks.workunit.client.1.smithi159.stdout:3/608: creat d0/d1/d3/d5/d25/d4e/d9f/fc2 x:0 0 0 2024-09-13T22:09:08.096 INFO:tasks.workunit.client.1.smithi159.stdout:8/912: rename da/c54 to da/d22/d2a/d39/d12a/c139 0 2024-09-13T22:09:08.097 INFO:tasks.workunit.client.1.smithi159.stdout:9/653: dread d1/dc/f3e [0,4194304] 0 2024-09-13T22:09:08.097 INFO:tasks.workunit.client.1.smithi159.stdout:0/815: dwrite d0/d2c/d96/feb [0,4194304] 0 2024-09-13T22:09:08.098 INFO:tasks.workunit.client.1.smithi159.stdout:0/816: chown d0/d48/dd9/lf5 324110 1 2024-09-13T22:09:08.098 INFO:tasks.workunit.client.1.smithi159.stdout:3/609: symlink d0/d1/lc3 0 2024-09-13T22:09:08.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/730: dwrite d3/d3f/f4a [4194304,4194304] 0 2024-09-13T22:09:08.099 INFO:tasks.workunit.client.1.smithi159.stdout:1/878: dwrite dd/d1e/d58/db4/f118 [0,4194304] 0 2024-09-13T22:09:08.099 INFO:tasks.workunit.client.1.smithi159.stdout:6/775: dwrite d3/da/d29/d26/d6c/fd2 [0,4194304] 0 2024-09-13T22:09:08.101 INFO:tasks.workunit.client.1.smithi159.stdout:2/541: dwrite d9/da/f4d [0,4194304] 0 2024-09-13T22:09:08.101 INFO:tasks.workunit.client.1.smithi159.stdout:2/542: creat d9/d48/d77/da6/db0/fbd x:0 0 0 2024-09-13T22:09:08.102 INFO:tasks.workunit.client.1.smithi159.stdout:8/913: rename da/d22/d4a/f4e to da/d5d/d70/d8e/dc1/f13a 0 2024-09-13T22:09:08.108 INFO:tasks.workunit.client.1.smithi159.stdout:0/817: symlink d0/d48/d7d/dca/dcd/l111 0 2024-09-13T22:09:08.108 INFO:tasks.workunit.client.1.smithi159.stdout:3/610: dread d0/d1/d3/d5/d25/d4e/d5a/f19 [0,4194304] 0 2024-09-13T22:09:08.109 INFO:tasks.workunit.client.1.smithi159.stdout:3/611: write d0/d1/d34/f70 [234172,3491] 0 2024-09-13T22:09:08.109 INFO:tasks.workunit.client.1.smithi159.stdout:3/612: stat d0/d1/d3/d5/d25/d4e 0 2024-09-13T22:09:08.109 INFO:tasks.workunit.client.1.smithi159.stdout:3/613: fdatasync d0/d1/f2 0 2024-09-13T22:09:08.109 INFO:tasks.workunit.client.1.smithi159.stdout:3/614: read d0/d1/f2 [2243711,121547] 0 2024-09-13T22:09:08.111 INFO:tasks.workunit.client.1.smithi159.stdout:1/879: write dd/d1e/d58/da7/f119 [3381464,50528] 0 2024-09-13T22:09:08.111 INFO:tasks.workunit.client.1.smithi159.stdout:1/880: chown f7 466386907 1 2024-09-13T22:09:08.112 INFO:tasks.workunit.client.1.smithi159.stdout:0/818: dread d0/d48/d4f/d2b/da3/ff0 [0,4194304] 0 2024-09-13T22:09:08.113 INFO:tasks.workunit.client.1.smithi159.stdout:0/819: stat d0/d2c/d71/cf4 0 2024-09-13T22:09:08.113 INFO:tasks.workunit.client.1.smithi159.stdout:0/820: dread - d0/d2c/d96/fc8 zero size 2024-09-13T22:09:08.113 INFO:tasks.workunit.client.1.smithi159.stdout:7/731: symlink d3/d2e/db6/d6c/db2/dce/lf2 0 2024-09-13T22:09:08.115 INFO:tasks.workunit.client.1.smithi159.stdout:5/730: dwrite d1/d11/d64/f3f [0,4194304] 0 2024-09-13T22:09:08.121 INFO:tasks.workunit.client.1.smithi159.stdout:6/776: creat d3/da/d29/d26/d6c/d6e/da9/ff3 x:0 0 0 2024-09-13T22:09:08.122 INFO:tasks.workunit.client.1.smithi159.stdout:9/654: dwrite d1/dc/d10/d6d/d4b/d98/da8/fba [0,4194304] 0 2024-09-13T22:09:08.123 INFO:tasks.workunit.client.1.smithi159.stdout:2/543: dwrite d9/d92/f9e [0,4194304] 0 2024-09-13T22:09:08.123 INFO:tasks.workunit.client.1.smithi159.stdout:2/544: readlink d9/d37/lb9 0 2024-09-13T22:09:08.129 INFO:tasks.workunit.client.1.smithi159.stdout:8/914: mkdir da/d36/d13b 0 2024-09-13T22:09:08.129 INFO:tasks.workunit.client.1.smithi159.stdout:8/915: chown da/d5d/dbc/feb 161 1 2024-09-13T22:09:08.143 INFO:tasks.workunit.client.1.smithi159.stdout:3/615: unlink d0/d1/d34/f3e 0 2024-09-13T22:09:08.143 INFO:tasks.workunit.client.1.smithi159.stdout:3/616: fsync d0/d68/fbc 0 2024-09-13T22:09:08.144 INFO:tasks.workunit.client.1.smithi159.stdout:1/881: mknod dd/d11/d13/d4b/d52/c11f 0 2024-09-13T22:09:08.146 INFO:tasks.workunit.client.1.smithi159.stdout:0/821: getdents d0/d48/d4f/d54 0 2024-09-13T22:09:08.147 INFO:tasks.workunit.client.1.smithi159.stdout:7/732: link d3/d2e/fb0 d3/d31/d4d/ff3 0 2024-09-13T22:09:08.147 INFO:tasks.workunit.client.1.smithi159.stdout:7/733: fdatasync d3/d31/d4d/d9e/fdc 0 2024-09-13T22:09:08.148 INFO:tasks.workunit.client.1.smithi159.stdout:5/731: unlink d1/d11/d50/ldb 0 2024-09-13T22:09:08.149 INFO:tasks.workunit.client.1.smithi159.stdout:6/777: rmdir d3/da/d25/d69/db3 39 2024-09-13T22:09:08.149 INFO:tasks.workunit.client.1.smithi159.stdout:6/778: readlink d3/da/d29/d26/l54 0 2024-09-13T22:09:08.152 INFO:tasks.workunit.client.1.smithi159.stdout:9/655: truncate d1/dc/d27/f65 371948 0 2024-09-13T22:09:08.153 INFO:tasks.workunit.client.1.smithi159.stdout:2/545: mkdir d9/d2d/db5/dbe 0 2024-09-13T22:09:08.153 INFO:tasks.workunit.client.1.smithi159.stdout:2/546: creat d9/d65/d40/d69/fbf x:0 0 0 2024-09-13T22:09:08.154 INFO:tasks.workunit.client.1.smithi159.stdout:2/547: stat d9/da/lc 0 2024-09-13T22:09:08.154 INFO:tasks.workunit.client.1.smithi159.stdout:2/548: creat d9/d65/d40/fc0 x:0 0 0 2024-09-13T22:09:08.154 INFO:tasks.workunit.client.1.smithi159.stdout:2/549: truncate d9/d65/d40/d69/fbf 117855 0 2024-09-13T22:09:08.154 INFO:tasks.workunit.client.1.smithi159.stdout:2/550: fdatasync d9/da/d82/f93 0 2024-09-13T22:09:08.155 INFO:tasks.workunit.client.1.smithi159.stdout:8/916: symlink da/d22/d2a/l13c 0 2024-09-13T22:09:08.159 INFO:tasks.workunit.client.1.smithi159.stdout:1/882: creat dd/d1e/d58/d8a/dbb/d3c/d95/df5/f120 x:0 0 0 2024-09-13T22:09:08.161 INFO:tasks.workunit.client.1.smithi159.stdout:0/822: creat d0/d48/d4f/d54/d74/db2/d10a/f112 x:0 0 0 2024-09-13T22:09:08.161 INFO:tasks.workunit.client.1.smithi159.stdout:0/823: chown d0/d48/d4f/d54/d74/f7a 810 1 2024-09-13T22:09:08.161 INFO:tasks.workunit.client.1.smithi159.stdout:7/734: creat d3/d2e/d6e/db9/ff4 x:0 0 0 2024-09-13T22:09:08.162 INFO:tasks.workunit.client.1.smithi159.stdout:7/735: chown d3/c2b 74506 1 2024-09-13T22:09:08.162 INFO:tasks.workunit.client.1.smithi159.stdout:7/736: creat d3/d2e/db6/d6c/db2/dce/ff5 x:0 0 0 2024-09-13T22:09:08.162 INFO:tasks.workunit.client.1.smithi159.stdout:5/732: truncate d1/d11/d64/d17/fc0 3024100 0 2024-09-13T22:09:08.162 INFO:tasks.workunit.client.1.smithi159.stdout:5/733: truncate d1/d11/d64/d17/f68 476315 0 2024-09-13T22:09:08.163 INFO:tasks.workunit.client.1.smithi159.stdout:6/779: mkdir d3/da/d25/d69/d96/df4 0 2024-09-13T22:09:08.164 INFO:tasks.workunit.client.1.smithi159.stdout:5/734: dread d1/d11/d64/d35/d60/f80 [0,4194304] 0 2024-09-13T22:09:08.167 INFO:tasks.workunit.client.1.smithi159.stdout:2/551: symlink d9/da/d25/lc1 0 2024-09-13T22:09:08.167 INFO:tasks.workunit.client.1.smithi159.stdout:2/552: chown d9/d92/f9e 5334111 1 2024-09-13T22:09:08.167 INFO:tasks.workunit.client.1.smithi159.stdout:2/553: fsync d9/d65/d40/f45 0 2024-09-13T22:09:08.167 INFO:tasks.workunit.client.1.smithi159.stdout:8/917: rmdir da/d22/d26 39 2024-09-13T22:09:08.170 INFO:tasks.workunit.client.1.smithi159.stdout:0/824: mkdir d0/d48/d4f/daf/d113 0 2024-09-13T22:09:08.170 INFO:tasks.workunit.client.1.smithi159.stdout:0/825: truncate d0/d48/d7d/ffc 671170 0 2024-09-13T22:09:08.173 INFO:tasks.workunit.client.1.smithi159.stdout:7/737: rename d3/d2e/d6e/ca3 to d3/d18/cf6 0 2024-09-13T22:09:08.174 INFO:tasks.workunit.client.1.smithi159.stdout:6/780: creat d3/d2a/db7/ff5 x:0 0 0 2024-09-13T22:09:08.176 INFO:tasks.workunit.client.1.smithi159.stdout:8/918: creat da/f13d x:0 0 0 2024-09-13T22:09:08.176 INFO:tasks.workunit.client.1.smithi159.stdout:1/883: getdents dd/d11/d18/d74/d82/d9a/de0 0 2024-09-13T22:09:08.178 INFO:tasks.workunit.client.1.smithi159.stdout:7/738: symlink d3/d31/d4d/d4e/d7a/lf7 0 2024-09-13T22:09:08.181 INFO:tasks.workunit.client.1.smithi159.stdout:6/781: unlink d3/da/d29/d1a/d3e/fe8 0 2024-09-13T22:09:08.183 INFO:tasks.workunit.client.1.smithi159.stdout:1/884: creat dd/d1e/d58/d8a/dbb/f121 x:0 0 0 2024-09-13T22:09:08.183 INFO:tasks.workunit.client.1.smithi159.stdout:1/885: fsync dd/d11/d18/f3d 0 2024-09-13T22:09:08.184 INFO:tasks.workunit.client.1.smithi159.stdout:0/826: dread d0/d48/d4f/d54/d74/db2/fd6 [0,4194304] 0 2024-09-13T22:09:08.185 INFO:tasks.workunit.client.1.smithi159.stdout:7/739: creat d3/ff8 x:0 0 0 2024-09-13T22:09:08.185 INFO:tasks.workunit.client.1.smithi159.stdout:7/740: truncate d3/fc2 1146878 0 2024-09-13T22:09:08.185 INFO:tasks.workunit.client.1.smithi159.stdout:5/735: dwrite d1/f96 [0,4194304] 0 2024-09-13T22:09:08.185 INFO:tasks.workunit.client.1.smithi159.stdout:5/736: write d1/d11/d1c/d32/f3a [915924,122459] 0 2024-09-13T22:09:08.186 INFO:tasks.workunit.client.1.smithi159.stdout:6/782: rename d3/da/d29/d1a/da3/da5/fc0 to d3/d2a/d3c/d46/dde/ff6 0 2024-09-13T22:09:08.186 INFO:tasks.workunit.client.1.smithi159.stdout:6/783: chown d3/da/d29/d1a/d3e/d5a/d6a/fd9 6828 1 2024-09-13T22:09:08.187 INFO:tasks.workunit.client.1.smithi159.stdout:1/886: mknod dd/d11/d18/d74/d82/d9a/db3/c122 0 2024-09-13T22:09:08.190 INFO:tasks.workunit.client.1.smithi159.stdout:7/741: mknod d3/d31/d4d/d9e/cf9 0 2024-09-13T22:09:08.191 INFO:tasks.workunit.client.1.smithi159.stdout:5/737: truncate d1/fa 6886992 0 2024-09-13T22:09:08.191 INFO:tasks.workunit.client.1.smithi159.stdout:5/738: chown d1/d11/d9e/f26 0 1 2024-09-13T22:09:08.192 INFO:tasks.workunit.client.1.smithi159.stdout:8/919: dwrite da/d36/d48/d9e/f132 [0,4194304] 0 2024-09-13T22:09:08.192 INFO:tasks.workunit.client.1.smithi159.stdout:8/920: chown da/d7e/d82/d6f/f9f 902679 1 2024-09-13T22:09:08.193 INFO:tasks.workunit.client.1.smithi159.stdout:6/784: symlink d3/d2a/d9b/lf7 0 2024-09-13T22:09:08.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/827: dread d0/d48/d4f/f67 [0,4194304] 0 2024-09-13T22:09:08.193 INFO:tasks.workunit.client.1.smithi159.stdout:0/828: dread - d0/d2c/d96/ff2 zero size 2024-09-13T22:09:08.194 INFO:tasks.workunit.client.1.smithi159.stdout:1/887: creat dd/d11/d18/d74/d82/da1/d10d/f123 x:0 0 0 2024-09-13T22:09:08.194 INFO:tasks.workunit.client.1.smithi159.stdout:1/888: fsync dd/d11/f40 0 2024-09-13T22:09:08.198 INFO:tasks.workunit.client.1.smithi159.stdout:5/739: dread d1/d11/d9e/f26 [0,4194304] 0 2024-09-13T22:09:08.198 INFO:tasks.workunit.client.1.smithi159.stdout:5/740: chown d1/d11/d64/d82/d8f/ldd 51444 1 2024-09-13T22:09:08.198 INFO:tasks.workunit.client.1.smithi159.stdout:6/785: symlink d3/da/lf8 0 2024-09-13T22:09:08.198 INFO:tasks.workunit.client.1.smithi159.stdout:6/786: write d3/da/d29/d1a/fc8 [491614,77256] 0 2024-09-13T22:09:08.199 INFO:tasks.workunit.client.1.smithi159.stdout:0/829: mkdir d0/d48/d4f/d66/d75/d114 0 2024-09-13T22:09:08.199 INFO:tasks.workunit.client.1.smithi159.stdout:0/830: dread - d0/d5e/d91/fd0 zero size 2024-09-13T22:09:08.201 INFO:tasks.workunit.client.1.smithi159.stdout:1/889: dread dd/d11/d13/d4b/f5b [0,4194304] 0 2024-09-13T22:09:08.201 INFO:tasks.workunit.client.1.smithi159.stdout:1/890: chown dd/d1e/d58/da7/de1/ded/ff3 2 1 2024-09-13T22:09:08.218 INFO:tasks.workunit.client.1.smithi159.stdout:0/831: rename d0/d5e/f6f to d0/d48/d4f/d54/dac/f115 0 2024-09-13T22:09:08.219 INFO:tasks.workunit.client.1.smithi159.stdout:5/741: dwrite d1/d11/d50/fbd [0,4194304] 0 2024-09-13T22:09:08.220 INFO:tasks.workunit.client.1.smithi159.stdout:5/742: truncate d1/d11/d1c/dd2/f88 2549984 0 2024-09-13T22:09:08.221 INFO:tasks.workunit.client.1.smithi159.stdout:5/743: dread d1/d11/d1c/dd2/fc5 [0,4194304] 0 2024-09-13T22:09:08.221 INFO:tasks.workunit.client.1.smithi159.stdout:5/744: chown d1/d11/d64/f3f 280285379 1 2024-09-13T22:09:08.223 INFO:tasks.workunit.client.1.smithi159.stdout:0/832: mkdir d0/d2c/d96/da1/d116 0 2024-09-13T22:09:08.225 INFO:tasks.workunit.client.1.smithi159.stdout:0/833: dread d0/d48/d4f/d2b/da3/ff0 [0,4194304] 0 2024-09-13T22:09:08.226 INFO:tasks.workunit.client.1.smithi159.stdout:0/834: readlink d0/d48/d4f/d2b/la6 0 2024-09-13T22:09:08.227 INFO:tasks.workunit.client.1.smithi159.stdout:5/745: mkdir d1/d11/d1c/dd2/d44/dd8/df2 0 2024-09-13T22:09:08.227 INFO:tasks.workunit.client.1.smithi159.stdout:5/746: truncate d1/d11/d1c/d32/f3a 5127578 0 2024-09-13T22:09:08.229 INFO:tasks.workunit.client.1.smithi159.stdout:1/891: rmdir dd/d1e/d58/da7 39 2024-09-13T22:09:08.233 INFO:tasks.workunit.client.1.smithi159.stdout:0/835: creat d0/dfe/f117 x:0 0 0 2024-09-13T22:09:08.233 INFO:tasks.workunit.client.1.smithi159.stdout:0/836: stat d0/d5e/c56 0 2024-09-13T22:09:08.239 INFO:tasks.workunit.client.1.smithi159.stdout:6/787: dwrite d3/da/d25/f4b [0,4194304] 0 2024-09-13T22:09:08.239 INFO:tasks.workunit.client.1.smithi159.stdout:6/788: write d3/da/d29/d1a/f94 [1156603,32952] 0 2024-09-13T22:09:08.239 INFO:tasks.workunit.client.1.smithi159.stdout:6/789: stat d3/da/d29/d1a/d3e/d5a/f9c 0 2024-09-13T22:09:08.240 INFO:tasks.workunit.client.1.smithi159.stdout:6/790: write d3/d2a/d3c/fc3 [1159169,965] 0 2024-09-13T22:09:08.243 INFO:tasks.workunit.client.1.smithi159.stdout:6/791: dread d3/f27 [0,4194304] 0 2024-09-13T22:09:08.247 INFO:tasks.workunit.client.1.smithi159.stdout:0/837: read d0/d2c/d96/feb [3133922,38954] 0 2024-09-13T22:09:08.247 INFO:tasks.workunit.client.1.smithi159.stdout:6/792: dread d3/fc6 [0,4194304] 0 2024-09-13T22:09:08.250 INFO:tasks.workunit.client.1.smithi159.stdout:6/793: truncate d3/da/d29/d26/f37 2965576 0 2024-09-13T22:09:08.250 INFO:tasks.workunit.client.1.smithi159.stdout:6/794: write d3/da/d29/fca [679587,56955] 0 2024-09-13T22:09:08.259 INFO:tasks.workunit.client.1.smithi159.stdout:4/923: sync 2024-09-13T22:09:08.259 INFO:tasks.workunit.client.1.smithi159.stdout:4/924: chown d13/d41/fe2 20 1 2024-09-13T22:09:08.260 INFO:tasks.workunit.client.1.smithi159.stdout:4/925: mkdir d13/d41/d135/d107/d14a 0 2024-09-13T22:09:08.263 INFO:tasks.workunit.client.1.smithi159.stdout:4/926: mkdir d13/d15/d26/d51/d65/d67/dd1/d14b 0 2024-09-13T22:09:08.265 INFO:tasks.workunit.client.1.smithi159.stdout:4/927: mknod d13/d41/d7e/d126/deb/c14c 0 2024-09-13T22:09:08.265 INFO:tasks.workunit.client.1.smithi159.stdout:4/928: truncate d13/d15/d26/d29/fd7 590419 0 2024-09-13T22:09:08.266 INFO:tasks.workunit.client.1.smithi159.stdout:4/929: stat d13/d20/lcb 0 2024-09-13T22:09:08.266 INFO:tasks.workunit.client.1.smithi159.stdout:5/747: dwrite d1/d11/d64/f3f [4194304,4194304] 0 2024-09-13T22:09:08.267 INFO:tasks.workunit.client.1.smithi159.stdout:2/554: getdents d9/d65/d40 0 2024-09-13T22:09:08.267 INFO:tasks.workunit.client.1.smithi159.stdout:2/555: dread - d9/d44/f46 zero size 2024-09-13T22:09:08.267 INFO:tasks.workunit.client.1.smithi159.stdout:2/556: chown d9/d37 51 1 2024-09-13T22:09:08.267 INFO:tasks.workunit.client.1.smithi159.stdout:2/557: dread - d9/d65/d40/fac zero size 2024-09-13T22:09:08.267 INFO:tasks.workunit.client.1.smithi159.stdout:2/558: getdents d9/d65/d40 0 2024-09-13T22:09:08.267 INFO:tasks.workunit.client.1.smithi159.stdout:2/559: stat d9/d65/d40/d69/fbf 0 2024-09-13T22:09:08.270 INFO:tasks.workunit.client.1.smithi159.stdout:1/892: dwrite dd/d11/d13/d10b/f98 [0,4194304] 0 2024-09-13T22:09:08.270 INFO:tasks.workunit.client.1.smithi159.stdout:1/893: write dd/d11/d13/d10b/f107 [635496,30191] 0 2024-09-13T22:09:08.270 INFO:tasks.workunit.client.1.smithi159.stdout:5/748: getdents d1/d11/d1c/dd2/d44 0 2024-09-13T22:09:08.271 INFO:tasks.workunit.client.1.smithi159.stdout:5/749: fdatasync d1/d11/d50/fb7 0 2024-09-13T22:09:08.271 INFO:tasks.workunit.client.1.smithi159.stdout:2/560: symlink d9/d65/d8d/lc2 0 2024-09-13T22:09:08.273 INFO:tasks.workunit.client.1.smithi159.stdout:1/894: rename dd/d1e/d58/d8a/ffb to dd/d11/d18/f124 0 2024-09-13T22:09:08.275 INFO:tasks.workunit.client.1.smithi159.stdout:1/895: rmdir dd/d1c 39 2024-09-13T22:09:08.275 INFO:tasks.workunit.client.1.smithi159.stdout:1/896: chown dd/d11/d13/c4c 1157 1 2024-09-13T22:09:08.276 INFO:tasks.workunit.client.1.smithi159.stdout:1/897: symlink dd/dcc/l125 0 2024-09-13T22:09:08.276 INFO:tasks.workunit.client.1.smithi159.stdout:1/898: chown dd/d11/d18/d49/d2d/d62/d7d/cb5 1487 1 2024-09-13T22:09:08.276 INFO:tasks.workunit.client.1.smithi159.stdout:1/899: readlink dd/d11/d18/le5 0 2024-09-13T22:09:08.276 INFO:tasks.workunit.client.1.smithi159.stdout:1/900: fsync dd/d1e/d58/d8a/dbb/da4/f105 0 2024-09-13T22:09:08.277 INFO:tasks.workunit.client.1.smithi159.stdout:1/901: write dd/f16 [359760,33234] 0 2024-09-13T22:09:08.277 INFO:tasks.workunit.client.1.smithi159.stdout:0/838: dwrite d0/d48/d4f/d54/d74/dbe/fe4 [0,4194304] 0 2024-09-13T22:09:08.277 INFO:tasks.workunit.client.1.smithi159.stdout:4/930: write d13/d15/d26/fa2 [510632,33035] 0 2024-09-13T22:09:08.278 INFO:tasks.workunit.client.1.smithi159.stdout:2/561: dread d9/da/f7d [0,4194304] 0 2024-09-13T22:09:08.278 INFO:tasks.workunit.client.1.smithi159.stdout:6/795: dwrite d3/d2a/d3c/d46/dde/ff6 [0,4194304] 0 2024-09-13T22:09:08.280 INFO:tasks.workunit.client.1.smithi159.stdout:1/902: mknod dd/d11/d18/d49/d2d/d62/c126 0 2024-09-13T22:09:08.286 INFO:tasks.workunit.client.1.smithi159.stdout:5/750: write d1/d11/d1c/dd2/fc3 [3275912,123252] 0 2024-09-13T22:09:08.286 INFO:tasks.workunit.client.1.smithi159.stdout:5/751: fdatasync d1/d11/d64/d82/d8f/fbe 0 2024-09-13T22:09:08.286 INFO:tasks.workunit.client.1.smithi159.stdout:5/752: fsync d1/d11/d64/d35/f57 0 2024-09-13T22:09:08.286 INFO:tasks.workunit.client.1.smithi159.stdout:4/931: rename d13/d41/d50/cff to d13/d11f/d133/c14d 0 2024-09-13T22:09:08.286 INFO:tasks.workunit.client.1.smithi159.stdout:4/932: dread - d13/d11f/f130 zero size 2024-09-13T22:09:08.287 INFO:tasks.workunit.client.1.smithi159.stdout:4/933: chown d13/d41/d7e/d126/f78 289 1 2024-09-13T22:09:08.289 INFO:tasks.workunit.client.1.smithi159.stdout:6/796: mknod d3/da/d29/d1a/d3e/d5a/d6a/cf9 0 2024-09-13T22:09:08.290 INFO:tasks.workunit.client.1.smithi159.stdout:1/903: getdents dd/d11/d18/d74/def 0 2024-09-13T22:09:08.294 INFO:tasks.workunit.client.1.smithi159.stdout:5/753: creat d1/d11/d1c/ff3 x:0 0 0 2024-09-13T22:09:08.294 INFO:tasks.workunit.client.1.smithi159.stdout:5/754: dread - d1/d11/d50/fe5 zero size 2024-09-13T22:09:08.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/934: link d13/d20/l96 d13/d15/l14e 0 2024-09-13T22:09:08.295 INFO:tasks.workunit.client.1.smithi159.stdout:4/935: dread - d13/ffd zero size 2024-09-13T22:09:08.298 INFO:tasks.workunit.client.1.smithi159.stdout:6/797: rename d3/d2a/d9b/lf7 to d3/da/d25/d69/lfa 0 2024-09-13T22:09:08.303 INFO:tasks.workunit.client.1.smithi159.stdout:4/936: link d13/d15/d26/d29/fd7 d13/d15/d26/f14f 0 2024-09-13T22:09:08.303 INFO:tasks.workunit.client.1.smithi159.stdout:6/798: symlink d3/d2a/d3c/d46/d73/df1/lfb 0 2024-09-13T22:09:08.303 INFO:tasks.workunit.client.1.smithi159.stdout:6/799: stat d3/d2a/d9b 0 2024-09-13T22:09:08.303 INFO:tasks.workunit.client.1.smithi159.stdout:6/800: fdatasync d3/da/d29/d1a/d3e/d5a/dbb/ff2 0 2024-09-13T22:09:08.303 INFO:tasks.workunit.client.1.smithi159.stdout:4/937: read d13/d15/d26/f33 [538552,131018] 0 2024-09-13T22:09:08.303 INFO:tasks.workunit.client.1.smithi159.stdout:6/801: fdatasync d3/d2a/d3c/d46/d73/f77 0 2024-09-13T22:09:08.306 INFO:tasks.workunit.client.1.smithi159.stdout:1/904: dread dd/d11/d13/fc9 [4194304,4194304] 0 2024-09-13T22:09:08.309 INFO:tasks.workunit.client.1.smithi159.stdout:5/755: dread d1/fad [0,4194304] 0 2024-09-13T22:09:08.310 INFO:tasks.workunit.client.1.smithi159.stdout:6/802: dread d3/da/f42 [0,4194304] 0 2024-09-13T22:09:08.310 INFO:tasks.workunit.client.1.smithi159.stdout:6/803: chown d3/da/d29/d1a/d3e/d5a/d6a/c87 1162001523 1 2024-09-13T22:09:08.310 INFO:tasks.workunit.client.1.smithi159.stdout:1/905: link dd/d11/d18/d74/d82/d9a/fa3 dd/d1e/d58/db4/f127 0 2024-09-13T22:09:08.311 INFO:tasks.workunit.client.1.smithi159.stdout:1/906: write dd/d1e/d58/d8a/dbb/f43 [915314,119104] 0 2024-09-13T22:09:08.312 INFO:tasks.workunit.client.1.smithi159.stdout:7/742: rmdir d3 39 2024-09-13T22:09:08.314 INFO:tasks.workunit.client.1.smithi159.stdout:7/743: creat d3/d2e/db6/d6c/ffa x:0 0 0 2024-09-13T22:09:08.318 INFO:tasks.workunit.client.1.smithi159.stdout:1/907: write dd/d1c/f86 [1203724,47037] 0 2024-09-13T22:09:08.323 INFO:tasks.workunit.client.1.smithi159.stdout:1/908: dread dd/d11/d18/d74/d82/d9a/fa3 [0,4194304] 0 2024-09-13T22:09:08.323 INFO:tasks.workunit.client.1.smithi159.stdout:1/909: dread - dd/d11/d18/d49/f8f zero size 2024-09-13T22:09:08.323 INFO:tasks.workunit.client.1.smithi159.stdout:6/804: dread d3/da/d29/d1a/d3e/d5a/dbb/ff2 [0,4194304] 0 2024-09-13T22:09:08.324 INFO:tasks.workunit.client.1.smithi159.stdout:2/562: dwrite d9/d65/f60 [0,4194304] 0 2024-09-13T22:09:08.324 INFO:tasks.workunit.client.1.smithi159.stdout:2/563: fsync d9/da/d25/f35 0 2024-09-13T22:09:08.326 INFO:tasks.workunit.client.1.smithi159.stdout:1/910: mknod dd/d1e/d58/da7/c128 0 2024-09-13T22:09:08.326 INFO:tasks.workunit.client.1.smithi159.stdout:0/839: dwrite d0/d48/d4f/d54/d74/f73 [4194304,4194304] 0 2024-09-13T22:09:08.326 INFO:tasks.workunit.client.1.smithi159.stdout:0/840: readlink d0/d48/d7d/dca/le0 0 2024-09-13T22:09:08.328 INFO:tasks.workunit.client.1.smithi159.stdout:6/805: mknod d3/da/d29/d26/d6c/cfc 0 2024-09-13T22:09:08.330 INFO:tasks.workunit.client.1.smithi159.stdout:2/564: symlink d9/d48/d77/da6/lc3 0 2024-09-13T22:09:08.335 INFO:tasks.workunit.client.1.smithi159.stdout:2/565: dread d9/da/f7b [0,4194304] 0 2024-09-13T22:09:08.335 INFO:tasks.workunit.client.1.smithi159.stdout:6/806: mkdir d3/da/d29/d26/d6c/d6e/dfd 0 2024-09-13T22:09:08.335 INFO:tasks.workunit.client.1.smithi159.stdout:6/807: fdatasync d3/d2a/d3c/f4f 0 2024-09-13T22:09:08.336 INFO:tasks.workunit.client.1.smithi159.stdout:6/808: truncate d3/da/d29/d1a/f1c 4460949 0 2024-09-13T22:09:08.336 INFO:tasks.workunit.client.1.smithi159.stdout:7/744: dread d3/d18/f9c [0,4194304] 0 2024-09-13T22:09:08.338 INFO:tasks.workunit.client.1.smithi159.stdout:2/566: symlink d9/da/d5a/lc4 0 2024-09-13T22:09:08.341 INFO:tasks.workunit.client.1.smithi159.stdout:4/938: dwrite d13/ffd [0,4194304] 0 2024-09-13T22:09:08.341 INFO:tasks.workunit.client.1.smithi159.stdout:4/939: dread - d13/d15/d26/d29/d3b/d8e/fdb zero size 2024-09-13T22:09:08.342 INFO:tasks.workunit.client.1.smithi159.stdout:7/745: rename d3/dab/dcc to d3/d31/d4d/d9e/dfb 0 2024-09-13T22:09:08.342 INFO:tasks.workunit.client.1.smithi159.stdout:7/746: write d3/ff8 [613117,36654] 0 2024-09-13T22:09:08.347 INFO:tasks.workunit.client.1.smithi159.stdout:2/567: symlink d9/d44/lc5 0 2024-09-13T22:09:08.347 INFO:tasks.workunit.client.1.smithi159.stdout:2/568: dread - d9/d65/d40/fac zero size 2024-09-13T22:09:08.349 INFO:tasks.workunit.client.1.smithi159.stdout:1/911: dread dd/d11/d18/d49/d2d/d62/f75 [0,4194304] 0 2024-09-13T22:09:08.350 INFO:tasks.workunit.client.1.smithi159.stdout:4/940: getdents d13/d41/d135 0 2024-09-13T22:09:08.358 INFO:tasks.workunit.client.1.smithi159.stdout:1/912: mknod dd/d11/d13/c129 0 2024-09-13T22:09:08.360 INFO:tasks.workunit.client.1.smithi159.stdout:6/809: dwrite d3/da/d29/d1a/d3e/d5a/d6a/fef [0,4194304] 0 2024-09-13T22:09:08.360 INFO:tasks.workunit.client.1.smithi159.stdout:6/810: write d3/da/d29/d1a/d3e/d5a/f78 [1427755,91868] 0 2024-09-13T22:09:08.361 INFO:tasks.workunit.client.1.smithi159.stdout:2/569: write d9/d44/f8a [3119504,4407] 0 2024-09-13T22:09:08.361 INFO:tasks.workunit.client.1.smithi159.stdout:2/570: creat d9/d92/fc6 x:0 0 0 2024-09-13T22:09:08.369 INFO:tasks.workunit.client.1.smithi159.stdout:5/756: write d1/d11/d9e/f26 [2892600,56140] 0 2024-09-13T22:09:08.369 INFO:tasks.workunit.client.1.smithi159.stdout:5/757: stat d1/d11/d9e/l4e 0 2024-09-13T22:09:08.370 INFO:tasks.workunit.client.1.smithi159.stdout:4/941: mkdir d13/d15/d26/d51/d65/d150 0 2024-09-13T22:09:08.374 INFO:tasks.workunit.client.1.smithi159.stdout:7/747: link d3/d2e/d6e/c79 d3/d2e/db6/d6c/db2/dbc/cfc 0 2024-09-13T22:09:08.374 INFO:tasks.workunit.client.1.smithi159.stdout:7/748: write d3/d3f/fa1 [4281125,116543] 0 2024-09-13T22:09:08.374 INFO:tasks.workunit.client.1.smithi159.stdout:7/749: chown d3/d31/l38 14254306 1 2024-09-13T22:09:08.376 INFO:tasks.workunit.client.1.smithi159.stdout:6/811: dread d3/da/d29/d26/d6c/f76 [0,4194304] 0 2024-09-13T22:09:08.376 INFO:tasks.workunit.client.1.smithi159.stdout:6/812: dread - d3/da/d29/d1a/d3e/d5a/f88 zero size 2024-09-13T22:09:08.376 INFO:tasks.workunit.client.1.smithi159.stdout:1/913: link dd/d1e/d58/d5f/f7c dd/d11/f12a 0 2024-09-13T22:09:08.386 INFO:tasks.workunit.client.1.smithi159.stdout:5/758: write d1/d11/d64/d82/d8c/fc2 [1834316,99635] 0 2024-09-13T22:09:08.386 INFO:tasks.workunit.client.1.smithi159.stdout:5/759: write d1/f96 [4431171,94780] 0 2024-09-13T22:09:08.386 INFO:tasks.workunit.client.1.smithi159.stdout:5/760: creat d1/d11/d64/d35/d7c/d7d/ff4 x:0 0 0 2024-09-13T22:09:08.386 INFO:tasks.workunit.client.1.smithi159.stdout:5/761: fsync d1/d11/d64/d35/d60/fa3 0 2024-09-13T22:09:08.391 INFO:tasks.workunit.client.1.smithi159.stdout:2/571: rename d9/d65/d40/f45 to d9/d2d/db5/fc7 0 2024-09-13T22:09:08.394 INFO:tasks.workunit.client.1.smithi159.stdout:1/914: symlink dd/d1c/l12b 0 2024-09-13T22:09:08.400 INFO:tasks.workunit.client.1.smithi159.stdout:5/762: creat d1/d11/d1c/dd2/d44/ff5 x:0 0 0 2024-09-13T22:09:08.400 INFO:tasks.workunit.client.1.smithi159.stdout:5/763: write d1/d11/d1c/dd2/d44/d85/fdc [414463,52499] 0 2024-09-13T22:09:08.405 INFO:tasks.workunit.client.1.smithi159.stdout:6/813: dwrite d3/da/d29/d1a/d3e/d5a/fba [0,4194304] 0 2024-09-13T22:09:08.405 INFO:tasks.workunit.client.1.smithi159.stdout:6/814: write d3/f23 [4669252,97144] 0 2024-09-13T22:09:08.413 INFO:tasks.workunit.client.1.smithi159.stdout:6/815: dread d3/d2a/d3c/d46/fcf [0,4194304] 0 2024-09-13T22:09:08.413 INFO:tasks.workunit.client.1.smithi159.stdout:4/942: rename d13/d9b/fc2 to d13/d15/d26/d29/d3b/de1/f151 0 2024-09-13T22:09:08.414 INFO:tasks.workunit.client.1.smithi159.stdout:2/572: mknod d9/d92/cc8 0 2024-09-13T22:09:08.415 INFO:tasks.workunit.client.1.smithi159.stdout:1/915: unlink dd/d11/d13/d4b/d52/d63/c96 0 2024-09-13T22:09:08.416 INFO:tasks.workunit.client.1.smithi159.stdout:5/764: mknod d1/d11/d1c/cf6 0 2024-09-13T22:09:08.416 INFO:tasks.workunit.client.1.smithi159.stdout:5/765: readlink d1/d11/d64/de8/lb0 0 2024-09-13T22:09:08.419 INFO:tasks.workunit.client.1.smithi159.stdout:6/816: rmdir d3/da/d25/d69/d96/df4 0 2024-09-13T22:09:08.421 INFO:tasks.workunit.client.1.smithi159.stdout:4/943: rename d13/d15/d26/d51/l13f to d13/d41/d7e/d126/l152 0 2024-09-13T22:09:08.422 INFO:tasks.workunit.client.1.smithi159.stdout:2/573: mkdir d9/d65/d40/d69/dc9 0 2024-09-13T22:09:08.424 INFO:tasks.workunit.client.1.smithi159.stdout:1/916: symlink dd/d11/d18/d49/d2d/d62/d7d/de8/l12c 0 2024-09-13T22:09:08.424 INFO:tasks.workunit.client.1.smithi159.stdout:1/917: chown dd/d11/d13/d10b/f98 163539120 1 2024-09-13T22:09:08.424 INFO:tasks.workunit.client.1.smithi159.stdout:1/918: truncate dd/d1e/d58/d5f/fda 4031235 0 2024-09-13T22:09:08.425 INFO:tasks.workunit.client.1.smithi159.stdout:4/944: dread d13/d41/d79/f7c [0,4194304] 0 2024-09-13T22:09:08.425 INFO:tasks.workunit.client.1.smithi159.stdout:5/766: symlink d1/d11/d64/d35/d60/lf7 0 2024-09-13T22:09:08.431 INFO:tasks.workunit.client.1.smithi159.stdout:6/817: rename d3/da/d29/d26/d6c/c7c to d3/da/d25/d69/d96/cfe 0 2024-09-13T22:09:08.450 INFO:tasks.workunit.client.1.smithi159.stdout:2/574: dwrite d9/d37/fa8 [0,4194304] 0 2024-09-13T22:09:08.451 INFO:tasks.workunit.client.1.smithi159.stdout:5/767: dwrite d1/d11/d64/d35/d7c/ff0 [0,4194304] 0 2024-09-13T22:09:08.452 INFO:tasks.workunit.client.1.smithi159.stdout:5/768: write d1/d11/d50/fe7 [1020055,62490] 0 2024-09-13T22:09:08.452 INFO:tasks.workunit.client.1.smithi159.stdout:5/769: write d1/d11/d50/fb7 [503124,8350] 0 2024-09-13T22:09:08.461 INFO:tasks.workunit.client.1.smithi159.stdout:2/575: write d9/d92/f9e [1642830,10192] 0 2024-09-13T22:09:08.461 INFO:tasks.workunit.client.1.smithi159.stdout:4/945: symlink d13/d15/d5a/l153 0 2024-09-13T22:09:08.463 INFO:tasks.workunit.client.1.smithi159.stdout:5/770: write d1/d11/d9e/f31 [3180317,83649] 0 2024-09-13T22:09:08.463 INFO:tasks.workunit.client.1.smithi159.stdout:5/771: dread - d1/d11/d64/d82/d8f/f79 zero size 2024-09-13T22:09:08.463 INFO:tasks.workunit.client.1.smithi159.stdout:5/772: creat d1/d11/d1c/dd2/d53/ff8 x:0 0 0 2024-09-13T22:09:08.464 INFO:tasks.workunit.client.1.smithi159.stdout:6/818: dwrite d3/da/d29/d1a/da3/da5/fab [0,4194304] 0 2024-09-13T22:09:08.464 INFO:tasks.workunit.client.1.smithi159.stdout:6/819: write d3/da/d29/d26/f37 [3384793,4040] 0 2024-09-13T22:09:08.519 INFO:tasks.workunit.client.1.smithi159.stdout:1/919: rmdir dd/d11/d18/d74/def/dfa 39 2024-09-13T22:09:08.530 INFO:tasks.workunit.client.1.smithi159.stdout:1/920: symlink dd/d11/d13/d4b/d52/d63/l12d 0 2024-09-13T22:09:08.532 INFO:tasks.workunit.client.1.smithi159.stdout:2/576: mkdir d9/d65/dca 0 2024-09-13T22:09:08.532 INFO:tasks.workunit.client.1.smithi159.stdout:2/577: write d9/d48/d77/f9b [952187,40705] 0 2024-09-13T22:09:08.534 INFO:tasks.workunit.client.1.smithi159.stdout:2/578: write d9/d65/f6c [1304212,24795] 0 2024-09-13T22:09:08.537 INFO:tasks.workunit.client.1.smithi159.stdout:1/921: rmdir dd/d11/d18/d49/d2d/d62/d7d 39 2024-09-13T22:09:08.539 INFO:tasks.workunit.client.1.smithi159.stdout:2/579: mknod d9/d65/dca/ccb 0 2024-09-13T22:09:08.539 INFO:tasks.workunit.client.1.smithi159.stdout:2/580: dread - d9/d65/d40/fc0 zero size 2024-09-13T22:09:08.543 INFO:tasks.workunit.client.1.smithi159.stdout:1/922: mknod dd/d11/d18/d49/d2d/d62/d7d/df6/c12e 0 2024-09-13T22:09:08.557 INFO:tasks.workunit.client.1.smithi159.stdout:2/581: dwrite d9/d2d/f78 [0,4194304] 0 2024-09-13T22:09:08.557 INFO:tasks.workunit.client.1.smithi159.stdout:2/582: creat d9/d92/fcc x:0 0 0 2024-09-13T22:09:08.557 INFO:tasks.workunit.client.1.smithi159.stdout:2/583: fsync d9/d48/d77/da6/db0/fbd 0 2024-09-13T22:09:08.557 INFO:tasks.workunit.client.1.smithi159.stdout:2/584: chown d9/da/d82/f93 252 1 2024-09-13T22:09:08.561 INFO:tasks.workunit.client.1.smithi159.stdout:2/585: creat d9/d48/d77/da6/fcd x:0 0 0 2024-09-13T22:09:08.561 INFO:tasks.workunit.client.1.smithi159.stdout:2/586: fdatasync d9/da/d25/f34 0 2024-09-13T22:09:08.562 INFO:tasks.workunit.client.1.smithi159.stdout:2/587: mkdir d9/d65/d40/d69/dab/dce 0 2024-09-13T22:09:08.563 INFO:tasks.workunit.client.1.smithi159.stdout:2/588: symlink d9/d65/dca/lcf 0 2024-09-13T22:09:08.577 INFO:tasks.workunit.client.1.smithi159.stdout:4/946: rename d13/d41/d7e/d126/cb3 to d13/d41/d135/c154 0 2024-09-13T22:09:08.577 INFO:tasks.workunit.client.1.smithi159.stdout:4/947: truncate d13/d41/d79/db2/dd5/f136 358796 0 2024-09-13T22:09:08.577 INFO:tasks.workunit.client.1.smithi159.stdout:4/948: creat d13/d41/d79/db2/dd5/f155 x:0 0 0 2024-09-13T22:09:08.595 INFO:tasks.workunit.client.1.smithi159.stdout:2/589: getdents d9/d65/d40/d69/dab 0 2024-09-13T22:09:08.596 INFO:tasks.workunit.client.1.smithi159.stdout:2/590: symlink d9/d48/d77/da6/db0/ld0 0 2024-09-13T22:09:08.596 INFO:tasks.workunit.client.1.smithi159.stdout:2/591: chown d9/d92 2444 1 2024-09-13T22:09:08.597 INFO:tasks.workunit.client.1.smithi159.stdout:4/949: dwrite d13/d15/f17 [0,4194304] 0 2024-09-13T22:09:08.597 INFO:tasks.workunit.client.1.smithi159.stdout:2/592: unlink d9/d37/f7f 0 2024-09-13T22:09:08.600 INFO:tasks.workunit.client.1.smithi159.stdout:5/773: rename d1/d11/d64/d35/d60/fc8 to d1/d11/d64/d35/d7c/ff9 0 2024-09-13T22:09:08.600 INFO:tasks.workunit.client.1.smithi159.stdout:5/774: write d1/d11/d64/d82/d8c/fd3 [934532,55497] 0 2024-09-13T22:09:08.602 INFO:tasks.workunit.client.1.smithi159.stdout:2/593: dread d9/d48/f7c [0,4194304] 0 2024-09-13T22:09:08.603 INFO:tasks.workunit.client.1.smithi159.stdout:6/820: rename d3/da/d29/d26/d6c/d6e/da9/ff3 to d3/d2a/d9b/fff 0 2024-09-13T22:09:08.608 INFO:tasks.workunit.client.1.smithi159.stdout:1/923: rename dd/d11/d13/d4b/d52/d63 to dd/d1e/d58/d8a/dbb/d3c/d95/df5/dfd/d12f 0 2024-09-13T22:09:08.610 INFO:tasks.workunit.client.1.smithi159.stdout:5/775: dread d1/d11/d1c/d32/f3a [0,4194304] 0 2024-09-13T22:09:08.610 INFO:tasks.workunit.client.1.smithi159.stdout:5/776: write d1/d11/d64/d35/f57 [1355494,85548] 0 2024-09-13T22:09:08.610 INFO:tasks.workunit.client.1.smithi159.stdout:6/821: rename d3/d2a/d3c/d46/fcf to d3/d2a/d3c/f100 0 2024-09-13T22:09:08.612 INFO:tasks.workunit.client.1.smithi159.stdout:2/594: write d9/da/f2a [2455344,80477] 0 2024-09-13T22:09:08.612 INFO:tasks.workunit.client.1.smithi159.stdout:2/595: truncate d9/da/d5a/f63 4357020 0 2024-09-13T22:09:08.612 INFO:tasks.workunit.client.1.smithi159.stdout:1/924: truncate dd/d1e/d58/db4/f127 1130072 0 2024-09-13T22:09:08.612 INFO:tasks.workunit.client.1.smithi159.stdout:1/925: dread - dd/d11/d13/ff9 zero size 2024-09-13T22:09:08.612 INFO:tasks.workunit.client.1.smithi159.stdout:1/926: dread - dd/d11/d18/f57 zero size 2024-09-13T22:09:08.612 INFO:tasks.workunit.client.1.smithi159.stdout:2/596: read d9/d65/d40/d69/fbf [81731,62238] 0 2024-09-13T22:09:08.612 INFO:tasks.workunit.client.1.smithi159.stdout:2/597: stat d9/d48/d77/l79 0 2024-09-13T22:09:08.613 INFO:tasks.workunit.client.1.smithi159.stdout:4/950: dwrite d13/d15/d26/d29/d3b/d8e/fca [0,4194304] 0 2024-09-13T22:09:08.614 INFO:tasks.workunit.client.1.smithi159.stdout:5/777: unlink d1/d11/d1c/d32/le2 0 2024-09-13T22:09:08.615 INFO:tasks.workunit.client.1.smithi159.stdout:6/822: rename d3/da/d29/d1a/d3e/d5a/f78 to d3/d64/f101 0 2024-09-13T22:09:08.617 INFO:tasks.workunit.client.1.smithi159.stdout:1/927: truncate dd/f16 1779368 0 2024-09-13T22:09:08.618 INFO:tasks.workunit.client.1.smithi159.stdout:2/598: symlink d9/d48/d77/da6/db0/ld1 0 2024-09-13T22:09:08.622 INFO:tasks.workunit.client.1.smithi159.stdout:4/951: creat d13/d15/d26/d29/d3b/de1/d118/f156 x:0 0 0 2024-09-13T22:09:08.622 INFO:tasks.workunit.client.1.smithi159.stdout:4/952: truncate d13/d41/d4d/f104 138986 0 2024-09-13T22:09:08.623 INFO:tasks.workunit.client.1.smithi159.stdout:4/953: dread - d13/fb6 zero size 2024-09-13T22:09:08.623 INFO:tasks.workunit.client.1.smithi159.stdout:4/954: read d13/d15/d26/d51/d65/f70 [2108690,111542] 0 2024-09-13T22:09:08.623 INFO:tasks.workunit.client.1.smithi159.stdout:7/750: sync 2024-09-13T22:09:08.623 INFO:tasks.workunit.client.1.smithi159.stdout:8/921: sync 2024-09-13T22:09:08.623 INFO:tasks.workunit.client.1.smithi159.stdout:9/656: sync 2024-09-13T22:09:08.623 INFO:tasks.workunit.client.1.smithi159.stdout:0/841: sync 2024-09-13T22:09:08.623 INFO:tasks.workunit.client.1.smithi159.stdout:3/617: sync 2024-09-13T22:09:08.623 INFO:tasks.workunit.client.1.smithi159.stdout:0/842: chown d0/d2c/d71/dc3/f106 930835640 1 2024-09-13T22:09:08.625 INFO:tasks.workunit.client.1.smithi159.stdout:4/955: dread d13/d15/d26/d51/d65/d67/d82/fce [0,4194304] 0 2024-09-13T22:09:08.627 INFO:tasks.workunit.client.1.smithi159.stdout:6/823: symlink d3/d64/dc1/l102 0 2024-09-13T22:09:08.627 INFO:tasks.workunit.client.1.smithi159.stdout:6/824: stat d3/d64/f101 0 2024-09-13T22:09:08.627 INFO:tasks.workunit.client.1.smithi159.stdout:6/825: write d3/da/d25/d69/d96/deb/fb2 [2288972,13989] 0 2024-09-13T22:09:08.630 INFO:tasks.workunit.client.1.smithi159.stdout:1/928: mknod dd/d1e/d58/d8a/dbb/d3c/d95/df5/dfd/c130 0 2024-09-13T22:09:08.633 INFO:tasks.workunit.client.1.smithi159.stdout:3/618: dread d0/d1/d3/d5/f88 [0,4194304] 0 2024-09-13T22:09:08.634 INFO:tasks.workunit.client.1.smithi159.stdout:2/599: mknod d9/d65/d40/d69/d66/cd2 0 2024-09-13T22:09:08.636 INFO:tasks.workunit.client.1.smithi159.stdout:7/751: rename d3/d2e/db6/d6c/db2/dce/fda to d3/d2e/ffd 0 2024-09-13T22:09:08.637 INFO:tasks.workunit.client.1.smithi159.stdout:7/752: fdatasync d3/ff 0 2024-09-13T22:09:08.638 INFO:tasks.workunit.client.1.smithi159.stdout:8/922: mkdir da/d7e/d82/d6f/d9a/d13e 0 2024-09-13T22:09:08.639 INFO:tasks.workunit.client.1.smithi159.stdout:5/778: mkdir d1/d11/d64/d35/dfa 0 2024-09-13T22:09:08.639 INFO:tasks.workunit.client.1.smithi159.stdout:6/826: stat d3/da/d29/d26/c65 0 2024-09-13T22:09:08.644 INFO:tasks.workunit.client.1.smithi159.stdout:1/929: write dd/d11/d18/f124 [1956847,98449] 0 2024-09-13T22:09:08.644 INFO:tasks.workunit.client.1.smithi159.stdout:3/619: truncate d0/d1/d3/dd/f64 1110840 0 2024-09-13T22:09:08.646 INFO:tasks.workunit.client.1.smithi159.stdout:9/657: dwrite d1/dc/d27/da4/fd0 [0,4194304] 0 2024-09-13T22:09:08.647 INFO:tasks.workunit.client.1.smithi159.stdout:9/658: creat d1/dc/d27/da4/fe1 x:0 0 0 2024-09-13T22:09:08.647 INFO:tasks.workunit.client.1.smithi159.stdout:9/659: read - d1/d5a/fa5 zero size 2024-09-13T22:09:08.648 INFO:tasks.workunit.client.1.smithi159.stdout:6/827: creat d3/da/d29/f103 x:0 0 0 2024-09-13T22:09:08.648 INFO:tasks.workunit.client.1.smithi159.stdout:6/828: chown d3/da/d29/d1a/d3e/d5a/c84 86055938 1 2024-09-13T22:09:08.649 INFO:tasks.workunit.client.1.smithi159.stdout:1/930: mkdir dd/d1e/d58/d8a/dbb/d3c/d95/df5/d131 0 2024-09-13T22:09:08.651 INFO:tasks.workunit.client.1.smithi159.stdout:3/620: mknod d0/d1/d3/d5/d25/d7e/cc4 0 2024-09-13T22:09:08.653 INFO:tasks.workunit.client.1.smithi159.stdout:8/923: link da/d22/l6b da/d7e/d82/d6f/d9a/d13e/l13f 0 2024-09-13T22:09:08.659 INFO:tasks.workunit.client.1.smithi159.stdout:9/660: rename d1/dc/d10/c4f to d1/dc/d10/d6d/d4b/ce2 0 2024-09-13T22:09:08.659 INFO:tasks.workunit.client.1.smithi159.stdout:9/661: fdatasync d1/dc/d10/fd8 0 2024-09-13T22:09:08.660 INFO:tasks.workunit.client.1.smithi159.stdout:5/779: creat d1/d11/d64/d17/ffb x:0 0 0 2024-09-13T22:09:08.661 INFO:tasks.workunit.client.1.smithi159.stdout:6/829: write d3/da/d29/d1a/d3e/f55 [74888,49011] 0 2024-09-13T22:09:08.661 INFO:tasks.workunit.client.1.smithi159.stdout:6/830: write d3/da/d25/d69/fcc [1484172,111161] 0 2024-09-13T22:09:08.662 INFO:tasks.workunit.client.1.smithi159.stdout:3/621: truncate d0/d1/d3/d5/f88 4086810 0 2024-09-13T22:09:08.665 INFO:tasks.workunit.client.1.smithi159.stdout:8/924: mkdir da/d7e/d82/dd8/d140 0 2024-09-13T22:09:08.665 INFO:tasks.workunit.client.1.smithi159.stdout:2/600: dwrite d9/da/f4d [0,4194304] 0 2024-09-13T22:09:08.668 INFO:tasks.workunit.client.1.smithi159.stdout:6/831: mknod d3/d2a/d3c/d46/c104 0 2024-09-13T22:09:08.669 INFO:tasks.workunit.client.1.smithi159.stdout:6/832: stat d3/f27 0 2024-09-13T22:09:08.670 INFO:tasks.workunit.client.1.smithi159.stdout:2/601: symlink d9/da/d82/d89/ld3 0 2024-09-13T22:09:08.670 INFO:tasks.workunit.client.1.smithi159.stdout:7/753: dwrite d3/d31/d4d/d4e/d7a/f9b [0,4194304] 0 2024-09-13T22:09:08.671 INFO:tasks.workunit.client.1.smithi159.stdout:7/754: chown d3/d31/d4d/ff3 10985 1 2024-09-13T22:09:08.677 INFO:tasks.workunit.client.1.smithi159.stdout:5/780: mknod d1/d11/d64/d35/dfa/cfc 0 2024-09-13T22:09:08.677 INFO:tasks.workunit.client.1.smithi159.stdout:5/781: chown d1/d11/d9e/d7b/c83 696356185 1 2024-09-13T22:09:08.679 INFO:tasks.workunit.client.1.smithi159.stdout:6/833: creat d3/da/d29/d1a/da3/da5/f105 x:0 0 0 2024-09-13T22:09:08.683 INFO:tasks.workunit.client.1.smithi159.stdout:5/782: dread d1/d11/d1c/dd2/fc3 [0,4194304] 0 2024-09-13T22:09:08.685 INFO:tasks.workunit.client.1.smithi159.stdout:2/602: symlink d9/d65/d40/d69/dab/dce/ld4 0 2024-09-13T22:09:08.685 INFO:tasks.workunit.client.1.smithi159.stdout:2/603: readlink d9/d44/l6a 0 2024-09-13T22:09:08.686 INFO:tasks.workunit.client.1.smithi159.stdout:7/755: creat d3/d2e/d6e/ffe x:0 0 0 2024-09-13T22:09:08.687 INFO:tasks.workunit.client.1.smithi159.stdout:1/931: rename dd/d11/d18/d74/d82/da1 to dd/d1e/d58/d8a/dbb/d3c/d95/df5/d131/d132 0 2024-09-13T22:09:08.688 INFO:tasks.workunit.client.1.smithi159.stdout:8/925: dwrite da/fb8 [0,4194304] 0 2024-09-13T22:09:08.689 INFO:tasks.workunit.client.1.smithi159.stdout:6/834: link d3/da/d29/d1a/d3e/cdf d3/d2a/d3c/d46/d73/c106 0 2024-09-13T22:09:08.690 INFO:tasks.workunit.client.1.smithi159.stdout:7/756: mkdir d3/d31/d4d/d9e/dfb/dff 0 2024-09-13T22:09:08.690 INFO:tasks.workunit.client.1.smithi159.stdout:7/757: chown d3/d2e/db6/d6c/ffa 194 1 2024-09-13T22:09:08.690 INFO:tasks.workunit.client.1.smithi159.stdout:7/758: creat d3/d2e/d6e/f100 x:0 0 0 2024-09-13T22:09:08.691 INFO:tasks.workunit.client.1.smithi159.stdout:2/604: rename d9/d65/d40/d69/dab/cba to d9/d2d/db5/cd5 0 2024-09-13T22:09:08.695 INFO:tasks.workunit.client.1.smithi159.stdout:5/783: dread d1/d11/d64/d35/d7c/ff0 [0,4194304] 0 2024-09-13T22:09:08.695 INFO:tasks.workunit.client.1.smithi159.stdout:8/926: creat da/d22/d26/d126/f141 x:0 0 0 2024-09-13T22:09:08.697 INFO:tasks.workunit.client.1.smithi159.stdout:6/835: creat d3/da/d29/d1a/da3/f107 x:0 0 0 2024-09-13T22:09:08.700 INFO:tasks.workunit.client.1.smithi159.stdout:7/759: mknod d3/d2e/db6/c101 0 2024-09-13T22:09:08.702 INFO:tasks.workunit.client.1.smithi159.stdout:2/605: mkdir d9/da/d82/d89/dd6 0 2024-09-13T22:09:08.702 INFO:tasks.workunit.client.1.smithi159.stdout:8/927: dread f4 [0,4194304] 0 2024-09-13T22:09:08.703 INFO:tasks.workunit.client.1.smithi159.stdout:5/784: rmdir d1/d11/d64/d35/d60 39 2024-09-13T22:09:08.703 INFO:tasks.workunit.client.1.smithi159.stdout:5/785: write d1/d11/d1c/dd2/d44/f7e [610298,112212] 0 2024-09-13T22:09:08.703 INFO:tasks.workunit.client.1.smithi159.stdout:5/786: write d1/d11/d9e/d7b/fd4 [350690,24342] 0 2024-09-13T22:09:08.705 INFO:tasks.workunit.client.1.smithi159.stdout:6/836: link d3/da/d29/d1a/d3e/d5a/cb8 d3/da/d29/d1a/d3e/d5a/c108 0 2024-09-13T22:09:08.707 INFO:tasks.workunit.client.1.smithi159.stdout:7/760: link d3/d2e/d6e/d74/dba/d5e/fa2 d3/d31/d4d/d9e/f102 0 2024-09-13T22:09:08.707 INFO:tasks.workunit.client.1.smithi159.stdout:7/761: dread - d3/d31/fdb zero size 2024-09-13T22:09:08.707 INFO:tasks.workunit.client.1.smithi159.stdout:7/762: dread - d3/d31/d4d/f99 zero size 2024-09-13T22:09:08.709 INFO:tasks.workunit.client.1.smithi159.stdout:2/606: creat d9/da/d82/d89/dd6/fd7 x:0 0 0 2024-09-13T22:09:08.710 INFO:tasks.workunit.client.1.smithi159.stdout:5/787: mknod d1/d11/d1c/dd2/d44/d85/cfd 0 2024-09-13T22:09:08.712 INFO:tasks.workunit.client.1.smithi159.stdout:6/837: symlink d3/da/d29/d1a/d3e/l109 0 2024-09-13T22:09:08.713 INFO:tasks.workunit.client.1.smithi159.stdout:7/763: stat d3/d2e/c44 0 2024-09-13T22:09:08.713 INFO:tasks.workunit.client.1.smithi159.stdout:7/764: fsync d3/d31/d4d/d4e/f51 0 2024-09-13T22:09:08.715 INFO:tasks.workunit.client.1.smithi159.stdout:6/838: symlink d3/da/d25/d69/d96/l10a 0 2024-09-13T22:09:08.715 INFO:tasks.workunit.client.1.smithi159.stdout:1/932: dwrite dd/d1e/d58/d8a/dbb/d3c/d95/df5/f120 [0,4194304] 0 2024-09-13T22:09:08.717 INFO:tasks.workunit.client.1.smithi159.stdout:6/839: mkdir d3/da/d29/d1a/d3e/d5a/d6a/d10b 0 2024-09-13T22:09:08.722 INFO:tasks.workunit.client.1.smithi159.stdout:1/933: symlink dd/d1e/d58/d8a/dbb/l133 0 2024-09-13T22:09:08.723 INFO:tasks.workunit.client.1.smithi159.stdout:1/934: chown dd/d1e/d58/da7/c128 3 1 2024-09-13T22:09:08.725 INFO:tasks.workunit.client.1.smithi159.stdout:6/840: link d3/da/d29/d1a/l51 d3/da/d29/d26/d6c/d6e/l10c 0 2024-09-13T22:09:08.726 INFO:tasks.workunit.client.1.smithi159.stdout:1/935: unlink dd/d1c/l30 0 2024-09-13T22:09:08.730 INFO:tasks.workunit.client.1.smithi159.stdout:1/936: dread dd/d11/d18/d49/d2d/f5d [0,4194304] 0 2024-09-13T22:09:08.730 INFO:tasks.workunit.client.1.smithi159.stdout:1/937: fsync dd/d1e/d58/d8a/dbb/d3c/d95/df5/d131/d132/d10d/f123 0 2024-09-13T22:09:08.735 INFO:tasks.workunit.client.1.smithi159.stdout:2/607: dwrite d9/da/d25/f35 [0,4194304] 0 2024-09-13T22:09:08.737 INFO:tasks.workunit.client.1.smithi159.stdout:6/841: write d3/da/d25/f5b [4121820,111065] 0 2024-09-13T22:09:08.738 INFO:tasks.workunit.client.1.smithi159.stdout:2/608: link d9/f38 d9/d65/d40/d69/d66/fd8 0 2024-09-13T22:09:08.738 INFO:tasks.workunit.client.1.smithi159.stdout:2/609: write d9/d48/d77/fb7 [956908,19488] 0 2024-09-13T22:09:08.738 INFO:tasks.workunit.client.1.smithi159.stdout:2/610: write d9/d48/f7c [979970,40357] 0 2024-09-13T22:09:08.738 INFO:tasks.workunit.client.1.smithi159.stdout:2/611: truncate d9/f38 2492840 0 2024-09-13T22:09:08.739 INFO:tasks.workunit.client.1.smithi159.stdout:7/765: dwrite d3/d3f/f48 [0,4194304] 0 2024-09-13T22:09:08.739 INFO:tasks.workunit.client.1.smithi159.stdout:7/766: dread d3/d2e/d6e/f86 [0,4194304] 0 2024-09-13T22:09:08.740 INFO:tasks.workunit.client.1.smithi159.stdout:2/612: creat d9/da/d25/fd9 x:0 0 0 2024-09-13T22:09:08.741 INFO:tasks.workunit.client.1.smithi159.stdout:2/613: fdatasync d9/d48/d77/da6/db0/fb6 0 2024-09-13T22:09:08.741 INFO:tasks.workunit.client.1.smithi159.stdout:2/614: fsync d9/da/d25/f34 0 2024-09-13T22:09:08.744 INFO:tasks.workunit.client.1.smithi159.stdout:7/767: creat d3/d2e/f103 x:0 0 0 2024-09-13T22:09:08.744 INFO:tasks.workunit.client.1.smithi159.stdout:7/768: fsync d3/d2e/d6e/fb5 0 2024-09-13T22:09:08.744 INFO:tasks.workunit.client.1.smithi159.stdout:1/938: dread dd/f8c [0,4194304] 0 2024-09-13T22:09:08.747 INFO:tasks.workunit.client.1.smithi159.stdout:2/615: unlink d9/d92/f9e 0 2024-09-13T22:09:08.749 INFO:tasks.workunit.client.1.smithi159.stdout:7/769: mknod d3/d31/d4d/d9e/dfb/dff/c104 0 2024-09-13T22:09:08.752 INFO:tasks.workunit.client.1.smithi159.stdout:2/616: getdents d9/d48 0 2024-09-13T22:09:08.755 INFO:tasks.workunit.client.1.smithi159.stdout:2/617: unlink d9/d65/cb4 0 2024-09-13T22:09:08.756 INFO:tasks.workunit.client.1.smithi159.stdout:2/618: stat d9/d65/d40/d69/d66/la3 0 2024-09-13T22:09:08.759 INFO:tasks.workunit.client.1.smithi159.stdout:7/770: read d3/d2e/fb0 [2929854,34458] 0 2024-09-13T22:09:08.760 INFO:tasks.workunit.client.1.smithi159.stdout:1/939: dwrite dd/d1e/d58/d5f/d84/f10f [0,4194304] 0 2024-09-13T22:09:08.762 INFO:tasks.workunit.client.1.smithi159.stdout:7/771: creat d3/d2e/db6/d6c/db2/f105 x:0 0 0 2024-09-13T22:09:08.769 INFO:tasks.workunit.client.1.smithi159.stdout:2/619: dread d9/da/d25/f35 [0,4194304] 0 2024-09-13T22:09:08.769 INFO:tasks.workunit.client.1.smithi159.stdout:1/940: write dd/d1e/d58/d8a/dbb/f66 [748110,3618] 0 2024-09-13T22:09:08.770 INFO:tasks.workunit.client.1.smithi159.stdout:7/772: write d3/ff [1808914,96977] 0 2024-09-13T22:09:08.771 INFO:tasks.workunit.client.1.smithi159.stdout:2/620: truncate d9/d37/f51 1647423 0 2024-09-13T22:09:08.771 INFO:tasks.workunit.client.1.smithi159.stdout:2/621: readlink d9/da/d25/l30 0 2024-09-13T22:09:08.774 INFO:tasks.workunit.client.1.smithi159.stdout:1/941: rename dd/d11/d13/d10b/fcf to dd/d11/d18/d74/d82/d9a/de0/f134 0 2024-09-13T22:09:08.775 INFO:tasks.workunit.client.1.smithi159.stdout:1/942: fsync dd/d1c/f25 0 2024-09-13T22:09:08.775 INFO:tasks.workunit.client.1.smithi159.stdout:1/943: stat dd/d1e/d58/cf1 0 2024-09-13T22:09:08.778 INFO:tasks.workunit.client.1.smithi159.stdout:7/773: link d3/d31/fd1 d3/dab/f106 0 2024-09-13T22:09:08.778 INFO:tasks.workunit.client.1.smithi159.stdout:7/774: truncate d3/d18/f54 4863994 0 2024-09-13T22:09:08.778 INFO:tasks.workunit.client.1.smithi159.stdout:7/775: write d3/d31/d4d/d4e/f52 [456588,34872] 0 2024-09-13T22:09:08.778 INFO:tasks.workunit.client.1.smithi159.stdout:7/776: write d3/d31/f33 [397766,42819] 0 2024-09-13T22:09:08.778 INFO:tasks.workunit.client.1.smithi159.stdout:1/944: chown dd/d1e/d58/d8a/dbb/d3c/d95/df5/d131/d132/fb9 41648 1 2024-09-13T22:09:08.781 INFO:tasks.workunit.client.1.smithi159.stdout:1/945: truncate dd/d1e/d58/d8a/dbb/f4e 1773019 0 2024-09-13T22:09:08.782 INFO:tasks.workunit.client.1.smithi159.stdout:2/622: dread d9/da/f4d [0,4194304] 0 2024-09-13T22:09:08.782 INFO:tasks.workunit.client.1.smithi159.stdout:2/623: chown d9/da/d82/d89/ld3 46738777 1 2024-09-13T22:09:08.784 INFO:tasks.workunit.client.1.smithi159.stdout:1/946: creat dd/d1e/d58/f135 x:0 0 0 2024-09-13T22:09:08.788 INFO:tasks.workunit.client.1.smithi159.stdout:1/947: dread dd/d1e/d58/d5f/d84/fd9 [0,4194304] 0 2024-09-13T22:09:08.793 INFO:tasks.workunit.client.1.smithi159.stdout:1/948: symlink dd/d1e/d58/db4/l136 0 2024-09-13T22:09:08.796 INFO:tasks.workunit.client.1.smithi159.stdout:2/624: truncate d9/da/d5a/f63 2748699 0 2024-09-13T22:09:08.797 INFO:tasks.workunit.client.1.smithi159.stdout:2/625: mknod d9/d48/d77/da6/cda 0 2024-09-13T22:09:08.799 INFO:tasks.workunit.client.1.smithi159.stdout:7/777: dwrite d3/d18/f1d [0,4194304] 0 2024-09-13T22:09:08.799 INFO:tasks.workunit.client.1.smithi159.stdout:2/626: unlink d9/d65/d40/d69/d66/cae 0 2024-09-13T22:09:08.799 INFO:tasks.workunit.client.1.smithi159.stdout:2/627: chown d9/d44/l73 1 1 2024-09-13T22:09:08.804 INFO:tasks.workunit.client.1.smithi159.stdout:7/778: getdents d3/d31 0 2024-09-13T22:09:08.806 INFO:tasks.workunit.client.1.smithi159.stdout:2/628: symlink d9/da/d82/d89/ldb 0 2024-09-13T22:09:08.807 INFO:tasks.workunit.client.1.smithi159.stdout:7/779: getdents d3/d31/d4d/d9e/dbe 0 2024-09-13T22:09:08.808 INFO:tasks.workunit.client.1.smithi159.stdout:2/629: mknod d9/d92/cdc 0 2024-09-13T22:09:08.809 INFO:tasks.workunit.client.1.smithi159.stdout:2/630: dread d9/d65/d40/d69/fbf [0,4194304] 0 2024-09-13T22:09:08.810 INFO:tasks.workunit.client.1.smithi159.stdout:7/780: mknod d3/d2e/dee/c107 0 2024-09-13T22:09:08.810 INFO:tasks.workunit.client.1.smithi159.stdout:2/631: mknod d9/d48/d77/cdd 0 2024-09-13T22:09:08.812 INFO:tasks.workunit.client.1.smithi159.stdout:7/781: rename d3/d31/d4d/l53 to d3/d2e/dee/l108 0 2024-09-13T22:09:08.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/632: getdents d9/d65/d40 0 2024-09-13T22:09:08.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/633: chown d9/d44/f46 7 1 2024-09-13T22:09:08.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/634: fdatasync d9/d37/f3a 0 2024-09-13T22:09:08.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/635: write d9/d92/f95 [728522,70227] 0 2024-09-13T22:09:08.815 INFO:tasks.workunit.client.1.smithi159.stdout:7/782: creat d3/d31/d4d/d9e/dfb/f109 x:0 0 0 2024-09-13T22:09:08.818 INFO:tasks.workunit.client.1.smithi159.stdout:2/636: link d9/da/d25/d91/fa4 d9/d48/d77/fde 0 2024-09-13T22:09:08.819 INFO:tasks.workunit.client.1.smithi159.stdout:2/637: mkdir d9/da/d5a/ddf 0 2024-09-13T22:09:08.820 INFO:tasks.workunit.client.1.smithi159.stdout:2/638: mknod d9/da/d5a/ce0 0 2024-09-13T22:09:08.829 INFO:tasks.workunit.client.1.smithi159.stdout:7/783: dwrite d3/d2e/fe0 [0,4194304] 0 2024-09-13T22:09:08.829 INFO:tasks.workunit.client.1.smithi159.stdout:7/784: chown d3/d2e/db6/f58 9568430 1 2024-09-13T22:09:08.829 INFO:tasks.workunit.client.1.smithi159.stdout:7/785: readlink d3/d31/d4d/d4e/d7a/l95 0 2024-09-13T22:09:08.836 INFO:tasks.workunit.client.1.smithi159.stdout:2/639: rmdir d9/da/d5a 39 2024-09-13T22:09:08.838 INFO:tasks.workunit.client.1.smithi159.stdout:7/786: symlink d3/d31/l10a 0 2024-09-13T22:09:08.838 INFO:tasks.workunit.client.1.smithi159.stdout:7/787: fsync d3/d2e/db6/d6c/db2/dce/ff0 0 2024-09-13T22:09:08.839 INFO:tasks.workunit.client.1.smithi159.stdout:7/788: write d3/d31/d4d/ff3 [4346163,40379] 0 2024-09-13T22:09:08.840 INFO:tasks.workunit.client.1.smithi159.stdout:2/640: mknod d9/d2d/db5/ce1 0 2024-09-13T22:09:08.840 INFO:tasks.workunit.client.1.smithi159.stdout:2/641: readlink d9/da/d82/d89/ld3 0 2024-09-13T22:09:08.840 INFO:tasks.workunit.client.1.smithi159.stdout:2/642: chown d9/d65/dca/lcf 57504 1 2024-09-13T22:09:08.842 INFO:tasks.workunit.client.1.smithi159.stdout:7/789: unlink d3/f11 0 2024-09-13T22:09:08.846 INFO:tasks.workunit.client.1.smithi159.stdout:2/643: rename d9/d65/d40 to d9/d65/d8d/de2 0 2024-09-13T22:09:08.848 INFO:tasks.workunit.client.1.smithi159.stdout:2/644: rename d9/d48/l57 to d9/da/d82/d89/dd6/le3 0 2024-09-13T22:09:08.849 INFO:tasks.workunit.client.1.smithi159.stdout:2/645: creat d9/d2d/db5/dbe/fe4 x:0 0 0 2024-09-13T22:09:08.851 INFO:tasks.workunit.client.1.smithi159.stdout:2/646: link d9/d44/l8e d9/da/d5a/le5 0 2024-09-13T22:09:08.852 INFO:tasks.workunit.client.1.smithi159.stdout:2/647: chown d9/c13 1721 1 2024-09-13T22:09:08.855 INFO:tasks.workunit.client.1.smithi159.stdout:2/648: getdents d9/d2d/db5 0 2024-09-13T22:09:08.855 INFO:tasks.workunit.client.1.smithi159.stdout:2/649: stat d9/d48/f99 0 2024-09-13T22:09:08.856 INFO:tasks.workunit.client.1.smithi159.stdout:2/650: creat d9/d44/fe6 x:0 0 0 2024-09-13T22:09:08.863 INFO:tasks.workunit.client.1.smithi159.stdout:7/790: dwrite d3/d2e/d6e/db9/ff4 [0,4194304] 0 2024-09-13T22:09:08.872 INFO:tasks.workunit.client.1.smithi159.stdout:7/791: dread d3/d3f/fb1 [0,4194304] 0 2024-09-13T22:09:08.873 INFO:tasks.workunit.client.1.smithi159.stdout:2/651: dwrite d9/d65/d8d/de2/d69/f90 [0,4194304] 0 2024-09-13T22:09:08.874 INFO:tasks.workunit.client.1.smithi159.stdout:7/792: rename d3/d31/d4d/d9e/fe7 to d3/d31/dd8/f10b 0 2024-09-13T22:09:08.878 INFO:tasks.workunit.client.1.smithi159.stdout:2/652: mkdir d9/d48/d77/da6/de7 0 2024-09-13T22:09:08.880 INFO:tasks.workunit.client.1.smithi159.stdout:7/793: rename d3/d18/c50 to d3/d2e/dee/c10c 0 2024-09-13T22:09:08.880 INFO:tasks.workunit.client.1.smithi159.stdout:2/653: chown d9/d65/c9f 53770 1 2024-09-13T22:09:08.882 INFO:tasks.workunit.client.1.smithi159.stdout:2/654: symlink d9/da/d25/d91/le8 0 2024-09-13T22:09:08.888 INFO:tasks.workunit.client.1.smithi159.stdout:7/794: write d3/d2e/d6e/f96 [1044416,24177] 0 2024-09-13T22:09:08.891 INFO:tasks.workunit.client.1.smithi159.stdout:2/655: truncate d9/d65/d8d/de2/d69/d66/fd8 1300429 0 2024-09-13T22:09:08.892 INFO:tasks.workunit.client.1.smithi159.stdout:2/656: readlink d9/d44/l73 0 2024-09-13T22:09:08.892 INFO:tasks.workunit.client.1.smithi159.stdout:2/657: chown d9/d65/d8d/de2/d69/d66/la3 325573337 1 2024-09-13T22:09:08.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/658: unlink d9/d2d/l97 0 2024-09-13T22:09:08.897 INFO:tasks.workunit.client.1.smithi159.stdout:2/659: mkdir d9/d48/de9 0 2024-09-13T22:09:08.898 INFO:tasks.workunit.client.1.smithi159.stdout:2/660: mknod d9/d37/cea 0 2024-09-13T22:09:08.924 INFO:tasks.workunit.client.1.smithi159.stdout:2/661: dwrite d9/d48/d77/fb7 [0,4194304] 0 2024-09-13T22:09:08.924 INFO:tasks.workunit.client.1.smithi159.stdout:2/662: write d9/d65/d8d/de2/fc0 [819029,66803] 0 2024-09-13T22:09:08.925 INFO:tasks.workunit.client.1.smithi159.stdout:2/663: getdents d9/d65/d8d/de2/d69/dab 0 2024-09-13T22:09:08.926 INFO:tasks.workunit.client.1.smithi159.stdout:2/664: mkdir d9/d44/deb 0 2024-09-13T22:09:08.927 INFO:tasks.workunit.client.1.smithi159.stdout:2/665: mkdir d9/d48/d77/dec 0 2024-09-13T22:09:08.928 INFO:tasks.workunit.client.1.smithi159.stdout:2/666: symlink d9/led 0 2024-09-13T22:09:08.935 INFO:tasks.workunit.client.1.smithi159.stdout:7/795: dwrite d3/d2e/d6e/d74/f85 [0,4194304] 0 2024-09-13T22:09:08.935 INFO:tasks.workunit.client.1.smithi159.stdout:7/796: readlink d3/d2e/l46 0 2024-09-13T22:09:08.938 INFO:tasks.workunit.client.1.smithi159.stdout:7/797: rename d3/d2e/l3a to d3/d2e/db6/d6c/db2/dce/l10d 0 2024-09-13T22:09:08.939 INFO:tasks.workunit.client.1.smithi159.stdout:7/798: symlink d3/d31/dd8/l10e 0 2024-09-13T22:09:08.940 INFO:tasks.workunit.client.1.smithi159.stdout:7/799: symlink d3/d2e/l10f 0 2024-09-13T22:09:08.950 INFO:tasks.workunit.client.1.smithi159.stdout:2/667: dwrite d9/d65/d8d/de2/faf [0,4194304] 0 2024-09-13T22:09:08.957 INFO:tasks.workunit.client.1.smithi159.stdout:7/800: dwrite d3/d31/fd1 [4194304,4194304] 0 2024-09-13T22:09:08.958 INFO:tasks.workunit.client.1.smithi159.stdout:2/668: rename d9/d48 to d9/d44/deb/dee 0 2024-09-13T22:09:08.961 INFO:tasks.workunit.client.1.smithi159.stdout:7/801: link d3/d31/d4d/d9e/l77 d3/d31/d4d/d9e/dfb/l110 0 2024-09-13T22:09:08.961 INFO:tasks.workunit.client.1.smithi159.stdout:7/802: creat d3/d2e/f111 x:0 0 0 2024-09-13T22:09:08.962 INFO:tasks.workunit.client.1.smithi159.stdout:2/669: unlink d9/d44/deb/dee/c87 0 2024-09-13T22:09:08.964 INFO:tasks.workunit.client.1.smithi159.stdout:7/803: mknod d3/d31/d4d/d9e/c112 0 2024-09-13T22:09:08.966 INFO:tasks.workunit.client.1.smithi159.stdout:7/804: creat d3/d2e/d6e/d74/dba/f113 x:0 0 0 2024-09-13T22:09:08.967 INFO:tasks.workunit.client.1.smithi159.stdout:7/805: write d3/d31/d4d/d4e/d7a/fc7 [102740,123632] 0 2024-09-13T22:09:08.968 INFO:tasks.workunit.client.1.smithi159.stdout:7/806: link d3/d2e/f82 d3/d31/d4d/d9e/f114 0 2024-09-13T22:09:08.969 INFO:tasks.workunit.client.1.smithi159.stdout:7/807: truncate d3/d2e/db6/d6c/ffa 145385 0 2024-09-13T22:09:08.970 INFO:tasks.workunit.client.1.smithi159.stdout:7/808: symlink d3/d31/l115 0 2024-09-13T22:09:08.970 INFO:tasks.workunit.client.1.smithi159.stdout:7/809: stat d3/d2e/d6e/ffe 0 2024-09-13T22:09:08.992 INFO:tasks.workunit.client.1.smithi159.stdout:7/810: dwrite d3/fc2 [0,4194304] 0 2024-09-13T22:09:09.010 INFO:tasks.workunit.client.1.smithi159.stdout:7/811: dwrite d3/d2e/f103 [0,4194304] 0 2024-09-13T22:09:09.015 INFO:tasks.workunit.client.1.smithi159.stdout:7/812: rmdir d3/d31/d4d/d9e 39 2024-09-13T22:09:09.015 INFO:tasks.workunit.client.1.smithi159.stdout:7/813: dread - d3/d2e/f111 zero size 2024-09-13T22:09:09.022 INFO:tasks.workunit.client.1.smithi159.stdout:7/814: symlink d3/dab/l116 0 2024-09-13T22:09:09.023 INFO:tasks.workunit.client.1.smithi159.stdout:7/815: symlink d3/d2e/l117 0 2024-09-13T22:09:09.026 INFO:tasks.workunit.client.1.smithi159.stdout:7/816: rename d3/d2e/d6e/db9/ff4 to d3/d31/d4d/f118 0 2024-09-13T22:09:09.027 INFO:tasks.workunit.client.1.smithi159.stdout:7/817: mkdir d3/d31/d4d/d4e/d119 0 2024-09-13T22:09:09.028 INFO:tasks.workunit.client.1.smithi159.stdout:7/818: write d3/d2e/db6/d6c/db2/dce/ff0 [721240,70806] 0 2024-09-13T22:09:09.048 INFO:tasks.workunit.client.1.smithi159.stdout:7/819: dwrite d3/d31/fdb [0,4194304] 0 2024-09-13T22:09:09.074 INFO:tasks.workunit.client.1.smithi159.stdout:7/820: dwrite d3/d2e/d6e/f86 [0,4194304] 0 2024-09-13T22:09:09.085 INFO:tasks.workunit.client.1.smithi159.stdout:7/821: dread d3/d18/f1d [0,4194304] 0 2024-09-13T22:09:09.085 INFO:tasks.workunit.client.1.smithi159.stdout:7/822: truncate d3/d2e/f103 4576895 0 2024-09-13T22:09:09.087 INFO:tasks.workunit.client.1.smithi159.stdout:7/823: creat d3/d2e/dee/f11a x:0 0 0 2024-09-13T22:09:09.087 INFO:tasks.workunit.client.1.smithi159.stdout:7/824: chown d3/dab 89631078 1 2024-09-13T22:09:09.095 INFO:tasks.workunit.client.1.smithi159.stdout:7/825: write d3/d31/d4d/d9e/f114 [3669791,93084] 0 2024-09-13T22:09:09.101 INFO:tasks.workunit.client.1.smithi159.stdout:7/826: dread d3/fb7 [0,4194304] 0 2024-09-13T22:09:09.103 INFO:tasks.workunit.client.1.smithi159.stdout:7/827: mknod d3/d31/d4d/d4e/d119/c11b 0 2024-09-13T22:09:09.103 INFO:tasks.workunit.client.1.smithi159.stdout:7/828: truncate d3/d31/d4d/f99 713605 0 2024-09-13T22:09:09.104 INFO:tasks.workunit.client.1.smithi159.stdout:7/829: rename d3/d31/l115 to d3/d2e/db6/d6c/l11c 0 2024-09-13T22:09:09.106 INFO:tasks.workunit.client.1.smithi159.stdout:7/830: symlink d3/d2e/db6/d6c/db2/dce/l11d 0 2024-09-13T22:09:09.106 INFO:tasks.workunit.client.1.smithi159.stdout:7/831: readlink d3/d2e/db6/d6c/l78 0 2024-09-13T22:09:09.109 INFO:tasks.workunit.client.1.smithi159.stdout:7/832: dread d3/d18/f1d [0,4194304] 0 2024-09-13T22:09:09.116 INFO:tasks.workunit.client.1.smithi159.stdout:7/833: read d3/d3f/fb1 [2893772,87271] 0 2024-09-13T22:09:09.124 INFO:tasks.workunit.client.1.smithi159.stdout:7/834: dread d3/d2e/db6/f58 [0,4194304] 0 2024-09-13T22:09:09.125 INFO:tasks.workunit.client.1.smithi159.stdout:7/835: creat d3/d2e/d6e/d74/f11e x:0 0 0 2024-09-13T22:09:09.125 INFO:tasks.workunit.client.1.smithi159.stdout:7/836: chown d3/d31/d4d/d9e/c112 215158 1 2024-09-13T22:09:09.126 INFO:tasks.workunit.client.1.smithi159.stdout:7/837: write d3/d31/d4d/f99 [695368,58445] 0 2024-09-13T22:09:09.126 INFO:tasks.workunit.client.1.smithi159.stdout:7/838: write d3/d31/d4d/d4e/d7a/fcf [823617,32205] 0 2024-09-13T22:09:09.127 INFO:tasks.workunit.client.1.smithi159.stdout:7/839: dread d3/d2e/db6/fa5 [0,4194304] 0 2024-09-13T22:09:09.128 INFO:tasks.workunit.client.1.smithi159.stdout:7/840: symlink d3/d2e/db6/d6c/db2/l11f 0 2024-09-13T22:09:09.129 INFO:tasks.workunit.client.1.smithi159.stdout:7/841: symlink d3/l120 0 2024-09-13T22:09:09.130 INFO:tasks.workunit.client.1.smithi159.stdout:7/842: creat d3/d31/d4d/d9e/f121 x:0 0 0 2024-09-13T22:09:09.141 INFO:tasks.workunit.client.1.smithi159.stdout:7/843: dread d3/d2e/f82 [0,4194304] 0 2024-09-13T22:09:09.146 INFO:tasks.workunit.client.1.smithi159.stdout:7/844: mknod d3/d2e/db6/d6c/c122 0 2024-09-13T22:09:09.149 INFO:tasks.workunit.client.1.smithi159.stdout:7/845: creat d3/d31/d4d/d4e/d7a/f123 x:0 0 0 2024-09-13T22:09:09.152 INFO:tasks.workunit.client.1.smithi159.stdout:7/846: mknod d3/d2e/d6e/d74/dba/c124 0 2024-09-13T22:09:09.152 INFO:tasks.workunit.client.1.smithi159.stdout:7/847: chown d3/d18/l28 750 1 2024-09-13T22:09:09.179 INFO:tasks.workunit.client.1.smithi159.stdout:7/848: dwrite d3/d2e/db6/d6c/db2/dce/ff5 [0,4194304] 0 2024-09-13T22:09:09.182 INFO:tasks.workunit.client.1.smithi159.stdout:7/849: mkdir d3/d31/d4d/d9e/dfb/dff/d125 0 2024-09-13T22:09:09.184 INFO:tasks.workunit.client.1.smithi159.stdout:7/850: mknod d3/d2e/d6e/d74/dba/d5e/c126 0 2024-09-13T22:09:09.184 INFO:tasks.workunit.client.1.smithi159.stdout:7/851: write d3/d31/d4d/d4e/fe5 [694408,76212] 0 2024-09-13T22:09:09.185 INFO:tasks.workunit.client.1.smithi159.stdout:7/852: unlink d3/d31/d4d/d9e/f114 0 2024-09-13T22:09:09.186 INFO:tasks.workunit.client.1.smithi159.stdout:7/853: unlink d3/d2e/db6/c70 0 2024-09-13T22:09:09.187 INFO:tasks.workunit.client.1.smithi159.stdout:7/854: unlink d3/d3f/c63 0 2024-09-13T22:09:09.274 INFO:tasks.workunit.client.1.smithi159.stdout:0/843: sync 2024-09-13T22:09:09.274 INFO:tasks.workunit.client.1.smithi159.stdout:0/844: stat d0/d48/d4f/daa/fce 0 2024-09-13T22:09:09.275 INFO:tasks.workunit.client.1.smithi159.stdout:0/845: truncate d0/d48/d4f/d54/d74/db2/fd6 1654166 0 2024-09-13T22:09:09.275 INFO:tasks.workunit.client.1.smithi159.stdout:0/846: readlink d0/d2c/l2d 0 2024-09-13T22:09:09.295 INFO:tasks.workunit.client.1.smithi159.stdout:0/847: dwrite d0/d48/d4f/f69 [0,4194304] 0 2024-09-13T22:09:09.442 INFO:tasks.workunit.client.1.smithi159.stdout:9/662: sync 2024-09-13T22:09:09.442 INFO:tasks.workunit.client.1.smithi159.stdout:4/956: sync 2024-09-13T22:09:09.442 INFO:tasks.workunit.client.1.smithi159.stdout:9/663: dread - d1/dc/d27/da4/fe1 zero size 2024-09-13T22:09:09.442 INFO:tasks.workunit.client.1.smithi159.stdout:4/957: chown d13/d15/d26/d29/d3b/daf/lda 1673328 1 2024-09-13T22:09:09.442 INFO:tasks.workunit.client.1.smithi159.stdout:4/958: stat d13/d15/d26/d29/d3b/d66/df2/cf8 0 2024-09-13T22:09:09.477 INFO:tasks.workunit.client.1.smithi159.stdout:4/959: stat d13/l58 0 2024-09-13T22:09:09.477 INFO:tasks.workunit.client.1.smithi159.stdout:4/960: readlink d13/d41/l64 0 2024-09-13T22:09:09.478 INFO:tasks.workunit.client.1.smithi159.stdout:9/664: mkdir d1/dc/d10/d6d/d4b/dcb/d74/de3 0 2024-09-13T22:09:09.479 INFO:tasks.workunit.client.1.smithi159.stdout:4/961: mkdir d13/d15/d26/d29/d3b/d66/d157 0 2024-09-13T22:09:09.507 INFO:tasks.workunit.client.1.smithi159.stdout:9/665: dwrite d1/dc/d10/d6d/d4b/dcb/d75/fa6 [0,4194304] 0 2024-09-13T22:09:09.508 INFO:tasks.workunit.client.1.smithi159.stdout:9/666: fdatasync d1/dc/d10/d6d/d4b/fb0 0 2024-09-13T22:09:09.508 INFO:tasks.workunit.client.1.smithi159.stdout:9/667: creat d1/dc/d27/d40/fe4 x:0 0 0 2024-09-13T22:09:09.508 INFO:tasks.workunit.client.1.smithi159.stdout:9/668: write d1/dc/d27/da4/db5/fc5 [873758,119994] 0 2024-09-13T22:09:09.508 INFO:tasks.workunit.client.1.smithi159.stdout:9/669: fdatasync d1/dc/f3e 0 2024-09-13T22:09:09.508 INFO:tasks.workunit.client.1.smithi159.stdout:4/962: dwrite d13/fec [0,4194304] 0 2024-09-13T22:09:09.508 INFO:tasks.workunit.client.1.smithi159.stdout:9/670: write d1/dc/d10/d69/f79 [190597,96877] 0 2024-09-13T22:09:09.508 INFO:tasks.workunit.client.1.smithi159.stdout:4/963: write d13/d15/d26/d51/d65/f91 [68871,40659] 0 2024-09-13T22:09:09.516 INFO:tasks.workunit.client.1.smithi159.stdout:4/964: symlink d13/d41/d4d/l158 0 2024-09-13T22:09:09.516 INFO:tasks.workunit.client.1.smithi159.stdout:4/965: stat d13/d15/f16 0 2024-09-13T22:09:09.522 INFO:tasks.workunit.client.1.smithi159.stdout:9/671: dwrite d1/dc/d27/d40/fc2 [0,4194304] 0 2024-09-13T22:09:09.527 INFO:tasks.workunit.client.1.smithi159.stdout:9/672: creat d1/dc/d10/d6d/d2f/d8b/d8f/fe5 x:0 0 0 2024-09-13T22:09:09.529 INFO:tasks.workunit.client.1.smithi159.stdout:4/966: write d13/d41/d4d/f104 [606816,6897] 0 2024-09-13T22:09:09.529 INFO:tasks.workunit.client.1.smithi159.stdout:4/967: write d13/d15/d26/d51/f5f [3460,123412] 0 2024-09-13T22:09:09.529 INFO:tasks.workunit.client.1.smithi159.stdout:4/968: creat d13/d41/d79/db2/dd5/f159 x:0 0 0 2024-09-13T22:09:09.529 INFO:tasks.workunit.client.1.smithi159.stdout:4/969: chown d13/d41/d79/db2/dd5/f134 101701 1 2024-09-13T22:09:09.531 INFO:tasks.workunit.client.1.smithi159.stdout:4/970: rmdir d13/d15/d26/d29/d3b/d66/d6c 39 2024-09-13T22:09:09.539 INFO:tasks.workunit.client.1.smithi159.stdout:4/971: dread d13/f38 [0,4194304] 0 2024-09-13T22:09:09.541 INFO:tasks.workunit.client.1.smithi159.stdout:4/972: symlink d13/d41/dbf/l15a 0 2024-09-13T22:09:09.545 INFO:tasks.workunit.client.1.smithi159.stdout:4/973: dread d13/f38 [0,4194304] 0 2024-09-13T22:09:09.551 INFO:tasks.workunit.client.1.smithi159.stdout:9/673: dwrite d1/dc/d10/d6d/d4b/f76 [4194304,4194304] 0 2024-09-13T22:09:09.553 INFO:tasks.workunit.client.1.smithi159.stdout:9/674: rmdir d1/d9/dab/dd7 39 2024-09-13T22:09:09.555 INFO:tasks.workunit.client.1.smithi159.stdout:9/675: mkdir d1/dc/d10/d6d/d4b/dcb/d74/de3/de6 0 2024-09-13T22:09:09.555 INFO:tasks.workunit.client.1.smithi159.stdout:9/676: stat d1/dc/d10/d6d/d4b/f76 0 2024-09-13T22:09:09.556 INFO:tasks.workunit.client.1.smithi159.stdout:9/677: getdents d1/dc/d10/d6d/d4b/d98/da8 0 2024-09-13T22:09:09.558 INFO:tasks.workunit.client.1.smithi159.stdout:9/678: mknod d1/dc/d10/ce7 0 2024-09-13T22:09:09.558 INFO:tasks.workunit.client.1.smithi159.stdout:9/679: creat d1/dc/d10/fe8 x:0 0 0 2024-09-13T22:09:09.558 INFO:tasks.workunit.client.1.smithi159.stdout:9/680: creat d1/dc/d10/fe9 x:0 0 0 2024-09-13T22:09:09.571 INFO:tasks.workunit.client.1.smithi159.stdout:9/681: dwrite d1/dc/d27/da4/fe1 [0,4194304] 0 2024-09-13T22:09:09.571 INFO:tasks.workunit.client.1.smithi159.stdout:9/682: dread - d1/dc/d10/d9c/fad zero size 2024-09-13T22:09:09.588 INFO:tasks.workunit.client.1.smithi159.stdout:9/683: dwrite d1/d5a/fa5 [0,4194304] 0 2024-09-13T22:09:09.602 INFO:tasks.workunit.client.1.smithi159.stdout:9/684: dwrite d1/d5a/f6e [0,4194304] 0 2024-09-13T22:09:09.619 INFO:tasks.workunit.client.1.smithi159.stdout:9/685: dwrite d1/d9/d1f/f77 [0,4194304] 0 2024-09-13T22:09:09.623 INFO:tasks.workunit.client.1.smithi159.stdout:9/686: creat d1/dc/d27/fea x:0 0 0 2024-09-13T22:09:09.624 INFO:tasks.workunit.client.1.smithi159.stdout:8/928: sync 2024-09-13T22:09:09.627 INFO:tasks.workunit.client.1.smithi159.stdout:9/687: creat d1/dc/d10/d6d/d4b/d98/feb x:0 0 0 2024-09-13T22:09:09.629 INFO:tasks.workunit.client.1.smithi159.stdout:8/929: symlink da/d7e/d82/d6f/d9a/de4/l142 0 2024-09-13T22:09:09.630 INFO:tasks.workunit.client.1.smithi159.stdout:9/688: creat d1/dc/d10/d6d/d2f/dd3/fec x:0 0 0 2024-09-13T22:09:09.630 INFO:tasks.workunit.client.1.smithi159.stdout:9/689: truncate d1/dc/d10/d6d/d4b/fbf 1319226 0 2024-09-13T22:09:09.633 INFO:tasks.workunit.client.1.smithi159.stdout:9/690: unlink d1/dc/d10/l28 0 2024-09-13T22:09:09.633 INFO:tasks.workunit.client.1.smithi159.stdout:8/930: write da/d36/d48/f67 [207169,60332] 0 2024-09-13T22:09:09.633 INFO:tasks.workunit.client.1.smithi159.stdout:8/931: fdatasync da/d5d/d70/f72 0 2024-09-13T22:09:09.634 INFO:tasks.workunit.client.1.smithi159.stdout:3/622: sync 2024-09-13T22:09:09.634 INFO:tasks.workunit.client.1.smithi159.stdout:5/788: sync 2024-09-13T22:09:09.635 INFO:tasks.workunit.client.1.smithi159.stdout:8/932: mknod da/d5d/d70/d8e/de0/c143 0 2024-09-13T22:09:09.635 INFO:tasks.workunit.client.1.smithi159.stdout:8/933: chown da/d5d/dbc/fec 4464 1 2024-09-13T22:09:09.635 INFO:tasks.workunit.client.1.smithi159.stdout:8/934: truncate da/d36/f79 2181777 0 2024-09-13T22:09:09.637 INFO:tasks.workunit.client.1.smithi159.stdout:5/789: fsync d1/d11/d64/d82/fc1 0 2024-09-13T22:09:09.637 INFO:tasks.workunit.client.1.smithi159.stdout:5/790: fdatasync d1/d11/d64/d17/f6d 0 2024-09-13T22:09:09.637 INFO:tasks.workunit.client.1.smithi159.stdout:5/791: fdatasync d1/d11/d1c/dd2/d53/f6a 0 2024-09-13T22:09:09.639 INFO:tasks.workunit.client.1.smithi159.stdout:8/935: truncate da/d5d/d70/d8e/fb0 3276838 0 2024-09-13T22:09:09.642 INFO:tasks.workunit.client.1.smithi159.stdout:9/691: dread d1/dc/d10/d6d/d4b/d98/da8/fb3 [0,4194304] 0 2024-09-13T22:09:09.642 INFO:tasks.workunit.client.1.smithi159.stdout:9/692: dread - d1/dc/d27/fea zero size 2024-09-13T22:09:09.643 INFO:tasks.workunit.client.1.smithi159.stdout:5/792: creat d1/d11/d64/d35/ffe x:0 0 0 2024-09-13T22:09:09.643 INFO:tasks.workunit.client.1.smithi159.stdout:5/793: write d1/d11/d1c/dd2/d44/d85/fdc [672287,89702] 0 2024-09-13T22:09:09.645 INFO:tasks.workunit.client.1.smithi159.stdout:8/936: creat da/d22/d26/f144 x:0 0 0 2024-09-13T22:09:09.647 INFO:tasks.workunit.client.1.smithi159.stdout:9/693: unlink d1/c7 0 2024-09-13T22:09:09.647 INFO:tasks.workunit.client.1.smithi159.stdout:9/694: write d1/dc/d10/d6d/d2f/f68 [13170814,110067] 0 2024-09-13T22:09:09.650 INFO:tasks.workunit.client.1.smithi159.stdout:8/937: rename da/d7e/db2 to da/d7e/d145 0 2024-09-13T22:09:09.651 INFO:tasks.workunit.client.1.smithi159.stdout:9/695: mkdir d1/dc/ded 0 2024-09-13T22:09:09.653 INFO:tasks.workunit.client.1.smithi159.stdout:5/794: mknod d1/d11/d64/d35/cff 0 2024-09-13T22:09:09.654 INFO:tasks.workunit.client.1.smithi159.stdout:5/795: creat d1/d11/f100 x:0 0 0 2024-09-13T22:09:09.654 INFO:tasks.workunit.client.1.smithi159.stdout:5/796: fdatasync d1/d11/d64/d17/f2c 0 2024-09-13T22:09:09.654 INFO:tasks.workunit.client.1.smithi159.stdout:3/623: dwrite d0/d1/d3/dd/f26 [0,4194304] 0 2024-09-13T22:09:09.654 INFO:tasks.workunit.client.1.smithi159.stdout:3/624: fdatasync d0/d1/d34/fb3 0 2024-09-13T22:09:09.655 INFO:tasks.workunit.client.1.smithi159.stdout:5/797: read d1/d11/d50/fb7 [357767,47573] 0 2024-09-13T22:09:09.656 INFO:tasks.workunit.client.1.smithi159.stdout:8/938: link da/d7e/d82/d6f/f100 da/d7e/d82/f146 0 2024-09-13T22:09:09.658 INFO:tasks.workunit.client.1.smithi159.stdout:9/696: link d1/dc/d27/d40/fe4 d1/d9/dab/fee 0 2024-09-13T22:09:09.658 INFO:tasks.workunit.client.1.smithi159.stdout:9/697: readlink d1/d9/d1f/l44 0 2024-09-13T22:09:09.666 INFO:tasks.workunit.client.1.smithi159.stdout:9/698: dread d1/dc/f9f [0,4194304] 0 2024-09-13T22:09:09.667 INFO:tasks.workunit.client.1.smithi159.stdout:3/625: symlink d0/d1/d34/d73/lc5 0 2024-09-13T22:09:09.667 INFO:tasks.workunit.client.1.smithi159.stdout:3/626: write d0/d1/d3/d5/d25/d4e/d5a/f21 [645375,41615] 0 2024-09-13T22:09:09.671 INFO:tasks.workunit.client.1.smithi159.stdout:8/939: truncate da/fef 1019096 0 2024-09-13T22:09:09.671 INFO:tasks.workunit.client.1.smithi159.stdout:8/940: write da/d7e/d82/dd8/de7/fea [1501492,79950] 0 2024-09-13T22:09:09.673 INFO:tasks.workunit.client.1.smithi159.stdout:9/699: mknod d1/dc/d27/d40/cef 0 2024-09-13T22:09:09.677 INFO:tasks.workunit.client.1.smithi159.stdout:5/798: unlink d1/d11/d64/fc9 0 2024-09-13T22:09:09.679 INFO:tasks.workunit.client.1.smithi159.stdout:9/700: symlink d1/dc/d10/d6d/d4b/dcb/d74/ddc/lf0 0 2024-09-13T22:09:09.683 INFO:tasks.workunit.client.1.smithi159.stdout:9/701: symlink d1/dc/d10/d6d/d4b/lf1 0 2024-09-13T22:09:09.683 INFO:tasks.workunit.client.1.smithi159.stdout:2/670: sync 2024-09-13T22:09:09.683 INFO:tasks.workunit.client.1.smithi159.stdout:6/842: sync 2024-09-13T22:09:09.683 INFO:tasks.workunit.client.1.smithi159.stdout:0/848: sync 2024-09-13T22:09:09.683 INFO:tasks.workunit.client.1.smithi159.stdout:7/855: sync 2024-09-13T22:09:09.683 INFO:tasks.workunit.client.1.smithi159.stdout:2/671: chown d9/d65/d8d/de2/d69/fbf 27753637 1 2024-09-13T22:09:09.684 INFO:tasks.workunit.client.1.smithi159.stdout:2/672: getdents d9/d65/d8d/de2 0 2024-09-13T22:09:09.684 INFO:tasks.workunit.client.1.smithi159.stdout:4/974: sync 2024-09-13T22:09:09.684 INFO:tasks.workunit.client.1.smithi159.stdout:2/673: fsync d9/d44/fe6 0 2024-09-13T22:09:09.684 INFO:tasks.workunit.client.1.smithi159.stdout:6/843: write d3/da/d29/d1a/d3e/f43 [173703,64782] 0 2024-09-13T22:09:09.684 INFO:tasks.workunit.client.1.smithi159.stdout:2/674: write d9/da/f18 [4474475,10050] 0 2024-09-13T22:09:09.684 INFO:tasks.workunit.client.1.smithi159.stdout:0/849: symlink d0/l118 0 2024-09-13T22:09:09.685 INFO:tasks.workunit.client.1.smithi159.stdout:5/799: write d1/d11/d1c/dd2/f5a [136062,113192] 0 2024-09-13T22:09:09.686 INFO:tasks.workunit.client.1.smithi159.stdout:3/627: dwrite d0/d1/d3/d5/d25/d2c/d65/f72 [0,4194304] 0 2024-09-13T22:09:09.686 INFO:tasks.workunit.client.1.smithi159.stdout:3/628: dread - d0/d1/d3/f82 zero size 2024-09-13T22:09:09.686 INFO:tasks.workunit.client.1.smithi159.stdout:7/856: symlink d3/d31/d4d/d9e/dfb/dff/l127 0 2024-09-13T22:09:09.686 INFO:tasks.workunit.client.1.smithi159.stdout:1/949: sync 2024-09-13T22:09:09.689 INFO:tasks.workunit.client.1.smithi159.stdout:4/975: creat d13/d15/f15b x:0 0 0 2024-09-13T22:09:09.689 INFO:tasks.workunit.client.1.smithi159.stdout:4/976: creat d13/d15/d26/d51/f15c x:0 0 0 2024-09-13T22:09:09.691 INFO:tasks.workunit.client.1.smithi159.stdout:6/844: rename d3/da/d29/d1a/d3e/d5a/c60 to d3/da/d25/d69/c10d 0 2024-09-13T22:09:09.693 INFO:tasks.workunit.client.1.smithi159.stdout:2/675: mkdir d9/d65/d8d/de2/d69/def 0 2024-09-13T22:09:09.694 INFO:tasks.workunit.client.1.smithi159.stdout:0/850: symlink d0/d48/d7d/dca/dcd/l119 0 2024-09-13T22:09:09.698 INFO:tasks.workunit.client.1.smithi159.stdout:3/629: truncate d0/d1/d3/d5/d25/d2c/f9a 1227556 0 2024-09-13T22:09:09.701 INFO:tasks.workunit.client.1.smithi159.stdout:4/977: symlink d13/d9b/l15d 0 2024-09-13T22:09:09.706 INFO:tasks.workunit.client.1.smithi159.stdout:5/800: rename d1/d11/d1c/dd2/d44/ff5 to d1/d11/d64/d82/f101 0 2024-09-13T22:09:09.708 INFO:tasks.workunit.client.1.smithi159.stdout:6/845: truncate d3/d2a/d3c/f100 680687 0 2024-09-13T22:09:09.708 INFO:tasks.workunit.client.1.smithi159.stdout:6/846: fsync d3/da/d29/d1a/f92 0 2024-09-13T22:09:09.711 INFO:tasks.workunit.client.1.smithi159.stdout:4/978: dread d13/d15/f62 [0,4194304] 0 2024-09-13T22:09:09.712 INFO:tasks.workunit.client.1.smithi159.stdout:5/801: dread d1/d11/d1c/d32/f4a [0,4194304] 0 2024-09-13T22:09:09.712 INFO:tasks.workunit.client.1.smithi159.stdout:5/802: fsync d1/d11/d1c/dd2/d44/d89/f93 0 2024-09-13T22:09:09.713 INFO:tasks.workunit.client.1.smithi159.stdout:0/851: creat d0/d48/d4f/d66/d75/f11a x:0 0 0 2024-09-13T22:09:09.713 INFO:tasks.workunit.client.1.smithi159.stdout:0/852: chown d0/d48/d4f/daf/dd4/dff 12910 1 2024-09-13T22:09:09.714 INFO:tasks.workunit.client.1.smithi159.stdout:6/847: mkdir d3/d2a/d3c/d5c/d10e 0 2024-09-13T22:09:09.715 INFO:tasks.workunit.client.1.smithi159.stdout:4/979: mknod d13/d15/d26/d51/c15e 0 2024-09-13T22:09:09.717 INFO:tasks.workunit.client.1.smithi159.stdout:9/702: dwrite d1/dc/d10/d6d/d4b/fbf [0,4194304] 0 2024-09-13T22:09:09.717 INFO:tasks.workunit.client.1.smithi159.stdout:0/853: link d0/d48/d4f/d2b/lb9 d0/d2c/d10d/l11b 0 2024-09-13T22:09:09.718 INFO:tasks.workunit.client.1.smithi159.stdout:0/854: write d0/d48/d4f/daf/dd4/fcf [1037654,27457] 0 2024-09-13T22:09:09.723 INFO:tasks.workunit.client.1.smithi159.stdout:7/857: dwrite d3/d2e/db6/d6c/ffa [0,4194304] 0 2024-09-13T22:09:09.723 INFO:tasks.workunit.client.1.smithi159.stdout:3/630: dwrite d0/d1/d3/d5/db/d39/f3f [0,4194304] 0 2024-09-13T22:09:09.723 INFO:tasks.workunit.client.1.smithi159.stdout:3/631: write d0/d1/f2 [583053,101813] 0 2024-09-13T22:09:09.725 INFO:tasks.workunit.client.1.smithi159.stdout:1/950: rename dd/d1e/d58/d8a/dbb/f33 to dd/d11/d18/d49/d2d/d112/f137 0 2024-09-13T22:09:09.726 INFO:tasks.workunit.client.1.smithi159.stdout:4/980: creat d13/d41/d7e/d126/f15f x:0 0 0 2024-09-13T22:09:09.726 INFO:tasks.workunit.client.1.smithi159.stdout:4/981: chown d13/d15/l52 83 1 2024-09-13T22:09:09.729 INFO:tasks.workunit.client.1.smithi159.stdout:5/803: unlink d1/d11/d64/de8/f7f 0 2024-09-13T22:09:09.729 INFO:tasks.workunit.client.1.smithi159.stdout:5/804: dread d1/d11/d1c/dd2/d53/f6a [0,4194304] 0 2024-09-13T22:09:09.738 INFO:tasks.workunit.client.1.smithi159.stdout:0/855: creat d0/d2c/d10d/f11c x:0 0 0 2024-09-13T22:09:09.739 INFO:tasks.workunit.client.1.smithi159.stdout:9/703: dwrite d1/dc/f5f [0,4194304] 0 2024-09-13T22:09:09.743 INFO:tasks.workunit.client.1.smithi159.stdout:5/805: read d1/d11/d64/d35/d7c/ff9 [1787790,35403] 0 2024-09-13T22:09:09.743 INFO:tasks.workunit.client.1.smithi159.stdout:5/806: write d1/d11/d1c/d32/f4a [2687920,72268] 0 2024-09-13T22:09:09.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:09 smithi089 ceph-mon[27921]: pgmap v266: 65 pgs: 65 active+clean; 1.8 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 142 MiB/s rd, 181 MiB/s wr, 333 op/s 2024-09-13T22:09:09.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:09 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:09.755 INFO:tasks.workunit.client.1.smithi159.stdout:3/632: dwrite d0/d1/d3/d5/db/d39/f6a [0,4194304] 0 2024-09-13T22:09:09.756 INFO:tasks.workunit.client.1.smithi159.stdout:1/951: truncate dd/d1e/d58/d8a/dbb/d3c/fbd 2964983 0 2024-09-13T22:09:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:09 smithi159 ceph-mon[35348]: pgmap v266: 65 pgs: 65 active+clean; 1.8 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 142 MiB/s rd, 181 MiB/s wr, 333 op/s 2024-09-13T22:09:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:09 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:09.762 INFO:tasks.workunit.client.1.smithi159.stdout:0/856: mknod d0/d48/d4f/d2b/da3/df9/c11d 0 2024-09-13T22:09:09.764 INFO:tasks.workunit.client.1.smithi159.stdout:4/982: dwrite d13/d41/dbf/fcd [0,4194304] 0 2024-09-13T22:09:09.764 INFO:tasks.workunit.client.1.smithi159.stdout:9/704: dwrite d1/d9/d1f/d99/f9d [4194304,4194304] 0 2024-09-13T22:09:09.764 INFO:tasks.workunit.client.1.smithi159.stdout:9/705: fsync d1/dc/d27/f65 0 2024-09-13T22:09:09.766 INFO:tasks.workunit.client.1.smithi159.stdout:5/807: creat d1/d11/d1c/dd2/dd6/f102 x:0 0 0 2024-09-13T22:09:09.766 INFO:tasks.workunit.client.1.smithi159.stdout:5/808: creat d1/d11/d1c/dd2/d53/f103 x:0 0 0 2024-09-13T22:09:09.767 INFO:tasks.workunit.client.1.smithi159.stdout:7/858: rmdir d3/d31/d4d/d4e/d7a 39 2024-09-13T22:09:09.774 INFO:tasks.workunit.client.1.smithi159.stdout:3/633: mkdir d0/d1/d3/d5/db/dc6 0 2024-09-13T22:09:09.779 INFO:tasks.workunit.client.1.smithi159.stdout:4/983: mkdir d13/d41/d135/d107/d14a/d160 0 2024-09-13T22:09:09.783 INFO:tasks.workunit.client.1.smithi159.stdout:9/706: mknod d1/dc/d10/d6d/d4b/d98/da8/cf2 0 2024-09-13T22:09:09.787 INFO:tasks.workunit.client.1.smithi159.stdout:7/859: mknod d3/d2e/dee/c128 0 2024-09-13T22:09:09.787 INFO:tasks.workunit.client.1.smithi159.stdout:7/860: write d3/d2e/db6/d6c/db2/dce/ff0 [1013383,69640] 0 2024-09-13T22:09:09.789 INFO:tasks.workunit.client.1.smithi159.stdout:2/676: rename d9/da/d25 to d9/d65/d8d/de2/df0 0 2024-09-13T22:09:09.789 INFO:tasks.workunit.client.1.smithi159.stdout:2/677: fdatasync d9/d44/deb/dee/f7e 0 2024-09-13T22:09:09.790 INFO:tasks.workunit.client.1.smithi159.stdout:7/861: read d3/d18/f20 [498766,13414] 0 2024-09-13T22:09:09.790 INFO:tasks.workunit.client.1.smithi159.stdout:7/862: write d3/d2e/d6e/f96 [80970,70293] 0 2024-09-13T22:09:09.790 INFO:tasks.workunit.client.1.smithi159.stdout:7/863: write d3/d2e/d6e/d74/fd0 [1408897,126850] 0 2024-09-13T22:09:09.791 INFO:tasks.workunit.client.1.smithi159.stdout:1/952: mknod dd/d1e/d58/d8a/dbb/da4/c138 0 2024-09-13T22:09:09.793 INFO:tasks.workunit.client.1.smithi159.stdout:9/707: write d1/dc/d27/da4/fd0 [211705,95203] 0 2024-09-13T22:09:09.793 INFO:tasks.workunit.client.1.smithi159.stdout:9/708: readlink d1/l5c 0 2024-09-13T22:09:09.793 INFO:tasks.workunit.client.1.smithi159.stdout:9/709: creat d1/dc/d27/ff3 x:0 0 0 2024-09-13T22:09:09.795 INFO:tasks.workunit.client.1.smithi159.stdout:0/857: getdents d0/d2c/d10d 0 2024-09-13T22:09:09.795 INFO:tasks.workunit.client.1.smithi159.stdout:0/858: fdatasync d0/f10 0 2024-09-13T22:09:09.798 INFO:tasks.workunit.client.1.smithi159.stdout:6/848: rename d3/da/d25/d69/d96/l10a to d3/d64/l10f 0 2024-09-13T22:09:09.798 INFO:tasks.workunit.client.1.smithi159.stdout:6/849: creat d3/da/d29/d1a/da3/da5/f110 x:0 0 0 2024-09-13T22:09:09.798 INFO:tasks.workunit.client.1.smithi159.stdout:1/953: dread dd/d11/d18/d49/d2d/d62/f75 [0,4194304] 0 2024-09-13T22:09:09.800 INFO:tasks.workunit.client.1.smithi159.stdout:7/864: unlink d3/d31/d4d/d4e/c97 0 2024-09-13T22:09:09.803 INFO:tasks.workunit.client.1.smithi159.stdout:0/859: link d0/d48/d4f/daa/fab d0/d48/f11e 0 2024-09-13T22:09:09.804 INFO:tasks.workunit.client.1.smithi159.stdout:0/860: dread - d0/d2c/fe9 zero size 2024-09-13T22:09:09.805 INFO:tasks.workunit.client.1.smithi159.stdout:2/678: rename d9/f3d to d9/d65/d8d/de2/d69/ff1 0 2024-09-13T22:09:09.805 INFO:tasks.workunit.client.1.smithi159.stdout:2/679: chown d9 513313862 1 2024-09-13T22:09:09.806 INFO:tasks.workunit.client.1.smithi159.stdout:2/680: stat d9/d65/f6c 0 2024-09-13T22:09:09.807 INFO:tasks.workunit.client.1.smithi159.stdout:7/865: mkdir d3/d31/d4d/d9e/dfb/dff/d129 0 2024-09-13T22:09:09.808 INFO:tasks.workunit.client.1.smithi159.stdout:9/710: mkdir d1/dc/d10/d6d/d2f/df4 0 2024-09-13T22:09:09.810 INFO:tasks.workunit.client.1.smithi159.stdout:0/861: link d0/d48/d4f/d2b/lb9 d0/d2c/d96/l11f 0 2024-09-13T22:09:09.811 INFO:tasks.workunit.client.1.smithi159.stdout:5/809: dwrite d1/d11/d64/fd [0,4194304] 0 2024-09-13T22:09:09.811 INFO:tasks.workunit.client.1.smithi159.stdout:4/984: dwrite d13/d41/d79/db2/dd5/f159 [0,4194304] 0 2024-09-13T22:09:09.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/681: symlink d9/d65/dca/lf2 0 2024-09-13T22:09:09.815 INFO:tasks.workunit.client.1.smithi159.stdout:2/682: truncate d9/da/d82/d89/f8b 27908 0 2024-09-13T22:09:09.816 INFO:tasks.workunit.client.1.smithi159.stdout:7/866: rename d3/d31/fdb to d3/d31/f12a 0 2024-09-13T22:09:09.816 INFO:tasks.workunit.client.1.smithi159.stdout:7/867: chown d3/d2e/d6e/d74/dba 974 1 2024-09-13T22:09:09.818 INFO:tasks.workunit.client.1.smithi159.stdout:6/850: dwrite d3/da/d25/d69/fcc [0,4194304] 0 2024-09-13T22:09:09.828 INFO:tasks.workunit.client.1.smithi159.stdout:1/954: rename fb to dd/d1e/d58/d8a/dbb/f139 0 2024-09-13T22:09:09.830 INFO:tasks.workunit.client.1.smithi159.stdout:2/683: mkdir d9/d65/d8d/de2/d69/d66/df3 0 2024-09-13T22:09:09.831 INFO:tasks.workunit.client.1.smithi159.stdout:7/868: truncate d3/d3f/fad 328958 0 2024-09-13T22:09:09.836 INFO:tasks.workunit.client.1.smithi159.stdout:5/810: rmdir d1/d11/d1c/dd2/d53 39 2024-09-13T22:09:09.838 INFO:tasks.workunit.client.1.smithi159.stdout:9/711: rename d1/dc/d10/d6d/d4b/c78 to d1/dc/d10/d6d/d2f/d8b/d8f/cf5 0 2024-09-13T22:09:09.839 INFO:tasks.workunit.client.1.smithi159.stdout:1/955: mkdir dd/d11/d18/d49/d2d/d62/d13a 0 2024-09-13T22:09:09.841 INFO:tasks.workunit.client.1.smithi159.stdout:0/862: getdents d0/d2c/d96 0 2024-09-13T22:09:09.841 INFO:tasks.workunit.client.1.smithi159.stdout:2/684: creat d9/da/d5a/ddf/ff4 x:0 0 0 2024-09-13T22:09:09.844 INFO:tasks.workunit.client.1.smithi159.stdout:5/811: mknod d1/d11/d64/d82/c104 0 2024-09-13T22:09:09.845 INFO:tasks.workunit.client.1.smithi159.stdout:5/812: stat d1/d11/c84 0 2024-09-13T22:09:09.848 INFO:tasks.workunit.client.1.smithi159.stdout:6/851: dwrite d3/da/d29/d26/f4d [0,4194304] 0 2024-09-13T22:09:09.848 INFO:tasks.workunit.client.1.smithi159.stdout:6/852: dread - d3/da/d29/f103 zero size 2024-09-13T22:09:09.848 INFO:tasks.workunit.client.1.smithi159.stdout:4/985: dwrite d13/d41/d50/f60 [4194304,4194304] 0 2024-09-13T22:09:09.848 INFO:tasks.workunit.client.1.smithi159.stdout:4/986: truncate d13/d15/d26/f72 442206 0 2024-09-13T22:09:09.848 INFO:tasks.workunit.client.1.smithi159.stdout:4/987: write d13/d41/d135/f122 [389055,101240] 0 2024-09-13T22:09:09.850 INFO:tasks.workunit.client.1.smithi159.stdout:9/712: dread d1/dc/d10/d6d/d2f/d8b/da1/fde [0,4194304] 0 2024-09-13T22:09:09.865 INFO:tasks.workunit.client.1.smithi159.stdout:4/988: dwrite d13/d15/d26/f61 [0,4194304] 0 2024-09-13T22:09:09.914 INFO:tasks.workunit.client.1.smithi159.stdout:2/685: creat d9/d65/d8d/de2/d69/dc9/ff5 x:0 0 0 2024-09-13T22:09:09.915 INFO:tasks.workunit.client.1.smithi159.stdout:2/686: readlink d9/d65/d8d/de2/d69/l9c 0 2024-09-13T22:09:09.915 INFO:tasks.workunit.client.1.smithi159.stdout:5/813: truncate d1/d11/d64/d17/f54 98721 0 2024-09-13T22:09:09.915 INFO:tasks.workunit.client.1.smithi159.stdout:5/814: dread - d1/d11/d9e/d7b/f8a zero size 2024-09-13T22:09:09.919 INFO:tasks.workunit.client.1.smithi159.stdout:6/853: unlink d3/da/d25/d69/lfa 0 2024-09-13T22:09:09.920 INFO:tasks.workunit.client.1.smithi159.stdout:6/854: dread d3/fc6 [0,4194304] 0 2024-09-13T22:09:09.920 INFO:tasks.workunit.client.1.smithi159.stdout:6/855: write d3/da/d29/d1a/d3e/d5a/f7d [2019208,129491] 0 2024-09-13T22:09:09.927 INFO:tasks.workunit.client.1.smithi159.stdout:9/713: symlink d1/dc/d10/d6d/d4b/dcb/d75/lf6 0 2024-09-13T22:09:09.927 INFO:tasks.workunit.client.1.smithi159.stdout:9/714: truncate d1/dc/d27/da4/fe1 4285581 0 2024-09-13T22:09:09.927 INFO:tasks.workunit.client.1.smithi159.stdout:9/715: readlink d1/l5c 0 2024-09-13T22:09:09.927 INFO:tasks.workunit.client.1.smithi159.stdout:9/716: write d1/dc/d10/d6d/d2f/d8b/d8f/fe5 [237799,50118] 0 2024-09-13T22:09:09.927 INFO:tasks.workunit.client.1.smithi159.stdout:4/989: truncate d13/fec 1967249 0 2024-09-13T22:09:09.929 INFO:tasks.workunit.client.1.smithi159.stdout:1/956: rename dd/d1e/d58/d5f/d84/cc8 to dd/d11/d13/d4b/d11b/c13b 0 2024-09-13T22:09:09.930 INFO:tasks.workunit.client.1.smithi159.stdout:2/687: mknod d9/d2d/db5/cf6 0 2024-09-13T22:09:09.931 INFO:tasks.workunit.client.1.smithi159.stdout:6/856: creat d3/da/f111 x:0 0 0 2024-09-13T22:09:09.932 INFO:tasks.workunit.client.1.smithi159.stdout:6/857: write d3/d2a/d3c/d46/d73/f77 [225463,41596] 0 2024-09-13T22:09:09.932 INFO:tasks.workunit.client.1.smithi159.stdout:9/717: mknod d1/dc/d10/d6d/d4b/dcb/cf7 0 2024-09-13T22:09:09.934 INFO:tasks.workunit.client.1.smithi159.stdout:5/815: dwrite d1/fad [0,4194304] 0 2024-09-13T22:09:09.934 INFO:tasks.workunit.client.1.smithi159.stdout:4/990: symlink d13/d15/d26/d51/d65/l161 0 2024-09-13T22:09:09.934 INFO:tasks.workunit.client.1.smithi159.stdout:4/991: creat d13/d15/d26/d51/f162 x:0 0 0 2024-09-13T22:09:09.938 INFO:tasks.workunit.client.1.smithi159.stdout:2/688: creat d9/d65/d8d/de2/d69/ff7 x:0 0 0 2024-09-13T22:09:09.939 INFO:tasks.workunit.client.1.smithi159.stdout:6/858: getdents d3/d2a 0 2024-09-13T22:09:09.940 INFO:tasks.workunit.client.1.smithi159.stdout:6/859: write d3/da/d25/f5b [7835913,637] 0 2024-09-13T22:09:09.940 INFO:tasks.workunit.client.1.smithi159.stdout:6/860: readlink d3/d64/dc1/l102 0 2024-09-13T22:09:09.942 INFO:tasks.workunit.client.1.smithi159.stdout:9/718: rename d1/d9/dab/fd9 to d1/d9/dab/dd7/ff8 0 2024-09-13T22:09:09.944 INFO:tasks.workunit.client.1.smithi159.stdout:5/816: mknod d1/d11/d1c/dd2/d44/c105 0 2024-09-13T22:09:09.945 INFO:tasks.workunit.client.1.smithi159.stdout:1/957: dwrite dd/d11/f83 [0,4194304] 0 2024-09-13T22:09:09.945 INFO:tasks.workunit.client.1.smithi159.stdout:1/958: chown dd/d11/cdd 403553279 1 2024-09-13T22:09:09.947 INFO:tasks.workunit.client.1.smithi159.stdout:4/992: symlink d13/d41/d79/db2/l163 0 2024-09-13T22:09:09.949 INFO:tasks.workunit.client.1.smithi159.stdout:2/689: link d9/l16 d9/d65/d8d/de2/df0/lf8 0 2024-09-13T22:09:09.949 INFO:tasks.workunit.client.1.smithi159.stdout:2/690: creat d9/d44/ff9 x:0 0 0 2024-09-13T22:09:09.951 INFO:tasks.workunit.client.1.smithi159.stdout:2/691: dread d9/d44/deb/dee/d77/fde [0,4194304] 0 2024-09-13T22:09:09.952 INFO:tasks.workunit.client.1.smithi159.stdout:2/692: write d9/d92/f95 [185422,104347] 0 2024-09-13T22:09:09.952 INFO:tasks.workunit.client.1.smithi159.stdout:2/693: creat d9/da/d82/ffa x:0 0 0 2024-09-13T22:09:09.953 INFO:tasks.workunit.client.1.smithi159.stdout:6/861: rmdir d3/d2a/d3c/d5c 39 2024-09-13T22:09:09.954 INFO:tasks.workunit.client.1.smithi159.stdout:9/719: link d1/l60 d1/dc/d27/da4/lf9 0 2024-09-13T22:09:09.958 INFO:tasks.workunit.client.1.smithi159.stdout:5/817: truncate d1/d11/f37 183080 0 2024-09-13T22:09:09.964 INFO:tasks.workunit.client.1.smithi159.stdout:1/959: mknod dd/dcc/c13c 0 2024-09-13T22:09:09.967 INFO:tasks.workunit.client.1.smithi159.stdout:4/993: creat d13/f164 x:0 0 0 2024-09-13T22:09:09.967 INFO:tasks.workunit.client.1.smithi159.stdout:4/994: chown d13/d41/d79/ff9 79 1 2024-09-13T22:09:09.967 INFO:tasks.workunit.client.1.smithi159.stdout:4/995: write d13/d15/d26/d29/f90 [1094028,108415] 0 2024-09-13T22:09:09.967 INFO:tasks.workunit.client.1.smithi159.stdout:5/818: dread d1/f2 [4194304,4194304] 0 2024-09-13T22:09:09.967 INFO:tasks.workunit.client.1.smithi159.stdout:5/819: getdents d1/d11/d50/dca 0 2024-09-13T22:09:09.970 INFO:tasks.workunit.client.1.smithi159.stdout:6/862: symlink d3/da/d25/d69/db3/l112 0 2024-09-13T22:09:09.970 INFO:tasks.workunit.client.1.smithi159.stdout:6/863: chown d3/d64/dc1 0 1 2024-09-13T22:09:09.973 INFO:tasks.workunit.client.1.smithi159.stdout:9/720: truncate d1/dc/d10/d6d/d87/f7f 2271142 0 2024-09-13T22:09:09.973 INFO:tasks.workunit.client.1.smithi159.stdout:2/694: dwrite d9/d65/d8d/de2/df0/f34 [0,4194304] 0 2024-09-13T22:09:09.981 INFO:tasks.workunit.client.1.smithi159.stdout:4/996: write d13/d15/d26/d29/d3b/de1/f151 [3893739,45652] 0 2024-09-13T22:09:09.981 INFO:tasks.workunit.client.1.smithi159.stdout:4/997: stat d13/fb6 0 2024-09-13T22:09:09.981 INFO:tasks.workunit.client.1.smithi159.stdout:1/960: mkdir dd/d1e/d58/d8a/dbb/d3c/d95/df5/dfd/d13d 0 2024-09-13T22:09:09.983 INFO:tasks.workunit.client.1.smithi159.stdout:6/864: write d3/da/d29/d1a/f92 [1519072,30240] 0 2024-09-13T22:09:09.984 INFO:tasks.workunit.client.1.smithi159.stdout:5/820: creat d1/f106 x:0 0 0 2024-09-13T22:09:09.985 INFO:tasks.workunit.client.1.smithi159.stdout:9/721: creat d1/d9/dab/dd7/ffa x:0 0 0 2024-09-13T22:09:09.990 INFO:tasks.workunit.client.1.smithi159.stdout:4/998: dread d13/d15/f25 [0,4194304] 0 2024-09-13T22:09:09.990 INFO:tasks.workunit.client.1.smithi159.stdout:4/999: creat d13/d15/d26/d51/d65/d67/f165 x:0 0 0 2024-09-13T22:09:09.990 INFO:tasks.workunit.client.1.smithi159.stdout:1/961: mknod dd/d11/d13/d10b/c13e 0 2024-09-13T22:09:09.997 INFO:tasks.workunit.client.1.smithi159.stdout:5/821: stat d1/d11/d64/d35/d7c/lb4 0 2024-09-13T22:09:09.998 INFO:tasks.workunit.client.1.smithi159.stdout:5/822: write d1/d11/d64/d82/d8f/f81 [517324,25927] 0 2024-09-13T22:09:09.999 INFO:tasks.workunit.client.1.smithi159.stdout:9/722: symlink d1/dc/d10/d6d/d2f/d8b/lfb 0 2024-09-13T22:09:10.003 INFO:tasks.workunit.client.1.smithi159.stdout:1/962: rename dd/d11/d18/d49/d2d/d62/d7d/c101 to dd/d1e/d58/da7/de1/ded/c13f 0 2024-09-13T22:09:10.003 INFO:tasks.workunit.client.1.smithi159.stdout:1/963: readlink dd/l2f 0 2024-09-13T22:09:10.004 INFO:tasks.workunit.client.1.smithi159.stdout:6/865: dwrite d3/da/d29/d26/fec [0,4194304] 0 2024-09-13T22:09:10.006 INFO:tasks.workunit.client.1.smithi159.stdout:1/964: stat dd/d11/d18/d49/cae 0 2024-09-13T22:09:10.006 INFO:tasks.workunit.client.1.smithi159.stdout:6/866: dread d3/da/d29/fca [0,4194304] 0 2024-09-13T22:09:10.010 INFO:tasks.workunit.client.1.smithi159.stdout:1/965: symlink dd/d11/d109/l140 0 2024-09-13T22:09:10.010 INFO:tasks.workunit.client.1.smithi159.stdout:1/966: chown dd/d11/d18/d49/d2d/d97/lca 7 1 2024-09-13T22:09:10.014 INFO:tasks.workunit.client.1.smithi159.stdout:1/967: unlink dd/d1e/d58/d8a/dbb/d3c/d95/df5/d131/d132/dc0/c10c 0 2024-09-13T22:09:10.016 INFO:tasks.workunit.client.1.smithi159.stdout:1/968: rmdir dd/d11/d13/d4b/d52 39 2024-09-13T22:09:10.017 INFO:tasks.workunit.client.1.smithi159.stdout:1/969: dread - dd/d11/d18/d74/f114 zero size 2024-09-13T22:09:10.017 INFO:tasks.workunit.client.1.smithi159.stdout:1/970: chown dd/d11/d13/ff9 2007146 1 2024-09-13T22:09:10.021 INFO:tasks.workunit.client.1.smithi159.stdout:1/971: mkdir dd/d11/d18/d74/def/d100/d141 0 2024-09-13T22:09:10.022 INFO:tasks.workunit.client.1.smithi159.stdout:6/867: write d3/da/d29/d26/fec [2279346,38675] 0 2024-09-13T22:09:10.022 INFO:tasks.workunit.client.1.smithi159.stdout:6/868: write d3/d2a/d3c/f100 [1123558,2601] 0 2024-09-13T22:09:10.023 INFO:tasks.workunit.client.1.smithi159.stdout:6/869: dread d3/da/d29/d1a/d3e/f43 [0,4194304] 0 2024-09-13T22:09:10.029 INFO:tasks.workunit.client.1.smithi159.stdout:8/941: sync 2024-09-13T22:09:10.029 INFO:tasks.workunit.client.1.smithi159.stdout:3/634: sync 2024-09-13T22:09:10.029 INFO:tasks.workunit.client.1.smithi159.stdout:8/942: write da/d36/f41 [1336274,23573] 0 2024-09-13T22:09:10.030 INFO:tasks.workunit.client.1.smithi159.stdout:2/695: write d9/d65/f85 [3516396,31618] 0 2024-09-13T22:09:10.033 INFO:tasks.workunit.client.1.smithi159.stdout:1/972: link dd/d1e/d58/d5f/d84/ccb dd/d1e/d58/c142 0 2024-09-13T22:09:10.036 INFO:tasks.workunit.client.1.smithi159.stdout:3/635: unlink d0/d1/d3/fa5 0 2024-09-13T22:09:10.039 INFO:tasks.workunit.client.1.smithi159.stdout:2/696: unlink d9/d65/d8d/de2/df0/d91/le8 0 2024-09-13T22:09:10.039 INFO:tasks.workunit.client.1.smithi159.stdout:2/697: write d9/da/f7d [412623,40541] 0 2024-09-13T22:09:10.039 INFO:tasks.workunit.client.1.smithi159.stdout:1/973: stat dd/d11/d34/l4a 0 2024-09-13T22:09:10.040 INFO:tasks.workunit.client.1.smithi159.stdout:3/636: truncate d0/d1/d15/f99 203091 0 2024-09-13T22:09:10.042 INFO:tasks.workunit.client.1.smithi159.stdout:8/943: truncate da/f18 1063264 0 2024-09-13T22:09:10.043 INFO:tasks.workunit.client.1.smithi159.stdout:2/698: mknod d9/d65/d8d/de2/cfb 0 2024-09-13T22:09:10.043 INFO:tasks.workunit.client.1.smithi159.stdout:2/699: fdatasync d9/da/d5a/f63 0 2024-09-13T22:09:10.046 INFO:tasks.workunit.client.1.smithi159.stdout:8/944: readlink da/l1e 0 2024-09-13T22:09:10.046 INFO:tasks.workunit.client.1.smithi159.stdout:8/945: chown da/d22/db3/db9 234531634 1 2024-09-13T22:09:10.046 INFO:tasks.workunit.client.1.smithi159.stdout:8/946: dread - da/d7e/d82/d6f/f117 zero size 2024-09-13T22:09:10.046 INFO:tasks.workunit.client.1.smithi159.stdout:8/947: write da/d5d/d70/d8e/dc1/dce/fe1 [831276,81216] 0 2024-09-13T22:09:10.050 INFO:tasks.workunit.client.1.smithi159.stdout:2/700: creat d9/d65/d8d/de2/ffc x:0 0 0 2024-09-13T22:09:10.053 INFO:tasks.workunit.client.1.smithi159.stdout:5/823: dwrite d1/d11/f75 [4194304,4194304] 0 2024-09-13T22:09:10.067 INFO:tasks.workunit.client.1.smithi159.stdout:2/701: dread d9/da/f18 [0,4194304] 0 2024-09-13T22:09:10.068 INFO:tasks.workunit.client.1.smithi159.stdout:2/702: chown d9/d65/d8d/de2/cfb 527309301 1 2024-09-13T22:09:10.068 INFO:tasks.workunit.client.1.smithi159.stdout:5/824: dread d1/d11/d1c/fae [0,4194304] 0 2024-09-13T22:09:10.069 INFO:tasks.workunit.client.1.smithi159.stdout:2/703: unlink d9/d65/d8d/de2/d69/d66/cd2 0 2024-09-13T22:09:10.069 INFO:tasks.workunit.client.1.smithi159.stdout:2/704: fsync d9/d44/deb/dee/d77/f9b 0 2024-09-13T22:09:10.075 INFO:tasks.workunit.client.1.smithi159.stdout:9/723: dwrite d1/dc/d10/d6d/d2f/fb7 [0,4194304] 0 2024-09-13T22:09:10.076 INFO:tasks.workunit.client.1.smithi159.stdout:9/724: read - d1/dc/d27/fcf zero size 2024-09-13T22:09:10.076 INFO:tasks.workunit.client.1.smithi159.stdout:5/825: dread d1/d11/d64/d35/f57 [0,4194304] 0 2024-09-13T22:09:10.076 INFO:tasks.workunit.client.1.smithi159.stdout:5/826: fsync d1/d11/d50/f62 0 2024-09-13T22:09:10.076 INFO:tasks.workunit.client.1.smithi159.stdout:5/827: getdents d1/d11/d50/dca 0 2024-09-13T22:09:10.076 INFO:tasks.workunit.client.1.smithi159.stdout:5/828: fsync d1/d11/d64/d35/d7c/fe0 0 2024-09-13T22:09:10.079 INFO:tasks.workunit.client.1.smithi159.stdout:5/829: dread d1/d11/d9e/d7b/fd4 [0,4194304] 0 2024-09-13T22:09:10.079 INFO:tasks.workunit.client.1.smithi159.stdout:5/830: fdatasync d1/d11/d64/d35/d7c/d7d/fed 0 2024-09-13T22:09:10.079 INFO:tasks.workunit.client.1.smithi159.stdout:5/831: chown d1/d11/d1c/dd2/d53/ca0 6441 1 2024-09-13T22:09:10.079 INFO:tasks.workunit.client.1.smithi159.stdout:9/725: mknod d1/dc/d10/d9c/cfc 0 2024-09-13T22:09:10.079 INFO:tasks.workunit.client.1.smithi159.stdout:9/726: write d1/dc/f12 [4195633,87391] 0 2024-09-13T22:09:10.080 INFO:tasks.workunit.client.1.smithi159.stdout:5/832: mkdir d1/d11/d1c/d107 0 2024-09-13T22:09:10.080 INFO:tasks.workunit.client.1.smithi159.stdout:5/833: stat d1/d11/d9e/f78 0 2024-09-13T22:09:10.081 INFO:tasks.workunit.client.1.smithi159.stdout:9/727: rmdir d1/dc/d10/d6d/d4b/dcb/d74/de3/de6 0 2024-09-13T22:09:10.081 INFO:tasks.workunit.client.1.smithi159.stdout:9/728: readlink d1/d9/d1f/lbd 0 2024-09-13T22:09:10.081 INFO:tasks.workunit.client.1.smithi159.stdout:9/729: chown d1/dc/d10/d9c/lcc 14320901 1 2024-09-13T22:09:10.081 INFO:tasks.workunit.client.1.smithi159.stdout:5/834: creat d1/d11/d64/d35/dfa/f108 x:0 0 0 2024-09-13T22:09:10.083 INFO:tasks.workunit.client.1.smithi159.stdout:9/730: rename d1/dc/d10/d6d/d4b/ce2 to d1/dc/d10/d6d/d2f/d8b/ddd/cfd 0 2024-09-13T22:09:10.092 INFO:tasks.workunit.client.1.smithi159.stdout:6/870: dwrite d3/d2a/d3c/d46/dde/ff6 [0,4194304] 0 2024-09-13T22:09:10.092 INFO:tasks.workunit.client.1.smithi159.stdout:6/871: truncate d3/da/d29/d26/f9f 738723 0 2024-09-13T22:09:10.093 INFO:tasks.workunit.client.1.smithi159.stdout:6/872: read - d3/da/d25/d69/fea zero size 2024-09-13T22:09:10.094 INFO:tasks.workunit.client.1.smithi159.stdout:6/873: rmdir d3/d2a/d3c/d5c 39 2024-09-13T22:09:10.094 INFO:tasks.workunit.client.1.smithi159.stdout:6/874: creat d3/da/f113 x:0 0 0 2024-09-13T22:09:10.095 INFO:tasks.workunit.client.1.smithi159.stdout:6/875: mknod d3/d2a/db5/c114 0 2024-09-13T22:09:10.097 INFO:tasks.workunit.client.1.smithi159.stdout:6/876: rename d3/fc6 to d3/da/d29/f115 0 2024-09-13T22:09:10.097 INFO:tasks.workunit.client.1.smithi159.stdout:6/877: dread - d3/f7e zero size 2024-09-13T22:09:10.098 INFO:tasks.workunit.client.1.smithi159.stdout:6/878: symlink d3/d2a/d3c/d46/dde/l116 0 2024-09-13T22:09:10.099 INFO:tasks.workunit.client.1.smithi159.stdout:6/879: link d3/da/d29/d1a/l51 d3/d2a/d9b/l117 0 2024-09-13T22:09:10.113 INFO:tasks.workunit.client.1.smithi159.stdout:6/880: write d3/da/d25/d69/fd6 [299308,86194] 0 2024-09-13T22:09:10.113 INFO:tasks.workunit.client.1.smithi159.stdout:6/881: chown d3/d2a/d9b/la2 1 1 2024-09-13T22:09:10.114 INFO:tasks.workunit.client.1.smithi159.stdout:6/882: chown d3/da/d29/c1b 263684 1 2024-09-13T22:09:10.114 INFO:tasks.workunit.client.1.smithi159.stdout:6/883: creat d3/d64/dc1/f118 x:0 0 0 2024-09-13T22:09:10.114 INFO:tasks.workunit.client.1.smithi159.stdout:6/884: write d3/da/d29/d26/d6c/d6e/fd8 [916006,77884] 0 2024-09-13T22:09:10.116 INFO:tasks.workunit.client.1.smithi159.stdout:1/974: dwrite dd/d1e/d58/d8a/dbb/f121 [0,4194304] 0 2024-09-13T22:09:10.116 INFO:tasks.workunit.client.1.smithi159.stdout:1/975: dread - dd/d11/d13/ff9 zero size 2024-09-13T22:09:10.118 INFO:tasks.workunit.client.1.smithi159.stdout:2/705: dwrite d9/d44/deb/dee/f99 [0,4194304] 0 2024-09-13T22:09:10.123 INFO:tasks.workunit.client.1.smithi159.stdout:1/976: link dd/d11/f83 dd/d1e/d58/d8a/dbb/d3c/f143 0 2024-09-13T22:09:10.125 INFO:tasks.workunit.client.1.smithi159.stdout:3/637: dwrite d0/d1/d34/f70 [0,4194304] 0 2024-09-13T22:09:10.125 INFO:tasks.workunit.client.1.smithi159.stdout:9/731: dwrite d1/dc/f3e [0,4194304] 0 2024-09-13T22:09:10.125 INFO:tasks.workunit.client.1.smithi159.stdout:6/885: dread d3/da/d29/d1a/da3/da5/fab [0,4194304] 0 2024-09-13T22:09:10.133 INFO:tasks.workunit.client.1.smithi159.stdout:1/977: link dd/d11/d18/d49/d2d/d62/f6a dd/d1e/d58/d8a/dbb/d3c/f144 0 2024-09-13T22:09:10.139 INFO:tasks.workunit.client.1.smithi159.stdout:6/886: write d3/d2a/fb9 [1945427,67060] 0 2024-09-13T22:09:10.139 INFO:tasks.workunit.client.1.smithi159.stdout:6/887: stat d3/da/d29/f45 0 2024-09-13T22:09:10.145 INFO:tasks.workunit.client.1.smithi159.stdout:1/978: read dd/d11/d13/f79 [2352052,89669] 0 2024-09-13T22:09:10.148 INFO:tasks.workunit.client.1.smithi159.stdout:9/732: rmdir d1/dc/d27/da4 39 2024-09-13T22:09:10.150 INFO:tasks.workunit.client.1.smithi159.stdout:1/979: stat dd/d1e/d58/d5f/d84/ccb 0 2024-09-13T22:09:10.156 INFO:tasks.workunit.client.1.smithi159.stdout:9/733: rename d1/d5a/fa5 to d1/dc/d10/d6d/d2f/ffe 0 2024-09-13T22:09:10.156 INFO:tasks.workunit.client.1.smithi159.stdout:6/888: write d3/da/d29/d26/f4d [3262767,14360] 0 2024-09-13T22:09:10.158 INFO:tasks.workunit.client.1.smithi159.stdout:6/889: getdents d3/da/d29/d1a 0 2024-09-13T22:09:10.161 INFO:tasks.workunit.client.1.smithi159.stdout:1/980: write dd/d11/d13/d4b/d52/f77 [3454448,80996] 0 2024-09-13T22:09:10.161 INFO:tasks.workunit.client.1.smithi159.stdout:6/890: getdents d3/da/d25/d69/db3 0 2024-09-13T22:09:10.161 INFO:tasks.workunit.client.1.smithi159.stdout:6/891: write d3/da/d25/f4b [5699657,27715] 0 2024-09-13T22:09:10.172 INFO:tasks.workunit.client.1.smithi159.stdout:1/981: dread dd/d11/d18/d49/d2d/d112/f137 [4194304,4194304] 0 2024-09-13T22:09:10.172 INFO:tasks.workunit.client.1.smithi159.stdout:1/982: read dd/d11/d18/d49/d2d/d97/f93 [169844,60717] 0 2024-09-13T22:09:10.176 INFO:tasks.workunit.client.1.smithi159.stdout:1/983: mknod dd/d11/d18/d49/d2d/d62/d7d/df6/c145 0 2024-09-13T22:09:10.176 INFO:tasks.workunit.client.1.smithi159.stdout:1/984: chown dd/d11/f12a 1 1 2024-09-13T22:09:10.178 INFO:tasks.workunit.client.1.smithi159.stdout:1/985: dread dd/d1e/d58/db4/f127 [0,4194304] 0 2024-09-13T22:09:10.178 INFO:tasks.workunit.client.1.smithi159.stdout:1/986: write dd/d1e/f44 [2178657,90136] 0 2024-09-13T22:09:10.182 INFO:tasks.workunit.client.1.smithi159.stdout:1/987: rename dd/d11/d13/d4b/d52/cbf to dd/d1e/d58/d8a/dbb/c146 0 2024-09-13T22:09:10.205 INFO:tasks.workunit.client.1.smithi159.stdout:7/869: sync 2024-09-13T22:09:10.206 INFO:tasks.workunit.client.1.smithi159.stdout:0/863: sync 2024-09-13T22:09:10.206 INFO:tasks.workunit.client.1.smithi159.stdout:7/870: fsync d3/d31/d4d/d4e/d7a/f9b 0 2024-09-13T22:09:10.206 INFO:tasks.workunit.client.1.smithi159.stdout:0/864: stat d0/d48/d4f/d54/d74/c10f 0 2024-09-13T22:09:10.206 INFO:tasks.workunit.client.1.smithi159.stdout:0/865: chown d0/d2c/d71/ca9 0 1 2024-09-13T22:09:10.206 INFO:tasks.workunit.client.1.smithi159.stdout:0/866: mkdir d0/d48/d4f/d66/d75/d120 0 2024-09-13T22:09:10.207 INFO:tasks.workunit.client.1.smithi159.stdout:6/892: dwrite d3/da/f113 [0,4194304] 0 2024-09-13T22:09:10.208 INFO:tasks.workunit.client.1.smithi159.stdout:9/734: dwrite d1/d9/dab/dd7/f89 [0,4194304] 0 2024-09-13T22:09:10.215 INFO:tasks.workunit.client.1.smithi159.stdout:6/893: mknod d3/da/d29/d1a/d3e/ddc/c119 0 2024-09-13T22:09:10.215 INFO:tasks.workunit.client.1.smithi159.stdout:1/988: dwrite dd/d1e/d58/d5f/d84/fd9 [0,4194304] 0 2024-09-13T22:09:10.217 INFO:tasks.workunit.client.1.smithi159.stdout:9/735: creat d1/dc/d10/d6d/d4b/dcb/d74/de3/fff x:0 0 0 2024-09-13T22:09:10.217 INFO:tasks.workunit.client.1.smithi159.stdout:9/736: chown d1/d5a 730630 1 2024-09-13T22:09:10.217 INFO:tasks.workunit.client.1.smithi159.stdout:9/737: stat d1/dc/d10/d6d/d2f/d8b 0 2024-09-13T22:09:10.217 INFO:tasks.workunit.client.1.smithi159.stdout:9/738: creat d1/dc/d10/d6d/d4b/dcb/d74/de3/f100 x:0 0 0 2024-09-13T22:09:10.218 INFO:tasks.workunit.client.1.smithi159.stdout:6/894: rename d3/d2a/le3 to d3/d64/dc1/l11a 0 2024-09-13T22:09:10.225 INFO:tasks.workunit.client.1.smithi159.stdout:9/739: mkdir d1/d5a/d101 0 2024-09-13T22:09:10.230 INFO:tasks.workunit.client.1.smithi159.stdout:9/740: read d1/dc/d10/d6d/d4b/d98/da8/fb3 [342911,20854] 0 2024-09-13T22:09:10.231 INFO:tasks.workunit.client.1.smithi159.stdout:9/741: symlink d1/d9/d1f/d99/l102 0 2024-09-13T22:09:10.246 INFO:tasks.workunit.client.1.smithi159.stdout:9/742: dread d1/dc/d10/d6d/d4b/dcb/d75/fa6 [0,4194304] 0 2024-09-13T22:09:10.254 INFO:tasks.workunit.client.1.smithi159.stdout:7/871: dwrite d3/d2e/db6/d6c/db2/dce/ff0 [0,4194304] 0 2024-09-13T22:09:10.254 INFO:tasks.workunit.client.1.smithi159.stdout:0/867: dwrite d0/d48/f70 [0,4194304] 0 2024-09-13T22:09:10.254 INFO:tasks.workunit.client.1.smithi159.stdout:0/868: chown d0/d48/d4f/d2b/da3/ff0 6 1 2024-09-13T22:09:10.255 INFO:tasks.workunit.client.1.smithi159.stdout:6/895: dwrite d3/da/d29/d1a/f92 [0,4194304] 0 2024-09-13T22:09:10.255 INFO:tasks.workunit.client.1.smithi159.stdout:6/896: read d3/da/d29/d1a/f94 [829126,66962] 0 2024-09-13T22:09:10.255 INFO:tasks.workunit.client.1.smithi159.stdout:6/897: write d3/da/d29/d1a/d3e/d5a/d6a/fef [4830689,120663] 0 2024-09-13T22:09:10.255 INFO:tasks.workunit.client.1.smithi159.stdout:6/898: fsync d3/d2a/d9b/fed 0 2024-09-13T22:09:10.256 INFO:tasks.workunit.client.1.smithi159.stdout:7/872: truncate d3/d3f/f48 373918 0 2024-09-13T22:09:10.258 INFO:tasks.workunit.client.1.smithi159.stdout:6/899: mknod d3/da/d29/d1a/d3e/c11b 0 2024-09-13T22:09:10.258 INFO:tasks.workunit.client.1.smithi159.stdout:6/900: fdatasync d3/da/d29/d1a/d3e/d5a/f88 0 2024-09-13T22:09:10.258 INFO:tasks.workunit.client.1.smithi159.stdout:6/901: chown d3/d2a/d9b/ce2 1086231 1 2024-09-13T22:09:10.268 INFO:tasks.workunit.client.1.smithi159.stdout:9/743: dwrite d1/d9/ff [0,4194304] 0 2024-09-13T22:09:10.279 INFO:tasks.workunit.client.1.smithi159.stdout:9/744: dread d1/f53 [0,4194304] 0 2024-09-13T22:09:10.281 INFO:tasks.workunit.client.1.smithi159.stdout:9/745: mknod d1/d9/dab/dd7/c103 0 2024-09-13T22:09:10.281 INFO:tasks.workunit.client.1.smithi159.stdout:9/746: creat d1/dc/d10/d6d/d87/f104 x:0 0 0 2024-09-13T22:09:10.285 INFO:tasks.workunit.client.1.smithi159.stdout:9/747: dread d1/dc/d10/d69/f90 [0,4194304] 0 2024-09-13T22:09:10.286 INFO:tasks.workunit.client.1.smithi159.stdout:9/748: creat d1/dc/d27/da4/db5/f105 x:0 0 0 2024-09-13T22:09:10.290 INFO:tasks.workunit.client.1.smithi159.stdout:6/902: dwrite d3/da/d25/f41 [0,4194304] 0 2024-09-13T22:09:10.290 INFO:tasks.workunit.client.1.smithi159.stdout:7/873: dwrite d3/d3f/f91 [0,4194304] 0 2024-09-13T22:09:10.291 INFO:tasks.workunit.client.1.smithi159.stdout:6/903: link d3/d2a/c93 d3/d2a/db7/c11c 0 2024-09-13T22:09:10.291 INFO:tasks.workunit.client.1.smithi159.stdout:6/904: creat d3/d2a/d3c/d46/f11d x:0 0 0 2024-09-13T22:09:10.297 INFO:tasks.workunit.client.1.smithi159.stdout:6/905: symlink d3/da/d25/d69/d96/deb/l11e 0 2024-09-13T22:09:10.297 INFO:tasks.workunit.client.1.smithi159.stdout:6/906: chown d3/da/faa 21314 1 2024-09-13T22:09:10.297 INFO:tasks.workunit.client.1.smithi159.stdout:6/907: truncate d3/d2a/f57 4931872 0 2024-09-13T22:09:10.300 INFO:tasks.workunit.client.1.smithi159.stdout:7/874: dread d3/f1e [0,4194304] 0 2024-09-13T22:09:10.302 INFO:tasks.workunit.client.1.smithi159.stdout:7/875: creat d3/d31/dd8/f12b x:0 0 0 2024-09-13T22:09:10.302 INFO:tasks.workunit.client.1.smithi159.stdout:7/876: fsync d3/fb7 0 2024-09-13T22:09:10.302 INFO:tasks.workunit.client.1.smithi159.stdout:7/877: readlink d3/lc 0 2024-09-13T22:09:10.302 INFO:tasks.workunit.client.1.smithi159.stdout:7/878: readlink d3/d2e/d6e/d74/dba/lef 0 2024-09-13T22:09:10.303 INFO:tasks.workunit.client.1.smithi159.stdout:7/879: mknod d3/d31/d4d/d9e/dfb/c12c 0 2024-09-13T22:09:10.304 INFO:tasks.workunit.client.1.smithi159.stdout:6/908: dread d3/da/f10 [4194304,4194304] 0 2024-09-13T22:09:10.305 INFO:tasks.workunit.client.1.smithi159.stdout:6/909: truncate d3/da/d29/d1a/d3e/d5a/dbb/ff2 1244627 0 2024-09-13T22:09:10.307 INFO:tasks.workunit.client.1.smithi159.stdout:7/880: getdents d3/d31/d4d/d4e 0 2024-09-13T22:09:10.309 INFO:tasks.workunit.client.1.smithi159.stdout:7/881: dread d3/d31/dd8/f10b [0,4194304] 0 2024-09-13T22:09:10.328 INFO:tasks.workunit.client.1.smithi159.stdout:6/910: dwrite d3/d2a/d9b/fe7 [0,4194304] 0 2024-09-13T22:09:10.329 INFO:tasks.workunit.client.1.smithi159.stdout:6/911: write d3/da/d29/d1a/f2e [739025,35431] 0 2024-09-13T22:09:10.329 INFO:tasks.workunit.client.1.smithi159.stdout:6/912: chown d3/da/d29/d26/cd7 3725 1 2024-09-13T22:09:10.337 INFO:tasks.workunit.client.1.smithi159.stdout:7/882: dwrite d3/d31/d4d/ff3 [0,4194304] 0 2024-09-13T22:09:10.337 INFO:tasks.workunit.client.1.smithi159.stdout:7/883: truncate d3/d2e/d6e/d74/fd0 1909451 0 2024-09-13T22:09:10.361 INFO:tasks.workunit.client.1.smithi159.stdout:6/913: mknod d3/da/c11f 0 2024-09-13T22:09:10.361 INFO:tasks.workunit.client.1.smithi159.stdout:6/914: creat d3/d64/dc1/f120 x:0 0 0 2024-09-13T22:09:10.362 INFO:tasks.workunit.client.1.smithi159.stdout:7/884: creat d3/d31/f12d x:0 0 0 2024-09-13T22:09:10.372 INFO:tasks.workunit.client.1.smithi159.stdout:6/915: mkdir d3/da/d29/d1a/d3e/d5a/d6a/d121 0 2024-09-13T22:09:10.372 INFO:tasks.workunit.client.1.smithi159.stdout:6/916: stat d3/da/d25/d69/c61 0 2024-09-13T22:09:10.373 INFO:tasks.workunit.client.1.smithi159.stdout:6/917: write d3/da/d29/d1a/f94 [1774150,100473] 0 2024-09-13T22:09:10.373 INFO:tasks.workunit.client.1.smithi159.stdout:6/918: getdents d3/da/d29/d26/d6c/d6e/dfd 0 2024-09-13T22:09:10.373 INFO:tasks.workunit.client.1.smithi159.stdout:7/885: getdents d3/d31/d4d/d4e/d119 0 2024-09-13T22:09:10.375 INFO:tasks.workunit.client.1.smithi159.stdout:7/886: link d3/d31/ca9 d3/d31/d4d/d9e/dbe/c12e 0 2024-09-13T22:09:10.380 INFO:tasks.workunit.client.1.smithi159.stdout:6/919: dread d3/da/d29/d1a/d3e/d5a/d6a/fd9 [0,4194304] 0 2024-09-13T22:09:10.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/920: mknod d3/d2a/d3c/d46/dde/c122 0 2024-09-13T22:09:10.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/921: truncate d3/d2a/d3c/f100 1522770 0 2024-09-13T22:09:10.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/922: chown d3/d2a/d3c/d46/c104 7643 1 2024-09-13T22:09:10.382 INFO:tasks.workunit.client.1.smithi159.stdout:6/923: stat d3/da/d29/d1a/d3e/ddc/c119 0 2024-09-13T22:09:10.383 INFO:tasks.workunit.client.1.smithi159.stdout:7/887: read d3/d3f/f4a [6916167,75994] 0 2024-09-13T22:09:10.383 INFO:tasks.workunit.client.1.smithi159.stdout:6/924: link d3/d2a/d3c/d46/d73/ca8 d3/da/d29/d1a/d3e/ddc/c123 0 2024-09-13T22:09:10.383 INFO:tasks.workunit.client.1.smithi159.stdout:7/888: rmdir d3/d31/d4d 39 2024-09-13T22:09:10.392 INFO:tasks.workunit.client.1.smithi159.stdout:6/925: rmdir d3/da/d29 39 2024-09-13T22:09:10.392 INFO:tasks.workunit.client.1.smithi159.stdout:6/926: truncate d3/d64/dc1/f120 891308 0 2024-09-13T22:09:10.392 INFO:tasks.workunit.client.1.smithi159.stdout:6/927: chown d3/c9 5 1 2024-09-13T22:09:10.394 INFO:tasks.workunit.client.1.smithi159.stdout:6/928: creat d3/d2a/d3c/d5c/f124 x:0 0 0 2024-09-13T22:09:10.396 INFO:tasks.workunit.client.1.smithi159.stdout:6/929: truncate d3/da/d29/d1a/f1c 739592 0 2024-09-13T22:09:10.398 INFO:tasks.workunit.client.1.smithi159.stdout:6/930: mknod d3/da/d29/d1a/d3e/ddc/c125 0 2024-09-13T22:09:10.416 INFO:tasks.workunit.client.1.smithi159.stdout:6/931: dwrite d3/d2a/d3c/d46/f11d [0,4194304] 0 2024-09-13T22:09:10.416 INFO:tasks.workunit.client.1.smithi159.stdout:6/932: readlink d3/d64/lb6 0 2024-09-13T22:09:10.419 INFO:tasks.workunit.client.1.smithi159.stdout:6/933: rename d3/da/d25/d69/d96/deb/fb2 to d3/da/d29/d1a/d3e/d5a/f126 0 2024-09-13T22:09:10.421 INFO:tasks.workunit.client.1.smithi159.stdout:6/934: unlink d3/da/d29/d26/fec 0 2024-09-13T22:09:10.422 INFO:tasks.workunit.client.1.smithi159.stdout:6/935: rmdir d3/da/d29/d1a/d3e/d5a 39 2024-09-13T22:09:10.429 INFO:tasks.workunit.client.1.smithi159.stdout:6/936: dread d3/f23 [0,4194304] 0 2024-09-13T22:09:10.432 INFO:tasks.workunit.client.1.smithi159.stdout:6/937: creat d3/da/d29/d1a/d3e/f127 x:0 0 0 2024-09-13T22:09:10.433 INFO:tasks.workunit.client.1.smithi159.stdout:6/938: mkdir d3/da/d29/d1a/da3/d128 0 2024-09-13T22:09:10.433 INFO:tasks.workunit.client.1.smithi159.stdout:6/939: chown d3/l14 1 1 2024-09-13T22:09:10.433 INFO:tasks.workunit.client.1.smithi159.stdout:6/940: creat d3/da/d29/d1a/da3/d128/f129 x:0 0 0 2024-09-13T22:09:10.433 INFO:tasks.workunit.client.1.smithi159.stdout:6/941: mknod d3/da/c12a 0 2024-09-13T22:09:10.446 INFO:tasks.workunit.client.1.smithi159.stdout:6/942: dwrite d3/d2a/d3c/fc3 [0,4194304] 0 2024-09-13T22:09:10.459 INFO:tasks.workunit.client.1.smithi159.stdout:6/943: dwrite d3/da/d29/f115 [0,4194304] 0 2024-09-13T22:09:10.459 INFO:tasks.workunit.client.1.smithi159.stdout:6/944: readlink d3/d2a/l3b 0 2024-09-13T22:09:10.461 INFO:tasks.workunit.client.1.smithi159.stdout:6/945: mkdir d3/da/d29/d1a/d3e/d5a/d12b 0 2024-09-13T22:09:10.465 INFO:tasks.workunit.client.1.smithi159.stdout:6/946: dread d3/da/f42 [0,4194304] 0 2024-09-13T22:09:10.465 INFO:tasks.workunit.client.1.smithi159.stdout:6/947: fsync d3/da/d29/d1a/d3e/d5a/d6a/fdb 0 2024-09-13T22:09:10.465 INFO:tasks.workunit.client.1.smithi159.stdout:6/948: chown d3/da/d29/d1a/d3e/d5a/d6a/c87 2040 1 2024-09-13T22:09:10.466 INFO:tasks.workunit.client.1.smithi159.stdout:6/949: mkdir d3/d2a/d9b/d12c 0 2024-09-13T22:09:10.468 INFO:tasks.workunit.client.1.smithi159.stdout:6/950: dread d3/f23 [4194304,4194304] 0 2024-09-13T22:09:10.468 INFO:tasks.workunit.client.1.smithi159.stdout:6/951: read d3/da/d25/d69/d96/f5e [183847,18473] 0 2024-09-13T22:09:10.470 INFO:tasks.workunit.client.1.smithi159.stdout:6/952: creat d3/da/d29/d1a/da3/da5/f12d x:0 0 0 2024-09-13T22:09:10.477 INFO:tasks.workunit.client.1.smithi159.stdout:6/953: dread d3/da/d29/d26/d6c/fd2 [0,4194304] 0 2024-09-13T22:09:10.484 INFO:tasks.workunit.client.1.smithi159.stdout:6/954: dread d3/da/d29/d26/d6c/f76 [4194304,4194304] 0 2024-09-13T22:09:10.487 INFO:tasks.workunit.client.1.smithi159.stdout:6/955: mkdir d3/da/d25/d69/d96/deb/d12e 0 2024-09-13T22:09:10.488 INFO:tasks.workunit.client.1.smithi159.stdout:6/956: link d3/d2a/d3c/d46/d73/df1/ce6 d3/da/d29/d26/d6c/d6e/da9/c12f 0 2024-09-13T22:09:10.488 INFO:tasks.workunit.client.1.smithi159.stdout:6/957: chown d3/d2a/d3c/d5c/cd1 20890358 1 2024-09-13T22:09:10.489 INFO:tasks.workunit.client.1.smithi159.stdout:6/958: write d3/da/d29/d1a/d3e/d5a/f126 [279430,6920] 0 2024-09-13T22:09:10.489 INFO:tasks.workunit.client.1.smithi159.stdout:6/959: chown d3/da/c8d 60 1 2024-09-13T22:09:10.493 INFO:tasks.workunit.client.1.smithi159.stdout:6/960: dread d3/da/d25/d69/fd6 [0,4194304] 0 2024-09-13T22:09:10.507 INFO:tasks.workunit.client.1.smithi159.stdout:6/961: dwrite d3/da/d29/f45 [0,4194304] 0 2024-09-13T22:09:10.516 INFO:tasks.workunit.client.1.smithi159.stdout:6/962: write d3/d2a/d9b/fe7 [1899,90513] 0 2024-09-13T22:09:10.519 INFO:tasks.workunit.client.1.smithi159.stdout:6/963: link d3/d2a/c68 d3/d2a/d3c/d46/dde/c130 0 2024-09-13T22:09:10.528 INFO:tasks.workunit.client.1.smithi159.stdout:6/964: dread d3/d2a/d3c/d46/dde/ff6 [0,4194304] 0 2024-09-13T22:09:10.531 INFO:tasks.workunit.client.1.smithi159.stdout:6/965: dread d3/da/d29/d26/d6c/d6e/fd8 [0,4194304] 0 2024-09-13T22:09:10.532 INFO:tasks.workunit.client.1.smithi159.stdout:6/966: mknod d3/da/d29/d1a/d3e/c131 0 2024-09-13T22:09:10.532 INFO:tasks.workunit.client.1.smithi159.stdout:6/967: chown d3/da/lf8 5514 1 2024-09-13T22:09:10.537 INFO:tasks.workunit.client.1.smithi159.stdout:6/968: rmdir d3/da/d29/d1a/da3/d128 39 2024-09-13T22:09:10.537 INFO:tasks.workunit.client.1.smithi159.stdout:6/969: dread - d3/d2a/db7/ff5 zero size 2024-09-13T22:09:10.540 INFO:tasks.workunit.client.1.smithi159.stdout:6/970: symlink d3/da/d29/d1a/da3/l132 0 2024-09-13T22:09:10.543 INFO:tasks.workunit.client.1.smithi159.stdout:6/971: rename d3/da/d29/d26/d6c/cfc to d3/d2a/db5/c133 0 2024-09-13T22:09:10.546 INFO:tasks.workunit.client.1.smithi159.stdout:6/972: mkdir d3/da/d29/d1a/d3e/d5a/d6a/d121/d134 0 2024-09-13T22:09:10.546 INFO:tasks.workunit.client.1.smithi159.stdout:6/973: fdatasync d3/da/d25/d69/fea 0 2024-09-13T22:09:10.546 INFO:tasks.workunit.client.1.smithi159.stdout:6/974: chown d3/da/d29/d1a/d3e/d5a/d6a/ff0 0 1 2024-09-13T22:09:10.548 INFO:tasks.workunit.client.1.smithi159.stdout:6/975: creat d3/da/d29/d1a/d3e/d5a/d6a/d121/d134/f135 x:0 0 0 2024-09-13T22:09:10.548 INFO:tasks.workunit.client.1.smithi159.stdout:6/976: chown d3/da/d29/d1a/f1c 6 1 2024-09-13T22:09:10.549 INFO:tasks.workunit.client.1.smithi159.stdout:6/977: creat d3/da/d29/d1a/da3/f136 x:0 0 0 2024-09-13T22:09:10.558 INFO:tasks.workunit.client.1.smithi159.stdout:6/978: write d3/da/d29/d1a/f90 [3047325,129083] 0 2024-09-13T22:09:10.560 INFO:tasks.workunit.client.1.smithi159.stdout:6/979: getdents d3/da/d29/d26 0 2024-09-13T22:09:10.571 INFO:tasks.workunit.client.1.smithi159.stdout:6/980: creat d3/d2a/d9b/d12c/f137 x:0 0 0 2024-09-13T22:09:10.574 INFO:tasks.workunit.client.1.smithi159.stdout:6/981: unlink d3/d2a/d3c/d5c/faf 0 2024-09-13T22:09:10.576 INFO:tasks.workunit.client.1.smithi159.stdout:6/982: mknod d3/d2a/d3c/d46/c138 0 2024-09-13T22:09:10.576 INFO:tasks.workunit.client.1.smithi159.stdout:6/983: stat d3/da/d29/c36 0 2024-09-13T22:09:10.576 INFO:tasks.workunit.client.1.smithi159.stdout:6/984: stat d3/da/d29/f17 0 2024-09-13T22:09:10.576 INFO:tasks.workunit.client.1.smithi159.stdout:6/985: readlink d3/lee 0 2024-09-13T22:09:10.579 INFO:tasks.workunit.client.1.smithi159.stdout:6/986: write d3/da/d29/d26/d6c/f76 [4527477,10837] 0 2024-09-13T22:09:10.582 INFO:tasks.workunit.client.1.smithi159.stdout:6/987: dread d3/da/d29/d26/d6c/d6e/fd8 [0,4194304] 0 2024-09-13T22:09:10.584 INFO:tasks.workunit.client.1.smithi159.stdout:6/988: rename d3/da/d29/d1a/d3e/d5a/d6a/fef to d3/da/d29/d1a/d3e/d5a/d6a/f139 0 2024-09-13T22:09:10.585 INFO:tasks.workunit.client.1.smithi159.stdout:6/989: symlink d3/d2a/l13a 0 2024-09-13T22:09:10.586 INFO:tasks.workunit.client.1.smithi159.stdout:6/990: mknod d3/da/d29/d26/d6c/d6e/c13b 0 2024-09-13T22:09:10.586 INFO:tasks.workunit.client.1.smithi159.stdout:6/991: read - d3/da/d29/d1a/da3/f136 zero size 2024-09-13T22:09:10.588 INFO:tasks.workunit.client.1.smithi159.stdout:6/992: unlink d3/da/d29/d1a/d3e/f127 0 2024-09-13T22:09:10.596 INFO:tasks.workunit.client.1.smithi159.stdout:6/993: write d3/da/d29/d1a/d3e/d5a/f7d [5363022,13874] 0 2024-09-13T22:09:10.598 INFO:tasks.workunit.client.1.smithi159.stdout:6/994: unlink d3/da/d29/d1a/l51 0 2024-09-13T22:09:10.600 INFO:tasks.workunit.client.1.smithi159.stdout:6/995: symlink d3/d2a/db5/l13c 0 2024-09-13T22:09:10.600 INFO:tasks.workunit.client.1.smithi159.stdout:6/996: fsync d3/d2a/d9b/fed 0 2024-09-13T22:09:10.603 INFO:tasks.workunit.client.1.smithi159.stdout:6/997: creat d3/d2a/d3c/d5c/d10e/f13d x:0 0 0 2024-09-13T22:09:10.603 INFO:tasks.workunit.client.1.smithi159.stdout:6/998: dread - d3/da/d29/d1a/d3e/d5a/d6a/ff0 zero size 2024-09-13T22:09:10.603 INFO:tasks.workunit.client.1.smithi159.stdout:6/999: chown d3/da/d29/d1a/d3e/d5a/dbb/ff2 27 1 2024-09-13T22:09:10.781 INFO:tasks.workunit.client.1.smithi159.stdout:5/835: sync 2024-09-13T22:09:10.781 INFO:tasks.workunit.client.1.smithi159.stdout:8/948: sync 2024-09-13T22:09:10.781 INFO:tasks.workunit.client.1.smithi159.stdout:2/706: sync 2024-09-13T22:09:10.781 INFO:tasks.workunit.client.1.smithi159.stdout:2/707: chown d9/da/cf 705993791 1 2024-09-13T22:09:10.782 INFO:tasks.workunit.client.1.smithi159.stdout:8/949: dread da/d22/d2a/da1/fb6 [0,4194304] 0 2024-09-13T22:09:10.782 INFO:tasks.workunit.client.1.smithi159.stdout:5/836: symlink d1/d11/d1c/dd2/d44/d89/l109 0 2024-09-13T22:09:10.782 INFO:tasks.workunit.client.1.smithi159.stdout:2/708: creat d9/d65/d8d/de2/d69/dab/dce/ffd x:0 0 0 2024-09-13T22:09:10.785 INFO:tasks.workunit.client.1.smithi159.stdout:2/709: mkdir d9/d65/dfe 0 2024-09-13T22:09:10.788 INFO:tasks.workunit.client.1.smithi159.stdout:2/710: mknod d9/d65/d8d/de2/cff 0 2024-09-13T22:09:10.791 INFO:tasks.workunit.client.1.smithi159.stdout:2/711: symlink d9/d92/l100 0 2024-09-13T22:09:10.792 INFO:tasks.workunit.client.1.smithi159.stdout:5/837: write d1/d11/d64/d17/f2c [2609775,48350] 0 2024-09-13T22:09:10.793 INFO:tasks.workunit.client.1.smithi159.stdout:2/712: creat d9/d44/deb/dee/d77/da6/db0/f101 x:0 0 0 2024-09-13T22:09:10.795 INFO:tasks.workunit.client.1.smithi159.stdout:5/838: read d1/d11/d1c/fae [509910,130009] 0 2024-09-13T22:09:10.804 INFO:tasks.workunit.client.1.smithi159.stdout:8/950: dwrite da/d7e/d82/dd8/fe8 [0,4194304] 0 2024-09-13T22:09:10.808 INFO:tasks.workunit.client.1.smithi159.stdout:8/951: mknod da/d5d/d70/d8e/dc1/dce/dd4/c147 0 2024-09-13T22:09:10.808 INFO:tasks.workunit.client.1.smithi159.stdout:8/952: dread - da/d22/d4a/dcc/f12f zero size 2024-09-13T22:09:10.822 INFO:tasks.workunit.client.1.smithi159.stdout:5/839: dwrite d1/d11/d1c/dd2/fc5 [0,4194304] 0 2024-09-13T22:09:10.823 INFO:tasks.workunit.client.1.smithi159.stdout:5/840: chown d1/d11/d64/d17/l2a 9618555 1 2024-09-13T22:09:10.823 INFO:tasks.workunit.client.1.smithi159.stdout:5/841: stat d1/d11/c84 0 2024-09-13T22:09:10.823 INFO:tasks.workunit.client.1.smithi159.stdout:5/842: truncate d1/d11/d9e/f31 4638857 0 2024-09-13T22:09:10.823 INFO:tasks.workunit.client.1.smithi159.stdout:2/713: dwrite d9/da/f18 [4194304,4194304] 0 2024-09-13T22:09:10.823 INFO:tasks.workunit.client.1.smithi159.stdout:2/714: write d9/d65/d8d/de2/d69/dc9/ff5 [978029,52293] 0 2024-09-13T22:09:10.826 INFO:tasks.workunit.client.1.smithi159.stdout:2/715: write f5 [615247,96624] 0 2024-09-13T22:09:10.826 INFO:tasks.workunit.client.1.smithi159.stdout:2/716: getdents d9/d44/deb/dee/de9 0 2024-09-13T22:09:10.826 INFO:tasks.workunit.client.1.smithi159.stdout:2/717: write d9/d44/deb/dee/d77/da6/db0/fbd [464313,105152] 0 2024-09-13T22:09:10.827 INFO:tasks.workunit.client.1.smithi159.stdout:5/843: creat d1/d11/d50/dca/f10a x:0 0 0 2024-09-13T22:09:10.832 INFO:tasks.workunit.client.1.smithi159.stdout:5/844: unlink d1/d11/d64/d35/c38 0 2024-09-13T22:09:10.832 INFO:tasks.workunit.client.1.smithi159.stdout:2/718: write d9/d37/f5b [3812137,60061] 0 2024-09-13T22:09:10.832 INFO:tasks.workunit.client.1.smithi159.stdout:2/719: dread - d9/d92/fb3 zero size 2024-09-13T22:09:10.834 INFO:tasks.workunit.client.1.smithi159.stdout:5/845: mknod d1/d11/d1c/dd2/d44/dd8/c10b 0 2024-09-13T22:09:10.835 INFO:tasks.workunit.client.1.smithi159.stdout:2/720: mkdir d9/d44/d102 0 2024-09-13T22:09:10.835 INFO:tasks.workunit.client.1.smithi159.stdout:2/721: read - d9/d65/d8d/de2/d69/ff7 zero size 2024-09-13T22:09:10.835 INFO:tasks.workunit.client.1.smithi159.stdout:2/722: write f5 [2582748,60701] 0 2024-09-13T22:09:10.836 INFO:tasks.workunit.client.1.smithi159.stdout:5/846: read d1/d11/d64/d35/f57 [1167907,114820] 0 2024-09-13T22:09:10.837 INFO:tasks.workunit.client.1.smithi159.stdout:2/723: truncate d9/da/f7d 212962 0 2024-09-13T22:09:10.838 INFO:tasks.workunit.client.1.smithi159.stdout:5/847: creat d1/d11/d1c/dd2/d44/dd8/f10c x:0 0 0 2024-09-13T22:09:10.841 INFO:tasks.workunit.client.1.smithi159.stdout:2/724: rename d9/da/d82/d89/f8b to d9/da/f103 0 2024-09-13T22:09:10.841 INFO:tasks.workunit.client.1.smithi159.stdout:2/725: write d9/d65/d8d/de2/d69/fbf [270084,42292] 0 2024-09-13T22:09:10.842 INFO:tasks.workunit.client.1.smithi159.stdout:5/848: mknod d1/d11/d9e/d7b/c10d 0 2024-09-13T22:09:10.844 INFO:tasks.workunit.client.1.smithi159.stdout:2/726: link d9/d65/d8d/de2/df0/fd9 d9/d44/deb/f104 0 2024-09-13T22:09:10.844 INFO:tasks.workunit.client.1.smithi159.stdout:2/727: fdatasync d9/f5e 0 2024-09-13T22:09:10.845 INFO:tasks.workunit.client.1.smithi159.stdout:5/849: rename d1/d11/d1c/d32/f4a to d1/d11/d1c/dd2/f10e 0 2024-09-13T22:09:10.845 INFO:tasks.workunit.client.1.smithi159.stdout:5/850: write d1/d11/d1c/dd2/d53/f103 [447429,44312] 0 2024-09-13T22:09:10.864 INFO:tasks.workunit.client.1.smithi159.stdout:2/728: dwrite d9/d37/f5b [0,4194304] 0 2024-09-13T22:09:10.865 INFO:tasks.workunit.client.1.smithi159.stdout:2/729: write d9/d2d/db5/fc7 [599742,100409] 0 2024-09-13T22:09:10.876 INFO:tasks.workunit.client.1.smithi159.stdout:2/730: dread d9/d92/fbc [0,4194304] 0 2024-09-13T22:09:10.876 INFO:tasks.workunit.client.1.smithi159.stdout:2/731: fsync d9/da/d82/f93 0 2024-09-13T22:09:10.876 INFO:tasks.workunit.client.1.smithi159.stdout:2/732: readlink d9/d44/l70 0 2024-09-13T22:09:10.877 INFO:tasks.workunit.client.1.smithi159.stdout:2/733: unlink d9/d44/deb/dee/f99 0 2024-09-13T22:09:10.878 INFO:tasks.workunit.client.1.smithi159.stdout:8/953: dwrite da/f18 [0,4194304] 0 2024-09-13T22:09:10.892 INFO:tasks.workunit.client.1.smithi159.stdout:8/954: dwrite da/d22/d2a/d39/d3e/f109 [0,4194304] 0 2024-09-13T22:09:10.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/734: symlink d9/d65/l105 0 2024-09-13T22:09:10.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/735: readlink d9/d44/l70 0 2024-09-13T22:09:10.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/736: creat d9/d44/deb/dee/d77/da6/db0/f106 x:0 0 0 2024-09-13T22:09:10.894 INFO:tasks.workunit.client.1.smithi159.stdout:2/737: creat d9/da/d82/f107 x:0 0 0 2024-09-13T22:09:10.896 INFO:tasks.workunit.client.1.smithi159.stdout:5/851: rename d1/d11/d1c/dd2/d44/dd8 to d1/d11/d64/de8/d10f 0 2024-09-13T22:09:10.896 INFO:tasks.workunit.client.1.smithi159.stdout:5/852: truncate d1/d11/d64/d17/ffb 722756 0 2024-09-13T22:09:10.900 INFO:tasks.workunit.client.1.smithi159.stdout:8/955: chown da/c25 0 1 2024-09-13T22:09:10.900 INFO:tasks.workunit.client.1.smithi159.stdout:8/956: write da/d22/d2a/da1/f101 [978249,2849] 0 2024-09-13T22:09:10.901 INFO:tasks.workunit.client.1.smithi159.stdout:8/957: fdatasync da/d5d/d70/d8e/dc1/fd9 0 2024-09-13T22:09:10.903 INFO:tasks.workunit.client.1.smithi159.stdout:5/853: truncate d1/d11/d64/d35/f57 661811 0 2024-09-13T22:09:10.903 INFO:tasks.workunit.client.1.smithi159.stdout:5/854: write d1/d11/d64/d35/d7c/fe1 [217900,10927] 0 2024-09-13T22:09:10.904 INFO:tasks.workunit.client.1.smithi159.stdout:8/958: symlink da/d5d/d113/l148 0 2024-09-13T22:09:10.904 INFO:tasks.workunit.client.1.smithi159.stdout:8/959: fdatasync da/d5d/dbc/f104 0 2024-09-13T22:09:10.904 INFO:tasks.workunit.client.1.smithi159.stdout:8/960: stat da/d5d/d70/d8e/de0/c143 0 2024-09-13T22:09:10.904 INFO:tasks.workunit.client.1.smithi159.stdout:8/961: chown da/d7e/d82/d6f/ca6 1541698168 1 2024-09-13T22:09:10.911 INFO:tasks.workunit.client.1.smithi159.stdout:5/855: rename d1/d11/d64/d17 to d1/d11/d64/d35/d7c/d7d/d110 0 2024-09-13T22:09:10.913 INFO:tasks.workunit.client.1.smithi159.stdout:2/738: dwrite d9/d92/f95 [0,4194304] 0 2024-09-13T22:09:10.913 INFO:tasks.workunit.client.1.smithi159.stdout:5/856: mknod d1/d11/d1c/dd2/d53/c111 0 2024-09-13T22:09:10.918 INFO:tasks.workunit.client.1.smithi159.stdout:2/739: mkdir d9/d65/d8d/de2/df0/d108 0 2024-09-13T22:09:10.918 INFO:tasks.workunit.client.1.smithi159.stdout:2/740: truncate d9/da/f7d 780603 0 2024-09-13T22:09:10.919 INFO:tasks.workunit.client.1.smithi159.stdout:2/741: readlink d9/d65/d8d/de2/d69/d66/la3 0 2024-09-13T22:09:10.920 INFO:tasks.workunit.client.1.smithi159.stdout:5/857: fsync d1/d11/d64/d35/d60/fa3 0 2024-09-13T22:09:10.923 INFO:tasks.workunit.client.1.smithi159.stdout:8/962: dwrite da/d36/d57/f95 [0,4194304] 0 2024-09-13T22:09:10.926 INFO:tasks.workunit.client.1.smithi159.stdout:8/963: getdents da/d22/d2a/d39/d12a 0 2024-09-13T22:09:10.930 INFO:tasks.workunit.client.1.smithi159.stdout:8/964: mknod da/d7e/d82/d6f/d9a/d13e/c149 0 2024-09-13T22:09:10.932 INFO:tasks.workunit.client.1.smithi159.stdout:8/965: rename da/d5d/d70/d8e/dc1/dce to da/d5d/d70/d8e/d14a 0 2024-09-13T22:09:10.932 INFO:tasks.workunit.client.1.smithi159.stdout:8/966: truncate da/d22/d2a/d39/f122 581407 0 2024-09-13T22:09:10.935 INFO:tasks.workunit.client.1.smithi159.stdout:3/638: sync 2024-09-13T22:09:10.935 INFO:tasks.workunit.client.1.smithi159.stdout:3/639: write d0/d1/d15/f99 [993128,30567] 0 2024-09-13T22:09:10.935 INFO:tasks.workunit.client.1.smithi159.stdout:0/869: sync 2024-09-13T22:09:10.935 INFO:tasks.workunit.client.1.smithi159.stdout:0/870: write d0/d48/d4f/d66/d75/f11a [712213,13676] 0 2024-09-13T22:09:10.935 INFO:tasks.workunit.client.1.smithi159.stdout:1/989: sync 2024-09-13T22:09:10.938 INFO:tasks.workunit.client.1.smithi159.stdout:0/871: symlink d0/l121 0 2024-09-13T22:09:10.939 INFO:tasks.workunit.client.1.smithi159.stdout:1/990: creat dd/d1e/d58/d8a/dbb/d3c/d95/df5/dfd/d12f/f147 x:0 0 0 2024-09-13T22:09:10.939 INFO:tasks.workunit.client.1.smithi159.stdout:1/991: chown dd/dcc/c13c 5 1 2024-09-13T22:09:10.939 INFO:tasks.workunit.client.1.smithi159.stdout:2/742: dwrite d9/d65/f85 [0,4194304] 0 2024-09-13T22:09:10.944 INFO:tasks.workunit.client.1.smithi159.stdout:1/992: dread dd/d1e/d58/d8a/dbb/f4e [0,4194304] 0 2024-09-13T22:09:10.946 INFO:tasks.workunit.client.1.smithi159.stdout:7/889: sync 2024-09-13T22:09:10.946 INFO:tasks.workunit.client.1.smithi159.stdout:9/749: sync 2024-09-13T22:09:10.948 INFO:tasks.workunit.client.1.smithi159.stdout:1/993: mkdir dd/d11/d13/d148 0 2024-09-13T22:09:10.950 INFO:tasks.workunit.client.1.smithi159.stdout:2/743: dread d9/d37/f56 [0,4194304] 0 2024-09-13T22:09:10.952 INFO:tasks.workunit.client.1.smithi159.stdout:0/872: write d0/d5e/f3f [445550,95091] 0 2024-09-13T22:09:10.952 INFO:tasks.workunit.client.1.smithi159.stdout:5/858: dwrite d1/d11/d64/f3f [0,4194304] 0 2024-09-13T22:09:10.952 INFO:tasks.workunit.client.1.smithi159.stdout:5/859: stat d1/d11/d64/d35/dfa 0 2024-09-13T22:09:10.952 INFO:tasks.workunit.client.1.smithi159.stdout:5/860: fsync d1/d11/d1c/f6e 0 2024-09-13T22:09:10.955 INFO:tasks.workunit.client.1.smithi159.stdout:9/750: write d1/f53 [2072066,108965] 0 2024-09-13T22:09:10.958 INFO:tasks.workunit.client.1.smithi159.stdout:2/744: mknod d9/d2d/db5/c109 0 2024-09-13T22:09:10.962 INFO:tasks.workunit.client.1.smithi159.stdout:0/873: truncate d0/d48/f85 281353 0 2024-09-13T22:09:10.965 INFO:tasks.workunit.client.1.smithi159.stdout:1/994: getdents dd/d11/d18/d74/d82/d9a 0 2024-09-13T22:09:10.968 INFO:tasks.workunit.client.1.smithi159.stdout:2/745: rename d9/f53 to d9/d65/dca/f10a 0 2024-09-13T22:09:10.968 INFO:tasks.workunit.client.1.smithi159.stdout:7/890: dwrite d3/d2e/db6/d6c/db2/dce/ff5 [0,4194304] 0 2024-09-13T22:09:10.968 INFO:tasks.workunit.client.1.smithi159.stdout:7/891: readlink d3/d31/d4d/laf 0 2024-09-13T22:09:10.973 INFO:tasks.workunit.client.1.smithi159.stdout:9/751: dwrite d1/dc/d10/f92 [0,4194304] 0 2024-09-13T22:09:10.973 INFO:tasks.workunit.client.1.smithi159.stdout:0/874: creat d0/d2c/d96/da1/f122 x:0 0 0 2024-09-13T22:09:10.973 INFO:tasks.workunit.client.1.smithi159.stdout:5/861: getdents d1/d11/d64/d35/d7c/d7d 0 2024-09-13T22:09:10.976 INFO:tasks.workunit.client.1.smithi159.stdout:1/995: mkdir dd/d11/d18/d49/d2d/d62/d7d/df6/d149 0 2024-09-13T22:09:10.979 INFO:tasks.workunit.client.1.smithi159.stdout:0/875: write d0/d48/d4f/f67 [3736581,119408] 0 2024-09-13T22:09:10.981 INFO:tasks.workunit.client.1.smithi159.stdout:2/746: rename d9/d44/d102 to d9/da/d82/d89/d10b 0 2024-09-13T22:09:10.981 INFO:tasks.workunit.client.1.smithi159.stdout:2/747: write d9/d65/d8d/de2/d69/ff7 [304110,99048] 0 2024-09-13T22:09:10.982 INFO:tasks.workunit.client.1.smithi159.stdout:5/862: write d1/f96 [3535269,47035] 0 2024-09-13T22:09:10.983 INFO:tasks.workunit.client.1.smithi159.stdout:5/863: dread - d1/d11/d64/d82/d8c/fcd zero size 2024-09-13T22:09:10.985 INFO:tasks.workunit.client.1.smithi159.stdout:7/892: mknod d3/d2e/db6/d6c/db2/c12f 0 2024-09-13T22:09:10.991 INFO:tasks.workunit.client.1.smithi159.stdout:9/752: mkdir d1/dc/d10/d6d/d87/d106 0 2024-09-13T22:09:10.991 INFO:tasks.workunit.client.1.smithi159.stdout:2/748: write d9/d65/d8d/de2/df0/f4e [539906,16066] 0 2024-09-13T22:09:10.991 INFO:tasks.workunit.client.1.smithi159.stdout:2/749: fsync d9/d65/d8d/de2/d69/f90 0 2024-09-13T22:09:11.002 INFO:tasks.workunit.client.1.smithi159.stdout:2/750: dread d9/da/f24 [0,4194304] 0 2024-09-13T22:09:11.003 INFO:tasks.workunit.client.1.smithi159.stdout:0/876: mkdir d0/d2c/d71/dc3/d123 0 2024-09-13T22:09:11.003 INFO:tasks.workunit.client.1.smithi159.stdout:0/877: stat d0/d48/fd1 0 2024-09-13T22:09:11.003 INFO:tasks.workunit.client.1.smithi159.stdout:0/878: dread - d0/d48/d4f/d54/d74/dbe/fcb zero size 2024-09-13T22:09:11.004 INFO:tasks.workunit.client.1.smithi159.stdout:0/879: dread d0/f45 [0,4194304] 0 2024-09-13T22:09:11.007 INFO:tasks.workunit.client.1.smithi159.stdout:5/864: dread d1/d11/d9e/f72 [0,4194304] 0 2024-09-13T22:09:11.010 INFO:tasks.workunit.client.1.smithi159.stdout:1/996: unlink dd/d1e/d58/d8a/dbb/fab 0 2024-09-13T22:09:11.011 INFO:tasks.workunit.client.1.smithi159.stdout:2/751: unlink d9/d44/deb/dee/d77/da6/db0/fb6 0 2024-09-13T22:09:11.013 INFO:tasks.workunit.client.1.smithi159.stdout:9/753: dwrite d1/dc/d27/d40/fc2 [0,4194304] 0 2024-09-13T22:09:11.013 INFO:tasks.workunit.client.1.smithi159.stdout:0/880: creat d0/d5e/d91/f124 x:0 0 0 2024-09-13T22:09:11.017 INFO:tasks.workunit.client.1.smithi159.stdout:2/752: mkdir d9/da/d5a/d10c 0 2024-09-13T22:09:11.020 INFO:tasks.workunit.client.1.smithi159.stdout:7/893: dwrite d3/d2e/db6/d6c/db2/fc6 [0,4194304] 0 2024-09-13T22:09:11.020 INFO:tasks.workunit.client.1.smithi159.stdout:1/997: dread dd/d1e/d58/d8a/dbb/d3c/f143 [0,4194304] 0 2024-09-13T22:09:11.021 INFO:tasks.workunit.client.1.smithi159.stdout:9/754: rename d1/dc/d10/d6d/d2f/d8b/d8f/l6b to d1/dc/d10/d6d/d4b/d98/l107 0 2024-09-13T22:09:11.024 INFO:tasks.workunit.client.1.smithi159.stdout:0/881: mknod d0/d2c/c125 0 2024-09-13T22:09:11.026 INFO:tasks.workunit.client.1.smithi159.stdout:5/865: mkdir d1/d11/d64/d112 0 2024-09-13T22:09:11.026 INFO:tasks.workunit.client.1.smithi159.stdout:5/866: fdatasync d1/d11/f75 0 2024-09-13T22:09:11.026 INFO:tasks.workunit.client.1.smithi159.stdout:5/867: chown d1/d11/d1c/dd2/d53/f87 588 1 2024-09-13T22:09:11.028 INFO:tasks.workunit.client.1.smithi159.stdout:2/753: dread d9/d65/d8d/de2/d69/ff1 [0,4194304] 0 2024-09-13T22:09:11.028 INFO:tasks.workunit.client.1.smithi159.stdout:2/754: write d9/d44/deb/f104 [899361,96219] 0 2024-09-13T22:09:11.033 INFO:tasks.workunit.client.1.smithi159.stdout:0/882: write d0/d48/dd9/de8/fad [2343007,94677] 0 2024-09-13T22:09:11.033 INFO:tasks.workunit.client.1.smithi159.stdout:7/894: unlink d3/d2e/f103 0 2024-09-13T22:09:11.037 INFO:tasks.workunit.client.1.smithi159.stdout:2/755: write d9/d65/f85 [3006606,64506] 0 2024-09-13T22:09:11.044 INFO:tasks.workunit.client.1.smithi159.stdout:1/998: rename dd/d11/d18/d49/d2d/d62/d7d/df6/cf8 to dd/d1e/d58/da7/de1/ded/c14a 0 2024-09-13T22:09:11.047 INFO:tasks.workunit.client.1.smithi159.stdout:9/755: mknod d1/dc/d10/d6d/d4b/d98/c108 0 2024-09-13T22:09:11.050 INFO:tasks.workunit.client.1.smithi159.stdout:5/868: creat d1/d11/d64/d82/d8c/f113 x:0 0 0 2024-09-13T22:09:11.054 INFO:tasks.workunit.client.1.smithi159.stdout:0/883: mkdir d0/d48/d4f/d54/dac/df7/d126 0 2024-09-13T22:09:11.054 INFO:tasks.workunit.client.1.smithi159.stdout:7/895: symlink d3/d2e/dee/l130 0 2024-09-13T22:09:11.056 INFO:tasks.workunit.client.1.smithi159.stdout:2/756: mkdir d9/d44/deb/d10d 0 2024-09-13T22:09:11.058 INFO:tasks.workunit.client.1.smithi159.stdout:1/999: mknod dd/d11/d18/d74/def/d100/c14b 0 2024-09-13T22:09:11.063 INFO:tasks.workunit.client.1.smithi159.stdout:0/884: truncate d0/d5e/f14 6745396 0 2024-09-13T22:09:11.065 INFO:tasks.workunit.client.1.smithi159.stdout:7/896: write d3/d2e/db6/d6c/db2/dce/ff0 [2744265,123774] 0 2024-09-13T22:09:11.066 INFO:tasks.workunit.client.1.smithi159.stdout:9/756: getdents d1/d9/dab/dd7 0 2024-09-13T22:09:11.066 INFO:tasks.workunit.client.1.smithi159.stdout:9/757: chown d1/dc/d27/d40/c5b 795645363 1 2024-09-13T22:09:11.069 INFO:tasks.workunit.client.1.smithi159.stdout:0/885: rename d0/d48/d7d/l7f to d0/d2c/d96/da1/d116/l127 0 2024-09-13T22:09:11.073 INFO:tasks.workunit.client.1.smithi159.stdout:7/897: rename d3/d3f/dea to d3/d31/d4d/d9e/dfb/dff/d125/d131 0 2024-09-13T22:09:11.075 INFO:tasks.workunit.client.1.smithi159.stdout:7/898: creat d3/d2e/d6e/db9/f132 x:0 0 0 2024-09-13T22:09:11.078 INFO:tasks.workunit.client.1.smithi159.stdout:7/899: rename d3/d2e/db6/d6c/c7f to d3/d31/d4d/d9e/dbe/c133 0 2024-09-13T22:09:11.084 INFO:tasks.workunit.client.1.smithi159.stdout:2/757: dwrite d9/da/f18 [4194304,4194304] 0 2024-09-13T22:09:11.085 INFO:tasks.workunit.client.1.smithi159.stdout:2/758: creat d9/d65/d8d/de2/d69/d66/f10e x:0 0 0 2024-09-13T22:09:11.085 INFO:tasks.workunit.client.1.smithi159.stdout:2/759: creat d9/d44/deb/d10d/f10f x:0 0 0 2024-09-13T22:09:11.087 INFO:tasks.workunit.client.1.smithi159.stdout:2/760: creat d9/f110 x:0 0 0 2024-09-13T22:09:11.087 INFO:tasks.workunit.client.1.smithi159.stdout:2/761: creat d9/d65/d8d/de2/d69/dc9/f111 x:0 0 0 2024-09-13T22:09:11.100 INFO:tasks.workunit.client.1.smithi159.stdout:5/869: dwrite d1/d11/d64/f43 [4194304,4194304] 0 2024-09-13T22:09:11.104 INFO:tasks.workunit.client.1.smithi159.stdout:5/870: mkdir d1/d11/d64/d35/d114 0 2024-09-13T22:09:11.104 INFO:tasks.workunit.client.1.smithi159.stdout:5/871: creat d1/d11/d50/f115 x:0 0 0 2024-09-13T22:09:11.110 INFO:tasks.workunit.client.1.smithi159.stdout:5/872: truncate d1/d11/d64/d35/d7c/d7d/d110/f68 466437 0 2024-09-13T22:09:11.110 INFO:tasks.workunit.client.1.smithi159.stdout:5/873: chown d1/d11/d64/d82/d8c/fcd 2072409454 1 2024-09-13T22:09:11.111 INFO:tasks.workunit.client.1.smithi159.stdout:5/874: symlink d1/d11/d1c/dd2/d53/l116 0 2024-09-13T22:09:11.119 INFO:tasks.workunit.client.1.smithi159.stdout:9/758: dwrite d1/dc/d27/d40/fe4 [0,4194304] 0 2024-09-13T22:09:11.119 INFO:tasks.workunit.client.1.smithi159.stdout:7/900: dwrite d3/d2e/d6e/db9/f132 [0,4194304] 0 2024-09-13T22:09:11.119 INFO:tasks.workunit.client.1.smithi159.stdout:0/886: dwrite d0/d48/dd9/de8/fc5 [0,4194304] 0 2024-09-13T22:09:11.120 INFO:tasks.workunit.client.1.smithi159.stdout:2/762: dwrite d9/da/d5a/f94 [0,4194304] 0 2024-09-13T22:09:11.130 INFO:tasks.workunit.client.1.smithi159.stdout:5/875: write d1/d11/d9e/fa7 [1958792,53718] 0 2024-09-13T22:09:11.130 INFO:tasks.workunit.client.1.smithi159.stdout:5/876: readlink d1/d11/d50/l66 0 2024-09-13T22:09:11.132 INFO:tasks.workunit.client.1.smithi159.stdout:9/759: rename d1/dc/d10/d6d/d2f/l72 to d1/d5a/d101/l109 0 2024-09-13T22:09:11.132 INFO:tasks.workunit.client.1.smithi159.stdout:9/760: chown d1/dc/d27/c51 24 1 2024-09-13T22:09:11.132 INFO:tasks.workunit.client.1.smithi159.stdout:9/761: chown d1/dc/d10/d6d/fc8 21991 1 2024-09-13T22:09:11.139 INFO:tasks.workunit.client.1.smithi159.stdout:7/901: dwrite d3/d18/f54 [0,4194304] 0 2024-09-13T22:09:11.147 INFO:tasks.workunit.client.1.smithi159.stdout:7/902: write d3/d2e/d6e/d74/f85 [2796449,6766] 0 2024-09-13T22:09:11.184 INFO:tasks.workunit.client.1.smithi159.stdout:2/763: link d9/da/d82/f93 d9/da/d82/d89/f112 0 2024-09-13T22:09:11.185 INFO:tasks.workunit.client.1.smithi159.stdout:2/764: stat d9/d65/d8d/de2/c62 0 2024-09-13T22:09:11.185 INFO:tasks.workunit.client.1.smithi159.stdout:2/765: stat d9/d65/d8d/de2/df0/l3e 0 2024-09-13T22:09:11.185 INFO:tasks.workunit.client.1.smithi159.stdout:2/766: readlink d9/d65/d8d/la9 0 2024-09-13T22:09:11.213 INFO:tasks.workunit.client.1.smithi159.stdout:5/877: mkdir d1/d11/d1c/dd2/d53/d117 0 2024-09-13T22:09:11.214 INFO:tasks.workunit.client.1.smithi159.stdout:9/762: mknod d1/dc/d10/c10a 0 2024-09-13T22:09:11.229 INFO:tasks.workunit.client.1.smithi159.stdout:9/763: dwrite d1/d5a/f6e [4194304,4194304] 0 2024-09-13T22:09:11.229 INFO:tasks.workunit.client.1.smithi159.stdout:9/764: creat d1/dc/d10/d6d/d4b/dcb/d74/de3/f10b x:0 0 0 2024-09-13T22:09:11.233 INFO:tasks.workunit.client.1.smithi159.stdout:7/903: symlink d3/l134 0 2024-09-13T22:09:11.233 INFO:tasks.workunit.client.1.smithi159.stdout:2/767: truncate d9/da/f7b 676298 0 2024-09-13T22:09:11.236 INFO:tasks.workunit.client.1.smithi159.stdout:5/878: rename d1/d11/d1c/dd2/d44/d85/cfd to d1/d11/d64/de8/d10f/df2/c118 0 2024-09-13T22:09:11.240 INFO:tasks.workunit.client.1.smithi159.stdout:9/765: mknod d1/dc/d10/d6d/d4b/dcb/d74/ddc/c10c 0 2024-09-13T22:09:11.241 INFO:tasks.workunit.client.1.smithi159.stdout:9/766: chown d1/dc/d10/d6d/d87/la7 415110 1 2024-09-13T22:09:11.243 INFO:tasks.workunit.client.1.smithi159.stdout:7/904: symlink d3/d18/l135 0 2024-09-13T22:09:11.248 INFO:tasks.workunit.client.1.smithi159.stdout:2/768: rename d9/d65/d8d/de2/df0/l3e to d9/d44/deb/dee/l113 0 2024-09-13T22:09:11.248 INFO:tasks.workunit.client.1.smithi159.stdout:2/769: fdatasync d9/d44/deb/dee/d77/da6/db0/f106 0 2024-09-13T22:09:11.248 INFO:tasks.workunit.client.1.smithi159.stdout:2/770: readlink d9/d65/d8d/de2/d69/l9c 0 2024-09-13T22:09:11.252 INFO:tasks.workunit.client.1.smithi159.stdout:5/879: mknod d1/d11/d64/d35/d7c/d7d/d110/c119 0 2024-09-13T22:09:11.252 INFO:tasks.workunit.client.1.smithi159.stdout:9/767: symlink d1/d9/dab/dd7/l10d 0 2024-09-13T22:09:11.254 INFO:tasks.workunit.client.1.smithi159.stdout:2/771: mknod d9/d65/d8d/de2/d69/dc9/c114 0 2024-09-13T22:09:11.254 INFO:tasks.workunit.client.1.smithi159.stdout:2/772: fsync d9/d44/deb/dee/f7c 0 2024-09-13T22:09:11.255 INFO:tasks.workunit.client.1.smithi159.stdout:2/773: stat d9/d44/deb/dee/d77/dec 0 2024-09-13T22:09:11.255 INFO:tasks.workunit.client.1.smithi159.stdout:5/880: truncate d1/d11/d64/d35/d7c/fe1 52036 0 2024-09-13T22:09:11.255 INFO:tasks.workunit.client.1.smithi159.stdout:5/881: stat d1/d11/d64/d35/f73 0 2024-09-13T22:09:11.258 INFO:tasks.workunit.client.1.smithi159.stdout:2/774: mknod d9/d44/deb/dee/c115 0 2024-09-13T22:09:11.263 INFO:tasks.workunit.client.1.smithi159.stdout:7/905: dwrite d3/d2e/d6e/d74/fd0 [0,4194304] 0 2024-09-13T22:09:11.277 INFO:tasks.workunit.client.1.smithi159.stdout:5/882: dwrite d1/d11/d64/d35/d7c/d7d/d110/ffb [0,4194304] 0 2024-09-13T22:09:11.279 INFO:tasks.workunit.client.1.smithi159.stdout:2/775: dwrite d9/d65/d8d/de2/d69/ff7 [0,4194304] 0 2024-09-13T22:09:11.282 INFO:tasks.workunit.client.1.smithi159.stdout:5/883: mknod d1/d11/d64/de8/d10f/df2/c11a 0 2024-09-13T22:09:11.282 INFO:tasks.workunit.client.1.smithi159.stdout:5/884: dread - d1/f76 zero size 2024-09-13T22:09:11.284 INFO:tasks.workunit.client.1.smithi159.stdout:2/776: link d9/da/lc d9/d2d/db5/dbe/l116 0 2024-09-13T22:09:11.294 INFO:tasks.workunit.client.1.smithi159.stdout:2/777: write d9/d65/d8d/de2/d69/f90 [951026,62387] 0 2024-09-13T22:09:11.297 INFO:tasks.workunit.client.1.smithi159.stdout:2/778: mknod d9/d65/d8d/de2/df0/d108/c117 0 2024-09-13T22:09:11.297 INFO:tasks.workunit.client.1.smithi159.stdout:2/779: fsync d9/da/d82/ffa 0 2024-09-13T22:09:11.297 INFO:tasks.workunit.client.1.smithi159.stdout:2/780: write d9/f1d [863317,117252] 0 2024-09-13T22:09:11.299 INFO:tasks.workunit.client.1.smithi159.stdout:2/781: unlink d9/d44/deb/dee/d77/da6/fcd 0 2024-09-13T22:09:11.299 INFO:tasks.workunit.client.1.smithi159.stdout:2/782: truncate d9/da/d5a/ddf/ff4 957148 0 2024-09-13T22:09:11.299 INFO:tasks.workunit.client.1.smithi159.stdout:2/783: stat d9/da/d5a/d10c 0 2024-09-13T22:09:11.302 INFO:tasks.workunit.client.1.smithi159.stdout:2/784: creat d9/da/f118 x:0 0 0 2024-09-13T22:09:11.302 INFO:tasks.workunit.client.1.smithi159.stdout:2/785: write d9/d65/d8d/de2/d69/fbf [1244155,118160] 0 2024-09-13T22:09:11.302 INFO:tasks.workunit.client.1.smithi159.stdout:2/786: write d9/d92/fcc [5218,40915] 0 2024-09-13T22:09:11.303 INFO:tasks.workunit.client.1.smithi159.stdout:2/787: getdents d9/d44/deb 0 2024-09-13T22:09:11.303 INFO:tasks.workunit.client.1.smithi159.stdout:2/788: fsync d9/d65/d8d/de2/d69/ff1 0 2024-09-13T22:09:11.303 INFO:tasks.workunit.client.1.smithi159.stdout:2/789: write d9/da/f2a [4104979,122759] 0 2024-09-13T22:09:11.306 INFO:tasks.workunit.client.1.smithi159.stdout:2/790: getdents d9/da/d5a 0 2024-09-13T22:09:11.309 INFO:tasks.workunit.client.1.smithi159.stdout:2/791: mkdir d9/da/d5a/d119 0 2024-09-13T22:09:11.320 INFO:tasks.workunit.client.1.smithi159.stdout:2/792: write d9/fe [3265338,81040] 0 2024-09-13T22:09:11.326 INFO:tasks.workunit.client.1.smithi159.stdout:2/793: dread d9/d65/d8d/de2/d69/ff1 [0,4194304] 0 2024-09-13T22:09:11.326 INFO:tasks.workunit.client.1.smithi159.stdout:2/794: dread - d9/d65/d8d/de2/d69/d66/f10e zero size 2024-09-13T22:09:11.354 INFO:tasks.workunit.client.1.smithi159.stdout:7/906: truncate d3/d2e/d6e/d74/fd0 703781 0 2024-09-13T22:09:11.354 INFO:tasks.workunit.client.1.smithi159.stdout:2/795: dwrite d9/da/d82/ffa [0,4194304] 0 2024-09-13T22:09:11.357 INFO:tasks.workunit.client.1.smithi159.stdout:7/907: mknod d3/d31/d4d/d9e/dfb/dff/d125/c136 0 2024-09-13T22:09:11.365 INFO:tasks.workunit.client.1.smithi159.stdout:2/796: truncate d9/f38 55951 0 2024-09-13T22:09:11.367 INFO:tasks.workunit.client.1.smithi159.stdout:2/797: read d9/d65/f6c [410135,67872] 0 2024-09-13T22:09:11.376 INFO:tasks.workunit.client.1.smithi159.stdout:2/798: getdents d9/d65/d8d/de2/d69 0 2024-09-13T22:09:11.377 INFO:tasks.workunit.client.1.smithi159.stdout:2/799: dread - d9/d44/deb/dee/d77/da6/db0/f106 zero size 2024-09-13T22:09:11.378 INFO:tasks.workunit.client.1.smithi159.stdout:7/908: dwrite d3/ff [0,4194304] 0 2024-09-13T22:09:11.381 INFO:tasks.workunit.client.1.smithi159.stdout:2/800: unlink d9/d37/lb9 0 2024-09-13T22:09:11.383 INFO:tasks.workunit.client.1.smithi159.stdout:2/801: creat d9/d65/d8d/f11a x:0 0 0 2024-09-13T22:09:11.385 INFO:tasks.workunit.client.1.smithi159.stdout:2/802: unlink d9/d65/d8d/de2/faf 0 2024-09-13T22:09:11.388 INFO:tasks.workunit.client.1.smithi159.stdout:2/803: unlink d9/l16 0 2024-09-13T22:09:11.388 INFO:tasks.workunit.client.1.smithi159.stdout:2/804: dread - d9/d44/deb/dee/d77/da6/db0/f106 zero size 2024-09-13T22:09:11.393 INFO:tasks.workunit.client.1.smithi159.stdout:7/909: dread d3/d31/f66 [0,4194304] 0 2024-09-13T22:09:11.422 INFO:tasks.workunit.client.1.smithi159.stdout:2/805: dwrite d9/d65/d8d/de2/df0/d91/fa4 [0,4194304] 0 2024-09-13T22:09:11.435 INFO:tasks.workunit.client.1.smithi159.stdout:7/910: dwrite d3/f2a [4194304,4194304] 0 2024-09-13T22:09:11.435 INFO:tasks.workunit.client.1.smithi159.stdout:7/911: chown d3/d2e/dee/l108 703 1 2024-09-13T22:09:11.444 INFO:tasks.workunit.client.1.smithi159.stdout:2/806: write d9/d65/d8d/de2/d69/f74 [2318663,90759] 0 2024-09-13T22:09:11.458 INFO:tasks.workunit.client.1.smithi159.stdout:7/912: dwrite d3/dab/f106 [0,4194304] 0 2024-09-13T22:09:11.459 INFO:tasks.workunit.client.1.smithi159.stdout:7/913: write d3/d2e/d6e/f100 [923706,8349] 0 2024-09-13T22:09:11.459 INFO:tasks.workunit.client.1.smithi159.stdout:2/807: read d9/da/d5a/f94 [3398857,105770] 0 2024-09-13T22:09:11.460 INFO:tasks.workunit.client.1.smithi159.stdout:7/914: dread d3/d31/d4d/f99 [0,4194304] 0 2024-09-13T22:09:11.462 INFO:tasks.workunit.client.1.smithi159.stdout:2/808: mkdir d9/da/d11b 0 2024-09-13T22:09:11.464 INFO:tasks.workunit.client.1.smithi159.stdout:7/915: creat d3/f137 x:0 0 0 2024-09-13T22:09:11.471 INFO:tasks.workunit.client.1.smithi159.stdout:2/809: creat d9/d65/d8d/de2/df0/d108/f11c x:0 0 0 2024-09-13T22:09:11.476 INFO:tasks.workunit.client.1.smithi159.stdout:2/810: rename d9/d65/d8d/de2/fac to d9/d44/deb/dee/de9/f11d 0 2024-09-13T22:09:11.488 INFO:tasks.workunit.client.1.smithi159.stdout:2/811: mknod d9/d65/d8d/de2/d69/d66/c11e 0 2024-09-13T22:09:11.492 INFO:tasks.workunit.client.1.smithi159.stdout:2/812: mknod d9/da/d82/d89/c11f 0 2024-09-13T22:09:11.503 INFO:tasks.workunit.client.1.smithi159.stdout:2/813: link d9/d65/d8d/de2/df0/c33 d9/d44/deb/dee/d77/da6/de7/c120 0 2024-09-13T22:09:11.506 INFO:tasks.workunit.client.1.smithi159.stdout:2/814: rename d9/d65/d8d/de2/df0/f35 to d9/d65/d8d/de2/d69/f121 0 2024-09-13T22:09:11.507 INFO:tasks.workunit.client.1.smithi159.stdout:2/815: symlink d9/d44/deb/d10d/l122 0 2024-09-13T22:09:11.508 INFO:tasks.workunit.client.1.smithi159.stdout:2/816: getdents d9/da/d82/d89/d10b 0 2024-09-13T22:09:11.508 INFO:tasks.workunit.client.1.smithi159.stdout:2/817: fdatasync d9/da/d82/d89/dd6/fd7 0 2024-09-13T22:09:11.508 INFO:tasks.workunit.client.1.smithi159.stdout:2/818: chown d9/d65/f6c 22 1 2024-09-13T22:09:11.509 INFO:tasks.workunit.client.1.smithi159.stdout:2/819: mknod d9/da/d82/c123 0 2024-09-13T22:09:11.509 INFO:tasks.workunit.client.1.smithi159.stdout:2/820: dread - d9/da/d82/fa1 zero size 2024-09-13T22:09:11.509 INFO:tasks.workunit.client.1.smithi159.stdout:2/821: write d9/da/f118 [329319,53709] 0 2024-09-13T22:09:11.518 INFO:tasks.workunit.client.1.smithi159.stdout:2/822: write d9/d65/d8d/de2/d69/ff1 [496778,105885] 0 2024-09-13T22:09:11.604 INFO:tasks.workunit.client.1.smithi159.stdout:8/967: sync 2024-09-13T22:09:11.605 INFO:tasks.workunit.client.1.smithi159.stdout:8/968: symlink da/d7e/d82/l14b 0 2024-09-13T22:09:11.606 INFO:tasks.workunit.client.1.smithi159.stdout:8/969: mkdir da/d7e/d82/dd8/de7/d114/d14c 0 2024-09-13T22:09:11.607 INFO:tasks.workunit.client.1.smithi159.stdout:8/970: creat da/d22/db3/f14d x:0 0 0 2024-09-13T22:09:11.611 INFO:tasks.workunit.client.1.smithi159.stdout:3/640: sync 2024-09-13T22:09:11.611 INFO:tasks.workunit.client.1.smithi159.stdout:3/641: read - d0/d1/d3/f82 zero size 2024-09-13T22:09:11.614 INFO:tasks.workunit.client.1.smithi159.stdout:8/971: mkdir da/d7e/d82/d6f/d14e 0 2024-09-13T22:09:11.614 INFO:tasks.workunit.client.1.smithi159.stdout:3/642: dread d0/d1/d3/d5/d25/d2c/f9a [0,4194304] 0 2024-09-13T22:09:11.614 INFO:tasks.workunit.client.1.smithi159.stdout:3/643: fsync d0/d1/d3/d5/db/f60 0 2024-09-13T22:09:11.615 INFO:tasks.workunit.client.1.smithi159.stdout:3/644: write d0/d1/d3/f82 [79828,102358] 0 2024-09-13T22:09:11.615 INFO:tasks.workunit.client.1.smithi159.stdout:3/645: fdatasync d0/d78/fb4 0 2024-09-13T22:09:11.615 INFO:tasks.workunit.client.1.smithi159.stdout:3/646: dread - d0/d78/fb7 zero size 2024-09-13T22:09:11.615 INFO:tasks.workunit.client.1.smithi159.stdout:3/647: chown d0/d1/d3/d5/d25/d4e 12418 1 2024-09-13T22:09:11.615 INFO:tasks.workunit.client.1.smithi159.stdout:8/972: symlink da/d22/d4a/dcc/d11f/l14f 0 2024-09-13T22:09:11.617 INFO:tasks.workunit.client.1.smithi159.stdout:3/648: creat d0/d1/d3/d5/db/d39/dbe/fc7 x:0 0 0 2024-09-13T22:09:11.619 INFO:tasks.workunit.client.1.smithi159.stdout:3/649: mknod d0/d1/d3/d5/d25/d4e/d5a/d9b/cc8 0 2024-09-13T22:09:11.620 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: pgmap v267: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 140 MiB/s rd, 192 MiB/s wr, 313 op/s 2024-09-13T22:09:11.620 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:11.620 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:11.620 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:09:11.621 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:09:11.621 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:11.621 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:11.621 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr fail", "who": "smithi089.naneiw"}]: dispatch 2024-09-13T22:09:11.621 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: Activating manager daemon smithi159.ghpomd 2024-09-13T22:09:11.621 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T22:09:11.621 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "mgr fail", "who": "smithi089.naneiw"}]': finished 2024-09-13T22:09:11.621 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:09:11.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: mgrmap e21: smithi159.ghpomd(active, starting, since 0.00700659s) 2024-09-13T22:09:11.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:09:11.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:09:11.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:09:11.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:09:11.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:09:11.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr metadata", "who": "smithi159.ghpomd", "id": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:09:11.622 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:09:11.623 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:09:11.623 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:09:11.623 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:09:11.623 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:09:11.623 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:09:11.623 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:09:11.623 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:09:11.623 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:11 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:09:11.624 INFO:tasks.workunit.client.1.smithi159.stdout:8/973: truncate da/f7d 3927539 0 2024-09-13T22:09:11.625 INFO:tasks.workunit.client.1.smithi159.stdout:8/974: symlink da/d36/d57/l150 0 2024-09-13T22:09:11.625 INFO:tasks.workunit.client.1.smithi159.stdout:8/975: fdatasync f4 0 2024-09-13T22:09:11.625 INFO:tasks.workunit.client.1.smithi159.stdout:8/976: creat da/d7e/d82/dd8/de7/f151 x:0 0 0 2024-09-13T22:09:11.626 INFO:tasks.workunit.client.1.smithi159.stdout:3/650: dread d0/d1/d3/d5/d25/d75/d5b/d45/f7d [0,4194304] 0 2024-09-13T22:09:11.626 INFO:tasks.workunit.client.1.smithi159.stdout:3/651: chown d0/d78/fb7 0 1 2024-09-13T22:09:11.627 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: pgmap v267: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 140 MiB/s rd, 192 MiB/s wr, 313 op/s 2024-09-13T22:09:11.627 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:11.627 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:11.628 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:09:11.628 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:09:11.628 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:11.628 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:11.628 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr fail", "who": "smithi089.naneiw"}]: dispatch 2024-09-13T22:09:11.628 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: Activating manager daemon smithi159.ghpomd 2024-09-13T22:09:11.628 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T22:09:11.628 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.14209 172.21.15.89:0/694257954' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "mgr fail", "who": "smithi089.naneiw"}]': finished 2024-09-13T22:09:11.629 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:09:11.629 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: mgrmap e21: smithi159.ghpomd(active, starting, since 0.00700659s) 2024-09-13T22:09:11.629 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:09:11.629 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:09:11.629 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:09:11.629 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:09:11.629 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:09:11.629 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr metadata", "who": "smithi159.ghpomd", "id": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:09:11.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:09:11.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:09:11.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:09:11.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:09:11.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:09:11.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:09:11.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:09:11.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:09:11.631 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:11 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:09:11.631 INFO:tasks.workunit.client.1.smithi159.stdout:3/652: mknod d0/d1/d3/d5/cc9 0 2024-09-13T22:09:11.631 INFO:tasks.workunit.client.1.smithi159.stdout:3/653: write d0/d1/d3/d5/d25/d4e/d92/fae [1003506,106838] 0 2024-09-13T22:09:11.631 INFO:tasks.workunit.client.1.smithi159.stdout:3/654: creat d0/d1/d3/d5/db/dc6/fca x:0 0 0 2024-09-13T22:09:11.631 INFO:tasks.workunit.client.1.smithi159.stdout:3/655: mkdir d0/d68/dcb 0 2024-09-13T22:09:11.645 INFO:tasks.workunit.client.1.smithi159.stdout:8/977: dwrite da/d36/d48/f67 [0,4194304] 0 2024-09-13T22:09:11.645 INFO:tasks.workunit.client.1.smithi159.stdout:8/978: chown da/d5d/d70/d8e/d14a/fe1 959 1 2024-09-13T22:09:11.647 INFO:tasks.workunit.client.1.smithi159.stdout:8/979: mkdir da/d7e/d82/d83/d103/d128/d152 0 2024-09-13T22:09:11.649 INFO:tasks.workunit.client.1.smithi159.stdout:8/980: symlink da/d7e/d82/d83/d103/d128/d152/l153 0 2024-09-13T22:09:11.651 INFO:tasks.workunit.client.1.smithi159.stdout:8/981: symlink da/d22/db3/l154 0 2024-09-13T22:09:11.652 INFO:tasks.workunit.client.1.smithi159.stdout:8/982: mknod da/d7e/d82/d83/d103/d128/d152/c155 0 2024-09-13T22:09:11.670 INFO:tasks.workunit.client.1.smithi159.stdout:8/983: dwrite da/d22/d4a/f7c [0,4194304] 0 2024-09-13T22:09:11.674 INFO:tasks.workunit.client.1.smithi159.stdout:8/984: rename da/d7e/d82/d6f/f100 to da/d5d/d70/d8e/de0/f156 0 2024-09-13T22:09:11.674 INFO:tasks.workunit.client.1.smithi159.stdout:8/985: chown da/d5d/d113 1144682 1 2024-09-13T22:09:11.867 INFO:tasks.workunit.client.1.smithi159.stdout:0/887: sync 2024-09-13T22:09:11.897 INFO:tasks.workunit.client.1.smithi159.stdout:0/888: rmdir d0/d48/d4f 39 2024-09-13T22:09:11.897 INFO:tasks.workunit.client.1.smithi159.stdout:0/889: chown d0/d48/d4f/d2b/c39 8071 1 2024-09-13T22:09:11.900 INFO:tasks.workunit.client.1.smithi159.stdout:0/890: getdents d0/d48/d4f 0 2024-09-13T22:09:11.900 INFO:tasks.workunit.client.1.smithi159.stdout:0/891: stat d0/d2c/c63 0 2024-09-13T22:09:11.963 INFO:tasks.workunit.client.1.smithi159.stdout:0/892: creat d0/d48/d7d/f128 x:0 0 0 2024-09-13T22:09:11.965 INFO:tasks.workunit.client.1.smithi159.stdout:0/893: creat d0/d48/d4f/daf/dd4/f129 x:0 0 0 2024-09-13T22:09:11.966 INFO:tasks.workunit.client.1.smithi159.stdout:0/894: symlink d0/d2c/d71/dc3/d123/l12a 0 2024-09-13T22:09:11.983 INFO:tasks.workunit.client.1.smithi159.stdout:0/895: dwrite d0/f10 [0,4194304] 0 2024-09-13T22:09:11.983 INFO:tasks.workunit.client.1.smithi159.stdout:0/896: write d0/d2c/fe9 [934317,80553] 0 2024-09-13T22:09:11.987 INFO:tasks.workunit.client.1.smithi159.stdout:0/897: mkdir d0/d48/d12b 0 2024-09-13T22:09:11.992 INFO:tasks.workunit.client.1.smithi159.stdout:0/898: rename d0/d2c/d96 to d0/d48/d12c 0 2024-09-13T22:09:11.996 INFO:tasks.workunit.client.1.smithi159.stdout:0/899: rename d0/f16 to d0/d48/d7d/dca/dcd/f12d 0 2024-09-13T22:09:11.999 INFO:tasks.workunit.client.1.smithi159.stdout:9/768: sync 2024-09-13T22:09:12.000 INFO:tasks.workunit.client.1.smithi159.stdout:5/885: sync 2024-09-13T22:09:12.000 INFO:tasks.workunit.client.1.smithi159.stdout:9/769: chown d1/dc/d27/c52 34769 1 2024-09-13T22:09:12.000 INFO:tasks.workunit.client.1.smithi159.stdout:5/886: write d1/d11/d64/d35/d7c/fdf [1012130,4813] 0 2024-09-13T22:09:12.000 INFO:tasks.workunit.client.1.smithi159.stdout:5/887: chown d1/d11/d64/d35/d7c/ff0 14061 1 2024-09-13T22:09:12.000 INFO:tasks.workunit.client.1.smithi159.stdout:5/888: write d1/d11/d50/fe7 [2039251,6924] 0 2024-09-13T22:09:12.000 INFO:tasks.workunit.client.1.smithi159.stdout:5/889: chown d1/d11/d9e/d7b/f8a 38274655 1 2024-09-13T22:09:12.000 INFO:tasks.workunit.client.1.smithi159.stdout:0/900: truncate d0/d48/d4f/d2b/f50 2258078 0 2024-09-13T22:09:12.001 INFO:tasks.workunit.client.1.smithi159.stdout:0/901: write d0/d2c/f43 [7928656,93513] 0 2024-09-13T22:09:12.003 INFO:tasks.workunit.client.1.smithi159.stdout:9/770: rename d1/dc/c29 to d1/d9/dab/dd7/c10e 0 2024-09-13T22:09:12.006 INFO:tasks.workunit.client.1.smithi159.stdout:5/890: mknod d1/d11/d1c/d32/c11b 0 2024-09-13T22:09:12.010 INFO:tasks.workunit.client.1.smithi159.stdout:5/891: dread d1/d11/d64/d35/f73 [4194304,4194304] 0 2024-09-13T22:09:12.010 INFO:tasks.workunit.client.1.smithi159.stdout:0/902: creat d0/d48/d7d/dca/dcd/f12e x:0 0 0 2024-09-13T22:09:12.012 INFO:tasks.workunit.client.1.smithi159.stdout:0/903: mkdir d0/d48/d4f/d66/d75/d120/d12f 0 2024-09-13T22:09:12.012 INFO:tasks.workunit.client.1.smithi159.stdout:0/904: write d0/d48/d4f/d66/f102 [546536,18083] 0 2024-09-13T22:09:12.013 INFO:tasks.workunit.client.1.smithi159.stdout:9/771: getdents d1/dc/d10/d9c 0 2024-09-13T22:09:12.017 INFO:tasks.workunit.client.1.smithi159.stdout:5/892: getdents d1/d11/d1c 0 2024-09-13T22:09:12.021 INFO:tasks.workunit.client.1.smithi159.stdout:0/905: rename d0/l118 to d0/d2c/l130 0 2024-09-13T22:09:12.030 INFO:tasks.workunit.client.1.smithi159.stdout:0/906: creat d0/d48/d4f/d2b/f131 x:0 0 0 2024-09-13T22:09:12.030 INFO:tasks.workunit.client.1.smithi159.stdout:0/907: readlink d0/d2c/d71/l78 0 2024-09-13T22:09:12.031 INFO:tasks.workunit.client.1.smithi159.stdout:5/893: rename d1/d11/d64/d35/d7c/d7d/d110/c30 to d1/d11/d64/c11c 0 2024-09-13T22:09:12.034 INFO:tasks.workunit.client.1.smithi159.stdout:5/894: symlink d1/d11/d1c/dd2/d44/d85/l11d 0 2024-09-13T22:09:12.036 INFO:tasks.workunit.client.1.smithi159.stdout:5/895: creat d1/d11/d1c/dd2/d53/f11e x:0 0 0 2024-09-13T22:09:12.037 INFO:tasks.workunit.client.1.smithi159.stdout:0/908: write d0/d48/d4f/d2b/f88 [3585288,50464] 0 2024-09-13T22:09:12.037 INFO:tasks.workunit.client.1.smithi159.stdout:0/909: creat d0/d48/d7d/dca/dcd/f132 x:0 0 0 2024-09-13T22:09:12.040 INFO:tasks.workunit.client.1.smithi159.stdout:0/910: rename d0/d48/d4f/d54/ca5 to d0/d48/d4f/d66/d75/d114/c133 0 2024-09-13T22:09:12.042 INFO:tasks.workunit.client.1.smithi159.stdout:5/896: unlink d1/d11/d64/l5b 0 2024-09-13T22:09:12.043 INFO:tasks.workunit.client.1.smithi159.stdout:0/911: mknod d0/d48/d12c/da1/d116/c134 0 2024-09-13T22:09:12.048 INFO:tasks.workunit.client.1.smithi159.stdout:5/897: creat d1/d11/d1c/dd2/d44/d89/f11f x:0 0 0 2024-09-13T22:09:12.048 INFO:tasks.workunit.client.1.smithi159.stdout:5/898: readlink d1/l5e 0 2024-09-13T22:09:12.049 INFO:tasks.workunit.client.1.smithi159.stdout:5/899: symlink d1/d11/d1c/dd2/d53/d117/l120 0 2024-09-13T22:09:12.050 INFO:tasks.workunit.client.1.smithi159.stdout:5/900: dread - d1/d11/d64/d35/d7c/d7d/ff4 zero size 2024-09-13T22:09:12.050 INFO:tasks.workunit.client.1.smithi159.stdout:5/901: truncate d1/d11/d9e/f31 3756361 0 2024-09-13T22:09:12.054 INFO:tasks.workunit.client.1.smithi159.stdout:0/912: dread d0/d48/d7d/dca/f10c [0,4194304] 0 2024-09-13T22:09:12.061 INFO:tasks.workunit.client.1.smithi159.stdout:5/902: dread d1/d11/d64/d82/d8f/fbe [0,4194304] 0 2024-09-13T22:09:12.076 INFO:tasks.workunit.client.1.smithi159.stdout:5/903: dwrite d1/d11/d1c/dd2/d44/d89/f99 [0,4194304] 0 2024-09-13T22:09:12.080 INFO:tasks.workunit.client.1.smithi159.stdout:5/904: rename d1/d11/d9e/d7b/c83 to d1/d11/d64/d35/d7c/c121 0 2024-09-13T22:09:12.097 INFO:tasks.workunit.client.1.smithi159.stdout:0/913: write d0/d48/f85 [909085,16174] 0 2024-09-13T22:09:12.127 INFO:tasks.workunit.client.1.smithi159.stdout:5/905: dwrite d1/d11/d64/d35/d7c/d7d/d110/f68 [0,4194304] 0 2024-09-13T22:09:12.136 INFO:tasks.workunit.client.1.smithi159.stdout:5/906: getdents d1/d11/d1c/dd2/dd6 0 2024-09-13T22:09:12.143 INFO:tasks.workunit.client.1.smithi159.stdout:5/907: creat d1/d11/d64/d82/d8f/dba/f122 x:0 0 0 2024-09-13T22:09:12.171 INFO:tasks.workunit.client.1.smithi159.stdout:5/908: dwrite d1/d11/d1c/fae [0,4194304] 0 2024-09-13T22:09:12.174 INFO:tasks.workunit.client.1.smithi159.stdout:5/909: symlink d1/d11/d64/d35/d60/l123 0 2024-09-13T22:09:12.178 INFO:tasks.workunit.client.1.smithi159.stdout:5/910: unlink d1/d11/d64/l18 0 2024-09-13T22:09:12.191 INFO:tasks.workunit.client.1.smithi159.stdout:5/911: write d1/fad [2713686,58949] 0 2024-09-13T22:09:12.191 INFO:tasks.workunit.client.1.smithi159.stdout:5/912: stat d1/d11/d1c/dd2/d44/d89/dcb/ld9 0 2024-09-13T22:09:12.195 INFO:tasks.workunit.client.1.smithi159.stdout:5/913: mkdir d1/d11/d64/d35/d7c/d124 0 2024-09-13T22:09:12.198 INFO:tasks.workunit.client.1.smithi159.stdout:5/914: mkdir d1/d11/d64/d35/dfa/d125 0 2024-09-13T22:09:12.198 INFO:tasks.workunit.client.1.smithi159.stdout:5/915: write d1/f76 [60358,43405] 0 2024-09-13T22:09:12.201 INFO:tasks.workunit.client.1.smithi159.stdout:5/916: mknod d1/d11/d64/d82/d8c/c126 0 2024-09-13T22:09:12.201 INFO:tasks.workunit.client.1.smithi159.stdout:5/917: fdatasync d1/d11/d64/d35/d7c/d7d/ff4 0 2024-09-13T22:09:12.203 INFO:tasks.workunit.client.1.smithi159.stdout:5/918: creat d1/d11/d50/dca/f127 x:0 0 0 2024-09-13T22:09:12.205 INFO:tasks.workunit.client.1.smithi159.stdout:5/919: creat d1/d11/d64/de8/f128 x:0 0 0 2024-09-13T22:09:12.215 INFO:tasks.workunit.client.1.smithi159.stdout:5/920: write d1/d11/d1c/dd2/fc5 [1220165,123917] 0 2024-09-13T22:09:12.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/921: chown d1/d11/d64/lda 1443 1 2024-09-13T22:09:12.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/922: chown d1/d11/d64/d35/d7c/d7d/d110/ffb 271 1 2024-09-13T22:09:12.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/923: fsync d1/d11/d50/fe7 0 2024-09-13T22:09:12.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/924: readlink d1/d11/d64/d82/d8c/lab 0 2024-09-13T22:09:12.216 INFO:tasks.workunit.client.1.smithi159.stdout:5/925: write d1/d11/d64/d82/f101 [6312,36487] 0 2024-09-13T22:09:12.236 INFO:tasks.workunit.client.1.smithi159.stdout:5/926: dwrite d1/d11/d64/d82/d8c/f113 [0,4194304] 0 2024-09-13T22:09:12.239 INFO:tasks.workunit.client.1.smithi159.stdout:5/927: getdents d1/d11/d64/d82 0 2024-09-13T22:09:12.253 INFO:tasks.workunit.client.1.smithi159.stdout:5/928: dwrite d1/d11/d1c/dd2/d44/f5d [0,4194304] 0 2024-09-13T22:09:12.253 INFO:tasks.workunit.client.1.smithi159.stdout:5/929: write d1/d11/d64/d35/d7c/ff9 [677656,14359] 0 2024-09-13T22:09:12.257 INFO:tasks.workunit.client.1.smithi159.stdout:3/656: sync 2024-09-13T22:09:12.257 INFO:tasks.workunit.client.1.smithi159.stdout:8/986: sync 2024-09-13T22:09:12.258 INFO:tasks.workunit.client.1.smithi159.stdout:8/987: dread - da/da0/f120 zero size 2024-09-13T22:09:12.258 INFO:tasks.workunit.client.1.smithi159.stdout:7/916: sync 2024-09-13T22:09:12.258 INFO:tasks.workunit.client.1.smithi159.stdout:7/917: write d3/d31/d4d/d9e/f121 [1018037,3238] 0 2024-09-13T22:09:12.258 INFO:tasks.workunit.client.1.smithi159.stdout:5/930: rename d1/d11/d64/f3f to d1/d11/d1c/dd2/d44/d85/f129 0 2024-09-13T22:09:12.258 INFO:tasks.workunit.client.1.smithi159.stdout:5/931: stat d1/d11/l21 0 2024-09-13T22:09:12.259 INFO:tasks.workunit.client.1.smithi159.stdout:2/823: sync 2024-09-13T22:09:12.259 INFO:tasks.workunit.client.1.smithi159.stdout:2/824: write d9/d92/fb3 [663498,104579] 0 2024-09-13T22:09:12.262 INFO:tasks.workunit.client.1.smithi159.stdout:8/988: link da/d7e/d82/c84 da/d5d/d70/d8e/c157 0 2024-09-13T22:09:12.262 INFO:tasks.workunit.client.1.smithi159.stdout:8/989: write da/d5d/dbc/ff9 [1404179,108401] 0 2024-09-13T22:09:12.262 INFO:tasks.workunit.client.1.smithi159.stdout:8/990: chown da/d7e/d82/d6f/d9a/d13e/l13f 0 1 2024-09-13T22:09:12.266 INFO:tasks.workunit.client.1.smithi159.stdout:3/657: rename d0/d1/lc3 to d0/d1/d3/d5/d25/d2c/d71/lcc 0 2024-09-13T22:09:12.269 INFO:tasks.workunit.client.1.smithi159.stdout:5/932: symlink d1/d11/d64/de8/l12a 0 2024-09-13T22:09:12.269 INFO:tasks.workunit.client.1.smithi159.stdout:5/933: creat d1/d11/d1c/dd2/d44/d85/f12b x:0 0 0 2024-09-13T22:09:12.269 INFO:tasks.workunit.client.1.smithi159.stdout:5/934: fdatasync d1/d11/d1c/dd2/fc3 0 2024-09-13T22:09:12.269 INFO:tasks.workunit.client.1.smithi159.stdout:9/772: sync 2024-09-13T22:09:12.269 INFO:tasks.workunit.client.1.smithi159.stdout:0/914: sync 2024-09-13T22:09:12.269 INFO:tasks.workunit.client.1.smithi159.stdout:2/825: mknod d9/da/d11b/c124 0 2024-09-13T22:09:12.271 INFO:tasks.workunit.client.1.smithi159.stdout:8/991: mknod da/d36/d48/c158 0 2024-09-13T22:09:12.273 INFO:tasks.workunit.client.1.smithi159.stdout:7/918: rename d3/d31/d4d/d4e/d7a/l95 to d3/d2e/db6/d6c/db2/l138 0 2024-09-13T22:09:12.274 INFO:tasks.workunit.client.1.smithi159.stdout:3/658: symlink d0/lcd 0 2024-09-13T22:09:12.276 INFO:tasks.workunit.client.1.smithi159.stdout:9/773: symlink d1/d5a/d101/l10f 0 2024-09-13T22:09:12.277 INFO:tasks.workunit.client.1.smithi159.stdout:9/774: chown d1/dc/d10/d6d/d2f/d8b/l94 349 1 2024-09-13T22:09:12.278 INFO:tasks.workunit.client.1.smithi159.stdout:5/935: dread d1/d11/d50/f62 [0,4194304] 0 2024-09-13T22:09:12.278 INFO:tasks.workunit.client.1.smithi159.stdout:0/915: link d0/d5e/c56 d0/d48/d4f/d2b/d103/c135 0 2024-09-13T22:09:12.280 INFO:tasks.workunit.client.1.smithi159.stdout:8/992: getdents da/d22/d4a/dcc/d11f 0 2024-09-13T22:09:12.284 INFO:tasks.workunit.client.1.smithi159.stdout:5/936: getdents d1/d11/d1c/dd2/d44/d89/dcb 0 2024-09-13T22:09:12.284 INFO:tasks.workunit.client.1.smithi159.stdout:5/937: truncate d1/d11/d9e/fe6 907480 0 2024-09-13T22:09:12.285 INFO:tasks.workunit.client.1.smithi159.stdout:3/659: write d0/d1/d3/dd/f26 [587351,58201] 0 2024-09-13T22:09:12.285 INFO:tasks.workunit.client.1.smithi159.stdout:0/916: mknod d0/d48/d4f/daf/c136 0 2024-09-13T22:09:12.286 INFO:tasks.workunit.client.1.smithi159.stdout:9/775: dread d1/dc/d10/d6d/d87/f83 [0,4194304] 0 2024-09-13T22:09:12.287 INFO:tasks.workunit.client.1.smithi159.stdout:2/826: truncate d9/d65/d8d/de2/df0/fd9 537843 0 2024-09-13T22:09:12.287 INFO:tasks.workunit.client.1.smithi159.stdout:2/827: write d9/d44/deb/dee/d77/da6/db0/fbd [1295697,44370] 0 2024-09-13T22:09:12.288 INFO:tasks.workunit.client.1.smithi159.stdout:7/919: rmdir d3/d2e/d6e/db9 39 2024-09-13T22:09:12.290 INFO:tasks.workunit.client.1.smithi159.stdout:3/660: rename d0/d1/d3/d5/db/cb1 to d0/d1/d81/cce 0 2024-09-13T22:09:12.293 INFO:tasks.workunit.client.1.smithi159.stdout:0/917: symlink d0/d48/d4f/d66/d75/d114/l137 0 2024-09-13T22:09:12.294 INFO:tasks.workunit.client.1.smithi159.stdout:0/918: fsync d0/d2c/f8c 0 2024-09-13T22:09:12.294 INFO:tasks.workunit.client.1.smithi159.stdout:0/919: write d0/d48/d4f/d54/dac/f115 [322308,25932] 0 2024-09-13T22:09:12.294 INFO:tasks.workunit.client.1.smithi159.stdout:0/920: chown d0/d5e/f55 32831514 1 2024-09-13T22:09:12.295 INFO:tasks.workunit.client.1.smithi159.stdout:2/828: creat d9/d44/deb/dee/d77/f125 x:0 0 0 2024-09-13T22:09:12.300 INFO:tasks.workunit.client.1.smithi159.stdout:7/920: mknod d3/d31/c139 0 2024-09-13T22:09:12.302 INFO:tasks.workunit.client.1.smithi159.stdout:3/661: rename d0/d1/d3/f24 to d0/d1/d3/d5/db/dc6/fcf 0 2024-09-13T22:09:12.302 INFO:tasks.workunit.client.1.smithi159.stdout:3/662: dread - d0/d1/d3/d5/d25/d4e/d9f/fc2 zero size 2024-09-13T22:09:12.302 INFO:tasks.workunit.client.1.smithi159.stdout:3/663: fdatasync d0/d1/d3/dd/f30 0 2024-09-13T22:09:12.304 INFO:tasks.workunit.client.1.smithi159.stdout:2/829: mkdir d9/d44/deb/dee/de9/d126 0 2024-09-13T22:09:12.307 INFO:tasks.workunit.client.1.smithi159.stdout:7/921: link d3/d2e/db6/f92 d3/d31/d4d/d4e/d7a/f13a 0 2024-09-13T22:09:12.308 INFO:tasks.workunit.client.1.smithi159.stdout:3/664: mknod d0/db0/cd0 0 2024-09-13T22:09:12.309 INFO:tasks.workunit.client.1.smithi159.stdout:2/830: mkdir d9/da/d82/d89/d10b/d127 0 2024-09-13T22:09:12.311 INFO:tasks.workunit.client.1.smithi159.stdout:7/922: mkdir d3/d31/d13b 0 2024-09-13T22:09:12.311 INFO:tasks.workunit.client.1.smithi159.stdout:7/923: write d3/d31/f12d [102775,1798] 0 2024-09-13T22:09:12.312 INFO:tasks.workunit.client.1.smithi159.stdout:7/924: chown d3/dab/f106 126 1 2024-09-13T22:09:12.312 INFO:tasks.workunit.client.1.smithi159.stdout:3/665: symlink d0/d1/d81/da2/ld1 0 2024-09-13T22:09:12.313 INFO:tasks.workunit.client.1.smithi159.stdout:3/666: creat d0/d1/d3/d5/db/dc6/fd2 x:0 0 0 2024-09-13T22:09:12.313 INFO:tasks.workunit.client.1.smithi159.stdout:2/831: mkdir d9/d2d/db5/dbe/d128 0 2024-09-13T22:09:12.314 INFO:tasks.workunit.client.1.smithi159.stdout:2/832: chown d9/d65/d8d/de2/d69/dab 239741 1 2024-09-13T22:09:12.314 INFO:tasks.workunit.client.1.smithi159.stdout:2/833: dread - d9/d44/deb/dee/d77/da6/db0/fb1 zero size 2024-09-13T22:09:12.316 INFO:tasks.workunit.client.1.smithi159.stdout:7/925: creat d3/d31/d4d/d9e/dfb/dff/f13c x:0 0 0 2024-09-13T22:09:12.317 INFO:tasks.workunit.client.1.smithi159.stdout:8/993: dwrite da/d5d/dbc/fec [0,4194304] 0 2024-09-13T22:09:12.318 INFO:tasks.workunit.client.1.smithi159.stdout:9/776: dwrite d1/dc/d10/f3b [0,4194304] 0 2024-09-13T22:09:12.319 INFO:tasks.workunit.client.1.smithi159.stdout:9/777: fsync d1/dc/d10/d6d/d4b/f76 0 2024-09-13T22:09:12.319 INFO:tasks.workunit.client.1.smithi159.stdout:3/667: rename d0/d1/d3/d5/d25/d2c/fbb to d0/d1/d3/d5/d25/d4e/d5a/d9b/fd3 0 2024-09-13T22:09:12.320 INFO:tasks.workunit.client.1.smithi159.stdout:0/921: dwrite d0/f52 [0,4194304] 0 2024-09-13T22:09:12.320 INFO:tasks.workunit.client.1.smithi159.stdout:0/922: getdents d0/d48/d4f/d66/d75/d120/d12f 0 2024-09-13T22:09:12.321 INFO:tasks.workunit.client.1.smithi159.stdout:5/938: dwrite d1/d11/d64/de8/fd7 [0,4194304] 0 2024-09-13T22:09:12.322 INFO:tasks.workunit.client.1.smithi159.stdout:8/994: creat da/d7e/d82/d83/f159 x:0 0 0 2024-09-13T22:09:12.329 INFO:tasks.workunit.client.1.smithi159.stdout:7/926: write d3/d31/d4d/d4e/d7a/f9b [2557437,64261] 0 2024-09-13T22:09:12.330 INFO:tasks.workunit.client.1.smithi159.stdout:7/927: write d3/d31/d4d/d9e/f8b [238140,65475] 0 2024-09-13T22:09:12.333 INFO:tasks.workunit.client.1.smithi159.stdout:5/939: symlink d1/d11/d64/d35/d7c/d7d/l12c 0 2024-09-13T22:09:12.333 INFO:tasks.workunit.client.1.smithi159.stdout:5/940: fsync d1/d11/d9e/f31 0 2024-09-13T22:09:12.333 INFO:tasks.workunit.client.1.smithi159.stdout:5/941: truncate d1/d11/d1c/d32/f3a 9276365 0 2024-09-13T22:09:12.333 INFO:tasks.workunit.client.1.smithi159.stdout:9/778: getdents d1/dc/d27 0 2024-09-13T22:09:12.336 INFO:tasks.workunit.client.1.smithi159.stdout:9/779: read d1/d9/f95 [12614,122105] 0 2024-09-13T22:09:12.336 INFO:tasks.workunit.client.1.smithi159.stdout:0/923: dread d0/d5e/f1a [4194304,4194304] 0 2024-09-13T22:09:12.336 INFO:tasks.workunit.client.1.smithi159.stdout:0/924: stat d0/d48/d4f/f76 0 2024-09-13T22:09:12.336 INFO:tasks.workunit.client.1.smithi159.stdout:7/928: unlink d3/d2e/d6e/d74/dba/lef 0 2024-09-13T22:09:12.337 INFO:tasks.workunit.client.1.smithi159.stdout:5/942: mknod d1/d11/d64/d35/d114/c12d 0 2024-09-13T22:09:12.340 INFO:tasks.workunit.client.1.smithi159.stdout:0/925: truncate d0/d5e/f3f 3726123 0 2024-09-13T22:09:12.342 INFO:tasks.workunit.client.1.smithi159.stdout:2/834: dwrite d9/d65/d8d/de2/d69/dab/fad [0,4194304] 0 2024-09-13T22:09:12.345 INFO:tasks.workunit.client.1.smithi159.stdout:9/780: getdents d1/dc/d10/d6d/d2f 0 2024-09-13T22:09:12.345 INFO:tasks.workunit.client.1.smithi159.stdout:9/781: creat d1/dc/d10/d6d/d4b/d98/f110 x:0 0 0 2024-09-13T22:09:12.346 INFO:tasks.workunit.client.1.smithi159.stdout:3/668: dwrite d0/d1/d3/d5/d25/fc0 [0,4194304] 0 2024-09-13T22:09:12.347 INFO:tasks.workunit.client.1.smithi159.stdout:3/669: fsync d0/d1/d3/d5/d25/d75/d5b/d45/f7d 0 2024-09-13T22:09:12.352 INFO:tasks.workunit.client.1.smithi159.stdout:7/929: link d3/d2e/db6/d6c/db2/c12f d3/d2e/d6e/d74/dba/c13d 0 2024-09-13T22:09:12.352 INFO:tasks.workunit.client.1.smithi159.stdout:7/930: write d3/d31/d4d/d9e/f71 [488411,19696] 0 2024-09-13T22:09:12.357 INFO:tasks.workunit.client.1.smithi159.stdout:5/943: creat d1/d11/d64/df1/f12e x:0 0 0 2024-09-13T22:09:12.357 INFO:tasks.workunit.client.1.smithi159.stdout:5/944: getdents d1/d11/d64/d35/dfa/d125 0 2024-09-13T22:09:12.366 INFO:tasks.workunit.client.1.smithi159.stdout:9/782: rmdir d1/dc/d10/d6d/d2f/df4 0 2024-09-13T22:09:12.366 INFO:tasks.workunit.client.1.smithi159.stdout:9/783: stat d1/dc/d10/d6d/d2f/d8b/cd6 0 2024-09-13T22:09:12.366 INFO:tasks.workunit.client.1.smithi159.stdout:9/784: readlink d1/dc/d10/d6d/l88 0 2024-09-13T22:09:12.366 INFO:tasks.workunit.client.1.smithi159.stdout:9/785: fdatasync d1/dc/d10/d6d/fac 0 2024-09-13T22:09:12.367 INFO:tasks.workunit.client.1.smithi159.stdout:9/786: write d1/dc/d10/d6d/f86 [5117886,105108] 0 2024-09-13T22:09:12.367 INFO:tasks.workunit.client.1.smithi159.stdout:9/787: creat d1/dc/d10/d6d/d2f/dd3/f111 x:0 0 0 2024-09-13T22:09:12.367 INFO:tasks.workunit.client.1.smithi159.stdout:9/788: getdents d1/dc/d27 0 2024-09-13T22:09:12.379 INFO:tasks.workunit.client.1.smithi159.stdout:2/835: dwrite d9/da/f2a [0,4194304] 0 2024-09-13T22:09:12.381 INFO:tasks.workunit.client.1.smithi159.stdout:2/836: write d9/d65/d8d/de2/d69/dc9/ff5 [679529,91559] 0 2024-09-13T22:09:12.382 INFO:tasks.workunit.client.1.smithi159.stdout:7/931: rename d3/d2e/db6/d6c/db2/dce/lf2 to d3/d31/d4d/d4e/l13e 0 2024-09-13T22:09:12.383 INFO:tasks.workunit.client.1.smithi159.stdout:3/670: dwrite d0/d1/d3/d5/d25/d2c/d7f/f90 [0,4194304] 0 2024-09-13T22:09:12.384 INFO:tasks.workunit.client.1.smithi159.stdout:0/926: dwrite d0/f52 [0,4194304] 0 2024-09-13T22:09:12.384 INFO:tasks.workunit.client.1.smithi159.stdout:0/927: chown d0/d48/d4f/d54/d74/db2 366536 1 2024-09-13T22:09:12.384 INFO:tasks.workunit.client.1.smithi159.stdout:0/928: truncate d0/d48/dd9/de8/fad 4259684 0 2024-09-13T22:09:12.384 INFO:tasks.workunit.client.1.smithi159.stdout:5/945: link d1/d11/f1e d1/d11/d1c/dd2/d53/d117/f12f 0 2024-09-13T22:09:12.387 INFO:tasks.workunit.client.1.smithi159.stdout:3/671: read d0/d1/d15/f99 [139820,96445] 0 2024-09-13T22:09:12.387 INFO:tasks.workunit.client.1.smithi159.stdout:3/672: read d0/d1/d3/d5/d25/f27 [4892685,44022] 0 2024-09-13T22:09:12.387 INFO:tasks.workunit.client.1.smithi159.stdout:9/789: dwrite d1/f48 [0,4194304] 0 2024-09-13T22:09:12.388 INFO:tasks.workunit.client.1.smithi159.stdout:2/837: mkdir d9/d44/d129 0 2024-09-13T22:09:12.389 INFO:tasks.workunit.client.1.smithi159.stdout:7/932: mknod d3/d2e/d6e/d74/c13f 0 2024-09-13T22:09:12.390 INFO:tasks.workunit.client.1.smithi159.stdout:2/838: dread d9/d65/d8d/de2/d69/d66/fd8 [0,4194304] 0 2024-09-13T22:09:12.400 INFO:tasks.workunit.client.1.smithi159.stdout:0/929: mkdir d0/d48/d4f/d66/d75/d120/d138 0 2024-09-13T22:09:12.401 INFO:tasks.workunit.client.1.smithi159.stdout:0/930: read - d0/d48/d12c/da1/fc7 zero size 2024-09-13T22:09:12.403 INFO:tasks.workunit.client.1.smithi159.stdout:5/946: fsync d1/d11/d64/d35/f40 0 2024-09-13T22:09:12.406 INFO:tasks.workunit.client.1.smithi159.stdout:3/673: unlink d0/d1/d3/d5/d25/d4e/d5a/f4c 0 2024-09-13T22:09:12.409 INFO:tasks.workunit.client.1.smithi159.stdout:7/933: dwrite d3/d31/f76 [0,4194304] 0 2024-09-13T22:09:12.409 INFO:tasks.workunit.client.1.smithi159.stdout:9/790: unlink d1/dc/d10/c1d 0 2024-09-13T22:09:12.409 INFO:tasks.workunit.client.1.smithi159.stdout:9/791: chown d1/f53 208478 1 2024-09-13T22:09:12.411 INFO:tasks.workunit.client.1.smithi159.stdout:2/839: creat d9/d2d/f12a x:0 0 0 2024-09-13T22:09:12.411 INFO:tasks.workunit.client.1.smithi159.stdout:5/947: readlink d1/d11/d64/l2b 0 2024-09-13T22:09:12.413 INFO:tasks.workunit.client.1.smithi159.stdout:3/674: creat d0/d1/d3/d5/d25/d75/d5b/d45/fd4 x:0 0 0 2024-09-13T22:09:12.417 INFO:tasks.workunit.client.1.smithi159.stdout:0/931: dwrite d0/d48/d7d/ffb [0,4194304] 0 2024-09-13T22:09:12.417 INFO:tasks.workunit.client.1.smithi159.stdout:0/932: write d0/d48/d7d/dca/fe6 [69947,96368] 0 2024-09-13T22:09:12.419 INFO:tasks.workunit.client.1.smithi159.stdout:7/934: unlink d3/d2e/l10f 0 2024-09-13T22:09:12.423 INFO:tasks.workunit.client.1.smithi159.stdout:3/675: creat d0/d78/fd5 x:0 0 0 2024-09-13T22:09:12.426 INFO:tasks.workunit.client.1.smithi159.stdout:2/840: rename d9/da/d5a/c64 to d9/d44/deb/c12b 0 2024-09-13T22:09:12.427 INFO:tasks.workunit.client.1.smithi159.stdout:2/841: truncate d9/d44/deb/dee/de9/f11d 368071 0 2024-09-13T22:09:12.427 INFO:tasks.workunit.client.1.smithi159.stdout:2/842: creat d9/d2d/db5/dbe/f12c x:0 0 0 2024-09-13T22:09:12.430 INFO:tasks.workunit.client.1.smithi159.stdout:9/792: dwrite d1/dc/d10/d6d/d4b/d98/f110 [0,4194304] 0 2024-09-13T22:09:12.431 INFO:tasks.workunit.client.1.smithi159.stdout:9/793: write d1/dc/d10/d6d/d87/f83 [4415364,51132] 0 2024-09-13T22:09:12.431 INFO:tasks.workunit.client.1.smithi159.stdout:9/794: fsync d1/dc/d10/fe9 0 2024-09-13T22:09:12.431 INFO:tasks.workunit.client.1.smithi159.stdout:9/795: chown d1/d5a 228628 1 2024-09-13T22:09:12.431 INFO:tasks.workunit.client.1.smithi159.stdout:9/796: fsync d1/dc/d27/fcf 0 2024-09-13T22:09:12.431 INFO:tasks.workunit.client.1.smithi159.stdout:2/843: dread d9/d65/d8d/de2/df0/fd9 [0,4194304] 0 2024-09-13T22:09:12.432 INFO:tasks.workunit.client.1.smithi159.stdout:7/935: fdatasync d3/d3f/fad 0 2024-09-13T22:09:12.434 INFO:tasks.workunit.client.1.smithi159.stdout:3/676: rename d0/d1/d3/d5/db/c84 to d0/d1/d3/d5/d25/d4e/d5a/cd6 0 2024-09-13T22:09:12.437 INFO:tasks.workunit.client.1.smithi159.stdout:9/797: mknod d1/dc/d10/d6d/d2f/d8b/c112 0 2024-09-13T22:09:12.438 INFO:tasks.workunit.client.1.smithi159.stdout:2/844: symlink d9/d65/d8d/de2/l12d 0 2024-09-13T22:09:12.441 INFO:tasks.workunit.client.1.smithi159.stdout:2/845: fdatasync d9/d65/d8d/de2/df0/f4e 0 2024-09-13T22:09:12.441 INFO:tasks.workunit.client.1.smithi159.stdout:2/846: stat d9/d44/f8a 0 2024-09-13T22:09:12.441 INFO:tasks.workunit.client.1.smithi159.stdout:2/847: creat d9/d65/d8d/de2/df0/d108/f12e x:0 0 0 2024-09-13T22:09:12.443 INFO:tasks.workunit.client.1.smithi159.stdout:3/677: rmdir d0/d1/d3/d5/d25/d2c/d65 39 2024-09-13T22:09:12.444 INFO:tasks.workunit.client.1.smithi159.stdout:0/933: dwrite d0/d2c/fde [0,4194304] 0 2024-09-13T22:09:12.444 INFO:tasks.workunit.client.1.smithi159.stdout:0/934: fsync d0/d2c/f8c 0 2024-09-13T22:09:12.447 INFO:tasks.workunit.client.1.smithi159.stdout:5/948: dwrite d1/d11/d64/f10 [8388608,4194304] 0 2024-09-13T22:09:12.454 INFO:tasks.workunit.client.1.smithi159.stdout:3/678: rename d0/d1/d3/d5/d25/d4e/d5a/f21 to d0/d1/d3/d5/d25/d7e/fd7 0 2024-09-13T22:09:12.456 INFO:tasks.workunit.client.1.smithi159.stdout:0/935: dread d0/f6a [0,4194304] 0 2024-09-13T22:09:12.456 INFO:tasks.workunit.client.1.smithi159.stdout:0/936: write d0/d48/f11e [141934,55870] 0 2024-09-13T22:09:12.459 INFO:tasks.workunit.client.1.smithi159.stdout:3/679: truncate d0/d1/d3/d5/d25/d4e/d5a/f19 2267981 0 2024-09-13T22:09:12.459 INFO:tasks.workunit.client.1.smithi159.stdout:3/680: write d0/d1/d3/d5/d25/d4e/d9f/fc2 [550800,64554] 0 2024-09-13T22:09:12.465 INFO:tasks.workunit.client.1.smithi159.stdout:3/681: creat d0/d91/fd8 x:0 0 0 2024-09-13T22:09:12.472 INFO:tasks.workunit.client.1.smithi159.stdout:9/798: dwrite d1/d9/ff [0,4194304] 0 2024-09-13T22:09:12.477 INFO:tasks.workunit.client.1.smithi159.stdout:7/936: dwrite d3/d31/d4d/d4e/d7a/f9b [0,4194304] 0 2024-09-13T22:09:12.477 INFO:tasks.workunit.client.1.smithi159.stdout:5/949: dwrite d1/d11/d64/d35/d7c/d7d/d110/fd5 [0,4194304] 0 2024-09-13T22:09:12.479 INFO:tasks.workunit.client.1.smithi159.stdout:5/950: write d1/d11/d64/d35/d7c/fdf [131486,9528] 0 2024-09-13T22:09:12.484 INFO:tasks.workunit.client.1.smithi159.stdout:9/799: dread d1/d9/dab/fee [0,4194304] 0 2024-09-13T22:09:12.498 INFO:tasks.workunit.client.1.smithi159.stdout:7/937: dwrite d3/d31/d4d/d4e/d7a/fcf [0,4194304] 0 2024-09-13T22:09:12.499 INFO:tasks.workunit.client.1.smithi159.stdout:5/951: creat d1/d11/d64/de8/d10f/f130 x:0 0 0 2024-09-13T22:09:12.502 INFO:tasks.workunit.client.1.smithi159.stdout:7/938: rename d3/d3f/f91 to d3/d2e/db6/f140 0 2024-09-13T22:09:12.503 INFO:tasks.workunit.client.1.smithi159.stdout:7/939: mkdir d3/d31/dd8/d141 0 2024-09-13T22:09:12.503 INFO:tasks.workunit.client.1.smithi159.stdout:7/940: creat d3/d31/d4d/d9e/dfb/f142 x:0 0 0 2024-09-13T22:09:12.508 INFO:tasks.workunit.client.1.smithi159.stdout:9/800: dwrite d1/dc/f9a [0,4194304] 0 2024-09-13T22:09:12.508 INFO:tasks.workunit.client.1.smithi159.stdout:9/801: fdatasync d1/f7b 0 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: Manager daemon smithi159.ghpomd is now available 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: Migrating agent root cert to cert store 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: Migrating agent root key to cert store 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: Checking for cert/key for grafana.smithi089 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: Migrating grafana.smithi089 cert to cert store 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: Migrating grafana.smithi089 key to cert store 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:12.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:12.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.ghpomd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:09:12.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.ghpomd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:09:12.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.ghpomd/trash_purge_schedule"}]: dispatch 2024-09-13T22:09:12.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:12 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.ghpomd/trash_purge_schedule"}]: dispatch 2024-09-13T22:09:12.514 INFO:tasks.workunit.client.1.smithi159.stdout:3/682: dwrite d0/d1/d3/dd/f20 [4194304,4194304] 0 2024-09-13T22:09:12.532 INFO:tasks.workunit.client.1.smithi159.stdout:5/952: dwrite d1/d11/d64/d35/d7c/d7d/d110/f6d [0,4194304] 0 2024-09-13T22:09:12.543 INFO:tasks.workunit.client.1.smithi159.stdout:5/953: dread d1/d11/d64/de8/fd7 [0,4194304] 0 2024-09-13T22:09:12.549 INFO:tasks.workunit.client.1.smithi159.stdout:7/941: dwrite d3/d2e/f82 [0,4194304] 0 2024-09-13T22:09:12.549 INFO:tasks.workunit.client.1.smithi159.stdout:3/683: dwrite d0/d1/d3/d5/d25/f27 [0,4194304] 0 2024-09-13T22:09:12.549 INFO:tasks.workunit.client.1.smithi159.stdout:3/684: truncate d0/d1/d3/d5/d25/d75/fab 826211 0 2024-09-13T22:09:12.549 INFO:tasks.workunit.client.1.smithi159.stdout:9/802: dwrite d1/dc/d27/d40/fce [0,4194304] 0 2024-09-13T22:09:12.552 INFO:tasks.workunit.client.1.smithi159.stdout:7/942: rename d3/d31/d4d/lc8 to d3/d2e/d6e/db9/l143 0 2024-09-13T22:09:12.553 INFO:tasks.workunit.client.1.smithi159.stdout:3/685: truncate d0/d1/d3/d5/db/d39/f52 5629628 0 2024-09-13T22:09:12.556 INFO:tasks.workunit.client.1.smithi159.stdout:9/803: rmdir d1/dc/d10/d6d/d87/d106 0 2024-09-13T22:09:12.556 INFO:tasks.workunit.client.1.smithi159.stdout:9/804: stat d1/dc/d10/d6d/d2f/d8b/ddd 0 2024-09-13T22:09:12.557 INFO:tasks.workunit.client.1.smithi159.stdout:7/943: mkdir d3/d31/d4d/d9e/dec/d144 0 2024-09-13T22:09:12.560 INFO:tasks.workunit.client.1.smithi159.stdout:5/954: dwrite d1/d11/d1c/dd2/d44/f5d [0,4194304] 0 2024-09-13T22:09:12.560 INFO:tasks.workunit.client.1.smithi159.stdout:5/955: fdatasync d1/d11/d64/f47 0 2024-09-13T22:09:12.562 INFO:tasks.workunit.client.1.smithi159.stdout:5/956: symlink d1/d11/d64/d35/d7c/l131 0 2024-09-13T22:09:12.563 INFO:tasks.workunit.client.1.smithi159.stdout:5/957: creat d1/d11/d1c/dd2/d44/f132 x:0 0 0 2024-09-13T22:09:12.563 INFO:tasks.workunit.client.1.smithi159.stdout:5/958: chown d1/f96 1955490585 1 2024-09-13T22:09:12.576 INFO:tasks.workunit.client.1.smithi159.stdout:5/959: dread d1/d11/d50/fe7 [0,4194304] 0 2024-09-13T22:09:12.576 INFO:tasks.workunit.client.1.smithi159.stdout:5/960: truncate d1/d11/d64/d35/d7c/fe0 643794 0 2024-09-13T22:09:12.576 INFO:tasks.workunit.client.1.smithi159.stdout:5/961: dread - d1/d11/d64/d82/d8c/fcd zero size 2024-09-13T22:09:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.576+0000 7f1445dda640 1 -- 172.21.15.89:0/1475552983 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400ff380 msgr2=0x7f14400ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.576+0000 7f1445dda640 1 --2- 172.21.15.89:0/1475552983 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400ff380 0x7f14400ff800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1430009880 tx=0x7f143002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.576+0000 7f1445dda640 1 -- 172.21.15.89:0/1475552983 shutdown_connections 2024-09-13T22:09:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.576+0000 7f1445dda640 1 --2- 172.21.15.89:0/1475552983 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400ff380 0x7f14400ff800 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.576+0000 7f1445dda640 1 --2- 172.21.15.89:0/1475552983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400fe180 0x7f14400fe580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.577+0000 7f1445dda640 1 -- 172.21.15.89:0/1475552983 >> 172.21.15.89:0/1475552983 conn(0x7f14400f98f0 msgr2=0x7f14400fbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.577+0000 7f1445dda640 1 -- 172.21.15.89:0/1475552983 shutdown_connections 2024-09-13T22:09:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.577+0000 7f1445dda640 1 -- 172.21.15.89:0/1475552983 wait complete. 2024-09-13T22:09:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.578+0000 7f1445dda640 1 Processor -- start 2024-09-13T22:09:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.578+0000 7f1445dda640 1 -- start start 2024-09-13T22:09:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.578+0000 7f1445dda640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400fe180 0x7f14401978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.578+0000 7f1445dda640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400ff380 0x7f1440197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.578+0000 7f1445dda640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440198400 con 0x7f14400fe180 2024-09-13T22:09:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.578+0000 7f1445dda640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440198570 con 0x7f14400ff380 2024-09-13T22:09:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400fe180 0x7f14401978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400fe180 0x7f14401978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36908/0 (socket says 172.21.15.89:36908) 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143f7fe640 1 -- 172.21.15.89:0/3964942292 learned_addr learned my addr 172.21.15.89:0/3964942292 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143f7fe640 1 -- 172.21.15.89:0/3964942292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400ff380 msgr2=0x7f1440197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143f7fe640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400ff380 0x7f1440197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143f7fe640 1 -- 172.21.15.89:0/3964942292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009560 con 0x7f14400fe180 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143f7fe640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400fe180 0x7f14401978f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f143800b9f0 tx=0x7f143800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143cff9640 1 -- 172.21.15.89:0/3964942292 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143800cb20 con 0x7f14400fe180 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143cff9640 1 -- 172.21.15.89:0/3964942292 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f143800cc80 con 0x7f14400fe180 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144019d010 con 0x7f14400fe180 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f143cff9640 1 -- 172.21.15.89:0/3964942292 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1438012710 con 0x7f14400fe180 2024-09-13T22:09:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.579+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144019d5b0 con 0x7f14400fe180 2024-09-13T22:09:12.584 INFO:tasks.workunit.client.1.smithi159.stdout:9/805: dwrite d1/dc/d10/d6d/d4b/dcb/d75/fa6 [0,4194304] 0 2024-09-13T22:09:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.580+0000 7f143cff9640 1 -- 172.21.15.89:0/3964942292 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 22) v1 ==== 46258+0+0 (secure 0 0 0) 0x7f1438012980 con 0x7f14400fe180 2024-09-13T22:09:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.580+0000 7f143cff9640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f142c039100 0x7f142c03b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.581+0000 7f143cff9640 1 -- 172.21.15.89:0/3964942292 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f143804dba0 con 0x7f14400fe180 2024-09-13T22:09:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.581+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14400fe600 con 0x7f14400fe180 2024-09-13T22:09:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.581+0000 7f143effd640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f142c039100 0x7f142c03b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.581+0000 7f143effd640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f142c039100 0x7f142c03b5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f143002a9c0 tx=0x7f1430000bc0 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:12.585 INFO:tasks.workunit.client.1.smithi159.stdout:5/962: rename d1/d11/d64/de8/d10f/f130 to d1/d11/d64/f133 0 2024-09-13T22:09:12.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.585+0000 7f143cff9640 1 -- 172.21.15.89:0/3964942292 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f1438019080 con 0x7f14400fe180 2024-09-13T22:09:12.589 INFO:tasks.workunit.client.1.smithi159.stdout:9/806: unlink d1/dc/d10/d6d/d2f/f68 0 2024-09-13T22:09:12.590 INFO:tasks.workunit.client.1.smithi159.stdout:7/944: dwrite d3/d2e/d6e/fb5 [0,4194304] 0 2024-09-13T22:09:12.592 INFO:tasks.workunit.client.1.smithi159.stdout:5/963: link d1/l48 d1/d11/d64/de8/l134 0 2024-09-13T22:09:12.596 INFO:tasks.workunit.client.1.smithi159.stdout:9/807: unlink d1/dc/d27/d40/fc2 0 2024-09-13T22:09:12.596 INFO:tasks.workunit.client.1.smithi159.stdout:9/808: chown d1/dc/d10/d6d/d4b/dcb/d75/fd2 886161372 1 2024-09-13T22:09:12.599 INFO:tasks.workunit.client.1.smithi159.stdout:5/964: rename d1/d11/d64/d82/d8c/fd3 to d1/d11/d64/d82/d8c/f135 0 2024-09-13T22:09:12.599 INFO:tasks.workunit.client.1.smithi159.stdout:5/965: chown d1/d11/d1c/dd2/d53 7936 1 2024-09-13T22:09:12.611 INFO:tasks.workunit.client.1.smithi159.stdout:5/966: dread d1/d11/d64/d35/d7c/d7d/d110/ffb [0,4194304] 0 2024-09-13T22:09:12.613 INFO:tasks.workunit.client.1.smithi159.stdout:5/967: rmdir d1/d11/d1c/dd2/d44/d89 39 2024-09-13T22:09:12.614 INFO:tasks.workunit.client.1.smithi159.stdout:5/968: mknod d1/d11/d64/d82/d8f/dba/c136 0 2024-09-13T22:09:12.614 INFO:tasks.workunit.client.1.smithi159.stdout:7/945: dwrite d3/d31/f12a [0,4194304] 0 2024-09-13T22:09:12.614 INFO:tasks.workunit.client.1.smithi159.stdout:5/969: truncate d1/d11/d50/fe5 874864 0 2024-09-13T22:09:12.615 INFO:tasks.workunit.client.1.smithi159.stdout:7/946: mkdir d3/d31/d4d/d9e/dfb/dff/d129/d145 0 2024-09-13T22:09:12.616 INFO:tasks.workunit.client.1.smithi159.stdout:7/947: stat d3/d2e/fe0 0 2024-09-13T22:09:12.616 INFO:tasks.workunit.client.1.smithi159.stdout:9/809: dwrite d1/dc/d10/d6d/fac [0,4194304] 0 2024-09-13T22:09:12.616 INFO:tasks.workunit.client.1.smithi159.stdout:5/970: dread d1/d11/d9e/f78 [0,4194304] 0 2024-09-13T22:09:12.616 INFO:tasks.workunit.client.1.smithi159.stdout:7/948: mknod d3/d31/d4d/d9e/dfb/dff/d129/d145/c146 0 2024-09-13T22:09:12.619 INFO:tasks.workunit.client.1.smithi159.stdout:9/810: creat d1/dc/ded/f113 x:0 0 0 2024-09-13T22:09:12.621 INFO:tasks.workunit.client.1.smithi159.stdout:5/971: symlink d1/d11/d1c/dd2/d44/d89/dcb/l137 0 2024-09-13T22:09:12.621 INFO:tasks.workunit.client.1.smithi159.stdout:5/972: write d1/fad [752076,76025] 0 2024-09-13T22:09:12.622 INFO:tasks.workunit.client.1.smithi159.stdout:9/811: mkdir d1/dc/d10/d6d/d2f/d8b/d114 0 2024-09-13T22:09:12.624 INFO:tasks.workunit.client.1.smithi159.stdout:5/973: link d1/d11/d1c/dd2/d53/ff8 d1/d11/d64/d35/d7c/d7d/f138 0 2024-09-13T22:09:12.625 INFO:tasks.workunit.client.1.smithi159.stdout:7/949: getdents d3 0 2024-09-13T22:09:12.631 INFO:tasks.workunit.client.1.smithi159.stdout:9/812: dread d1/dc/d10/d6d/f86 [0,4194304] 0 2024-09-13T22:09:12.631 INFO:tasks.workunit.client.1.smithi159.stdout:9/813: fsync d1/dc/d10/d6d/d4b/d98/da8/fb3 0 2024-09-13T22:09:12.634 INFO:tasks.workunit.client.1.smithi159.stdout:5/974: dread d1/d11/d64/d35/d7c/d7d/d110/f54 [0,4194304] 0 2024-09-13T22:09:12.634 INFO:tasks.workunit.client.1.smithi159.stdout:5/975: truncate d1/d11/d64/df1/f12e 74577 0 2024-09-13T22:09:12.635 INFO:tasks.workunit.client.1.smithi159.stdout:9/814: mkdir d1/dc/d10/d115 0 2024-09-13T22:09:12.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/815: dread d1/dc/d10/fb9 [0,4194304] 0 2024-09-13T22:09:12.638 INFO:tasks.workunit.client.1.smithi159.stdout:9/816: stat d1/dc/d10/d6d/d2f/d8b/da1/fde 0 2024-09-13T22:09:12.639 INFO:tasks.workunit.client.1.smithi159.stdout:5/976: rename d1/d11/d1c/dd2/d53/l116 to d1/d11/d1c/dd2/d44/d85/l139 0 2024-09-13T22:09:12.642 INFO:tasks.workunit.client.1.smithi159.stdout:9/817: mkdir d1/dc/d10/d6d/d2f/d116 0 2024-09-13T22:09:12.642 INFO:tasks.workunit.client.1.smithi159.stdout:9/818: fdatasync d1/dc/f12 0 2024-09-13T22:09:12.644 INFO:tasks.workunit.client.1.smithi159.stdout:5/977: chown d1/d11/d64/l39 737078 1 2024-09-13T22:09:12.647 INFO:tasks.workunit.client.1.smithi159.stdout:9/819: creat d1/dc/d10/d6d/d2f/d8b/ddd/f117 x:0 0 0 2024-09-13T22:09:12.648 INFO:tasks.workunit.client.1.smithi159.stdout:5/978: rename d1/d11/d50/le4 to d1/d11/d64/de8/d10f/df2/l13a 0 2024-09-13T22:09:12.651 INFO:tasks.workunit.client.1.smithi159.stdout:9/820: rename d1/dc/d10/f92 to d1/dc/d10/d6d/d2f/d8b/ddd/f118 0 2024-09-13T22:09:12.654 INFO:tasks.workunit.client.1.smithi159.stdout:5/979: rmdir d1/d11/d50/dca 39 2024-09-13T22:09:12.656 INFO:tasks.workunit.client.1.smithi159.stdout:9/821: creat d1/dc/d10/d6d/d4b/dcb/d74/ddc/f119 x:0 0 0 2024-09-13T22:09:12.656 INFO:tasks.workunit.client.1.smithi159.stdout:9/822: write d1/dc/d27/ff3 [418860,25306] 0 2024-09-13T22:09:12.656 INFO:tasks.workunit.client.1.smithi159.stdout:9/823: creat d1/dc/d10/d69/f11a x:0 0 0 2024-09-13T22:09:12.659 INFO:tasks.workunit.client.1.smithi159.stdout:5/980: rename d1/d11/d64/d35/d7c/c121 to d1/d11/d64/de8/d10f/df2/c13b 0 2024-09-13T22:09:12.668 INFO:tasks.workunit.client.1.smithi159.stdout:5/981: symlink d1/d11/d64/d35/d7c/d7d/l13c 0 2024-09-13T22:09:12.671 INFO:tasks.workunit.client.1.smithi159.stdout:5/982: creat d1/d11/d1c/f13d x:0 0 0 2024-09-13T22:09:12.672 INFO:tasks.workunit.client.1.smithi159.stdout:9/824: dwrite d1/dc/f12 [4194304,4194304] 0 2024-09-13T22:09:12.673 INFO:tasks.workunit.client.1.smithi159.stdout:9/825: stat d1/dc/f9f 0 2024-09-13T22:09:12.676 INFO:tasks.workunit.client.1.smithi159.stdout:9/826: mkdir d1/d9/d1f/d11b 0 2024-09-13T22:09:12.677 INFO:tasks.workunit.client.1.smithi159.stdout:9/827: write d1/dc/d10/d6d/d2f/fb7 [4409415,99484] 0 2024-09-13T22:09:12.682 INFO:tasks.workunit.client.1.smithi159.stdout:9/828: rename d1/dc/d27/d40 to d1/dc/d27/d11c 0 2024-09-13T22:09:12.682 INFO:tasks.workunit.client.1.smithi159.stdout:9/829: stat d1/f81 0 2024-09-13T22:09:12.682 INFO:tasks.workunit.client.1.smithi159.stdout:9/830: write d1/dc/d10/f3b [4402564,19854] 0 2024-09-13T22:09:12.689 INFO:tasks.workunit.client.1.smithi159.stdout:9/831: write d1/dc/f9f [3406477,85001] 0 2024-09-13T22:09:12.689 INFO:tasks.workunit.client.1.smithi159.stdout:5/983: dwrite d1/d11/d64/d35/d7c/d7d/ff4 [0,4194304] 0 2024-09-13T22:09:12.690 INFO:tasks.workunit.client.1.smithi159.stdout:9/832: dread d1/dc/d27/d11c/fb1 [0,4194304] 0 2024-09-13T22:09:12.693 INFO:tasks.workunit.client.1.smithi159.stdout:5/984: mkdir d1/d11/d64/d82/d8f/d13e 0 2024-09-13T22:09:12.693 INFO:tasks.workunit.client.1.smithi159.stdout:5/985: chown d1/d11/d50/fb7 15142 1 2024-09-13T22:09:12.693 INFO:tasks.workunit.client.1.smithi159.stdout:5/986: chown d1/d11/d9e/fe6 5040532 1 2024-09-13T22:09:12.693 INFO:tasks.workunit.client.1.smithi159.stdout:5/987: creat d1/d11/d64/d35/dfa/f13f x:0 0 0 2024-09-13T22:09:12.693 INFO:tasks.workunit.client.1.smithi159.stdout:5/988: chown d1/d11/d64/d35/dfa/f13f 67 1 2024-09-13T22:09:12.693 INFO:tasks.workunit.client.1.smithi159.stdout:9/833: creat d1/dc/d10/d6d/d2f/d8b/da1/f11d x:0 0 0 2024-09-13T22:09:12.696 INFO:tasks.workunit.client.1.smithi159.stdout:5/989: dread d1/d11/d64/d35/d7c/d7d/d110/fc0 [0,4194304] 0 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: Manager daemon smithi159.ghpomd is now available 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: Migrating agent root cert to cert store 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: Migrating agent root key to cert store 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: Checking for cert/key for grafana.smithi089 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: Migrating grafana.smithi089 cert to cert store 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: Migrating grafana.smithi089 key to cert store 2024-09-13T22:09:12.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.712 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:12.712 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:12.712 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:12.712 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.ghpomd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:09:12.712 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.ghpomd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:09:12.712 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.ghpomd/trash_purge_schedule"}]: dispatch 2024-09-13T22:09:12.712 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:12 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.ghpomd/trash_purge_schedule"}]: dispatch 2024-09-13T22:09:12.712 INFO:tasks.workunit.client.1.smithi159.stdout:9/834: mkdir d1/d9/d1f/d99/d11e 0 2024-09-13T22:09:12.712 INFO:tasks.workunit.client.1.smithi159.stdout:9/835: fsync d1/dc/d27/d11c/f70 0 2024-09-13T22:09:12.715 INFO:tasks.workunit.client.1.smithi159.stdout:9/836: mkdir d1/d9/d1f/d11f 0 2024-09-13T22:09:12.719 INFO:tasks.workunit.client.1.smithi159.stdout:9/837: mkdir d1/dc/d10/d6d/d4b/d98/d120 0 2024-09-13T22:09:12.723 INFO:tasks.workunit.client.1.smithi159.stdout:5/990: dwrite d1/d11/d64/f10 [4194304,4194304] 0 2024-09-13T22:09:12.723 INFO:tasks.workunit.client.1.smithi159.stdout:5/991: fsync d1/d11/d1c/dd2/f5a 0 2024-09-13T22:09:12.724 INFO:tasks.workunit.client.1.smithi159.stdout:5/992: creat d1/d11/d1c/d32/f140 x:0 0 0 2024-09-13T22:09:12.728 INFO:tasks.workunit.client.1.smithi159.stdout:9/838: dread d1/dc/d10/d6d/d4b/d98/da8/fba [0,4194304] 0 2024-09-13T22:09:12.728 INFO:tasks.workunit.client.1.smithi159.stdout:9/839: write d1/dc/d10/fe9 [760903,80766] 0 2024-09-13T22:09:12.728 INFO:tasks.workunit.client.1.smithi159.stdout:9/840: creat d1/dc/ded/f121 x:0 0 0 2024-09-13T22:09:12.728 INFO:tasks.workunit.client.1.smithi159.stdout:9/841: write d1/dc/d27/f65 [951457,28462] 0 2024-09-13T22:09:12.728 INFO:tasks.workunit.client.1.smithi159.stdout:9/842: chown d1/f53 0 1 2024-09-13T22:09:12.745 INFO:tasks.workunit.client.1.smithi159.stdout:5/993: dwrite d1/d11/d64/d35/d7c/d7d/d110/f2c [0,4194304] 0 2024-09-13T22:09:12.748 INFO:tasks.workunit.client.1.smithi159.stdout:9/843: dwrite d1/d9/dab/dd7/f89 [0,4194304] 0 2024-09-13T22:09:12.749 INFO:tasks.workunit.client.1.smithi159.stdout:9/844: mknod d1/dc/d27/da4/c122 0 2024-09-13T22:09:12.750 INFO:tasks.workunit.client.1.smithi159.stdout:9/845: symlink d1/dc/d10/d6d/d2f/d8b/d8f/l123 0 2024-09-13T22:09:12.752 INFO:tasks.workunit.client.1.smithi159.stdout:9/846: rename d1/dc/d10/d6d/d4b/f76 to d1/dc/d10/d6d/d2f/d8b/d8f/f124 0 2024-09-13T22:09:12.753 INFO:tasks.workunit.client.1.smithi159.stdout:9/847: mkdir d1/d9/d1f/d11f/d125 0 2024-09-13T22:09:12.759 INFO:tasks.workunit.client.1.smithi159.stdout:5/994: dread d1/d11/d64/d35/d60/fa3 [0,4194304] 0 2024-09-13T22:09:12.761 INFO:tasks.workunit.client.1.smithi159.stdout:5/995: mkdir d1/d11/d64/de8/d10f/d141 0 2024-09-13T22:09:12.778 INFO:tasks.workunit.client.1.smithi159.stdout:9/848: dwrite d1/dc/d27/da4/fd0 [0,4194304] 0 2024-09-13T22:09:12.778 INFO:tasks.workunit.client.1.smithi159.stdout:5/996: dwrite d1/d11/d64/f10 [8388608,4194304] 0 2024-09-13T22:09:12.781 INFO:tasks.workunit.client.1.smithi159.stdout:9/849: unlink d1/d5a/d101/l109 0 2024-09-13T22:09:12.783 INFO:tasks.workunit.client.1.smithi159.stdout:5/997: mknod d1/d11/d1c/dd2/d44/d85/c142 0 2024-09-13T22:09:12.784 INFO:tasks.workunit.client.1.smithi159.stdout:5/998: chown d1/d11/d64/l39 2 1 2024-09-13T22:09:12.784 INFO:tasks.workunit.client.1.smithi159.stdout:5/999: dread - d1/d11/d1c/dd2/dd6/f102 zero size 2024-09-13T22:09:12.785 INFO:tasks.workunit.client.1.smithi159.stdout:9/850: mknod d1/dc/d10/d6d/d4b/d98/da8/c126 0 2024-09-13T22:09:12.787 INFO:tasks.workunit.client.1.smithi159.stdout:9/851: getdents d1/dc 0 2024-09-13T22:09:12.788 INFO:tasks.workunit.client.1.smithi159.stdout:9/852: creat d1/dc/d10/d6d/d2f/d8b/d8f/f127 x:0 0 0 2024-09-13T22:09:12.788 INFO:tasks.workunit.client.1.smithi159.stdout:9/853: read - d1/dc/d27/da4/db5/f105 zero size 2024-09-13T22:09:12.788 INFO:tasks.workunit.client.1.smithi159.stdout:9/854: write d1/dc/d10/fe8 [919003,33464] 0 2024-09-13T22:09:12.788 INFO:tasks.workunit.client.1.smithi159.stdout:9/855: dread - d1/dc/d10/d6d/d4b/dcb/d74/ddc/f119 zero size 2024-09-13T22:09:12.788 INFO:tasks.workunit.client.1.smithi159.stdout:9/856: fsync d1/dc/d27/d11c/fe4 0 2024-09-13T22:09:12.788 INFO:tasks.workunit.client.1.smithi159.stdout:9/857: creat d1/d5a/f128 x:0 0 0 2024-09-13T22:09:12.793 INFO:tasks.workunit.client.1.smithi159.stdout:0/937: sync 2024-09-13T22:09:12.793 INFO:tasks.workunit.client.1.smithi159.stdout:2/848: sync 2024-09-13T22:09:12.793 INFO:tasks.workunit.client.1.smithi159.stdout:8/995: sync 2024-09-13T22:09:12.794 INFO:tasks.workunit.client.1.smithi159.stdout:2/849: mkdir d9/d44/deb/d10d/d12f 0 2024-09-13T22:09:12.796 INFO:tasks.workunit.client.1.smithi159.stdout:0/938: dread d0/d48/d4f/d66/d75/f11a [0,4194304] 0 2024-09-13T22:09:12.796 INFO:tasks.workunit.client.1.smithi159.stdout:0/939: chown d0/d2c/f43 4083 1 2024-09-13T22:09:12.798 INFO:tasks.workunit.client.1.smithi159.stdout:8/996: rename da/da0/ld6 to da/d7e/d82/dd8/de7/l15a 0 2024-09-13T22:09:12.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.806+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 --> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14401035c0 con 0x7f142c039100 2024-09-13T22:09:12.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.808+0000 7f143cff9640 1 -- 172.21.15.89:0/3964942292 <== mgr.24319 v2:172.21.15.159:6828/1500548398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f14401035c0 con 0x7f142c039100 2024-09-13T22:09:12.811 INFO:tasks.workunit.client.1.smithi159.stdout:9/858: dwrite d1/f7b [0,4194304] 0 2024-09-13T22:09:12.811 INFO:tasks.workunit.client.1.smithi159.stdout:9/859: creat d1/dc/ded/f129 x:0 0 0 2024-09-13T22:09:12.815 INFO:tasks.workunit.client.1.smithi159.stdout:9/860: rmdir d1/dc/d10/d6d/d2f/d116 0 2024-09-13T22:09:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.813+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f142c039100 msgr2=0x7f142c03b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.813+0000 7f1445dda640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f142c039100 0x7f142c03b5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f143002a9c0 tx=0x7f1430000bc0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.813+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400fe180 msgr2=0x7f14401978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.813+0000 7f1445dda640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400fe180 0x7f14401978f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f143800b9f0 tx=0x7f143800beb0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.813+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 shutdown_connections 2024-09-13T22:09:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.813+0000 7f1445dda640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f142c039100 0x7f142c03b5c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.813+0000 7f1445dda640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14400ff380 0x7f1440197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.813+0000 7f1445dda640 1 --2- 172.21.15.89:0/3964942292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14400fe180 0x7f14401978f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.813+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 >> 172.21.15.89:0/3964942292 conn(0x7f14400f98f0 msgr2=0x7f14400fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:12.818 INFO:tasks.workunit.client.1.smithi159.stdout:9/861: symlink d1/d5a/l12a 0 2024-09-13T22:09:12.818 INFO:tasks.workunit.client.1.smithi159.stdout:9/862: chown d1/f30 3 1 2024-09-13T22:09:12.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.814+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 shutdown_connections 2024-09-13T22:09:12.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.814+0000 7f1445dda640 1 -- 172.21.15.89:0/3964942292 wait complete. 2024-09-13T22:09:12.825 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:09:12.829 INFO:tasks.workunit.client.1.smithi159.stdout:9/863: dread d1/dc/d27/d11c/f70 [0,4194304] 0 2024-09-13T22:09:12.829 INFO:tasks.workunit.client.1.smithi159.stdout:0/940: dwrite d0/d48/d4f/d66/f87 [4194304,4194304] 0 2024-09-13T22:09:12.832 INFO:tasks.workunit.client.1.smithi159.stdout:0/941: mkdir d0/d48/d4f/d54/d74/db2/d139 0 2024-09-13T22:09:12.834 INFO:tasks.workunit.client.1.smithi159.stdout:2/850: dwrite d9/d2d/db5/dbe/fe4 [0,4194304] 0 2024-09-13T22:09:12.840 INFO:tasks.workunit.client.1.smithi159.stdout:8/997: dwrite da/d22/f27 [0,4194304] 0 2024-09-13T22:09:12.843 INFO:tasks.workunit.client.1.smithi159.stdout:2/851: mknod d9/da/d82/d89/d10b/c130 0 2024-09-13T22:09:12.847 INFO:tasks.workunit.client.1.smithi159.stdout:2/852: link d9/d44/deb/dee/c50 d9/d44/deb/dee/d77/da6/db0/c131 0 2024-09-13T22:09:12.851 INFO:tasks.workunit.client.1.smithi159.stdout:2/853: symlink d9/da/d5a/d10c/l132 0 2024-09-13T22:09:12.852 INFO:tasks.workunit.client.1.smithi159.stdout:8/998: dread da/d36/d57/f95 [0,4194304] 0 2024-09-13T22:09:12.852 INFO:tasks.workunit.client.1.smithi159.stdout:2/854: write d9/da/d5a/f63 [3553838,45900] 0 2024-09-13T22:09:12.855 INFO:tasks.workunit.client.1.smithi159.stdout:0/942: dwrite d0/f26 [0,4194304] 0 2024-09-13T22:09:12.857 INFO:tasks.workunit.client.1.smithi159.stdout:9/864: dwrite d1/dc/d10/d69/f90 [0,4194304] 0 2024-09-13T22:09:12.859 INFO:tasks.workunit.client.1.smithi159.stdout:0/943: unlink d0/dfe/f117 0 2024-09-13T22:09:12.862 INFO:tasks.workunit.client.1.smithi159.stdout:8/999: dread da/d7e/d82/dd8/f12c [0,4194304] 0 2024-09-13T22:09:12.872 INFO:tasks.workunit.client.1.smithi159.stdout:9/865: symlink d1/dc/d10/d69/l12b 0 2024-09-13T22:09:12.873 INFO:tasks.workunit.client.1.smithi159.stdout:0/944: creat d0/d48/d4f/d54/d74/db2/f13a x:0 0 0 2024-09-13T22:09:12.873 INFO:tasks.workunit.client.1.smithi159.stdout:0/945: chown d0/d48/d4f/d54/d74/f7e 28 1 2024-09-13T22:09:12.874 INFO:tasks.workunit.client.1.smithi159.stdout:9/866: mknod d1/dc/ded/c12c 0 2024-09-13T22:09:12.875 INFO:tasks.workunit.client.1.smithi159.stdout:9/867: mknod d1/d9/d1f/c12d 0 2024-09-13T22:09:12.878 INFO:tasks.workunit.client.1.smithi159.stdout:0/946: dread d0/d5e/f1e [0,4194304] 0 2024-09-13T22:09:12.878 INFO:tasks.workunit.client.1.smithi159.stdout:9/868: dread d1/dc/d27/ff3 [0,4194304] 0 2024-09-13T22:09:12.879 INFO:tasks.workunit.client.1.smithi159.stdout:0/947: rename d0/d48/d12c/fc8 to d0/d48/d4f/daa/f13b 0 2024-09-13T22:09:12.884 INFO:tasks.workunit.client.1.smithi159.stdout:0/948: mkdir d0/d2c/d10d/d13c 0 2024-09-13T22:09:12.884 INFO:tasks.workunit.client.1.smithi159.stdout:0/949: chown d0/d5e/c1b 0 1 2024-09-13T22:09:12.884 INFO:tasks.workunit.client.1.smithi159.stdout:0/950: dread - d0/d48/d4f/d54/d74/db2/d10a/f112 zero size 2024-09-13T22:09:12.885 INFO:tasks.workunit.client.1.smithi159.stdout:9/869: read d1/dc/d10/d6d/d2f/d8b/da1/fde [1002636,55049] 0 2024-09-13T22:09:12.886 INFO:tasks.workunit.client.1.smithi159.stdout:9/870: truncate d1/d9/f38 866375 0 2024-09-13T22:09:12.887 INFO:tasks.workunit.client.1.smithi159.stdout:0/951: write d0/d48/d7d/dca/f10c [2003614,56167] 0 2024-09-13T22:09:12.889 INFO:tasks.workunit.client.1.smithi159.stdout:0/952: rename d0/d2c/f36 to d0/d48/d7d/dca/f13d 0 2024-09-13T22:09:12.895 INFO:tasks.workunit.client.1.smithi159.stdout:9/871: write d1/dc/d10/d6d/d2f/ffe [2511366,118939] 0 2024-09-13T22:09:12.895 INFO:tasks.workunit.client.1.smithi159.stdout:9/872: getdents d1/dc 0 2024-09-13T22:09:12.899 INFO:tasks.workunit.client.1.smithi159.stdout:9/873: getdents d1/dc/d10 0 2024-09-13T22:09:12.899 INFO:tasks.workunit.client.1.smithi159.stdout:9/874: readlink d1/d9/d1f/l44 0 2024-09-13T22:09:12.900 INFO:tasks.workunit.client.1.smithi159.stdout:9/875: fdatasync d1/dc/d10/d6d/d2f/d8b/d8f/f124 0 2024-09-13T22:09:12.900 INFO:tasks.workunit.client.1.smithi159.stdout:9/876: getdents d1/d9/d1f/d11f/d125 0 2024-09-13T22:09:12.900 INFO:tasks.workunit.client.1.smithi159.stdout:9/877: creat d1/d5a/f12e x:0 0 0 2024-09-13T22:09:12.900 INFO:tasks.workunit.client.1.smithi159.stdout:0/953: write d0/f10 [578090,109084] 0 2024-09-13T22:09:12.900 INFO:tasks.workunit.client.1.smithi159.stdout:0/954: fsync d0/d48/d4f/d54/f80 0 2024-09-13T22:09:12.902 INFO:tasks.workunit.client.1.smithi159.stdout:9/878: mkdir d1/dc/d27/da4/d12f 0 2024-09-13T22:09:12.909 INFO:tasks.workunit.client.1.smithi159.stdout:9/879: write d1/fe [3250729,122136] 0 2024-09-13T22:09:12.913 INFO:tasks.workunit.client.1.smithi159.stdout:9/880: write d1/d9/dab/dd7/ffa [489738,125764] 0 2024-09-13T22:09:12.913 INFO:tasks.workunit.client.1.smithi159.stdout:9/881: write d1/f53 [2581242,99233] 0 2024-09-13T22:09:12.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.912+0000 7fb0c3642640 1 -- 172.21.15.89:0/3330144660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0feaf0 msgr2=0x7fb0bc0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:12.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.912+0000 7fb0c3642640 1 --2- 172.21.15.89:0/3330144660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0feaf0 0x7fb0bc0feef0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009880 tx=0x7fb0b802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.912+0000 7fb0c3642640 1 -- 172.21.15.89:0/3330144660 shutdown_connections 2024-09-13T22:09:12.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.912+0000 7fb0c3642640 1 --2- 172.21.15.89:0/3330144660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0bc0ffcf0 0x7fb0bc100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.912+0000 7fb0c3642640 1 --2- 172.21.15.89:0/3330144660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0feaf0 0x7fb0bc0feef0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.912+0000 7fb0c3642640 1 -- 172.21.15.89:0/3330144660 >> 172.21.15.89:0/3330144660 conn(0x7fb0bc0fa280 msgr2=0x7fb0bc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.912+0000 7fb0c3642640 1 -- 172.21.15.89:0/3330144660 shutdown_connections 2024-09-13T22:09:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.912+0000 7fb0c3642640 1 -- 172.21.15.89:0/3330144660 wait complete. 2024-09-13T22:09:12.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c3642640 1 Processor -- start 2024-09-13T22:09:12.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c3642640 1 -- start start 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c3642640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0bc0feaf0 0x7fb0bc102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c3642640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0ffcf0 0x7fb0bc1010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c3642640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc101610 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c3642640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc101780 con 0x7fb0bc0feaf0 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c0bdd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0ffcf0 0x7fb0bc1010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c0bdd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0ffcf0 0x7fb0bc1010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36928/0 (socket says 172.21.15.89:36928) 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c0bdd640 1 -- 172.21.15.89:0/1616943722 learned_addr learned my addr 172.21.15.89:0/1616943722 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.913+0000 7fb0c13de640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0bc0feaf0 0x7fb0bc102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0c0bdd640 1 -- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0bc0feaf0 msgr2=0x7fb0bc102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0c0bdd640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0bc0feaf0 0x7fb0bc102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0c0bdd640 1 -- 172.21.15.89:0/1616943722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b8009560 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0c13de640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0bc0feaf0 0x7fb0bc102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:09:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0c0bdd640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0ffcf0 0x7fb0bc1010d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00e970 tx=0x7fb0ac00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0b27fc640 1 -- 172.21.15.89:0/1616943722 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0ac00cc90 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0bc101a60 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0b27fc640 1 -- 172.21.15.89:0/1616943722 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0ac00cdf0 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0b27fc640 1 -- 172.21.15.89:0/1616943722 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0ac018810 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.914+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0bc19d6c0 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.918 INFO:tasks.workunit.client.1.smithi159.stdout:9/882: unlink d1/dc/d27/d11c/cef 0 2024-09-13T22:09:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.915+0000 7fb0b27fc640 1 -- 172.21.15.89:0/1616943722 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 22) v1 ==== 46258+0+0 (secure 0 0 0) 0x7fb0ac018a80 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.915+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0bc0feef0 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.915+0000 7fb0b27fc640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fb0a8039100 0x7fb0a803b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.915+0000 7fb0b27fc640 1 -- 172.21.15.89:0/1616943722 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb0ac014070 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.916+0000 7fb0c13de640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fb0a8039100 0x7fb0a803b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:12.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.916+0000 7fb0c13de640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fb0a8039100 0x7fb0a803b5c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009230 tx=0x7fb0b80314e0 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:12.920 INFO:tasks.workunit.client.1.smithi159.stdout:9/883: symlink d1/dc/d10/d6d/d4b/dcb/d75/l130 0 2024-09-13T22:09:12.920 INFO:tasks.workunit.client.1.smithi159.stdout:9/884: write d1/dc/d10/fb9 [1594201,105415] 0 2024-09-13T22:09:12.921 INFO:tasks.workunit.client.1.smithi159.stdout:9/885: mknod d1/dc/d10/d115/c131 0 2024-09-13T22:09:12.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:12.920+0000 7fb0b27fc640 1 -- 172.21.15.89:0/1616943722 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fb0ac0152d0 con 0x7fb0bc0ffcf0 2024-09-13T22:09:12.924 INFO:tasks.workunit.client.1.smithi159.stdout:9/886: symlink d1/dc/d10/l132 0 2024-09-13T22:09:12.926 INFO:tasks.workunit.client.1.smithi159.stdout:9/887: symlink d1/dc/d10/d6d/d2f/l133 0 2024-09-13T22:09:12.926 INFO:tasks.workunit.client.1.smithi159.stdout:9/888: creat d1/dc/d10/d6d/d2f/d8b/ddd/f134 x:0 0 0 2024-09-13T22:09:12.926 INFO:tasks.workunit.client.1.smithi159.stdout:9/889: write d1/dc/d10/d6d/d4b/d98/da8/fb3 [724490,84054] 0 2024-09-13T22:09:12.928 INFO:tasks.workunit.client.1.smithi159.stdout:9/890: rmdir d1/dc/d10/d6d/d2f/d8b/d114 0 2024-09-13T22:09:12.930 INFO:tasks.workunit.client.1.smithi159.stdout:3/686: sync 2024-09-13T22:09:12.930 INFO:tasks.workunit.client.1.smithi159.stdout:7/950: sync 2024-09-13T22:09:12.930 INFO:tasks.workunit.client.1.smithi159.stdout:7/951: truncate d3/d31/fae 977842 0 2024-09-13T22:09:12.930 INFO:tasks.workunit.client.1.smithi159.stdout:9/891: creat d1/dc/d10/d6d/d4b/d98/d120/f135 x:0 0 0 2024-09-13T22:09:12.967 INFO:tasks.workunit.client.1.smithi159.stdout:3/687: symlink d0/db0/ld9 0 2024-09-13T22:09:12.968 INFO:tasks.workunit.client.1.smithi159.stdout:7/952: mkdir d3/d2e/d6e/d74/d147 0 2024-09-13T22:09:12.969 INFO:tasks.workunit.client.1.smithi159.stdout:9/892: truncate d1/dc/d27/d11c/f70 905922 0 2024-09-13T22:09:12.970 INFO:tasks.workunit.client.1.smithi159.stdout:3/688: rmdir d0/d1/d3/d5/db 39 2024-09-13T22:09:12.970 INFO:tasks.workunit.client.1.smithi159.stdout:3/689: fdatasync d0/d78/fd5 0 2024-09-13T22:09:12.972 INFO:tasks.workunit.client.1.smithi159.stdout:7/953: unlink d3/d3f/fb1 0 2024-09-13T22:09:12.972 INFO:tasks.workunit.client.1.smithi159.stdout:7/954: chown d3/d31/d4d/d9e/c112 4012066 1 2024-09-13T22:09:12.976 INFO:tasks.workunit.client.1.smithi159.stdout:9/893: creat d1/dc/d10/d9c/f136 x:0 0 0 2024-09-13T22:09:12.980 INFO:tasks.workunit.client.1.smithi159.stdout:3/690: unlink d0/d1/d3/d5/d25/d75/d5b/d45/c95 0 2024-09-13T22:09:12.985 INFO:tasks.workunit.client.1.smithi159.stdout:9/894: rename d1/dc/d10/d6d/d4b/d98/da8/cf2 to d1/dc/c137 0 2024-09-13T22:09:12.988 INFO:tasks.workunit.client.1.smithi159.stdout:7/955: dwrite d3/f62 [0,4194304] 0 2024-09-13T22:09:12.989 INFO:tasks.workunit.client.1.smithi159.stdout:9/895: symlink d1/dc/ded/l138 0 2024-09-13T22:09:12.991 INFO:tasks.workunit.client.1.smithi159.stdout:3/691: link d0/d1/d3/dd/c69 d0/d68/cda 0 2024-09-13T22:09:12.999 INFO:tasks.workunit.client.1.smithi159.stdout:3/692: dread d0/d1/d3/d5/f88 [0,4194304] 0 2024-09-13T22:09:13.001 INFO:tasks.workunit.client.1.smithi159.stdout:7/956: dread d3/d31/d4d/d4e/d7a/f9b [0,4194304] 0 2024-09-13T22:09:13.002 INFO:tasks.workunit.client.1.smithi159.stdout:7/957: creat d3/d2e/d6e/f148 x:0 0 0 2024-09-13T22:09:13.002 INFO:tasks.workunit.client.1.smithi159.stdout:7/958: chown d3/d31/d4d/d9e/f8b 243 1 2024-09-13T22:09:13.005 INFO:tasks.workunit.client.1.smithi159.stdout:3/693: link d0/d1/d34/f40 d0/d1/d3/d5/d25/d4e/d5a/d9b/fdb 0 2024-09-13T22:09:13.009 INFO:tasks.workunit.client.1.smithi159.stdout:7/959: link d3/d31/d4d/f8e d3/d2e/db6/d6c/f149 0 2024-09-13T22:09:13.009 INFO:tasks.workunit.client.1.smithi159.stdout:7/960: chown d3/d2e/db6/d6c/db2 0 1 2024-09-13T22:09:13.013 INFO:tasks.workunit.client.1.smithi159.stdout:9/896: dwrite d1/dc/d10/d69/f90 [0,4194304] 0 2024-09-13T22:09:13.013 INFO:tasks.workunit.client.1.smithi159.stdout:9/897: creat d1/dc/d27/da4/db5/f139 x:0 0 0 2024-09-13T22:09:13.015 INFO:tasks.workunit.client.1.smithi159.stdout:7/961: rename d3/d31/d4d/d4e/d7a/fcf to d3/d31/d4d/d9e/dfb/dff/d125/f14a 0 2024-09-13T22:09:13.017 INFO:tasks.workunit.client.1.smithi159.stdout:3/694: getdents d0/d1/d3/d5/d25/d4e/d92 0 2024-09-13T22:09:13.025 INFO:tasks.workunit.client.1.smithi159.stdout:9/898: write d1/dc/f5f [2318156,75647] 0 2024-09-13T22:09:13.025 INFO:tasks.workunit.client.1.smithi159.stdout:9/899: dread - d1/dc/d10/d6d/d2f/d8b/da1/f11d zero size 2024-09-13T22:09:13.027 INFO:tasks.workunit.client.1.smithi159.stdout:9/900: mknod d1/dc/d10/d6d/d4b/dcb/d74/c13a 0 2024-09-13T22:09:13.027 INFO:tasks.workunit.client.1.smithi159.stdout:9/901: chown d1/dc/d10/d6d/d2f/l71 1477541 1 2024-09-13T22:09:13.027 INFO:tasks.workunit.client.1.smithi159.stdout:9/902: chown d1/dc/d10/f3b 4 1 2024-09-13T22:09:13.028 INFO:tasks.workunit.client.1.smithi159.stdout:9/903: mknod d1/dc/c13b 0 2024-09-13T22:09:13.037 INFO:tasks.workunit.client.1.smithi159.stdout:7/962: dwrite d3/d18/f1d [0,4194304] 0 2024-09-13T22:09:13.040 INFO:tasks.workunit.client.1.smithi159.stdout:3/695: write d0/d1/d3/d5/db/d39/f52 [3224069,65187] 0 2024-09-13T22:09:13.042 INFO:tasks.workunit.client.1.smithi159.stdout:7/963: dread d3/d31/f66 [0,4194304] 0 2024-09-13T22:09:13.042 INFO:tasks.workunit.client.1.smithi159.stdout:3/696: link d0/d1/d3/la1 d0/d1/d34/ldc 0 2024-09-13T22:09:13.045 INFO:tasks.workunit.client.1.smithi159.stdout:3/697: link d0/d1/d3/d5/d25/d75/fab d0/d1/d3/d5/db/d58/fdd 0 2024-09-13T22:09:13.045 INFO:tasks.workunit.client.1.smithi159.stdout:3/698: chown d0/c28 1 1 2024-09-13T22:09:13.046 INFO:tasks.workunit.client.1.smithi159.stdout:3/699: dread d0/d1/d3/f82 [0,4194304] 0 2024-09-13T22:09:13.047 INFO:tasks.workunit.client.1.smithi159.stdout:3/700: dread d0/d1/d3/f82 [0,4194304] 0 2024-09-13T22:09:13.047 INFO:tasks.workunit.client.1.smithi159.stdout:3/701: chown d0/d1/d3/d5/db/d39/f6a 21 1 2024-09-13T22:09:13.047 INFO:tasks.workunit.client.1.smithi159.stdout:3/702: stat d0/d1/d3/d5/db/d39 0 2024-09-13T22:09:13.048 INFO:tasks.workunit.client.1.smithi159.stdout:3/703: write d0/d1/d3/d5/db/d39/fba [653837,83450] 0 2024-09-13T22:09:13.048 INFO:tasks.workunit.client.1.smithi159.stdout:3/704: creat d0/d1/d3/d5/d25/fde x:0 0 0 2024-09-13T22:09:13.058 INFO:tasks.workunit.client.1.smithi159.stdout:7/964: dwrite d3/d31/d4d/d4e/fe5 [0,4194304] 0 2024-09-13T22:09:13.063 INFO:tasks.workunit.client.1.smithi159.stdout:3/705: creat d0/d1/d3/d5/d25/d75/d5b/fdf x:0 0 0 2024-09-13T22:09:13.063 INFO:tasks.workunit.client.1.smithi159.stdout:3/706: creat d0/d1/d3/dd/fe0 x:0 0 0 2024-09-13T22:09:13.063 INFO:tasks.workunit.client.1.smithi159.stdout:3/707: fsync d0/d1/d3/d5/db/dc6/fd2 0 2024-09-13T22:09:13.069 INFO:tasks.workunit.client.1.smithi159.stdout:3/708: symlink d0/d78/le1 0 2024-09-13T22:09:13.074 INFO:tasks.workunit.client.1.smithi159.stdout:7/965: dwrite d3/f2a [8388608,4194304] 0 2024-09-13T22:09:13.075 INFO:tasks.workunit.client.1.smithi159.stdout:7/966: truncate d3/d2e/db6/d6c/db2/dce/ff5 1196151 0 2024-09-13T22:09:13.075 INFO:tasks.workunit.client.1.smithi159.stdout:7/967: write d3/d3f/fa1 [5442126,27461] 0 2024-09-13T22:09:13.078 INFO:tasks.workunit.client.1.smithi159.stdout:7/968: dread d3/d31/d4d/d9e/dfb/fdd [0,4194304] 0 2024-09-13T22:09:13.078 INFO:tasks.workunit.client.1.smithi159.stdout:7/969: dread - d3/d2e/d6e/d74/f11e zero size 2024-09-13T22:09:13.078 INFO:tasks.workunit.client.1.smithi159.stdout:7/970: chown d3/d31/d4d/d9e/f8b 6 1 2024-09-13T22:09:13.078 INFO:tasks.workunit.client.1.smithi159.stdout:7/971: write d3/ff8 [1082372,8233] 0 2024-09-13T22:09:13.078 INFO:tasks.workunit.client.1.smithi159.stdout:7/972: creat d3/d31/d4d/d9e/dfb/dff/f14b x:0 0 0 2024-09-13T22:09:13.078 INFO:tasks.workunit.client.1.smithi159.stdout:7/973: chown d3/d2e/db6/d6c/l9d 0 1 2024-09-13T22:09:13.079 INFO:tasks.workunit.client.1.smithi159.stdout:3/709: dread d0/d1/d3/d5/f55 [0,4194304] 0 2024-09-13T22:09:13.080 INFO:tasks.workunit.client.1.smithi159.stdout:3/710: readlink d0/d1/d3/dd/l66 0 2024-09-13T22:09:13.084 INFO:tasks.workunit.client.1.smithi159.stdout:3/711: rmdir d0/d1/d3/d5/d25/d75/d5b/d45 39 2024-09-13T22:09:13.085 INFO:tasks.workunit.client.1.smithi159.stdout:3/712: truncate d0/d1/d3/d5/d25/d2c/d65/f72 1745053 0 2024-09-13T22:09:13.087 INFO:tasks.workunit.client.1.smithi159.stdout:3/713: getdents d0/d1/d3/d5/d25/d2c 0 2024-09-13T22:09:13.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/974: dwrite d3/d18/f20 [0,4194304] 0 2024-09-13T22:09:13.098 INFO:tasks.workunit.client.1.smithi159.stdout:7/975: truncate d3/d2e/d6e/d74/f85 5245647 0 2024-09-13T22:09:13.106 INFO:tasks.workunit.client.1.smithi159.stdout:7/976: write d3/d18/f7c [3339905,39050] 0 2024-09-13T22:09:13.115 INFO:tasks.workunit.client.1.smithi159.stdout:7/977: dread d3/d31/fd1 [4194304,4194304] 0 2024-09-13T22:09:13.129 INFO:tasks.workunit.client.1.smithi159.stdout:7/978: dwrite d3/d2e/db6/f58 [4194304,4194304] 0 2024-09-13T22:09:13.130 INFO:tasks.workunit.client.1.smithi159.stdout:7/979: rename d3/d31/d4d/d9e/dfb/dff/d129 to d3/d31/d4d/d9e/dec/d144/d14c 0 2024-09-13T22:09:13.131 INFO:tasks.workunit.client.1.smithi159.stdout:7/980: rmdir d3/d31/d4d/d9e/dfb/dff/d125 39 2024-09-13T22:09:13.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.148+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 --> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0bc0fc430 con 0x7fb0a8039100 2024-09-13T22:09:13.153 INFO:tasks.workunit.client.1.smithi159.stdout:7/981: dwrite d3/d2e/db6/f92 [0,4194304] 0 2024-09-13T22:09:13.162 INFO:tasks.workunit.client.1.smithi159.stdout:7/982: creat d3/d3f/f14d x:0 0 0 2024-09-13T22:09:13.162 INFO:tasks.workunit.client.1.smithi159.stdout:7/983: fsync d3/d2e/d6e/f100 0 2024-09-13T22:09:13.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.160+0000 7fb0b27fc640 1 -- 172.21.15.89:0/1616943722 <== mgr.24319 v2:172.21.15.159:6828/1500548398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb0bc0fc430 con 0x7fb0a8039100 2024-09-13T22:09:13.163 INFO:tasks.workunit.client.1.smithi159.stdout:7/984: mkdir d3/d31/d4d/d9e/d14e 0 2024-09-13T22:09:13.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fb0a8039100 msgr2=0x7fb0a803b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fb0a8039100 0x7fb0a803b5c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009230 tx=0x7fb0b80314e0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0ffcf0 msgr2=0x7fb0bc1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0ffcf0 0x7fb0bc1010d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00e970 tx=0x7fb0ac00ee30 comp rx=0 tx=0).stop 2024-09-13T22:09:13.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 shutdown_connections 2024-09-13T22:09:13.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0bc0ffcf0 0x7fb0bc1010d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fb0a8039100 0x7fb0a803b5c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 --2- 172.21.15.89:0/1616943722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0bc0feaf0 0x7fb0bc102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 >> 172.21.15.89:0/1616943722 conn(0x7fb0bc0fa280 msgr2=0x7fb0bc0fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:13.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 shutdown_connections 2024-09-13T22:09:13.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.163+0000 7fb0c3642640 1 -- 172.21.15.89:0/1616943722 wait complete. 2024-09-13T22:09:13.174 INFO:tasks.workunit.client.1.smithi159.stdout:0/955: sync 2024-09-13T22:09:13.174 INFO:tasks.workunit.client.1.smithi159.stdout:2/855: sync 2024-09-13T22:09:13.174 INFO:tasks.workunit.client.1.smithi159.stdout:2/856: chown f5 4622987 1 2024-09-13T22:09:13.174 INFO:tasks.workunit.client.1.smithi159.stdout:2/857: fsync d9/d65/dca/f10a 0 2024-09-13T22:09:13.181 INFO:tasks.workunit.client.1.smithi159.stdout:2/858: rmdir d9/da/d82/d89/dd6 39 2024-09-13T22:09:13.184 INFO:tasks.workunit.client.1.smithi159.stdout:2/859: read d9/da/f103 [10784,130459] 0 2024-09-13T22:09:13.195 INFO:tasks.workunit.client.1.smithi159.stdout:2/860: write d9/d65/f60 [2586197,73431] 0 2024-09-13T22:09:13.196 INFO:tasks.workunit.client.1.smithi159.stdout:2/861: chown d9/d44/deb/dee/d77/da6 10788915 1 2024-09-13T22:09:13.210 INFO:tasks.workunit.client.1.smithi159.stdout:2/862: write d9/d92/f95 [795012,6519] 0 2024-09-13T22:09:13.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.275+0000 7f573fe26640 1 -- 172.21.15.89:0/324237325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738100680 msgr2=0x7f5738102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.275+0000 7f573fe26640 1 --2- 172.21.15.89:0/324237325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738100680 0x7f5738102a70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f57340098b0 tx=0x7f573402a4d0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.275+0000 7f573fe26640 1 -- 172.21.15.89:0/324237325 shutdown_connections 2024-09-13T22:09:13.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.275+0000 7f573fe26640 1 --2- 172.21.15.89:0/324237325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5738102fb0 0x7f57381053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.275+0000 7f573fe26640 1 --2- 172.21.15.89:0/324237325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738100680 0x7f5738102a70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.275+0000 7f573fe26640 1 -- 172.21.15.89:0/324237325 >> 172.21.15.89:0/324237325 conn(0x7f57380fa280 msgr2=0x7f57380fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:13.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.275+0000 7f573fe26640 1 -- 172.21.15.89:0/324237325 shutdown_connections 2024-09-13T22:09:13.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.275+0000 7f573fe26640 1 -- 172.21.15.89:0/324237325 wait complete. 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573fe26640 1 Processor -- start 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573fe26640 1 -- start start 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573fe26640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5738100680 0x7f57380fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573fe26640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738102fb0 0x7f57380fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573fe26640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57380feb70 con 0x7f5738102fb0 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573fe26640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57380fece0 con 0x7f5738100680 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573d3c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738102fb0 0x7f57380fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573d3c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738102fb0 0x7f57380fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36952/0 (socket says 172.21.15.89:36952) 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573d3c1640 1 -- 172.21.15.89:0/1816354967 learned_addr learned my addr 172.21.15.89:0/1816354967 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.276+0000 7f573dbc2640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5738100680 0x7f57380fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f573d3c1640 1 -- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5738100680 msgr2=0x7f57380fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f573d3c1640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5738100680 0x7f57380fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f573d3c1640 1 -- 172.21.15.89:0/1816354967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5734009560 con 0x7f5738102fb0 2024-09-13T22:09:13.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f573dbc2640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5738100680 0x7f57380fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:09:13.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f573d3c1640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738102fb0 0x7f57380fe630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f572800e940 tx=0x7f572800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:13.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f572effd640 1 -- 172.21.15.89:0/1816354967 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5728009700 con 0x7f5738102fb0 2024-09-13T22:09:13.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f572effd640 1 -- 172.21.15.89:0/1816354967 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57280054e0 con 0x7f5738102fb0 2024-09-13T22:09:13.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57380fefc0 con 0x7f5738102fb0 2024-09-13T22:09:13.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f572effd640 1 -- 172.21.15.89:0/1816354967 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5728010430 con 0x7f5738102fb0 2024-09-13T22:09:13.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.277+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573819d750 con 0x7f5738102fb0 2024-09-13T22:09:13.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.278+0000 7f572effd640 1 -- 172.21.15.89:0/1816354967 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 22) v1 ==== 46258+0+0 (secure 0 0 0) 0x7f5728010590 con 0x7f5738102fb0 2024-09-13T22:09:13.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.278+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5738100a60 con 0x7f5738102fb0 2024-09-13T22:09:13.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.278+0000 7f572effd640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f5724039100 0x7f572403b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:13.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.278+0000 7f572effd640 1 -- 172.21.15.89:0/1816354967 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5728014070 con 0x7f5738102fb0 2024-09-13T22:09:13.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.279+0000 7f573dbc2640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f5724039100 0x7f572403b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:13.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.279+0000 7f573dbc2640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f5724039100 0x7f572403b5c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5734006010 tx=0x7f57340314e0 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:13.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.284+0000 7f572effd640 1 -- 172.21.15.89:0/1816354967 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f5728016330 con 0x7f5738102fb0 2024-09-13T22:09:13.307 INFO:tasks.workunit.client.1.smithi159.stdout:9/904: sync 2024-09-13T22:09:13.307 INFO:tasks.workunit.client.1.smithi159.stdout:9/905: chown d1/dc/ded/f129 54 1 2024-09-13T22:09:13.309 INFO:tasks.workunit.client.1.smithi159.stdout:9/906: unlink d1/dc/d10/d6d/d2f/fb7 0 2024-09-13T22:09:13.309 INFO:tasks.workunit.client.1.smithi159.stdout:9/907: readlink d1/dc/d27/l36 0 2024-09-13T22:09:13.309 INFO:tasks.workunit.client.1.smithi159.stdout:9/908: read - d1/dc/d27/fc4 zero size 2024-09-13T22:09:13.309 INFO:tasks.workunit.client.1.smithi159.stdout:9/909: chown d1/dc/d27/d11c/fe4 88733 1 2024-09-13T22:09:13.312 INFO:tasks.workunit.client.1.smithi159.stdout:9/910: dread d1/d9/ff [4194304,4194304] 0 2024-09-13T22:09:13.320 INFO:tasks.workunit.client.1.smithi159.stdout:9/911: dread d1/d9/d1f/d99/f9d [4194304,4194304] 0 2024-09-13T22:09:13.320 INFO:tasks.workunit.client.1.smithi159.stdout:9/912: fsync d1/d9/dab/dd7/ffa 0 2024-09-13T22:09:13.320 INFO:tasks.workunit.client.1.smithi159.stdout:9/913: readlink d1/d9/l1e 0 2024-09-13T22:09:13.357 INFO:tasks.workunit.client.1.smithi159.stdout:9/914: dwrite d1/d9/f38 [0,4194304] 0 2024-09-13T22:09:13.360 INFO:tasks.workunit.client.1.smithi159.stdout:9/915: symlink d1/dc/d10/d6d/d4b/dcb/d74/de3/l13c 0 2024-09-13T22:09:13.360 INFO:tasks.workunit.client.1.smithi159.stdout:9/916: dread - d1/dc/d10/d6d/d4b/dcb/d74/de3/f10b zero size 2024-09-13T22:09:13.363 INFO:tasks.workunit.client.1.smithi159.stdout:9/917: rename d1/d9/dab/dd7/ff8 to d1/dc/d10/d6d/d2f/d8b/f13d 0 2024-09-13T22:09:13.367 INFO:tasks.workunit.client.1.smithi159.stdout:9/918: rmdir d1/d5a 39 2024-09-13T22:09:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.368+0000 7f572effd640 1 -- 172.21.15.89:0/1816354967 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 23) v1 ==== 46554+0+0 (secure 0 0 0) 0x7f572800cc90 con 0x7f5738102fb0 2024-09-13T22:09:13.372 INFO:tasks.workunit.client.1.smithi159.stdout:9/919: mkdir d1/dc/d10/d6d/d2f/d8b/d8f/d13e 0 2024-09-13T22:09:13.372 INFO:tasks.workunit.client.1.smithi159.stdout:9/920: chown d1/dc/ded/l138 0 1 2024-09-13T22:09:13.375 INFO:tasks.workunit.client.1.smithi159.stdout:9/921: symlink d1/dc/d10/d6d/d4b/dcb/d74/de3/l13f 0 2024-09-13T22:09:13.393 INFO:tasks.workunit.client.1.smithi159.stdout:9/922: dwrite d1/dc/d27/fc4 [0,4194304] 0 2024-09-13T22:09:13.394 INFO:tasks.workunit.client.1.smithi159.stdout:9/923: truncate d1/dc/d10/fe8 1831787 0 2024-09-13T22:09:13.399 INFO:tasks.workunit.client.1.smithi159.stdout:9/924: rename d1/dc/d10/c8c to d1/dc/d27/da4/d12f/c140 0 2024-09-13T22:09:13.399 INFO:tasks.workunit.client.1.smithi159.stdout:9/925: fsync d1/dc/d10/d6d/fac 0 2024-09-13T22:09:13.401 INFO:tasks.workunit.client.1.smithi159.stdout:9/926: write d1/dc/d10/d6d/d2f/d8b/f97 [176821,121487] 0 2024-09-13T22:09:13.405 INFO:tasks.workunit.client.1.smithi159.stdout:9/927: symlink d1/dc/d27/l141 0 2024-09-13T22:09:13.423 INFO:tasks.workunit.client.1.smithi159.stdout:9/928: dwrite d1/dc/d10/d6d/d4b/dcb/d74/de3/f10b [0,4194304] 0 2024-09-13T22:09:13.438 INFO:tasks.workunit.client.1.smithi159.stdout:9/929: dwrite d1/f48 [0,4194304] 0 2024-09-13T22:09:13.450 INFO:tasks.workunit.client.1.smithi159.stdout:9/930: dread d1/f7b [0,4194304] 0 2024-09-13T22:09:13.454 INFO:tasks.workunit.client.1.smithi159.stdout:9/931: dread d1/dc/d27/d11c/f70 [0,4194304] 0 2024-09-13T22:09:13.454 INFO:tasks.workunit.client.1.smithi159.stdout:9/932: chown d1/dc/d10/d6d/d4b/dcb/d74/ddc/c10c 3533 1 2024-09-13T22:09:13.454 INFO:tasks.workunit.client.1.smithi159.stdout:9/933: chown d1/dc/d10/d6d/d2f/f37 205347417 1 2024-09-13T22:09:13.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:13 smithi089 ceph-mon[27921]: Deploying cephadm binary to smithi089 2024-09-13T22:09:13.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:13 smithi089 ceph-mon[27921]: mgrmap e22: smithi159.ghpomd(active, since 1.18612s) 2024-09-13T22:09:13.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:13 smithi089 ceph-mon[27921]: pgmap v3: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T22:09:13.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:13 smithi089 ceph-mon[27921]: Deploying cephadm binary to smithi159 2024-09-13T22:09:13.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:13 smithi089 ceph-mon[27921]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:13.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:13 smithi089 ceph-mon[27921]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:13.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:13 smithi089 ceph-mon[27921]: pgmap v4: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T22:09:13.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.513+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 --> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f57381039d0 con 0x7f5724039100 2024-09-13T22:09:13.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.538+0000 7f572effd640 1 -- 172.21.15.89:0/1816354967 <== mgr.24319 v2:172.21.15.159:6828/1500548398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f57381039d0 con 0x7f5724039100 2024-09-13T22:09:13.540 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:09:13.540 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (6m) 2m ago 8m 25.0M - 0.25.0 c8568f914cd2 6ef74b73ca3e 2024-09-13T22:09:13.540 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (8m) 2m ago 8m 7528k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (7m) 22s ago 7m 7654k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (8m) 2m ago 8m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (7m) 22s ago 7m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (6m) 2m ago 8m 88.2M - 9.4.7 954c08fa6188 59724cff87bd 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (2m) 2m ago 2m 13.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (2m) 2m ago 2m 11.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (2m) 22s ago 2m 180M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (2m) 22s ago 2m 14.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:9283,8765,8443 running (9m) 2m ago 9m 487M - 18.2.4-845-ge4e227b3 67ddd33fa72f deeaa986e2d7 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (50s) 22s ago 7m 122M - 19.1.1-324-gecab7be5 0652ff2b5d78 105fec331cd0 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (9m) 2m ago 9m 47.7M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (7m) 22s ago 7m 37.4M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (8m) 2m ago 8m 15.9M - 1.5.0 0da6a335fe13 eeaf1dd44f97 2024-09-13T22:09:13.541 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (7m) 22s ago 7m 15.7M - 1.5.0 0da6a335fe13 c76544fc91f3 2024-09-13T22:09:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (6m) 2m ago 6m 55.6M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:09:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (6m) 2m ago 6m 50.2M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:09:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (5m) 2m ago 5m 55.9M 3946M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:09:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (5m) 22s ago 5m 120M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:09:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (4m) 22s ago 4m 122M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:09:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (4m) 22s ago 4m 107M 4970M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:09:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (6m) 2m ago 7m 58.3M - 2.43.0 a07b618ecd1d 4bb2a482e0e5 2024-09-13T22:09:13.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f5724039100 msgr2=0x7f572403b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f5724039100 0x7f572403b5c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5734006010 tx=0x7f57340314e0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738102fb0 msgr2=0x7f57380fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738102fb0 0x7f57380fe630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f572800e940 tx=0x7f572800ee00 comp rx=0 tx=0).stop 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 shutdown_connections 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5738102fb0 0x7f57380fe630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f5724039100 0x7f572403b5c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 --2- 172.21.15.89:0/1816354967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5738100680 0x7f57380fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 >> 172.21.15.89:0/1816354967 conn(0x7f57380fa280 msgr2=0x7f57380fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 shutdown_connections 2024-09-13T22:09:13.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.542+0000 7f573fe26640 1 -- 172.21.15.89:0/1816354967 wait complete. 2024-09-13T22:09:13.558 INFO:tasks.workunit.client.1.smithi159.stdout:9/934: symlink d1/d9/d1f/d99/l142 0 2024-09-13T22:09:13.584 INFO:tasks.workunit.client.1.smithi159.stdout:9/935: symlink d1/dc/d27/da4/d12f/l143 0 2024-09-13T22:09:13.617 INFO:tasks.workunit.client.1.smithi159.stdout:2/863: sync 2024-09-13T22:09:13.617 INFO:tasks.workunit.client.1.smithi159.stdout:7/985: sync 2024-09-13T22:09:13.617 INFO:tasks.workunit.client.1.smithi159.stdout:3/714: sync 2024-09-13T22:09:13.617 INFO:tasks.workunit.client.1.smithi159.stdout:0/956: sync 2024-09-13T22:09:13.619 INFO:tasks.workunit.client.1.smithi159.stdout:2/864: dread d9/da/d5a/ddf/ff4 [0,4194304] 0 2024-09-13T22:09:13.620 INFO:tasks.workunit.client.1.smithi159.stdout:2/865: chown d9/d92/fcc 366478176 1 2024-09-13T22:09:13.620 INFO:tasks.workunit.client.1.smithi159.stdout:2/866: dread - d9/d44/deb/dee/d77/da6/db0/f106 zero size 2024-09-13T22:09:13.620 INFO:tasks.workunit.client.1.smithi159.stdout:2/867: write d9/d65/d8d/de2/d69/d66/f10e [841337,61879] 0 2024-09-13T22:09:13.620 INFO:tasks.workunit.client.1.smithi159.stdout:7/986: creat d3/f14f x:0 0 0 2024-09-13T22:09:13.623 INFO:tasks.workunit.client.1.smithi159.stdout:3/715: rename d0/d1/d3/d5/db/dc6/fcf to d0/d1/d3/d5/d25/d4e/fe2 0 2024-09-13T22:09:13.624 INFO:tasks.workunit.client.1.smithi159.stdout:2/868: getdents d9/d2d 0 2024-09-13T22:09:13.625 INFO:tasks.workunit.client.1.smithi159.stdout:0/957: dread d0/d5e/f1a [0,4194304] 0 2024-09-13T22:09:13.625 INFO:tasks.workunit.client.1.smithi159.stdout:0/958: chown d0/d48/dd9/de8/cf3 26 1 2024-09-13T22:09:13.625 INFO:tasks.workunit.client.1.smithi159.stdout:0/959: getdents d0/d2c/d10d/d13c 0 2024-09-13T22:09:13.625 INFO:tasks.workunit.client.1.smithi159.stdout:0/960: read - d0/d2c/d71/dc3/f106 zero size 2024-09-13T22:09:13.628 INFO:tasks.workunit.client.1.smithi159.stdout:7/987: mkdir d3/d31/d4d/d9e/d14e/d150 0 2024-09-13T22:09:13.629 INFO:tasks.workunit.client.1.smithi159.stdout:3/716: mknod d0/d1/d81/ce3 0 2024-09-13T22:09:13.631 INFO:tasks.workunit.client.1.smithi159.stdout:2/869: readlink d9/d65/d8d/de2/df0/lf8 0 2024-09-13T22:09:13.631 INFO:tasks.workunit.client.1.smithi159.stdout:2/870: fdatasync d9/d44/deb/dee/f7c 0 2024-09-13T22:09:13.634 INFO:tasks.workunit.client.1.smithi159.stdout:3/717: symlink d0/d1/d34/le4 0 2024-09-13T22:09:13.637 INFO:tasks.workunit.client.1.smithi159.stdout:2/871: link f5 d9/d65/d8d/de2/d69/def/f133 0 2024-09-13T22:09:13.637 INFO:tasks.workunit.client.1.smithi159.stdout:2/872: truncate d9/d92/fcc 296586 0 2024-09-13T22:09:13.639 INFO:tasks.workunit.client.1.smithi159.stdout:7/988: dread d3/d31/d4d/d4e/fe5 [0,4194304] 0 2024-09-13T22:09:13.639 INFO:tasks.workunit.client.1.smithi159.stdout:7/989: write d3/d31/d4d/d4e/d7a/f123 [160214,2325] 0 2024-09-13T22:09:13.642 INFO:tasks.workunit.client.1.smithi159.stdout:7/990: symlink d3/d31/d4d/d9e/dec/d144/l151 0 2024-09-13T22:09:13.642 INFO:tasks.workunit.client.1.smithi159.stdout:7/991: chown d3/d18/cf1 782333661 1 2024-09-13T22:09:13.642 INFO:tasks.workunit.client.1.smithi159.stdout:7/992: chown d3/d2e/db6/d6c/db2/dce/ff5 1055475310 1 2024-09-13T22:09:13.644 INFO:tasks.workunit.client.1.smithi159.stdout:7/993: mknod d3/d31/d4d/d9e/dec/d144/d14c/c152 0 2024-09-13T22:09:13.646 INFO:tasks.workunit.client.1.smithi159.stdout:7/994: truncate d3/d2e/d6e/d74/fca 1657571 0 2024-09-13T22:09:13.647 INFO:tasks.workunit.client.1.smithi159.stdout:0/961: dwrite d0/d48/d7d/fa0 [0,4194304] 0 2024-09-13T22:09:13.647 INFO:tasks.workunit.client.1.smithi159.stdout:0/962: chown d0/d48 28 1 2024-09-13T22:09:13.647 INFO:tasks.workunit.client.1.smithi159.stdout:0/963: chown d0/d5e/d91/fb1 540459936 1 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.647+0000 7f6caf6d8640 1 -- 172.21.15.89:0/2502191978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 msgr2=0x7f6ca8101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.647+0000 7f6caf6d8640 1 --2- 172.21.15.89:0/2502191978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 0x7f6ca8101230 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009880 tx=0x7f6ca402a4b0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.647+0000 7f6caf6d8640 1 -- 172.21.15.89:0/2502191978 shutdown_connections 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.647+0000 7f6caf6d8640 1 --2- 172.21.15.89:0/2502191978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 0x7f6ca8101230 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.647+0000 7f6caf6d8640 1 --2- 172.21.15.89:0/2502191978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca80ffbb0 0x7f6ca80fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.647+0000 7f6caf6d8640 1 -- 172.21.15.89:0/2502191978 >> 172.21.15.89:0/2502191978 conn(0x7f6ca80fb360 msgr2=0x7f6ca80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.647+0000 7f6caf6d8640 1 -- 172.21.15.89:0/2502191978 shutdown_connections 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.647+0000 7f6caf6d8640 1 -- 172.21.15.89:0/2502191978 wait complete. 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.647+0000 7f6caf6d8640 1 Processor -- start 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6caf6d8640 1 -- start start 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6caf6d8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca80ffbb0 0x7f6ca8071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6caf6d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 0x7f6ca8071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:13.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6caf6d8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8072020 con 0x7f6ca8100db0 2024-09-13T22:09:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6caf6d8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8072190 con 0x7f6ca80ffbb0 2024-09-13T22:09:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6cacc73640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 0x7f6ca8071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6cacc73640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 0x7f6ca8071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37324/0 (socket says 172.21.15.89:37324) 2024-09-13T22:09:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6cacc73640 1 -- 172.21.15.89:0/374659169 learned_addr learned my addr 172.21.15.89:0/374659169 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6cad474640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca80ffbb0 0x7f6ca8071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6cacc73640 1 -- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca80ffbb0 msgr2=0x7f6ca8071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6cacc73640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca80ffbb0 0x7f6ca8071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.648+0000 7f6cacc73640 1 -- 172.21.15.89:0/374659169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca4009560 con 0x7f6ca8100db0 2024-09-13T22:09:13.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.649+0000 7f6cacc73640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 0x7f6ca8071a50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4031540 tx=0x7f6ca40055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:13.653 INFO:tasks.workunit.client.1.smithi159.stdout:9/936: rmdir d1 39 2024-09-13T22:09:13.654 INFO:tasks.workunit.client.1.smithi159.stdout:3/718: write d0/d1/d34/fb3 [324032,65508] 0 2024-09-13T22:09:13.654 INFO:tasks.workunit.client.1.smithi159.stdout:3/719: creat d0/d78/fe5 x:0 0 0 2024-09-13T22:09:13.654 INFO:tasks.workunit.client.1.smithi159.stdout:7/995: symlink d3/d31/d4d/d9e/dfb/dff/d125/d131/l153 0 2024-09-13T22:09:13.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.649+0000 7f6c9e7fc640 1 -- 172.21.15.89:0/374659169 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ca4004aa0 con 0x7f6ca8100db0 2024-09-13T22:09:13.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.649+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca8072be0 con 0x7f6ca8100db0 2024-09-13T22:09:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.649+0000 7f6c9e7fc640 1 -- 172.21.15.89:0/374659169 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ca4004c00 con 0x7f6ca8100db0 2024-09-13T22:09:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.649+0000 7f6c9e7fc640 1 -- 172.21.15.89:0/374659169 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ca4003a70 con 0x7f6ca8100db0 2024-09-13T22:09:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.649+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca8073090 con 0x7f6ca8100db0 2024-09-13T22:09:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.650+0000 7f6c9e7fc640 1 -- 172.21.15.89:0/374659169 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 23) v1 ==== 46554+0+0 (secure 0 0 0) 0x7f6ca4003bd0 con 0x7f6ca8100db0 2024-09-13T22:09:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.650+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca80744e0 con 0x7f6ca8100db0 2024-09-13T22:09:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.651+0000 7f6c9e7fc640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f6c940394e0 0x7f6c9403b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.651+0000 7f6c9e7fc640 1 -- 172.21.15.89:0/374659169 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6ca406ec10 con 0x7f6ca8100db0 2024-09-13T22:09:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.651+0000 7f6cad474640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f6c940394e0 0x7f6c9403b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.652+0000 7f6cad474640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f6c940394e0 0x7f6c9403b9a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8100c10 tx=0x7f6c98005f90 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:13.656 INFO:tasks.workunit.client.1.smithi159.stdout:0/964: truncate d0/d5e/f14 2593096 0 2024-09-13T22:09:13.659 INFO:tasks.workunit.client.1.smithi159.stdout:3/720: dread d0/d68/f7b [0,4194304] 0 2024-09-13T22:09:13.659 INFO:tasks.workunit.client.1.smithi159.stdout:9/937: dread d1/dc/d27/da4/db5/fc5 [0,4194304] 0 2024-09-13T22:09:13.659 INFO:tasks.workunit.client.1.smithi159.stdout:7/996: truncate d3/d2e/f82 4131579 0 2024-09-13T22:09:13.660 INFO:tasks.workunit.client.1.smithi159.stdout:3/721: write d0/d1/d3/d5/d25/d4e/d5a/d9b/fd3 [286429,45621] 0 2024-09-13T22:09:13.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.660+0000 7f6c9e7fc640 1 -- 172.21.15.89:0/374659169 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f6ca4043360 con 0x7f6ca8100db0 2024-09-13T22:09:13.662 INFO:tasks.workunit.client.1.smithi159.stdout:0/965: symlink d0/d48/d4f/daf/dd4/dff/l13e 0 2024-09-13T22:09:13.665 INFO:tasks.workunit.client.1.smithi159.stdout:9/938: creat d1/dc/d10/d69/f144 x:0 0 0 2024-09-13T22:09:13.666 INFO:tasks.workunit.client.1.smithi159.stdout:7/997: creat d3/d2e/db6/d6c/db2/dce/f154 x:0 0 0 2024-09-13T22:09:13.670 INFO:tasks.workunit.client.1.smithi159.stdout:0/966: truncate d0/d48/d4f/f53 412564 0 2024-09-13T22:09:13.677 INFO:tasks.workunit.client.1.smithi159.stdout:9/939: dread d1/d9/ff [0,4194304] 0 2024-09-13T22:09:13.679 INFO:tasks.workunit.client.1.smithi159.stdout:0/967: creat d0/d2c/d71/f13f x:0 0 0 2024-09-13T22:09:13.679 INFO:tasks.workunit.client.1.smithi159.stdout:0/968: chown d0/d48/d4f/d54/d74/dbe/c107 115368 1 2024-09-13T22:09:13.680 INFO:tasks.workunit.client.1.smithi159.stdout:0/969: stat d0/d48/d12c/da1/fec 0 2024-09-13T22:09:13.680 INFO:tasks.workunit.client.1.smithi159.stdout:7/998: symlink d3/d2e/d6e/d74/dba/l155 0 2024-09-13T22:09:13.684 INFO:tasks.workunit.client.1.smithi159.stdout:9/940: rename d1/d9/d1f/d11f to d1/dc/d10/d6d/d2f/d8b/d8f/d13e/d145 0 2024-09-13T22:09:13.685 INFO:tasks.workunit.client.1.smithi159.stdout:3/722: dwrite d0/d1/d34/f70 [0,4194304] 0 2024-09-13T22:09:13.688 INFO:tasks.workunit.client.1.smithi159.stdout:0/970: creat d0/d48/d4f/d66/d75/d120/d12f/f140 x:0 0 0 2024-09-13T22:09:13.689 INFO:tasks.workunit.client.1.smithi159.stdout:7/999: getdents d3/d31/d4d/d4e/d7a 0 2024-09-13T22:09:13.695 INFO:tasks.workunit.client.1.smithi159.stdout:9/941: link d1/dc/d10/d6d/d87/ldb d1/dc/d10/d6d/d4b/d98/l146 0 2024-09-13T22:09:13.699 INFO:tasks.workunit.client.1.smithi159.stdout:3/723: rename d0/d1/d3/d5/d25/d75/l3b to d0/d1/d3/d5/d25/d2c/d7f/le6 0 2024-09-13T22:09:13.704 INFO:tasks.workunit.client.1.smithi159.stdout:0/971: mkdir d0/d48/d4f/d54/d74/db2/d141 0 2024-09-13T22:09:13.704 INFO:tasks.workunit.client.1.smithi159.stdout:9/942: creat d1/d5a/d101/f147 x:0 0 0 2024-09-13T22:09:13.706 INFO:tasks.workunit.client.1.smithi159.stdout:3/724: mknod d0/d1/d3/d5/d25/d7e/ce7 0 2024-09-13T22:09:13.708 INFO:tasks.workunit.client.1.smithi159.stdout:0/972: mkdir d0/d48/d4f/daf/d104/d142 0 2024-09-13T22:09:13.709 INFO:tasks.workunit.client.1.smithi159.stdout:9/943: creat d1/dc/d27/da4/db5/f148 x:0 0 0 2024-09-13T22:09:13.714 INFO:tasks.workunit.client.1.smithi159.stdout:3/725: dread d0/d1/d3/d5/d25/d4e/d5a/f19 [0,4194304] 0 2024-09-13T22:09:13.714 INFO:tasks.workunit.client.1.smithi159.stdout:3/726: readlink d0/d1/d34/ldc 0 2024-09-13T22:09:13.715 INFO:tasks.workunit.client.1.smithi159.stdout:3/727: mknod d0/d1/d3/d5/d25/d75/d5b/d45/ce8 0 2024-09-13T22:09:13.718 INFO:tasks.workunit.client.1.smithi159.stdout:3/728: creat d0/d1/d3/d5/d25/d2c/d65/fe9 x:0 0 0 2024-09-13T22:09:13.718 INFO:tasks.workunit.client.1.smithi159.stdout:3/729: write d0/d1/d3/d5/d25/fde [299013,28360] 0 2024-09-13T22:09:13.720 INFO:tasks.workunit.client.1.smithi159.stdout:3/730: rename d0/d78/fd5 to d0/d1/d3/d5/fea 0 2024-09-13T22:09:13.721 INFO:tasks.workunit.client.1.smithi159.stdout:0/973: dread d0/d48/d4f/fb [0,4194304] 0 2024-09-13T22:09:13.721 INFO:tasks.workunit.client.1.smithi159.stdout:3/731: creat d0/d1/feb x:0 0 0 2024-09-13T22:09:13.722 INFO:tasks.workunit.client.1.smithi159.stdout:0/974: mknod d0/d48/d4f/d54/d74/c143 0 2024-09-13T22:09:13.724 INFO:tasks.workunit.client.1.smithi159.stdout:0/975: getdents d0/d48/d4f/d54 0 2024-09-13T22:09:13.729 INFO:tasks.workunit.client.1.smithi159.stdout:3/732: dread d0/d1/d3/d5/d25/d2c/f32 [0,4194304] 0 2024-09-13T22:09:13.734 INFO:tasks.workunit.client.1.smithi159.stdout:0/976: dread d0/d2c/fde [0,4194304] 0 2024-09-13T22:09:13.735 INFO:tasks.workunit.client.1.smithi159.stdout:0/977: rmdir d0/d2c/d71/dc3 39 2024-09-13T22:09:13.735 INFO:tasks.workunit.client.1.smithi159.stdout:0/978: readlink d0/d2c/d71/l101 0 2024-09-13T22:09:13.735 INFO:tasks.workunit.client.1.smithi159.stdout:9/944: dwrite d1/dc/d10/d6d/d2f/d8b/da1/f11d [0,4194304] 0 2024-09-13T22:09:13.737 INFO:tasks.workunit.client.1.smithi159.stdout:0/979: creat d0/d48/d4f/daf/d104/d142/f144 x:0 0 0 2024-09-13T22:09:13.738 INFO:tasks.workunit.client.1.smithi159.stdout:9/945: mkdir d1/dc/d10/d149 0 2024-09-13T22:09:13.739 INFO:tasks.workunit.client.1.smithi159.stdout:0/980: write d0/d48/d4f/d66/d75/f11a [126138,70] 0 2024-09-13T22:09:13.739 INFO:tasks.workunit.client.1.smithi159.stdout:0/981: read - d0/d5e/d91/fd0 zero size 2024-09-13T22:09:13.739 INFO:tasks.workunit.client.1.smithi159.stdout:0/982: write d0/d48/d4f/d66/d75/f11a [822769,31580] 0 2024-09-13T22:09:13.741 INFO:tasks.workunit.client.1.smithi159.stdout:9/946: creat d1/dc/d10/d6d/d4b/d98/d120/f14a x:0 0 0 2024-09-13T22:09:13.742 INFO:tasks.workunit.client.1.smithi159.stdout:0/983: symlink d0/d48/d4f/daf/d113/l145 0 2024-09-13T22:09:13.742 INFO:tasks.workunit.client.1.smithi159.stdout:0/984: read d0/d48/d7d/dca/f10c [1255381,16800] 0 2024-09-13T22:09:13.745 INFO:tasks.workunit.client.1.smithi159.stdout:9/947: getdents d1/dc/d27/da4/d12f 0 2024-09-13T22:09:13.745 INFO:tasks.workunit.client.1.smithi159.stdout:9/948: fdatasync d1/dc/f9a 0 2024-09-13T22:09:13.745 INFO:tasks.workunit.client.1.smithi159.stdout:9/949: truncate d1/dc/d10/d6d/d4b/d98/da8/fbe 534650 0 2024-09-13T22:09:13.745 INFO:tasks.workunit.client.1.smithi159.stdout:0/985: creat d0/d48/d4f/d66/d75/d120/f146 x:0 0 0 2024-09-13T22:09:13.748 INFO:tasks.workunit.client.1.smithi159.stdout:9/950: symlink d1/d9/dab/l14b 0 2024-09-13T22:09:13.749 INFO:tasks.workunit.client.1.smithi159.stdout:0/986: creat d0/d2c/d10d/d13c/f147 x:0 0 0 2024-09-13T22:09:13.752 INFO:tasks.workunit.client.1.smithi159.stdout:0/987: getdents d0/d48/d4f/d54/d74 0 2024-09-13T22:09:13.757 INFO:tasks.workunit.client.1.smithi159.stdout:3/733: dwrite d0/d1/d3/d5/d25/d7e/fd7 [0,4194304] 0 2024-09-13T22:09:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:13 smithi159 ceph-mon[35348]: Deploying cephadm binary to smithi089 2024-09-13T22:09:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:13 smithi159 ceph-mon[35348]: mgrmap e22: smithi159.ghpomd(active, since 1.18612s) 2024-09-13T22:09:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:13 smithi159 ceph-mon[35348]: pgmap v3: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T22:09:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:13 smithi159 ceph-mon[35348]: Deploying cephadm binary to smithi159 2024-09-13T22:09:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:13 smithi159 ceph-mon[35348]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:13 smithi159 ceph-mon[35348]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:13 smithi159 ceph-mon[35348]: pgmap v4: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T22:09:13.761 INFO:tasks.workunit.client.1.smithi159.stdout:0/988: rmdir d0/d48/d4f/daf/d104/d142 39 2024-09-13T22:09:13.761 INFO:tasks.workunit.client.1.smithi159.stdout:3/734: dread d0/d1/d34/fad [0,4194304] 0 2024-09-13T22:09:13.765 INFO:tasks.workunit.client.1.smithi159.stdout:0/989: creat d0/d48/d4f/d66/d75/d114/f148 x:0 0 0 2024-09-13T22:09:13.769 INFO:tasks.workunit.client.1.smithi159.stdout:3/735: write d0/d1/d3/d5/d25/d4e/d5a/d9b/fdb [1803134,19215] 0 2024-09-13T22:09:13.774 INFO:tasks.workunit.client.1.smithi159.stdout:0/990: dread d0/d48/d12c/feb [0,4194304] 0 2024-09-13T22:09:13.799 INFO:tasks.workunit.client.1.smithi159.stdout:3/736: dwrite d0/d1/d34/fb3 [4194304,4194304] 0 2024-09-13T22:09:13.799 INFO:tasks.workunit.client.1.smithi159.stdout:0/991: dwrite d0/f77 [0,4194304] 0 2024-09-13T22:09:13.800 INFO:tasks.workunit.client.1.smithi159.stdout:3/737: link d0/d1/d3/d5/d25/d4e/d9f/la0 d0/d1/d34/d73/lec 0 2024-09-13T22:09:13.803 INFO:tasks.workunit.client.1.smithi159.stdout:0/992: link d0/d2c/c105 d0/d48/d7d/dca/dcd/c149 0 2024-09-13T22:09:13.812 INFO:tasks.workunit.client.1.smithi159.stdout:0/993: dread d0/d48/d7d/ffb [0,4194304] 0 2024-09-13T22:09:13.833 INFO:tasks.workunit.client.1.smithi159.stdout:3/738: dwrite d0/d1/d3/d5/d25/d4e/d5a/f67 [0,4194304] 0 2024-09-13T22:09:13.834 INFO:tasks.workunit.client.1.smithi159.stdout:3/739: stat d0/d1/d3/d5/f55 0 2024-09-13T22:09:13.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/740: write d0/d1/f47 [4153307,56891] 0 2024-09-13T22:09:13.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/741: write d0/d1/d3/d5/d25/d4e/d92/fae [1292578,76525] 0 2024-09-13T22:09:13.859 INFO:tasks.workunit.client.1.smithi159.stdout:3/742: dwrite d0/d1/d3/d5/d25/d4e/d5a/f19 [0,4194304] 0 2024-09-13T22:09:13.859 INFO:tasks.workunit.client.1.smithi159.stdout:3/743: fsync d0/d1/d3/d5/f31 0 2024-09-13T22:09:13.874 INFO:tasks.workunit.client.1.smithi159.stdout:3/744: dwrite d0/d1/d3/f82 [0,4194304] 0 2024-09-13T22:09:13.874 INFO:tasks.workunit.client.1.smithi159.stdout:3/745: read - d0/d1/d3/d5/d25/d75/d5b/d45/d8c/fa4 zero size 2024-09-13T22:09:13.883 INFO:tasks.workunit.client.1.smithi159.stdout:3/746: write d0/d1/d3/d5/db/d39/f3f [1239243,17268] 0 2024-09-13T22:09:13.885 INFO:tasks.workunit.client.1.smithi159.stdout:3/747: mknod d0/d1/d3/d5/d25/d4e/d5a/d9b/ced 0 2024-09-13T22:09:13.886 INFO:tasks.workunit.client.1.smithi159.stdout:3/748: unlink d0/d1/d3/d5/d25/l2b 0 2024-09-13T22:09:13.889 INFO:tasks.workunit.client.1.smithi159.stdout:3/749: dread d0/d1/d34/f40 [0,4194304] 0 2024-09-13T22:09:13.891 INFO:tasks.workunit.client.1.smithi159.stdout:3/750: creat d0/d1/d3/d5/d25/d7e/fee x:0 0 0 2024-09-13T22:09:13.891 INFO:tasks.workunit.client.1.smithi159.stdout:3/751: write d0/d1/d15/f9e [646773,79836] 0 2024-09-13T22:09:13.893 INFO:tasks.workunit.client.1.smithi159.stdout:3/752: unlink d0/d1/d34/f70 0 2024-09-13T22:09:13.896 INFO:tasks.workunit.client.1.smithi159.stdout:3/753: getdents d0/d1/d3/d5/d25/d4e/d5a 0 2024-09-13T22:09:13.896 INFO:tasks.workunit.client.1.smithi159.stdout:3/754: fdatasync d0/d1/d3/d5/d25/d7e/fd7 0 2024-09-13T22:09:13.902 INFO:tasks.workunit.client.1.smithi159.stdout:3/755: dread d0/d1/d3/d5/d25/d2c/d65/f72 [0,4194304] 0 2024-09-13T22:09:13.903 INFO:tasks.workunit.client.1.smithi159.stdout:3/756: mknod d0/d1/d3/d5/d25/d2c/cef 0 2024-09-13T22:09:13.904 INFO:tasks.workunit.client.1.smithi159.stdout:3/757: rmdir d0 39 2024-09-13T22:09:13.905 INFO:tasks.workunit.client.1.smithi159.stdout:3/758: creat d0/d1/d3/d5/db/dc6/ff0 x:0 0 0 2024-09-13T22:09:13.905 INFO:tasks.workunit.client.1.smithi159.stdout:3/759: chown d0/d1/d3/d5/l5f 1193304 1 2024-09-13T22:09:13.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.948+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ca81087a0 con 0x7f6ca8100db0 2024-09-13T22:09:13.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.949+0000 7f6c9e7fc640 1 -- 172.21.15.89:0/374659169 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f6ca40352f0 con 0x7f6ca8100db0 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:09:13.951 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:09:13.952 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:09:13.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:09:13.952 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:09:13.952 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 12, 2024-09-13T22:09:13.952 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:09:13.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:09:13.952 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:09:13.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.951+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f6c940394e0 msgr2=0x7f6c9403b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.951+0000 7f6caf6d8640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f6c940394e0 0x7f6c9403b9a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8100c10 tx=0x7f6c98005f90 comp rx=0 tx=0).stop 2024-09-13T22:09:13.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.951+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 msgr2=0x7f6ca8071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:13.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.951+0000 7f6caf6d8640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 0x7f6ca8071a50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4031540 tx=0x7f6ca40055c0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.952+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 shutdown_connections 2024-09-13T22:09:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.952+0000 7f6caf6d8640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8100db0 0x7f6ca8071a50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.952+0000 7f6caf6d8640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f6c940394e0 0x7f6c9403b9a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.952+0000 7f6caf6d8640 1 --2- 172.21.15.89:0/374659169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ca80ffbb0 0x7f6ca8071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.952+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 >> 172.21.15.89:0/374659169 conn(0x7f6ca80fb360 msgr2=0x7f6ca81044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.952+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 shutdown_connections 2024-09-13T22:09:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:13.952+0000 7f6caf6d8640 1 -- 172.21.15.89:0/374659169 wait complete. 2024-09-13T22:09:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.052+0000 7f93d452c640 1 -- 172.21.15.89:0/4199062664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 msgr2=0x7f93cc102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.053+0000 7f93d452c640 1 --2- 172.21.15.89:0/4199062664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 0x7f93cc102a70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0098b0 tx=0x7f93bc02a4d0 comp rx=0 tx=0).stop 2024-09-13T22:09:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.053+0000 7f93d452c640 1 -- 172.21.15.89:0/4199062664 shutdown_connections 2024-09-13T22:09:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.053+0000 7f93d452c640 1 --2- 172.21.15.89:0/4199062664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc102fb0 0x7f93cc1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.053+0000 7f93d452c640 1 --2- 172.21.15.89:0/4199062664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 0x7f93cc102a70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.053+0000 7f93d452c640 1 -- 172.21.15.89:0/4199062664 >> 172.21.15.89:0/4199062664 conn(0x7f93cc0fa280 msgr2=0x7f93cc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.053+0000 7f93d452c640 1 -- 172.21.15.89:0/4199062664 shutdown_connections 2024-09-13T22:09:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.053+0000 7f93d452c640 1 -- 172.21.15.89:0/4199062664 wait complete. 2024-09-13T22:09:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.053+0000 7f93d452c640 1 Processor -- start 2024-09-13T22:09:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.053+0000 7f93d452c640 1 -- start start 2024-09-13T22:09:14.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d452c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 0x7f93cc195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:14.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d452c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc102fb0 0x7f93cc195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:14.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d452c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc196220 con 0x7f93cc100680 2024-09-13T22:09:14.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d452c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc196390 con 0x7f93cc102fb0 2024-09-13T22:09:14.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d22c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 0x7f93cc195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:14.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d22c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 0x7f93cc195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37334/0 (socket says 172.21.15.89:37334) 2024-09-13T22:09:14.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d22c8640 1 -- 172.21.15.89:0/1846014098 learned_addr learned my addr 172.21.15.89:0/1846014098 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:14.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d1ac7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc102fb0 0x7f93cc195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:14.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d1ac7640 1 -- 172.21.15.89:0/1846014098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 msgr2=0x7f93cc195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:14.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d1ac7640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 0x7f93cc195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:14.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d1ac7640 1 -- 172.21.15.89:0/1846014098 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc009560 con 0x7f93cc102fb0 2024-09-13T22:09:14.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.054+0000 7f93d22c8640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 0x7f93cc195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:09:14.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.055+0000 7f93d1ac7640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc102fb0 0x7f93cc195c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009c50 tx=0x7f93c800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:14.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.055+0000 7f93c37fe640 1 -- 172.21.15.89:0/1846014098 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c8004200 con 0x7f93cc102fb0 2024-09-13T22:09:14.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.055+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc0fe4d0 con 0x7f93cc102fb0 2024-09-13T22:09:14.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.055+0000 7f93c37fe640 1 -- 172.21.15.89:0/1846014098 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93c8009e90 con 0x7f93cc102fb0 2024-09-13T22:09:14.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.055+0000 7f93c37fe640 1 -- 172.21.15.89:0/1846014098 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c8004d70 con 0x7f93cc102fb0 2024-09-13T22:09:14.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.055+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc0fea20 con 0x7f93cc102fb0 2024-09-13T22:09:14.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.056+0000 7f93c37fe640 1 -- 172.21.15.89:0/1846014098 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) v1 ==== 46554+0+0 (secure 0 0 0) 0x7f93c80035f0 con 0x7f93cc102fb0 2024-09-13T22:09:14.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.056+0000 7f93c37fe640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f93b8039490 0x7f93b803b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:14.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.056+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc108830 con 0x7f93cc102fb0 2024-09-13T22:09:14.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.056+0000 7f93c37fe640 1 -- 172.21.15.89:0/1846014098 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f93c8005020 con 0x7f93cc102fb0 2024-09-13T22:09:14.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.056+0000 7f93d22c8640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f93b8039490 0x7f93b803b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:14.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.057+0000 7f93d22c8640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f93b8039490 0x7f93b803b950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f93bc000c00 tx=0x7f93bc0314e0 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:14.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.064+0000 7f93c37fe640 1 -- 172.21.15.89:0/1846014098 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f93c80188e0 con 0x7f93cc102fb0 2024-09-13T22:09:14.112 INFO:tasks.workunit.client.1.smithi159.stdout:2/873: sync 2024-09-13T22:09:14.114 INFO:tasks.workunit.client.1.smithi159.stdout:2/874: getdents d9/da/d82 0 2024-09-13T22:09:14.116 INFO:tasks.workunit.client.1.smithi159.stdout:2/875: truncate d9/fe 1985791 0 2024-09-13T22:09:14.122 INFO:tasks.workunit.client.1.smithi159.stdout:2/876: mknod d9/d65/d8d/de2/df0/d91/c134 0 2024-09-13T22:09:14.122 INFO:tasks.workunit.client.1.smithi159.stdout:2/877: dread - d9/d44/deb/dee/d77/da6/db0/f101 zero size 2024-09-13T22:09:14.128 INFO:tasks.workunit.client.1.smithi159.stdout:2/878: dread d9/d44/deb/dee/d77/da6/db0/fbd [0,4194304] 0 2024-09-13T22:09:14.129 INFO:tasks.workunit.client.1.smithi159.stdout:2/879: dread d9/d44/deb/dee/de9/f11d [0,4194304] 0 2024-09-13T22:09:14.129 INFO:tasks.workunit.client.1.smithi159.stdout:2/880: truncate d9/d44/deb/dee/d77/f125 229390 0 2024-09-13T22:09:14.133 INFO:tasks.workunit.client.1.smithi159.stdout:2/881: unlink d9/d65/d8d/de2/d69/ff7 0 2024-09-13T22:09:14.133 INFO:tasks.workunit.client.1.smithi159.stdout:2/882: stat d9/c36 0 2024-09-13T22:09:14.133 INFO:tasks.workunit.client.1.smithi159.stdout:2/883: truncate d9/d92/fcc 776901 0 2024-09-13T22:09:14.139 INFO:tasks.workunit.client.1.smithi159.stdout:2/884: symlink d9/da/d11b/l135 0 2024-09-13T22:09:14.139 INFO:tasks.workunit.client.1.smithi159.stdout:2/885: fsync d9/d92/fcc 0 2024-09-13T22:09:14.156 INFO:tasks.workunit.client.1.smithi159.stdout:2/886: dwrite d9/d44/deb/dee/d77/da6/db0/f106 [0,4194304] 0 2024-09-13T22:09:14.169 INFO:tasks.workunit.client.1.smithi159.stdout:2/887: write d9/da/f2a [1569010,125933] 0 2024-09-13T22:09:14.169 INFO:tasks.workunit.client.1.smithi159.stdout:2/888: chown d9/d65/d8d/de2/l12d 35111754 1 2024-09-13T22:09:14.170 INFO:tasks.workunit.client.1.smithi159.stdout:2/889: write d9/da/f7d [618726,7874] 0 2024-09-13T22:09:14.172 INFO:tasks.workunit.client.1.smithi159.stdout:2/890: mkdir d9/da/d82/d136 0 2024-09-13T22:09:14.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.290+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 --> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93cc1039d0 con 0x7f93b8039490 2024-09-13T22:09:14.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.296+0000 7f93c37fe640 1 -- 172.21.15.89:0/1846014098 <== mgr.24319 v2:172.21.15.159:6828/1500548398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f93cc1039d0 con 0x7f93b8039490 2024-09-13T22:09:14.297 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:09:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:09:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:09:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:09:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T22:09:14.297 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "1/2 daemons upgraded", 2024-09-13T22:09:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-13T22:09:14.298 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:09:14.298 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:09:14.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f93b8039490 msgr2=0x7f93b803b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:14.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f93b8039490 0x7f93b803b950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f93bc000c00 tx=0x7f93bc0314e0 comp rx=0 tx=0).stop 2024-09-13T22:09:14.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc102fb0 msgr2=0x7f93cc195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:14.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc102fb0 0x7f93cc195c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009c50 tx=0x7f93c800c6a0 comp rx=0 tx=0).stop 2024-09-13T22:09:14.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 shutdown_connections 2024-09-13T22:09:14.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f93b8039490 0x7f93b803b950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:14.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93cc102fb0 0x7f93cc195c50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:14.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 --2- 172.21.15.89:0/1846014098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93cc100680 0x7f93cc195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:14.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 >> 172.21.15.89:0/1846014098 conn(0x7f93cc0fa280 msgr2=0x7f93cc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.298+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 shutdown_connections 2024-09-13T22:09:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:14.299+0000 7f93d452c640 1 -- 172.21.15.89:0/1846014098 wait complete. 2024-09-13T22:09:14.370 INFO:tasks.workunit.client.1.smithi159.stdout:9/951: sync 2024-09-13T22:09:14.379 INFO:tasks.workunit.client.1.smithi159.stdout:9/952: dread d1/dc/d10/d6d/d2f/d8b/ddd/f118 [0,4194304] 0 2024-09-13T22:09:14.387 INFO:tasks.workunit.client.1.smithi159.stdout:9/953: read d1/dc/d10/d6d/d4b/dcb/d75/f85 [2713138,26330] 0 2024-09-13T22:09:14.397 INFO:tasks.workunit.client.1.smithi159.stdout:9/954: dread d1/dc/d27/d11c/fce [0,4194304] 0 2024-09-13T22:09:14.413 INFO:tasks.workunit.client.1.smithi159.stdout:9/955: dwrite d1/dc/d10/fe9 [0,4194304] 0 2024-09-13T22:09:14.416 INFO:tasks.workunit.client.1.smithi159.stdout:9/956: creat d1/dc/d10/d6d/d2f/d8b/d8f/d13e/d145/f14c x:0 0 0 2024-09-13T22:09:14.419 INFO:tasks.workunit.client.1.smithi159.stdout:9/957: mknod d1/d9/dab/dd7/c14d 0 2024-09-13T22:09:14.421 INFO:tasks.workunit.client.1.smithi159.stdout:9/958: rmdir d1/dc/d10/d9c 39 2024-09-13T22:09:14.422 INFO:tasks.workunit.client.1.smithi159.stdout:9/959: symlink d1/dc/d10/d9c/l14e 0 2024-09-13T22:09:14.445 INFO:tasks.workunit.client.1.smithi159.stdout:9/960: dwrite d1/dc/d10/d6d/d4b/f55 [0,4194304] 0 2024-09-13T22:09:14.447 INFO:tasks.workunit.client.1.smithi159.stdout:9/961: dread d1/dc/d10/d6d/d4b/dcb/d75/fd2 [0,4194304] 0 2024-09-13T22:09:14.448 INFO:tasks.workunit.client.1.smithi159.stdout:9/962: unlink d1/f7b 0 2024-09-13T22:09:14.450 INFO:tasks.workunit.client.1.smithi159.stdout:9/963: link d1/dc/d10/d6d/d4b/dcb/cf7 d1/dc/d10/d6d/d2f/d8b/d8f/d13e/d145/d125/c14f 0 2024-09-13T22:09:14.451 INFO:tasks.workunit.client.1.smithi159.stdout:9/964: creat d1/dc/d10/d115/f150 x:0 0 0 2024-09-13T22:09:14.453 INFO:tasks.workunit.client.1.smithi159.stdout:9/965: rename d1/dc/d10/d6d/d4b/dcb/d74/ddc/lf0 to d1/dc/d10/d6d/d2f/d8b/d8f/d13e/l151 0 2024-09-13T22:09:14.454 INFO:tasks.workunit.client.1.smithi159.stdout:9/966: creat d1/dc/d27/da4/db5/f152 x:0 0 0 2024-09-13T22:09:14.456 INFO:tasks.workunit.client.1.smithi159.stdout:9/967: rmdir d1/d5a/d101 39 2024-09-13T22:09:14.456 INFO:tasks.workunit.client.1.smithi159.stdout:9/968: dread - d1/dc/ded/f121 zero size 2024-09-13T22:09:14.470 INFO:tasks.workunit.client.1.smithi159.stdout:9/969: write d1/dc/d10/d6d/d4b/d98/da8/fbe [1401309,130057] 0 2024-09-13T22:09:14.472 INFO:tasks.workunit.client.1.smithi159.stdout:9/970: link d1/dc/d10/d6d/d2f/d8b/d8f/d13e/d145/d125/c14f d1/d5a/d101/c153 0 2024-09-13T22:09:14.475 INFO:tasks.workunit.client.1.smithi159.stdout:9/971: rmdir d1/dc/d10/d115 39 2024-09-13T22:09:14.477 INFO:tasks.workunit.client.1.smithi159.stdout:9/972: rename d1/dc/d10/d6d/d4b/dcb/d74/ddc to d1/d154 0 2024-09-13T22:09:14.479 INFO:tasks.workunit.client.1.smithi159.stdout:9/973: rmdir d1/d5a/d101 39 2024-09-13T22:09:14.542 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:14 smithi089 ceph-mon[27921]: mgrmap e23: smithi159.ghpomd(active, since 2s) 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:14 smithi089 ceph-mon[27921]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:14 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:13] ENGINE Bus STARTING 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:14 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:13] ENGINE Serving on https://172.21.15.159:7150 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:14 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:13] ENGINE Error in HTTPServer.serve 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:09:14.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:14 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:13] ENGINE Serving on http://172.21.15.159:8765 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:14 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:13] ENGINE Bus STARTED 2024-09-13T22:09:14.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:14 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/374659169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:09:14.658 INFO:tasks.workunit.client.1.smithi159.stdout:9/974: sync 2024-09-13T22:09:14.658 INFO:tasks.workunit.client.1.smithi159.stdout:0/994: sync 2024-09-13T22:09:14.658 INFO:tasks.workunit.client.1.smithi159.stdout:2/891: sync 2024-09-13T22:09:14.658 INFO:tasks.workunit.client.1.smithi159.stdout:3/760: sync 2024-09-13T22:09:14.658 INFO:tasks.workunit.client.1.smithi159.stdout:0/995: write d0/d48/d4f/d66/d75/d120/d12f/f140 [677857,81839] 0 2024-09-13T22:09:14.661 INFO:tasks.workunit.client.1.smithi159.stdout:2/892: truncate d9/da/f7d 763905 0 2024-09-13T22:09:14.662 INFO:tasks.workunit.client.1.smithi159.stdout:9/975: creat d1/dc/d10/d6d/d2f/d8b/d8f/f155 x:0 0 0 2024-09-13T22:09:14.665 INFO:tasks.workunit.client.1.smithi159.stdout:3/761: rename d0/d1/d34/f79 to d0/d1/d3/d5/d25/d2c/d65/ff1 0 2024-09-13T22:09:14.670 INFO:tasks.workunit.client.1.smithi159.stdout:2/893: readlink d9/da/d5a/lc4 0 2024-09-13T22:09:14.670 INFO:tasks.workunit.client.1.smithi159.stdout:2/894: fsync d9/d65/d8d/de2/fc0 0 2024-09-13T22:09:14.671 INFO:tasks.workunit.client.1.smithi159.stdout:9/976: rename d1/dc/d27/da4/d12f/l143 to d1/dc/d10/d69/l156 0 2024-09-13T22:09:14.674 INFO:tasks.workunit.client.1.smithi159.stdout:0/996: getdents d0/d2c/d71 0 2024-09-13T22:09:14.674 INFO:tasks.workunit.client.1.smithi159.stdout:0/997: chown d0/f10 19 1 2024-09-13T22:09:14.676 INFO:tasks.workunit.client.1.smithi159.stdout:2/895: creat d9/d65/d8d/de2/f137 x:0 0 0 2024-09-13T22:09:14.676 INFO:tasks.workunit.client.1.smithi159.stdout:2/896: chown d9/d2d/db5/ce1 98 1 2024-09-13T22:09:14.676 INFO:tasks.workunit.client.1.smithi159.stdout:2/897: write d9/da/d82/d89/f112 [4086170,37680] 0 2024-09-13T22:09:14.680 INFO:tasks.workunit.client.1.smithi159.stdout:0/998: creat d0/d48/d4f/d54/dac/df7/f14a x:0 0 0 2024-09-13T22:09:14.680 INFO:tasks.workunit.client.1.smithi159.stdout:2/898: creat d9/d37/f138 x:0 0 0 2024-09-13T22:09:14.681 INFO:tasks.workunit.client.1.smithi159.stdout:0/999: creat d0/d48/d4f/d54/f14b x:0 0 0 2024-09-13T22:09:14.682 INFO:tasks.workunit.client.1.smithi159.stdout:2/899: mkdir d9/d2d/db5/d139 0 2024-09-13T22:09:14.689 INFO:tasks.workunit.client.1.smithi159.stdout:9/977: dwrite d1/d9/dab/fee [4194304,4194304] 0 2024-09-13T22:09:14.689 INFO:tasks.workunit.client.1.smithi159.stdout:3/762: dwrite d0/d1/d34/d73/f77 [4194304,4194304] 0 2024-09-13T22:09:14.691 INFO:tasks.workunit.client.1.smithi159.stdout:9/978: mknod d1/d9/d1f/d99/c157 0 2024-09-13T22:09:14.695 INFO:tasks.workunit.client.1.smithi159.stdout:3/763: creat d0/d68/ff2 x:0 0 0 2024-09-13T22:09:14.695 INFO:tasks.workunit.client.1.smithi159.stdout:3/764: chown d0/d1/d3/d5/d25/d2c/d71/d8f 58047795 1 2024-09-13T22:09:14.728 INFO:tasks.workunit.client.1.smithi159.stdout:9/979: dwrite d1/dc/d10/d6d/d4b/f55 [0,4194304] 0 2024-09-13T22:09:14.729 INFO:tasks.workunit.client.1.smithi159.stdout:3/765: dwrite d0/d1/d3/d5/f31 [0,4194304] 0 2024-09-13T22:09:14.729 INFO:tasks.workunit.client.1.smithi159.stdout:3/766: chown d0/d1/d3/d5/db/dc6 452444 1 2024-09-13T22:09:14.729 INFO:tasks.workunit.client.1.smithi159.stdout:3/767: chown d0/d1/d3/dd/l1e 961299689 1 2024-09-13T22:09:14.730 INFO:tasks.workunit.client.1.smithi159.stdout:2/900: dwrite d9/da/f103 [0,4194304] 0 2024-09-13T22:09:14.731 INFO:tasks.workunit.client.1.smithi159.stdout:3/768: rename d0/d1/d3/d5/d25/d2c/d65/c83 to d0/d1/d81/da2/cf3 0 2024-09-13T22:09:14.732 INFO:tasks.workunit.client.1.smithi159.stdout:3/769: write d0/d1/d3/d5/d25/d2c/f9a [1323188,37131] 0 2024-09-13T22:09:14.732 INFO:tasks.workunit.client.1.smithi159.stdout:3/770: write d0/d1/d3/d5/d25/d75/d5b/d45/f7d [3887665,40416] 0 2024-09-13T22:09:14.735 INFO:tasks.workunit.client.1.smithi159.stdout:3/771: dread d0/d1/d3/d5/d25/d2c/f33 [0,4194304] 0 2024-09-13T22:09:14.735 INFO:tasks.workunit.client.1.smithi159.stdout:2/901: link d9/da/d82/d89/f112 d9/d2d/db5/f13a 0 2024-09-13T22:09:14.735 INFO:tasks.workunit.client.1.smithi159.stdout:2/902: chown d9/da/d82/d89/d10b/c130 4065 1 2024-09-13T22:09:14.740 INFO:tasks.workunit.client.1.smithi159.stdout:3/772: mkdir d0/d1/d3/d5/d25/d4e/d5a/df4 0 2024-09-13T22:09:14.742 INFO:tasks.workunit.client.1.smithi159.stdout:2/903: symlink d9/d92/l13b 0 2024-09-13T22:09:14.742 INFO:tasks.workunit.client.1.smithi159.stdout:3/773: creat d0/db0/ff5 x:0 0 0 2024-09-13T22:09:14.744 INFO:tasks.workunit.client.1.smithi159.stdout:2/904: mkdir d9/d65/dfe/d13c 0 2024-09-13T22:09:14.744 INFO:tasks.workunit.client.1.smithi159.stdout:2/905: fdatasync d9/d65/f85 0 2024-09-13T22:09:14.745 INFO:tasks.workunit.client.1.smithi159.stdout:2/906: creat d9/d92/f13d x:0 0 0 2024-09-13T22:09:14.745 INFO:tasks.workunit.client.1.smithi159.stdout:2/907: dread - d9/da/d82/d89/dd6/fd7 zero size 2024-09-13T22:09:14.745 INFO:tasks.workunit.client.1.smithi159.stdout:3/774: mknod d0/d1/d3/d5/db/d39/dbe/cf6 0 2024-09-13T22:09:14.746 INFO:tasks.workunit.client.1.smithi159.stdout:2/908: chown d9/d65/l81 201 1 2024-09-13T22:09:14.746 INFO:tasks.workunit.client.1.smithi159.stdout:2/909: creat d9/d65/d8d/de2/d69/dab/dce/f13e x:0 0 0 2024-09-13T22:09:14.746 INFO:tasks.workunit.client.1.smithi159.stdout:2/910: fdatasync d9/da/d82/ffa 0 2024-09-13T22:09:14.748 INFO:tasks.workunit.client.1.smithi159.stdout:3/775: mkdir d0/d1/d81/da2/df7 0 2024-09-13T22:09:14.748 INFO:tasks.workunit.client.1.smithi159.stdout:3/776: creat d0/d1/d3/d5/db/d39/dbe/ff8 x:0 0 0 2024-09-13T22:09:14.749 INFO:tasks.workunit.client.1.smithi159.stdout:2/911: symlink d9/da/d82/d89/l13f 0 2024-09-13T22:09:14.751 INFO:tasks.workunit.client.1.smithi159.stdout:3/777: creat d0/d1/d15/ff9 x:0 0 0 2024-09-13T22:09:14.752 INFO:tasks.workunit.client.1.smithi159.stdout:2/912: unlink d9/d37/fa8 0 2024-09-13T22:09:14.753 INFO:tasks.workunit.client.1.smithi159.stdout:3/778: mkdir d0/d1/dfa 0 2024-09-13T22:09:14.753 INFO:tasks.workunit.client.1.smithi159.stdout:2/913: symlink d9/da/d5a/d10c/l140 0 2024-09-13T22:09:14.755 INFO:tasks.workunit.client.1.smithi159.stdout:3/779: unlink d0/d78/fb4 0 2024-09-13T22:09:14.755 INFO:tasks.workunit.client.1.smithi159.stdout:2/914: symlink d9/da/d11b/l141 0 2024-09-13T22:09:14.757 INFO:tasks.workunit.client.1.smithi159.stdout:3/780: link d0/d1/d3/d5/d25/d75/d5b/c98 d0/d1/d34/cfb 0 2024-09-13T22:09:14.757 INFO:tasks.workunit.client.1.smithi159.stdout:2/915: symlink d9/d65/d8d/de2/d69/dc9/l142 0 2024-09-13T22:09:14.759 INFO:tasks.workunit.client.1.smithi159.stdout:3/781: mknod d0/d1/d3/d5/d25/d2c/d71/cfc 0 2024-09-13T22:09:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:14 smithi159 ceph-mon[35348]: mgrmap e23: smithi159.ghpomd(active, since 2s) 2024-09-13T22:09:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:14 smithi159 ceph-mon[35348]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:14 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:13] ENGINE Bus STARTING 2024-09-13T22:09:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:14 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:13] ENGINE Serving on https://172.21.15.159:7150 2024-09-13T22:09:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:14 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:13] ENGINE Error in HTTPServer.serve 2024-09-13T22:09:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Traceback (most recent call last): 2024-09-13T22:09:14.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._run(expiration_interval) 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: s = self.context.wrap_socket( 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: return self.sslsocket_class._create( 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:09:14.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self.do_handshake() 2024-09-13T22:09:14.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:09:14.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._sslobj.do_handshake() 2024-09-13T22:09:14.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:09:14.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:14 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:13] ENGINE Serving on http://172.21.15.159:8765 2024-09-13T22:09:14.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:14 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:13] ENGINE Bus STARTED 2024-09-13T22:09:14.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:14 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/374659169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:09:14.761 INFO:tasks.workunit.client.1.smithi159.stdout:2/916: link d9/d44/f46 d9/d92/f143 0 2024-09-13T22:09:14.763 INFO:tasks.workunit.client.1.smithi159.stdout:2/917: unlink d9/d65/d8d/de2/df0/f34 0 2024-09-13T22:09:14.763 INFO:tasks.workunit.client.1.smithi159.stdout:2/918: dread - d9/d44/f46 zero size 2024-09-13T22:09:14.764 INFO:tasks.workunit.client.1.smithi159.stdout:2/919: write d9/d44/deb/f104 [1125090,59812] 0 2024-09-13T22:09:14.764 INFO:tasks.workunit.client.1.smithi159.stdout:2/920: chown d9/d92/f143 65861 1 2024-09-13T22:09:14.765 INFO:tasks.workunit.client.1.smithi159.stdout:2/921: rename d9/d44/deb/dee/l6e to d9/d2d/l144 0 2024-09-13T22:09:14.765 INFO:tasks.workunit.client.1.smithi159.stdout:2/922: write d9/d44/deb/d10d/f10f [674000,75367] 0 2024-09-13T22:09:14.770 INFO:tasks.workunit.client.1.smithi159.stdout:2/923: dread d9/da/d5a/f63 [0,4194304] 0 2024-09-13T22:09:14.770 INFO:tasks.workunit.client.1.smithi159.stdout:2/924: write d9/d44/deb/dee/d77/f9b [1853300,4837] 0 2024-09-13T22:09:14.770 INFO:tasks.workunit.client.1.smithi159.stdout:2/925: stat d9/d92 0 2024-09-13T22:09:14.772 INFO:tasks.workunit.client.1.smithi159.stdout:2/926: unlink d9/da/f7b 0 2024-09-13T22:09:14.772 INFO:tasks.workunit.client.1.smithi159.stdout:2/927: write d9/da/d82/d89/dd6/fd7 [878179,59649] 0 2024-09-13T22:09:14.774 INFO:tasks.workunit.client.1.smithi159.stdout:2/928: unlink d9/da/d82/c123 0 2024-09-13T22:09:14.782 INFO:tasks.workunit.client.1.smithi159.stdout:3/782: dwrite d0/d1/d3/d5/db/d58/f6c [0,4194304] 0 2024-09-13T22:09:14.783 INFO:tasks.workunit.client.1.smithi159.stdout:3/783: rename d0/d1/d15/f5e to d0/d1/d3/d5/db/d39/dbe/ffd 0 2024-09-13T22:09:14.786 INFO:tasks.workunit.client.1.smithi159.stdout:3/784: symlink d0/d1/d3/d5/d25/d75/d5b/lfe 0 2024-09-13T22:09:14.787 INFO:tasks.workunit.client.1.smithi159.stdout:2/929: dread d9/da/f22 [0,4194304] 0 2024-09-13T22:09:14.794 INFO:tasks.workunit.client.1.smithi159.stdout:2/930: dread d9/d44/deb/f104 [0,4194304] 0 2024-09-13T22:09:14.794 INFO:tasks.workunit.client.1.smithi159.stdout:3/785: dread d0/d1/d3/f82 [0,4194304] 0 2024-09-13T22:09:14.798 INFO:tasks.workunit.client.1.smithi159.stdout:2/931: symlink d9/da/d5a/d119/l145 0 2024-09-13T22:09:14.801 INFO:tasks.workunit.client.1.smithi159.stdout:2/932: symlink d9/d44/deb/dee/d77/da6/l146 0 2024-09-13T22:09:14.818 INFO:tasks.workunit.client.1.smithi159.stdout:3/786: dwrite d0/d1/d15/f99 [0,4194304] 0 2024-09-13T22:09:14.818 INFO:tasks.workunit.client.1.smithi159.stdout:3/787: write d0/d1/d3/d5/db/d58/f80 [4528949,119711] 0 2024-09-13T22:09:14.818 INFO:tasks.workunit.client.1.smithi159.stdout:2/933: dwrite d9/da/d82/f107 [0,4194304] 0 2024-09-13T22:09:14.820 INFO:tasks.workunit.client.1.smithi159.stdout:3/788: mknod d0/d1/d3/d5/d25/d2c/cff 0 2024-09-13T22:09:14.829 INFO:tasks.workunit.client.1.smithi159.stdout:3/789: write d0/d1/d3/d5/db/d58/f80 [1609914,99853] 0 2024-09-13T22:09:14.829 INFO:tasks.workunit.client.1.smithi159.stdout:3/790: readlink d0/d1/d3/d5/d25/d75/lb6 0 2024-09-13T22:09:14.836 INFO:tasks.workunit.client.1.smithi159.stdout:2/934: dwrite d9/da/f18 [0,4194304] 0 2024-09-13T22:09:14.836 INFO:tasks.workunit.client.1.smithi159.stdout:2/935: write d9/d37/f138 [816138,111959] 0 2024-09-13T22:09:14.836 INFO:tasks.workunit.client.1.smithi159.stdout:2/936: write d9/d65/d8d/de2/fc0 [815509,124926] 0 2024-09-13T22:09:14.837 INFO:tasks.workunit.client.1.smithi159.stdout:2/937: dread - d9/d65/d8d/de2/d69/dab/dce/ffd zero size 2024-09-13T22:09:14.838 INFO:tasks.workunit.client.1.smithi159.stdout:2/938: fdatasync d9/d44/deb/d10d/f10f 0 2024-09-13T22:09:14.844 INFO:tasks.workunit.client.1.smithi159.stdout:3/791: write d0/d1/d3/d5/f17 [10180829,93008] 0 2024-09-13T22:09:14.844 INFO:tasks.workunit.client.1.smithi159.stdout:3/792: creat d0/d91/f100 x:0 0 0 2024-09-13T22:09:14.844 INFO:tasks.workunit.client.1.smithi159.stdout:3/793: chown d0/d1/d3/d5/l5f 4085351 1 2024-09-13T22:09:14.849 INFO:tasks.workunit.client.1.smithi159.stdout:3/794: link d0/d1/d3/d5/d25/d4e/d5a/cd6 d0/d1/d15/c101 0 2024-09-13T22:09:14.851 INFO:tasks.workunit.client.1.smithi159.stdout:3/795: mknod d0/d91/c102 0 2024-09-13T22:09:14.853 INFO:tasks.workunit.client.1.smithi159.stdout:3/796: getdents d0/d1/d3/d5/db/dc6 0 2024-09-13T22:09:14.857 INFO:tasks.workunit.client.1.smithi159.stdout:2/939: dwrite f5 [0,4194304] 0 2024-09-13T22:09:14.858 INFO:tasks.workunit.client.1.smithi159.stdout:3/797: getdents d0/d1/d3/d5/d25/d94 0 2024-09-13T22:09:14.861 INFO:tasks.workunit.client.1.smithi159.stdout:3/798: rename d0/d1/d3/f82 to d0/d1/d3/d5/db/d58/f103 0 2024-09-13T22:09:14.864 INFO:tasks.workunit.client.1.smithi159.stdout:2/940: dread d9/fe [0,4194304] 0 2024-09-13T22:09:14.875 INFO:tasks.workunit.client.1.smithi159.stdout:3/799: symlink d0/d1/d15/l104 0 2024-09-13T22:09:14.875 INFO:tasks.workunit.client.1.smithi159.stdout:3/800: readlink d0/d78/le1 0 2024-09-13T22:09:14.875 INFO:tasks.workunit.client.1.smithi159.stdout:3/801: write d0/d1/d3/d5/d25/d75/d5b/d45/fd4 [142482,121323] 0 2024-09-13T22:09:14.877 INFO:tasks.workunit.client.1.smithi159.stdout:2/941: rename d9/d92/fb3 to d9/d44/f147 0 2024-09-13T22:09:14.881 INFO:tasks.workunit.client.1.smithi159.stdout:3/802: rename d0/d1/d3/d5/db/d39/fba to d0/d1/d81/da2/f105 0 2024-09-13T22:09:14.882 INFO:tasks.workunit.client.1.smithi159.stdout:2/942: mkdir d9/d65/d8d/de2/d69/def/d148 0 2024-09-13T22:09:14.885 INFO:tasks.workunit.client.1.smithi159.stdout:3/803: link d0/l16 d0/d1/dfa/l106 0 2024-09-13T22:09:14.889 INFO:tasks.workunit.client.1.smithi159.stdout:2/943: rename d9/d44/f46 to d9/d2d/db5/d139/f149 0 2024-09-13T22:09:14.892 INFO:tasks.workunit.client.1.smithi159.stdout:3/804: rename d0/d1/d3/d5/d25/d2c/d7f/f90 to d0/d1/d3/d5/d25/d75/d5b/d45/d8c/f107 0 2024-09-13T22:09:14.892 INFO:tasks.workunit.client.1.smithi159.stdout:3/805: creat d0/d91/f108 x:0 0 0 2024-09-13T22:09:14.895 INFO:tasks.workunit.client.1.smithi159.stdout:2/944: link d9/d44/deb/dee/d77/da6/db0/c131 d9/d65/d8d/c14a 0 2024-09-13T22:09:14.895 INFO:tasks.workunit.client.1.smithi159.stdout:2/945: fsync d9/da/f103 0 2024-09-13T22:09:14.898 INFO:tasks.workunit.client.1.smithi159.stdout:3/806: symlink d0/d1/d3/dd/l109 0 2024-09-13T22:09:14.898 INFO:tasks.workunit.client.1.smithi159.stdout:3/807: write d0/d1/d3/dd/f26 [3314672,128191] 0 2024-09-13T22:09:14.898 INFO:tasks.workunit.client.1.smithi159.stdout:3/808: write d0/d1/d3/d5/d25/d4e/d5a/d9b/fd3 [32786,90509] 0 2024-09-13T22:09:14.899 INFO:tasks.workunit.client.1.smithi159.stdout:2/946: truncate d9/d37/f51 4066995 0 2024-09-13T22:09:14.903 INFO:tasks.workunit.client.1.smithi159.stdout:3/809: creat d0/f10a x:0 0 0 2024-09-13T22:09:14.903 INFO:tasks.workunit.client.1.smithi159.stdout:3/810: chown d0/d1/d3/d5/d25/d2c/d65/fe9 3463043 1 2024-09-13T22:09:14.907 INFO:tasks.workunit.client.1.smithi159.stdout:2/947: mknod d9/da/d5a/c14b 0 2024-09-13T22:09:14.908 INFO:tasks.workunit.client.1.smithi159.stdout:2/948: truncate d9/d2d/f12a 772260 0 2024-09-13T22:09:14.919 INFO:tasks.workunit.client.1.smithi159.stdout:2/949: dread d9/d37/f3a [0,4194304] 0 2024-09-13T22:09:14.919 INFO:tasks.workunit.client.1.smithi159.stdout:2/950: stat d9/d44/deb/dee/d77/da6/cda 0 2024-09-13T22:09:14.919 INFO:tasks.workunit.client.1.smithi159.stdout:2/951: truncate d9/fe 2538725 0 2024-09-13T22:09:14.919 INFO:tasks.workunit.client.1.smithi159.stdout:2/952: read d9/da/d5a/f94 [1076714,18296] 0 2024-09-13T22:09:14.922 INFO:tasks.workunit.client.1.smithi159.stdout:2/953: creat d9/d44/deb/dee/d77/da6/de7/f14c x:0 0 0 2024-09-13T22:09:14.923 INFO:tasks.workunit.client.1.smithi159.stdout:2/954: write d9/d65/f85 [5940280,84465] 0 2024-09-13T22:09:14.923 INFO:tasks.workunit.client.1.smithi159.stdout:2/955: getdents d9/d2d/db5/dbe/d128 0 2024-09-13T22:09:14.932 INFO:tasks.workunit.client.1.smithi159.stdout:3/811: dwrite d0/d78/f7c [0,4194304] 0 2024-09-13T22:09:14.932 INFO:tasks.workunit.client.1.smithi159.stdout:3/812: truncate d0/d1/d15/f9e 1429964 0 2024-09-13T22:09:14.935 INFO:tasks.workunit.client.1.smithi159.stdout:2/956: write f5 [1517005,77784] 0 2024-09-13T22:09:14.941 INFO:tasks.workunit.client.1.smithi159.stdout:3/813: write d0/d1/d3/d5/db/d58/f6c [8207164,19055] 0 2024-09-13T22:09:14.946 INFO:tasks.workunit.client.1.smithi159.stdout:2/957: dread d9/d44/deb/dee/d77/da6/db0/f106 [0,4194304] 0 2024-09-13T22:09:14.946 INFO:tasks.workunit.client.1.smithi159.stdout:2/958: creat d9/d65/d8d/de2/d69/dc9/f14d x:0 0 0 2024-09-13T22:09:14.946 INFO:tasks.workunit.client.1.smithi159.stdout:2/959: chown d9/d65/d8d/de2/ffc 4353958 1 2024-09-13T22:09:14.950 INFO:tasks.workunit.client.1.smithi159.stdout:3/814: dread d0/d1/d3/d5/db/d39/dbe/ffd [0,4194304] 0 2024-09-13T22:09:14.954 INFO:tasks.workunit.client.1.smithi159.stdout:2/960: dread d9/d65/d8d/de2/df0/f4e [0,4194304] 0 2024-09-13T22:09:14.955 INFO:tasks.workunit.client.1.smithi159.stdout:2/961: mknod d9/d65/d8d/de2/d69/def/c14e 0 2024-09-13T22:09:14.958 INFO:tasks.workunit.client.1.smithi159.stdout:2/962: rmdir d9/da/d5a/ddf 39 2024-09-13T22:09:14.958 INFO:tasks.workunit.client.1.smithi159.stdout:2/963: write d9/d65/d8d/de2/df0/fd9 [1281459,107901] 0 2024-09-13T22:09:14.961 INFO:tasks.workunit.client.1.smithi159.stdout:2/964: truncate d9/d65/d8d/de2/d69/f74 3221932 0 2024-09-13T22:09:14.961 INFO:tasks.workunit.client.1.smithi159.stdout:2/965: chown d9/d92 5485023 1 2024-09-13T22:09:14.961 INFO:tasks.workunit.client.1.smithi159.stdout:2/966: write d9/da/d5a/ddf/ff4 [1680412,71103] 0 2024-09-13T22:09:14.961 INFO:tasks.workunit.client.1.smithi159.stdout:2/967: stat d9/d2d/db5/f13a 0 2024-09-13T22:09:14.961 INFO:tasks.workunit.client.1.smithi159.stdout:2/968: stat d9/d44/deb/d10d/f10f 0 2024-09-13T22:09:14.963 INFO:tasks.workunit.client.1.smithi159.stdout:2/969: write d9/d44/deb/f104 [814467,74394] 0 2024-09-13T22:09:14.972 INFO:tasks.workunit.client.1.smithi159.stdout:3/815: dwrite d0/db0/ff5 [0,4194304] 0 2024-09-13T22:09:14.980 INFO:tasks.workunit.client.1.smithi159.stdout:2/970: dwrite d9/d65/d8d/de2/d69/dc9/f14d [0,4194304] 0 2024-09-13T22:09:14.989 INFO:tasks.workunit.client.1.smithi159.stdout:2/971: write d9/da/d82/ffa [2147937,50834] 0 2024-09-13T22:09:14.995 INFO:tasks.workunit.client.1.smithi159.stdout:3/816: getdents d0 0 2024-09-13T22:09:14.996 INFO:tasks.workunit.client.1.smithi159.stdout:2/972: dread d9/d65/d8d/de2/df0/fd9 [0,4194304] 0 2024-09-13T22:09:14.997 INFO:tasks.workunit.client.1.smithi159.stdout:3/817: mknod d0/d1/d3/d5/d25/d4e/d5a/df4/c10b 0 2024-09-13T22:09:14.999 INFO:tasks.workunit.client.1.smithi159.stdout:2/973: mknod d9/d65/d8d/de2/d69/def/d148/c14f 0 2024-09-13T22:09:15.000 INFO:tasks.workunit.client.1.smithi159.stdout:2/974: chown d9/d44/deb/dee/d77/da6/l146 116202 1 2024-09-13T22:09:15.009 INFO:tasks.workunit.client.1.smithi159.stdout:2/975: rename d9/d92 to d9/d65/d8d/de2/d69/d66/df3/d150 0 2024-09-13T22:09:15.009 INFO:tasks.workunit.client.1.smithi159.stdout:2/976: fdatasync d9/d44/deb/dee/de9/f11d 0 2024-09-13T22:09:15.010 INFO:tasks.workunit.client.1.smithi159.stdout:9/980: sync 2024-09-13T22:09:15.012 INFO:tasks.workunit.client.1.smithi159.stdout:2/977: mkdir d9/d44/deb/dee/d77/da6/de7/d151 0 2024-09-13T22:09:15.013 INFO:tasks.workunit.client.1.smithi159.stdout:3/818: dwrite d0/d1/d3/d5/fa9 [4194304,4194304] 0 2024-09-13T22:09:15.014 INFO:tasks.workunit.client.1.smithi159.stdout:9/981: rename d1/dc/d27/c9b to d1/d5a/d101/c158 0 2024-09-13T22:09:15.016 INFO:tasks.workunit.client.1.smithi159.stdout:2/978: symlink d9/d44/deb/dee/d77/dec/l152 0 2024-09-13T22:09:15.016 INFO:tasks.workunit.client.1.smithi159.stdout:2/979: chown d9/d2d/db5/d139 3645 1 2024-09-13T22:09:15.016 INFO:tasks.workunit.client.1.smithi159.stdout:2/980: chown d9/da/d82/fa1 160 1 2024-09-13T22:09:15.018 INFO:tasks.workunit.client.1.smithi159.stdout:3/819: rmdir d0/d1/d3/d5/d25/d2c/d71 39 2024-09-13T22:09:15.019 INFO:tasks.workunit.client.1.smithi159.stdout:2/981: getdents d9/d65/dca 0 2024-09-13T22:09:15.020 INFO:tasks.workunit.client.1.smithi159.stdout:3/820: mkdir d0/d1/d81/da2/df7/d10c 0 2024-09-13T22:09:15.021 INFO:tasks.workunit.client.1.smithi159.stdout:3/821: truncate d0/d91/fd8 738471 0 2024-09-13T22:09:15.021 INFO:tasks.workunit.client.1.smithi159.stdout:3/822: chown d0/d1/d15/ff9 100 1 2024-09-13T22:09:15.024 INFO:tasks.workunit.client.1.smithi159.stdout:2/982: unlink d9/da/c17 0 2024-09-13T22:09:15.024 INFO:tasks.workunit.client.1.smithi159.stdout:2/983: dread - d9/d44/deb/dee/d77/da6/de7/f14c zero size 2024-09-13T22:09:15.025 INFO:tasks.workunit.client.1.smithi159.stdout:3/823: mknod d0/d1/dfa/c10d 0 2024-09-13T22:09:15.025 INFO:tasks.workunit.client.1.smithi159.stdout:3/824: chown d0/d1/d3/d5/db/d58 133608096 1 2024-09-13T22:09:15.027 INFO:tasks.workunit.client.1.smithi159.stdout:2/984: mknod d9/d65/d8d/c153 0 2024-09-13T22:09:15.029 INFO:tasks.workunit.client.1.smithi159.stdout:3/825: mknod d0/d1/d34/d73/c10e 0 2024-09-13T22:09:15.032 INFO:tasks.workunit.client.1.smithi159.stdout:9/982: dwrite d1/dc/d10/fb9 [0,4194304] 0 2024-09-13T22:09:15.033 INFO:tasks.workunit.client.1.smithi159.stdout:3/826: unlink d0/d78/fb7 0 2024-09-13T22:09:15.037 INFO:tasks.workunit.client.1.smithi159.stdout:9/983: link d1/dc/d10/d6d/d4b/dcb/d75/l130 d1/dc/d10/d6d/d2f/dd3/l159 0 2024-09-13T22:09:15.040 INFO:tasks.workunit.client.1.smithi159.stdout:3/827: mkdir d0/d68/dcb/d10f 0 2024-09-13T22:09:15.041 INFO:tasks.workunit.client.1.smithi159.stdout:9/984: link d1/dc/d10/d6d/d2f/d8b/d8f/lc9 d1/dc/ded/l15a 0 2024-09-13T22:09:15.042 INFO:tasks.workunit.client.1.smithi159.stdout:2/985: dwrite d9/d65/d8d/de2/d69/dab/dce/f13e [0,4194304] 0 2024-09-13T22:09:15.043 INFO:tasks.workunit.client.1.smithi159.stdout:9/985: creat d1/dc/d10/d6d/d2f/d8b/d8f/d13e/f15b x:0 0 0 2024-09-13T22:09:15.052 INFO:tasks.workunit.client.1.smithi159.stdout:2/986: unlink d9/d65/c9f 0 2024-09-13T22:09:15.053 INFO:tasks.workunit.client.1.smithi159.stdout:2/987: dread d9/d44/deb/dee/de9/f11d [0,4194304] 0 2024-09-13T22:09:15.054 INFO:tasks.workunit.client.1.smithi159.stdout:2/988: fdatasync d9/d65/d8d/de2/d69/d66/f10e 0 2024-09-13T22:09:15.057 INFO:tasks.workunit.client.1.smithi159.stdout:3/828: dwrite d0/d1/d3/f48 [4194304,4194304] 0 2024-09-13T22:09:15.059 INFO:tasks.workunit.client.1.smithi159.stdout:2/989: creat d9/da/d5a/d119/f154 x:0 0 0 2024-09-13T22:09:15.060 INFO:tasks.workunit.client.1.smithi159.stdout:2/990: dread - d9/d2d/db5/d139/f149 zero size 2024-09-13T22:09:15.060 INFO:tasks.workunit.client.1.smithi159.stdout:2/991: stat d9/d65/d8d/de2/d69/dc9/l142 0 2024-09-13T22:09:15.064 INFO:tasks.workunit.client.1.smithi159.stdout:3/829: rename d0/d1/d3/dd/cb2 to d0/d1/d3/d5/d25/d75/d5b/c110 0 2024-09-13T22:09:15.065 INFO:tasks.workunit.client.1.smithi159.stdout:9/986: dwrite d1/dc/d10/d6d/d2f/d8b/ddd/f118 [0,4194304] 0 2024-09-13T22:09:15.066 INFO:tasks.workunit.client.1.smithi159.stdout:3/830: creat d0/d1/d81/da2/df7/d10c/f111 x:0 0 0 2024-09-13T22:09:15.066 INFO:tasks.workunit.client.1.smithi159.stdout:3/831: write d0/d1/d3/d5/d25/d7e/fee [151392,15653] 0 2024-09-13T22:09:15.069 INFO:tasks.workunit.client.1.smithi159.stdout:9/987: mknod d1/d5a/c15c 0 2024-09-13T22:09:15.082 INFO:tasks.workunit.client.1.smithi159.stdout:2/992: dwrite d9/da/d5a/ddf/ff4 [0,4194304] 0 2024-09-13T22:09:15.088 INFO:tasks.workunit.client.1.smithi159.stdout:9/988: mknod d1/d154/c15d 0 2024-09-13T22:09:15.094 INFO:tasks.workunit.client.1.smithi159.stdout:3/832: rmdir d0/db0 39 2024-09-13T22:09:15.098 INFO:tasks.workunit.client.1.smithi159.stdout:9/989: rename d1/dc/d10/fb9 to d1/dc/d10/d6d/d4b/d98/da8/f15e 0 2024-09-13T22:09:15.100 INFO:tasks.workunit.client.1.smithi159.stdout:2/993: getdents d9/d44/deb/dee/de9 0 2024-09-13T22:09:15.100 INFO:tasks.workunit.client.1.smithi159.stdout:2/994: read d9/da/d82/d89/f112 [542093,120733] 0 2024-09-13T22:09:15.100 INFO:tasks.workunit.client.1.smithi159.stdout:2/995: chown d9/d65/dca/lf2 3 1 2024-09-13T22:09:15.101 INFO:tasks.workunit.client.1.smithi159.stdout:3/833: symlink d0/d1/dfa/l112 0 2024-09-13T22:09:15.101 INFO:tasks.workunit.client.1.smithi159.stdout:3/834: readlink d0/d1/d3/d5/db/d58/l61 0 2024-09-13T22:09:15.103 INFO:tasks.workunit.client.1.smithi159.stdout:2/996: dread d9/f1d [0,4194304] 0 2024-09-13T22:09:15.103 INFO:tasks.workunit.client.1.smithi159.stdout:9/990: creat d1/d5a/d101/f15f x:0 0 0 2024-09-13T22:09:15.103 INFO:tasks.workunit.client.1.smithi159.stdout:3/835: mknod d0/d1/d3/d5/db/d58/dc1/c113 0 2024-09-13T22:09:15.104 INFO:tasks.workunit.client.1.smithi159.stdout:2/997: symlink d9/da/d82/l155 0 2024-09-13T22:09:15.105 INFO:tasks.workunit.client.1.smithi159.stdout:9/991: mknod d1/dc/d10/d6d/d4b/c160 0 2024-09-13T22:09:15.107 INFO:tasks.workunit.client.1.smithi159.stdout:3/836: mknod d0/d1/d3/d5/d25/d7e/c114 0 2024-09-13T22:09:15.110 INFO:tasks.workunit.client.1.smithi159.stdout:9/992: rename d1/dc/d27/da4/fe1 to d1/d9/d1f/d11b/f161 0 2024-09-13T22:09:15.110 INFO:tasks.workunit.client.1.smithi159.stdout:9/993: chown d1/dc/d10/d6d/d4b/dcb/d74/de3/l13c 22582175 1 2024-09-13T22:09:15.116 INFO:tasks.workunit.client.1.smithi159.stdout:2/998: dread d9/da/f24 [0,4194304] 0 2024-09-13T22:09:15.120 INFO:tasks.workunit.client.1.smithi159.stdout:2/999: symlink d9/d65/d8d/de2/df0/l156 0 2024-09-13T22:09:15.123 INFO:tasks.workunit.client.1.smithi159.stdout:3/837: dwrite d0/d1/d3/d5/db/dc6/fd2 [0,4194304] 0 2024-09-13T22:09:15.134 INFO:tasks.workunit.client.1.smithi159.stdout:9/994: dwrite d1/d9/dab/fee [4194304,4194304] 0 2024-09-13T22:09:15.137 INFO:tasks.workunit.client.1.smithi159.stdout:3/838: write d0/d1/d3/d5/d25/fc0 [2187482,92218] 0 2024-09-13T22:09:15.137 INFO:tasks.workunit.client.1.smithi159.stdout:3/839: stat d0/d1/d81/da2 0 2024-09-13T22:09:15.137 INFO:tasks.workunit.client.1.smithi159.stdout:3/840: chown d0/d1/d3/d5/d25/d4e/d5a/d9b/caa 1 1 2024-09-13T22:09:15.143 INFO:tasks.workunit.client.1.smithi159.stdout:9/995: read d1/dc/d10/d6d/d4b/d98/da8/f15e [381257,33959] 0 2024-09-13T22:09:15.145 INFO:tasks.workunit.client.1.smithi159.stdout:9/996: creat d1/dc/d10/d9c/f162 x:0 0 0 2024-09-13T22:09:15.147 INFO:tasks.workunit.client.1.smithi159.stdout:9/997: rename d1/dc/d10/d6d/d4b/l7e to d1/dc/ded/l163 0 2024-09-13T22:09:15.147 INFO:tasks.workunit.client.1.smithi159.stdout:9/998: dread - d1/dc/d10/d6d/d2f/d8b/d8f/f127 zero size 2024-09-13T22:09:15.148 INFO:tasks.workunit.client.1.smithi159.stdout:9/999: unlink d1/dc/d10/d6d/d4b/f6c 0 2024-09-13T22:09:15.161 INFO:tasks.workunit.client.1.smithi159.stdout:3/841: dwrite d0/d1/d3/d5/d25/d4e/d92/fae [0,4194304] 0 2024-09-13T22:09:15.162 INFO:tasks.workunit.client.1.smithi159.stdout:3/842: dread d0/d91/fd8 [0,4194304] 0 2024-09-13T22:09:15.231 INFO:tasks.workunit.client.1.smithi159.stdout:3/843: dwrite d0/d1/d3/d5/d25/d4e/d92/fae [4194304,4194304] 0 2024-09-13T22:09:15.252 INFO:tasks.workunit.client.1.smithi159.stdout:3/844: dwrite d0/d1/d3/d5/d25/d4e/fe2 [0,4194304] 0 2024-09-13T22:09:15.254 INFO:tasks.workunit.client.1.smithi159.stdout:3/845: rmdir d0/d1/d3/d5/d25/d2c/d71 39 2024-09-13T22:09:15.256 INFO:tasks.workunit.client.1.smithi159.stdout:3/846: creat d0/f115 x:0 0 0 2024-09-13T22:09:15.257 INFO:tasks.workunit.client.1.smithi159.stdout:3/847: truncate d0/d1/d81/da2/f105 186410 0 2024-09-13T22:09:15.259 INFO:tasks.workunit.client.1.smithi159.stdout:3/848: creat d0/d68/f116 x:0 0 0 2024-09-13T22:09:15.272 INFO:tasks.workunit.client.1.smithi159.stdout:3/849: read d0/d1/d3/f1f [879289,26788] 0 2024-09-13T22:09:15.274 INFO:tasks.workunit.client.1.smithi159.stdout:3/850: creat d0/d1/d3/d5/d25/d2c/d71/d8f/f117 x:0 0 0 2024-09-13T22:09:15.274 INFO:tasks.workunit.client.1.smithi159.stdout:3/851: chown d0/d1/d3/d5/db/d58/f103 1021848095 1 2024-09-13T22:09:15.278 INFO:tasks.workunit.client.1.smithi159.stdout:3/852: mknod d0/d68/dcb/c118 0 2024-09-13T22:09:15.290 INFO:tasks.workunit.client.1.smithi159.stdout:3/853: dread d0/d1/d34/d73/f77 [0,4194304] 0 2024-09-13T22:09:15.301 INFO:tasks.workunit.client.1.smithi159.stdout:3/854: dread d0/d1/d3/d5/f88 [0,4194304] 0 2024-09-13T22:09:15.303 INFO:tasks.workunit.client.1.smithi159.stdout:3/855: unlink d0/d1/d3/d5/d25/d4e/d5a/d9b/cc8 0 2024-09-13T22:09:15.303 INFO:tasks.workunit.client.1.smithi159.stdout:3/856: creat d0/d1/f119 x:0 0 0 2024-09-13T22:09:15.326 INFO:tasks.workunit.client.1.smithi159.stdout:3/857: dwrite d0/d1/d3/d5/db/f60 [0,4194304] 0 2024-09-13T22:09:15.329 INFO:tasks.workunit.client.1.smithi159.stdout:3/858: mkdir d0/d68/d11a 0 2024-09-13T22:09:15.354 INFO:tasks.workunit.client.1.smithi159.stdout:3/859: dwrite d0/d1/d3/d5/d25/d75/d5b/d45/f53 [0,4194304] 0 2024-09-13T22:09:15.445 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:15 smithi089 ceph-mon[27921]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:15.446 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:15 smithi089 ceph-mon[27921]: pgmap v5: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T22:09:15.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:15 smithi159 ceph-mon[35348]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:15.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:15 smithi159 ceph-mon[35348]: pgmap v5: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T22:09:15.816 INFO:tasks.workunit.client.1.smithi159.stdout:3/860: sync 2024-09-13T22:09:15.831 INFO:tasks.workunit.client.1.smithi159.stdout:3/861: dwrite d0/d1/d3/d5/d25/d4e/d5a/d9b/fd3 [0,4194304] 0 2024-09-13T22:09:15.832 INFO:tasks.workunit.client.1.smithi159.stdout:3/862: write d0/d1/d3/d5/d25/d2c/d65/f72 [2764572,75554] 0 2024-09-13T22:09:15.842 INFO:tasks.workunit.client.1.smithi159.stdout:3/863: write d0/d1/d3/d5/d25/d7e/fd7 [1042515,44006] 0 2024-09-13T22:09:15.843 INFO:tasks.workunit.client.1.smithi159.stdout:3/864: rename d0/d1/d3/d5/fea to d0/d1/d3/d5/d25/d4e/d5a/df4/f11b 0 2024-09-13T22:09:15.843 INFO:tasks.workunit.client.1.smithi159.stdout:3/865: creat d0/d1/d15/f11c x:0 0 0 2024-09-13T22:09:15.845 INFO:tasks.workunit.client.1.smithi159.stdout:3/866: mkdir d0/d1/d3/d5/db/d39/d11d 0 2024-09-13T22:09:15.847 INFO:tasks.workunit.client.1.smithi159.stdout:3/867: symlink d0/d1/d3/l11e 0 2024-09-13T22:09:15.853 INFO:tasks.workunit.client.1.smithi159.stdout:3/868: dread d0/d1/d3/f48 [0,4194304] 0 2024-09-13T22:09:15.879 INFO:tasks.workunit.client.1.smithi159.stdout:3/869: dwrite d0/d1/d3/d5/f55 [0,4194304] 0 2024-09-13T22:09:15.879 INFO:tasks.workunit.client.1.smithi159.stdout:3/870: chown d0/d1/f74 1527118 1 2024-09-13T22:09:15.881 INFO:tasks.workunit.client.1.smithi159.stdout:3/871: creat d0/d1/d3/d5/db/d58/dc1/f11f x:0 0 0 2024-09-13T22:09:15.881 INFO:tasks.workunit.client.1.smithi159.stdout:3/872: readlink d0/d1/d3/l11e 0 2024-09-13T22:09:15.881 INFO:tasks.workunit.client.1.smithi159.stdout:3/873: truncate d0/d1/d3/d5/db/d58/f6c 9298519 0 2024-09-13T22:09:15.881 INFO:tasks.workunit.client.1.smithi159.stdout:3/874: creat d0/d1/dfa/f120 x:0 0 0 2024-09-13T22:09:15.936 INFO:tasks.workunit.client.1.smithi159.stdout:3/875: dwrite d0/d1/d3/d5/db/d39/dbe/ffd [0,4194304] 0 2024-09-13T22:09:15.944 INFO:tasks.workunit.client.1.smithi159.stdout:3/876: dread d0/d1/f47 [0,4194304] 0 2024-09-13T22:09:15.944 INFO:tasks.workunit.client.1.smithi159.stdout:3/877: truncate d0/d1/d3/d5/d25/d75/d5b/d45/fd4 440458 0 2024-09-13T22:09:15.960 INFO:tasks.workunit.client.1.smithi159.stdout:3/878: dwrite d0/db0/ff5 [0,4194304] 0 2024-09-13T22:09:15.963 INFO:tasks.workunit.client.1.smithi159.stdout:3/879: dread d0/d1/d3/dd/f64 [0,4194304] 0 2024-09-13T22:09:15.964 INFO:tasks.workunit.client.1.smithi159.stdout:3/880: truncate d0/d1/d3/f48 4015154 0 2024-09-13T22:09:15.966 INFO:tasks.workunit.client.1.smithi159.stdout:3/881: rename d0/d1/d3/d5/d25/d4e/d9f/lb9 to d0/d78/l121 0 2024-09-13T22:09:15.968 INFO:tasks.workunit.client.1.smithi159.stdout:3/882: symlink d0/d1/d3/d5/d25/d4e/d9f/l122 0 2024-09-13T22:09:15.968 INFO:tasks.workunit.client.1.smithi159.stdout:3/883: stat d0/d1/d34/f40 0 2024-09-13T22:09:15.968 INFO:tasks.workunit.client.1.smithi159.stdout:3/884: chown d0/d1/d3/dd/l109 0 1 2024-09-13T22:09:15.968 INFO:tasks.workunit.client.1.smithi159.stdout:3/885: chown d0/d1/d3/d5/d25/d4e/d5a/df4 0 1 2024-09-13T22:09:15.976 INFO:tasks.workunit.client.1.smithi159.stdout:3/886: write d0/d1/d3/d5/db/d39/dbe/ffd [2836340,30322] 0 2024-09-13T22:09:15.977 INFO:tasks.workunit.client.1.smithi159.stdout:3/887: mknod d0/d1/d34/d73/c123 0 2024-09-13T22:09:15.980 INFO:tasks.workunit.client.1.smithi159.stdout:3/888: rmdir d0/d1/d3/d5/d25/d2c 39 2024-09-13T22:09:15.989 INFO:tasks.workunit.client.1.smithi159.stdout:3/889: write d0/d1/d15/f99 [1170172,51625] 0 2024-09-13T22:09:15.991 INFO:tasks.workunit.client.1.smithi159.stdout:3/890: rename d0/d1/d34/d73/f77 to d0/d1/d81/f124 0 2024-09-13T22:09:15.991 INFO:tasks.workunit.client.1.smithi159.stdout:3/891: truncate d0/d1/d81/f124 8569900 0 2024-09-13T22:09:15.997 INFO:tasks.workunit.client.1.smithi159.stdout:3/892: dread d0/d1/d3/d5/f17 [8388608,4194304] 0 2024-09-13T22:09:15.997 INFO:tasks.workunit.client.1.smithi159.stdout:3/893: fsync d0/d1/d3/d5/db/d58/dc1/f11f 0 2024-09-13T22:09:15.998 INFO:tasks.workunit.client.1.smithi159.stdout:3/894: creat d0/d68/f125 x:0 0 0 2024-09-13T22:09:16.014 INFO:tasks.workunit.client.1.smithi159.stdout:3/895: dwrite d0/d1/d3/d5/d25/d75/d5b/fdf [0,4194304] 0 2024-09-13T22:09:16.017 INFO:tasks.workunit.client.1.smithi159.stdout:3/896: read d0/d1/d3/d5/d25/d2c/f32 [3725143,29625] 0 2024-09-13T22:09:16.039 INFO:tasks.workunit.client.1.smithi159.stdout:3/897: rmdir d0/d1 39 2024-09-13T22:09:16.040 INFO:tasks.workunit.client.1.smithi159.stdout:3/898: stat d0/d1/d3/d5/d25/d4e/d9f/lb5 0 2024-09-13T22:09:16.043 INFO:tasks.workunit.client.1.smithi159.stdout:3/899: mkdir d0/d1/d15/d126 0 2024-09-13T22:09:16.044 INFO:tasks.workunit.client.1.smithi159.stdout:3/900: truncate d0/d1/d34/fad 1759692 0 2024-09-13T22:09:16.046 INFO:tasks.workunit.client.1.smithi159.stdout:3/901: truncate d0/d1/d3/dd/f20 3049666 0 2024-09-13T22:09:16.048 INFO:tasks.workunit.client.1.smithi159.stdout:3/902: symlink d0/d1/d3/d5/db/d39/dbe/l127 0 2024-09-13T22:09:16.050 INFO:tasks.workunit.client.1.smithi159.stdout:3/903: creat d0/d68/dcb/d10f/f128 x:0 0 0 2024-09-13T22:09:16.050 INFO:tasks.workunit.client.1.smithi159.stdout:3/904: fsync d0/d1/d3/d5/d25/d2c/f33 0 2024-09-13T22:09:16.050 INFO:tasks.workunit.client.1.smithi159.stdout:3/905: truncate d0/d68/fbc 799178 0 2024-09-13T22:09:16.050 INFO:tasks.workunit.client.1.smithi159.stdout:3/906: readlink d0/d1/d3/d5/db/lbf 0 2024-09-13T22:09:16.051 INFO:tasks.workunit.client.1.smithi159.stdout:3/907: truncate d0/d1/d3/f1f 4123982 0 2024-09-13T22:09:16.521 INFO:tasks.workunit.client.1.smithi159.stdout:3/908: sync 2024-09-13T22:09:16.521 INFO:tasks.workunit.client.1.smithi159.stdout:3/909: symlink d0/d1/d3/d5/db/d39/l129 0 2024-09-13T22:09:16.522 INFO:tasks.workunit.client.1.smithi159.stdout:3/910: unlink d0/d1/d15/c101 0 2024-09-13T22:09:16.524 INFO:tasks.workunit.client.1.smithi159.stdout:3/911: unlink d0/d1/d3/d5/db/d39/f6a 0 2024-09-13T22:09:16.540 INFO:tasks.workunit.client.1.smithi159.stdout:3/912: dwrite d0/d1/d3/d5/db/d58/f103 [0,4194304] 0 2024-09-13T22:09:16.540 INFO:tasks.workunit.client.1.smithi159.stdout:3/913: write d0/d1/d15/ff9 [595616,86999] 0 2024-09-13T22:09:16.550 INFO:tasks.workunit.client.1.smithi159.stdout:3/914: dread d0/d1/d3/d5/d25/d4e/d5a/f67 [0,4194304] 0 2024-09-13T22:09:16.551 INFO:tasks.workunit.client.1.smithi159.stdout:3/915: read d0/d1/d81/da2/f105 [37153,52968] 0 2024-09-13T22:09:16.551 INFO:tasks.workunit.client.1.smithi159.stdout:3/916: chown d0/d1/d3/d5/db/d39 54 1 2024-09-13T22:09:16.551 INFO:tasks.workunit.client.1.smithi159.stdout:3/917: write d0/d1/d3/d5/d25/d4e/d5a/df4/f11b [194328,94574] 0 2024-09-13T22:09:16.568 INFO:tasks.workunit.client.1.smithi159.stdout:3/918: dwrite d0/d1/d3/d5/d25/d4e/d5a/d9b/fd3 [0,4194304] 0 2024-09-13T22:09:16.588 INFO:tasks.workunit.client.1.smithi159.stdout:3/919: dwrite d0/d1/f47 [0,4194304] 0 2024-09-13T22:09:16.589 INFO:tasks.workunit.client.1.smithi159.stdout:3/920: read d0/d1/d3/d5/d25/d75/d5b/d45/f7d [2666665,98103] 0 2024-09-13T22:09:16.589 INFO:tasks.workunit.client.1.smithi159.stdout:3/921: symlink d0/d1/dfa/l12a 0 2024-09-13T22:09:16.608 INFO:tasks.workunit.client.1.smithi159.stdout:3/922: dwrite d0/d1/d3/d5/d25/fde [0,4194304] 0 2024-09-13T22:09:16.611 INFO:tasks.workunit.client.1.smithi159.stdout:3/923: creat d0/d1/d81/da2/f12b x:0 0 0 2024-09-13T22:09:16.611 INFO:tasks.workunit.client.1.smithi159.stdout:3/924: write d0/d1/d3/d5/db/d39/dbe/ff8 [163465,81849] 0 2024-09-13T22:09:16.613 INFO:tasks.workunit.client.1.smithi159.stdout:3/925: rename d0/d1/d3/d5/d25/d2c/d71 to d0/d1/d3/d5/d25/d94/d12c 0 2024-09-13T22:09:16.613 INFO:tasks.workunit.client.1.smithi159.stdout:3/926: chown d0/d1/d3/d5/d25/d4e/d92 2330338 1 2024-09-13T22:09:16.614 INFO:tasks.workunit.client.1.smithi159.stdout:3/927: readlink d0/d1/d3/l11e 0 2024-09-13T22:09:16.615 INFO:tasks.workunit.client.1.smithi159.stdout:3/928: creat d0/db0/f12d x:0 0 0 2024-09-13T22:09:16.630 INFO:tasks.workunit.client.1.smithi159.stdout:3/929: dwrite d0/d1/d15/ff9 [0,4194304] 0 2024-09-13T22:09:16.631 INFO:tasks.workunit.client.1.smithi159.stdout:3/930: truncate d0/d1/d3/d5/d25/d7e/fd7 3864069 0 2024-09-13T22:09:16.633 INFO:tasks.workunit.client.1.smithi159.stdout:3/931: rename d0/d1/d3/d5/d25/d4e/d9f/lb5 to d0/d1/d34/l12e 0 2024-09-13T22:09:16.637 INFO:tasks.workunit.client.1.smithi159.stdout:3/932: creat d0/d1/d3/d5/d25/d4e/d5a/f12f x:0 0 0 2024-09-13T22:09:16.637 INFO:tasks.workunit.client.1.smithi159.stdout:3/933: dread - d0/d1/d3/d5/db/d58/dc1/f11f zero size 2024-09-13T22:09:16.639 INFO:tasks.workunit.client.1.smithi159.stdout:3/934: fdatasync d0/d1/d3/d5/d25/d4e/d5a/df4/f11b 0 2024-09-13T22:09:16.641 INFO:tasks.workunit.client.1.smithi159.stdout:3/935: creat d0/d1/d3/d5/db/d58/f130 x:0 0 0 2024-09-13T22:09:16.642 INFO:tasks.workunit.client.1.smithi159.stdout:3/936: rename d0/d1/d3/d5/db/d39/l129 to d0/d1/d3/d5/d25/d94/l131 0 2024-09-13T22:09:16.644 INFO:tasks.workunit.client.1.smithi159.stdout:3/937: rmdir d0/d1/d3/d5/db/d39/d11d 0 2024-09-13T22:09:16.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:16 smithi089 ceph-mon[27921]: mgrmap e24: smithi159.ghpomd(active, since 4s) 2024-09-13T22:09:16.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:16 smithi159 ceph-mon[35348]: mgrmap e24: smithi159.ghpomd(active, since 4s) 2024-09-13T22:09:17.077 INFO:tasks.workunit.client.1.smithi159.stdout:3/938: sync 2024-09-13T22:09:17.078 INFO:tasks.workunit.client.1.smithi159.stdout:3/939: mkdir d0/d1/dfa/d132 0 2024-09-13T22:09:17.078 INFO:tasks.workunit.client.1.smithi159.stdout:3/940: read - d0/d1/d3/d5/d25/d94/d12c/d8f/f117 zero size 2024-09-13T22:09:17.079 INFO:tasks.workunit.client.1.smithi159.stdout:3/941: rename d0/d1/d34/d73/lc5 to d0/d1/d81/da2/df7/l133 0 2024-09-13T22:09:17.079 INFO:tasks.workunit.client.1.smithi159.stdout:3/942: rename d0 to d0/d1/d3/d134 22 2024-09-13T22:09:17.082 INFO:tasks.workunit.client.1.smithi159.stdout:3/943: rename d0/f57 to d0/d68/d11a/f135 0 2024-09-13T22:09:17.099 INFO:tasks.workunit.client.1.smithi159.stdout:3/944: dwrite d0/d1/d81/da2/f12b [0,4194304] 0 2024-09-13T22:09:17.099 INFO:tasks.workunit.client.1.smithi159.stdout:3/945: chown d0/d1/d15/d126 11 1 2024-09-13T22:09:17.105 INFO:tasks.workunit.client.1.smithi159.stdout:3/946: dread d0/d1/d3/d5/d25/d2c/d65/f72 [0,4194304] 0 2024-09-13T22:09:17.122 INFO:tasks.workunit.client.1.smithi159.stdout:3/947: dwrite d0/d1/d3/d5/d25/d75/d5b/fdf [0,4194304] 0 2024-09-13T22:09:17.122 INFO:tasks.workunit.client.1.smithi159.stdout:3/948: symlink d0/d1/d15/l136 0 2024-09-13T22:09:17.124 INFO:tasks.workunit.client.1.smithi159.stdout:3/949: creat d0/d1/d3/d5/d25/d75/d5b/d45/f137 x:0 0 0 2024-09-13T22:09:17.137 INFO:tasks.workunit.client.1.smithi159.stdout:3/950: dwrite d0/d1/d3/d5/d25/d94/d12c/d8f/f117 [0,4194304] 0 2024-09-13T22:09:17.140 INFO:tasks.workunit.client.1.smithi159.stdout:3/951: rmdir d0/d1/d3/d5/d25/d2c 39 2024-09-13T22:09:17.142 INFO:tasks.workunit.client.1.smithi159.stdout:3/952: link d0/db0/ff5 d0/d1/d3/d5/d25/d2c/d65/f138 0 2024-09-13T22:09:17.144 INFO:tasks.workunit.client.1.smithi159.stdout:3/953: read d0/d1/d3/d5/db/d58/fdd [602397,128776] 0 2024-09-13T22:09:17.146 INFO:tasks.workunit.client.1.smithi159.stdout:3/954: creat d0/d1/d81/f139 x:0 0 0 2024-09-13T22:09:17.146 INFO:tasks.workunit.client.1.smithi159.stdout:3/955: creat d0/d68/dcb/d10f/f13a x:0 0 0 2024-09-13T22:09:17.146 INFO:tasks.workunit.client.1.smithi159.stdout:3/956: write d0/d1/d3/dd/fe0 [981614,49771] 0 2024-09-13T22:09:17.146 INFO:tasks.workunit.client.1.smithi159.stdout:3/957: chown d0/d68/dcb/d10f/f13a 1900 1 2024-09-13T22:09:17.146 INFO:tasks.workunit.client.1.smithi159.stdout:3/958: chown d0/d1/d3/d5/d25/d75/d5b/d45 117032 1 2024-09-13T22:09:17.147 INFO:tasks.workunit.client.1.smithi159.stdout:3/959: creat d0/d1/d81/f13b x:0 0 0 2024-09-13T22:09:17.147 INFO:tasks.workunit.client.1.smithi159.stdout:3/960: stat d0/f10a 0 2024-09-13T22:09:17.147 INFO:tasks.workunit.client.1.smithi159.stdout:3/961: creat d0/d68/dcb/d10f/f13c x:0 0 0 2024-09-13T22:09:17.149 INFO:tasks.workunit.client.1.smithi159.stdout:3/962: mkdir d0/d1/d3/d5/db/d39/d13d 0 2024-09-13T22:09:17.149 INFO:tasks.workunit.client.1.smithi159.stdout:3/963: dread - d0/d1/d3/d5/d25/d75/d5b/d45/f137 zero size 2024-09-13T22:09:17.166 INFO:tasks.workunit.client.1.smithi159.stdout:3/964: dwrite d0/d91/fd8 [0,4194304] 0 2024-09-13T22:09:17.191 INFO:tasks.workunit.client.1.smithi159.stdout:3/965: dwrite d0/d91/f108 [0,4194304] 0 2024-09-13T22:09:17.194 INFO:tasks.workunit.client.1.smithi159.stdout:3/966: rmdir d0/d1/dfa/d132 0 2024-09-13T22:09:17.216 INFO:tasks.workunit.client.1.smithi159.stdout:3/967: dwrite d0/d1/d3/d5/f31 [0,4194304] 0 2024-09-13T22:09:17.216 INFO:tasks.workunit.client.1.smithi159.stdout:3/968: write d0/d91/f100 [655013,7217] 0 2024-09-13T22:09:17.217 INFO:tasks.workunit.client.1.smithi159.stdout:3/969: creat d0/d68/d11a/f13e x:0 0 0 2024-09-13T22:09:17.218 INFO:tasks.workunit.client.1.smithi159.stdout:3/970: rmdir d0/d1 39 2024-09-13T22:09:17.220 INFO:tasks.workunit.client.1.smithi159.stdout:3/971: mknod d0/d1/d3/d5/db/c13f 0 2024-09-13T22:09:17.246 INFO:tasks.workunit.client.1.smithi159.stdout:3/972: rmdir d0 39 2024-09-13T22:09:17.247 INFO:tasks.workunit.client.1.smithi159.stdout:3/973: symlink d0/d1/d3/d5/d25/d2c/d65/l140 0 2024-09-13T22:09:17.248 INFO:tasks.workunit.client.1.smithi159.stdout:3/974: rmdir d0/d1/d3/d5/d25/d2c/d65 39 2024-09-13T22:09:17.248 INFO:tasks.workunit.client.1.smithi159.stdout:3/975: write d0/d68/dcb/d10f/f13c [977812,124189] 0 2024-09-13T22:09:17.248 INFO:tasks.workunit.client.1.smithi159.stdout:3/976: truncate d0/d1/d3/d5/db/d39/dbe/fc7 61160 0 2024-09-13T22:09:17.271 INFO:tasks.workunit.client.1.smithi159.stdout:3/977: dwrite d0/d1/d34/fbd [0,4194304] 0 2024-09-13T22:09:17.293 INFO:tasks.workunit.client.1.smithi159.stdout:3/978: dwrite d0/d91/fd8 [0,4194304] 0 2024-09-13T22:09:17.297 INFO:tasks.workunit.client.1.smithi159.stdout:3/979: rmdir d0/d1/d3/d5/d25/d94 39 2024-09-13T22:09:17.301 INFO:tasks.workunit.client.1.smithi159.stdout:3/980: link d0/d1/d81/da2/f105 d0/d1/d3/d5/db/d39/dbe/f141 0 2024-09-13T22:09:17.305 INFO:tasks.workunit.client.1.smithi159.stdout:3/981: creat d0/d1/d3/d5/db/d39/d13d/f142 x:0 0 0 2024-09-13T22:09:17.322 INFO:tasks.workunit.client.1.smithi159.stdout:3/982: getdents d0/d1/d3/d5/db/d39/d13d 0 2024-09-13T22:09:17.326 INFO:tasks.workunit.client.1.smithi159.stdout:3/983: symlink d0/d1/d3/d5/d25/d4e/l143 0 2024-09-13T22:09:17.326 INFO:tasks.workunit.client.1.smithi159.stdout:3/984: fdatasync d0/d1/d3/d5/d25/d94/d12c/d8f/fa3 0 2024-09-13T22:09:17.326 INFO:tasks.workunit.client.1.smithi159.stdout:3/985: chown d0/d1/d3/d5/db/d39/dbe/l127 4 1 2024-09-13T22:09:17.326 INFO:tasks.workunit.client.1.smithi159.stdout:3/986: fdatasync d0/d68/f7b 0 2024-09-13T22:09:17.328 INFO:tasks.workunit.client.1.smithi159.stdout:3/987: link d0/d1/dfa/l12a d0/db0/l144 0 2024-09-13T22:09:17.328 INFO:tasks.workunit.client.1.smithi159.stdout:3/988: dread - d0/d1/d3/d5/d25/d75/d5b/d45/d8c/fa4 zero size 2024-09-13T22:09:17.328 INFO:tasks.workunit.client.1.smithi159.stdout:3/989: write d0/d1/d81/da2/f105 [1042174,81357] 0 2024-09-13T22:09:17.328 INFO:tasks.workunit.client.1.smithi159.stdout:3/990: fdatasync d0/d91/f108 0 2024-09-13T22:09:17.330 INFO:tasks.workunit.client.1.smithi159.stdout:3/991: rename d0/d1/d3/d5/d25/d94/d12c/c8a to d0/d1/d3/d5/db/dc6/c145 0 2024-09-13T22:09:17.354 INFO:tasks.workunit.client.1.smithi159.stdout:3/992: dwrite d0/d68/d11a/f13e [0,4194304] 0 2024-09-13T22:09:17.357 INFO:tasks.workunit.client.1.smithi159.stdout:3/993: mkdir d0/d1/d3/d5/d25/d2c/d146 0 2024-09-13T22:09:17.357 INFO:tasks.workunit.client.1.smithi159.stdout:3/994: fdatasync d0/d1/dfa/f120 0 2024-09-13T22:09:17.386 INFO:tasks.workunit.client.1.smithi159.stdout:3/995: dwrite d0/d1/d3/d5/db/dc6/fca [0,4194304] 0 2024-09-13T22:09:17.391 INFO:tasks.workunit.client.1.smithi159.stdout:3/996: mknod d0/d1/dfa/c147 0 2024-09-13T22:09:17.403 INFO:tasks.workunit.client.1.smithi159.stdout:3/997: write d0/d1/f47 [1757223,27714] 0 2024-09-13T22:09:17.404 INFO:tasks.workunit.client.1.smithi159.stdout:3/998: dread d0/d1/d3/d5/d25/d7e/fee [0,4194304] 0 2024-09-13T22:09:17.407 INFO:tasks.workunit.client.1.smithi159.stdout:3/999: creat d0/d1/d81/f148 x:0 0 0 2024-09-13T22:09:17.415 INFO:tasks.workunit.client.1.smithi159.stderr:+ rm -rf -- ./tmp.8iGUkoBjqV 2024-09-13T22:09:17.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:17 smithi089 ceph-mon[27921]: Standby manager daemon smithi089.naneiw started 2024-09-13T22:09:17.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:17 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.89:0/898407236' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.naneiw/crt"}]: dispatch 2024-09-13T22:09:17.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:17 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.89:0/898407236' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:09:17.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:17 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.89:0/898407236' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.naneiw/key"}]: dispatch 2024-09-13T22:09:17.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:17 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.89:0/898407236' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:09:17.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:17 smithi089 ceph-mon[27921]: pgmap v6: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T22:09:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:17 smithi159 ceph-mon[35348]: Standby manager daemon smithi089.naneiw started 2024-09-13T22:09:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:17 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.89:0/898407236' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.naneiw/crt"}]: dispatch 2024-09-13T22:09:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:17 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.89:0/898407236' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:09:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:17 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.89:0/898407236' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.naneiw/key"}]: dispatch 2024-09-13T22:09:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:17 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.89:0/898407236' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:09:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:17 smithi159 ceph-mon[35348]: pgmap v6: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T22:09:18.633 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:18 smithi089 ceph-mon[27921]: mgrmap e25: smithi159.ghpomd(active, since 6s), standbys: smithi089.naneiw 2024-09-13T22:09:18.633 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:18 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T22:09:18.669 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:18 smithi159 ceph-mon[35348]: mgrmap e25: smithi159.ghpomd(active, since 6s), standbys: smithi089.naneiw 2024-09-13T22:09:18.669 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:18 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T22:09:19.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:19 smithi089 ceph-mon[27921]: pgmap v7: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 64 MiB/s wr, 299 op/s 2024-09-13T22:09:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:19 smithi159 ceph-mon[35348]: pgmap v7: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 64 MiB/s wr, 299 op/s 2024-09-13T22:09:20.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:20 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:20 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:20 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:20 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:20 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:20 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:20 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:20 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:20 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:20 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:20 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:20 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:21.846 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:21.846 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:21.846 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.846 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.846 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.846 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.847 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.847 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.847 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: Adjusting osd_memory_target on smithi089 to 1215M 2024-09-13T22:09:21.847 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:21.847 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:21 smithi159 ceph-mon[35348]: pgmap v8: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 50 MiB/s wr, 231 op/s 2024-09-13T22:09:21.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: Adjusting osd_memory_target on smithi089 to 1215M 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:21 smithi089 ceph-mon[27921]: pgmap v8: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 50 MiB/s wr, 231 op/s 2024-09-13T22:09:24.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:24 smithi089 ceph-mon[27921]: pgmap v9: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 32 MiB/s rd, 42 MiB/s wr, 363 op/s 2024-09-13T22:09:24.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:24 smithi159 ceph-mon[35348]: pgmap v9: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 32 MiB/s rd, 42 MiB/s wr, 363 op/s 2024-09-13T22:09:26.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:26 smithi089 ceph-mon[27921]: pgmap v10: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 37 MiB/s wr, 327 op/s 2024-09-13T22:09:26.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:26 smithi159 ceph-mon[35348]: pgmap v10: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 37 MiB/s wr, 327 op/s 2024-09-13T22:09:27.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:27 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:27.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:27 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:28.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:28 smithi159 ceph-mon[35348]: pgmap v11: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 37 MiB/s wr, 327 op/s 2024-09-13T22:09:28.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:28 smithi089 ceph-mon[27921]: pgmap v11: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 37 MiB/s wr, 327 op/s 2024-09-13T22:09:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: Adjusting osd_memory_target on smithi159 to 2240M 2024-09-13T22:09:29.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:29.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:09:29.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:09:29.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:09:29.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:09:29.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:09:29.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:09:29.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:09:29.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:09:29.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:29 smithi089 ceph-mon[27921]: pgmap v12: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 28 MiB/s rd, 38 MiB/s wr, 463 op/s 2024-09-13T22:09:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: Adjusting osd_memory_target on smithi159 to 2240M 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:09:29.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:09:29.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:29 smithi159 ceph-mon[35348]: pgmap v12: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 28 MiB/s rd, 38 MiB/s wr, 463 op/s 2024-09-13T22:09:30.945 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:30 smithi089 ceph-mon[27921]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:09:30.945 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:30 smithi089 ceph-mon[27921]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:09:30.945 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:30 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:30.945 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:30 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:30.945 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:30 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:30.945 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:30 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:30.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:30 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:30.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:30 smithi089 ceph-mon[27921]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T22:09:30.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:30 smithi089 ceph-mon[27921]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T22:09:31.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:30 smithi159 ceph-mon[35348]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:09:31.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:30 smithi159 ceph-mon[35348]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:09:31.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:30 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:31.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:30 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:31.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:30 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:31.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:30 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:31.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:30 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:31.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:30 smithi159 ceph-mon[35348]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T22:09:31.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:30 smithi159 ceph-mon[35348]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T22:09:31.910 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:31 smithi159 ceph-mon[35348]: pgmap v13: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 386 KiB/s rd, 1.6 MiB/s wr, 293 op/s 2024-09-13T22:09:31.948 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:31 smithi089 ceph-mon[27921]: pgmap v13: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 386 KiB/s rd, 1.6 MiB/s wr, 293 op/s 2024-09-13T22:09:34.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:34 smithi089 ceph-mon[27921]: pgmap v14: 65 pgs: 65 active+clean; 1017 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 406 KiB/s rd, 2.4 MiB/s wr, 468 op/s 2024-09-13T22:09:34.503 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:34 smithi159 ceph-mon[35348]: pgmap v14: 65 pgs: 65 active+clean; 1017 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 406 KiB/s rd, 2.4 MiB/s wr, 468 op/s 2024-09-13T22:09:36.204 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:36 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:36.204 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:36 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:36.204 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:36 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:09:36.204 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:36 smithi089 ceph-mon[27921]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:09:36.204 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:36 smithi089 ceph-mon[27921]: pgmap v15: 65 pgs: 65 active+clean; 1017 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 KiB/s rd, 1.5 MiB/s wr, 310 op/s 2024-09-13T22:09:36.205 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:36 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:36.205 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:36 smithi089 ceph-mon[27921]: Upgrade: Need to upgrade myself (mgr.smithi159.ghpomd) 2024-09-13T22:09:36.205 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:36 smithi089 ceph-mon[27921]: Upgrade: Need to upgrade myself (mgr.smithi159.ghpomd) 2024-09-13T22:09:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:36 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:36 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:36 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:09:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:36 smithi159 ceph-mon[35348]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:09:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:36 smithi159 ceph-mon[35348]: pgmap v15: 65 pgs: 65 active+clean; 1017 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 KiB/s rd, 1.5 MiB/s wr, 310 op/s 2024-09-13T22:09:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:36 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:36.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:36 smithi159 ceph-mon[35348]: Upgrade: Need to upgrade myself (mgr.smithi159.ghpomd) 2024-09-13T22:09:36.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:36 smithi159 ceph-mon[35348]: Upgrade: Need to upgrade myself (mgr.smithi159.ghpomd) 2024-09-13T22:09:37.546 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T22:09:37.546 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T22:09:37.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:37 smithi089 ceph-mon[27921]: Upgrade: Updating mgr.smithi089.naneiw 2024-09-13T22:09:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:37 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:37 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.naneiw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:09:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:37 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.naneiw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:09:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:37 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:09:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:37 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:09:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:37 smithi089 ceph-mon[27921]: Deploying daemon mgr.smithi089.naneiw on smithi089 2024-09-13T22:09:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:37 smithi089 ceph-mon[27921]: pgmap v16: 65 pgs: 65 active+clean; 1017 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 KiB/s rd, 1.5 MiB/s wr, 310 op/s 2024-09-13T22:09:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:37 smithi159 ceph-mon[35348]: Upgrade: Updating mgr.smithi089.naneiw 2024-09-13T22:09:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:37 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:37 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.naneiw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:09:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:37 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.naneiw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:09:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:37 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:09:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:37 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:09:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:37 smithi159 ceph-mon[35348]: Deploying daemon mgr.smithi089.naneiw on smithi089 2024-09-13T22:09:38.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:37 smithi159 ceph-mon[35348]: pgmap v16: 65 pgs: 65 active+clean; 1017 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 KiB/s rd, 1.5 MiB/s wr, 310 op/s 2024-09-13T22:09:40.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:40 smithi089 ceph-mon[27921]: pgmap v17: 65 pgs: 65 active+clean; 411 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.6 MiB/s wr, 414 op/s 2024-09-13T22:09:40.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:40 smithi159 ceph-mon[35348]: pgmap v17: 65 pgs: 65 active+clean; 411 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.6 MiB/s wr, 414 op/s 2024-09-13T22:09:41.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:41 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:41.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:41 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:41.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:41 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:41.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:41 smithi089 ceph-mon[27921]: pgmap v18: 65 pgs: 65 active+clean; 411 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.9 MiB/s wr, 278 op/s 2024-09-13T22:09:41.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:41 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:41.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:41 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:41.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:41 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:41.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:41 smithi159 ceph-mon[35348]: pgmap v18: 65 pgs: 65 active+clean; 411 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.9 MiB/s wr, 278 op/s 2024-09-13T22:09:42.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:42 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:42.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:42 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:43.743 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:43 smithi089 ceph-mon[27921]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.7 MiB/s wr, 444 op/s 2024-09-13T22:09:43.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:43 smithi159 ceph-mon[35348]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.7 MiB/s wr, 444 op/s 2024-09-13T22:09:44.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.389+0000 7f98b0295640 1 -- 172.21.15.89:0/146939167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 msgr2=0x7f98a80ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:44.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.389+0000 7f98b0295640 1 --2- 172.21.15.89:0/146939167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 0x7f98a80ff290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9898009880 tx=0x7f989802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.389+0000 7f98b0295640 1 -- 172.21.15.89:0/146939167 shutdown_connections 2024-09-13T22:09:44.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.389+0000 7f98b0295640 1 --2- 172.21.15.89:0/146939167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 0x7f98a80ff290 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.389+0000 7f98b0295640 1 --2- 172.21.15.89:0/146939167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80fe4f0 0x7f98a80fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.389+0000 7f98b0295640 1 -- 172.21.15.89:0/146939167 >> 172.21.15.89:0/146939167 conn(0x7f98a80fa280 msgr2=0x7f98a80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.390+0000 7f98b0295640 1 -- 172.21.15.89:0/146939167 shutdown_connections 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.390+0000 7f98b0295640 1 -- 172.21.15.89:0/146939167 wait complete. 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.390+0000 7f98b0295640 1 Processor -- start 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.390+0000 7f98b0295640 1 -- start start 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.390+0000 7f98b0295640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80fe4f0 0x7f98a8197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.390+0000 7f98b0295640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 0x7f98a8197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.390+0000 7f98b0295640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a81983a0 con 0x7f98a80fee30 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.390+0000 7f98b0295640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8198510 con 0x7f98a80fe4f0 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.391+0000 7f98ad830640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 0x7f98a8197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.391+0000 7f98ad830640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 0x7f98a8197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36678/0 (socket says 172.21.15.89:36678) 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.391+0000 7f98ad830640 1 -- 172.21.15.89:0/3868124023 learned_addr learned my addr 172.21.15.89:0/3868124023 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:44.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.391+0000 7f98ae031640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80fe4f0 0x7f98a8197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:44.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.391+0000 7f98ad830640 1 -- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80fe4f0 msgr2=0x7f98a8197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:44.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.391+0000 7f98ad830640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80fe4f0 0x7f98a8197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.391+0000 7f98ad830640 1 -- 172.21.15.89:0/3868124023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898009560 con 0x7f98a80fee30 2024-09-13T22:09:44.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.391+0000 7f98ae031640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80fe4f0 0x7f98a8197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:09:44.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.391+0000 7f98ad830640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 0x7f98a8197dd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9898005520 tx=0x7f9898005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:44.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.392+0000 7f989f7fe640 1 -- 172.21.15.89:0/3868124023 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9898004aa0 con 0x7f98a80fee30 2024-09-13T22:09:44.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.392+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a819cf50 con 0x7f98a80fee30 2024-09-13T22:09:44.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.392+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a819d410 con 0x7f98a80fee30 2024-09-13T22:09:44.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.392+0000 7f989f7fe640 1 -- 172.21.15.89:0/3868124023 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9898004c00 con 0x7f98a80fee30 2024-09-13T22:09:44.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.392+0000 7f989f7fe640 1 -- 172.21.15.89:0/3868124023 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9898003b10 con 0x7f98a80fee30 2024-09-13T22:09:44.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.393+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c005280 con 0x7f98a80fee30 2024-09-13T22:09:44.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.394+0000 7f989f7fe640 1 -- 172.21.15.89:0/3868124023 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f9898003d10 con 0x7f98a80fee30 2024-09-13T22:09:44.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.395+0000 7f989f7fe640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f989406d8a0 0x7f989406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:44.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.395+0000 7f989f7fe640 1 -- 172.21.15.89:0/3868124023 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f98980ae460 con 0x7f98a80fee30 2024-09-13T22:09:44.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.395+0000 7f98ae031640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f989406d8a0 0x7f989406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:44.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.395+0000 7f98ae031640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f989406d8a0 0x7f989406fd60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f98a4005fd0 tx=0x7f98a400b390 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:44.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.399+0000 7f989f7fe640 1 -- 172.21.15.89:0/3868124023 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f9898077a90 con 0x7f98a80fee30 2024-09-13T22:09:44.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.600+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 --> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f988c000bf0 con 0x7f989406d8a0 2024-09-13T22:09:44.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.602+0000 7f989f7fe640 1 -- 172.21.15.89:0/3868124023 <== mgr.24319 v2:172.21.15.159:6828/1500548398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f988c000bf0 con 0x7f989406d8a0 2024-09-13T22:09:44.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.606+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f989406d8a0 msgr2=0x7f989406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:44.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.606+0000 7f98b0295640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f989406d8a0 0x7f989406fd60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f98a4005fd0 tx=0x7f98a400b390 comp rx=0 tx=0).stop 2024-09-13T22:09:44.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.606+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 msgr2=0x7f98a8197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:44.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.606+0000 7f98b0295640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 0x7f98a8197dd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9898005520 tx=0x7f9898005550 comp rx=0 tx=0).stop 2024-09-13T22:09:44.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.607+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 shutdown_connections 2024-09-13T22:09:44.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.607+0000 7f98b0295640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a80fee30 0x7f98a8197dd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.607+0000 7f98b0295640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f989406d8a0 0x7f989406fd60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.607+0000 7f98b0295640 1 --2- 172.21.15.89:0/3868124023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a80fe4f0 0x7f98a8197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.607+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 >> 172.21.15.89:0/3868124023 conn(0x7f98a80fa280 msgr2=0x7f98a8106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:44.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.607+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 shutdown_connections 2024-09-13T22:09:44.608 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.607+0000 7f98b0295640 1 -- 172.21.15.89:0/3868124023 wait complete. 2024-09-13T22:09:44.623 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:09:44.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.733+0000 7f5818782640 1 -- 172.21.15.89:0/354870068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58100ffcf0 msgr2=0x7f5810100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:44.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.733+0000 7f5818782640 1 --2- 172.21.15.89:0/354870068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58100ffcf0 0x7f5810100170 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f58000097e0 tx=0x7f580002a3f0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.733+0000 7f5818782640 1 -- 172.21.15.89:0/354870068 shutdown_connections 2024-09-13T22:09:44.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.733+0000 7f5818782640 1 --2- 172.21.15.89:0/354870068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58100ffcf0 0x7f5810100170 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.733+0000 7f5818782640 1 --2- 172.21.15.89:0/354870068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58100feaf0 0x7f58100feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.733+0000 7f5818782640 1 -- 172.21.15.89:0/354870068 >> 172.21.15.89:0/354870068 conn(0x7f58100fa280 msgr2=0x7f58100fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:44.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.734+0000 7f5818782640 1 -- 172.21.15.89:0/354870068 shutdown_connections 2024-09-13T22:09:44.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.734+0000 7f5818782640 1 -- 172.21.15.89:0/354870068 wait complete. 2024-09-13T22:09:44.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.734+0000 7f5818782640 1 Processor -- start 2024-09-13T22:09:44.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.734+0000 7f5818782640 1 -- start start 2024-09-13T22:09:44.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f5818782640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58100feaf0 0x7f581018f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:44.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f5818782640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58100ffcf0 0x7f581018fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:44.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f5818782640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581018c2b0 con 0x7f58100ffcf0 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f5818782640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581018c420 con 0x7f58100feaf0 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f581651e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58100feaf0 0x7f581018f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f581651e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58100feaf0 0x7f581018f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.89:41084/0 (socket says 172.21.15.89:41084) 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f581651e640 1 -- 172.21.15.89:0/3724667630 learned_addr learned my addr 172.21.15.89:0/3724667630 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f5815d1d640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58100ffcf0 0x7f581018fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f581651e640 1 -- 172.21.15.89:0/3724667630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58100ffcf0 msgr2=0x7f581018fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.735+0000 7f581651e640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58100ffcf0 0x7f581018fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.736+0000 7f581651e640 1 -- 172.21.15.89:0/3724667630 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800009490 con 0x7f58100feaf0 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.736+0000 7f581651e640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58100feaf0 0x7f581018f770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f580c009750 tx=0x7f580c009c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.736+0000 7f58077fe640 1 -- 172.21.15.89:0/3724667630 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f580c012070 con 0x7f58100feaf0 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.736+0000 7f58077fe640 1 -- 172.21.15.89:0/3724667630 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f580c004020 con 0x7f58100feaf0 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.736+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581018c700 con 0x7f58100feaf0 2024-09-13T22:09:44.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.736+0000 7f58077fe640 1 -- 172.21.15.89:0/3724667630 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f580c003bf0 con 0x7f58100feaf0 2024-09-13T22:09:44.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.736+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581018cc50 con 0x7f58100feaf0 2024-09-13T22:09:44.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.738+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58100feef0 con 0x7f58100feaf0 2024-09-13T22:09:44.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.739+0000 7f58077fe640 1 -- 172.21.15.89:0/3724667630 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f580c004190 con 0x7f58100feaf0 2024-09-13T22:09:44.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.740+0000 7f58077fe640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f57fc06d8e0 0x7f57fc06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:44.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.740+0000 7f5815d1d640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f57fc06d8e0 0x7f57fc06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:44.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.740+0000 7f58077fe640 1 -- 172.21.15.89:0/3724667630 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f580c08cd10 con 0x7f58100feaf0 2024-09-13T22:09:44.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.741+0000 7f5815d1d640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f57fc06d8e0 0x7f57fc06fda0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58000308e0 tx=0x7f5800005af0 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:44.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.748+0000 7f58077fe640 1 -- 172.21.15.89:0/3724667630 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f580c056270 con 0x7f58100feaf0 2024-09-13T22:09:44.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.987+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 --> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58100608f0 con 0x7f57fc06d8e0 2024-09-13T22:09:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.989+0000 7f58077fe640 1 -- 172.21.15.89:0/3724667630 <== mgr.24319 v2:172.21.15.159:6828/1500548398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f58100608f0 con 0x7f57fc06d8e0 2024-09-13T22:09:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f57fc06d8e0 msgr2=0x7f57fc06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f57fc06d8e0 0x7f57fc06fda0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58000308e0 tx=0x7f5800005af0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58100feaf0 msgr2=0x7f581018f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58100feaf0 0x7f581018f770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f580c009750 tx=0x7f580c009c10 comp rx=0 tx=0).stop 2024-09-13T22:09:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 shutdown_connections 2024-09-13T22:09:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58100ffcf0 0x7f581018fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f57fc06d8e0 0x7f57fc06fda0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 --2- 172.21.15.89:0/3724667630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58100feaf0 0x7f581018f770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 >> 172.21.15.89:0/3724667630 conn(0x7f58100fa280 msgr2=0x7f58101033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 shutdown_connections 2024-09-13T22:09:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:44.991+0000 7f5818782640 1 -- 172.21.15.89:0/3724667630 wait complete. 2024-09-13T22:09:45.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.077+0000 7f21da25f640 1 -- 172.21.15.89:0/1338264012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d4100dd0 msgr2=0x7f21d4101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.077+0000 7f21da25f640 1 --2- 172.21.15.89:0/1338264012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d4100dd0 0x7f21d4101250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009880 tx=0x7f21c402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.077+0000 7f21da25f640 1 -- 172.21.15.89:0/1338264012 shutdown_connections 2024-09-13T22:09:45.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.077+0000 7f21da25f640 1 --2- 172.21.15.89:0/1338264012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d4100dd0 0x7f21d4101250 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.077+0000 7f21da25f640 1 --2- 172.21.15.89:0/1338264012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d40ffbd0 0x7f21d40fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.077+0000 7f21da25f640 1 -- 172.21.15.89:0/1338264012 >> 172.21.15.89:0/1338264012 conn(0x7f21d40fb360 msgr2=0x7f21d40fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:45.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.077+0000 7f21da25f640 1 -- 172.21.15.89:0/1338264012 shutdown_connections 2024-09-13T22:09:45.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.077+0000 7f21da25f640 1 -- 172.21.15.89:0/1338264012 wait complete. 2024-09-13T22:09:45.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.077+0000 7f21da25f640 1 Processor -- start 2024-09-13T22:09:45.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21da25f640 1 -- start start 2024-09-13T22:09:45.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21da25f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d40ffbd0 0x7f21d4074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:45.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21da25f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d4100dd0 0x7f21d40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:45.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21da25f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4072de0 con 0x7f21d40ffbd0 2024-09-13T22:09:45.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21da25f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4072f50 con 0x7f21d4100dd0 2024-09-13T22:09:45.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21d37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d40ffbd0 0x7f21d4074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:45.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21d37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d40ffbd0 0x7f21d4074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36696/0 (socket says 172.21.15.89:36696) 2024-09-13T22:09:45.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21d37fe640 1 -- 172.21.15.89:0/4020079552 learned_addr learned my addr 172.21.15.89:0/4020079552 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:45.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21d2ffd640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d4100dd0 0x7f21d40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:45.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21d37fe640 1 -- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d4100dd0 msgr2=0x7f21d40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21d37fe640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d4100dd0 0x7f21d40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.078+0000 7f21d37fe640 1 -- 172.21.15.89:0/4020079552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4009560 con 0x7f21d40ffbd0 2024-09-13T22:09:45.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.079+0000 7f21d37fe640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d40ffbd0 0x7f21d4074200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00e940 tx=0x7f21bc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:45.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.079+0000 7f21d0ff9640 1 -- 172.21.15.89:0/4020079552 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21bc0096e0 con 0x7f21d40ffbd0 2024-09-13T22:09:45.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.079+0000 7f21d0ff9640 1 -- 172.21.15.89:0/4020079552 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21bc0044f0 con 0x7f21d40ffbd0 2024-09-13T22:09:45.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.079+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d4073230 con 0x7f21d40ffbd0 2024-09-13T22:09:45.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.080+0000 7f21d0ff9640 1 -- 172.21.15.89:0/4020079552 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21bc010430 con 0x7f21d40ffbd0 2024-09-13T22:09:45.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.080+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d419d6e0 con 0x7f21d40ffbd0 2024-09-13T22:09:45.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.080+0000 7f21d0ff9640 1 -- 172.21.15.89:0/4020079552 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f21bc0106f0 con 0x7f21d40ffbd0 2024-09-13T22:09:45.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.080+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d40fffd0 con 0x7f21d40ffbd0 2024-09-13T22:09:45.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.081+0000 7f21d0ff9640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f21c006d890 0x7f21c006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:45.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.081+0000 7f21d0ff9640 1 -- 172.21.15.89:0/4020079552 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f21bc014070 con 0x7f21d40ffbd0 2024-09-13T22:09:45.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.081+0000 7f21d2ffd640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f21c006d890 0x7f21c006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:45.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.082+0000 7f21d2ffd640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f21c006d890 0x7f21c006fd50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f21c4000c00 tx=0x7f21c40314e0 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:45.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.086+0000 7f21d0ff9640 1 -- 172.21.15.89:0/4020079552 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f21bc092060 con 0x7f21d40ffbd0 2024-09-13T22:09:45.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.279+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 --> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f21d402c4f0 con 0x7f21c006d890 2024-09-13T22:09:45.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.296+0000 7f21d0ff9640 1 -- 172.21.15.89:0/4020079552 <== mgr.24319 v2:172.21.15.159:6828/1500548398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f21d402c4f0 con 0x7f21c006d890 2024-09-13T22:09:45.298 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:09:45.298 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (7m) 25s ago 8m 25.1M - 0.25.0 c8568f914cd2 6ef74b73ca3e 2024-09-13T22:09:45.298 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (9m) 25s ago 9m 7730k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:09:45.298 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (8m) 25s ago 8m 7730k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:09:45.298 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (9m) 25s ago 9m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:09:45.298 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (8m) 25s ago 8m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:09:45.298 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (7m) 25s ago 8m 86.7M - 9.4.7 954c08fa6188 59724cff87bd 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (3m) 25s ago 3m 15.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (3m) 25s ago 3m 13.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (3m) 25s ago 3m 226M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (3m) 25s ago 3m 15.3M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 starting - - - - 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (82s) 25s ago 7m 483M - 19.1.1-324-gecab7be5 0652ff2b5d78 105fec331cd0 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (10m) 25s ago 10m 56.0M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (7m) 25s ago 7m 39.9M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (8m) 25s ago 8m 16.4M - 1.5.0 0da6a335fe13 eeaf1dd44f97 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (8m) 25s ago 8m 15.6M - 1.5.0 0da6a335fe13 c76544fc91f3 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (7m) 25s ago 7m 243M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (6m) 25s ago 6m 246M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (6m) 25s ago 6m 202M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:09:45.299 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (5m) 25s ago 5m 287M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:09:45.300 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (5m) 25s ago 5m 241M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:09:45.300 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (4m) 25s ago 4m 261M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:09:45.300 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 starting - - - - 2024-09-13T22:09:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f21c006d890 msgr2=0x7f21c006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f21c006d890 0x7f21c006fd50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f21c4000c00 tx=0x7f21c40314e0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d40ffbd0 msgr2=0x7f21d4074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d40ffbd0 0x7f21d4074200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00e940 tx=0x7f21bc00ee00 comp rx=0 tx=0).stop 2024-09-13T22:09:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 shutdown_connections 2024-09-13T22:09:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f21c006d890 0x7f21c006fd50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21d4100dd0 0x7f21d40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 --2- 172.21.15.89:0/4020079552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d40ffbd0 0x7f21d4074200 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 >> 172.21.15.89:0/4020079552 conn(0x7f21d40fb360 msgr2=0x7f21d4104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 shutdown_connections 2024-09-13T22:09:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.299+0000 7f21da25f640 1 -- 172.21.15.89:0/4020079552 wait complete. 2024-09-13T22:09:45.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.385+0000 7fc75982d640 1 -- 172.21.15.89:0/891208019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 msgr2=0x7fc754102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.385+0000 7fc75982d640 1 --2- 172.21.15.89:0/891208019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 0x7fc754102a70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc7440098b0 tx=0x7fc74402a4d0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.385+0000 7fc75982d640 1 -- 172.21.15.89:0/891208019 shutdown_connections 2024-09-13T22:09:45.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.385+0000 7fc75982d640 1 --2- 172.21.15.89:0/891208019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc754102fb0 0x7fc7541053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.385+0000 7fc75982d640 1 --2- 172.21.15.89:0/891208019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 0x7fc754102a70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.385+0000 7fc75982d640 1 -- 172.21.15.89:0/891208019 >> 172.21.15.89:0/891208019 conn(0x7fc7540fa280 msgr2=0x7fc7540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:45.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.385+0000 7fc75982d640 1 -- 172.21.15.89:0/891208019 shutdown_connections 2024-09-13T22:09:45.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.385+0000 7fc75982d640 1 -- 172.21.15.89:0/891208019 wait complete. 2024-09-13T22:09:45.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.385+0000 7fc75982d640 1 Processor -- start 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc75982d640 1 -- start start 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc75982d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 0x7fc7541956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc75982d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc754102fb0 0x7fc754195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc75982d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc754196200 con 0x7fc754100680 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc75982d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc754196370 con 0x7fc754102fb0 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc752ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 0x7fc7541956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc752ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 0x7fc7541956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36720/0 (socket says 172.21.15.89:36720) 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc752ffd640 1 -- 172.21.15.89:0/3877626112 learned_addr learned my addr 172.21.15.89:0/3877626112 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc7527fc640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc754102fb0 0x7fc754195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc752ffd640 1 -- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc754102fb0 msgr2=0x7fc754195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc752ffd640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc754102fb0 0x7fc754195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.386+0000 7fc752ffd640 1 -- 172.21.15.89:0/3877626112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009560 con 0x7fc754100680 2024-09-13T22:09:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.387+0000 7fc752ffd640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 0x7fc7541956f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc7440054f0 tx=0x7fc744005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.387+0000 7fc75882b640 1 -- 172.21.15.89:0/3877626112 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc744004aa0 con 0x7fc754100680 2024-09-13T22:09:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.387+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75419adb0 con 0x7fc754100680 2024-09-13T22:09:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.387+0000 7fc75882b640 1 -- 172.21.15.89:0/3877626112 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc744004c00 con 0x7fc754100680 2024-09-13T22:09:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.387+0000 7fc75882b640 1 -- 172.21.15.89:0/3877626112 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc744003b10 con 0x7fc754100680 2024-09-13T22:09:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.387+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75419b240 con 0x7fc754100680 2024-09-13T22:09:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.388+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc754108810 con 0x7fc754100680 2024-09-13T22:09:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.388+0000 7fc75882b640 1 -- 172.21.15.89:0/3877626112 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fc744003d80 con 0x7fc754100680 2024-09-13T22:09:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.389+0000 7fc75882b640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fc73c06d8a0 0x7fc73c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.389+0000 7fc75882b640 1 -- 172.21.15.89:0/3877626112 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc7440ae4e0 con 0x7fc754100680 2024-09-13T22:09:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.389+0000 7fc7527fc640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fc73c06d8a0 0x7fc73c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.389+0000 7fc7527fc640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fc73c06d8a0 0x7fc73c06fd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc754196c10 tx=0x7fc74800b410 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.394+0000 7fc75882b640 1 -- 172.21.15.89:0/3877626112 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc744077b10 con 0x7fc754100680 2024-09-13T22:09:45.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.643+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc75419b4b0 con 0x7fc754100680 2024-09-13T22:09:45.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.643+0000 7fc75882b640 1 -- 172.21.15.89:0/3877626112 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7fc74407b1d0 con 0x7fc754100680 2024-09-13T22:09:45.645 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:09:45.645 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:09:45.645 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:09:45.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:09:45.645 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:09:45.645 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T22:09:45.645 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:09:45.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:09:45.646 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:09:45.646 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:09:45.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:09:45.646 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:09:45.646 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:09:45.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:09:45.646 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:09:45.646 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 13, 2024-09-13T22:09:45.646 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:09:45.647 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:09:45.647 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:09:45.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fc73c06d8a0 msgr2=0x7fc73c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fc73c06d8a0 0x7fc73c06fd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc754196c10 tx=0x7fc74800b410 comp rx=0 tx=0).stop 2024-09-13T22:09:45.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 msgr2=0x7fc7541956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 0x7fc7541956f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc7440054f0 tx=0x7fc744005520 comp rx=0 tx=0).stop 2024-09-13T22:09:45.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 shutdown_connections 2024-09-13T22:09:45.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7fc73c06d8a0 0x7fc73c06fd60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc754102fb0 0x7fc754195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 --2- 172.21.15.89:0/3877626112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc754100680 0x7fc7541956f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 >> 172.21.15.89:0/3877626112 conn(0x7fc7540fa280 msgr2=0x7fc7540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:45.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 shutdown_connections 2024-09-13T22:09:45.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.645+0000 7fc75982d640 1 -- 172.21.15.89:0/3877626112 wait complete. 2024-09-13T22:09:45.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.763+0000 7f8b1b551640 1 -- 172.21.15.89:0/3930257766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b14072f10 msgr2=0x7f8b14073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.763+0000 7f8b1b551640 1 --2- 172.21.15.89:0/3930257766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b14072f10 0x7f8b14073370 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8b040097e0 tx=0x7f8b0402a3f0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.764+0000 7f8b1b551640 1 -- 172.21.15.89:0/3930257766 shutdown_connections 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.764+0000 7f8b1b551640 1 --2- 172.21.15.89:0/3930257766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b14072f10 0x7f8b14073370 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.764+0000 7f8b1b551640 1 --2- 172.21.15.89:0/3930257766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b140744e0 0x7f8b14072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.764+0000 7f8b1b551640 1 -- 172.21.15.89:0/3930257766 >> 172.21.15.89:0/3930257766 conn(0x7f8b140fb110 msgr2=0x7f8b140fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.764+0000 7f8b1b551640 1 -- 172.21.15.89:0/3930257766 shutdown_connections 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.764+0000 7f8b1b551640 1 -- 172.21.15.89:0/3930257766 wait complete. 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b1b551640 1 Processor -- start 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b1b551640 1 -- start start 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b1b551640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14072f10 0x7f8b1410ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b1b551640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b140744e0 0x7f8b1410b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b1b551640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1410b6e0 con 0x7f8b140744e0 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b1b551640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b141a95f0 con 0x7f8b14072f10 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b19d4e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b140744e0 0x7f8b1410b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b1a54f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14072f10 0x7f8b1410ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b19d4e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b140744e0 0x7f8b1410b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36752/0 (socket says 172.21.15.89:36752) 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.765+0000 7f8b19d4e640 1 -- 172.21.15.89:0/689654811 learned_addr learned my addr 172.21.15.89:0/689654811 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.766+0000 7f8b1a54f640 1 -- 172.21.15.89:0/689654811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b140744e0 msgr2=0x7f8b1410b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.766+0000 7f8b1a54f640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b140744e0 0x7f8b1410b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.766+0000 7f8b1a54f640 1 -- 172.21.15.89:0/689654811 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04009490 con 0x7f8b14072f10 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.766+0000 7f8b1a54f640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14072f10 0x7f8b1410ab80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005fd0 tx=0x7f8b1000eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.767+0000 7f8b0b7fe640 1 -- 172.21.15.89:0/689654811 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b1000ca80 con 0x7f8b14072f10 2024-09-13T22:09:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.767+0000 7f8b0b7fe640 1 -- 172.21.15.89:0/689654811 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b1000cbe0 con 0x7f8b14072f10 2024-09-13T22:09:45.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.767+0000 7f8b0b7fe640 1 -- 172.21.15.89:0/689654811 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b10018750 con 0x7f8b14072f10 2024-09-13T22:09:45.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.767+0000 7f8b1b551640 1 -- 172.21.15.89:0/689654811 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b141a9790 con 0x7f8b14072f10 2024-09-13T22:09:45.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.767+0000 7f8b1b551640 1 -- 172.21.15.89:0/689654811 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b141a9bd0 con 0x7f8b14072f10 2024-09-13T22:09:45.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.769+0000 7f8b097fa640 1 -- 172.21.15.89:0/689654811 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1410ecf0 con 0x7f8b14072f10 2024-09-13T22:09:45.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.770+0000 7f8b0b7fe640 1 -- 172.21.15.89:0/689654811 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f8b10010430 con 0x7f8b14072f10 2024-09-13T22:09:45.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.771+0000 7f8b0b7fe640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f8b0006d9a0 0x7f8b0006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:09:45.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.771+0000 7f8b19d4e640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f8b0006d9a0 0x7f8b0006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:09:45.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.771+0000 7f8b0b7fe640 1 -- 172.21.15.89:0/689654811 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8b10014070 con 0x7f8b14072f10 2024-09-13T22:09:45.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.772+0000 7f8b19d4e640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f8b0006d9a0 0x7f8b0006fe60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8b141a5560 tx=0x7f8b0400b040 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:09:45.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:45.778+0000 7f8b0b7fe640 1 -- 172.21.15.89:0/689654811 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f8b10053d10 con 0x7f8b14072f10 2024-09-13T22:09:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.060+0000 7f8b097fa640 1 -- 172.21.15.89:0/689654811 --> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b140612f0 con 0x7f8b0006d9a0 2024-09-13T22:09:46.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.061+0000 7f8b0b7fe640 1 -- 172.21.15.89:0/689654811 <== mgr.24319 v2:172.21.15.159:6828/1500548398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f8b140612f0 con 0x7f8b0006d9a0 2024-09-13T22:09:46.062 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:09:46.062 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:09:46.062 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:09:46.062 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:09:46.062 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:09:46.063 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-13T22:09:46.063 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:09:46.063 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T22:09:46.063 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T22:09:46.063 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:09:46.063 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:09:46.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 -- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f8b0006d9a0 msgr2=0x7f8b0006fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:46.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f8b0006d9a0 0x7f8b0006fe60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8b141a5560 tx=0x7f8b0400b040 comp rx=0 tx=0).stop 2024-09-13T22:09:46.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 -- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14072f10 msgr2=0x7f8b1410ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:09:46.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14072f10 0x7f8b1410ab80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005fd0 tx=0x7f8b1000eba0 comp rx=0 tx=0).stop 2024-09-13T22:09:46.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 -- 172.21.15.89:0/689654811 shutdown_connections 2024-09-13T22:09:46.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b140744e0 0x7f8b1410b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:46.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:6828/1500548398,v1:172.21.15.159:6829/1500548398] conn(0x7f8b0006d9a0 0x7f8b0006fe60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:46.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 --2- 172.21.15.89:0/689654811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14072f10 0x7f8b1410ab80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:09:46.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 -- 172.21.15.89:0/689654811 >> 172.21.15.89:0/689654811 conn(0x7f8b140fb110 msgr2=0x7f8b140fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:09:46.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 -- 172.21.15.89:0/689654811 shutdown_connections 2024-09-13T22:09:46.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:09:46.063+0000 7f8b097fa640 1 -- 172.21.15.89:0/689654811 wait complete. 2024-09-13T22:09:46.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 269 op/s 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3877626112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: Standby manager daemon smithi089.naneiw restarted 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: Standby manager daemon smithi089.naneiw started 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.naneiw/crt"}]: dispatch 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.naneiw/key"}]: dispatch 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:46.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:46 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:46.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:46.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:46.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 269 op/s 2024-09-13T22:09:46.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3877626112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:09:46.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: Standby manager daemon smithi089.naneiw restarted 2024-09-13T22:09:46.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: Standby manager daemon smithi089.naneiw started 2024-09-13T22:09:46.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.naneiw/crt"}]: dispatch 2024-09-13T22:09:46.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:09:46.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.naneiw/key"}]: dispatch 2024-09-13T22:09:46.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:09:46.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:46.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:46 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:47.457 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:47 smithi089 ceph-mon[27921]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:47.457 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:47 smithi089 ceph-mon[27921]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:47.457 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:47 smithi089 ceph-mon[27921]: mgrmap e26: smithi159.ghpomd(active, since 35s), standbys: smithi089.naneiw 2024-09-13T22:09:47.457 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:47 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:47.457 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:47 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:47 smithi159 ceph-mon[35348]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:47 smithi159 ceph-mon[35348]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:09:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:47 smithi159 ceph-mon[35348]: mgrmap e26: smithi159.ghpomd(active, since 35s), standbys: smithi089.naneiw 2024-09-13T22:09:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:47 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:47 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:48.463 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:48 smithi089 ceph-mon[27921]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 269 op/s 2024-09-13T22:09:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:48 smithi159 ceph-mon[35348]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 269 op/s 2024-09-13T22:09:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:49 smithi089 ceph-mon[27921]: pgmap v22: 65 pgs: 65 active+clean; 313 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.9 MiB/s wr, 440 op/s 2024-09-13T22:09:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:49 smithi159 ceph-mon[35348]: pgmap v22: 65 pgs: 65 active+clean; 313 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.9 MiB/s wr, 440 op/s 2024-09-13T22:09:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: pgmap v23: 65 pgs: 65 active+clean; 313 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.8 MiB/s wr, 336 op/s 2024-09-13T22:09:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr fail", "who": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr fail", "who": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: Activating manager daemon smithi089.naneiw 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd='[{"prefix": "mgr fail", "who": "smithi159.ghpomd"}]': finished 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: mgrmap e27: smithi089.naneiw(active, starting, since 0.00829835s) 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:09:52.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:09:52.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:09:52.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: Manager daemon smithi089.naneiw is now available 2024-09-13T22:09:52.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:52.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:52.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:09:52.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/trash_purge_schedule"}]: dispatch 2024-09-13T22:09:52.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: pgmap v23: 65 pgs: 65 active+clean; 313 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.8 MiB/s wr, 336 op/s 2024-09-13T22:09:52.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.24319 172.21.15.159:0/2428286108' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr fail", "who": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "mgr fail", "who": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: Activating manager daemon smithi089.naneiw 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.24319 ' entity='mgr.smithi159.ghpomd' cmd='[{"prefix": "mgr fail", "who": "smithi159.ghpomd"}]': finished 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: mgrmap e27: smithi089.naneiw(active, starting, since 0.00829835s) 2024-09-13T22:09:52.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:09:52.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:09:52.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:09:52.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:09:52.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:09:52.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: Manager daemon smithi089.naneiw is now available 2024-09-13T22:09:52.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:09:52.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:09:52.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:09:52.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/trash_purge_schedule"}]: dispatch 2024-09-13T22:09:53.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:53 smithi089 ceph-mon[27921]: mgrmap e28: smithi089.naneiw(active, since 1.01287s) 2024-09-13T22:09:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:53 smithi089 ceph-mon[27921]: pgmap v3: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:09:54.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:53 smithi159 ceph-mon[35348]: mgrmap e28: smithi089.naneiw(active, since 1.01287s) 2024-09-13T22:09:54.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:53 smithi159 ceph-mon[35348]: pgmap v3: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:09:55.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:54 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:53] ENGINE Bus STARTING 2024-09-13T22:09:55.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:54 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:53] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T22:09:55.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:54 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:53] ENGINE Error in HTTPServer.serve 2024-09-13T22:09:55.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Traceback (most recent call last): 2024-09-13T22:09:55.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:09:55.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:09:55.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:09:55.168 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._run(expiration_interval) 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: s = self.context.wrap_socket( 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: return self.sslsocket_class._create( 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self.do_handshake() 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._sslobj.do_handshake() 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:09:55.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:54 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:53] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T22:09:55.170 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:54 smithi159 ceph-mon[35348]: [13/Sep/2024:22:09:53] ENGINE Bus STARTED 2024-09-13T22:09:55.170 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:54 smithi159 ceph-mon[35348]: pgmap v4: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:09:55.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:54 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:53] ENGINE Bus STARTING 2024-09-13T22:09:55.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:54 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:53] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:54 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:53] ENGINE Error in HTTPServer.serve 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:09:55.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T22:09:55.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:09:55.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T22:09:55.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:09:55.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T22:09:55.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:09:55.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:54 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:53] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T22:09:55.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:54 smithi089 ceph-mon[27921]: [13/Sep/2024:22:09:53] ENGINE Bus STARTED 2024-09-13T22:09:55.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:54 smithi089 ceph-mon[27921]: pgmap v4: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:09:55.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:55 smithi089 ceph-mon[27921]: mgrmap e29: smithi089.naneiw(active, since 3s) 2024-09-13T22:09:56.207 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:55 smithi159 ceph-mon[35348]: mgrmap e29: smithi089.naneiw(active, since 3s) 2024-09-13T22:09:57.246 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:56 smithi159 ceph-mon[35348]: pgmap v5: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:09:57.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:56 smithi089 ceph-mon[27921]: pgmap v5: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:09:58.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:57 smithi089 ceph-mon[27921]: mgrmap e30: smithi089.naneiw(active, since 5s) 2024-09-13T22:09:58.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:57 smithi159 ceph-mon[35348]: mgrmap e30: smithi089.naneiw(active, since 5s) 2024-09-13T22:09:59.356 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: pgmap v6: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 177 KiB/s wr, 144 op/s 2024-09-13T22:09:59.356 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:59.356 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:59.356 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:09:59.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2392632605' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:09:59.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2392632605' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:09:59.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2392632605' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:09:59.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2392632605' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:09:59.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:59.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:09:59 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: pgmap v6: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 177 KiB/s wr, 144 op/s 2024-09-13T22:09:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:09:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2392632605' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:09:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2392632605' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:09:59.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2392632605' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:09:59.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2392632605' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:09:59.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:09:59.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:09:59 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:00.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:00 smithi089 ceph-mon[27921]: mgrmap e31: smithi089.naneiw(active, since 7s), standbys: smithi159.ghpomd 2024-09-13T22:10:00.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:00 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi159.ghpomd", "id": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:10:00.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:00 smithi089 ceph-mon[27921]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:10:00.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:00 smithi089 ceph-mon[27921]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:10:00.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:00 smithi089 ceph-mon[27921]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:10:00.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:00 smithi159 ceph-mon[35348]: mgrmap e31: smithi089.naneiw(active, since 7s), standbys: smithi159.ghpomd 2024-09-13T22:10:00.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:00 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi159.ghpomd", "id": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:10:00.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:00 smithi159 ceph-mon[35348]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:10:00.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:00 smithi159 ceph-mon[35348]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:10:00.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:00 smithi159 ceph-mon[35348]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:10:01.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:01 smithi089 ceph-mon[27921]: pgmap v7: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54 KiB/s rd, 1.4 MiB/s wr, 845 op/s 2024-09-13T22:10:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:01 smithi159 ceph-mon[35348]: pgmap v7: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54 KiB/s rd, 1.4 MiB/s wr, 845 op/s 2024-09-13T22:10:03.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:03 smithi089 ceph-mon[27921]: pgmap v8: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 657 op/s 2024-09-13T22:10:03.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:03 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:03.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:03 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:03.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:03 smithi159 ceph-mon[35348]: pgmap v8: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 657 op/s 2024-09-13T22:10:03.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:03 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:03.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:03 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:05.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:05 smithi089 ceph-mon[27921]: pgmap v9: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 1.8 MiB/s wr, 990 op/s 2024-09-13T22:10:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:05 smithi159 ceph-mon[35348]: pgmap v9: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 1.8 MiB/s wr, 990 op/s 2024-09-13T22:10:07.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:07 smithi089 ceph-mon[27921]: pgmap v10: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.6 MiB/s wr, 906 op/s 2024-09-13T22:10:07.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:07 smithi159 ceph-mon[35348]: pgmap v10: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.6 MiB/s wr, 906 op/s 2024-09-13T22:10:08.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:08 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:10:08.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:08 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:10:09.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:09 smithi089 ceph-mon[27921]: pgmap v11: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 1.8 MiB/s wr, 941 op/s 2024-09-13T22:10:09.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:09.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:09 smithi159 ceph-mon[35348]: pgmap v11: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 1.8 MiB/s wr, 941 op/s 2024-09-13T22:10:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:10.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:10 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:10.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:10 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:10.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:10 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:10:10.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:10 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:10:10.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:10 smithi159 ceph-mon[35348]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:10:10.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:10 smithi159 ceph-mon[35348]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:10:10.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:10 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:10.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:10 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:10.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:10 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:10:10.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:10 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:10:10.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:10 smithi089 ceph-mon[27921]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:10:10.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:10 smithi089 ceph-mon[27921]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: pgmap v12: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.4 MiB/s wr, 1.07k op/s 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:11.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:11 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:11.709 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T22:10:11.710 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T22:10:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:10:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:10:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:10:11.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:10:11.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: pgmap v12: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.4 MiB/s wr, 1.07k op/s 2024-09-13T22:10:11.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:10:11.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:10:11.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:11.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:11.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:11.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:11.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:11 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:12.235 DEBUG:teuthology.parallel:result is None 2024-09-13T22:10:12.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:12 smithi089 ceph-mon[27921]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T22:10:12.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:12 smithi089 ceph-mon[27921]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T22:10:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:12 smithi159 ceph-mon[35348]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T22:10:12.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:12 smithi159 ceph-mon[35348]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T22:10:13.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:13 smithi089 ceph-mon[27921]: pgmap v13: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 643 op/s 2024-09-13T22:10:13.757 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:13 smithi159 ceph-mon[35348]: pgmap v13: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 643 op/s 2024-09-13T22:10:15.599 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:15 smithi089 ceph-mon[27921]: pgmap v14: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 844 op/s 2024-09-13T22:10:15.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:15 smithi159 ceph-mon[35348]: pgmap v14: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 844 op/s 2024-09-13T22:10:16.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.180+0000 7ff233597640 1 -- 172.21.15.89:0/3976738094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240953a0 msgr2=0x7ff2240957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.180+0000 7ff233597640 1 --2- 172.21.15.89:0/3976738094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240953a0 0x7ff2240957a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff228009880 tx=0x7ff22802a4b0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.181+0000 7ff233597640 1 -- 172.21.15.89:0/3976738094 shutdown_connections 2024-09-13T22:10:16.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.181+0000 7ff233597640 1 --2- 172.21.15.89:0/3976738094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2240965a0 0x7ff224096a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.181+0000 7ff233597640 1 --2- 172.21.15.89:0/3976738094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240953a0 0x7ff2240957a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.182+0000 7ff233597640 1 -- 172.21.15.89:0/3976738094 >> 172.21.15.89:0/3976738094 conn(0x7ff224090b30 msgr2=0x7ff224092f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:16.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.183+0000 7ff233597640 1 -- 172.21.15.89:0/3976738094 shutdown_connections 2024-09-13T22:10:16.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.187+0000 7ff233597640 1 -- 172.21.15.89:0/3976738094 wait complete. 2024-09-13T22:10:16.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.188+0000 7ff233597640 1 Processor -- start 2024-09-13T22:10:16.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.188+0000 7ff233597640 1 -- start start 2024-09-13T22:10:16.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.188+0000 7ff233597640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2240953a0 0x7ff22412af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:16.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.188+0000 7ff233597640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240965a0 0x7ff22412b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:16.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.188+0000 7ff233597640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22412ba70 con 0x7ff2240953a0 2024-09-13T22:10:16.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.188+0000 7ff233597640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22412bbe0 con 0x7ff2240965a0 2024-09-13T22:10:16.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.189+0000 7ff231d94640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240965a0 0x7ff22412b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:16.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.189+0000 7ff231d94640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240965a0 0x7ff22412b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.89:52110/0 (socket says 172.21.15.89:52110) 2024-09-13T22:10:16.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.189+0000 7ff231d94640 1 -- 172.21.15.89:0/3991975542 learned_addr learned my addr 172.21.15.89:0/3991975542 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:16.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.189+0000 7ff232595640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2240953a0 0x7ff22412af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:16.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.191+0000 7ff232595640 1 -- 172.21.15.89:0/3991975542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240965a0 msgr2=0x7ff22412b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.191+0000 7ff232595640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240965a0 0x7ff22412b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.191+0000 7ff232595640 1 -- 172.21.15.89:0/3991975542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009560 con 0x7ff2240953a0 2024-09-13T22:10:16.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.191+0000 7ff232595640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2240953a0 0x7ff22412af60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff228009880 tx=0x7ff228005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:16.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.192+0000 7ff2237fe640 1 -- 172.21.15.89:0/3991975542 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff228044c30 con 0x7ff2240953a0 2024-09-13T22:10:16.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.192+0000 7ff2237fe640 1 -- 172.21.15.89:0/3991975542 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff228044d90 con 0x7ff2240953a0 2024-09-13T22:10:16.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.193+0000 7ff2237fe640 1 -- 172.21.15.89:0/3991975542 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff228031e00 con 0x7ff2240953a0 2024-09-13T22:10:16.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.195+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff224006400 con 0x7ff2240953a0 2024-09-13T22:10:16.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.195+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2240068f0 con 0x7ff2240953a0 2024-09-13T22:10:16.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.197+0000 7ff2237fe640 1 -- 172.21.15.89:0/3991975542 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 31) v1 ==== 92514+0+0 (secure 0 0 0) 0x7ff228004740 con 0x7ff2240953a0 2024-09-13T22:10:16.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.197+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff224095820 con 0x7ff2240953a0 2024-09-13T22:10:16.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.198+0000 7ff2237fe640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7ff21806e1d0 0x7ff218070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:16.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.198+0000 7ff2237fe640 1 -- 172.21.15.89:0/3991975542 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff228031640 con 0x7ff2240953a0 2024-09-13T22:10:16.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.199+0000 7ff231d94640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7ff21806e1d0 0x7ff218070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:16.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.200+0000 7ff231d94640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7ff21806e1d0 0x7ff218070690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff22412c480 tx=0x7ff21c0091c0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:16.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.208+0000 7ff2237fe640 1 -- 172.21.15.89:0/3991975542 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ff228080800 con 0x7ff2240953a0 2024-09-13T22:10:16.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.477+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff22409aef0 con 0x7ff21806e1d0 2024-09-13T22:10:16.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.478+0000 7ff2237fe640 1 -- 172.21.15.89:0/3991975542 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7ff22409aef0 con 0x7ff21806e1d0 2024-09-13T22:10:16.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7ff21806e1d0 msgr2=0x7ff218070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7ff21806e1d0 0x7ff218070690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff22412c480 tx=0x7ff21c0091c0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2240953a0 msgr2=0x7ff22412af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2240953a0 0x7ff22412af60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff228009880 tx=0x7ff228005610 comp rx=0 tx=0).stop 2024-09-13T22:10:16.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 shutdown_connections 2024-09-13T22:10:16.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7ff21806e1d0 0x7ff218070690 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2240965a0 0x7ff22412b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 --2- 172.21.15.89:0/3991975542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2240953a0 0x7ff22412af60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 >> 172.21.15.89:0/3991975542 conn(0x7ff224090b30 msgr2=0x7ff2240997d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:16.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 shutdown_connections 2024-09-13T22:10:16.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.481+0000 7ff233597640 1 -- 172.21.15.89:0/3991975542 wait complete. 2024-09-13T22:10:16.491 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:10:16.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.568+0000 7f9c64d03640 1 -- 172.21.15.89:0/3215192183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ffcf0 msgr2=0x7f9c60100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.568+0000 7f9c64d03640 1 --2- 172.21.15.89:0/3215192183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ffcf0 0x7f9c60100170 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009880 tx=0x7f9c4802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.568+0000 7f9c64d03640 1 -- 172.21.15.89:0/3215192183 shutdown_connections 2024-09-13T22:10:16.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.568+0000 7f9c64d03640 1 --2- 172.21.15.89:0/3215192183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ffcf0 0x7f9c60100170 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.568+0000 7f9c64d03640 1 --2- 172.21.15.89:0/3215192183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c600feaf0 0x7f9c600feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.568+0000 7f9c64d03640 1 -- 172.21.15.89:0/3215192183 >> 172.21.15.89:0/3215192183 conn(0x7f9c600fa280 msgr2=0x7f9c600fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:16.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.568+0000 7f9c64d03640 1 -- 172.21.15.89:0/3215192183 shutdown_connections 2024-09-13T22:10:16.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.568+0000 7f9c64d03640 1 -- 172.21.15.89:0/3215192183 wait complete. 2024-09-13T22:10:16.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c64d03640 1 Processor -- start 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c64d03640 1 -- start start 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c64d03640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600feaf0 0x7f9c60102eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c64d03640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c600ffcf0 0x7f9c60101550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c64d03640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60101a90 con 0x7f9c600feaf0 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c64d03640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60101c00 con 0x7f9c600ffcf0 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c5e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600feaf0 0x7f9c60102eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c5e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600feaf0 0x7f9c60102eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57360/0 (socket says 172.21.15.89:57360) 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c5e59c640 1 -- 172.21.15.89:0/1666861189 learned_addr learned my addr 172.21.15.89:0/1666861189 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.569+0000 7f9c5dd9b640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c600ffcf0 0x7f9c60101550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.570+0000 7f9c5e59c640 1 -- 172.21.15.89:0/1666861189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c600ffcf0 msgr2=0x7f9c60101550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.570+0000 7f9c5e59c640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c600ffcf0 0x7f9c60101550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.570+0000 7f9c5e59c640 1 -- 172.21.15.89:0/1666861189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48009560 con 0x7f9c600feaf0 2024-09-13T22:10:16.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.570+0000 7f9c5e59c640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600feaf0 0x7f9c60102eb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000d8d0 tx=0x7f9c5000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:16.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.570+0000 7f9c577fe640 1 -- 172.21.15.89:0/1666861189 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c5000bea0 con 0x7f9c600feaf0 2024-09-13T22:10:16.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.570+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c60101ee0 con 0x7f9c600feaf0 2024-09-13T22:10:16.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.570+0000 7f9c577fe640 1 -- 172.21.15.89:0/1666861189 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c50009c00 con 0x7f9c600feaf0 2024-09-13T22:10:16.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.570+0000 7f9c577fe640 1 -- 172.21.15.89:0/1666861189 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c5000f790 con 0x7f9c600feaf0 2024-09-13T22:10:16.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.570+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6019d6f0 con 0x7f9c600feaf0 2024-09-13T22:10:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.571+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c60108040 con 0x7f9c600feaf0 2024-09-13T22:10:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.572+0000 7f9c577fe640 1 -- 172.21.15.89:0/1666861189 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 31) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f9c5000fa50 con 0x7f9c600feaf0 2024-09-13T22:10:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.572+0000 7f9c577fe640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f9c4c06e3b0 0x7f9c4c070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.572+0000 7f9c577fe640 1 -- 172.21.15.89:0/1666861189 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9c5008e410 con 0x7f9c600feaf0 2024-09-13T22:10:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.572+0000 7f9c5dd9b640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f9c4c06e3b0 0x7f9c4c070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.573+0000 7f9c5dd9b640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f9c4c06e3b0 0x7f9c4c070870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9c48000c00 tx=0x7f9c480314e0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:16.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.577+0000 7f9c577fe640 1 -- 172.21.15.89:0/1666861189 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f9c500577c0 con 0x7f9c600feaf0 2024-09-13T22:10:16.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.770+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c601035e0 con 0x7f9c4c06e3b0 2024-09-13T22:10:16.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.771+0000 7f9c577fe640 1 -- 172.21.15.89:0/1666861189 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f9c601035e0 con 0x7f9c4c06e3b0 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f9c4c06e3b0 msgr2=0x7f9c4c070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f9c4c06e3b0 0x7f9c4c070870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9c48000c00 tx=0x7f9c480314e0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600feaf0 msgr2=0x7f9c60102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600feaf0 0x7f9c60102eb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000d8d0 tx=0x7f9c5000dd90 comp rx=0 tx=0).stop 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 shutdown_connections 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f9c4c06e3b0 0x7f9c4c070870 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c600ffcf0 0x7f9c60101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 --2- 172.21.15.89:0/1666861189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600feaf0 0x7f9c60102eb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 >> 172.21.15.89:0/1666861189 conn(0x7f9c600fa280 msgr2=0x7f9c600fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.773+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 shutdown_connections 2024-09-13T22:10:16.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.774+0000 7f9c64d03640 1 -- 172.21.15.89:0/1666861189 wait complete. 2024-09-13T22:10:16.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.859+0000 7fd13c49a640 1 -- 172.21.15.89:0/3353626357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340ffcf0 msgr2=0x7fd134100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.859+0000 7fd13c49a640 1 --2- 172.21.15.89:0/3353626357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340ffcf0 0x7fd134100170 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd124009880 tx=0x7fd12402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.859+0000 7fd13c49a640 1 -- 172.21.15.89:0/3353626357 shutdown_connections 2024-09-13T22:10:16.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.859+0000 7fd13c49a640 1 --2- 172.21.15.89:0/3353626357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340ffcf0 0x7fd134100170 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.859+0000 7fd13c49a640 1 --2- 172.21.15.89:0/3353626357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1340feaf0 0x7fd1340feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.859+0000 7fd13c49a640 1 -- 172.21.15.89:0/3353626357 >> 172.21.15.89:0/3353626357 conn(0x7fd1340fa280 msgr2=0x7fd1340fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:16.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.859+0000 7fd13c49a640 1 -- 172.21.15.89:0/3353626357 shutdown_connections 2024-09-13T22:10:16.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.859+0000 7fd13c49a640 1 -- 172.21.15.89:0/3353626357 wait complete. 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.860+0000 7fd13c49a640 1 Processor -- start 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.860+0000 7fd13c49a640 1 -- start start 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.860+0000 7fd13c49a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340feaf0 0x7fd134068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13c49a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1340ffcf0 0x7fd13419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13c49a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13419a9a0 con 0x7fd1340feaf0 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13c49a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13419aae0 con 0x7fd1340ffcf0 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13a236640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340feaf0 0x7fd134068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13a236640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340feaf0 0x7fd134068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57372/0 (socket says 172.21.15.89:57372) 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13a236640 1 -- 172.21.15.89:0/3631570902 learned_addr learned my addr 172.21.15.89:0/3631570902 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:16.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd139a35640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1340ffcf0 0x7fd13419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:16.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13a236640 1 -- 172.21.15.89:0/3631570902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1340ffcf0 msgr2=0x7fd13419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:16.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13a236640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1340ffcf0 0x7fd13419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:16.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13a236640 1 -- 172.21.15.89:0/3631570902 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124009560 con 0x7fd1340feaf0 2024-09-13T22:10:16.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13a236640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340feaf0 0x7fd134068790 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd13000d8d0 tx=0x7fd13000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:16.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd12b7fe640 1 -- 172.21.15.89:0/3631570902 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd13000bea0 con 0x7fd1340feaf0 2024-09-13T22:10:16.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13419ad90 con 0x7fd1340feaf0 2024-09-13T22:10:16.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd12b7fe640 1 -- 172.21.15.89:0/3631570902 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd130009c00 con 0x7fd1340feaf0 2024-09-13T22:10:16.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd12b7fe640 1 -- 172.21.15.89:0/3631570902 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd13000f790 con 0x7fd1340feaf0 2024-09-13T22:10:16.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.861+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13419b2b0 con 0x7fd1340feaf0 2024-09-13T22:10:16.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.862+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13418e670 con 0x7fd1340feaf0 2024-09-13T22:10:16.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.863+0000 7fd12b7fe640 1 -- 172.21.15.89:0/3631570902 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 31) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fd13000fa50 con 0x7fd1340feaf0 2024-09-13T22:10:16.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.863+0000 7fd12b7fe640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd12006e3b0 0x7fd120070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:16.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.863+0000 7fd12b7fe640 1 -- 172.21.15.89:0/3631570902 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd13008e410 con 0x7fd1340feaf0 2024-09-13T22:10:16.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.863+0000 7fd139a35640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd12006e3b0 0x7fd120070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:16.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.864+0000 7fd139a35640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd12006e3b0 0x7fd120070870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd124000c00 tx=0x7fd1240314e0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:16.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:16.868+0000 7fd12b7fe640 1 -- 172.21.15.89:0/3631570902 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd1300577c0 con 0x7fd1340feaf0 2024-09-13T22:10:17.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.061+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd13402c4f0 con 0x7fd12006e3b0 2024-09-13T22:10:17.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.076+0000 7fd12b7fe640 1 -- 172.21.15.89:0/3631570902 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd13402c4f0 con 0x7fd12006e3b0 2024-09-13T22:10:17.077 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:10:17.077 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (8m) 19s ago 9m 25.1M - 0.25.0 c8568f914cd2 6ef74b73ca3e 2024-09-13T22:10:17.077 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (9m) 19s ago 9m 7784k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:10:17.077 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (8m) 8s ago 8m 7788k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:10:17.077 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (9m) 19s ago 9m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:10:17.077 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (8m) 8s ago 8m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (7m) 19s ago 9m 88.5M - 9.4.7 954c08fa6188 59724cff87bd 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (3m) 19s ago 3m 15.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (3m) 19s ago 3m 13.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (3m) 8s ago 3m 216M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (3m) 8s ago 3m 15.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (37s) 19s ago 10m 474M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (114s) 8s ago 8m 96.5M - 19.1.1-324-gecab7be5 0652ff2b5d78 105fec331cd0 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (10m) 19s ago 10m 56.5M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (8m) 8s ago 8m 44.1M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (9m) 19s ago 9m 16.3M - 1.5.0 0da6a335fe13 eeaf1dd44f97 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (8m) 8s ago 8m 15.7M - 1.5.0 0da6a335fe13 c76544fc91f3 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (7m) 19s ago 7m 213M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (7m) 19s ago 7m 232M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:10:17.078 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (6m) 19s ago 6m 197M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:10:17.079 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (6m) 8s ago 6m 256M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:10:17.079 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (5m) 8s ago 5m 216M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:10:17.079 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (5m) 8s ago 5m 229M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:10:17.079 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (42s) 19s ago 8m 42.2M - 2.43.0 a07b618ecd1d 52c6cf4a0a89 2024-09-13T22:10:17.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd12006e3b0 msgr2=0x7fd120070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd12006e3b0 0x7fd120070870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd124000c00 tx=0x7fd1240314e0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340feaf0 msgr2=0x7fd134068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340feaf0 0x7fd134068790 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd13000d8d0 tx=0x7fd13000dd90 comp rx=0 tx=0).stop 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 shutdown_connections 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd12006e3b0 0x7fd120070870 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1340ffcf0 0x7fd13419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 --2- 172.21.15.89:0/3631570902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1340feaf0 0x7fd134068790 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 >> 172.21.15.89:0/3631570902 conn(0x7fd1340fa280 msgr2=0x7fd1341033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 shutdown_connections 2024-09-13T22:10:17.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.079+0000 7fd13c49a640 1 -- 172.21.15.89:0/3631570902 wait complete. 2024-09-13T22:10:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.207+0000 7f33c705f640 1 -- 172.21.15.89:0/852748471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c00ffbd0 msgr2=0x7f33c00fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.207+0000 7f33c705f640 1 --2- 172.21.15.89:0/852748471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c00ffbd0 0x7f33c00fffd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f33b40097e0 tx=0x7f33b402a3f0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.208+0000 7f33c705f640 1 -- 172.21.15.89:0/852748471 shutdown_connections 2024-09-13T22:10:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.208+0000 7f33c705f640 1 --2- 172.21.15.89:0/852748471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c0100dd0 0x7f33c0101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.208+0000 7f33c705f640 1 --2- 172.21.15.89:0/852748471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c00ffbd0 0x7f33c00fffd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.208+0000 7f33c705f640 1 -- 172.21.15.89:0/852748471 >> 172.21.15.89:0/852748471 conn(0x7f33c00fb360 msgr2=0x7f33c00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:17.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.208+0000 7f33c705f640 1 -- 172.21.15.89:0/852748471 shutdown_connections 2024-09-13T22:10:17.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.208+0000 7f33c705f640 1 -- 172.21.15.89:0/852748471 wait complete. 2024-09-13T22:10:17.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.209+0000 7f33c705f640 1 Processor -- start 2024-09-13T22:10:17.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.209+0000 7f33c705f640 1 -- start start 2024-09-13T22:10:17.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.209+0000 7f33c705f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c00ffbd0 0x7f33c019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:17.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.209+0000 7f33c705f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c0100dd0 0x7f33c019c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:17.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.209+0000 7f33c705f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c019c770 con 0x7f33c0100dd0 2024-09-13T22:10:17.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.209+0000 7f33c705f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c019c8e0 con 0x7f33c00ffbd0 2024-09-13T22:10:17.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.209+0000 7f33bffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c0100dd0 0x7f33c019c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:17.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.209+0000 7f33bffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c0100dd0 0x7f33c019c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57392/0 (socket says 172.21.15.89:57392) 2024-09-13T22:10:17.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.209+0000 7f33bffff640 1 -- 172.21.15.89:0/3441992031 learned_addr learned my addr 172.21.15.89:0/3441992031 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:17.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.210+0000 7f33c4dfb640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c00ffbd0 0x7f33c019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:17.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.210+0000 7f33bffff640 1 -- 172.21.15.89:0/3441992031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c00ffbd0 msgr2=0x7f33c019bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.210+0000 7f33bffff640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c00ffbd0 0x7f33c019bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.210+0000 7f33bffff640 1 -- 172.21.15.89:0/3441992031 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4009490 con 0x7f33c0100dd0 2024-09-13T22:10:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.210+0000 7f33bffff640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c0100dd0 0x7f33c019c1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00e940 tx=0x7f33ac00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.210+0000 7f33bdffb640 1 -- 172.21.15.89:0/3441992031 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33ac00cc90 con 0x7f33c0100dd0 2024-09-13T22:10:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.211+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c01a1370 con 0x7f33c0100dd0 2024-09-13T22:10:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.211+0000 7f33bdffb640 1 -- 172.21.15.89:0/3441992031 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33ac00cdf0 con 0x7f33c0100dd0 2024-09-13T22:10:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.211+0000 7f33bdffb640 1 -- 172.21.15.89:0/3441992031 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33ac004e70 con 0x7f33c0100dd0 2024-09-13T22:10:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.211+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c01a1860 con 0x7f33c0100dd0 2024-09-13T22:10:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.212+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c0103700 con 0x7f33c0100dd0 2024-09-13T22:10:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.213+0000 7f33bdffb640 1 -- 172.21.15.89:0/3441992031 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 31) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f33ac021440 con 0x7f33c0100dd0 2024-09-13T22:10:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.213+0000 7f33bdffb640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f33b006e440 0x7f33b0070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:17.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.213+0000 7f33bdffb640 1 -- 172.21.15.89:0/3441992031 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f33ac014070 con 0x7f33c0100dd0 2024-09-13T22:10:17.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.214+0000 7f33c4dfb640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f33b006e440 0x7f33b0070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:17.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.214+0000 7f33c4dfb640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f33b006e440 0x7f33b0070900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f33b40308d0 tx=0x7f33b4004700 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:17.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.221+0000 7f33bdffb640 1 -- 172.21.15.89:0/3441992031 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f33ac057cb0 con 0x7f33c0100dd0 2024-09-13T22:10:17.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.492+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f33c0074420 con 0x7f33c0100dd0 2024-09-13T22:10:17.494 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:17 smithi089 ceph-mon[27921]: pgmap v15: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 430 op/s 2024-09-13T22:10:17.494 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:17 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:17.494 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:17 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:17.494 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:17 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:10:17.494 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:17 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.493+0000 7f33bdffb640 1 -- 172.21.15.89:0/3441992031 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f33ac05b370 con 0x7f33c0100dd0 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:10:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:10:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:10:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:10:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:10:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:10:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 12, 2024-09-13T22:10:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:10:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:10:17.496 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:10:17.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f33b006e440 msgr2=0x7f33b0070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f33b006e440 0x7f33b0070900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f33b40308d0 tx=0x7f33b4004700 comp rx=0 tx=0).stop 2024-09-13T22:10:17.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c0100dd0 msgr2=0x7f33c019c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c0100dd0 0x7f33c019c1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00e940 tx=0x7f33ac00ee00 comp rx=0 tx=0).stop 2024-09-13T22:10:17.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 shutdown_connections 2024-09-13T22:10:17.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f33b006e440 0x7f33b0070900 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c0100dd0 0x7f33c019c1a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 --2- 172.21.15.89:0/3441992031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c00ffbd0 0x7f33c019bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 >> 172.21.15.89:0/3441992031 conn(0x7f33c00fb360 msgr2=0x7f33c01095e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:17.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 shutdown_connections 2024-09-13T22:10:17.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.495+0000 7f33c705f640 1 -- 172.21.15.89:0/3441992031 wait complete. 2024-09-13T22:10:17.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.580+0000 7fd3dbc53640 1 -- 172.21.15.89:0/2243472056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 msgr2=0x7fd3d41012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.580+0000 7fd3dbc53640 1 --2- 172.21.15.89:0/2243472056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 0x7fd3d41012b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40097e0 tx=0x7fd3c402a3f0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.580+0000 7fd3dbc53640 1 -- 172.21.15.89:0/2243472056 shutdown_connections 2024-09-13T22:10:17.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.580+0000 7fd3dbc53640 1 --2- 172.21.15.89:0/2243472056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 0x7fd3d41012b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.580+0000 7fd3dbc53640 1 --2- 172.21.15.89:0/2243472056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d40fde50 0x7fd3d40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.580+0000 7fd3dbc53640 1 -- 172.21.15.89:0/2243472056 >> 172.21.15.89:0/2243472056 conn(0x7fd3d40f99c0 msgr2=0x7fd3d40fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:17.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3dbc53640 1 -- 172.21.15.89:0/2243472056 shutdown_connections 2024-09-13T22:10:17.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3dbc53640 1 -- 172.21.15.89:0/2243472056 wait complete. 2024-09-13T22:10:17.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3dbc53640 1 Processor -- start 2024-09-13T22:10:17.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3dbc53640 1 -- start start 2024-09-13T22:10:17.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3dbc53640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d40fde50 0x7fd3d4100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:17.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3dbc53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 0x7fd3d40fede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:17.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3dbc53640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40ff320 con 0x7fd3d4100e30 2024-09-13T22:10:17.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3dbc53640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40ff490 con 0x7fd3d40fde50 2024-09-13T22:10:17.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3d91ee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 0x7fd3d40fede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:17.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3d91ee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 0x7fd3d40fede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57406/0 (socket says 172.21.15.89:57406) 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.581+0000 7fd3d91ee640 1 -- 172.21.15.89:0/622589821 learned_addr learned my addr 172.21.15.89:0/622589821 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3d99ef640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d40fde50 0x7fd3d4100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3d91ee640 1 -- 172.21.15.89:0/622589821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d40fde50 msgr2=0x7fd3d4100790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3d91ee640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d40fde50 0x7fd3d4100790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3d91ee640 1 -- 172.21.15.89:0/622589821 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009560 con 0x7fd3d4100e30 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3d91ee640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 0x7fd3d40fede0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009900 tx=0x7fd3c4030c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3caffd640 1 -- 172.21.15.89:0/622589821 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c40037c0 con 0x7fd3d4100e30 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3caffd640 1 -- 172.21.15.89:0/622589821 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3c40044f0 con 0x7fd3d4100e30 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c4009490 con 0x7fd3d4100e30 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3caffd640 1 -- 172.21.15.89:0/622589821 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c4031d80 con 0x7fd3d4100e30 2024-09-13T22:10:17.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.582+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d40ffa70 con 0x7fd3d4100e30 2024-09-13T22:10:17.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.583+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d40fe250 con 0x7fd3d4100e30 2024-09-13T22:10:17.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.584+0000 7fd3caffd640 1 -- 172.21.15.89:0/622589821 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 31) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fd3c4031400 con 0x7fd3d4100e30 2024-09-13T22:10:17.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.584+0000 7fd3caffd640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd3c006e3b0 0x7fd3c0070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:17.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.584+0000 7fd3caffd640 1 -- 172.21.15.89:0/622589821 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd3c40afa10 con 0x7fd3d4100e30 2024-09-13T22:10:17.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.584+0000 7fd3d99ef640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd3c006e3b0 0x7fd3c0070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:17.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.585+0000 7fd3d99ef640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd3c006e3b0 0x7fd3c0070870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009530 tx=0x7fd3d0009260 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:17.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.589+0000 7fd3caffd640 1 -- 172.21.15.89:0/622589821 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd3c4078e40 con 0x7fd3d4100e30 2024-09-13T22:10:17.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:17 smithi159 ceph-mon[35348]: pgmap v15: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 430 op/s 2024-09-13T22:10:17.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:17 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:17.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:17 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:17.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:17 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:10:17.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:17 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:17.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.784+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3d40608f0 con 0x7fd3c006e3b0 2024-09-13T22:10:17.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.786+0000 7fd3caffd640 1 -- 172.21.15.89:0/622589821 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fd3d40608f0 con 0x7fd3c006e3b0 2024-09-13T22:10:17.787 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:10:17.787 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:10:17.787 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:10:17.787 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:10:17.787 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:10:17.787 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-13T22:10:17.787 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:10:17.787 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T22:10:17.788 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T22:10:17.788 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:10:17.788 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:10:17.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd3c006e3b0 msgr2=0x7fd3c0070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd3c006e3b0 0x7fd3c0070870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009530 tx=0x7fd3d0009260 comp rx=0 tx=0).stop 2024-09-13T22:10:17.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 msgr2=0x7fd3d40fede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:17.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 0x7fd3d40fede0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009900 tx=0x7fd3c4030c00 comp rx=0 tx=0).stop 2024-09-13T22:10:17.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 shutdown_connections 2024-09-13T22:10:17.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd3c006e3b0 0x7fd3c0070870 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d4100e30 0x7fd3d40fede0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 --2- 172.21.15.89:0/622589821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3d40fde50 0x7fd3d4100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:17.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 >> 172.21.15.89:0/622589821 conn(0x7fd3d40f99c0 msgr2=0x7fd3d41044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:17.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 shutdown_connections 2024-09-13T22:10:17.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:17.788+0000 7fd3dbc53640 1 -- 172.21.15.89:0/622589821 wait complete. 2024-09-13T22:10:18.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:18 smithi089 ceph-mon[27921]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:18 smithi089 ceph-mon[27921]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:18 smithi089 ceph-mon[27921]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:18 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:10:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:18 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3441992031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:18 smithi159 ceph-mon[35348]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:18 smithi159 ceph-mon[35348]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:18 smithi159 ceph-mon[35348]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:18 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:10:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:18 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3441992031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:19.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:19 smithi089 ceph-mon[27921]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:19.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:19 smithi089 ceph-mon[27921]: pgmap v16: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 467 op/s 2024-09-13T22:10:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:19 smithi159 ceph-mon[35348]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:19 smithi159 ceph-mon[35348]: pgmap v16: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 467 op/s 2024-09-13T22:10:21.614 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:21 smithi159 ceph-mon[35348]: pgmap v17: 65 pgs: 65 active+clean; 243 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 2.3 MiB/s wr, 706 op/s 2024-09-13T22:10:21.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:21 smithi089 ceph-mon[27921]: pgmap v17: 65 pgs: 65 active+clean; 243 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 2.3 MiB/s wr, 706 op/s 2024-09-13T22:10:22.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:22 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:10:22.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:22 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:10:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:23 smithi089 ceph-mon[27921]: pgmap v18: 65 pgs: 65 active+clean; 243 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 512 op/s 2024-09-13T22:10:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:23 smithi089 ceph-mon[27921]: Upgrade: Updating mgr.smithi159.ghpomd 2024-09-13T22:10:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:23 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:10:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:23 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:10:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:23 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:10:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:23 smithi089 ceph-mon[27921]: Deploying daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:10:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:23 smithi159 ceph-mon[35348]: pgmap v18: 65 pgs: 65 active+clean; 243 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 512 op/s 2024-09-13T22:10:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:23 smithi159 ceph-mon[35348]: Upgrade: Updating mgr.smithi159.ghpomd 2024-09-13T22:10:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:23 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:10:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:23 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:10:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:23 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:10:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:23 smithi159 ceph-mon[35348]: Deploying daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:10:24.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:24 smithi159 ceph-mon[35348]: pgmap v19: 65 pgs: 65 active+clean; 237 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 813 op/s 2024-09-13T22:10:24.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:24 smithi089 ceph-mon[27921]: pgmap v19: 65 pgs: 65 active+clean; 237 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 813 op/s 2024-09-13T22:10:26.464 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T22:10:26.465 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T22:10:26.819 DEBUG:teuthology.parallel:result is None 2024-09-13T22:10:26.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T22:10:26.853 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T22:10:26.853 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T22:10:26.976 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T22:10:26.976 DEBUG:teuthology.parallel:result is None 2024-09-13T22:10:27.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:26 smithi089 ceph-mon[27921]: pgmap v20: 65 pgs: 65 active+clean; 237 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 612 op/s 2024-09-13T22:10:27.205 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:26 smithi159 ceph-mon[35348]: pgmap v20: 65 pgs: 65 active+clean; 237 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 612 op/s 2024-09-13T22:10:28.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:28 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:28.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:28 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:28.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:28 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:28.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:28 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:28.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:28 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:28.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:28 smithi089 ceph-mon[27921]: pgmap v21: 65 pgs: 65 active+clean; 237 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.6 MiB/s wr, 645 op/s 2024-09-13T22:10:28.789 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:28 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:28.789 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:28 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:28.789 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:28 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:28.789 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:28 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:28.789 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:28 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:28.789 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:28 smithi159 ceph-mon[35348]: pgmap v21: 65 pgs: 65 active+clean; 237 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.6 MiB/s wr, 645 op/s 2024-09-13T22:10:31.240 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:30 smithi159 ceph-mon[35348]: pgmap v22: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.9 MiB/s wr, 797 op/s 2024-09-13T22:10:31.240 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:30 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:31.240 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:30 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:31.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:30 smithi089 ceph-mon[27921]: pgmap v22: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.9 MiB/s wr, 797 op/s 2024-09-13T22:10:31.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:30 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:31.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:30 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:32.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:32 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:32.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:32 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:32.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:32 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:32.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:32 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:33 smithi089 ceph-mon[27921]: pgmap v23: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 522 op/s 2024-09-13T22:10:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:33 smithi089 ceph-mon[27921]: Standby manager daemon smithi159.ghpomd restarted 2024-09-13T22:10:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:33 smithi089 ceph-mon[27921]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:10:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:33 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2644300559' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:10:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:33 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2644300559' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:10:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:33 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2644300559' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:10:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:33 smithi089 ceph-mon[27921]: from='mgr.? 172.21.15.159:0/2644300559' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:10:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:33 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:33.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:33 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:33 smithi159 ceph-mon[35348]: pgmap v23: 65 pgs: 65 active+clean; 222 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 522 op/s 2024-09-13T22:10:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:33 smithi159 ceph-mon[35348]: Standby manager daemon smithi159.ghpomd restarted 2024-09-13T22:10:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:33 smithi159 ceph-mon[35348]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:10:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:33 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2644300559' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:10:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:33 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2644300559' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:10:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:33 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2644300559' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:10:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:33 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/2644300559' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:10:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:33 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:33.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:33 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:34.366 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:34 smithi159 ceph-mon[35348]: mgrmap e32: smithi089.naneiw(active, since 41s), standbys: smithi159.ghpomd 2024-09-13T22:10:34.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:34 smithi089 ceph-mon[27921]: mgrmap e32: smithi089.naneiw(active, since 41s), standbys: smithi159.ghpomd 2024-09-13T22:10:35.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: pgmap v24: 65 pgs: 65 active+clean; 205 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 535 op/s 2024-09-13T22:10:35.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:10:35.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.naneiw"}]: dispatch 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.naneiw"}]': finished 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.ghpomd"}]: dispatch 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.ghpomd"}]': finished 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:35 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: pgmap v24: 65 pgs: 65 active+clean; 205 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 535 op/s 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.naneiw"}]: dispatch 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.naneiw"}]': finished 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.ghpomd"}]: dispatch 2024-09-13T22:10:35.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.ghpomd"}]': finished 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:35.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:35 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:36.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:36 smithi089 ceph-mon[27921]: Upgrade: Setting container_image for all mgr 2024-09-13T22:10:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:36 smithi089 ceph-mon[27921]: Upgrade: Setting container_image for all rgw 2024-09-13T22:10:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:36 smithi089 ceph-mon[27921]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T22:10:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:36 smithi089 ceph-mon[27921]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T22:10:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:36 smithi089 ceph-mon[27921]: Upgrade: Setting container_image for all iscsi 2024-09-13T22:10:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:36 smithi089 ceph-mon[27921]: Upgrade: Setting container_image for all nfs 2024-09-13T22:10:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:36 smithi089 ceph-mon[27921]: Upgrade: Setting container_image for all nvmeof 2024-09-13T22:10:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:36 smithi159 ceph-mon[35348]: Upgrade: Setting container_image for all mgr 2024-09-13T22:10:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:36 smithi159 ceph-mon[35348]: Upgrade: Setting container_image for all rgw 2024-09-13T22:10:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:36 smithi159 ceph-mon[35348]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T22:10:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:36 smithi159 ceph-mon[35348]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T22:10:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:36 smithi159 ceph-mon[35348]: Upgrade: Setting container_image for all iscsi 2024-09-13T22:10:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:36 smithi159 ceph-mon[35348]: Upgrade: Setting container_image for all nfs 2024-09-13T22:10:36.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:36 smithi159 ceph-mon[35348]: Upgrade: Setting container_image for all nvmeof 2024-09-13T22:10:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:37 smithi089 ceph-mon[27921]: pgmap v25: 65 pgs: 65 active+clean; 205 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 550 KiB/s wr, 234 op/s 2024-09-13T22:10:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:37 smithi089 ceph-mon[27921]: Upgrade: Updating node-exporter.smithi089 (1/2) 2024-09-13T22:10:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:37 smithi089 ceph-mon[27921]: Deploying daemon node-exporter.smithi089 on smithi089 2024-09-13T22:10:37.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:37 smithi159 ceph-mon[35348]: pgmap v25: 65 pgs: 65 active+clean; 205 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 550 KiB/s wr, 234 op/s 2024-09-13T22:10:37.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:37 smithi159 ceph-mon[35348]: Upgrade: Updating node-exporter.smithi089 (1/2) 2024-09-13T22:10:37.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:37 smithi159 ceph-mon[35348]: Deploying daemon node-exporter.smithi089 on smithi089 2024-09-13T22:10:38.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:38 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:10:38.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:38 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:10:39.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:39 smithi089 ceph-mon[27921]: pgmap v26: 65 pgs: 65 active+clean; 205 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 557 KiB/s wr, 234 op/s 2024-09-13T22:10:39.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:39 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:39.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:39 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:39.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:39 smithi159 ceph-mon[35348]: pgmap v26: 65 pgs: 65 active+clean; 205 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 557 KiB/s wr, 234 op/s 2024-09-13T22:10:39.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:39 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:39.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:39 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:41.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:41 smithi159 ceph-mon[35348]: pgmap v27: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 416 KiB/s wr, 202 op/s 2024-09-13T22:10:41.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:41 smithi159 ceph-mon[35348]: Upgrade: Updating node-exporter.smithi159 (2/2) 2024-09-13T22:10:41.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:41 smithi159 ceph-mon[35348]: Deploying daemon node-exporter.smithi159 on smithi159 2024-09-13T22:10:41.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:41 smithi089 ceph-mon[27921]: pgmap v27: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 416 KiB/s wr, 202 op/s 2024-09-13T22:10:41.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:41 smithi089 ceph-mon[27921]: Upgrade: Updating node-exporter.smithi159 (2/2) 2024-09-13T22:10:41.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:41 smithi089 ceph-mon[27921]: Deploying daemon node-exporter.smithi159 on smithi159 2024-09-13T22:10:43.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:43 smithi089 ceph-mon[27921]: pgmap v28: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 9.9 KiB/s wr, 13 op/s 2024-09-13T22:10:43.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:43 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:43.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:43 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:43.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:43 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:43.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:43 smithi159 ceph-mon[35348]: pgmap v28: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 9.9 KiB/s wr, 13 op/s 2024-09-13T22:10:43.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:43 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:43.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:43 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:43.614 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:43 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:45.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:45 smithi089 ceph-mon[27921]: pgmap v29: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 9.9 KiB/s wr, 13 op/s 2024-09-13T22:10:45.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:45 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:45.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:45 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:45 smithi159 ceph-mon[35348]: pgmap v29: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 9.9 KiB/s wr, 13 op/s 2024-09-13T22:10:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:45 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:45 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:46.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:46 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:46.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:46 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:46.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:46 smithi089 ceph-mon[27921]: pgmap v30: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.4 KiB/s wr, 0 op/s 2024-09-13T22:10:47.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:46 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:47.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:46 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:47.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:46 smithi159 ceph-mon[35348]: pgmap v30: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.4 KiB/s wr, 0 op/s 2024-09-13T22:10:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.873+0000 7fee775ca640 1 -- 172.21.15.89:0/343966426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 msgr2=0x7fee70100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.873+0000 7fee775ca640 1 --2- 172.21.15.89:0/343966426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 0x7fee70100170 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee60009880 tx=0x7fee6002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:10:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.873+0000 7fee775ca640 1 -- 172.21.15.89:0/343966426 shutdown_connections 2024-09-13T22:10:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.873+0000 7fee775ca640 1 --2- 172.21.15.89:0/343966426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 0x7fee70100170 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.873+0000 7fee775ca640 1 --2- 172.21.15.89:0/343966426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee700feaf0 0x7fee700feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.873+0000 7fee775ca640 1 -- 172.21.15.89:0/343966426 >> 172.21.15.89:0/343966426 conn(0x7fee700fa280 msgr2=0x7fee700fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.873+0000 7fee775ca640 1 -- 172.21.15.89:0/343966426 shutdown_connections 2024-09-13T22:10:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.873+0000 7fee775ca640 1 -- 172.21.15.89:0/343966426 wait complete. 2024-09-13T22:10:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee775ca640 1 Processor -- start 2024-09-13T22:10:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee775ca640 1 -- start start 2024-09-13T22:10:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee775ca640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee700feaf0 0x7fee70197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee775ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 0x7fee70197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee775ca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee701983a0 con 0x7fee700ffcf0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee775ca640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee70198510 con 0x7fee700feaf0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee74b65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 0x7fee70197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee74b65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 0x7fee70197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38756/0 (socket says 172.21.15.89:38756) 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee74b65640 1 -- 172.21.15.89:0/2977268611 learned_addr learned my addr 172.21.15.89:0/2977268611 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.874+0000 7fee75366640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee700feaf0 0x7fee70197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.875+0000 7fee74b65640 1 -- 172.21.15.89:0/2977268611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee700feaf0 msgr2=0x7fee70197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.875+0000 7fee74b65640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee700feaf0 0x7fee70197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.875+0000 7fee74b65640 1 -- 172.21.15.89:0/2977268611 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009560 con 0x7fee700ffcf0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.875+0000 7fee74b65640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 0x7fee70197dd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fee60005520 tx=0x7fee60005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.875+0000 7fee667fc640 1 -- 172.21.15.89:0/2977268611 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee60004aa0 con 0x7fee700ffcf0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.875+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7019cf00 con 0x7fee700ffcf0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.875+0000 7fee667fc640 1 -- 172.21.15.89:0/2977268611 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee60004c00 con 0x7fee700ffcf0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.875+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7019d3c0 con 0x7fee700ffcf0 2024-09-13T22:10:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.875+0000 7fee667fc640 1 -- 172.21.15.89:0/2977268611 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee60003b10 con 0x7fee700ffcf0 2024-09-13T22:10:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.877+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee700feef0 con 0x7fee700ffcf0 2024-09-13T22:10:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.877+0000 7fee667fc640 1 -- 172.21.15.89:0/2977268611 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fee60003d40 con 0x7fee700ffcf0 2024-09-13T22:10:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.877+0000 7fee667fc640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fee5c06e3b0 0x7fee5c070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:47.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.878+0000 7fee667fc640 1 -- 172.21.15.89:0/2977268611 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fee600af540 con 0x7fee700ffcf0 2024-09-13T22:10:47.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.878+0000 7fee75366640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fee5c06e3b0 0x7fee5c070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:47.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.878+0000 7fee75366640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fee5c06e3b0 0x7fee5c070870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee700ffb50 tx=0x7fee6c00b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:47.882+0000 7fee667fc640 1 -- 172.21.15.89:0/2977268611 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fee600789a0 con 0x7fee700ffcf0 2024-09-13T22:10:48.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.109+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee700608f0 con 0x7fee5c06e3b0 2024-09-13T22:10:48.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.117+0000 7fee667fc640 1 -- 172.21.15.89:0/2977268611 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fee700608f0 con 0x7fee5c06e3b0 2024-09-13T22:10:48.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fee5c06e3b0 msgr2=0x7fee5c070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fee5c06e3b0 0x7fee5c070870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee700ffb50 tx=0x7fee6c00b390 comp rx=0 tx=0).stop 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 msgr2=0x7fee70197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 0x7fee70197dd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fee60005520 tx=0x7fee60005550 comp rx=0 tx=0).stop 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 shutdown_connections 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fee5c06e3b0 0x7fee5c070870 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee700ffcf0 0x7fee70197dd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 --2- 172.21.15.89:0/2977268611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee700feaf0 0x7fee70197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 >> 172.21.15.89:0/2977268611 conn(0x7fee700fa280 msgr2=0x7fee700fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 shutdown_connections 2024-09-13T22:10:48.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.119+0000 7fee775ca640 1 -- 172.21.15.89:0/2977268611 wait complete. 2024-09-13T22:10:48.129 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:10:48.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.204+0000 7f3aca918640 1 -- 172.21.15.89:0/1156719632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fedb0 msgr2=0x7f3ac40ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.204+0000 7f3aca918640 1 --2- 172.21.15.89:0/1156719632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fedb0 0x7f3ac40ff210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009880 tx=0x7f3ab802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.204+0000 7f3aca918640 1 -- 172.21.15.89:0/1156719632 shutdown_connections 2024-09-13T22:10:48.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.204+0000 7f3aca918640 1 --2- 172.21.15.89:0/1156719632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fedb0 0x7f3ac40ff210 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.204+0000 7f3aca918640 1 --2- 172.21.15.89:0/1156719632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ac40fe470 0x7f3ac40fe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.204+0000 7f3aca918640 1 -- 172.21.15.89:0/1156719632 >> 172.21.15.89:0/1156719632 conn(0x7f3ac40fa280 msgr2=0x7f3ac40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:48.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.204+0000 7f3aca918640 1 -- 172.21.15.89:0/1156719632 shutdown_connections 2024-09-13T22:10:48.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.204+0000 7f3aca918640 1 -- 172.21.15.89:0/1156719632 wait complete. 2024-09-13T22:10:48.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.205+0000 7f3aca918640 1 Processor -- start 2024-09-13T22:10:48.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.205+0000 7f3aca918640 1 -- start start 2024-09-13T22:10:48.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.205+0000 7f3aca918640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fe470 0x7f3ac41978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.205+0000 7f3aca918640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ac40fedb0 0x7f3ac4197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.205+0000 7f3aca918640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac41983c0 con 0x7f3ac40fe470 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.205+0000 7f3aca918640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4198530 con 0x7f3ac40fedb0 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fe470 0x7f3ac41978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fe470 0x7f3ac41978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38782/0 (socket says 172.21.15.89:38782) 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac3fff640 1 -- 172.21.15.89:0/1916844846 learned_addr learned my addr 172.21.15.89:0/1916844846 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac37fe640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ac40fedb0 0x7f3ac4197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac3fff640 1 -- 172.21.15.89:0/1916844846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ac40fedb0 msgr2=0x7f3ac4197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac3fff640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ac40fedb0 0x7f3ac4197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac3fff640 1 -- 172.21.15.89:0/1916844846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8009560 con 0x7f3ac40fe470 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac3fff640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fe470 0x7f3ac41978b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400d900 tx=0x7f3ab400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:48.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac17fa640 1 -- 172.21.15.89:0/1916844846 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ab4009c00 con 0x7f3ac40fe470 2024-09-13T22:10:48.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac17fa640 1 -- 172.21.15.89:0/1916844846 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ab4009d60 con 0x7f3ac40fe470 2024-09-13T22:10:48.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac419cf80 con 0x7f3ac40fe470 2024-09-13T22:10:48.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3ac17fa640 1 -- 172.21.15.89:0/1916844846 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ab40049d0 con 0x7f3ac40fe470 2024-09-13T22:10:48.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.206+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac419d440 con 0x7f3ac40fe470 2024-09-13T22:10:48.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.208+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac40fe870 con 0x7f3ac40fe470 2024-09-13T22:10:48.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.208+0000 7f3ac17fa640 1 -- 172.21.15.89:0/1916844846 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f3ab4004b30 con 0x7f3ac40fe470 2024-09-13T22:10:48.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.209+0000 7f3ac17fa640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3aac06e3b0 0x7f3aac070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:48.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.209+0000 7f3ac37fe640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3aac06e3b0 0x7f3aac070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:48.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.209+0000 7f3ac17fa640 1 -- 172.21.15.89:0/1916844846 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3ab408e0b0 con 0x7f3ac40fe470 2024-09-13T22:10:48.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.209+0000 7f3ac37fe640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3aac06e3b0 0x7f3aac070870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8000c00 tx=0x7f3ab80314e0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:48.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.213+0000 7f3ac17fa640 1 -- 172.21.15.89:0/1916844846 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f3ab4057550 con 0x7f3ac40fe470 2024-09-13T22:10:48.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.404+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ac402c4f0 con 0x7f3aac06e3b0 2024-09-13T22:10:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.405+0000 7f3ac17fa640 1 -- 172.21.15.89:0/1916844846 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f3ac402c4f0 con 0x7f3aac06e3b0 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3aac06e3b0 msgr2=0x7f3aac070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3aac06e3b0 0x7f3aac070870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8000c00 tx=0x7f3ab80314e0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fe470 msgr2=0x7f3ac41978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fe470 0x7f3ac41978b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400d900 tx=0x7f3ab400ddc0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 shutdown_connections 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3aac06e3b0 0x7f3aac070870 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ac40fedb0 0x7f3ac4197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 --2- 172.21.15.89:0/1916844846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ac40fe470 0x7f3ac41978b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 >> 172.21.15.89:0/1916844846 conn(0x7f3ac40fa280 msgr2=0x7f3ac4106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.407+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 shutdown_connections 2024-09-13T22:10:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.408+0000 7f3aca918640 1 -- 172.21.15.89:0/1916844846 wait complete. 2024-09-13T22:10:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.492+0000 7f4d71500640 1 -- 172.21.15.89:0/627954615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 msgr2=0x7f4d6c102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.492+0000 7f4d71500640 1 --2- 172.21.15.89:0/627954615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 0x7f4d6c102a70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009c50 tx=0x7f4d6402a9a0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.492+0000 7f4d71500640 1 -- 172.21.15.89:0/627954615 shutdown_connections 2024-09-13T22:10:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.492+0000 7f4d71500640 1 --2- 172.21.15.89:0/627954615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d6c102fb0 0x7f4d6c1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.492+0000 7f4d71500640 1 --2- 172.21.15.89:0/627954615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 0x7f4d6c102a70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.492+0000 7f4d71500640 1 -- 172.21.15.89:0/627954615 >> 172.21.15.89:0/627954615 conn(0x7f4d6c0fa280 msgr2=0x7f4d6c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.492+0000 7f4d71500640 1 -- 172.21.15.89:0/627954615 shutdown_connections 2024-09-13T22:10:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.492+0000 7f4d71500640 1 -- 172.21.15.89:0/627954615 wait complete. 2024-09-13T22:10:48.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.493+0000 7f4d71500640 1 Processor -- start 2024-09-13T22:10:48.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.493+0000 7f4d71500640 1 -- start start 2024-09-13T22:10:48.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.493+0000 7f4d71500640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 0x7f4d6c195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:48.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.493+0000 7f4d71500640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d6c102fb0 0x7f4d6c195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:48.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.493+0000 7f4d71500640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c196270 con 0x7f4d6c100680 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.493+0000 7f4d71500640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c1963e0 con 0x7f4d6c102fb0 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.493+0000 7f4d6affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 0x7f4d6c195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.493+0000 7f4d6affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 0x7f4d6c195760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38802/0 (socket says 172.21.15.89:38802) 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.493+0000 7f4d6affd640 1 -- 172.21.15.89:0/1411543396 learned_addr learned my addr 172.21.15.89:0/1411543396 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d6a7fc640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d6c102fb0 0x7f4d6c195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d6affd640 1 -- 172.21.15.89:0/1411543396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d6c102fb0 msgr2=0x7f4d6c195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d6affd640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d6c102fb0 0x7f4d6c195ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d6affd640 1 -- 172.21.15.89:0/1411543396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64009900 con 0x7f4d6c100680 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d6a7fc640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d6c102fb0 0x7f4d6c195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d6affd640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 0x7f4d6c195760 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d640098d0 tx=0x7f4d64030890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d63fff640 1 -- 172.21.15.89:0/1411543396 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d64003b40 con 0x7f4d6c100680 2024-09-13T22:10:48.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c19ae20 con 0x7f4d6c100680 2024-09-13T22:10:48.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d63fff640 1 -- 172.21.15.89:0/1411543396 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d64030cc0 con 0x7f4d6c100680 2024-09-13T22:10:48.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d63fff640 1 -- 172.21.15.89:0/1411543396 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d64044790 con 0x7f4d6c100680 2024-09-13T22:10:48.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.494+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c19b310 con 0x7f4d6c100680 2024-09-13T22:10:48.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.495+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c108880 con 0x7f4d6c100680 2024-09-13T22:10:48.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.496+0000 7f4d63fff640 1 -- 172.21.15.89:0/1411543396 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f4d6400a040 con 0x7f4d6c100680 2024-09-13T22:10:48.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.496+0000 7f4d63fff640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4d5806e3b0 0x7f4d58070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:48.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.496+0000 7f4d63fff640 1 -- 172.21.15.89:0/1411543396 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4d640afa70 con 0x7f4d6c100680 2024-09-13T22:10:48.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.496+0000 7f4d6a7fc640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4d5806e3b0 0x7f4d58070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:48.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.497+0000 7f4d6a7fc640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4d5806e3b0 0x7f4d58070870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4d54006fd0 tx=0x7f4d54008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:48.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.501+0000 7f4d63fff640 1 -- 172.21.15.89:0/1411543396 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f4d64078e20 con 0x7f4d6c100680 2024-09-13T22:10:48.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.692+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d6c1039d0 con 0x7f4d5806e3b0 2024-09-13T22:10:48.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.703+0000 7f4d63fff640 1 -- 172.21.15.89:0/1411543396 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f4d6c1039d0 con 0x7f4d5806e3b0 2024-09-13T22:10:48.705 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:10:48.705 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (8m) 0s ago 9m 25.1M - 0.25.0 c8568f914cd2 6ef74b73ca3e 2024-09-13T22:10:48.705 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (10m) 0s ago 10m 7852k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:10:48.705 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (9m) 3s ago 9m 7872k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:10:48.705 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (10m) 0s ago 10m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:10:48.706 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (9m) 3s ago 9m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:10:48.706 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (8m) 0s ago 9m 88.5M - 9.4.7 954c08fa6188 59724cff87bd 2024-09-13T22:10:48.706 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (4m) 0s ago 4m 16.1M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:10:48.706 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (4m) 0s ago 4m 14.3M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:10:48.706 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (4m) 3s ago 4m 162M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:10:48.706 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (4m) 3s ago 4m 16.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:10:48.706 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (68s) 0s ago 11m 492M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:10:48.706 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (21s) 3s ago 9m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:10:48.706 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (11m) 0s ago 11m 60.1M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (8m) 3s ago 8m 46.4M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (10s) 0s ago 9m 3678k - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (6s) 3s ago 9m 3573k - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (8m) 0s ago 8m 242M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (7m) 0s ago 7m 258M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (7m) 0s ago 7m 222M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (6m) 3s ago 6m 283M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (6m) 3s ago 6m 247M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (6m) 3s ago 5m 253M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:10:48.707 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (32s) 0s ago 9m 45.7M - 2.43.0 a07b618ecd1d 875d0f485758 2024-09-13T22:10:48.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4d5806e3b0 msgr2=0x7f4d58070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4d5806e3b0 0x7f4d58070870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4d54006fd0 tx=0x7f4d54008040 comp rx=0 tx=0).stop 2024-09-13T22:10:48.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 msgr2=0x7f4d6c195760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 0x7f4d6c195760 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d640098d0 tx=0x7f4d64030890 comp rx=0 tx=0).stop 2024-09-13T22:10:48.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 shutdown_connections 2024-09-13T22:10:48.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4d5806e3b0 0x7f4d58070870 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d6c102fb0 0x7f4d6c195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 --2- 172.21.15.89:0/1411543396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d6c100680 0x7f4d6c195760 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 >> 172.21.15.89:0/1411543396 conn(0x7f4d6c0fa280 msgr2=0x7f4d6c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:48.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 shutdown_connections 2024-09-13T22:10:48.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.706+0000 7f4d71500640 1 -- 172.21.15.89:0/1411543396 wait complete. 2024-09-13T22:10:48.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.790+0000 7f42c9002640 1 -- 172.21.15.89:0/2194361214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 msgr2=0x7f42c40fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.790+0000 7f42c9002640 1 --2- 172.21.15.89:0/2194361214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 0x7f42c40fff50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009880 tx=0x7f42b802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.790+0000 7f42c9002640 1 -- 172.21.15.89:0/2194361214 shutdown_connections 2024-09-13T22:10:48.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.790+0000 7f42c9002640 1 --2- 172.21.15.89:0/2194361214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 0x7f42c40fff50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.790+0000 7f42c9002640 1 --2- 172.21.15.89:0/2194361214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c40fe8d0 0x7f42c40fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.790+0000 7f42c9002640 1 -- 172.21.15.89:0/2194361214 >> 172.21.15.89:0/2194361214 conn(0x7f42c40fa080 msgr2=0x7f42c40fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:48.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.790+0000 7f42c9002640 1 -- 172.21.15.89:0/2194361214 shutdown_connections 2024-09-13T22:10:48.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.790+0000 7f42c9002640 1 -- 172.21.15.89:0/2194361214 wait complete. 2024-09-13T22:10:48.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.791+0000 7f42c9002640 1 Processor -- start 2024-09-13T22:10:48.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.791+0000 7f42c9002640 1 -- start start 2024-09-13T22:10:48.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.791+0000 7f42c9002640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c40fe8d0 0x7f42c4068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:48.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.791+0000 7f42c9002640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 0x7f42c419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:48.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.791+0000 7f42c9002640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c419a7a0 con 0x7f42c40ffad0 2024-09-13T22:10:48.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.791+0000 7f42c9002640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c419a8e0 con 0x7f42c40fe8d0 2024-09-13T22:10:48.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.792+0000 7f42c259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 0x7f42c419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:48.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.792+0000 7f42c2d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c40fe8d0 0x7f42c4068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:48.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.792+0000 7f42c259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 0x7f42c419a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38824/0 (socket says 172.21.15.89:38824) 2024-09-13T22:10:48.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.792+0000 7f42c259c640 1 -- 172.21.15.89:0/1300395008 learned_addr learned my addr 172.21.15.89:0/1300395008 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:48.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.792+0000 7f42c2d9d640 1 -- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 msgr2=0x7f42c419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:48.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.792+0000 7f42c2d9d640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 0x7f42c419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:48.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.792+0000 7f42c2d9d640 1 -- 172.21.15.89:0/1300395008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009560 con 0x7f42c40fe8d0 2024-09-13T22:10:48.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.792+0000 7f42c259c640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 0x7f42c419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:10:48.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.792+0000 7f42c2d9d640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c40fe8d0 0x7f42c4068790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009b20 tx=0x7f42b400b2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:48.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.793+0000 7f42abfff640 1 -- 172.21.15.89:0/1300395008 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b4015070 con 0x7f42c40fe8d0 2024-09-13T22:10:48.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.793+0000 7f42abfff640 1 -- 172.21.15.89:0/1300395008 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42b40044f0 con 0x7f42c40fe8d0 2024-09-13T22:10:48.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.793+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c4194000 con 0x7f42c40fe8d0 2024-09-13T22:10:48.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.793+0000 7f42abfff640 1 -- 172.21.15.89:0/1300395008 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b4019680 con 0x7f42c40fe8d0 2024-09-13T22:10:48.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.794+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c41945d0 con 0x7f42c40fe8d0 2024-09-13T22:10:48.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.794+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4195fb0 con 0x7f42c40fe8d0 2024-09-13T22:10:48.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.795+0000 7f42abfff640 1 -- 172.21.15.89:0/1300395008 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f42b4023440 con 0x7f42c40fe8d0 2024-09-13T22:10:48.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.795+0000 7f42abfff640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f42ac06e3b0 0x7f42ac070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:48.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.795+0000 7f42abfff640 1 -- 172.21.15.89:0/1300395008 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f42b40920c0 con 0x7f42c40fe8d0 2024-09-13T22:10:48.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.795+0000 7f42c259c640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f42ac06e3b0 0x7f42ac070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:48.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.796+0000 7f42c259c640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f42ac06e3b0 0x7f42ac070870 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f42c4068d10 tx=0x7f42b80314e0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:48.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:48.800+0000 7f42abfff640 1 -- 172.21.15.89:0/1300395008 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f42b405b5a0 con 0x7f42c40fe8d0 2024-09-13T22:10:48.957 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:48.957 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:48.958 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:48 smithi089 ceph-mon[27921]: pgmap v31: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.4 KiB/s wr, 0 op/s 2024-09-13T22:10:48.958 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:48 smithi089 ceph-mon[27921]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:48.958 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:48.958 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:48 smithi159 ceph-mon[35348]: pgmap v31: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.4 KiB/s wr, 0 op/s 2024-09-13T22:10:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:48 smithi159 ceph-mon[35348]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:49.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:49.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.041+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f42c4107720 con 0x7f42c40fe8d0 2024-09-13T22:10:49.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.042+0000 7f42abfff640 1 -- 172.21.15.89:0/1300395008 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f42b405ec60 con 0x7f42c40fe8d0 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:10:49.044 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:10:49.045 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:10:49.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:10:49.045 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:10:49.045 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 12, 2024-09-13T22:10:49.045 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:10:49.045 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:10:49.045 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.044+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f42ac06e3b0 msgr2=0x7f42ac070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.044+0000 7f42c9002640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f42ac06e3b0 0x7f42ac070870 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f42c4068d10 tx=0x7f42b80314e0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.044+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c40fe8d0 msgr2=0x7f42c4068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.044+0000 7f42c9002640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c40fe8d0 0x7f42c4068790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009b20 tx=0x7f42b400b2c0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.044+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 shutdown_connections 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.044+0000 7f42c9002640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f42ac06e3b0 0x7f42ac070870 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.044+0000 7f42c9002640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42c40ffad0 0x7f42c419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.044+0000 7f42c9002640 1 --2- 172.21.15.89:0/1300395008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c40fe8d0 0x7f42c4068790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.044+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 >> 172.21.15.89:0/1300395008 conn(0x7f42c40fa080 msgr2=0x7f42c4103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:49.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.045+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 shutdown_connections 2024-09-13T22:10:49.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.045+0000 7f42c9002640 1 -- 172.21.15.89:0/1300395008 wait complete. 2024-09-13T22:10:49.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.128+0000 7f13db721640 1 -- 172.21.15.89:0/2459921255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 msgr2=0x7f13d41031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:49.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.128+0000 7f13db721640 1 --2- 172.21.15.89:0/2459921255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 0x7f13d41031e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009880 tx=0x7f13c402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.128+0000 7f13db721640 1 -- 172.21.15.89:0/2459921255 shutdown_connections 2024-09-13T22:10:49.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.128+0000 7f13db721640 1 --2- 172.21.15.89:0/2459921255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 0x7f13d41031e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.128+0000 7f13db721640 1 --2- 172.21.15.89:0/2459921255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d40fe420 0x7f13d4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.128+0000 7f13db721640 1 -- 172.21.15.89:0/2459921255 >> 172.21.15.89:0/2459921255 conn(0x7f13d40fa250 msgr2=0x7f13d40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:49.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.128+0000 7f13db721640 1 -- 172.21.15.89:0/2459921255 shutdown_connections 2024-09-13T22:10:49.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.128+0000 7f13db721640 1 -- 172.21.15.89:0/2459921255 wait complete. 2024-09-13T22:10:49.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.128+0000 7f13db721640 1 Processor -- start 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13db721640 1 -- start start 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13db721640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d40fe420 0x7f13d419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13db721640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 0x7f13d419c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13db721640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d419c730 con 0x7f13d4100d70 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13db721640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d419c8a0 con 0x7f13d40fe420 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13d8cbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 0x7f13d419c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13d8cbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 0x7f13d419c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38852/0 (socket says 172.21.15.89:38852) 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13d8cbc640 1 -- 172.21.15.89:0/2415072274 learned_addr learned my addr 172.21.15.89:0/2415072274 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13d94bd640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d40fe420 0x7f13d419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13d8cbc640 1 -- 172.21.15.89:0/2415072274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d40fe420 msgr2=0x7f13d419bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13d8cbc640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d40fe420 0x7f13d419bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13d8cbc640 1 -- 172.21.15.89:0/2415072274 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4009560 con 0x7f13d4100d70 2024-09-13T22:10:49.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13d94bd640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d40fe420 0x7f13d419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:10:49.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.129+0000 7f13d8cbc640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 0x7f13d419c160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f13c4005520 tx=0x7f13c4005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:49.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.130+0000 7f13ca7fc640 1 -- 172.21.15.89:0/2415072274 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c4004aa0 con 0x7f13d4100d70 2024-09-13T22:10:49.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.130+0000 7f13ca7fc640 1 -- 172.21.15.89:0/2415072274 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13c4004c00 con 0x7f13d4100d70 2024-09-13T22:10:49.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.130+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d41a1290 con 0x7f13d4100d70 2024-09-13T22:10:49.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.130+0000 7f13ca7fc640 1 -- 172.21.15.89:0/2415072274 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c4003b10 con 0x7f13d4100d70 2024-09-13T22:10:49.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.130+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d41a1800 con 0x7f13d4100d70 2024-09-13T22:10:49.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.131+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d410ed90 con 0x7f13d4100d70 2024-09-13T22:10:49.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.131+0000 7f13ca7fc640 1 -- 172.21.15.89:0/2415072274 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f13c4031d20 con 0x7f13d4100d70 2024-09-13T22:10:49.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.132+0000 7f13ca7fc640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f13c006e3b0 0x7f13c0070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:10:49.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.132+0000 7f13ca7fc640 1 -- 172.21.15.89:0/2415072274 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f13c40af560 con 0x7f13d4100d70 2024-09-13T22:10:49.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.132+0000 7f13d94bd640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f13c006e3b0 0x7f13c0070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:10:49.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.132+0000 7f13d94bd640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f13c006e3b0 0x7f13c0070870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f13d00058c0 tx=0x7f13d0005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:10:49.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.136+0000 7f13ca7fc640 1 -- 172.21.15.89:0/2415072274 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f13c4078990 con 0x7f13d4100d70 2024-09-13T22:10:49.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.322+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13d4101770 con 0x7f13c006e3b0 2024-09-13T22:10:49.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.323+0000 7f13ca7fc640 1 -- 172.21.15.89:0/2415072274 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f13d4101770 con 0x7f13c006e3b0 2024-09-13T22:10:49.325 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:10:49.325 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:10:49.325 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:10:49.325 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:10:49.325 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:10:49.325 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-13T22:10:49.325 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:10:49.325 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T22:10:49.326 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-13T22:10:49.326 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:10:49.326 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.325+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f13c006e3b0 msgr2=0x7f13c0070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.325+0000 7f13db721640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f13c006e3b0 0x7f13c0070870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f13d00058c0 tx=0x7f13d0005850 comp rx=0 tx=0).stop 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.325+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 msgr2=0x7f13d419c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.325+0000 7f13db721640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 0x7f13d419c160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f13c4005520 tx=0x7f13c4005550 comp rx=0 tx=0).stop 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.325+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 shutdown_connections 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.325+0000 7f13db721640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f13c006e3b0 0x7f13c0070870 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.325+0000 7f13db721640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13d4100d70 0x7f13d419c160 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.325+0000 7f13db721640 1 --2- 172.21.15.89:0/2415072274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d40fe420 0x7f13d419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.325+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 >> 172.21.15.89:0/2415072274 conn(0x7f13d40fa250 msgr2=0x7f13d40fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.326+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 shutdown_connections 2024-09-13T22:10:49.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:10:49.326+0000 7f13db721640 1 -- 172.21.15.89:0/2415072274 wait complete. 2024-09-13T22:10:50.066 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:49 smithi089 ceph-mon[27921]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:50.066 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:49 smithi089 ceph-mon[27921]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:50.066 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:49 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:50.066 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:49 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:50.066 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:49 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/1300395008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:50.066 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:49 smithi089 ceph-mon[27921]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:50.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:49 smithi159 ceph-mon[35348]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:50.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:49 smithi159 ceph-mon[35348]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:50.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:49 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:50.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:49 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:50.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:49 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/1300395008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:50.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:49 smithi159 ceph-mon[35348]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:10:51.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:50 smithi089 ceph-mon[27921]: pgmap v32: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T22:10:51.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:50 smithi159 ceph-mon[35348]: pgmap v32: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T22:10:52.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:52.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:52.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:10:52.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: pgmap v33: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-13T22:10:52.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:10:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:10:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: pgmap v33: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-13T22:10:53.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:10:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:53 smithi089 ceph-mon[27921]: Upgrade: Updating prometheus.smithi089 2024-09-13T22:10:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:53 smithi159 ceph-mon[35348]: Upgrade: Updating prometheus.smithi089 2024-09-13T22:10:54.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:54 smithi089 ceph-mon[27921]: Deploying daemon prometheus.smithi089 on smithi089 2024-09-13T22:10:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:54 smithi089 ceph-mon[27921]: pgmap v34: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-13T22:10:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:54 smithi159 ceph-mon[35348]: Deploying daemon prometheus.smithi089 on smithi089 2024-09-13T22:10:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:54 smithi159 ceph-mon[35348]: pgmap v34: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-13T22:10:57.183 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:56 smithi089 ceph-mon[27921]: pgmap v35: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:10:57.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:56 smithi159 ceph-mon[35348]: pgmap v35: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:10:59.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:10:58 smithi089 ceph-mon[27921]: pgmap v36: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:10:59.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:10:58 smithi159 ceph-mon[35348]: pgmap v36: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:00.418 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:00 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:00.418 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:00 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:00.419 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:00 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:00.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:00 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:00.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:00 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:00.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:00 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:01 smithi159 ceph-mon[35348]: pgmap v37: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:01.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:01 smithi089 ceph-mon[27921]: pgmap v37: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:03.416 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:03 smithi089 ceph-mon[27921]: pgmap v38: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:03.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:03 smithi159 ceph-mon[35348]: pgmap v38: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:05.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:05 smithi089 ceph-mon[27921]: pgmap v39: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:05.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:05 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:05.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:05 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:05.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:05 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:05.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:05 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:05 smithi159 ceph-mon[35348]: pgmap v39: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:05 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:05 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:05 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:05.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:05 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:07.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:07 smithi089 ceph-mon[27921]: pgmap v40: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:07.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:07 smithi159 ceph-mon[35348]: pgmap v40: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:08.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:08 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:11:08.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:08 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: pgmap v41: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:09.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:09 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: pgmap v41: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:09.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:09 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:11.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:11 smithi089 ceph-mon[27921]: Upgrade: Updating alertmanager.smithi089 2024-09-13T22:11:11.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:11 smithi089 ceph-mon[27921]: Deploying daemon alertmanager.smithi089 on smithi089 2024-09-13T22:11:11.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:11 smithi089 ceph-mon[27921]: pgmap v42: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:11 smithi159 ceph-mon[35348]: Upgrade: Updating alertmanager.smithi089 2024-09-13T22:11:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:11 smithi159 ceph-mon[35348]: Deploying daemon alertmanager.smithi089 on smithi089 2024-09-13T22:11:11.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:11 smithi159 ceph-mon[35348]: pgmap v42: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:13.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:13 smithi089 ceph-mon[27921]: pgmap v43: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:13.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:13 smithi159 ceph-mon[35348]: pgmap v43: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:15.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:15 smithi089 ceph-mon[27921]: pgmap v44: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:15.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:15 smithi159 ceph-mon[35348]: pgmap v44: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:16.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:16 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:16.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:16 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:16.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:16 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:16.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:16 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:16.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:16 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:16.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:16 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:17.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:17 smithi089 ceph-mon[27921]: pgmap v45: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:17.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:17 smithi159 ceph-mon[35348]: pgmap v45: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.407+0000 7f38416af640 1 -- 172.21.15.89:0/1960704217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c102f60 msgr2=0x7f383c105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.408+0000 7f38416af640 1 --2- 172.21.15.89:0/1960704217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c102f60 0x7f383c105350 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f38240098b0 tx=0x7f382402a4d0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.408+0000 7f38416af640 1 -- 172.21.15.89:0/1960704217 shutdown_connections 2024-09-13T22:11:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.408+0000 7f38416af640 1 --2- 172.21.15.89:0/1960704217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c102f60 0x7f383c105350 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.408+0000 7f38416af640 1 --2- 172.21.15.89:0/1960704217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c100630 0x7f383c102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.408+0000 7f38416af640 1 -- 172.21.15.89:0/1960704217 >> 172.21.15.89:0/1960704217 conn(0x7f383c0fa250 msgr2=0x7f383c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.408+0000 7f38416af640 1 -- 172.21.15.89:0/1960704217 shutdown_connections 2024-09-13T22:11:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.408+0000 7f38416af640 1 -- 172.21.15.89:0/1960704217 wait complete. 2024-09-13T22:11:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.408+0000 7f38416af640 1 Processor -- start 2024-09-13T22:11:19.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f38416af640 1 -- start start 2024-09-13T22:11:19.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f38416af640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c100630 0x7f383c195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:19.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f38416af640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c102f60 0x7f383c195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:19.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f38416af640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c196260 con 0x7f383c100630 2024-09-13T22:11:19.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f38416af640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c1963d0 con 0x7f383c102f60 2024-09-13T22:11:19.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f383affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c100630 0x7f383c195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:19.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f383affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c100630 0x7f383c195750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59200/0 (socket says 172.21.15.89:59200) 2024-09-13T22:11:19.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f383affd640 1 -- 172.21.15.89:0/3897677337 learned_addr learned my addr 172.21.15.89:0/3897677337 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:11:19.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f383affd640 1 -- 172.21.15.89:0/3897677337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c102f60 msgr2=0x7f383c195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f383affd640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c102f60 0x7f383c195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f383affd640 1 -- 172.21.15.89:0/3897677337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824009560 con 0x7f383c100630 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f383affd640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c100630 0x7f383c195750 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f382c00ba80 tx=0x7f382c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f3833fff640 1 -- 172.21.15.89:0/3897677337 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382c00cb50 con 0x7f383c100630 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f3833fff640 1 -- 172.21.15.89:0/3897677337 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f382c00ccb0 con 0x7f383c100630 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c19ae70 con 0x7f383c100630 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.409+0000 7f3833fff640 1 -- 172.21.15.89:0/3897677337 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382c0077a0 con 0x7f383c100630 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.410+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c19b410 con 0x7f383c100630 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.410+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383c100a90 con 0x7f383c100630 2024-09-13T22:11:19.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.411+0000 7f3833fff640 1 -- 172.21.15.89:0/3897677337 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f382c007920 con 0x7f383c100630 2024-09-13T22:11:19.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.411+0000 7f3833fff640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f382806e3b0 0x7f3828070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:19.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.411+0000 7f3833fff640 1 -- 172.21.15.89:0/3897677337 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f382c08dcb0 con 0x7f383c100630 2024-09-13T22:11:19.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.411+0000 7f383a7fc640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f382806e3b0 0x7f3828070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:19.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.412+0000 7f383a7fc640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f382806e3b0 0x7f3828070870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f382402a9f0 tx=0x7f3824000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:19.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.416+0000 7f3833fff640 1 -- 172.21.15.89:0/3897677337 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f382c057220 con 0x7f383c100630 2024-09-13T22:11:19.452 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:19 smithi089 ceph-mon[27921]: pgmap v46: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:19 smithi159 ceph-mon[35348]: pgmap v46: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:19.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.607+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f383c1039a0 con 0x7f382806e3b0 2024-09-13T22:11:19.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.608+0000 7f3833fff640 1 -- 172.21.15.89:0/3897677337 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f383c1039a0 con 0x7f382806e3b0 2024-09-13T22:11:19.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f382806e3b0 msgr2=0x7f3828070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f382806e3b0 0x7f3828070870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f382402a9f0 tx=0x7f3824000bc0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c100630 msgr2=0x7f383c195750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c100630 0x7f383c195750 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f382c00ba80 tx=0x7f382c00bf40 comp rx=0 tx=0).stop 2024-09-13T22:11:19.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 shutdown_connections 2024-09-13T22:11:19.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f382806e3b0 0x7f3828070870 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f383c102f60 0x7f383c195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 --2- 172.21.15.89:0/3897677337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f383c100630 0x7f383c195750 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 >> 172.21.15.89:0/3897677337 conn(0x7f383c0fa250 msgr2=0x7f383c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:19.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 shutdown_connections 2024-09-13T22:11:19.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.610+0000 7f38416af640 1 -- 172.21.15.89:0/3897677337 wait complete. 2024-09-13T22:11:19.621 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:11:19.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 -- 172.21.15.89:0/3553472882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 msgr2=0x7f6bd8100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 --2- 172.21.15.89:0/3553472882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 0x7f6bd8100100 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009880 tx=0x7f6bc402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 -- 172.21.15.89:0/3553472882 shutdown_connections 2024-09-13T22:11:19.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 --2- 172.21.15.89:0/3553472882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 0x7f6bd8100100 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 --2- 172.21.15.89:0/3553472882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd80fea80 0x7f6bd80fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 -- 172.21.15.89:0/3553472882 >> 172.21.15.89:0/3553472882 conn(0x7f6bd80fa230 msgr2=0x7f6bd80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 -- 172.21.15.89:0/3553472882 shutdown_connections 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 -- 172.21.15.89:0/3553472882 wait complete. 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 Processor -- start 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.692+0000 7f6bdf108640 1 -- start start 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bdf108640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd80fea80 0x7f6bd8102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bdf108640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 0x7f6bd8101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bdf108640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81015a0 con 0x7f6bd80ffc80 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bdf108640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8101710 con 0x7f6bd80fea80 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 0x7f6bd8101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 0x7f6bd8101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59226/0 (socket says 172.21.15.89:59226) 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bd7fff640 1 -- 172.21.15.89:0/1343650533 learned_addr learned my addr 172.21.15.89:0/1343650533 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:11:19.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bdcea4640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd80fea80 0x7f6bd8102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bd7fff640 1 -- 172.21.15.89:0/1343650533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd80fea80 msgr2=0x7f6bd8102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bd7fff640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd80fea80 0x7f6bd8102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bd7fff640 1 -- 172.21.15.89:0/1343650533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4009560 con 0x7f6bd80ffc80 2024-09-13T22:11:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.693+0000 7f6bd7fff640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 0x7f6bd8101060 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4006010 tx=0x7f6bc40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.694+0000 7f6bd5ffb640 1 -- 172.21.15.89:0/1343650533 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bc4004aa0 con 0x7f6bd80ffc80 2024-09-13T22:11:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.694+0000 7f6bd5ffb640 1 -- 172.21.15.89:0/1343650533 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bc4004c00 con 0x7f6bd80ffc80 2024-09-13T22:11:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.694+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd8101990 con 0x7f6bd80ffc80 2024-09-13T22:11:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.694+0000 7f6bd5ffb640 1 -- 172.21.15.89:0/1343650533 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bc40039b0 con 0x7f6bd80ffc80 2024-09-13T22:11:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.694+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd819d720 con 0x7f6bd80ffc80 2024-09-13T22:11:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.695+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd8107690 con 0x7f6bd80ffc80 2024-09-13T22:11:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.696+0000 7f6bd5ffb640 1 -- 172.21.15.89:0/1343650533 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f6bc4003c20 con 0x7f6bd80ffc80 2024-09-13T22:11:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.696+0000 7f6bd5ffb640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f6bc806e3b0 0x7f6bc8070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:19.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.696+0000 7f6bd5ffb640 1 -- 172.21.15.89:0/1343650533 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6bc40af4b0 con 0x7f6bd80ffc80 2024-09-13T22:11:19.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.696+0000 7f6bdcea4640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f6bc806e3b0 0x7f6bc8070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:19.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.697+0000 7f6bdcea4640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f6bc806e3b0 0x7f6bc8070870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc005fd0 tx=0x7f6bcc00b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:19.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.701+0000 7f6bd5ffb640 1 -- 172.21.15.89:0/1343650533 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f6bc4078930 con 0x7f6bd80ffc80 2024-09-13T22:11:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.887+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bd8068bf0 con 0x7f6bc806e3b0 2024-09-13T22:11:19.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.889+0000 7f6bd5ffb640 1 -- 172.21.15.89:0/1343650533 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f6bd8068bf0 con 0x7f6bc806e3b0 2024-09-13T22:11:19.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f6bc806e3b0 msgr2=0x7f6bc8070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f6bc806e3b0 0x7f6bc8070870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc005fd0 tx=0x7f6bcc00b390 comp rx=0 tx=0).stop 2024-09-13T22:11:19.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 msgr2=0x7f6bd8101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 0x7f6bd8101060 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4006010 tx=0x7f6bc40055a0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 shutdown_connections 2024-09-13T22:11:19.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f6bc806e3b0 0x7f6bc8070870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd80ffc80 0x7f6bd8101060 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 --2- 172.21.15.89:0/1343650533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd80fea80 0x7f6bd8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 >> 172.21.15.89:0/1343650533 conn(0x7f6bd80fa230 msgr2=0x7f6bd80684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:19.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 shutdown_connections 2024-09-13T22:11:19.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.891+0000 7f6bdf108640 1 -- 172.21.15.89:0/1343650533 wait complete. 2024-09-13T22:11:19.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.976+0000 7fc9363ce640 1 -- 172.21.15.89:0/1638904190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc930100630 msgr2=0x7fc930102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.976+0000 7fc9363ce640 1 --2- 172.21.15.89:0/1638904190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc930100630 0x7fc930102a20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc9200098b0 tx=0x7fc92002a4d0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.976+0000 7fc9363ce640 1 -- 172.21.15.89:0/1638904190 shutdown_connections 2024-09-13T22:11:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.976+0000 7fc9363ce640 1 --2- 172.21.15.89:0/1638904190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc930102f60 0x7fc930105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.976+0000 7fc9363ce640 1 --2- 172.21.15.89:0/1638904190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc930100630 0x7fc930102a20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.976+0000 7fc9363ce640 1 -- 172.21.15.89:0/1638904190 >> 172.21.15.89:0/1638904190 conn(0x7fc9300fa230 msgr2=0x7fc9300fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.976+0000 7fc9363ce640 1 -- 172.21.15.89:0/1638904190 shutdown_connections 2024-09-13T22:11:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.976+0000 7fc9363ce640 1 -- 172.21.15.89:0/1638904190 wait complete. 2024-09-13T22:11:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.977+0000 7fc9363ce640 1 Processor -- start 2024-09-13T22:11:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.977+0000 7fc9363ce640 1 -- start start 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc9363ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc930100630 0x7fc9300fff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc9363ce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc930102f60 0x7fc9300fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc9363ce640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc930100480 con 0x7fc930100630 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc9363ce640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300feb20 con 0x7fc930102f60 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc92f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc930102f60 0x7fc9300fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc92f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc930102f60 0x7fc9300fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.89:54946/0 (socket says 172.21.15.89:54946) 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc92f7fe640 1 -- 172.21.15.89:0/4242754950 learned_addr learned my addr 172.21.15.89:0/4242754950 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc92ffff640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc930100630 0x7fc9300fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc92f7fe640 1 -- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc930100630 msgr2=0x7fc9300fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc92f7fe640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc930100630 0x7fc9300fff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.978+0000 7fc92f7fe640 1 -- 172.21.15.89:0/4242754950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920009560 con 0x7fc930102f60 2024-09-13T22:11:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.979+0000 7fc92f7fe640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc930102f60 0x7fc9300fe5e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc92400c8f0 tx=0x7fc92400cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.979+0000 7fc92d7fa640 1 -- 172.21.15.89:0/4242754950 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc924004410 con 0x7fc930102f60 2024-09-13T22:11:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.979+0000 7fc92d7fa640 1 -- 172.21.15.89:0/4242754950 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc924007c60 con 0x7fc930102f60 2024-09-13T22:11:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.979+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9300fee00 con 0x7fc930102f60 2024-09-13T22:11:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.979+0000 7fc92d7fa640 1 -- 172.21.15.89:0/4242754950 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92400f450 con 0x7fc930102f60 2024-09-13T22:11:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.979+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9300ff3d0 con 0x7fc930102f60 2024-09-13T22:11:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.980+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9301087c0 con 0x7fc930102f60 2024-09-13T22:11:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.981+0000 7fc92d7fa640 1 -- 172.21.15.89:0/4242754950 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fc9240077a0 con 0x7fc930102f60 2024-09-13T22:11:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.981+0000 7fc92d7fa640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc91806e3b0 0x7fc918070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:19.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.981+0000 7fc92ffff640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc91806e3b0 0x7fc918070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:19.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.981+0000 7fc92d7fa640 1 -- 172.21.15.89:0/4242754950 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc92408e350 con 0x7fc930102f60 2024-09-13T22:11:19.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.982+0000 7fc92ffff640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc91806e3b0 0x7fc918070870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc920006010 tx=0x7fc9200314e0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:19.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:19.986+0000 7fc92d7fa640 1 -- 172.21.15.89:0/4242754950 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc9240577b0 con 0x7fc930102f60 2024-09-13T22:11:20.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.189+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc93019d760 con 0x7fc91806e3b0 2024-09-13T22:11:20.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.199+0000 7fc92d7fa640 1 -- 172.21.15.89:0/4242754950 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc93019d760 con 0x7fc91806e3b0 2024-09-13T22:11:20.201 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:11:20.201 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (5s) 0s ago 10m 16.0M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:11:20.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (10m) 0s ago 10m 7889k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:11:20.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (9m) 35s ago 9m 7872k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:11:20.201 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (10m) 0s ago 10m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (9m) 35s ago 9m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (8m) 0s ago 10m 88.6M - 9.4.7 954c08fa6188 59724cff87bd 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (4m) 0s ago 4m 16.3M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (4m) 0s ago 4m 14.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (4m) 35s ago 4m 162M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (4m) 35s ago 4m 16.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (100s) 0s ago 11m 495M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (53s) 35s ago 9m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (11m) 0s ago 11m 58.5M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (9m) 35s ago 9m 46.4M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:11:20.202 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (42s) 0s ago 10m 7776k - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:11:20.203 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (38s) 35s ago 9m 3573k - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:11:20.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (8m) 0s ago 8m 243M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:11:20.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (8m) 0s ago 8m 258M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:11:20.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (7m) 0s ago 7m 222M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:11:20.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (7m) 35s ago 7m 283M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:11:20.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (6m) 35s ago 6m 247M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:11:20.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (6m) 35s ago 6m 253M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:11:20.203 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (21s) 0s ago 10m 44.9M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc91806e3b0 msgr2=0x7fc918070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc91806e3b0 0x7fc918070870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc920006010 tx=0x7fc9200314e0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc930102f60 msgr2=0x7fc9300fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc930102f60 0x7fc9300fe5e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc92400c8f0 tx=0x7fc92400cdb0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 shutdown_connections 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc91806e3b0 0x7fc918070870 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc930102f60 0x7fc9300fe5e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 --2- 172.21.15.89:0/4242754950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc930100630 0x7fc9300fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 >> 172.21.15.89:0/4242754950 conn(0x7fc9300fa230 msgr2=0x7fc9300fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 shutdown_connections 2024-09-13T22:11:20.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.201+0000 7fc9363ce640 1 -- 172.21.15.89:0/4242754950 wait complete. 2024-09-13T22:11:20.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.284+0000 7fcc50ced640 1 -- 172.21.15.89:0/1454594067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c0ffba0 msgr2=0x7fcc4c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.284+0000 7fcc50ced640 1 --2- 172.21.15.89:0/1454594067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c0ffba0 0x7fcc4c0fffa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009880 tx=0x7fcc3c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.284+0000 7fcc50ced640 1 -- 172.21.15.89:0/1454594067 shutdown_connections 2024-09-13T22:11:20.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.284+0000 7fcc50ced640 1 --2- 172.21.15.89:0/1454594067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc4c100da0 0x7fcc4c101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.284+0000 7fcc50ced640 1 --2- 172.21.15.89:0/1454594067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c0ffba0 0x7fcc4c0fffa0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.284+0000 7fcc50ced640 1 -- 172.21.15.89:0/1454594067 >> 172.21.15.89:0/1454594067 conn(0x7fcc4c0fb330 msgr2=0x7fcc4c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:20.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.284+0000 7fcc50ced640 1 -- 172.21.15.89:0/1454594067 shutdown_connections 2024-09-13T22:11:20.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.284+0000 7fcc50ced640 1 -- 172.21.15.89:0/1454594067 wait complete. 2024-09-13T22:11:20.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.285+0000 7fcc50ced640 1 Processor -- start 2024-09-13T22:11:20.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.285+0000 7fcc50ced640 1 -- start start 2024-09-13T22:11:20.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.285+0000 7fcc50ced640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc4c0ffba0 0x7fcc4c074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:20.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.285+0000 7fcc50ced640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c100da0 0x7fcc4c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:20.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.285+0000 7fcc50ced640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c072de0 con 0x7fcc4c100da0 2024-09-13T22:11:20.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.285+0000 7fcc50ced640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c072f50 con 0x7fcc4c0ffba0 2024-09-13T22:11:20.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc49d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c100da0 0x7fcc4c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:20.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc49d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c100da0 0x7fcc4c0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59268/0 (socket says 172.21.15.89:59268) 2024-09-13T22:11:20.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc49d9b640 1 -- 172.21.15.89:0/171893694 learned_addr learned my addr 172.21.15.89:0/171893694 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc4a59c640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc4c0ffba0 0x7fcc4c074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc49d9b640 1 -- 172.21.15.89:0/171893694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc4c0ffba0 msgr2=0x7fcc4c074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc49d9b640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc4c0ffba0 0x7fcc4c074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc49d9b640 1 -- 172.21.15.89:0/171893694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c009560 con 0x7fcc4c100da0 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc4a59c640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc4c0ffba0 0x7fcc4c074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc49d9b640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c100da0 0x7fcc4c0728a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000d8d0 tx=0x7fcc4000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc3b7fe640 1 -- 172.21.15.89:0/171893694 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc40009c00 con 0x7fcc4c100da0 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc3b7fe640 1 -- 172.21.15.89:0/171893694 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc40009d60 con 0x7fcc4c100da0 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c073230 con 0x7fcc4c100da0 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c19d690 con 0x7fcc4c100da0 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.286+0000 7fcc3b7fe640 1 -- 172.21.15.89:0/171893694 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc400049d0 con 0x7fcc4c100da0 2024-09-13T22:11:20.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.287+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c0fffa0 con 0x7fcc4c100da0 2024-09-13T22:11:20.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.288+0000 7fcc3b7fe640 1 -- 172.21.15.89:0/171893694 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fcc40004c90 con 0x7fcc4c100da0 2024-09-13T22:11:20.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.289+0000 7fcc3b7fe640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fcc3406e3b0 0x7fcc34070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:20.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.289+0000 7fcc3b7fe640 1 -- 172.21.15.89:0/171893694 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcc4008e240 con 0x7fcc4c100da0 2024-09-13T22:11:20.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.289+0000 7fcc4a59c640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fcc3406e3b0 0x7fcc34070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:20.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.289+0000 7fcc4a59c640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fcc3406e3b0 0x7fcc34070870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c031540 tx=0x7fcc3c005de0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:20.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.293+0000 7fcc3b7fe640 1 -- 172.21.15.89:0/171893694 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fcc400575f0 con 0x7fcc4c100da0 2024-09-13T22:11:20.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.536+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcc4c108790 con 0x7fcc4c100da0 2024-09-13T22:11:20.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.537+0000 7fcc3b7fe640 1 -- 172.21.15.89:0/171893694 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fcc4005acb0 con 0x7fcc4c100da0 2024-09-13T22:11:20.541 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:11:20.541 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:11:20.542 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:11:20.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:11:20.543 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:11:20.543 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 12, 2024-09-13T22:11:20.543 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:11:20.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:11:20.543 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:11:20.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fcc3406e3b0 msgr2=0x7fcc34070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fcc3406e3b0 0x7fcc34070870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c031540 tx=0x7fcc3c005de0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c100da0 msgr2=0x7fcc4c0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c100da0 0x7fcc4c0728a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000d8d0 tx=0x7fcc4000dd90 comp rx=0 tx=0).stop 2024-09-13T22:11:20.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 shutdown_connections 2024-09-13T22:11:20.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fcc3406e3b0 0x7fcc34070870 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c100da0 0x7fcc4c0728a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 --2- 172.21.15.89:0/171893694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc4c0ffba0 0x7fcc4c074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 >> 172.21.15.89:0/171893694 conn(0x7fcc4c0fb330 msgr2=0x7fcc4c104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:20.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.540+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 shutdown_connections 2024-09-13T22:11:20.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.541+0000 7fcc50ced640 1 -- 172.21.15.89:0/171893694 wait complete. 2024-09-13T22:11:20.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.627+0000 7f637d4a1640 1 -- 172.21.15.89:0/3036223414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378072e00 msgr2=0x7f6378073260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.627+0000 7f637d4a1640 1 --2- 172.21.15.89:0/3036223414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378072e00 0x7f6378073260 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f636c009880 tx=0x7f636c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.627+0000 7f637d4a1640 1 -- 172.21.15.89:0/3036223414 shutdown_connections 2024-09-13T22:11:20.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.627+0000 7f637d4a1640 1 --2- 172.21.15.89:0/3036223414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378072e00 0x7f6378073260 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.627+0000 7f637d4a1640 1 --2- 172.21.15.89:0/3036223414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6378074460 0x7f63780728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.627+0000 7f637d4a1640 1 -- 172.21.15.89:0/3036223414 >> 172.21.15.89:0/3036223414 conn(0x7f63780fb360 msgr2=0x7f63780fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:20.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.627+0000 7f637d4a1640 1 -- 172.21.15.89:0/3036223414 shutdown_connections 2024-09-13T22:11:20.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.627+0000 7f637d4a1640 1 -- 172.21.15.89:0/3036223414 wait complete. 2024-09-13T22:11:20.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f637d4a1640 1 Processor -- start 2024-09-13T22:11:20.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f637d4a1640 1 -- start start 2024-09-13T22:11:20.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f637d4a1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6378072e00 0x7f6378197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:20.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f637d4a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378074460 0x7f6378197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:20.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f637d4a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6378198320 con 0x7f6378074460 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f637d4a1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6378198490 con 0x7f6378072e00 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f63767fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378074460 0x7f6378197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f63767fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378074460 0x7f6378197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59280/0 (socket says 172.21.15.89:59280) 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f63767fc640 1 -- 172.21.15.89:0/3130906235 learned_addr learned my addr 172.21.15.89:0/3130906235 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.628+0000 7f6376ffd640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6378072e00 0x7f6378197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.629+0000 7f63767fc640 1 -- 172.21.15.89:0/3130906235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6378072e00 msgr2=0x7f6378197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.629+0000 7f63767fc640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6378072e00 0x7f6378197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.629+0000 7f63767fc640 1 -- 172.21.15.89:0/3130906235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c009560 con 0x7f6378074460 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.629+0000 7f63767fc640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378074460 0x7f6378197d50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f636c005640 tx=0x7f636c005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.629+0000 7f635ffff640 1 -- 172.21.15.89:0/3130906235 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f636c004ba0 con 0x7f6378074460 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.629+0000 7f635ffff640 1 -- 172.21.15.89:0/3130906235 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f636c004d00 con 0x7f6378074460 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.629+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637819ced0 con 0x7f6378074460 2024-09-13T22:11:20.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.629+0000 7f635ffff640 1 -- 172.21.15.89:0/3130906235 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f636c003c30 con 0x7f6378074460 2024-09-13T22:11:20.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.629+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637819d410 con 0x7f6378074460 2024-09-13T22:11:20.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.630+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6378073260 con 0x7f6378074460 2024-09-13T22:11:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.631+0000 7f635ffff640 1 -- 172.21.15.89:0/3130906235 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f636c031640 con 0x7f6378074460 2024-09-13T22:11:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.631+0000 7f635ffff640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f636006e3b0 0x7f6360070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.631+0000 7f635ffff640 1 -- 172.21.15.89:0/3130906235 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f636c0af650 con 0x7f6378074460 2024-09-13T22:11:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.631+0000 7f6376ffd640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f636006e3b0 0x7f6360070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.632+0000 7f6376ffd640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f636006e3b0 0x7f6360070870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63680058c0 tx=0x7f636800a2d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:20.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.636+0000 7f635ffff640 1 -- 172.21.15.89:0/3130906235 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f636c078ab0 con 0x7f6378074460 2024-09-13T22:11:20.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.827+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6378107110 con 0x7f636006e3b0 2024-09-13T22:11:20.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.828+0000 7f635ffff640 1 -- 172.21.15.89:0/3130906235 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f6378107110 con 0x7f636006e3b0 2024-09-13T22:11:20.830 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:11:20.831 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:11:20.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.830+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f636006e3b0 msgr2=0x7f6360070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.830+0000 7f637d4a1640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f636006e3b0 0x7f6360070870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63680058c0 tx=0x7f636800a2d0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.830+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378074460 msgr2=0x7f6378197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:20.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.830+0000 7f637d4a1640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378074460 0x7f6378197d50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f636c005640 tx=0x7f636c005670 comp rx=0 tx=0).stop 2024-09-13T22:11:20.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.830+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 shutdown_connections 2024-09-13T22:11:20.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.830+0000 7f637d4a1640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f636006e3b0 0x7f6360070870 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.830+0000 7f637d4a1640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6378074460 0x7f6378197d50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.830+0000 7f637d4a1640 1 --2- 172.21.15.89:0/3130906235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6378072e00 0x7f6378197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:20.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.830+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 >> 172.21.15.89:0/3130906235 conn(0x7f63780fb360 msgr2=0x7f63781059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:20.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.831+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 shutdown_connections 2024-09-13T22:11:20.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:20.831+0000 7f637d4a1640 1 -- 172.21.15.89:0/3130906235 wait complete. 2024-09-13T22:11:21.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:21 smithi159 ceph-mon[35348]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:21.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:21 smithi159 ceph-mon[35348]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:21.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:21 smithi159 ceph-mon[35348]: pgmap v47: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:21.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:21 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:21.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:21 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:21.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:21 smithi159 ceph-mon[35348]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:21.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:21 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/171893694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:21.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:21 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:21.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:21 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:21.493 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:21 smithi089 ceph-mon[27921]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:21.493 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:21 smithi089 ceph-mon[27921]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:21.493 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:21 smithi089 ceph-mon[27921]: pgmap v47: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:21.493 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:21 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:21.493 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:21 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:21.493 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:21 smithi089 ceph-mon[27921]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:21.494 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:21 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/171893694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:21.494 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:21 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:21.494 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:21 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:22.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:22 smithi089 ceph-mon[27921]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:22.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:22 smithi159 ceph-mon[35348]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:23.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:23 smithi089 ceph-mon[27921]: pgmap v48: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:23.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:23 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:11:23.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:23 smithi159 ceph-mon[35348]: pgmap v48: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:23.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:23 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:11:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: pgmap v49: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:25.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:25 smithi089 ceph-mon[27921]: mgrmap e33: smithi089.naneiw(active, since 93s), standbys: smithi159.ghpomd 2024-09-13T22:11:25.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: pgmap v49: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:25.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:25.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:25 smithi159 ceph-mon[35348]: mgrmap e33: smithi089.naneiw(active, since 93s), standbys: smithi159.ghpomd 2024-09-13T22:11:26.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:26 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:11:26.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:26 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:11:27.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:27 smithi159 ceph-mon[35348]: Upgrade: Updating grafana.smithi089 2024-09-13T22:11:27.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:27 smithi159 ceph-mon[35348]: Deploying daemon grafana.smithi089 on smithi089 2024-09-13T22:11:27.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:27 smithi159 ceph-mon[35348]: pgmap v50: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:27.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:27 smithi089 ceph-mon[27921]: Upgrade: Updating grafana.smithi089 2024-09-13T22:11:27.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:27 smithi089 ceph-mon[27921]: Deploying daemon grafana.smithi089 on smithi089 2024-09-13T22:11:27.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:27 smithi089 ceph-mon[27921]: pgmap v50: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:29.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:29 smithi159 ceph-mon[35348]: pgmap v51: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:29.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:29 smithi089 ceph-mon[27921]: pgmap v51: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:31.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:31 smithi159 ceph-mon[35348]: pgmap v52: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:31.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:31 smithi089 ceph-mon[27921]: pgmap v52: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:33.314 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:33 smithi089 ceph-mon[27921]: pgmap v53: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:33 smithi159 ceph-mon[35348]: pgmap v53: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:35.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:35 smithi089 ceph-mon[27921]: pgmap v54: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:35.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:35 smithi159 ceph-mon[35348]: pgmap v54: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:11:37.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:37 smithi089 ceph-mon[27921]: pgmap v55: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:37.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:37 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:11:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:37 smithi159 ceph-mon[35348]: pgmap v55: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:37 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:11:38.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:38 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:38.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:38 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:38.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:38 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:38.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:38 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:38.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:38 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:38.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:38 smithi089 ceph-mon[27921]: pgmap v56: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:38.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:38 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:38.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:38 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:38.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:38 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:38.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:38 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:38.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:38 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:38.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:38 smithi159 ceph-mon[35348]: pgmap v56: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:41.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:40 smithi089 ceph-mon[27921]: pgmap v57: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:40 smithi159 ceph-mon[35348]: pgmap v57: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:43.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:42 smithi089 ceph-mon[27921]: pgmap v58: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:43.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:42 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:43.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:42 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:43.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:42 smithi159 ceph-mon[35348]: pgmap v58: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:43.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:42 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:43.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:42 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:44.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:44 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:44.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:44 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:44.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:44 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:44.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:44 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:45.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:45 smithi089 ceph-mon[27921]: pgmap v59: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:45.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:45 smithi159 ceph-mon[35348]: pgmap v59: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:47.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: pgmap v60: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:47.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:47.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:47.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:47.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:47.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:47.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:11:47.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:47.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T22:11:47.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T22:11:47.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T22:11:47.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:47 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: pgmap v60: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:47.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:47.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:47.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:47.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:47.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:47.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:11:47.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:47.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:47.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:47.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T22:11:47.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T22:11:47.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.513 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:11:47.514 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T22:11:47.515 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T22:11:47.515 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:47 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:11:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: Upgrade: Finalizing container_image settings 2024-09-13T22:11:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: Upgrade: Complete! 2024-09-13T22:11:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:48.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:48.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:48 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:11:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: Upgrade: Finalizing container_image settings 2024-09-13T22:11:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: Upgrade: Complete! 2024-09-13T22:11:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:11:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:11:48.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:11:48.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:48 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:11:49.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:49 smithi089 ceph-mon[27921]: pgmap v61: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:49.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:49 smithi159 ceph-mon[35348]: pgmap v61: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:50.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.928+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/697684797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 msgr2=0x7f3f580fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:50.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.928+0000 7f3f5f4c5640 1 --2- 172.21.15.89:0/697684797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 0x7f3f580fff80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009880 tx=0x7f3f5402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:11:50.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.928+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/697684797 shutdown_connections 2024-09-13T22:11:50.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.928+0000 7f3f5f4c5640 1 --2- 172.21.15.89:0/697684797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f58100d80 0x7f3f58101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:50.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.928+0000 7f3f5f4c5640 1 --2- 172.21.15.89:0/697684797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 0x7f3f580fff80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:50.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.928+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/697684797 >> 172.21.15.89:0/697684797 conn(0x7f3f580fb330 msgr2=0x7f3f580fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:50.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.928+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/697684797 shutdown_connections 2024-09-13T22:11:50.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.928+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/697684797 wait complete. 2024-09-13T22:11:50.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.929+0000 7f3f5f4c5640 1 Processor -- start 2024-09-13T22:11:50.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.929+0000 7f3f5f4c5640 1 -- start start 2024-09-13T22:11:50.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.929+0000 7f3f5f4c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 0x7f3f58074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.929+0000 7f3f5f4c5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f58100d80 0x7f3f580728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.929+0000 7f3f5f4c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f58072de0 con 0x7f3f580ffb80 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.929+0000 7f3f5f4c5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f58072f50 con 0x7f3f58100d80 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.929+0000 7f3f5d261640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 0x7f3f58074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.929+0000 7f3f5d261640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 0x7f3f58074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59174/0 (socket says 172.21.15.89:59174) 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.929+0000 7f3f5d261640 1 -- 172.21.15.89:0/3352104702 learned_addr learned my addr 172.21.15.89:0/3352104702 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f5ca60640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f58100d80 0x7f3f580728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f5d261640 1 -- 172.21.15.89:0/3352104702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f58100d80 msgr2=0x7f3f580728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f5d261640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f58100d80 0x7f3f580728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f5d261640 1 -- 172.21.15.89:0/3352104702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54009560 con 0x7f3f580ffb80 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f5ca60640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f58100d80 0x7f3f580728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f5d261640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 0x7f3f58074200 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f5402a9c0 tx=0x7f3f540054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f4e7fc640 1 -- 172.21.15.89:0/3352104702 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f54004aa0 con 0x7f3f580ffb80 2024-09-13T22:11:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f4e7fc640 1 -- 172.21.15.89:0/3352104702 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f54004c00 con 0x7f3f580ffb80 2024-09-13T22:11:50.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f580731d0 con 0x7f3f580ffb80 2024-09-13T22:11:50.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f4e7fc640 1 -- 172.21.15.89:0/3352104702 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f54003a80 con 0x7f3f580ffb80 2024-09-13T22:11:50.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.930+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f580736c0 con 0x7f3f580ffb80 2024-09-13T22:11:50.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.932+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5818f700 con 0x7f3f580ffb80 2024-09-13T22:11:50.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.932+0000 7f3f4e7fc640 1 -- 172.21.15.89:0/3352104702 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f3f54003d40 con 0x7f3f580ffb80 2024-09-13T22:11:50.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.932+0000 7f3f4e7fc640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3f4406e270 0x7f3f44070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:50.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.932+0000 7f3f4e7fc640 1 -- 172.21.15.89:0/3352104702 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3f540af360 con 0x7f3f580ffb80 2024-09-13T22:11:50.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.932+0000 7f3f5ca60640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3f4406e270 0x7f3f44070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:50.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.933+0000 7f3f5ca60640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3f4406e270 0x7f3f44070730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3f48005d00 tx=0x7f3f48005ed0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:50.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:50.937+0000 7f3f4e7fc640 1 -- 172.21.15.89:0/3352104702 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f3f54078930 con 0x7f3f580ffb80 2024-09-13T22:11:51.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.123+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f580608f0 con 0x7f3f4406e270 2024-09-13T22:11:51.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.124+0000 7f3f4e7fc640 1 -- 172.21.15.89:0/3352104702 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3f580608f0 con 0x7f3f4406e270 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3f4406e270 msgr2=0x7f3f44070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3f4406e270 0x7f3f44070730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3f48005d00 tx=0x7f3f48005ed0 comp rx=0 tx=0).stop 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 msgr2=0x7f3f58074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 0x7f3f58074200 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f5402a9c0 tx=0x7f3f540054f0 comp rx=0 tx=0).stop 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 shutdown_connections 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3f4406e270 0x7f3f44070730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f58100d80 0x7f3f580728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 --2- 172.21.15.89:0/3352104702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f580ffb80 0x7f3f58074200 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 >> 172.21.15.89:0/3352104702 conn(0x7f3f580fb330 msgr2=0x7f3f58104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.126+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 shutdown_connections 2024-09-13T22:11:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:51.127+0000 7f3f5f4c5640 1 -- 172.21.15.89:0/3352104702 wait complete. 2024-09-13T22:11:51.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:51 smithi159 ceph-mon[35348]: pgmap v62: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:51.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:51 smithi089 ceph-mon[27921]: pgmap v62: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:52.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:52 smithi089 ceph-mon[27921]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:52.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:52 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:11:52.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:52 smithi159 ceph-mon[35348]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:11:52.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:52 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:11:53.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-13T22:11:53.382 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:11:53.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:53 smithi089 ceph-mon[27921]: pgmap v63: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:53.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:53 smithi159 ceph-mon[35348]: pgmap v63: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:54.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.961+0000 7fc269ed9640 1 -- 172.21.15.89:0/4018593422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 msgr2=0x7fc2640fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:54.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.961+0000 7fc269ed9640 1 --2- 172.21.15.89:0/4018593422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 0x7fc2640fee80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc258009880 tx=0x7fc25802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:11:54.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.961+0000 7fc269ed9640 1 -- 172.21.15.89:0/4018593422 shutdown_connections 2024-09-13T22:11:54.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.961+0000 7fc269ed9640 1 --2- 172.21.15.89:0/4018593422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 0x7fc2640fee80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:54.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.961+0000 7fc269ed9640 1 --2- 172.21.15.89:0/4018593422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc264104a20 0x7fc264104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:54.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.961+0000 7fc269ed9640 1 -- 172.21.15.89:0/4018593422 >> 172.21.15.89:0/4018593422 conn(0x7fc2640fa700 msgr2=0x7fc2640fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:54.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.961+0000 7fc269ed9640 1 -- 172.21.15.89:0/4018593422 shutdown_connections 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.961+0000 7fc269ed9640 1 -- 172.21.15.89:0/4018593422 wait complete. 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc269ed9640 1 Processor -- start 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc269ed9640 1 -- start start 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc269ed9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 0x7fc26419b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc269ed9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc264104a20 0x7fc26419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc269ed9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26419c4f0 con 0x7fc2640fea20 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc269ed9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264195a80 con 0x7fc264104a20 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc2637fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 0x7fc26419b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc2637fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 0x7fc26419b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49974/0 (socket says 172.21.15.89:49974) 2024-09-13T22:11:54.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc2637fe640 1 -- 172.21.15.89:0/2291518166 learned_addr learned my addr 172.21.15.89:0/2291518166 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc2637fe640 1 -- 172.21.15.89:0/2291518166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc264104a20 msgr2=0x7fc26419bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc2637fe640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc264104a20 0x7fc26419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.962+0000 7fc2637fe640 1 -- 172.21.15.89:0/2291518166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc258009560 con 0x7fc2640fea20 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.963+0000 7fc2637fe640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 0x7fc26419b990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc25400b420 tx=0x7fc25400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.963+0000 7fc260ff9640 1 -- 172.21.15.89:0/2291518166 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc254011800 con 0x7fc2640fea20 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.963+0000 7fc260ff9640 1 -- 172.21.15.89:0/2291518166 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc254011e20 con 0x7fc2640fea20 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.963+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc264195d60 con 0x7fc2640fea20 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.963+0000 7fc260ff9640 1 -- 172.21.15.89:0/2291518166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc25400f2e0 con 0x7fc2640fea20 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.963+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2641962b0 con 0x7fc2640fea20 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.964+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc264100160 con 0x7fc2640fea20 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.964+0000 7fc260ff9640 1 -- 172.21.15.89:0/2291518166 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7fc254010380 con 0x7fc2640fea20 2024-09-13T22:11:54.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.965+0000 7fc260ff9640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc24c06e270 0x7fc24c070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:54.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.965+0000 7fc260ff9640 1 -- 172.21.15.89:0/2291518166 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc25408da70 con 0x7fc2640fea20 2024-09-13T22:11:54.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.965+0000 7fc262ffd640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc24c06e270 0x7fc24c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:54.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.965+0000 7fc262ffd640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc24c06e270 0x7fc24c070730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc264196ef0 tx=0x7fc258000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:54.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:54.969+0000 7fc260ff9640 1 -- 172.21.15.89:0/2291518166 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc2540570c0 con 0x7fc2640fea20 2024-09-13T22:11:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.200+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc26410bd10 con 0x7fc2640fea20 2024-09-13T22:11:55.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.200+0000 7fc260ff9640 1 -- 172.21.15.89:0/2291518166 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fc25408de60 con 0x7fc2640fea20 2024-09-13T22:11:55.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.202+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc24c06e270 msgr2=0x7fc24c070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:55.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.202+0000 7fc269ed9640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc24c06e270 0x7fc24c070730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc264196ef0 tx=0x7fc258000bc0 comp rx=0 tx=0).stop 2024-09-13T22:11:55.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.202+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 msgr2=0x7fc26419b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:55.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.202+0000 7fc269ed9640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 0x7fc26419b990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc25400b420 tx=0x7fc25400b8e0 comp rx=0 tx=0).stop 2024-09-13T22:11:55.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.203+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 shutdown_connections 2024-09-13T22:11:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.203+0000 7fc269ed9640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc24c06e270 0x7fc24c070730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.203+0000 7fc269ed9640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc264104a20 0x7fc26419bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.203+0000 7fc269ed9640 1 --2- 172.21.15.89:0/2291518166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2640fea20 0x7fc26419b990 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.203+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 >> 172.21.15.89:0/2291518166 conn(0x7fc2640fa700 msgr2=0x7fc264068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.203+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 shutdown_connections 2024-09-13T22:11:55.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:55.203+0000 7fc269ed9640 1 -- 172.21.15.89:0/2291518166 wait complete. 2024-09-13T22:11:55.213 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:11:55.456 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:55 smithi089 ceph-mon[27921]: pgmap v64: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:55.457 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:55 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2291518166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:55.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:55 smithi159 ceph-mon[35348]: pgmap v64: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:55.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:55 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2291518166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:55.910 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-13T22:11:56.119 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:11:57.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:57 smithi159 ceph-mon[35348]: pgmap v65: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:57.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:57 smithi089 ceph-mon[27921]: pgmap v65: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:57.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.878+0000 7faaf5f48640 1 -- 172.21.15.89:0/1804823525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 msgr2=0x7faaf0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:57.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.878+0000 7faaf5f48640 1 --2- 172.21.15.89:0/1804823525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 0x7faaf0104e10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faae0009880 tx=0x7faae002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:11:57.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.878+0000 7faaf5f48640 1 -- 172.21.15.89:0/1804823525 shutdown_connections 2024-09-13T22:11:57.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.878+0000 7faaf5f48640 1 --2- 172.21.15.89:0/1804823525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf00fea30 0x7faaf00fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:57.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.878+0000 7faaf5f48640 1 --2- 172.21.15.89:0/1804823525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 0x7faaf0104e10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.878+0000 7faaf5f48640 1 -- 172.21.15.89:0/1804823525 >> 172.21.15.89:0/1804823525 conn(0x7faaf00fa730 msgr2=0x7faaf00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.878+0000 7faaf5f48640 1 -- 172.21.15.89:0/1804823525 shutdown_connections 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.878+0000 7faaf5f48640 1 -- 172.21.15.89:0/1804823525 wait complete. 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.879+0000 7faaf5f48640 1 Processor -- start 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.879+0000 7faaf5f48640 1 -- start start 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.879+0000 7faaf5f48640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf00fea30 0x7faaf0194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.879+0000 7faaf5f48640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 0x7faaf0194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.879+0000 7faaf5f48640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0195630 con 0x7faaf0104a30 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.879+0000 7faaf5f48640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0199380 con 0x7faaf00fea30 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaeeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 0x7faaf0194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaeeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 0x7faaf0194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49998/0 (socket says 172.21.15.89:49998) 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaeeffd640 1 -- 172.21.15.89:0/3343089559 learned_addr learned my addr 172.21.15.89:0/3343089559 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:11:57.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaef7fe640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf00fea30 0x7faaf0194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaeeffd640 1 -- 172.21.15.89:0/3343089559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf00fea30 msgr2=0x7faaf0194a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaeeffd640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf00fea30 0x7faaf0194a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaeeffd640 1 -- 172.21.15.89:0/3343089559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae0009560 con 0x7faaf0104a30 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaeeffd640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 0x7faaf0194f50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faae400d6f0 tx=0x7faae400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaecff9640 1 -- 172.21.15.89:0/3343089559 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae4009a30 con 0x7faaf0104a30 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf0199660 con 0x7faaf0104a30 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaecff9640 1 -- 172.21.15.89:0/3343089559 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faae40054e0 con 0x7faaf0104a30 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaecff9640 1 -- 172.21.15.89:0/3343089559 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae4010460 con 0x7faaf0104a30 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.880+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf0199bb0 con 0x7faaf0104a30 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.881+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf0100170 con 0x7faaf0104a30 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.882+0000 7faaecff9640 1 -- 172.21.15.89:0/3343089559 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7faae4009b90 con 0x7faaf0104a30 2024-09-13T22:11:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.882+0000 7faaecff9640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faad806e270 0x7faad8070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:11:57.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.883+0000 7faaef7fe640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faad806e270 0x7faad8070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:11:57.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.883+0000 7faaecff9640 1 -- 172.21.15.89:0/3343089559 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7faae408dca0 con 0x7faaf0104a30 2024-09-13T22:11:57.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.883+0000 7faaef7fe640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faad806e270 0x7faad8070730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faae0009230 tx=0x7faae00058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:11:57.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:57.887+0000 7faaecff9640 1 -- 172.21.15.89:0/3343089559 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7faae4092070 con 0x7faaf0104a30 2024-09-13T22:11:58.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.120+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faaf0106fa0 con 0x7faaf0104a30 2024-09-13T22:11:58.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.120+0000 7faaecff9640 1 -- 172.21.15.89:0/3343089559 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7faae4057320 con 0x7faaf0104a30 2024-09-13T22:11:58.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faad806e270 msgr2=0x7faad8070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:58.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faad806e270 0x7faad8070730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faae0009230 tx=0x7faae00058d0 comp rx=0 tx=0).stop 2024-09-13T22:11:58.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 msgr2=0x7faaf0194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:11:58.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 0x7faaf0194f50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faae400d6f0 tx=0x7faae400dbb0 comp rx=0 tx=0).stop 2024-09-13T22:11:58.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 shutdown_connections 2024-09-13T22:11:58.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faad806e270 0x7faad8070730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:58.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaf0104a30 0x7faaf0194f50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:58.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 --2- 172.21.15.89:0/3343089559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaf00fea30 0x7faaf0194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:11:58.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 >> 172.21.15.89:0/3343089559 conn(0x7faaf00fa730 msgr2=0x7faaf00fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:11:58.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 shutdown_connections 2024-09-13T22:11:58.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:11:58.123+0000 7faaf5f48640 1 -- 172.21.15.89:0/3343089559 wait complete. 2024-09-13T22:11:58.133 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)" 2024-09-13T22:11:58.398 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:58 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3343089559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:58.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:58 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3343089559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:11:58.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-13T22:11:59.035 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:11:59.465 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:11:59 smithi089 ceph-mon[27921]: pgmap v66: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:11:59.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:11:59 smithi159 ceph-mon[35348]: pgmap v66: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.720+0000 7fc103e4b640 1 -- 172.21.15.89:0/457179071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 msgr2=0x7fc0fc0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.720+0000 7fc103e4b640 1 --2- 172.21.15.89:0/457179071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 0x7fc0fc0fee50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009880 tx=0x7fc0f802c6b0 comp rx=0 tx=0).stop 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.720+0000 7fc103e4b640 1 -- 172.21.15.89:0/457179071 shutdown_connections 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.720+0000 7fc103e4b640 1 --2- 172.21.15.89:0/457179071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 0x7fc0fc0fee50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.720+0000 7fc103e4b640 1 --2- 172.21.15.89:0/457179071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0fc1049f0 0x7fc0fc104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.720+0000 7fc103e4b640 1 -- 172.21.15.89:0/457179071 >> 172.21.15.89:0/457179071 conn(0x7fc0fc0758a0 msgr2=0x7fc0fc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.720+0000 7fc103e4b640 1 -- 172.21.15.89:0/457179071 shutdown_connections 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.720+0000 7fc103e4b640 1 -- 172.21.15.89:0/457179071 wait complete. 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc103e4b640 1 Processor -- start 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc103e4b640 1 -- start start 2024-09-13T22:12:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc103e4b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 0x7fc0fc1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc103e4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0fc1049f0 0x7fc0fc199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc103e4b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc19a150 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc103e4b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc1936e0 con 0x7fc0fc1049f0 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc101be7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 0x7fc0fc1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc101be7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 0x7fc0fc1995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50012/0 (socket says 172.21.15.89:50012) 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc101be7640 1 -- 172.21.15.89:0/3195832883 learned_addr learned my addr 172.21.15.89:0/3195832883 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc101be7640 1 -- 172.21.15.89:0/3195832883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0fc1049f0 msgr2=0x7fc0fc199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc1013e6640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0fc1049f0 0x7fc0fc199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc101be7640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0fc1049f0 0x7fc0fc199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc101be7640 1 -- 172.21.15.89:0/3195832883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8009560 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.721+0000 7fc1013e6640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0fc1049f0 0x7fc0fc199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:12:00.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.722+0000 7fc101be7640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 0x7fc0fc1995f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00d8d0 tx=0x7fc0ec00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.722+0000 7fc0f2ffd640 1 -- 172.21.15.89:0/3195832883 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0ec009c00 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.722+0000 7fc0f2ffd640 1 -- 172.21.15.89:0/3195832883 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0ec009d60 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.722+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0fc1939c0 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.722+0000 7fc0f2ffd640 1 -- 172.21.15.89:0/3195832883 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0ec0049d0 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.722+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc193f10 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.723+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0fc100130 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.723+0000 7fc0f2ffd640 1 -- 172.21.15.89:0/3195832883 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7fc0ec004c90 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.724+0000 7fc0f2ffd640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc0e806e270 0x7fc0e8070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.724+0000 7fc0f2ffd640 1 -- 172.21.15.89:0/3195832883 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc0ec08def0 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.724+0000 7fc1013e6640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc0e806e270 0x7fc0e8070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.724+0000 7fc1013e6640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc0e806e270 0x7fc0e8070730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8006010 tx=0x7fc0f8005e60 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.728+0000 7fc0f2ffd640 1 -- 172.21.15.89:0/3195832883 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc0ec0574c0 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.961+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc0fc194cb0 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.961+0000 7fc0f2ffd640 1 -- 172.21.15.89:0/3195832883 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fc0ec05ab80 con 0x7fc0fc0fe9f0 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.963+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc0e806e270 msgr2=0x7fc0e8070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.963+0000 7fc103e4b640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc0e806e270 0x7fc0e8070730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8006010 tx=0x7fc0f8005e60 comp rx=0 tx=0).stop 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.963+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 msgr2=0x7fc0fc1995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.963+0000 7fc103e4b640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 0x7fc0fc1995f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00d8d0 tx=0x7fc0ec00dd90 comp rx=0 tx=0).stop 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.963+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 shutdown_connections 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.963+0000 7fc103e4b640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fc0e806e270 0x7fc0e8070730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.963+0000 7fc103e4b640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0fc1049f0 0x7fc0fc199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.963+0000 7fc103e4b640 1 --2- 172.21.15.89:0/3195832883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0fc0fe9f0 0x7fc0fc1995f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.963+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 >> 172.21.15.89:0/3195832883 conn(0x7fc0fc0758a0 msgr2=0x7fc0fc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.964+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 shutdown_connections 2024-09-13T22:12:00.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:00.964+0000 7fc103e4b640 1 -- 172.21.15.89:0/3195832883 wait complete. 2024-09-13T22:12:00.974 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:12:01.561 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:01 smithi159 ceph-mon[35348]: pgmap v67: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:01.562 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:01 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/3195832883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:12:01.635 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:01 smithi089 ceph-mon[27921]: pgmap v67: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:01.635 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:01 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/3195832883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:12:01.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-13T22:12:01.860 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:12:03.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:03 smithi089 ceph-mon[27921]: pgmap v68: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.619+0000 7f718f89d640 1 -- 172.21.15.89:0/1022847878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71880ffda0 msgr2=0x7f7188100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.619+0000 7f718f89d640 1 --2- 172.21.15.89:0/1022847878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71880ffda0 0x7f7188100180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7184009880 tx=0x7f718402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.619+0000 7f718f89d640 1 -- 172.21.15.89:0/1022847878 shutdown_connections 2024-09-13T22:12:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.619+0000 7f718f89d640 1 --2- 172.21.15.89:0/1022847878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7188100750 0x7f71881047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.619+0000 7f718f89d640 1 --2- 172.21.15.89:0/1022847878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71880ffda0 0x7f7188100180 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.619+0000 7f718f89d640 1 -- 172.21.15.89:0/1022847878 >> 172.21.15.89:0/1022847878 conn(0x7f71880fb840 msgr2=0x7f71880fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.619+0000 7f718f89d640 1 -- 172.21.15.89:0/1022847878 shutdown_connections 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.619+0000 7f718f89d640 1 -- 172.21.15.89:0/1022847878 wait complete. 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718f89d640 1 Processor -- start 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718f89d640 1 -- start start 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718f89d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71880ffda0 0x7f71880727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718f89d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7188100750 0x7f7188072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718f89d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188073230 con 0x7f7188100750 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718f89d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71880733a0 con 0x7f71880ffda0 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718ce38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7188100750 0x7f7188072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718ce38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7188100750 0x7f7188072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54058/0 (socket says 172.21.15.89:54058) 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718ce38640 1 -- 172.21.15.89:0/3558575219 learned_addr learned my addr 172.21.15.89:0/3558575219 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:03.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718ce38640 1 -- 172.21.15.89:0/3558575219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71880ffda0 msgr2=0x7f71880727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:03.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718ce38640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71880ffda0 0x7f71880727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:03.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718ce38640 1 -- 172.21.15.89:0/3558575219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184009560 con 0x7f7188100750 2024-09-13T22:12:03.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.620+0000 7f718ce38640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7188100750 0x7f7188072cf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f717800d6f0 tx=0x7f717800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:03.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.621+0000 7f717e7fc640 1 -- 172.21.15.89:0/3558575219 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7178009a30 con 0x7f7188100750 2024-09-13T22:12:03.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.621+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71881a1c90 con 0x7f7188100750 2024-09-13T22:12:03.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.621+0000 7f717e7fc640 1 -- 172.21.15.89:0/3558575219 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71780054e0 con 0x7f7188100750 2024-09-13T22:12:03.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.621+0000 7f717e7fc640 1 -- 172.21.15.89:0/3558575219 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7178010460 con 0x7f7188100750 2024-09-13T22:12:03.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.621+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71881a1ff0 con 0x7f7188100750 2024-09-13T22:12:03.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.622+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7188101280 con 0x7f7188100750 2024-09-13T22:12:03.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.622+0000 7f717e7fc640 1 -- 172.21.15.89:0/3558575219 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f7178009b90 con 0x7f7188100750 2024-09-13T22:12:03.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.623+0000 7f717e7fc640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f717406e270 0x7f7174070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:03.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.623+0000 7f717e7fc640 1 -- 172.21.15.89:0/3558575219 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f717808dd50 con 0x7f7188100750 2024-09-13T22:12:03.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.623+0000 7f718d639640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f717406e270 0x7f7174070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:03.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.623+0000 7f718d639640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f717406e270 0x7f7174070730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7184009880 tx=0x7f7184000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:03.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.627+0000 7f717e7fc640 1 -- 172.21.15.89:0/3558575219 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f7178057320 con 0x7f7188100750 2024-09-13T22:12:03.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:03 smithi159 ceph-mon[35348]: pgmap v68: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:03.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:03.807+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}) v1 -- 0x7f718810cdd0 con 0x7f717406e270 2024-09-13T22:12:05.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:05 smithi089 ceph-mon[27921]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:05.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:05 smithi089 ceph-mon[27921]: pgmap v69: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:05.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:05 smithi159 ceph-mon[35348]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:05.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:05 smithi159 ceph-mon[35348]: pgmap v69: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:05.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.959+0000 7f717e7fc640 1 -- 172.21.15.89:0/3558575219 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5742 (secure 0 0 0) 0x7f718810cdd0 con 0x7f717406e270 2024-09-13T22:12:05.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.961+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f717406e270 msgr2=0x7f7174070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:05.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.961+0000 7f718f89d640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f717406e270 0x7f7174070730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7184009880 tx=0x7f7184000bc0 comp rx=0 tx=0).stop 2024-09-13T22:12:05.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.961+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7188100750 msgr2=0x7f7188072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:05.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.961+0000 7f718f89d640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7188100750 0x7f7188072cf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f717800d6f0 tx=0x7f717800dbb0 comp rx=0 tx=0).stop 2024-09-13T22:12:05.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.961+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 shutdown_connections 2024-09-13T22:12:05.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.961+0000 7f718f89d640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f717406e270 0x7f7174070730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.961+0000 7f718f89d640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7188100750 0x7f7188072cf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.961+0000 7f718f89d640 1 --2- 172.21.15.89:0/3558575219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71880ffda0 0x7f71880727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.961+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 >> 172.21.15.89:0/3558575219 conn(0x7f71880fb840 msgr2=0x7f71880fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.962+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 shutdown_connections 2024-09-13T22:12:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:05.962+0000 7f718f89d640 1 -- 172.21.15.89:0/3558575219 wait complete. 2024-09-13T22:12:05.972 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:12:06.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T22:12:06.832 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:12:07.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:07 smithi089 ceph-mon[27921]: pgmap v70: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:07.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:07 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:12:07.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:07 smithi159 ceph-mon[35348]: pgmap v70: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:07.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:07 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:12:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.491+0000 7f3baab82640 1 -- 172.21.15.89:0/3894099721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 msgr2=0x7f3ba41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.491+0000 7f3baab82640 1 --2- 172.21.15.89:0/3894099721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 0x7f3ba41047a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009880 tx=0x7f3b9002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.491+0000 7f3baab82640 1 -- 172.21.15.89:0/3894099721 shutdown_connections 2024-09-13T22:12:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.491+0000 7f3baab82640 1 --2- 172.21.15.89:0/3894099721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 0x7f3ba41047a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.491+0000 7f3baab82640 1 --2- 172.21.15.89:0/3894099721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40ffda0 0x7f3ba4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.491+0000 7f3baab82640 1 -- 172.21.15.89:0/3894099721 >> 172.21.15.89:0/3894099721 conn(0x7f3ba40fb840 msgr2=0x7f3ba40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.491+0000 7f3baab82640 1 -- 172.21.15.89:0/3894099721 shutdown_connections 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.491+0000 7f3baab82640 1 -- 172.21.15.89:0/3894099721 wait complete. 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3baab82640 1 Processor -- start 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3baab82640 1 -- start start 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3baab82640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40ffda0 0x7f3ba419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3baab82640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 0x7f3ba419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3baab82640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4195930 con 0x7f3ba4100750 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3baab82640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4195a70 con 0x7f3ba40ffda0 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3ba3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 0x7f3ba419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3ba3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 0x7f3ba419be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54074/0 (socket says 172.21.15.89:54074) 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3ba3fff640 1 -- 172.21.15.89:0/646288259 learned_addr learned my addr 172.21.15.89:0/646288259 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3ba891e640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40ffda0 0x7f3ba419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3ba3fff640 1 -- 172.21.15.89:0/646288259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40ffda0 msgr2=0x7f3ba419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3ba3fff640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40ffda0 0x7f3ba419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3ba3fff640 1 -- 172.21.15.89:0/646288259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009560 con 0x7f3ba4100750 2024-09-13T22:12:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3ba891e640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40ffda0 0x7f3ba419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:12:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.492+0000 7f3ba3fff640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 0x7f3ba419be10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b9002a9c0 tx=0x7f3b900055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.493+0000 7f3ba1ffb640 1 -- 172.21.15.89:0/646288259 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b90004aa0 con 0x7f3ba4100750 2024-09-13T22:12:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.493+0000 7f3ba1ffb640 1 -- 172.21.15.89:0/646288259 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b90004c00 con 0x7f3ba4100750 2024-09-13T22:12:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.493+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba4195cf0 con 0x7f3ba4100750 2024-09-13T22:12:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.493+0000 7f3ba1ffb640 1 -- 172.21.15.89:0/646288259 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b90003ab0 con 0x7f3ba4100750 2024-09-13T22:12:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.493+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba41961e0 con 0x7f3ba4100750 2024-09-13T22:12:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.494+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba4101280 con 0x7f3ba4100750 2024-09-13T22:12:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.494+0000 7f3ba1ffb640 1 -- 172.21.15.89:0/646288259 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f3b90003ce0 con 0x7f3ba4100750 2024-09-13T22:12:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.495+0000 7f3ba1ffb640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3b9406e270 0x7f3b94070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.495+0000 7f3ba1ffb640 1 -- 172.21.15.89:0/646288259 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3b900af280 con 0x7f3ba4100750 2024-09-13T22:12:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.495+0000 7f3ba891e640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3b9406e270 0x7f3b94070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.496+0000 7f3ba891e640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3b9406e270 0x7f3b94070730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b980058c0 tx=0x7f3b98005d30 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:08.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.500+0000 7f3ba1ffb640 1 -- 172.21.15.89:0/646288259 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f3b90078850 con 0x7f3ba4100750 2024-09-13T22:12:08.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.682+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ba410cdd0 con 0x7f3b9406e270 2024-09-13T22:12:08.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.692+0000 7f3ba1ffb640 1 -- 172.21.15.89:0/646288259 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3ba410cdd0 con 0x7f3b9406e270 2024-09-13T22:12:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:12:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (54s) 26s ago 11m 16.0M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:12:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (11m) 26s ago 11m 7914k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:12:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (10m) 83s ago 10m 7872k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:12:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (11m) 26s ago 11m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:12:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (10m) 83s ago 10m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:12:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (31s) 26s ago 11m 47.7M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:12:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (5m) 26s ago 5m 16.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:12:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (5m) 26s ago 5m 14.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (5m) 83s ago 5m 162M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (5m) 83s ago 5m 16.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (2m) 26s ago 12m 503M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (101s) 83s ago 10m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (12m) 26s ago 12m 59.5M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (10m) 83s ago 10m 46.4M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (90s) 26s ago 11m 8384k - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (86s) 83s ago 10m 3573k - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (9m) 26s ago 9m 243M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:12:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (9m) 26s ago 9m 258M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:12:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (8m) 26s ago 8m 222M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:12:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (8m) 83s ago 8m 283M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:12:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (7m) 83s ago 7m 247M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:12:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (7m) 83s ago 7m 253M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:12:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (70s) 26s ago 10m 45.1M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:12:08.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3b9406e270 msgr2=0x7f3b94070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:08.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3b9406e270 0x7f3b94070730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b980058c0 tx=0x7f3b98005d30 comp rx=0 tx=0).stop 2024-09-13T22:12:08.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 msgr2=0x7f3ba419be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:08.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 0x7f3ba419be10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b9002a9c0 tx=0x7f3b900055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:08.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 shutdown_connections 2024-09-13T22:12:08.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f3b9406e270 0x7f3b94070730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:08.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba4100750 0x7f3ba419be10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:08.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 --2- 172.21.15.89:0/646288259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40ffda0 0x7f3ba419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:08.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 >> 172.21.15.89:0/646288259 conn(0x7f3ba40fb840 msgr2=0x7f3ba40fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:08.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 shutdown_connections 2024-09-13T22:12:08.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:08.694+0000 7f3baab82640 1 -- 172.21.15.89:0/646288259 wait complete. 2024-09-13T22:12:09.308 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:09 smithi089 ceph-mon[27921]: pgmap v71: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:09.332 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T22:12:09.333 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:12:09.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-13T22:12:09.537 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:12:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:09 smithi159 ceph-mon[35348]: pgmap v71: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:10.565 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:10 smithi089 ceph-mon[27921]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:10.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:10 smithi159 ceph-mon[35348]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.093+0000 7fed39959640 1 -- 172.21.15.89:0/3939862080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed34103a20 msgr2=0x7fed34103e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.093+0000 7fed39959640 1 --2- 172.21.15.89:0/3939862080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed34103a20 0x7fed34103e00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fed24009880 tx=0x7fed2402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.093+0000 7fed39959640 1 -- 172.21.15.89:0/3939862080 shutdown_connections 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.093+0000 7fed39959640 1 --2- 172.21.15.89:0/3939862080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed340ff1d0 0x7fed340ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.093+0000 7fed39959640 1 --2- 172.21.15.89:0/3939862080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed34103a20 0x7fed34103e00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.093+0000 7fed39959640 1 -- 172.21.15.89:0/3939862080 >> 172.21.15.89:0/3939862080 conn(0x7fed340f9e90 msgr2=0x7fed340fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.093+0000 7fed39959640 1 -- 172.21.15.89:0/3939862080 shutdown_connections 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.093+0000 7fed39959640 1 -- 172.21.15.89:0/3939862080 wait complete. 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed39959640 1 Processor -- start 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed39959640 1 -- start start 2024-09-13T22:12:11.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed39959640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed340ff1d0 0x7fed34197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed39959640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed34103a20 0x7fed34198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed39959640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34198870 con 0x7fed340ff1d0 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed39959640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed341989e0 con 0x7fed34103a20 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed340ff1d0 0x7fed34197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed32ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed340ff1d0 0x7fed34197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54092/0 (socket says 172.21.15.89:54092) 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed32ffd640 1 -- 172.21.15.89:0/2829419657 learned_addr learned my addr 172.21.15.89:0/2829419657 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.094+0000 7fed2bfff640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed34103a20 0x7fed34198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed32ffd640 1 -- 172.21.15.89:0/2829419657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed34103a20 msgr2=0x7fed34198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed32ffd640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed34103a20 0x7fed34198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed32ffd640 1 -- 172.21.15.89:0/2829419657 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed24009560 con 0x7fed340ff1d0 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed2bfff640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed34103a20 0x7fed34198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:12:11.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed32ffd640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed340ff1d0 0x7fed34197d30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fed2402a9c0 tx=0x7fed240055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed38957640 1 -- 172.21.15.89:0/2829419657 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed24004aa0 con 0x7fed340ff1d0 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3419c760 con 0x7fed340ff1d0 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed38957640 1 -- 172.21.15.89:0/2829419657 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed24004c00 con 0x7fed340ff1d0 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed38957640 1 -- 172.21.15.89:0/2829419657 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed24003ab0 con 0x7fed340ff1d0 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.095+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3419cc50 con 0x7fed340ff1d0 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.096+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed341001e0 con 0x7fed340ff1d0 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.097+0000 7fed38957640 1 -- 172.21.15.89:0/2829419657 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7fed24003ce0 con 0x7fed340ff1d0 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.097+0000 7fed38957640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fed2006e270 0x7fed20070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.097+0000 7fed38957640 1 -- 172.21.15.89:0/2829419657 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fed240af280 con 0x7fed340ff1d0 2024-09-13T22:12:11.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.097+0000 7fed2bfff640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fed2006e270 0x7fed20070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:11.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.098+0000 7fed2bfff640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fed2006e270 0x7fed20070730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fed341992e0 tx=0x7fed1c00a5c0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:11.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.102+0000 7fed38957640 1 -- 172.21.15.89:0/2829419657 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fed24078850 con 0x7fed340ff1d0 2024-09-13T22:12:11.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.270+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fed340ff610 con 0x7fed340ff1d0 2024-09-13T22:12:11.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.275+0000 7fed38957640 1 -- 172.21.15.89:0/2829419657 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v50)=0 v50) v1 ==== 125+0+0 (secure 0 0 0) 0x7fed2407bf10 con 0x7fed340ff1d0 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fed2006e270 msgr2=0x7fed20070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fed2006e270 0x7fed20070730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fed341992e0 tx=0x7fed1c00a5c0 comp rx=0 tx=0).stop 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed340ff1d0 msgr2=0x7fed34197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed340ff1d0 0x7fed34197d30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fed2402a9c0 tx=0x7fed240055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 shutdown_connections 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fed2006e270 0x7fed20070730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed34103a20 0x7fed34198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 --2- 172.21.15.89:0/2829419657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed340ff1d0 0x7fed34197d30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 >> 172.21.15.89:0/2829419657 conn(0x7fed340f9e90 msgr2=0x7fed340fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 shutdown_connections 2024-09-13T22:12:11.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:11.277+0000 7fed39959640 1 -- 172.21.15.89:0/2829419657 wait complete. 2024-09-13T22:12:11.513 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:11 smithi089 ceph-mon[27921]: pgmap v72: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:11.513 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:11 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2829419657' entity='client.admin' 2024-09-13T22:12:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:11 smithi159 ceph-mon[35348]: pgmap v72: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:11.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:11 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2829419657' entity='client.admin' 2024-09-13T22:12:12.004 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T22:12:12.004 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:12:12.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T22:12:12.211 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:12:12.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:12 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:12.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:12 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:12.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:12 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:12:12.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:12 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:12.585 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:12 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:12.585 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:12 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:12.585 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:12 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:12:12.585 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:12 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:13.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:13 smithi089 ceph-mon[27921]: pgmap v73: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:13.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:13 smithi159 ceph-mon[35348]: pgmap v73: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:13.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.792+0000 7f5a7ed76640 1 -- 172.21.15.89:0/3263508284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 msgr2=0x7f5a78104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.792+0000 7f5a7ed76640 1 --2- 172.21.15.89:0/3263508284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 0x7f5a78104dd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009880 tx=0x7f5a7002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.792+0000 7f5a7ed76640 1 -- 172.21.15.89:0/3263508284 shutdown_connections 2024-09-13T22:12:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.792+0000 7f5a7ed76640 1 --2- 172.21.15.89:0/3263508284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a780fe9f0 0x7f5a780fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.792+0000 7f5a7ed76640 1 --2- 172.21.15.89:0/3263508284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 0x7f5a78104dd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.792+0000 7f5a7ed76640 1 -- 172.21.15.89:0/3263508284 >> 172.21.15.89:0/3263508284 conn(0x7f5a780758a0 msgr2=0x7f5a780fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.792+0000 7f5a7ed76640 1 -- 172.21.15.89:0/3263508284 shutdown_connections 2024-09-13T22:12:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.792+0000 7f5a7ed76640 1 -- 172.21.15.89:0/3263508284 wait complete. 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.793+0000 7f5a7ed76640 1 Processor -- start 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.793+0000 7f5a7ed76640 1 -- start start 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.793+0000 7f5a7ed76640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a780fe9f0 0x7f5a7819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.793+0000 7f5a7ed76640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 0x7f5a7819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.793+0000 7f5a7ed76640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7819c3b0 con 0x7f5a781049f0 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.793+0000 7f5a7ed76640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78195880 con 0x7f5a780fe9f0 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.793+0000 7f5a77fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 0x7f5a7819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.793+0000 7f5a77fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 0x7f5a7819bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54296/0 (socket says 172.21.15.89:54296) 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.793+0000 7f5a77fff640 1 -- 172.21.15.89:0/324622297 learned_addr learned my addr 172.21.15.89:0/324622297 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a7cb12640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a780fe9f0 0x7f5a7819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a77fff640 1 -- 172.21.15.89:0/324622297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a780fe9f0 msgr2=0x7f5a7819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a77fff640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a780fe9f0 0x7f5a7819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a77fff640 1 -- 172.21.15.89:0/324622297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70009560 con 0x7f5a781049f0 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a7cb12640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a780fe9f0 0x7f5a7819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a77fff640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 0x7f5a7819bd60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000c8a0 tx=0x7f5a6000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a75ffb640 1 -- 172.21.15.89:0/324622297 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a60007b80 con 0x7f5a781049f0 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a75ffb640 1 -- 172.21.15.89:0/324622297 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a60007ce0 con 0x7f5a781049f0 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a78195b60 con 0x7f5a781049f0 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a75ffb640 1 -- 172.21.15.89:0/324622297 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a60018810 con 0x7f5a781049f0 2024-09-13T22:12:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.794+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a781960b0 con 0x7f5a781049f0 2024-09-13T22:12:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.795+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a78100130 con 0x7f5a781049f0 2024-09-13T22:12:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.796+0000 7f5a75ffb640 1 -- 172.21.15.89:0/324622297 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f5a60018970 con 0x7f5a781049f0 2024-09-13T22:12:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.796+0000 7f5a75ffb640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f5a6406e270 0x7f5a64070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.796+0000 7f5a75ffb640 1 -- 172.21.15.89:0/324622297 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5a6008e310 con 0x7f5a781049f0 2024-09-13T22:12:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.796+0000 7f5a7cb12640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f5a6406e270 0x7f5a64070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.797+0000 7f5a7cb12640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f5a6406e270 0x7f5a64070730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a70006010 tx=0x7f5a70005e60 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.800+0000 7f5a75ffb640 1 -- 172.21.15.89:0/324622297 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f5a60057960 con 0x7f5a781049f0 2024-09-13T22:12:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.968+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f5a7810bc60 con 0x7f5a781049f0 2024-09-13T22:12:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.968+0000 7f5a75ffb640 1 -- 172.21.15.89:0/324622297 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v50)=0 v50) v1 ==== 155+0+0 (secure 0 0 0) 0x7f5a6005b020 con 0x7f5a781049f0 2024-09-13T22:12:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.970+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f5a6406e270 msgr2=0x7f5a64070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.970+0000 7f5a7ed76640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f5a6406e270 0x7f5a64070730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a70006010 tx=0x7f5a70005e60 comp rx=0 tx=0).stop 2024-09-13T22:12:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.970+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 msgr2=0x7f5a7819bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.970+0000 7f5a7ed76640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 0x7f5a7819bd60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000c8a0 tx=0x7f5a6000cd60 comp rx=0 tx=0).stop 2024-09-13T22:12:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.971+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 shutdown_connections 2024-09-13T22:12:13.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.971+0000 7f5a7ed76640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f5a6406e270 0x7f5a64070730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:13.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.971+0000 7f5a7ed76640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a781049f0 0x7f5a7819bd60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:13.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.971+0000 7f5a7ed76640 1 --2- 172.21.15.89:0/324622297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a780fe9f0 0x7f5a7819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:13.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.971+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 >> 172.21.15.89:0/324622297 conn(0x7f5a780758a0 msgr2=0x7f5a78067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:13.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.971+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 shutdown_connections 2024-09-13T22:12:13.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:13.971+0000 7f5a7ed76640 1 -- 172.21.15.89:0/324622297 wait complete. 2024-09-13T22:12:14.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T22:12:14.762 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:12:15.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:15 smithi089 ceph-mon[27921]: pgmap v74: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:15.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:15 smithi159 ceph-mon[35348]: pgmap v74: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:16.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.266+0000 7f0155889640 1 -- 172.21.15.89:0/3895098633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01500fea30 msgr2=0x7f01500fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:16.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.266+0000 7f0155889640 1 --2- 172.21.15.89:0/3895098633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01500fea30 0x7f01500fee90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0144009c20 tx=0x7f014402a970 comp rx=0 tx=0).stop 2024-09-13T22:12:16.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.266+0000 7f0155889640 1 -- 172.21.15.89:0/3895098633 shutdown_connections 2024-09-13T22:12:16.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.266+0000 7f0155889640 1 --2- 172.21.15.89:0/3895098633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01500fea30 0x7f01500fee90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:16.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.266+0000 7f0155889640 1 --2- 172.21.15.89:0/3895098633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0150104a30 0x7f0150104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:16.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.266+0000 7f0155889640 1 -- 172.21.15.89:0/3895098633 >> 172.21.15.89:0/3895098633 conn(0x7f01500fa730 msgr2=0x7f01500fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:16.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.266+0000 7f0155889640 1 -- 172.21.15.89:0/3895098633 shutdown_connections 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.266+0000 7f0155889640 1 -- 172.21.15.89:0/3895098633 wait complete. 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.267+0000 7f0155889640 1 Processor -- start 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.267+0000 7f0155889640 1 -- start start 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.267+0000 7f0155889640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01500fea30 0x7f015019a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f0155889640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0150104a30 0x7f015019adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f0155889640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015019b3d0 con 0x7f0150104a30 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f0155889640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0150194960 con 0x7f01500fea30 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f014e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0150104a30 0x7f015019adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f014e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0150104a30 0x7f015019adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54320/0 (socket says 172.21.15.89:54320) 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f014e7fc640 1 -- 172.21.15.89:0/649791007 learned_addr learned my addr 172.21.15.89:0/649791007 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f014effd640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01500fea30 0x7f015019a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f014e7fc640 1 -- 172.21.15.89:0/649791007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01500fea30 msgr2=0x7f015019a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f014e7fc640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01500fea30 0x7f015019a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f014e7fc640 1 -- 172.21.15.89:0/649791007 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0144009900 con 0x7f0150104a30 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f014effd640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01500fea30 0x7f015019a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f014e7fc640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0150104a30 0x7f015019adb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f014402ae90 tx=0x7f01440308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f0154887640 1 -- 172.21.15.89:0/649791007 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f014402f590 con 0x7f0150104a30 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f0154887640 1 -- 172.21.15.89:0/649791007 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0144030ca0 con 0x7f0150104a30 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0150194be0 con 0x7f0150104a30 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f0154887640 1 -- 172.21.15.89:0/649791007 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0144039680 con 0x7f0150104a30 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.268+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01501950d0 con 0x7f0150104a30 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.269+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0150100170 con 0x7f0150104a30 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.270+0000 7f0154887640 1 -- 172.21.15.89:0/649791007 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f014400a040 con 0x7f0150104a30 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.270+0000 7f0154887640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f013806e270 0x7f0138070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.270+0000 7f0154887640 1 -- 172.21.15.89:0/649791007 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f014402c040 con 0x7f0150104a30 2024-09-13T22:12:16.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.270+0000 7f014effd640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f013806e270 0x7f0138070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:16.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.271+0000 7f014effd640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f013806e270 0x7f0138070730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0148009930 tx=0x7f0148008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:16.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.275+0000 7f0154887640 1 -- 172.21.15.89:0/649791007 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f0144078b70 con 0x7f0150104a30 2024-09-13T22:12:16.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.447+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f01500fef10 con 0x7f0150104a30 2024-09-13T22:12:16.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.447+0000 7f0154887640 1 -- 172.21.15.89:0/649791007 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v50)=0 v50) v1 ==== 163+0+0 (secure 0 0 0) 0x7f014407c230 con 0x7f0150104a30 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f013806e270 msgr2=0x7f0138070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f013806e270 0x7f0138070730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0148009930 tx=0x7f0148008040 comp rx=0 tx=0).stop 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0150104a30 msgr2=0x7f015019adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0150104a30 0x7f015019adb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f014402ae90 tx=0x7f01440308a0 comp rx=0 tx=0).stop 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 shutdown_connections 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f013806e270 0x7f0138070730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0150104a30 0x7f015019adb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 --2- 172.21.15.89:0/649791007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01500fea30 0x7f015019a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 >> 172.21.15.89:0/649791007 conn(0x7f01500fa730 msgr2=0x7f01500fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 shutdown_connections 2024-09-13T22:12:16.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:16.449+0000 7f0155889640 1 -- 172.21.15.89:0/649791007 wait complete. 2024-09-13T22:12:17.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T22:12:17.330 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:12:17.452 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:17 smithi089 ceph-mon[27921]: pgmap v75: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:17.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:17 smithi159 ceph-mon[35348]: pgmap v75: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.929+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/552391293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 msgr2=0x7fd0cc104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.929+0000 7fd0d0a8b640 1 --2- 172.21.15.89:0/552391293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 0x7fd0cc104dd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009880 tx=0x7fd0bc02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.929+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/552391293 shutdown_connections 2024-09-13T22:12:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.929+0000 7fd0d0a8b640 1 --2- 172.21.15.89:0/552391293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc0fe9f0 0x7fd0cc0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.929+0000 7fd0d0a8b640 1 --2- 172.21.15.89:0/552391293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 0x7fd0cc104dd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.929+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/552391293 >> 172.21.15.89:0/552391293 conn(0x7fd0cc0758a0 msgr2=0x7fd0cc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.929+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/552391293 shutdown_connections 2024-09-13T22:12:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.929+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/552391293 wait complete. 2024-09-13T22:12:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.930+0000 7fd0d0a8b640 1 Processor -- start 2024-09-13T22:12:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.930+0000 7fd0d0a8b640 1 -- start start 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.930+0000 7fd0d0a8b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc0fe9f0 0x7fd0cc19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.930+0000 7fd0d0a8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 0x7fd0cc19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.930+0000 7fd0d0a8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc19c410 con 0x7fd0cc1049f0 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.930+0000 7fd0d0a8b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc1959a0 con 0x7fd0cc0fe9f0 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 0x7fd0cc19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 0x7fd0cc19bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54328/0 (socket says 172.21.15.89:54328) 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c9d9b640 1 -- 172.21.15.89:0/1467600659 learned_addr learned my addr 172.21.15.89:0/1467600659 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0ca59c640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc0fe9f0 0x7fd0cc19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c9d9b640 1 -- 172.21.15.89:0/1467600659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc0fe9f0 msgr2=0x7fd0cc19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c9d9b640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc0fe9f0 0x7fd0cc19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:18.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c9d9b640 1 -- 172.21.15.89:0/1467600659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc009560 con 0x7fd0cc1049f0 2024-09-13T22:12:18.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c9d9b640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 0x7fd0cc19bdf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400b420 tx=0x7fd0b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:18.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c37fe640 1 -- 172.21.15.89:0/1467600659 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b4011800 con 0x7fd0cc1049f0 2024-09-13T22:12:18.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c37fe640 1 -- 172.21.15.89:0/1467600659 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0b4011e20 con 0x7fd0cc1049f0 2024-09-13T22:12:18.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc195c80 con 0x7fd0cc1049f0 2024-09-13T22:12:18.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0c37fe640 1 -- 172.21.15.89:0/1467600659 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b400f2e0 con 0x7fd0cc1049f0 2024-09-13T22:12:18.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.931+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc1961d0 con 0x7fd0cc1049f0 2024-09-13T22:12:18.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.932+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc100130 con 0x7fd0cc1049f0 2024-09-13T22:12:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.933+0000 7fd0c37fe640 1 -- 172.21.15.89:0/1467600659 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7fd0b4010380 con 0x7fd0cc1049f0 2024-09-13T22:12:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.933+0000 7fd0c37fe640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd0b806e280 0x7fd0b8070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.933+0000 7fd0c37fe640 1 -- 172.21.15.89:0/1467600659 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd0b408d9d0 con 0x7fd0cc1049f0 2024-09-13T22:12:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.934+0000 7fd0ca59c640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd0b806e280 0x7fd0b8070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.934+0000 7fd0ca59c640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd0b806e280 0x7fd0b8070740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009230 tx=0x7fd0bc005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:18.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:18.938+0000 7fd0c37fe640 1 -- 172.21.15.89:0/1467600659 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd0b4057020 con 0x7fd0cc1049f0 2024-09-13T22:12:19.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.102+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fd0cc10bce0 con 0x7fd0cc1049f0 2024-09-13T22:12:19.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.103+0000 7fd0c37fe640 1 -- 172.21.15.89:0/1467600659 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v50)=0 v50) v1 ==== 135+0+0 (secure 0 0 0) 0x7fd0b405a6e0 con 0x7fd0cc1049f0 2024-09-13T22:12:19.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd0b806e280 msgr2=0x7fd0b8070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd0b806e280 0x7fd0b8070740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009230 tx=0x7fd0bc005a20 comp rx=0 tx=0).stop 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 msgr2=0x7fd0cc19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 0x7fd0cc19bdf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400b420 tx=0x7fd0b400b8e0 comp rx=0 tx=0).stop 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 shutdown_connections 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fd0b806e280 0x7fd0b8070740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0cc1049f0 0x7fd0cc19bdf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 --2- 172.21.15.89:0/1467600659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc0fe9f0 0x7fd0cc19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 >> 172.21.15.89:0/1467600659 conn(0x7fd0cc0758a0 msgr2=0x7fd0cc0fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 shutdown_connections 2024-09-13T22:12:19.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:19.105+0000 7fd0d0a8b640 1 -- 172.21.15.89:0/1467600659 wait complete. 2024-09-13T22:12:19.605 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:19 smithi089 ceph-mon[27921]: pgmap v76: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:19.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T22:12:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:19 smithi159 ceph-mon[35348]: pgmap v76: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:19.935 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:12:21.580 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:21 smithi089 ceph-mon[27921]: pgmap v77: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.582+0000 7fb5f035c640 1 -- 172.21.15.89:0/3243755384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 msgr2=0x7fb5e80fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.582+0000 7fb5f035c640 1 --2- 172.21.15.89:0/3243755384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 0x7fb5e80fffb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009880 tx=0x7fb5d802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.582+0000 7fb5f035c640 1 -- 172.21.15.89:0/3243755384 shutdown_connections 2024-09-13T22:12:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.582+0000 7fb5f035c640 1 --2- 172.21.15.89:0/3243755384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 0x7fb5e80fffb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.582+0000 7fb5f035c640 1 --2- 172.21.15.89:0/3243755384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e8105c00 0x7fb5e8105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.582+0000 7fb5f035c640 1 -- 172.21.15.89:0/3243755384 >> 172.21.15.89:0/3243755384 conn(0x7fb5e80fb830 msgr2=0x7fb5e80fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.582+0000 7fb5f035c640 1 -- 172.21.15.89:0/3243755384 shutdown_connections 2024-09-13T22:12:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.582+0000 7fb5f035c640 1 -- 172.21.15.89:0/3243755384 wait complete. 2024-09-13T22:12:21.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5f035c640 1 Processor -- start 2024-09-13T22:12:21.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5f035c640 1 -- start start 2024-09-13T22:12:21.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5f035c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 0x7fb5e819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5f035c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e8105c00 0x7fb5e819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5f035c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e819c450 con 0x7fb5e80ffb50 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5f035c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e81959e0 con 0x7fb5e8105c00 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5ee0f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 0x7fb5e819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5ee0f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 0x7fb5e819b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54342/0 (socket says 172.21.15.89:54342) 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5ee0f8640 1 -- 172.21.15.89:0/2156827679 learned_addr learned my addr 172.21.15.89:0/2156827679 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5ee0f8640 1 -- 172.21.15.89:0/2156827679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e8105c00 msgr2=0x7fb5e819be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5ee0f8640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e8105c00 0x7fb5e819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5ee0f8640 1 -- 172.21.15.89:0/2156827679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d8009560 con 0x7fb5e80ffb50 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.583+0000 7fb5ee0f8640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 0x7fb5e819b8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400b420 tx=0x7fb5e400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.584+0000 7fb5df7fe640 1 -- 172.21.15.89:0/2156827679 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e4011800 con 0x7fb5e80ffb50 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.584+0000 7fb5df7fe640 1 -- 172.21.15.89:0/2156827679 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5e4011e20 con 0x7fb5e80ffb50 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.584+0000 7fb5df7fe640 1 -- 172.21.15.89:0/2156827679 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e400f2e0 con 0x7fb5e80ffb50 2024-09-13T22:12:21.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.584+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e8195cc0 con 0x7fb5e80ffb50 2024-09-13T22:12:21.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.584+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e8196290 con 0x7fb5e80ffb50 2024-09-13T22:12:21.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.585+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e8101200 con 0x7fb5e80ffb50 2024-09-13T22:12:21.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.585+0000 7fb5df7fe640 1 -- 172.21.15.89:0/2156827679 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7fb5e4010380 con 0x7fb5e80ffb50 2024-09-13T22:12:21.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.586+0000 7fb5df7fe640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fb5d406e270 0x7fb5d4070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:21.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.586+0000 7fb5df7fe640 1 -- 172.21.15.89:0/2156827679 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb5e408da70 con 0x7fb5e80ffb50 2024-09-13T22:12:21.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.586+0000 7fb5ed8f7640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fb5d406e270 0x7fb5d4070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:21.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.586+0000 7fb5ed8f7640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fb5d406e270 0x7fb5d4070730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8196e50 tx=0x7fb5d8000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:21.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.590+0000 7fb5df7fe640 1 -- 172.21.15.89:0/2156827679 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fb5e40570c0 con 0x7fb5e80ffb50 2024-09-13T22:12:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:21 smithi159 ceph-mon[35348]: pgmap v77: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:21.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.775+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5e81080e0 con 0x7fb5d406e270 2024-09-13T22:12:21.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.780+0000 7fb5df7fe640 1 -- 172.21.15.89:0/2156827679 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fb5e81080e0 con 0x7fb5d406e270 2024-09-13T22:12:21.781 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:12:21.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.782+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fb5d406e270 msgr2=0x7fb5d4070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:21.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.782+0000 7fb5f035c640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fb5d406e270 0x7fb5d4070730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8196e50 tx=0x7fb5d8000bc0 comp rx=0 tx=0).stop 2024-09-13T22:12:21.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.782+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 msgr2=0x7fb5e819b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:21.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.782+0000 7fb5f035c640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 0x7fb5e819b8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400b420 tx=0x7fb5e400b8e0 comp rx=0 tx=0).stop 2024-09-13T22:12:21.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.783+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 shutdown_connections 2024-09-13T22:12:21.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.783+0000 7fb5f035c640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7fb5d406e270 0x7fb5d4070730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:21.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.783+0000 7fb5f035c640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e8105c00 0x7fb5e819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:21.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.783+0000 7fb5f035c640 1 --2- 172.21.15.89:0/2156827679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5e80ffb50 0x7fb5e819b8f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.783+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 >> 172.21.15.89:0/2156827679 conn(0x7fb5e80fb830 msgr2=0x7fb5e80fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.783+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 shutdown_connections 2024-09-13T22:12:21.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:21.783+0000 7fb5f035c640 1 -- 172.21.15.89:0/2156827679 wait complete. 2024-09-13T22:12:22.605 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T22:12:22.605 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:12:22.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T22:12:22.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:22.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:12:22.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:22.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:22.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:22.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:12:22.866 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:22.866 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:12:22.866 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: pgmap v78: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:22.866 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:22 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:12:22.880 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:12:23.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:23.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:12:23.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:23.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:23.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:23.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:12:23.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:23.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:12:23.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: pgmap v78: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:23.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:22 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:12:25.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:24 smithi089 ceph-mon[27921]: pgmap v79: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:25.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:24 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:25.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:24 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:25.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:24 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:12:25.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:24 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:25.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:24 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T22:12:25.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:24 smithi159 ceph-mon[35348]: pgmap v79: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:25.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:24 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:25.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:24 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:25.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:24 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:12:25.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:24 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:25.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:24 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T22:12:26.220 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:12:26.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 -- 172.21.15.89:0/1487763161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54940fe9f0 msgr2=0x7f54940fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 --2- 172.21.15.89:0/1487763161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54940fe9f0 0x7f54940fee50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5480009880 tx=0x7f548002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 -- 172.21.15.89:0/1487763161 shutdown_connections 2024-09-13T22:12:26.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 --2- 172.21.15.89:0/1487763161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54940fe9f0 0x7f54940fee50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 --2- 172.21.15.89:0/1487763161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54941049f0 0x7f5494104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 -- 172.21.15.89:0/1487763161 >> 172.21.15.89:0/1487763161 conn(0x7f54940758a0 msgr2=0x7f54940fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 -- 172.21.15.89:0/1487763161 shutdown_connections 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 -- 172.21.15.89:0/1487763161 wait complete. 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 Processor -- start 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.782+0000 7f549ac78640 1 -- start start 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f549ac78640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54940fe9f0 0x7f54940fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f549ac78640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54941049f0 0x7f54940fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f549ac78640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54940fb800 con 0x7f54941049f0 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f549ac78640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54940fb970 con 0x7f54940fe9f0 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f5493fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54941049f0 0x7f54940fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f5493fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54941049f0 0x7f54940fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34578/0 (socket says 172.21.15.89:34578) 2024-09-13T22:12:26.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f5493fff640 1 -- 172.21.15.89:0/83390189 learned_addr learned my addr 172.21.15.89:0/83390189 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f5498a14640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54940fe9f0 0x7f54940fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f5493fff640 1 -- 172.21.15.89:0/83390189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54940fe9f0 msgr2=0x7f54940fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f5493fff640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54940fe9f0 0x7f54940fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f5493fff640 1 -- 172.21.15.89:0/83390189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5480009560 con 0x7f54941049f0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.783+0000 7f5493fff640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54941049f0 0x7f54940fb2c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f548002a9c0 tx=0x7f54800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.784+0000 7f5491ffb640 1 -- 172.21.15.89:0/83390189 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5480004aa0 con 0x7f54941049f0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.784+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54940fbbf0 con 0x7f54941049f0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.784+0000 7f5491ffb640 1 -- 172.21.15.89:0/83390189 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5480004c00 con 0x7f54941049f0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.784+0000 7f5491ffb640 1 -- 172.21.15.89:0/83390189 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5480003ab0 con 0x7f54941049f0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.784+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54941a2040 con 0x7f54941049f0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.785+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5494100130 con 0x7f54941049f0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.785+0000 7f5491ffb640 1 -- 172.21.15.89:0/83390189 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f5480003ce0 con 0x7f54941049f0 2024-09-13T22:12:26.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.786+0000 7f5491ffb640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f548406e270 0x7f5484070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.786+0000 7f5491ffb640 1 -- 172.21.15.89:0/83390189 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f54800af120 con 0x7f54941049f0 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.786+0000 7f5498a14640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f548406e270 0x7f5484070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.786+0000 7f5498a14640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f548406e270 0x7f5484070730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f548800a810 tx=0x7f5488008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.790+0000 7f5491ffb640 1 -- 172.21.15.89:0/83390189 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f54800786f0 con 0x7f54941049f0 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.983+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54940fbbf0 con 0x7f548406e270 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.985+0000 7f5491ffb640 1 -- 172.21.15.89:0/83390189 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f54940fbbf0 con 0x7f548406e270 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.988+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f548406e270 msgr2=0x7f5484070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.988+0000 7f549ac78640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f548406e270 0x7f5484070730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f548800a810 tx=0x7f5488008040 comp rx=0 tx=0).stop 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.988+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54941049f0 msgr2=0x7f54940fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.988+0000 7f549ac78640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54941049f0 0x7f54940fb2c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f548002a9c0 tx=0x7f54800055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.988+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 shutdown_connections 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.989+0000 7f549ac78640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f548406e270 0x7f5484070730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.989+0000 7f549ac78640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54941049f0 0x7f54940fb2c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.989+0000 7f549ac78640 1 --2- 172.21.15.89:0/83390189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54940fe9f0 0x7f54940fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.989+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 >> 172.21.15.89:0/83390189 conn(0x7f54940758a0 msgr2=0x7f54940682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:26.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.989+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 shutdown_connections 2024-09-13T22:12:26.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:25.989+0000 7f549ac78640 1 -- 172.21.15.89:0/83390189 wait complete. 2024-09-13T22:12:26.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 -- 172.21.15.89:0/2150674429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b80ffb00 msgr2=0x7f04b80fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 --2- 172.21.15.89:0/2150674429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b80ffb00 0x7f04b80fff60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009880 tx=0x7f04a402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 -- 172.21.15.89:0/2150674429 shutdown_connections 2024-09-13T22:12:26.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 --2- 172.21.15.89:0/2150674429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b80ffb00 0x7f04b80fff60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 --2- 172.21.15.89:0/2150674429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b8105b90 0x7f04b8105f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 -- 172.21.15.89:0/2150674429 >> 172.21.15.89:0/2150674429 conn(0x7f04b80fb840 msgr2=0x7f04b80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:26.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 -- 172.21.15.89:0/2150674429 shutdown_connections 2024-09-13T22:12:26.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 -- 172.21.15.89:0/2150674429 wait complete. 2024-09-13T22:12:26.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 Processor -- start 2024-09-13T22:12:26.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.087+0000 7f04beb7a640 1 -- start start 2024-09-13T22:12:26.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04beb7a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b80ffb00 0x7f04b819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04beb7a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b8105b90 0x7f04b819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04beb7a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b819c380 con 0x7f04b8105b90 2024-09-13T22:12:26.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04beb7a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b8195910 con 0x7f04b80ffb00 2024-09-13T22:12:26.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b8105b90 0x7f04b819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b8105b90 0x7f04b819bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34606/0 (socket says 172.21.15.89:34606) 2024-09-13T22:12:26.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04b7fff640 1 -- 172.21.15.89:0/3375687231 learned_addr learned my addr 172.21.15.89:0/3375687231 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:26.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04bc916640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b80ffb00 0x7f04b819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04b7fff640 1 -- 172.21.15.89:0/3375687231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b80ffb00 msgr2=0x7f04b819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04b7fff640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b80ffb00 0x7f04b819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04b7fff640 1 -- 172.21.15.89:0/3375687231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a4009560 con 0x7f04b8105b90 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04b7fff640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b8105b90 0x7f04b819bd60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f04a402a9c0 tx=0x7f04a40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.088+0000 7f04b5ffb640 1 -- 172.21.15.89:0/3375687231 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a4004aa0 con 0x7f04b8105b90 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.089+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b8195b90 con 0x7f04b8105b90 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.089+0000 7f04b5ffb640 1 -- 172.21.15.89:0/3375687231 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04a4004c00 con 0x7f04b8105b90 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.089+0000 7f04b5ffb640 1 -- 172.21.15.89:0/3375687231 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a4003980 con 0x7f04b8105b90 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.089+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b8196080 con 0x7f04b8105b90 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.090+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b8101200 con 0x7f04b8105b90 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.090+0000 7f04b5ffb640 1 -- 172.21.15.89:0/3375687231 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f04a4003bf0 con 0x7f04b8105b90 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.091+0000 7f04b5ffb640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f04a806e270 0x7f04a8070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.091+0000 7f04b5ffb640 1 -- 172.21.15.89:0/3375687231 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f04a40af180 con 0x7f04b8105b90 2024-09-13T22:12:26.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:25 smithi089 ceph-mon[27921]: Upgrade: Target is version 19.1.1-324-gecab7be5 (squid) 2024-09-13T22:12:26.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:25 smithi089 ceph-mon[27921]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T22:12:26.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:25 smithi089 ceph-mon[27921]: Upgrade: Setting container_image for all mgr 2024-09-13T22:12:26.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.091+0000 7f04bc916640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f04a806e270 0x7f04a8070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.091+0000 7f04bc916640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f04a806e270 0x7f04a8070730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00bbe0 tx=0x7f04ac00b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:26.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.099+0000 7f04b5ffb640 1 -- 172.21.15.89:0/3375687231 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f04a4078800 con 0x7f04b8105b90 2024-09-13T22:12:26.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:25 smithi159 ceph-mon[35348]: Upgrade: Target is version 19.1.1-324-gecab7be5 (squid) 2024-09-13T22:12:26.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:25 smithi159 ceph-mon[35348]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T22:12:26.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:25 smithi159 ceph-mon[35348]: Upgrade: Setting container_image for all mgr 2024-09-13T22:12:26.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.290+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04b810cd70 con 0x7f04a806e270 2024-09-13T22:12:26.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.291+0000 7f04b5ffb640 1 -- 172.21.15.89:0/3375687231 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f04b810cd70 con 0x7f04a806e270 2024-09-13T22:12:26.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f04a806e270 msgr2=0x7f04a8070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f04a806e270 0x7f04a8070730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00bbe0 tx=0x7f04ac00b390 comp rx=0 tx=0).stop 2024-09-13T22:12:26.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b8105b90 msgr2=0x7f04b819bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b8105b90 0x7f04b819bd60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f04a402a9c0 tx=0x7f04a40055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 shutdown_connections 2024-09-13T22:12:26.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f04a806e270 0x7f04a8070730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b8105b90 0x7f04b819bd60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 --2- 172.21.15.89:0/3375687231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b80ffb00 0x7f04b819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 >> 172.21.15.89:0/3375687231 conn(0x7f04b80fb840 msgr2=0x7f04b80fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:26.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 shutdown_connections 2024-09-13T22:12:26.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.293+0000 7f04beb7a640 1 -- 172.21.15.89:0/3375687231 wait complete. 2024-09-13T22:12:26.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.377+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/3366179390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 msgr2=0x7f4ec8109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.377+0000 7f4ecdcd8640 1 --2- 172.21.15.89:0/3366179390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 0x7f4ec8109b20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0098b0 tx=0x7f4ebc02a560 comp rx=0 tx=0).stop 2024-09-13T22:12:26.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.377+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/3366179390 shutdown_connections 2024-09-13T22:12:26.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.377+0000 7f4ecdcd8640 1 --2- 172.21.15.89:0/3366179390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 0x7f4ec8109b20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.377+0000 7f4ecdcd8640 1 --2- 172.21.15.89:0/3366179390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ec8100d10 0x7f4ec81010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.377+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/3366179390 >> 172.21.15.89:0/3366179390 conn(0x7f4ec80758a0 msgr2=0x7f4ec80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:26.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.377+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/3366179390 shutdown_connections 2024-09-13T22:12:26.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.377+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/3366179390 wait complete. 2024-09-13T22:12:26.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.377+0000 7f4ecdcd8640 1 Processor -- start 2024-09-13T22:12:26.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ecdcd8640 1 -- start start 2024-09-13T22:12:26.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ecdcd8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ec8100d10 0x7f4ec8197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ecdcd8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 0x7f4ec8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ecdcd8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81989e0 con 0x7f4ec8101630 2024-09-13T22:12:26.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ecdcd8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec819c750 con 0x7f4ec8100d10 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ec6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 0x7f4ec8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ec6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 0x7f4ec8198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34628/0 (socket says 172.21.15.89:34628) 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ec6ffd640 1 -- 172.21.15.89:0/2701519743 learned_addr learned my addr 172.21.15.89:0/2701519743 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ec77fe640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ec8100d10 0x7f4ec8197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ec6ffd640 1 -- 172.21.15.89:0/2701519743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ec8100d10 msgr2=0x7f4ec8197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ec6ffd640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ec8100d10 0x7f4ec8197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ec6ffd640 1 -- 172.21.15.89:0/2701519743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc009560 con 0x7f4ec8101630 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.378+0000 7f4ec6ffd640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 0x7f4ec8198350 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc006010 tx=0x7f4ebc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.379+0000 7f4ec4ff9640 1 -- 172.21.15.89:0/2701519743 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ebc004aa0 con 0x7f4ec8101630 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.379+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec819c9d0 con 0x7f4ec8101630 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.379+0000 7f4ec4ff9640 1 -- 172.21.15.89:0/2701519743 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ebc004c00 con 0x7f4ec8101630 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.379+0000 7f4ec4ff9640 1 -- 172.21.15.89:0/2701519743 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ebc003a20 con 0x7f4ec8101630 2024-09-13T22:12:26.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.379+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec819cec0 con 0x7f4ec8101630 2024-09-13T22:12:26.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.380+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec80684b0 con 0x7f4ec8101630 2024-09-13T22:12:26.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.380+0000 7f4ec4ff9640 1 -- 172.21.15.89:0/2701519743 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f4ebc003c90 con 0x7f4ec8101630 2024-09-13T22:12:26.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.381+0000 7f4ec4ff9640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4eb006e270 0x7f4eb0070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.381+0000 7f4ec4ff9640 1 -- 172.21.15.89:0/2701519743 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4ebc0af380 con 0x7f4ec8101630 2024-09-13T22:12:26.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.381+0000 7f4ec77fe640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4eb006e270 0x7f4eb0070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.381+0000 7f4ec77fe640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4eb006e270 0x7f4eb0070730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009890 tx=0x7f4eb8008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:26.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.385+0000 7f4ec4ff9640 1 -- 172.21.15.89:0/2701519743 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f4ebc078950 con 0x7f4ec8101630 2024-09-13T22:12:26.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.569+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ec810ce00 con 0x7f4eb006e270 2024-09-13T22:12:26.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.578+0000 7f4ec4ff9640 1 -- 172.21.15.89:0/2701519743 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4ec810ce00 con 0x7f4eb006e270 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (71s) 44s ago 11m 16.0M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (11m) 44s ago 11m 7914k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (10m) 101s ago 10m 7872k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (11m) 44s ago 11m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (10m) 101s ago 10m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (49s) 44s ago 11m 47.7M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (5m) 44s ago 5m 16.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (6m) 44s ago 6m 14.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:12:26.580 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (6m) 101s ago 6m 162M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (5m) 101s ago 5m 16.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (2m) 44s ago 12m 503M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (119s) 101s ago 10m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (12m) 44s ago 13m 59.5M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f d3e6d0d0c916 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (10m) 101s ago 10m 46.4M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 9cc9ae567397 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (108s) 44s ago 11m 8384k - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (104s) 101s ago 10m 3573k - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (9m) 44s ago 9m 243M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (9m) 44s ago 9m 258M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:12:26.581 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (8m) 44s ago 8m 222M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:12:26.582 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (8m) 101s ago 8m 283M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:12:26.582 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (8m) 101s ago 8m 247M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:12:26.582 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (7m) 101s ago 7m 253M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:12:26.582 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (87s) 44s ago 11m 45.1M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:12:26.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.580+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4eb006e270 msgr2=0x7f4eb0070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.580+0000 7f4ecdcd8640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4eb006e270 0x7f4eb0070730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009890 tx=0x7f4eb8008040 comp rx=0 tx=0).stop 2024-09-13T22:12:26.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.580+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 msgr2=0x7f4ec8198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.580+0000 7f4ecdcd8640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 0x7f4ec8198350 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc006010 tx=0x7f4ebc0055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.581+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 shutdown_connections 2024-09-13T22:12:26.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.581+0000 7f4ecdcd8640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4eb006e270 0x7f4eb0070730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.581+0000 7f4ecdcd8640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ec8101630 0x7f4ec8198350 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.581+0000 7f4ecdcd8640 1 --2- 172.21.15.89:0/2701519743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ec8100d10 0x7f4ec8197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.581+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 >> 172.21.15.89:0/2701519743 conn(0x7f4ec80758a0 msgr2=0x7f4ec80fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:26.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.581+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 shutdown_connections 2024-09-13T22:12:26.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.581+0000 7f4ecdcd8640 1 -- 172.21.15.89:0/2701519743 wait complete. 2024-09-13T22:12:26.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.661+0000 7f05a3f61640 1 -- 172.21.15.89:0/2155021101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c1049f0 msgr2=0x7f059c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.661+0000 7f05a3f61640 1 --2- 172.21.15.89:0/2155021101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c1049f0 0x7f059c104dd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f058c009880 tx=0x7f058c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.661+0000 7f05a3f61640 1 -- 172.21.15.89:0/2155021101 shutdown_connections 2024-09-13T22:12:26.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.661+0000 7f05a3f61640 1 --2- 172.21.15.89:0/2155021101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c0fe9f0 0x7f059c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.661+0000 7f05a3f61640 1 --2- 172.21.15.89:0/2155021101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c1049f0 0x7f059c104dd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.661+0000 7f05a3f61640 1 -- 172.21.15.89:0/2155021101 >> 172.21.15.89:0/2155021101 conn(0x7f059c0758a0 msgr2=0x7f059c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:26.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.661+0000 7f05a3f61640 1 -- 172.21.15.89:0/2155021101 shutdown_connections 2024-09-13T22:12:26.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.661+0000 7f05a3f61640 1 -- 172.21.15.89:0/2155021101 wait complete. 2024-09-13T22:12:26.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.662+0000 7f05a3f61640 1 Processor -- start 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.662+0000 7f05a3f61640 1 -- start start 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.662+0000 7f05a3f61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c0fe9f0 0x7f059c0fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.662+0000 7f05a3f61640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c1049f0 0x7f059c0fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.662+0000 7f05a3f61640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0fb800 con 0x7f059c0fe9f0 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.662+0000 7f05a3f61640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0fb940 con 0x7f059c1049f0 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.662+0000 7f05a1cfd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c0fe9f0 0x7f059c0fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.662+0000 7f05a1cfd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c0fe9f0 0x7f059c0fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34640/0 (socket says 172.21.15.89:34640) 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.662+0000 7f05a1cfd640 1 -- 172.21.15.89:0/2087439401 learned_addr learned my addr 172.21.15.89:0/2087439401 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f05a14fc640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c1049f0 0x7f059c0fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f05a1cfd640 1 -- 172.21.15.89:0/2087439401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c1049f0 msgr2=0x7f059c0fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f05a1cfd640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c1049f0 0x7f059c0fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f05a1cfd640 1 -- 172.21.15.89:0/2087439401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c009560 con 0x7f059c0fe9f0 2024-09-13T22:12:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f05a14fc640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c1049f0 0x7f059c0fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:12:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f05a1cfd640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c0fe9f0 0x7f059c0fad80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f058c02a9c0 tx=0x7f058c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f0592ffd640 1 -- 172.21.15.89:0/2087439401 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f058c004aa0 con 0x7f059c0fe9f0 2024-09-13T22:12:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f0592ffd640 1 -- 172.21.15.89:0/2087439401 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f058c004c00 con 0x7f059c0fe9f0 2024-09-13T22:12:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c0fbbc0 con 0x7f059c0fe9f0 2024-09-13T22:12:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f0592ffd640 1 -- 172.21.15.89:0/2087439401 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f058c003980 con 0x7f059c0fe9f0 2024-09-13T22:12:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.663+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c1a2030 con 0x7f059c0fe9f0 2024-09-13T22:12:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.664+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c100130 con 0x7f059c0fe9f0 2024-09-13T22:12:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.665+0000 7f0592ffd640 1 -- 172.21.15.89:0/2087439401 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f058c003b00 con 0x7f059c0fe9f0 2024-09-13T22:12:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.665+0000 7f0592ffd640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f058806e270 0x7f0588070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.665+0000 7f0592ffd640 1 -- 172.21.15.89:0/2087439401 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f058c0af180 con 0x7f059c0fe9f0 2024-09-13T22:12:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.665+0000 7f05a14fc640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f058806e270 0x7f0588070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.666+0000 7f05a14fc640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f058806e270 0x7f0588070730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f05980058c0 tx=0x7f0598005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:26.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.669+0000 7f0592ffd640 1 -- 172.21.15.89:0/2087439401 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f058c0787d0 con 0x7f059c0fe9f0 2024-09-13T22:12:26.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.936+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f059c0fee50 con 0x7f059c0fe9f0 2024-09-13T22:12:26.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.936+0000 7f0592ffd640 1 -- 172.21.15.89:0/2087439401 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f058c07be90 con 0x7f059c0fe9f0 2024-09-13T22:12:26.938 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:12:26.938 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:12:26.938 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:12:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:12:26.940 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 12, 2024-09-13T22:12:26.940 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:12:26.940 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:12:26.940 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:12:26.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f058806e270 msgr2=0x7f0588070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f058806e270 0x7f0588070730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f05980058c0 tx=0x7f0598005850 comp rx=0 tx=0).stop 2024-09-13T22:12:26.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c0fe9f0 msgr2=0x7f059c0fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:26.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c0fe9f0 0x7f059c0fad80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f058c02a9c0 tx=0x7f058c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 shutdown_connections 2024-09-13T22:12:26.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f058806e270 0x7f0588070730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c1049f0 0x7f059c0fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 --2- 172.21.15.89:0/2087439401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f059c0fe9f0 0x7f059c0fad80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:26.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 >> 172.21.15.89:0/2087439401 conn(0x7f059c0758a0 msgr2=0x7f059c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:26.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 shutdown_connections 2024-09-13T22:12:26.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:26.939+0000 7f05a3f61640 1 -- 172.21.15.89:0/2087439401 wait complete. 2024-09-13T22:12:27.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.024+0000 7faf260cc640 1 -- 172.21.15.89:0/4187908751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200fea50 msgr2=0x7faf200fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.024+0000 7faf260cc640 1 --2- 172.21.15.89:0/4187908751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200fea50 0x7faf200fee30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faf10009880 tx=0x7faf1002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.024+0000 7faf260cc640 1 -- 172.21.15.89:0/4187908751 shutdown_connections 2024-09-13T22:12:27.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.024+0000 7faf260cc640 1 --2- 172.21.15.89:0/4187908751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf200ff400 0x7faf201038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.024+0000 7faf260cc640 1 --2- 172.21.15.89:0/4187908751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200fea50 0x7faf200fee30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.024+0000 7faf260cc640 1 -- 172.21.15.89:0/4187908751 >> 172.21.15.89:0/4187908751 conn(0x7faf200fa730 msgr2=0x7faf200fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:27.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.024+0000 7faf260cc640 1 -- 172.21.15.89:0/4187908751 shutdown_connections 2024-09-13T22:12:27.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.025+0000 7faf260cc640 1 -- 172.21.15.89:0/4187908751 wait complete. 2024-09-13T22:12:27.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.025+0000 7faf260cc640 1 Processor -- start 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.025+0000 7faf260cc640 1 -- start start 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.025+0000 7faf260cc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf200fea50 0x7faf2019c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.025+0000 7faf260cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200ff400 0x7faf2019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.025+0000 7faf260cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2019cd50 con 0x7faf200ff400 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.025+0000 7faf260cc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf201a0ac0 con 0x7faf200fea50 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf17fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200ff400 0x7faf2019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf17fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200ff400 0x7faf2019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34654/0 (socket says 172.21.15.89:34654) 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf17fff640 1 -- 172.21.15.89:0/2218498849 learned_addr learned my addr 172.21.15.89:0/2218498849 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf1f7fe640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf200fea50 0x7faf2019c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf17fff640 1 -- 172.21.15.89:0/2218498849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf200fea50 msgr2=0x7faf2019c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf17fff640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf200fea50 0x7faf2019c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf17fff640 1 -- 172.21.15.89:0/2218498849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10009560 con 0x7faf200ff400 2024-09-13T22:12:27.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf1f7fe640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf200fea50 0x7faf2019c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:12:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf17fff640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200ff400 0x7faf2019c6c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faf0800b420 tx=0x7faf0800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf1d7fa640 1 -- 172.21.15.89:0/2218498849 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf08011800 con 0x7faf200ff400 2024-09-13T22:12:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf1d7fa640 1 -- 172.21.15.89:0/2218498849 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf08011e20 con 0x7faf200ff400 2024-09-13T22:12:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf201a0da0 con 0x7faf200ff400 2024-09-13T22:12:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf1d7fa640 1 -- 172.21.15.89:0/2218498849 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf0800f2e0 con 0x7faf200ff400 2024-09-13T22:12:27.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.026+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf201a12f0 con 0x7faf200ff400 2024-09-13T22:12:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.027+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf20068d30 con 0x7faf200ff400 2024-09-13T22:12:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.028+0000 7faf1d7fa640 1 -- 172.21.15.89:0/2218498849 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7faf08010380 con 0x7faf200ff400 2024-09-13T22:12:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.028+0000 7faf1d7fa640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faf0c06e270 0x7faf0c070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.028+0000 7faf1d7fa640 1 -- 172.21.15.89:0/2218498849 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7faf0808db10 con 0x7faf200ff400 2024-09-13T22:12:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.028+0000 7faf1f7fe640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faf0c06e270 0x7faf0c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:27.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.029+0000 7faf1f7fe640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faf0c06e270 0x7faf0c070730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf10006010 tx=0x7faf10005e60 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:27.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.033+0000 7faf1d7fa640 1 -- 172.21.15.89:0/2218498849 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7faf080570e0 con 0x7faf200ff400 2024-09-13T22:12:27.123 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:26 smithi089 ceph-mon[27921]: pgmap v80: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:27.124 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:26 smithi089 ceph-mon[27921]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:27.124 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:26 smithi089 ceph-mon[27921]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:27.124 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:26 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:27.124 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:26 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:12:27.124 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:26 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:12:27.124 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:26 smithi089 ceph-mon[27921]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:27.124 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:26 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2087439401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:12:27.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.238+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf200feeb0 con 0x7faf200ff400 2024-09-13T22:12:27.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.239+0000 7faf1d7fa640 1 -- 172.21.15.89:0/2218498849 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1845 (secure 0 0 0) 0x7faf0805a7a0 con 0x7faf200ff400 2024-09-13T22:12:27.240 INFO:teuthology.orchestra.run.smithi089.stdout:e15 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:12:27.241 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:12:27.242 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:27.243 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:27.244 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:12:27.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faf0c06e270 msgr2=0x7faf0c070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faf0c06e270 0x7faf0c070730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf10006010 tx=0x7faf10005e60 comp rx=0 tx=0).stop 2024-09-13T22:12:27.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200ff400 msgr2=0x7faf2019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200ff400 0x7faf2019c6c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faf0800b420 tx=0x7faf0800b8e0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 shutdown_connections 2024-09-13T22:12:27.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7faf0c06e270 0x7faf0c070730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf200ff400 0x7faf2019c6c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 --2- 172.21.15.89:0/2218498849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf200fea50 0x7faf2019c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 >> 172.21.15.89:0/2218498849 conn(0x7faf200fa730 msgr2=0x7faf2010d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:27.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 shutdown_connections 2024-09-13T22:12:27.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.241+0000 7faf260cc640 1 -- 172.21.15.89:0/2218498849 wait complete. 2024-09-13T22:12:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:26 smithi159 ceph-mon[35348]: pgmap v80: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:26 smithi159 ceph-mon[35348]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:26 smithi159 ceph-mon[35348]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:26 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:26 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:12:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:26 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:12:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:26 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:26 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2087439401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.328+0000 7f4c8c387640 1 -- 172.21.15.89:0/1001702182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 msgr2=0x7f4c840fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.328+0000 7f4c8c387640 1 --2- 172.21.15.89:0/1001702182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 0x7f4c840fee80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009880 tx=0x7f4c8002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.328+0000 7f4c8c387640 1 -- 172.21.15.89:0/1001702182 shutdown_connections 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.328+0000 7f4c8c387640 1 --2- 172.21.15.89:0/1001702182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 0x7f4c840fee80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.328+0000 7f4c8c387640 1 --2- 172.21.15.89:0/1001702182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c84104a20 0x7f4c84104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.328+0000 7f4c8c387640 1 -- 172.21.15.89:0/1001702182 >> 172.21.15.89:0/1001702182 conn(0x7f4c840fa700 msgr2=0x7f4c840fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.328+0000 7f4c8c387640 1 -- 172.21.15.89:0/1001702182 shutdown_connections 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.328+0000 7f4c8c387640 1 -- 172.21.15.89:0/1001702182 wait complete. 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8c387640 1 Processor -- start 2024-09-13T22:12:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8c387640 1 -- start start 2024-09-13T22:12:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8c387640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 0x7f4c8419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8c387640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c84104a20 0x7f4c8419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8c387640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8419c4b0 con 0x7f4c840fea20 2024-09-13T22:12:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8c387640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c84195a90 con 0x7f4c84104a20 2024-09-13T22:12:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8a123640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 0x7f4c8419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8a123640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 0x7f4c8419b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34664/0 (socket says 172.21.15.89:34664) 2024-09-13T22:12:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8a123640 1 -- 172.21.15.89:0/1462682695 learned_addr learned my addr 172.21.15.89:0/1462682695 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8a123640 1 -- 172.21.15.89:0/1462682695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c84104a20 msgr2=0x7f4c8419be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8a123640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c84104a20 0x7f4c8419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8a123640 1 -- 172.21.15.89:0/1462682695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c80009560 con 0x7f4c840fea20 2024-09-13T22:12:27.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.329+0000 7f4c8a123640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 0x7f4c8419b950 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400b420 tx=0x7f4c7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:27.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.330+0000 7f4c7b7fe640 1 -- 172.21.15.89:0/1462682695 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c74011800 con 0x7f4c840fea20 2024-09-13T22:12:27.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.330+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c84195d70 con 0x7f4c840fea20 2024-09-13T22:12:27.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.330+0000 7f4c7b7fe640 1 -- 172.21.15.89:0/1462682695 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c74011e20 con 0x7f4c840fea20 2024-09-13T22:12:27.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.330+0000 7f4c7b7fe640 1 -- 172.21.15.89:0/1462682695 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7400f2e0 con 0x7f4c840fea20 2024-09-13T22:12:27.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.330+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c841962c0 con 0x7f4c840fea20 2024-09-13T22:12:27.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.331+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c84100160 con 0x7f4c840fea20 2024-09-13T22:12:27.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.331+0000 7f4c7b7fe640 1 -- 172.21.15.89:0/1462682695 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f4c74010380 con 0x7f4c840fea20 2024-09-13T22:12:27.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.332+0000 7f4c7b7fe640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4c7006e280 0x7f4c70070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:27.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.332+0000 7f4c7b7fe640 1 -- 172.21.15.89:0/1462682695 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4c7408d6b0 con 0x7f4c840fea20 2024-09-13T22:12:27.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.332+0000 7f4c89922640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4c7006e280 0x7f4c70070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:27.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.332+0000 7f4c89922640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4c7006e280 0x7f4c70070740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c8002a9c0 tx=0x7f4c80000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:27.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.336+0000 7f4c7b7fe640 1 -- 172.21.15.89:0/1462682695 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f4c74056c80 con 0x7f4c840fea20 2024-09-13T22:12:27.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.527+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 --> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c8410ce10 con 0x7f4c7006e280 2024-09-13T22:12:27.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.529+0000 7f4c7b7fe640 1 -- 172.21.15.89:0/1462682695 <== mgr.14660 v2:172.21.15.89:6800/4031420145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f4c8410ce10 con 0x7f4c7006e280 2024-09-13T22:12:27.530 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:12:27.530 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:12:27.530 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:12:27.530 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:12:27.530 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:12:27.530 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-13T22:12:27.530 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:12:27.531 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/23 daemons upgraded", 2024-09-13T22:12:27.531 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T22:12:27.531 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:12:27.531 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:12:27.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4c7006e280 msgr2=0x7f4c70070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4c7006e280 0x7f4c70070740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c8002a9c0 tx=0x7f4c80000bc0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 msgr2=0x7f4c8419b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 0x7f4c8419b950 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400b420 tx=0x7f4c7400b8e0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 shutdown_connections 2024-09-13T22:12:27.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f4c7006e280 0x7f4c70070740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c84104a20 0x7f4c8419be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 --2- 172.21.15.89:0/1462682695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c840fea20 0x7f4c8419b950 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 >> 172.21.15.89:0/1462682695 conn(0x7f4c840fa700 msgr2=0x7f4c840fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:27.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 shutdown_connections 2024-09-13T22:12:27.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.531+0000 7f4c8c387640 1 -- 172.21.15.89:0/1462682695 wait complete. 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 -- 172.21.15.89:0/128724632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b601015f0 msgr2=0x7f2b60109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 --2- 172.21.15.89:0/128724632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b601015f0 0x7f2b60109ae0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c009880 tx=0x7f2b5c02a530 comp rx=0 tx=0).stop 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 -- 172.21.15.89:0/128724632 shutdown_connections 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 --2- 172.21.15.89:0/128724632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b601015f0 0x7f2b60109ae0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 --2- 172.21.15.89:0/128724632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b60100cd0 0x7f2b601010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 -- 172.21.15.89:0/128724632 >> 172.21.15.89:0/128724632 conn(0x7f2b600fa730 msgr2=0x7f2b600fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 -- 172.21.15.89:0/128724632 shutdown_connections 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 -- 172.21.15.89:0/128724632 wait complete. 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 Processor -- start 2024-09-13T22:12:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.611+0000 7f2b67757640 1 -- start start 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b67757640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60100cd0 0x7f2b6019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b67757640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b601015f0 0x7f2b6019bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b67757640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6019c4f0 con 0x7f2b60100cd0 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b67757640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60195a80 con 0x7f2b601015f0 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b654f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60100cd0 0x7f2b6019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b654f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60100cd0 0x7f2b6019b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34676/0 (socket says 172.21.15.89:34676) 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b654f3640 1 -- 172.21.15.89:0/507556023 learned_addr learned my addr 172.21.15.89:0/507556023 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b64cf2640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b601015f0 0x7f2b6019bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b654f3640 1 -- 172.21.15.89:0/507556023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b601015f0 msgr2=0x7f2b6019bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b654f3640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b601015f0 0x7f2b6019bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b654f3640 1 -- 172.21.15.89:0/507556023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c009560 con 0x7f2b60100cd0 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b654f3640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60100cd0 0x7f2b6019b990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000b420 tx=0x7f2b5000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b567fc640 1 -- 172.21.15.89:0/507556023 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b50011800 con 0x7f2b60100cd0 2024-09-13T22:12:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b567fc640 1 -- 172.21.15.89:0/507556023 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b50011e20 con 0x7f2b60100cd0 2024-09-13T22:12:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b60195d60 con 0x7f2b60100cd0 2024-09-13T22:12:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.612+0000 7f2b567fc640 1 -- 172.21.15.89:0/507556023 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5000f2e0 con 0x7f2b60100cd0 2024-09-13T22:12:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.613+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b60196280 con 0x7f2b60100cd0 2024-09-13T22:12:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.614+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b60068d30 con 0x7f2b60100cd0 2024-09-13T22:12:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.614+0000 7f2b567fc640 1 -- 172.21.15.89:0/507556023 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 33) v1 ==== 92412+0+0 (secure 0 0 0) 0x7f2b50010380 con 0x7f2b60100cd0 2024-09-13T22:12:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.615+0000 7f2b567fc640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f2b4c06e270 0x7f2b4c070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.615+0000 7f2b567fc640 1 -- 172.21.15.89:0/507556023 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2b5008db10 con 0x7f2b60100cd0 2024-09-13T22:12:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.615+0000 7f2b64cf2640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f2b4c06e270 0x7f2b4c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:27.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.615+0000 7f2b64cf2640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f2b4c06e270 0x7f2b4c070730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c000c00 tx=0x7f2b5c005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:27.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.619+0000 7f2b567fc640 1 -- 172.21.15.89:0/507556023 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f2b500570e0 con 0x7f2b60100cd0 2024-09-13T22:12:27.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.855+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2b60104440 con 0x7f2b60100cd0 2024-09-13T22:12:27.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.855+0000 7f2b567fc640 1 -- 172.21.15.89:0/507556023 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2b5005a7a0 con 0x7f2b60100cd0 2024-09-13T22:12:27.857 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:27.857 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:27.857 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.857+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f2b4c06e270 msgr2=0x7f2b4c070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.857+0000 7f2b67757640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f2b4c06e270 0x7f2b4c070730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c000c00 tx=0x7f2b5c005a20 comp rx=0 tx=0).stop 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.857+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60100cd0 msgr2=0x7f2b6019b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.857+0000 7f2b67757640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60100cd0 0x7f2b6019b990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000b420 tx=0x7f2b5000b8e0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.857+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 shutdown_connections 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.857+0000 7f2b67757640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:6800/4031420145,v1:172.21.15.89:6801/4031420145] conn(0x7f2b4c06e270 0x7f2b4c070730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.857+0000 7f2b67757640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b601015f0 0x7f2b6019bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.857+0000 7f2b67757640 1 --2- 172.21.15.89:0/507556023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60100cd0 0x7f2b6019b990 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.858+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 >> 172.21.15.89:0/507556023 conn(0x7f2b600fa730 msgr2=0x7f2b60101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:27.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.858+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 shutdown_connections 2024-09-13T22:12:27.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:27.858+0000 7f2b67757640 1 -- 172.21.15.89:0/507556023 wait complete. 2024-09-13T22:12:28.126 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:27 smithi089 ceph-mon[27921]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:28.126 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:27 smithi089 ceph-mon[27921]: Upgrade: Updating mon.smithi089 2024-09-13T22:12:28.126 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:27 smithi089 ceph-mon[27921]: Deploying daemon mon.smithi089 on smithi089 2024-09-13T22:12:28.126 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:27 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/2218498849' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:12:28.126 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:27 smithi089 ceph-mon[27921]: from='client.? 172.21.15.89:0/507556023' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:12:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:27 smithi159 ceph-mon[35348]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:27 smithi159 ceph-mon[35348]: Upgrade: Updating mon.smithi089 2024-09-13T22:12:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:27 smithi159 ceph-mon[35348]: Deploying daemon mon.smithi089 on smithi089 2024-09-13T22:12:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:27 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/2218498849' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:12:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:27 smithi159 ceph-mon[35348]: from='client.? 172.21.15.89:0/507556023' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:12:28.689 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:28 smithi089 systemd[1]: Stopping Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:12:28.690 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:28 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089[27917]: 2024-09-13T22:12:28.684+0000 7fb98f2f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi089 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:12:28.690 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:28 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089[27917]: 2024-09-13T22:12:28.684+0000 7fb98f2f9640 -1 mon.smithi089@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T22:12:28.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:28 smithi089 podman[109768]: 2024-09-13 22:12:28.766489024 +0000 UTC m=+0.185118189 container died d3e6d0d0c916688b536bcbe25e3fdb9bf1d9ccbe26d2273e8c62e3043678cde3 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, maintainer=Guillaume Abrioux , RELEASE=reef-e4e227b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T22:12:29.433 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:29 smithi089 podman[109768]: 2024-09-13 22:12:29.126360221 +0000 UTC m=+0.544989429 container cleanup d3e6d0d0c916688b536bcbe25e3fdb9bf1d9ccbe26d2273e8c62e3043678cde3 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, io.buildah.version=1.37.2, RELEASE=reef-e4e227b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:12:29.433 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:29 smithi089 bash[109768]: ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089 2024-09-13T22:12:29.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:29 smithi089 podman[109794]: 2024-09-13 22:12:29.432595874 +0000 UTC m=+0.660531242 container remove d3e6d0d0c916688b536bcbe25e3fdb9bf1d9ccbe26d2273e8c62e3043678cde3 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=reef-e4e227b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-13T22:12:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:29 smithi089 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089.service: Deactivated successfully. 2024-09-13T22:12:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:29 smithi089 systemd[1]: Stopped Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:12:29.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:29 smithi089 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089.service: Consumed 12.122s CPU time. 2024-09-13T22:12:30.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:29 smithi089 systemd[1]: Starting Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:12:30.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 podman[109920]: 2024-09-13 22:12:29.927672378 +0000 UTC m=+0.016342285 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:12:30.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 podman[109920]: 2024-09-13 22:12:30.029059668 +0000 UTC m=+0.117729560 container create 6b2c5b0ea3e13e05e9a1eee024fa26a66e5c2d7d800a463cf42a04b0181603f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T22:12:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 podman[109920]: 2024-09-13 22:12:30.273480374 +0000 UTC m=+0.362150265 container init 6b2c5b0ea3e13e05e9a1eee024fa26a66e5c2d7d800a463cf42a04b0181603f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T22:12:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 podman[109920]: 2024-09-13 22:12:30.277134413 +0000 UTC m=+0.365804315 container start 6b2c5b0ea3e13e05e9a1eee024fa26a66e5c2d7d800a463cf42a04b0181603f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T22:12:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:12:30.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: pidfile_write: ignore empty --pid-file 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: load: jerasure load: lrc 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: RocksDB version: 7.9.2 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Git sha 0 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: DB SUMMARY 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: DB Session ID: X9MQ83MKBOB0HVZQ7ZHX 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: CURRENT file: CURRENT 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1511 Bytes 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi089/store.db dir, Total Num: 1, files: 000032.sst 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi089/store.db: 000030.log size: 1354162 ; 2024-09-13T22:12:30.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.error_if_exists: 0 2024-09-13T22:12:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.create_if_missing: 0 2024-09-13T22:12:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.paranoid_checks: 1 2024-09-13T22:12:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T22:12:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:12:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T22:12:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.env: 0x563f849cd940 2024-09-13T22:12:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T22:12:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.info_log: 0x563f861a78c0 2024-09-13T22:12:30.749 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:12:30.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.statistics: (nil) 2024-09-13T22:12:30.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.use_fsync: 0 2024-09-13T22:12:30.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_log_file_size: 0 2024-09-13T22:12:30.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:12:30.750 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.allow_fallocate: 1 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.use_direct_reads: 0 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.db_log_dir: 2024-09-13T22:12:30.751 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.wal_dir: 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.write_buffer_manager: 0x563f861b6dc0 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:12:30.752 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.unordered_write: 0 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:12:30.753 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.row_cache: None 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.wal_filter: None 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.two_write_queues: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.wal_compression: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.atomic_flush: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.log_readahead_size: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:12:30.754 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_background_jobs: 2 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_background_compactions: -1 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_subcompactions: 1 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:12:30.755 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_open_files: -1 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_background_flushes: -1 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Compression algorithms supported: 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: kZSTD supported: 0 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: kXpressCompression supported: 0 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: kBZip2Compression supported: 0 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: kLZ4Compression supported: 1 2024-09-13T22:12:30.756 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: kZlibCompression supported: 1 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: kSnappyCompression supported: 1 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000015 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.merge_operator: 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_filter: None 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:12:30.757 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563f861a7520) 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks: 1 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_top_level_index_and_filter: 1 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_type: 0 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_index_type: 0 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_shortening: 1 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: checksum: 4 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: no_block_cache: 0 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache: 0x563f8619b1f0 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_name: BinnedLRUCache 2024-09-13T22:12:30.758 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_options: 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: capacity : 536870912 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_shard_bits : 4 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: strict_capacity_limit : 0 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: high_pri_pool_ratio: 0.000 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_compressed: (nil) 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: persistent_cache: (nil) 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size: 4096 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size_deviation: 10 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_restart_interval: 16 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_block_restart_interval: 1 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: metadata_block_size: 4096 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: partition_filters: 0 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: use_delta_encoding: 1 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: filter_policy: bloomfilter 2024-09-13T22:12:30.759 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: whole_key_filtering: 1 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: verify_compression: 0 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: read_amp_bytes_per_bit: 0 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: format_version: 5 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_index_compression: 1 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_align: 0 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_auto_readahead_size: 262144 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: prepopulate_block_cache: 0 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: initial_auto_readahead_size: 8192 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression: NoCompression 2024-09-13T22:12:30.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.num_levels: 7 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:12:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:12:30.762 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:12:30.763 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:12:30.763 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:12:30.763 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:12:30.763 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:12:30.763 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:12:30.764 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:12:30.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.inplace_update_support: 0 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.bloom_locality: 0 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.max_successive_merges: 0 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:12:30.766 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.ttl: 2592000 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.enable_blob_files: false 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.min_blob_size: 0 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:12:30.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12047, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 01a8d625-f6d3-4c29-b68e-003095d1976f 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726265550303273, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726265550308143, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 1230183, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12048, "largest_seqno": 13140, "table_properties": {"data_size": 1224728, "index_size": 3134, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 12221, "raw_average_key_size": 24, "raw_value_size": 1213885, "raw_average_value_size": 2408, "num_data_blocks": 142, "num_entries": 504, "num_filter_entries": 504, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726265550, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "01a8d625-f6d3-4c29-b68e-003095d1976f", "db_session_id": "X9MQ83MKBOB0HVZQ7ZHX", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726265550308250, "job": 1, "event": "recovery_finished"} 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi089/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563f861c8e00 2024-09-13T22:12:30.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: DB pointer 0x563f862c4000 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** DB Stats ** 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:12:30.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L0 1/0 1.17 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 451.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L6 1/0 7.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Sum 2/0 8.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 451.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 451.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 451.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:12:30.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative compaction: 0.00 GB write, 163.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval compaction: 0.00 GB write, 163.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache BinnedLRUCache@0x563f8619b1f0#2 capacity: 512.00 MB usage: 4.73 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,3.33 KB,0.000634789%) Misc(1,0.00 KB,0%) 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: starting mon.smithi089 rank 0 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi089 fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:12:30.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: mon.smithi089@-1(???) e2 preinit fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: mon.smithi089@-1(???).mds e15 new map 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: mon.smithi089@-1(???).mds e15 print_map 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: e15 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: legacy client fscid: 1 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Filesystem 'cephfs' (1) 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: fs_name cephfs 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: epoch 15 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:12:30.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: tableserver 0 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: root 0 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: session_timeout 60 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: session_autoclose 300 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_file_size 1099511627776 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_xattr_size 65536 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: required_client_features {} 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: last_failure 0 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: last_failure_osd_epoch 46 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_mds 1 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: in 0 2024-09-13T22:12:30.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: up {0=24247} 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: failed 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: damaged 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: stopped 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_pools [3] 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: metadata_pool 2 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: inline_data enabled 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: balancer 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: bal_rank_mask -1 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: standby_count_wanted 1 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: qdb_cluster leader: 0 members: 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T22:12:30.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Standby daemons: 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: mon.smithi089@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: mon.smithi089@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: mon.smithi089@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: mon.smithi089@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 ceph-mon[109939]: mon.smithi089@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 bash[109920]: 6b2c5b0ea3e13e05e9a1eee024fa26a66e5c2d7d800a463cf42a04b0181603f0 2024-09-13T22:12:30.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:30 smithi089 systemd[1]: Started Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:12:32.095 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:12:32.095 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:12:32.095 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: pgmap v82: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: mon.smithi089 calling monitor election 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: mon.smithi089 is new leader, mons smithi089,smithi159 in quorum (ranks 0,1) 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: monmap epoch 2 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: last_changed 2024-09-13T22:01:53.825962+0000 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: created 2024-09-13T21:59:19.977648+0000 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: min_mon_release 18 (reef) 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: election_strategy: 1 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.smithi159 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T22:12:32.096 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: mgrmap e33: smithi089.naneiw(active, since 2m), standbys: smithi159.ghpomd 2024-09-13T22:12:32.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:32.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:32.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:12:32.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: from='mgr.14660 ' entity='' 2024-09-13T22:12:32.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:31 smithi159 ceph-mon[35348]: mgrmap e34: smithi089.naneiw(active, since 2m), standbys: smithi159.ghpomd 2024-09-13T22:12:32.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:12:32.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: from='mgr.14660 172.21.15.89:0/1297251277' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:12:32.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: pgmap v82: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:32.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: mon.smithi089 calling monitor election 2024-09-13T22:12:32.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: mon.smithi089 is new leader, mons smithi089,smithi159 in quorum (ranks 0,1) 2024-09-13T22:12:32.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: monmap epoch 2 2024-09-13T22:12:32.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:12:32.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: last_changed 2024-09-13T22:01:53.825962+0000 2024-09-13T22:12:32.104 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: created 2024-09-13T21:59:19.977648+0000 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: min_mon_release 18 (reef) 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: election_strategy: 1 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.smithi159 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: mgrmap e33: smithi089.naneiw(active, since 2m), standbys: smithi159.ghpomd 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: from='mgr.14660 ' entity='' 2024-09-13T22:12:32.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:31 smithi089 ceph-mon[109939]: mgrmap e34: smithi089.naneiw(active, since 2m), standbys: smithi159.ghpomd 2024-09-13T22:12:36.843 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: Standby manager daemon smithi159.ghpomd restarted 2024-09-13T22:12:36.843 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:12:36.843 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/497968673' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/497968673' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/497968673' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.? 172.21.15.159:0/497968673' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: Active manager daemon smithi089.naneiw restarted 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: Activating manager daemon smithi089.naneiw 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: mgrmap e35: smithi089.naneiw(active, starting, since 0.00643174s), standbys: smithi159.ghpomd 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:12:36.844 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi159.ghpomd", "id": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:12:36.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:36 smithi159 ceph-mon[35348]: Manager daemon smithi089.naneiw is now available 2024-09-13T22:12:36.858 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: Standby manager daemon smithi159.ghpomd restarted 2024-09-13T22:12:36.858 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: Standby manager daemon smithi159.ghpomd started 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.? 172.21.15.159:0/497968673' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/crt"}]: dispatch 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.? 172.21.15.159:0/497968673' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.? 172.21.15.159:0/497968673' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.ghpomd/key"}]: dispatch 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.? 172.21.15.159:0/497968673' entity='mgr.smithi159.ghpomd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: Active manager daemon smithi089.naneiw restarted 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: Activating manager daemon smithi089.naneiw 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: mgrmap e35: smithi089.naneiw(active, starting, since 0.00643174s), standbys: smithi159.ghpomd 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:12:36.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi089.naneiw", "id": "smithi089.naneiw"}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr metadata", "who": "smithi159.ghpomd", "id": "smithi159.ghpomd"}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:12:36.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:36 smithi089 ceph-mon[109939]: Manager daemon smithi089.naneiw is now available 2024-09-13T22:12:37.827 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:37.827 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:12:37.827 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:12:37.827 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/trash_purge_schedule"}]: dispatch 2024-09-13T22:12:37.827 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:37 smithi089 ceph-mon[109939]: mgrmap e36: smithi089.naneiw(active, since 1.00923s), standbys: smithi159.ghpomd 2024-09-13T22:12:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:37 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:37 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:12:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:37 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:12:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:37 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.naneiw/trash_purge_schedule"}]: dispatch 2024-09-13T22:12:38.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:37 smithi159 ceph-mon[35348]: mgrmap e36: smithi089.naneiw(active, since 1.00923s), standbys: smithi159.ghpomd 2024-09-13T22:12:38.956 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:38 smithi089 ceph-mon[109939]: [13/Sep/2024:22:12:37] ENGINE Bus STARTING 2024-09-13T22:12:39.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:38 smithi159 ceph-mon[35348]: [13/Sep/2024:22:12:37] ENGINE Bus STARTING 2024-09-13T22:12:39.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:39 smithi089 ceph-mon[109939]: [13/Sep/2024:22:12:37] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T22:12:39.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:39 smithi089 ceph-mon[109939]: [13/Sep/2024:22:12:37] ENGINE Error in HTTPServer.serve 2024-09-13T22:12:39.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T22:12:39.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:12:39.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:12:39.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:12:39.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T22:12:39.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:12:39.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:39 smithi089 ceph-mon[109939]: [13/Sep/2024:22:12:37] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T22:12:39.948 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:39 smithi089 ceph-mon[109939]: [13/Sep/2024:22:12:37] ENGINE Bus STARTED 2024-09-13T22:12:39.948 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:39 smithi089 ceph-mon[109939]: pgmap v4: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:39.948 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:39 smithi089 ceph-mon[109939]: mgrmap e37: smithi089.naneiw(active, since 2s), standbys: smithi159.ghpomd 2024-09-13T22:12:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:39 smithi159 ceph-mon[35348]: [13/Sep/2024:22:12:37] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T22:12:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:39 smithi159 ceph-mon[35348]: [13/Sep/2024:22:12:37] ENGINE Error in HTTPServer.serve 2024-09-13T22:12:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Traceback (most recent call last): 2024-09-13T22:12:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:12:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:12:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:12:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._run(expiration_interval) 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: s = self.context.wrap_socket( 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: return self.sslsocket_class._create( 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self.do_handshake() 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: self._sslobj.do_handshake() 2024-09-13T22:12:40.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:12:40.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:39 smithi159 ceph-mon[35348]: [13/Sep/2024:22:12:37] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T22:12:40.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:39 smithi159 ceph-mon[35348]: [13/Sep/2024:22:12:37] ENGINE Bus STARTED 2024-09-13T22:12:40.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:39 smithi159 ceph-mon[35348]: pgmap v4: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:40.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:39 smithi159 ceph-mon[35348]: mgrmap e37: smithi089.naneiw(active, since 2s), standbys: smithi159.ghpomd 2024-09-13T22:12:40.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:40 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:40 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:40 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:40 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:42.072 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:41 smithi089 ceph-mon[109939]: pgmap v5: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:42.072 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:41 smithi089 ceph-mon[109939]: mgrmap e38: smithi089.naneiw(active, since 4s), standbys: smithi159.ghpomd 2024-09-13T22:12:42.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:41 smithi159 ceph-mon[35348]: pgmap v5: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:42.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:41 smithi159 ceph-mon[35348]: mgrmap e38: smithi089.naneiw(active, since 4s), standbys: smithi159.ghpomd 2024-09-13T22:12:43.333 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:43 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:43.333 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:43 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:43.333 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:43 smithi089 ceph-mon[109939]: pgmap v6: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:43.333 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:43 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:43.333 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:43 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:43 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:43 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:43 smithi159 ceph-mon[35348]: pgmap v6: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:43 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:43 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:45.946 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:45 smithi089 ceph-mon[109939]: pgmap v7: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T22:12:46.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:45 smithi159 ceph-mon[35348]: pgmap v7: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T22:12:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:12:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:12:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:12:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:12:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:12:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: pgmap v8: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:12:47.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T22:12:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:12:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: pgmap v8: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: Updating smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: Updating smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:47.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:47.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:12:47.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:46 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T22:12:49.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:49 smithi089 ceph-mon[109939]: Upgrade: Updating mon.smithi159 2024-09-13T22:12:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:49 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:49 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:12:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:49 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:12:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:49 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:49 smithi089 ceph-mon[109939]: Deploying daemon mon.smithi159 on smithi159 2024-09-13T22:12:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:49 smithi089 ceph-mon[109939]: pgmap v9: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T22:12:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:49 smithi159 ceph-mon[35348]: Upgrade: Updating mon.smithi159 2024-09-13T22:12:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:49 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:49 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:12:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:49 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:12:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:49 smithi159 ceph-mon[35348]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:12:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:49 smithi159 ceph-mon[35348]: Deploying daemon mon.smithi159 on smithi159 2024-09-13T22:12:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:49 smithi159 ceph-mon[35348]: pgmap v9: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T22:12:50.468 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:50 smithi159 systemd[1]: Stopping Ceph mon.smithi159 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:12:50.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:50 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159[35310]: 2024-09-13T22:12:50.466+0000 7f9aa16a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi159 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:12:50.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:50 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159[35310]: 2024-09-13T22:12:50.466+0000 7f9aa16a4640 -1 mon.smithi159@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T22:12:50.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:50 smithi159 podman[81838]: 2024-09-13 22:12:50.543626737 +0000 UTC m=+0.339958256 container died 9cc9ae5673971832da6dd7e671c8499164c9fbb13adf40a030f731507e5db75b (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T22:12:51.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:50 smithi159 podman[81838]: 2024-09-13 22:12:50.966712517 +0000 UTC m=+0.763044036 container cleanup 9cc9ae5673971832da6dd7e671c8499164c9fbb13adf40a030f731507e5db75b (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T22:12:51.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:50 smithi159 bash[81838]: ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159 2024-09-13T22:12:51.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:51 smithi159 podman[81850]: 2024-09-13 22:12:51.151231548 +0000 UTC m=+0.605305566 container remove 9cc9ae5673971832da6dd7e671c8499164c9fbb13adf40a030f731507e5db75b (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=reef-e4e227b, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T22:12:51.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:51 smithi159 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi159.service: Deactivated successfully. 2024-09-13T22:12:51.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:51 smithi159 systemd[1]: Stopped Ceph mon.smithi159 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:12:51.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:51 smithi159 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi159.service: Consumed 7.081s CPU time. 2024-09-13T22:12:51.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:51 smithi159 systemd[1]: Starting Ceph mon.smithi159 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:12:52.063 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:51 smithi159 podman[81981]: 2024-09-13 22:12:51.711955755 +0000 UTC m=+0.016077749 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:12:52.064 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:51 smithi159 podman[81981]: 2024-09-13 22:12:51.818964516 +0000 UTC m=+0.123086495 container create 7e0ece9671a705ca4051bfb8d054e6a1440464017ebea1547b2e2084606eed9c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T22:12:52.419 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 podman[81981]: 2024-09-13 22:12:52.063160731 +0000 UTC m=+0.367282710 container init 7e0ece9671a705ca4051bfb8d054e6a1440464017ebea1547b2e2084606eed9c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:12:52.419 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 podman[81981]: 2024-09-13 22:12:52.066438414 +0000 UTC m=+0.370560394 container start 7e0ece9671a705ca4051bfb8d054e6a1440464017ebea1547b2e2084606eed9c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-13T22:12:52.419 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:12:52.419 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: pidfile_write: ignore empty --pid-file 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: load: jerasure load: lrc 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: RocksDB version: 7.9.2 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Git sha 0 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: DB SUMMARY 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: DB Session ID: 70VT00SEYGPK6YC7AWTR 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: CURRENT file: CURRENT 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1404 Bytes 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi159/store.db dir, Total Num: 1, files: 000027.sst 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi159/store.db: 000025.log size: 4638822 ; 2024-09-13T22:12:52.420 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.error_if_exists: 0 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.create_if_missing: 0 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.paranoid_checks: 1 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.env: 0x55ead1768940 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.info_log: 0x55ead2c878c0 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.statistics: (nil) 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.use_fsync: 0 2024-09-13T22:12:52.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_log_file_size: 0 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.allow_fallocate: 1 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.use_direct_reads: 0 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.db_log_dir: 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.wal_dir: 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:12:52.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.write_buffer_manager: 0x55ead2c96dc0 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:12:52.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:12:52.424 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:12:52.424 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.unordered_write: 0 2024-09-13T22:12:52.424 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:12:52.424 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:12:52.424 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:12:52.424 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:12:52.424 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.row_cache: None 2024-09-13T22:12:52.424 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.wal_filter: None 2024-09-13T22:12:52.425 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:12:52.425 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.two_write_queues: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.wal_compression: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.atomic_flush: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.log_readahead_size: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:12:52.426 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_background_jobs: 2 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_background_compactions: -1 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_subcompactions: 1 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:12:52.427 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_open_files: -1 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_background_flushes: -1 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Compression algorithms supported: 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: kZSTD supported: 0 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: kXpressCompression supported: 0 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: kBZip2Compression supported: 0 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:12:52.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: kLZ4Compression supported: 1 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: kZlibCompression supported: 1 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: kSnappyCompression supported: 1 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000010 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.merge_operator: 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_filter: None 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:12:52.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ead2c87520) 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks: 1 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_top_level_index_and_filter: 1 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_type: 0 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_index_type: 0 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_shortening: 1 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: checksum: 4 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: no_block_cache: 0 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache: 0x55ead2c7b1f0 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_name: BinnedLRUCache 2024-09-13T22:12:52.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_options: 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: capacity : 536870912 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: num_shard_bits : 4 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: strict_capacity_limit : 0 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: high_pri_pool_ratio: 0.000 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_compressed: (nil) 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: persistent_cache: (nil) 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size: 4096 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size_deviation: 10 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_restart_interval: 16 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_block_restart_interval: 1 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: metadata_block_size: 4096 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: partition_filters: 0 2024-09-13T22:12:52.431 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: use_delta_encoding: 1 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: filter_policy: bloomfilter 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: whole_key_filtering: 1 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: verify_compression: 0 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: read_amp_bytes_per_bit: 0 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: format_version: 5 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_index_compression: 1 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_align: 0 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_auto_readahead_size: 262144 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: prepopulate_block_cache: 0 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: initial_auto_readahead_size: 8192 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:12:52.432 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression: NoCompression 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.num_levels: 7 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:12:52.433 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:12:52.434 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:12:52.435 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:12:52.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.inplace_update_support: 0 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:12:52.437 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.bloom_locality: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.max_successive_merges: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.ttl: 2592000 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.enable_blob_files: false 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.min_blob_size: 0 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:12:52.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12237, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 350db71d-1e13-49cb-896c-946c77fcecb8 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726265572093881, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726265572106759, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2862879, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12242, "largest_seqno": 13906, "table_properties": {"data_size": 2855482, "index_size": 4559, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1797, "raw_key_size": 16943, "raw_average_key_size": 24, "raw_value_size": 2840370, "raw_average_value_size": 4040, "num_data_blocks": 208, "num_entries": 703, "num_filter_entries": 703, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726265572, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "350db71d-1e13-49cb-896c-946c77fcecb8", "db_session_id": "70VT00SEYGPK6YC7AWTR", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-13T22:12:52.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726265572106925, "job": 1, "event": "recovery_finished"} 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi159/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ead2ca8e00 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: DB pointer 0x55ead2da4000 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** DB Stats ** 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:12:52.440 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L0 1/0 2.73 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 647.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L6 1/0 7.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Sum 2/0 9.99 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 647.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 647.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T22:12:52.441 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 647.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:12:52.442 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative compaction: 0.00 GB write, 151.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval compaction: 0.00 GB write, 151.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Block cache BinnedLRUCache@0x55ead2c7b1f0#2 capacity: 512.00 MB usage: 6.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: starting mon.smithi159 rank 1 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi159 fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: mon.smithi159@-1(???) e2 preinit fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: mon.smithi159@-1(???).mds e15 new map 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: mon.smithi159@-1(???).mds e15 print_map 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: e15 2024-09-13T22:12:52.443 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: legacy client fscid: 1 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Filesystem 'cephfs' (1) 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: fs_name cephfs 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: epoch 15 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: tableserver 0 2024-09-13T22:12:52.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: root 0 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: session_timeout 60 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: session_autoclose 300 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_file_size 1099511627776 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_xattr_size 65536 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: required_client_features {} 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: last_failure 0 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: last_failure_osd_epoch 46 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_mds 1 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: in 0 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: up {0=24247} 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: failed 2024-09-13T22:12:52.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: damaged 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: stopped 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_pools [3] 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: metadata_pool 2 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: inline_data enabled 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: balancer 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: bal_rank_mask -1 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: standby_count_wanted 1 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: qdb_cluster leader: 0 members: 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Standby daemons: 2024-09-13T22:12:52.446 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: mon.smithi159@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: mon.smithi159@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: mon.smithi159@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: mon.smithi159@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 ceph-mon[82000]: mon.smithi159@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 bash[81981]: 7e0ece9671a705ca4051bfb8d054e6a1440464017ebea1547b2e2084606eed9c 2024-09-13T22:12:52.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:52 smithi159 systemd[1]: Started Ceph mon.smithi159 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:12:54.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:12:54.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: mon.smithi089 calling monitor election 2024-09-13T22:12:54.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: mon.smithi159 calling monitor election 2024-09-13T22:12:54.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: mon.smithi089 is new leader, mons smithi089,smithi159 in quorum (ranks 0,1) 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: monmap epoch 3 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: last_changed 2024-09-13T22:12:53.653077+0000 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: created 2024-09-13T21:59:19.977648+0000 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: min_mon_release 19 (squid) 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: election_strategy: 1 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.smithi159 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: mgrmap e38: smithi089.naneiw(active, since 17s), standbys: smithi159.ghpomd 2024-09-13T22:12:54.979 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:54.980 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:54.980 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:12:54.980 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:54.980 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:54.980 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:54 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: mon.smithi089 calling monitor election 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: mon.smithi159 calling monitor election 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: mon.smithi089 is new leader, mons smithi089,smithi159 in quorum (ranks 0,1) 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: monmap epoch 3 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: fsid 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: last_changed 2024-09-13T22:12:53.653077+0000 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: created 2024-09-13T21:59:19.977648+0000 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: min_mon_release 19 (squid) 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: election_strategy: 1 2024-09-13T22:12:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.smithi159 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: mgrmap e38: smithi089.naneiw(active, since 17s), standbys: smithi159.ghpomd 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:54.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:54 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:12:55.940 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:55 smithi159 ceph-mon[82000]: pgmap v12: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T22:12:55.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:55 smithi089 ceph-mon[109939]: pgmap v12: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T22:12:57.879 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:57 smithi159 ceph-mon[82000]: pgmap v13: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:57.879 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:57 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:57.879 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:57 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:57.879 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:57 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:57.879 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:57 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:57.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.951+0000 7fc9615ee640 1 -- 172.21.15.89:0/2921963116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c0fe9f0 msgr2=0x7fc95c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:57.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.951+0000 7fc9615ee640 1 --2- 172.21.15.89:0/2921963116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c0fe9f0 0x7fc95c0fee50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc944009880 tx=0x7fc94402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:57.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.951+0000 7fc9615ee640 1 -- 172.21.15.89:0/2921963116 shutdown_connections 2024-09-13T22:12:57.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.951+0000 7fc9615ee640 1 --2- 172.21.15.89:0/2921963116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c0fe9f0 0x7fc95c0fee50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:57.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.951+0000 7fc9615ee640 1 --2- 172.21.15.89:0/2921963116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc95c1049f0 0x7fc95c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:57.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.951+0000 7fc9615ee640 1 -- 172.21.15.89:0/2921963116 >> 172.21.15.89:0/2921963116 conn(0x7fc95c0758a0 msgr2=0x7fc95c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:57.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.951+0000 7fc9615ee640 1 -- 172.21.15.89:0/2921963116 shutdown_connections 2024-09-13T22:12:57.953 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:57 smithi089 ceph-mon[109939]: pgmap v13: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:57.953 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:57 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:57.954 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:57 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:57.954 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:57 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:57.954 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:57 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.951+0000 7fc9615ee640 1 -- 172.21.15.89:0/2921963116 wait complete. 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.952+0000 7fc9615ee640 1 Processor -- start 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.952+0000 7fc9615ee640 1 -- start start 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.952+0000 7fc9615ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc95c0fe9f0 0x7fc95c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.952+0000 7fc9615ee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c1049f0 0x7fc95c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.952+0000 7fc9615ee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c195960 con 0x7fc95c1049f0 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.952+0000 7fc9615ee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c195aa0 con 0x7fc95c0fe9f0 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.952+0000 7fc95a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c1049f0 0x7fc95c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc95affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc95c0fe9f0 0x7fc95c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc95a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c1049f0 0x7fc95c19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53040/0 (socket says 172.21.15.89:53040) 2024-09-13T22:12:57.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc95a7fc640 1 -- 172.21.15.89:0/2423883562 learned_addr learned my addr 172.21.15.89:0/2423883562 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc95a7fc640 1 -- 172.21.15.89:0/2423883562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc95c0fe9f0 msgr2=0x7fc95c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc95a7fc640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc95c0fe9f0 0x7fc95c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc95a7fc640 1 -- 172.21.15.89:0/2423883562 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009560 con 0x7fc95c1049f0 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc95a7fc640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c1049f0 0x7fc95c19be40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc94402a9c0 tx=0x7fc9440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc953fff640 1 -- 172.21.15.89:0/2423883562 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc944004aa0 con 0x7fc95c1049f0 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc953fff640 1 -- 172.21.15.89:0/2423883562 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc944004c00 con 0x7fc95c1049f0 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c195d20 con 0x7fc95c1049f0 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc953fff640 1 -- 172.21.15.89:0/2423883562 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc944003980 con 0x7fc95c1049f0 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.953+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c196210 con 0x7fc95c1049f0 2024-09-13T22:12:57.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.955+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c100130 con 0x7fc95c1049f0 2024-09-13T22:12:57.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.955+0000 7fc953fff640 1 -- 172.21.15.89:0/2423883562 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fc944003b20 con 0x7fc95c1049f0 2024-09-13T22:12:57.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.955+0000 7fc953fff640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc94806e730 0x7fc948070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:57.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.956+0000 7fc953fff640 1 -- 172.21.15.89:0/2423883562 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc9440af830 con 0x7fc95c1049f0 2024-09-13T22:12:57.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.956+0000 7fc95affd640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc94806e730 0x7fc948070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:57.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.956+0000 7fc95affd640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc94806e730 0x7fc948070bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc94c005fd0 tx=0x7fc94c009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:57.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:57.960+0000 7fc953fff640 1 -- 172.21.15.89:0/2423883562 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc944078890 con 0x7fc95c1049f0 2024-09-13T22:12:58.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.142+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc95c10bc80 con 0x7fc94806e730 2024-09-13T22:12:58.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.144+0000 7fc953fff640 1 -- 172.21.15.89:0/2423883562 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc95c10bc80 con 0x7fc94806e730 2024-09-13T22:12:58.147 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc94806e730 msgr2=0x7fc948070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc94806e730 0x7fc948070bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc94c005fd0 tx=0x7fc94c009680 comp rx=0 tx=0).stop 2024-09-13T22:12:58.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c1049f0 msgr2=0x7fc95c19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c1049f0 0x7fc95c19be40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc94402a9c0 tx=0x7fc9440055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 shutdown_connections 2024-09-13T22:12:58.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc94806e730 0x7fc948070bf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c1049f0 0x7fc95c19be40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 --2- 172.21.15.89:0/2423883562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc95c0fe9f0 0x7fc95c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 >> 172.21.15.89:0/2423883562 conn(0x7fc95c0758a0 msgr2=0x7fc95c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:58.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 shutdown_connections 2024-09-13T22:12:58.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.146+0000 7fc9615ee640 1 -- 172.21.15.89:0/2423883562 wait complete. 2024-09-13T22:12:58.156 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:12:58.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.227+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1763601457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 msgr2=0x7fb1f00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.227+0000 7fb1f51c8640 1 --2- 172.21.15.89:0/1763601457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 0x7fb1f00fee50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009c20 tx=0x7fb1e402a970 comp rx=0 tx=0).stop 2024-09-13T22:12:58.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.227+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1763601457 shutdown_connections 2024-09-13T22:12:58.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.227+0000 7fb1f51c8640 1 --2- 172.21.15.89:0/1763601457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 0x7fb1f00fee50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.227+0000 7fb1f51c8640 1 --2- 172.21.15.89:0/1763601457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f01049f0 0x7fb1f0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.227+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1763601457 >> 172.21.15.89:0/1763601457 conn(0x7fb1f00758a0 msgr2=0x7fb1f00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:58.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.228+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1763601457 shutdown_connections 2024-09-13T22:12:58.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.228+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1763601457 wait complete. 2024-09-13T22:12:58.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.228+0000 7fb1f51c8640 1 Processor -- start 2024-09-13T22:12:58.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1f51c8640 1 -- start start 2024-09-13T22:12:58.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1f51c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 0x7fb1f019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:58.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1f51c8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f01049f0 0x7fb1f019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:58.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1f51c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f019c400 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1f51c8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f01958d0 con 0x7fb1f01049f0 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1eed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 0x7fb1f019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1eed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 0x7fb1f019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53066/0 (socket says 172.21.15.89:53066) 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1eed9d640 1 -- 172.21.15.89:0/1827246126 learned_addr learned my addr 172.21.15.89:0/1827246126 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1ee59c640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f01049f0 0x7fb1f019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1eed9d640 1 -- 172.21.15.89:0/1827246126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f01049f0 msgr2=0x7fb1f019bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1eed9d640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f01049f0 0x7fb1f019bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.229+0000 7fb1eed9d640 1 -- 172.21.15.89:0/1827246126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009900 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.230+0000 7fb1eed9d640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 0x7fb1f019b870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c8a0 tx=0x7fb1e000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.230+0000 7fb1d7fff640 1 -- 172.21.15.89:0/1827246126 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e0007b80 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.230+0000 7fb1d7fff640 1 -- 172.21.15.89:0/1827246126 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1e0007ce0 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.230+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f0195bb0 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.230+0000 7fb1d7fff640 1 -- 172.21.15.89:0/1827246126 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e0018810 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.230+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f0196100 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.231+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f0100130 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.232+0000 7fb1d7fff640 1 -- 172.21.15.89:0/1827246126 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fb1e0018a80 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.232+0000 7fb1d7fff640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb1d806e730 0x7fb1d8070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:58.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.232+0000 7fb1d7fff640 1 -- 172.21.15.89:0/1827246126 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb1e008eb50 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.232+0000 7fb1ee59c640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb1d806e730 0x7fb1d8070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:58.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.233+0000 7fb1ee59c640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb1d806e730 0x7fb1d8070bf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0197120 tx=0x7fb1e4009820 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:58.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.237+0000 7fb1d7fff640 1 -- 172.21.15.89:0/1827246126 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb1e0057a80 con 0x7fb1f00fe9f0 2024-09-13T22:12:58.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.419+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1f010bcf0 con 0x7fb1d806e730 2024-09-13T22:12:58.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.420+0000 7fb1d7fff640 1 -- 172.21.15.89:0/1827246126 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb1f010bcf0 con 0x7fb1d806e730 2024-09-13T22:12:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb1d806e730 msgr2=0x7fb1d8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb1d806e730 0x7fb1d8070bf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0197120 tx=0x7fb1e4009820 comp rx=0 tx=0).stop 2024-09-13T22:12:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 msgr2=0x7fb1f019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 0x7fb1f019b870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c8a0 tx=0x7fb1e000cd60 comp rx=0 tx=0).stop 2024-09-13T22:12:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 shutdown_connections 2024-09-13T22:12:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb1d806e730 0x7fb1d8070bf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f01049f0 0x7fb1f019bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 --2- 172.21.15.89:0/1827246126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f00fe9f0 0x7fb1f019b870 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 >> 172.21.15.89:0/1827246126 conn(0x7fb1f00758a0 msgr2=0x7fb1f00fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 shutdown_connections 2024-09-13T22:12:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.422+0000 7fb1f51c8640 1 -- 172.21.15.89:0/1827246126 wait complete. 2024-09-13T22:12:58.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/2871652300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb80fe9f0 msgr2=0x7f5bb80fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 --2- 172.21.15.89:0/2871652300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb80fe9f0 0x7f5bb80fee50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009880 tx=0x7f5ba002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/2871652300 shutdown_connections 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 --2- 172.21.15.89:0/2871652300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb80fe9f0 0x7f5bb80fee50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 --2- 172.21.15.89:0/2871652300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5bb81049f0 0x7f5bb8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/2871652300 >> 172.21.15.89:0/2871652300 conn(0x7f5bb80758a0 msgr2=0x7f5bb80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/2871652300 shutdown_connections 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/2871652300 wait complete. 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 Processor -- start 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.504+0000 7f5bbcdc4640 1 -- start start 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bbcdc4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5bb80fe9f0 0x7f5bb819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bbcdc4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb81049f0 0x7f5bb819bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bbcdc4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb81959f0 con 0x7f5bb81049f0 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bbcdc4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8195b30 con 0x7f5bb80fe9f0 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bb5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb81049f0 0x7f5bb819bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:58.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bb5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb81049f0 0x7f5bb819bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53088/0 (socket says 172.21.15.89:53088) 2024-09-13T22:12:58.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bb5d9b640 1 -- 172.21.15.89:0/1851984687 learned_addr learned my addr 172.21.15.89:0/1851984687 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:58.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bb659c640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5bb80fe9f0 0x7f5bb819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:58.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bb5d9b640 1 -- 172.21.15.89:0/1851984687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5bb80fe9f0 msgr2=0x7f5bb819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bb5d9b640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5bb80fe9f0 0x7f5bb819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bb5d9b640 1 -- 172.21.15.89:0/1851984687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba0009560 con 0x7f5bb81049f0 2024-09-13T22:12:58.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5bb5d9b640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb81049f0 0x7f5bb819bed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ba002a9c0 tx=0x7f5ba00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:58.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.505+0000 7f5baf7fe640 1 -- 172.21.15.89:0/1851984687 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ba0004aa0 con 0x7f5bb81049f0 2024-09-13T22:12:58.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.506+0000 7f5baf7fe640 1 -- 172.21.15.89:0/1851984687 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ba0004c00 con 0x7f5bb81049f0 2024-09-13T22:12:58.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.506+0000 7f5baf7fe640 1 -- 172.21.15.89:0/1851984687 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ba0003a20 con 0x7f5bb81049f0 2024-09-13T22:12:58.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.506+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb8195db0 con 0x7f5bb81049f0 2024-09-13T22:12:58.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.506+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb8196250 con 0x7f5bb81049f0 2024-09-13T22:12:58.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.507+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb8100130 con 0x7f5bb81049f0 2024-09-13T22:12:58.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.507+0000 7f5baf7fe640 1 -- 172.21.15.89:0/1851984687 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f5ba0031c90 con 0x7f5bb81049f0 2024-09-13T22:12:58.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.508+0000 7f5baf7fe640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5ba406e730 0x7f5ba4070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:58.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.508+0000 7f5baf7fe640 1 -- 172.21.15.89:0/1851984687 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5ba00af9d0 con 0x7f5bb81049f0 2024-09-13T22:12:58.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.508+0000 7f5bb659c640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5ba406e730 0x7f5ba4070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:58.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.508+0000 7f5bb659c640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5ba406e730 0x7f5ba4070bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009990 tx=0x7f5ba8009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:58.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.512+0000 7f5baf7fe640 1 -- 172.21.15.89:0/1851984687 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5ba0078900 con 0x7f5bb81049f0 2024-09-13T22:12:58.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.688+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bb8196fc0 con 0x7f5ba406e730 2024-09-13T22:12:58.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.697+0000 7f5baf7fe640 1 -- 172.21.15.89:0/1851984687 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5bb8196fc0 con 0x7f5ba406e730 2024-09-13T22:12:58.699 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:12:58.699 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (104s) 16s ago 12m 16.1M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:12:58.699 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (12m) 16s ago 12m 7994k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:12:58.699 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (11m) 2s ago 11m 8124k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:12:58.699 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (12m) 16s ago 12m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:12:58.699 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (11m) 2s ago 11m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (81s) 16s ago 11m 76.5M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (6m) 16s ago 6m 17.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (6m) 16s ago 6m 15.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (6m) 2s ago 6m 161M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (6m) 2s ago 6m 17.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (3m) 16s ago 13m 472M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (2m) 2s ago 11m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (28s) 16s ago 13m 28.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (6s) 2s ago 11m 21.9M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (2m) 16s ago 12m 15.7M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (2m) 2s ago 11m 15.9M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:12:58.700 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (10m) 16s ago 10m 244M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:12:58.701 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (9m) 16s ago 9m 259M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:12:58.701 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (9m) 16s ago 9m 222M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:12:58.701 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (9m) 2s ago 9m 285M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:12:58.701 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (8m) 2s ago 8m 249M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:12:58.701 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (8m) 2s ago 8m 254M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:12:58.701 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (2m) 16s ago 11m 54.2M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.699+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5ba406e730 msgr2=0x7f5ba4070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.699+0000 7f5bbcdc4640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5ba406e730 0x7f5ba4070bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009990 tx=0x7f5ba8009110 comp rx=0 tx=0).stop 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.699+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb81049f0 msgr2=0x7f5bb819bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.699+0000 7f5bbcdc4640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb81049f0 0x7f5bb819bed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ba002a9c0 tx=0x7f5ba00055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.699+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 shutdown_connections 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.699+0000 7f5bbcdc4640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5ba406e730 0x7f5ba4070bf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.699+0000 7f5bbcdc4640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb81049f0 0x7f5bb819bed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.699+0000 7f5bbcdc4640 1 --2- 172.21.15.89:0/1851984687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5bb80fe9f0 0x7f5bb819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.700+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 >> 172.21.15.89:0/1851984687 conn(0x7f5bb80758a0 msgr2=0x7f5bb80fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.700+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 shutdown_connections 2024-09-13T22:12:58.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.700+0000 7f5bbcdc4640 1 -- 172.21.15.89:0/1851984687 wait complete. 2024-09-13T22:12:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.779+0000 7f4964d82640 1 -- 172.21.15.89:0/1410093777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4960104a10 msgr2=0x7f4960104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.779+0000 7f4964d82640 1 --2- 172.21.15.89:0/1410093777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4960104a10 0x7f4960104df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4958009c20 tx=0x7f495802a970 comp rx=0 tx=0).stop 2024-09-13T22:12:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.779+0000 7f4964d82640 1 -- 172.21.15.89:0/1410093777 shutdown_connections 2024-09-13T22:12:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.779+0000 7f4964d82640 1 --2- 172.21.15.89:0/1410093777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49600fea10 0x7f49600fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.779+0000 7f4964d82640 1 --2- 172.21.15.89:0/1410093777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4960104a10 0x7f4960104df0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.779+0000 7f4964d82640 1 -- 172.21.15.89:0/1410093777 >> 172.21.15.89:0/1410093777 conn(0x7f49600fa730 msgr2=0x7f49600fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.780+0000 7f4964d82640 1 -- 172.21.15.89:0/1410093777 shutdown_connections 2024-09-13T22:12:58.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.780+0000 7f4964d82640 1 -- 172.21.15.89:0/1410093777 wait complete. 2024-09-13T22:12:58.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.780+0000 7f4964d82640 1 Processor -- start 2024-09-13T22:12:58.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.780+0000 7f4964d82640 1 -- start start 2024-09-13T22:12:58.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f4964d82640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49600fea10 0x7f4960196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:58.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f4964d82640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4960104a10 0x7f4960196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f4964d82640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4960197430 con 0x7f49600fea10 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f4964d82640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49601975a0 con 0x7f4960104a10 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f495e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49600fea10 0x7f4960196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f495e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49600fea10 0x7f4960196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53118/0 (socket says 172.21.15.89:53118) 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f495e59c640 1 -- 172.21.15.89:0/299022308 learned_addr learned my addr 172.21.15.89:0/299022308 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f495dd9b640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4960104a10 0x7f4960196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f495e59c640 1 -- 172.21.15.89:0/299022308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4960104a10 msgr2=0x7f4960196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f495e59c640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4960104a10 0x7f4960196e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f495e59c640 1 -- 172.21.15.89:0/299022308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958009900 con 0x7f49600fea10 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f495dd9b640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4960104a10 0x7f4960196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f495e59c640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49600fea10 0x7f4960196920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f495802ae90 tx=0x7f4958030880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f49577fe640 1 -- 172.21.15.89:0/299022308 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f495802f3c0 con 0x7f49600fea10 2024-09-13T22:12:58.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.781+0000 7f49577fe640 1 -- 172.21.15.89:0/299022308 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f495802f9e0 con 0x7f49600fea10 2024-09-13T22:12:58.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.782+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496019f990 con 0x7f49600fea10 2024-09-13T22:12:58.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.782+0000 7f49577fe640 1 -- 172.21.15.89:0/299022308 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4958039450 con 0x7f49600fea10 2024-09-13T22:12:58.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.782+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496019fcf0 con 0x7f49600fea10 2024-09-13T22:12:58.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.783+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4960100150 con 0x7f49600fea10 2024-09-13T22:12:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.783+0000 7f49577fe640 1 -- 172.21.15.89:0/299022308 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f495800a040 con 0x7f49600fea10 2024-09-13T22:12:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.784+0000 7f49577fe640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f494c06e730 0x7f494c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.784+0000 7f49577fe640 1 -- 172.21.15.89:0/299022308 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f495802c040 con 0x7f49600fea10 2024-09-13T22:12:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.784+0000 7f495dd9b640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f494c06e730 0x7f494c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.784+0000 7f495dd9b640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f494c06e730 0x7f494c070bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f49480058c0 tx=0x7f4948005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:58.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:58.788+0000 7f49577fe640 1 -- 172.21.15.89:0/299022308 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4958078bf0 con 0x7f49600fea10 2024-09-13T22:12:59.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.018+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4960068a70 con 0x7f49600fea10 2024-09-13T22:12:59.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.018+0000 7f49577fe640 1 -- 172.21.15.89:0/299022308 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f495807c2b0 con 0x7f49600fea10 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:12:59.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:12:59.021 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:12:59.021 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:12:59.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:12:59.021 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:12:59.021 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 10, 2024-09-13T22:12:59.021 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T22:12:59.021 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:12:59.021 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:12:59.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f494c06e730 msgr2=0x7f494c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f494c06e730 0x7f494c070bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f49480058c0 tx=0x7f4948005850 comp rx=0 tx=0).stop 2024-09-13T22:12:59.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49600fea10 msgr2=0x7f4960196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49600fea10 0x7f4960196920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f495802ae90 tx=0x7f4958030880 comp rx=0 tx=0).stop 2024-09-13T22:12:59.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 shutdown_connections 2024-09-13T22:12:59.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f494c06e730 0x7f494c070bf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4960104a10 0x7f4960196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 --2- 172.21.15.89:0/299022308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49600fea10 0x7f4960196920 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 >> 172.21.15.89:0/299022308 conn(0x7f49600fa730 msgr2=0x7f49600fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:59.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 shutdown_connections 2024-09-13T22:12:59.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.021+0000 7f4964d82640 1 -- 172.21.15.89:0/299022308 wait complete. 2024-09-13T22:12:59.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.102+0000 7f41234ac640 1 -- 172.21.15.89:0/3229614862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 msgr2=0x7f411c104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.102+0000 7f41234ac640 1 --2- 172.21.15.89:0/3229614862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 0x7f411c104e00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4118009880 tx=0x7f411802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.103+0000 7f41234ac640 1 -- 172.21.15.89:0/3229614862 shutdown_connections 2024-09-13T22:12:59.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.103+0000 7f41234ac640 1 --2- 172.21.15.89:0/3229614862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f411c0fea20 0x7f411c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.103+0000 7f41234ac640 1 --2- 172.21.15.89:0/3229614862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 0x7f411c104e00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.103+0000 7f41234ac640 1 -- 172.21.15.89:0/3229614862 >> 172.21.15.89:0/3229614862 conn(0x7f411c0fa700 msgr2=0x7f411c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:59.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.103+0000 7f41234ac640 1 -- 172.21.15.89:0/3229614862 shutdown_connections 2024-09-13T22:12:59.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.103+0000 7f41234ac640 1 -- 172.21.15.89:0/3229614862 wait complete. 2024-09-13T22:12:59.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.103+0000 7f41234ac640 1 Processor -- start 2024-09-13T22:12:59.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.103+0000 7f41234ac640 1 -- start start 2024-09-13T22:12:59.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f41234ac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f411c0fea20 0x7f411c194880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f41234ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 0x7f411c194dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f41234ac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c195300 con 0x7f411c104a20 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f41234ac640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c195470 con 0x7f411c0fea20 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f4120a47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 0x7f411c194dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f4120a47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 0x7f411c194dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53132/0 (socket says 172.21.15.89:53132) 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f4121248640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f411c0fea20 0x7f411c194880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f4120a47640 1 -- 172.21.15.89:0/644489720 learned_addr learned my addr 172.21.15.89:0/644489720 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f4120a47640 1 -- 172.21.15.89:0/644489720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f411c0fea20 msgr2=0x7f411c194880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f4120a47640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f411c0fea20 0x7f411c194880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f4120a47640 1 -- 172.21.15.89:0/644489720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4118009560 con 0x7f411c104a20 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f4121248640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f411c0fea20 0x7f411c194880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:12:59.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.104+0000 7f4120a47640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 0x7f411c194dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f410c00b420 tx=0x7f410c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:59.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.105+0000 7f41127fc640 1 -- 172.21.15.89:0/644489720 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f410c011800 con 0x7f411c104a20 2024-09-13T22:12:59.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.105+0000 7f41127fc640 1 -- 172.21.15.89:0/644489720 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f410c011e20 con 0x7f411c104a20 2024-09-13T22:12:59.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.105+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c1a1ef0 con 0x7f411c104a20 2024-09-13T22:12:59.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.105+0000 7f41127fc640 1 -- 172.21.15.89:0/644489720 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f410c00f2e0 con 0x7f411c104a20 2024-09-13T22:12:59.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.105+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c1a2250 con 0x7f411c104a20 2024-09-13T22:12:59.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.106+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c1040c0 con 0x7f411c104a20 2024-09-13T22:12:59.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.106+0000 7f41127fc640 1 -- 172.21.15.89:0/644489720 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f410c010380 con 0x7f411c104a20 2024-09-13T22:12:59.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.107+0000 7f41127fc640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f410806e730 0x7f4108070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:59.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.107+0000 7f41127fc640 1 -- 172.21.15.89:0/644489720 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f410c08e060 con 0x7f411c104a20 2024-09-13T22:12:59.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.107+0000 7f4121248640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f410806e730 0x7f4108070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:59.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.107+0000 7f4121248640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f410806e730 0x7f4108070bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4118009230 tx=0x7f41180058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:59.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.111+0000 7f41127fc640 1 -- 172.21.15.89:0/644489720 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f410c057080 con 0x7f411c104a20 2024-09-13T22:12:59.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.318+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f411c0fef00 con 0x7f411c104a20 2024-09-13T22:12:59.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.318+0000 7f41127fc640 1 -- 172.21.15.89:0/644489720 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f410c05a740 con 0x7f411c104a20 2024-09-13T22:12:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:e15 2024-09-13T22:12:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:12:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:12:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:12:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:12:59.320 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:12:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:12:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:12:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:12:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T22:12:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:12:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:12:59.323 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:12:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:12:59.323 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:59.323 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:59.323 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.320+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f410806e730 msgr2=0x7f4108070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.320+0000 7f41234ac640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f410806e730 0x7f4108070bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4118009230 tx=0x7f41180058d0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.321+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 msgr2=0x7f411c194dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.321+0000 7f41234ac640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 0x7f411c194dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f410c00b420 tx=0x7f410c00b8e0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.321+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 shutdown_connections 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.321+0000 7f41234ac640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f410806e730 0x7f4108070bf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.321+0000 7f41234ac640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411c104a20 0x7f411c194dc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.321+0000 7f41234ac640 1 --2- 172.21.15.89:0/644489720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f411c0fea20 0x7f411c194880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.321+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 >> 172.21.15.89:0/644489720 conn(0x7f411c0fa700 msgr2=0x7f411c0fb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:59.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.321+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 shutdown_connections 2024-09-13T22:12:59.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.321+0000 7f41234ac640 1 -- 172.21.15.89:0/644489720 wait complete. 2024-09-13T22:12:59.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.402+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/504417918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841049f0 msgr2=0x7f4a84104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.402+0000 7f4a8a1cc640 1 --2- 172.21.15.89:0/504417918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841049f0 0x7f4a84104dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009880 tx=0x7f4a7402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.402+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/504417918 shutdown_connections 2024-09-13T22:12:59.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.402+0000 7f4a8a1cc640 1 --2- 172.21.15.89:0/504417918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a840fe9f0 0x7f4a840fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.402+0000 7f4a8a1cc640 1 --2- 172.21.15.89:0/504417918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841049f0 0x7f4a84104dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.402+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/504417918 >> 172.21.15.89:0/504417918 conn(0x7f4a840758a0 msgr2=0x7f4a840fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:59.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.402+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/504417918 shutdown_connections 2024-09-13T22:12:59.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.402+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/504417918 wait complete. 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.403+0000 7f4a8a1cc640 1 Processor -- start 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.403+0000 7f4a8a1cc640 1 -- start start 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.403+0000 7f4a8a1cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a840fe9f0 0x7f4a84196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.403+0000 7f4a8a1cc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a841049f0 0x7f4a84196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.403+0000 7f4a8a1cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841974a0 con 0x7f4a840fe9f0 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.403+0000 7f4a8a1cc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841975e0 con 0x7f4a841049f0 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a840fe9f0 0x7f4a84196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a840fe9f0 0x7f4a84196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53152/0 (socket says 172.21.15.89:53152) 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a837fe640 1 -- 172.21.15.89:0/1397775536 learned_addr learned my addr 172.21.15.89:0/1397775536 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a7bfff640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a841049f0 0x7f4a84196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:59.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a837fe640 1 -- 172.21.15.89:0/1397775536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a841049f0 msgr2=0x7f4a84196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a837fe640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a841049f0 0x7f4a84196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a837fe640 1 -- 172.21.15.89:0/1397775536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a74009560 con 0x7f4a840fe9f0 2024-09-13T22:12:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a837fe640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a840fe9f0 0x7f4a84196940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4a7402a9c0 tx=0x7f4a740055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a817fa640 1 -- 172.21.15.89:0/1397775536 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a74004aa0 con 0x7f4a840fe9f0 2024-09-13T22:12:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8419f9b0 con 0x7f4a840fe9f0 2024-09-13T22:12:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a817fa640 1 -- 172.21.15.89:0/1397775536 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a74004c00 con 0x7f4a840fe9f0 2024-09-13T22:12:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a817fa640 1 -- 172.21.15.89:0/1397775536 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a74003980 con 0x7f4a840fe9f0 2024-09-13T22:12:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.404+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8419fdc0 con 0x7f4a840fe9f0 2024-09-13T22:12:59.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.406+0000 7f4a817fa640 1 -- 172.21.15.89:0/1397775536 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f4a74003bf0 con 0x7f4a840fe9f0 2024-09-13T22:12:59.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.406+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a84100130 con 0x7f4a840fe9f0 2024-09-13T22:12:59.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.406+0000 7f4a817fa640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4a7006e730 0x7f4a70070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:59.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.406+0000 7f4a817fa640 1 -- 172.21.15.89:0/1397775536 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4a740af910 con 0x7f4a840fe9f0 2024-09-13T22:12:59.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.407+0000 7f4a7bfff640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4a7006e730 0x7f4a70070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:59.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.407+0000 7f4a7bfff640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4a7006e730 0x7f4a70070bf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4a840687f0 tx=0x7f4a6c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:59.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.411+0000 7f4a817fa640 1 -- 172.21.15.89:0/1397775536 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4a740788f0 con 0x7f4a840fe9f0 2024-09-13T22:12:59.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.592+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a840682e0 con 0x7f4a7006e730 2024-09-13T22:12:59.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.593+0000 7f4a817fa640 1 -- 172.21.15.89:0/1397775536 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4a840682e0 con 0x7f4a7006e730 2024-09-13T22:12:59.594 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:12:59.594 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "4/23 daemons upgraded", 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:12:59.595 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4a7006e730 msgr2=0x7f4a70070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4a7006e730 0x7f4a70070bf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4a840687f0 tx=0x7f4a6c00b410 comp rx=0 tx=0).stop 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a840fe9f0 msgr2=0x7f4a84196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a840fe9f0 0x7f4a84196940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4a7402a9c0 tx=0x7f4a740055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 shutdown_connections 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4a7006e730 0x7f4a70070bf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a841049f0 0x7f4a84196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 --2- 172.21.15.89:0/1397775536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a840fe9f0 0x7f4a84196940 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 >> 172.21.15.89:0/1397775536 conn(0x7f4a840758a0 msgr2=0x7f4a840fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 shutdown_connections 2024-09-13T22:12:59.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.595+0000 7f4a8a1cc640 1 -- 172.21.15.89:0/1397775536 wait complete. 2024-09-13T22:12:59.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 -- 172.21.15.89:0/2719946705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 msgr2=0x7f1ac41010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 --2- 172.21.15.89:0/2719946705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 0x7f1ac41010f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ab40098b0 tx=0x7f1ab402a560 comp rx=0 tx=0).stop 2024-09-13T22:12:59.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 -- 172.21.15.89:0/2719946705 shutdown_connections 2024-09-13T22:12:59.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 --2- 172.21.15.89:0/2719946705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ac4101630 0x7f1ac4109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 --2- 172.21.15.89:0/2719946705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 0x7f1ac41010f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 -- 172.21.15.89:0/2719946705 >> 172.21.15.89:0/2719946705 conn(0x7f1ac40758a0 msgr2=0x7f1ac40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:59.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 -- 172.21.15.89:0/2719946705 shutdown_connections 2024-09-13T22:12:59.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:59 smithi089 ceph-mon[109939]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:59.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:59 smithi089 ceph-mon[109939]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:59.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:59 smithi089 ceph-mon[109939]: pgmap v14: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:12:59.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:59 smithi089 ceph-mon[109939]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:12:59.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:59 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/299022308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:12:59.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:12:59 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/644489720' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:12:59.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 -- 172.21.15.89:0/2719946705 wait complete. 2024-09-13T22:12:59.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 Processor -- start 2024-09-13T22:12:59.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.677+0000 7f1acc5be640 1 -- start start 2024-09-13T22:12:59.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1acc5be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 0x7f1ac419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:59.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1acc5be640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ac4101630 0x7f1ac419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:59.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1acc5be640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4195a20 con 0x7f1ac4100d10 2024-09-13T22:12:59.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1acc5be640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4195b60 con 0x7f1ac4101630 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1aca35a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 0x7f1ac419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1aca35a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 0x7f1ac419b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53174/0 (socket says 172.21.15.89:53174) 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1aca35a640 1 -- 172.21.15.89:0/2017934214 learned_addr learned my addr 172.21.15.89:0/2017934214 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1ac9b59640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ac4101630 0x7f1ac419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1aca35a640 1 -- 172.21.15.89:0/2017934214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ac4101630 msgr2=0x7f1ac419bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1aca35a640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ac4101630 0x7f1ac419bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1aca35a640 1 -- 172.21.15.89:0/2017934214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4009560 con 0x7f1ac4100d10 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.678+0000 7f1aca35a640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 0x7f1ac419b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4006010 tx=0x7f1ab40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.679+0000 7f1abb7fe640 1 -- 172.21.15.89:0/2017934214 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab40048d0 con 0x7f1ac4100d10 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.679+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac4195de0 con 0x7f1ac4100d10 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.679+0000 7f1abb7fe640 1 -- 172.21.15.89:0/2017934214 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ab4031640 con 0x7f1ac4100d10 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.679+0000 7f1abb7fe640 1 -- 172.21.15.89:0/2017934214 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab4003800 con 0x7f1ac4100d10 2024-09-13T22:12:59.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.679+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac41962d0 con 0x7f1ac4100d10 2024-09-13T22:12:59.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.680+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac40684b0 con 0x7f1ac4100d10 2024-09-13T22:12:59.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.680+0000 7f1abb7fe640 1 -- 172.21.15.89:0/2017934214 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f1ab4004a30 con 0x7f1ac4100d10 2024-09-13T22:12:59.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.681+0000 7f1abb7fe640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ab006e730 0x7f1ab0070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:12:59.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.681+0000 7f1ac9b59640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ab006e730 0x7f1ab0070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:12:59.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.681+0000 7f1abb7fe640 1 -- 172.21.15.89:0/2017934214 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1ab40af8e0 con 0x7f1ac4100d10 2024-09-13T22:12:59.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.681+0000 7f1ac9b59640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ab006e730 0x7f1ab0070bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4197270 tx=0x7f1ac0005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:12:59.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.685+0000 7f1abb7fe640 1 -- 172.21.15.89:0/2017934214 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1ab4078860 con 0x7f1ac4100d10 2024-09-13T22:12:59.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.913+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1ac4196fb0 con 0x7f1ac4100d10 2024-09-13T22:12:59.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.913+0000 7f1abb7fe640 1 -- 172.21.15.89:0/2017934214 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1ab407bf20 con 0x7f1ac4100d10 2024-09-13T22:12:59.914 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:59.914 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:12:59.915 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:12:59.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ab006e730 msgr2=0x7f1ab0070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ab006e730 0x7f1ab0070bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4197270 tx=0x7f1ac0005f90 comp rx=0 tx=0).stop 2024-09-13T22:12:59.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 msgr2=0x7f1ac419b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:12:59.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 0x7f1ac419b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4006010 tx=0x7f1ab40055a0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 shutdown_connections 2024-09-13T22:12:59.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ab006e730 0x7f1ab0070bf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ac4101630 0x7f1ac419bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 --2- 172.21.15.89:0/2017934214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac4100d10 0x7f1ac419b9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:12:59.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 >> 172.21.15.89:0/2017934214 conn(0x7f1ac40758a0 msgr2=0x7f1ac4101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:12:59.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 shutdown_connections 2024-09-13T22:12:59.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:12:59.915+0000 7f1acc5be640 1 -- 172.21.15.89:0/2017934214 wait complete. 2024-09-13T22:13:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:59 smithi159 ceph-mon[82000]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:59 smithi159 ceph-mon[82000]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:59 smithi159 ceph-mon[82000]: pgmap v14: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:59 smithi159 ceph-mon[82000]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:59 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/299022308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:00.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:12:59 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/644489720' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:13:00.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:00.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2017934214' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:13:00.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:00.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:00.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:00.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:13:00.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:00.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:13:00.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:13:00.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:00 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:00.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:00.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2017934214' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:13:00.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:00.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:00.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:00.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:13:00.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:00.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:13:00.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:13:00.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:00 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:01.918 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:01 smithi089 ceph-mon[109939]: Reconfiguring mon.smithi089 (monmap changed)... 2024-09-13T22:13:01.918 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:01 smithi089 ceph-mon[109939]: Reconfiguring daemon mon.smithi089 on smithi089 2024-09-13T22:13:01.918 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:01 smithi089 ceph-mon[109939]: pgmap v15: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:02.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:01 smithi159 ceph-mon[82000]: Reconfiguring mon.smithi089 (monmap changed)... 2024-09-13T22:13:02.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:01 smithi159 ceph-mon[82000]: Reconfiguring daemon mon.smithi089 on smithi089 2024-09-13T22:13:02.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:01 smithi159 ceph-mon[82000]: pgmap v15: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:03.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:02 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:03.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:02 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:03.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:02 smithi089 ceph-mon[109939]: Reconfiguring mgr.smithi089.naneiw (monmap changed)... 2024-09-13T22:13:03.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:02 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.naneiw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:13:03.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:02 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:13:03.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:02 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:03.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:02 smithi089 ceph-mon[109939]: Reconfiguring daemon mgr.smithi089.naneiw on smithi089 2024-09-13T22:13:03.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:02 smithi089 ceph-mon[109939]: pgmap v16: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:02 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:02 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:02 smithi159 ceph-mon[82000]: Reconfiguring mgr.smithi089.naneiw (monmap changed)... 2024-09-13T22:13:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:02 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.naneiw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:13:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:02 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:13:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:02 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:02 smithi159 ceph-mon[82000]: Reconfiguring daemon mgr.smithi089.naneiw on smithi089 2024-09-13T22:13:03.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:02 smithi159 ceph-mon[82000]: pgmap v16: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:04.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:04.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:04.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: Reconfiguring ceph-exporter.smithi089 (monmap changed)... 2024-09-13T22:13:04.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:13:04.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:13:04.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:13:04.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: Unable to update caps for client.ceph-exporter.smithi089 2024-09-13T22:13:04.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi089"}]: dispatch 2024-09-13T22:13:04.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:04.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:04 smithi089 ceph-mon[109939]: Reconfiguring daemon ceph-exporter.smithi089 on smithi089 2024-09-13T22:13:04.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:04.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:04.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: Reconfiguring ceph-exporter.smithi089 (monmap changed)... 2024-09-13T22:13:04.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:13:04.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:13:04.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:13:04.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: Unable to update caps for client.ceph-exporter.smithi089 2024-09-13T22:13:04.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi089"}]: dispatch 2024-09-13T22:13:04.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:04.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:04 smithi159 ceph-mon[82000]: Reconfiguring daemon ceph-exporter.smithi089 on smithi089 2024-09-13T22:13:05.901 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:05 smithi089 ceph-mon[109939]: pgmap v17: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:05.901 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:05 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:05.901 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:05 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:05.901 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:05 smithi089 ceph-mon[109939]: Reconfiguring crash.smithi089 (monmap changed)... 2024-09-13T22:13:05.901 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:05 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:13:05.902 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:05 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:05.902 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:05 smithi089 ceph-mon[109939]: Reconfiguring daemon crash.smithi089 on smithi089 2024-09-13T22:13:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:05 smithi159 ceph-mon[82000]: pgmap v17: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:05 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:05 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:05 smithi159 ceph-mon[82000]: Reconfiguring crash.smithi089 (monmap changed)... 2024-09-13T22:13:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:05 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:13:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:05 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:05 smithi159 ceph-mon[82000]: Reconfiguring daemon crash.smithi089 on smithi089 2024-09-13T22:13:07.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:07.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:07.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:06 smithi089 ceph-mon[109939]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T22:13:07.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:13:07.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:07.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:06 smithi089 ceph-mon[109939]: Reconfiguring daemon osd.0 on smithi089 2024-09-13T22:13:07.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:06 smithi089 ceph-mon[109939]: pgmap v18: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:07.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:13:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:06 smithi159 ceph-mon[82000]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T22:13:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:13:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:06 smithi159 ceph-mon[82000]: Reconfiguring daemon osd.0 on smithi089 2024-09-13T22:13:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:06 smithi159 ceph-mon[82000]: pgmap v18: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:13:08.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:08 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:08.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:08 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:08.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:08 smithi159 ceph-mon[82000]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T22:13:08.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:08 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:13:08.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:08 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:08.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:08 smithi159 ceph-mon[82000]: Reconfiguring daemon osd.1 on smithi089 2024-09-13T22:13:08.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:08 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:08 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:08 smithi089 ceph-mon[109939]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T22:13:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:08 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:13:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:08 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:08.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:08 smithi089 ceph-mon[109939]: Reconfiguring daemon osd.1 on smithi089 2024-09-13T22:13:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:09 smithi089 ceph-mon[109939]: pgmap v19: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:09 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:09 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:09 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:13:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:09 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:09 smithi159 ceph-mon[82000]: pgmap v19: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:09 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:09 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:09 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:13:09.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:09 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:10.732 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:10 smithi089 ceph-mon[109939]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T22:13:10.732 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:10 smithi089 ceph-mon[109939]: Reconfiguring daemon osd.2 on smithi089 2024-09-13T22:13:10.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:10 smithi159 ceph-mon[82000]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T22:13:10.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:10 smithi159 ceph-mon[82000]: Reconfiguring daemon osd.2 on smithi089 2024-09-13T22:13:11.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:11.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:11.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:11 smithi089 ceph-mon[109939]: Reconfiguring mds.cephfs.smithi089.euhfjz (monmap changed)... 2024-09-13T22:13:11.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.euhfjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:13:11.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:11.681 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:11 smithi089 ceph-mon[109939]: Reconfiguring daemon mds.cephfs.smithi089.euhfjz on smithi089 2024-09-13T22:13:11.681 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:11 smithi089 ceph-mon[109939]: pgmap v20: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:11.712 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:11.712 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:11.712 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:11 smithi159 ceph-mon[82000]: Reconfiguring mds.cephfs.smithi089.euhfjz (monmap changed)... 2024-09-13T22:13:11.712 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.euhfjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:13:11.712 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:11.712 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:11 smithi159 ceph-mon[82000]: Reconfiguring daemon mds.cephfs.smithi089.euhfjz on smithi089 2024-09-13T22:13:11.713 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:11 smithi159 ceph-mon[82000]: pgmap v20: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:12 smithi089 ceph-mon[109939]: Reconfiguring mds.cephfs.smithi089.egpifu (monmap changed)... 2024-09-13T22:13:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.egpifu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:13:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:12 smithi089 ceph-mon[109939]: Reconfiguring daemon mds.cephfs.smithi089.egpifu on smithi089 2024-09-13T22:13:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:12 smithi159 ceph-mon[82000]: Reconfiguring mds.cephfs.smithi089.egpifu (monmap changed)... 2024-09-13T22:13:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.egpifu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:13:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:12 smithi159 ceph-mon[82000]: Reconfiguring daemon mds.cephfs.smithi089.egpifu on smithi089 2024-09-13T22:13:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:13 smithi159 ceph-mon[82000]: pgmap v21: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:13:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:13:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:13:13.870 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi159"}]: dispatch 2024-09-13T22:13:13.871 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:13 smithi089 ceph-mon[109939]: pgmap v21: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:13:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:13:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:13:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi159"}]: dispatch 2024-09-13T22:13:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:14.993 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:14 smithi159 ceph-mon[82000]: Reconfiguring ceph-exporter.smithi159 (monmap changed)... 2024-09-13T22:13:14.993 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:14 smithi159 ceph-mon[82000]: Unable to update caps for client.ceph-exporter.smithi159 2024-09-13T22:13:14.993 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:14 smithi159 ceph-mon[82000]: Reconfiguring daemon ceph-exporter.smithi159 on smithi159 2024-09-13T22:13:14.993 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:14.993 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:14.993 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:13:14.993 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:14 smithi089 ceph-mon[109939]: Reconfiguring ceph-exporter.smithi159 (monmap changed)... 2024-09-13T22:13:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:14 smithi089 ceph-mon[109939]: Unable to update caps for client.ceph-exporter.smithi159 2024-09-13T22:13:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:14 smithi089 ceph-mon[109939]: Reconfiguring daemon ceph-exporter.smithi159 on smithi159 2024-09-13T22:13:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:13:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:15.964 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:15 smithi159 ceph-mon[82000]: pgmap v22: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:15.964 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:15 smithi159 ceph-mon[82000]: Reconfiguring crash.smithi159 (monmap changed)... 2024-09-13T22:13:15.964 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:15 smithi159 ceph-mon[82000]: Reconfiguring daemon crash.smithi159 on smithi159 2024-09-13T22:13:15.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:15 smithi089 ceph-mon[109939]: pgmap v22: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:15.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:15 smithi089 ceph-mon[109939]: Reconfiguring crash.smithi159 (monmap changed)... 2024-09-13T22:13:15.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:15 smithi089 ceph-mon[109939]: Reconfiguring daemon crash.smithi159 on smithi159 2024-09-13T22:13:17.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:17.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:17.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:17 smithi159 ceph-mon[82000]: Reconfiguring mgr.smithi159.ghpomd (monmap changed)... 2024-09-13T22:13:17.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:13:17.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:13:17.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:17.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:17 smithi159 ceph-mon[82000]: Reconfiguring daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:13:17.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:17 smithi159 ceph-mon[82000]: pgmap v23: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:17.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:17.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:17.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:17 smithi089 ceph-mon[109939]: Reconfiguring mgr.smithi159.ghpomd (monmap changed)... 2024-09-13T22:13:17.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.ghpomd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:13:17.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:13:17.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:17.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:17 smithi089 ceph-mon[109939]: Reconfiguring daemon mgr.smithi159.ghpomd on smithi159 2024-09-13T22:13:17.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:17 smithi089 ceph-mon[109939]: pgmap v23: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:18.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:18 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:18 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:18 smithi089 ceph-mon[109939]: Reconfiguring mon.smithi159 (monmap changed)... 2024-09-13T22:13:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:18 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:13:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:18 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:13:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:18 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:18.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:18 smithi089 ceph-mon[109939]: Reconfiguring daemon mon.smithi159 on smithi159 2024-09-13T22:13:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:18 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:18 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:18 smithi159 ceph-mon[82000]: Reconfiguring mon.smithi159 (monmap changed)... 2024-09-13T22:13:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:18 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:13:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:18 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:13:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:18 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:18.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:18 smithi159 ceph-mon[82000]: Reconfiguring daemon mon.smithi159 on smithi159 2024-09-13T22:13:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:19 smithi159 ceph-mon[82000]: pgmap v24: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:19 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:19 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:19 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T22:13:19.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:19 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:19.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:19 smithi089 ceph-mon[109939]: pgmap v24: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:19.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:19 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:19.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:19 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:19.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:19 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T22:13:19.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:19 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:20.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:20 smithi159 ceph-mon[82000]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T22:13:20.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:20 smithi159 ceph-mon[82000]: Reconfiguring daemon osd.3 on smithi159 2024-09-13T22:13:20.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:20.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:20.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T22:13:20.741 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:20.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:20 smithi089 ceph-mon[109939]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T22:13:20.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:20 smithi089 ceph-mon[109939]: Reconfiguring daemon osd.3 on smithi159 2024-09-13T22:13:20.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T22:13:20.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:21.586 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:21 smithi159 ceph-mon[82000]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T22:13:21.586 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:21 smithi159 ceph-mon[82000]: Reconfiguring daemon osd.4 on smithi159 2024-09-13T22:13:21.586 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:21 smithi159 ceph-mon[82000]: pgmap v25: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:21.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:21 smithi089 ceph-mon[109939]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T22:13:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:21 smithi089 ceph-mon[109939]: Reconfiguring daemon osd.4 on smithi159 2024-09-13T22:13:21.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:21 smithi089 ceph-mon[109939]: pgmap v25: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:22 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:13:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:22 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:22 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:22 smithi089 ceph-mon[109939]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T22:13:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:22 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T22:13:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:22 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:22.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:22 smithi089 ceph-mon[109939]: Reconfiguring daemon osd.5 on smithi159 2024-09-13T22:13:22.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:22 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:13:22.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:22 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:22.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:22 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:22.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:22 smithi159 ceph-mon[82000]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T22:13:22.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:22 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T22:13:22.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:22 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:22.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:22 smithi159 ceph-mon[82000]: Reconfiguring daemon osd.5 on smithi159 2024-09-13T22:13:23.671 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:23 smithi159 ceph-mon[82000]: pgmap v26: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:23.671 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:23 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:23.671 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:23 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:23.671 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:23 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.hqlvpx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:13:23.671 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:23 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:23 smithi089 ceph-mon[109939]: pgmap v26: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:23 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:23 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:23 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.hqlvpx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:13:23.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:23 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:24.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:24 smithi089 ceph-mon[109939]: Reconfiguring mds.cephfs.smithi159.hqlvpx (monmap changed)... 2024-09-13T22:13:24.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:24 smithi089 ceph-mon[109939]: Reconfiguring daemon mds.cephfs.smithi159.hqlvpx on smithi159 2024-09-13T22:13:24.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:24 smithi159 ceph-mon[82000]: Reconfiguring mds.cephfs.smithi159.hqlvpx (monmap changed)... 2024-09-13T22:13:24.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:24 smithi159 ceph-mon[82000]: Reconfiguring daemon mds.cephfs.smithi159.hqlvpx on smithi159 2024-09-13T22:13:25.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:25 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:25.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:25 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:25.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:25 smithi089 ceph-mon[109939]: Reconfiguring mds.cephfs.smithi159.rowsot (monmap changed)... 2024-09-13T22:13:25.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:25 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.rowsot", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:13:25.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:25 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:25.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:25 smithi089 ceph-mon[109939]: Reconfiguring daemon mds.cephfs.smithi159.rowsot on smithi159 2024-09-13T22:13:25.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:25 smithi089 ceph-mon[109939]: pgmap v27: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:25.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:25 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:25.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:25 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:25.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:25 smithi159 ceph-mon[82000]: Reconfiguring mds.cephfs.smithi159.rowsot (monmap changed)... 2024-09-13T22:13:25.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:25 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.rowsot", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:13:25.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:25 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:25.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:25 smithi159 ceph-mon[82000]: Reconfiguring daemon mds.cephfs.smithi159.rowsot on smithi159 2024-09-13T22:13:25.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:25 smithi159 ceph-mon[82000]: pgmap v27: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:27.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:27.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:27.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:13:27.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:27.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:27.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all mon 2024-09-13T22:13:27.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:27.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]: dispatch 2024-09-13T22:13:27.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]': finished 2024-09-13T22:13:27.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]: dispatch 2024-09-13T22:13:27.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]': finished 2024-09-13T22:13:27.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:26 smithi089 ceph-mon[109939]: pgmap v28: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:13:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:27.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all mon 2024-09-13T22:13:27.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:27.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]: dispatch 2024-09-13T22:13:27.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]': finished 2024-09-13T22:13:27.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]: dispatch 2024-09-13T22:13:27.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]': finished 2024-09-13T22:13:27.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:26 smithi159 ceph-mon[82000]: pgmap v28: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:28.568 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:28 smithi089 ceph-mon[109939]: Upgrade: Updating crash.smithi089 (1/2) 2024-09-13T22:13:28.568 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:28 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:28.568 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:28 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:13:28.569 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:28 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:28.569 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:28 smithi089 ceph-mon[109939]: Deploying daemon crash.smithi089 on smithi089 2024-09-13T22:13:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:28 smithi159 ceph-mon[82000]: Upgrade: Updating crash.smithi089 (1/2) 2024-09-13T22:13:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:28 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:28 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:13:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:28 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:28.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:28 smithi159 ceph-mon[82000]: Deploying daemon crash.smithi089 on smithi089 2024-09-13T22:13:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:29 smithi089 ceph-mon[109939]: pgmap v29: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:29.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:29 smithi159 ceph-mon[82000]: pgmap v29: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:30.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.001+0000 7fcb6c63b640 1 -- 172.21.15.89:0/974118559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640fe8a0 msgr2=0x7fcb640fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.001+0000 7fcb6c63b640 1 --2- 172.21.15.89:0/974118559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640fe8a0 0x7fcb640fec80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009880 tx=0x7fcb6002a490 comp rx=0 tx=0).stop 2024-09-13T22:13:30.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.001+0000 7fcb6c63b640 1 -- 172.21.15.89:0/974118559 shutdown_connections 2024-09-13T22:13:30.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.001+0000 7fcb6c63b640 1 --2- 172.21.15.89:0/974118559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb640ff250 0x7fcb6410bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.001+0000 7fcb6c63b640 1 --2- 172.21.15.89:0/974118559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640fe8a0 0x7fcb640fec80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.001+0000 7fcb6c63b640 1 -- 172.21.15.89:0/974118559 >> 172.21.15.89:0/974118559 conn(0x7fcb640758a0 msgr2=0x7fcb640fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:30.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.001+0000 7fcb6c63b640 1 -- 172.21.15.89:0/974118559 shutdown_connections 2024-09-13T22:13:30.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.001+0000 7fcb6c63b640 1 -- 172.21.15.89:0/974118559 wait complete. 2024-09-13T22:13:30.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.002+0000 7fcb6c63b640 1 Processor -- start 2024-09-13T22:13:30.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.002+0000 7fcb6c63b640 1 -- start start 2024-09-13T22:13:30.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.002+0000 7fcb6c63b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb640fe8a0 0x7fcb64197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.002+0000 7fcb6c63b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640ff250 0x7fcb64198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.002+0000 7fcb6c63b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641988e0 con 0x7fcb640ff250 2024-09-13T22:13:30.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.002+0000 7fcb6c63b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6419b550 con 0x7fcb640fe8a0 2024-09-13T22:13:30.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.002+0000 7fcb69bd6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640ff250 0x7fcb64198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.002+0000 7fcb69bd6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640ff250 0x7fcb64198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40760/0 (socket says 172.21.15.89:40760) 2024-09-13T22:13:30.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.002+0000 7fcb69bd6640 1 -- 172.21.15.89:0/2711586371 learned_addr learned my addr 172.21.15.89:0/2711586371 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:13:30.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb6a3d7640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb640fe8a0 0x7fcb64197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb69bd6640 1 -- 172.21.15.89:0/2711586371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb640fe8a0 msgr2=0x7fcb64197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb69bd6640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb640fe8a0 0x7fcb64197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb69bd6640 1 -- 172.21.15.89:0/2711586371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb60009560 con 0x7fcb640ff250 2024-09-13T22:13:30.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb6a3d7640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb640fe8a0 0x7fcb64197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:13:30.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb69bd6640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640ff250 0x7fcb64198200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400d8d0 tx=0x7fcb5400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:30.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb5b7fe640 1 -- 172.21.15.89:0/2711586371 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5400bea0 con 0x7fcb640ff250 2024-09-13T22:13:30.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6419b830 con 0x7fcb640ff250 2024-09-13T22:13:30.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb5b7fe640 1 -- 172.21.15.89:0/2711586371 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb54009c00 con 0x7fcb640ff250 2024-09-13T22:13:30.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb5b7fe640 1 -- 172.21.15.89:0/2711586371 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5400f710 con 0x7fcb640ff250 2024-09-13T22:13:30.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.003+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6419bd80 con 0x7fcb640ff250 2024-09-13T22:13:30.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.004+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb640684b0 con 0x7fcb640ff250 2024-09-13T22:13:30.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.005+0000 7fcb5b7fe640 1 -- 172.21.15.89:0/2711586371 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fcb5400f990 con 0x7fcb640ff250 2024-09-13T22:13:30.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.005+0000 7fcb5b7fe640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fcb5006e730 0x7fcb50070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.005+0000 7fcb5b7fe640 1 -- 172.21.15.89:0/2711586371 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcb5408e6d0 con 0x7fcb640ff250 2024-09-13T22:13:30.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.005+0000 7fcb6a3d7640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fcb5006e730 0x7fcb50070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.006+0000 7fcb6a3d7640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fcb5006e730 0x7fcb50070bf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcb60006010 tx=0x7fcb60005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:30.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.011+0000 7fcb5b7fe640 1 -- 172.21.15.89:0/2711586371 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcb54057600 con 0x7fcb640ff250 2024-09-13T22:13:30.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.213+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb640008d0 con 0x7fcb5006e730 2024-09-13T22:13:30.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.215+0000 7fcb5b7fe640 1 -- 172.21.15.89:0/2711586371 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fcb640008d0 con 0x7fcb5006e730 2024-09-13T22:13:30.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fcb5006e730 msgr2=0x7fcb50070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fcb5006e730 0x7fcb50070bf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcb60006010 tx=0x7fcb60005e60 comp rx=0 tx=0).stop 2024-09-13T22:13:30.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640ff250 msgr2=0x7fcb64198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640ff250 0x7fcb64198200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400d8d0 tx=0x7fcb5400dd90 comp rx=0 tx=0).stop 2024-09-13T22:13:30.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 shutdown_connections 2024-09-13T22:13:30.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fcb5006e730 0x7fcb50070bf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640ff250 0x7fcb64198200 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 --2- 172.21.15.89:0/2711586371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb640fe8a0 0x7fcb64197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 >> 172.21.15.89:0/2711586371 conn(0x7fcb640758a0 msgr2=0x7fcb640fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 shutdown_connections 2024-09-13T22:13:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.217+0000 7fcb6c63b640 1 -- 172.21.15.89:0/2711586371 wait complete. 2024-09-13T22:13:30.229 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:13:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.308+0000 7f299527e640 1 -- 172.21.15.89:0/1863366429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29900ffb30 msgr2=0x7f29900fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.308+0000 7f299527e640 1 --2- 172.21.15.89:0/1863366429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29900ffb30 0x7f29900fff90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2978009880 tx=0x7f297802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.308+0000 7f299527e640 1 -- 172.21.15.89:0/1863366429 shutdown_connections 2024-09-13T22:13:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.308+0000 7f299527e640 1 --2- 172.21.15.89:0/1863366429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29900ffb30 0x7f29900fff90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.308+0000 7f299527e640 1 --2- 172.21.15.89:0/1863366429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2990105be0 0x7f2990105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.308+0000 7f299527e640 1 -- 172.21.15.89:0/1863366429 >> 172.21.15.89:0/1863366429 conn(0x7f29900fb810 msgr2=0x7f29900fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.308+0000 7f299527e640 1 -- 172.21.15.89:0/1863366429 shutdown_connections 2024-09-13T22:13:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.308+0000 7f299527e640 1 -- 172.21.15.89:0/1863366429 wait complete. 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f299527e640 1 Processor -- start 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f299527e640 1 -- start start 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f299527e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29900ffb30 0x7f299019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f299527e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2990105be0 0x7f299019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f299527e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299019c260 con 0x7f2990105be0 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f299527e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2990195880 con 0x7f29900ffb30 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f2987fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2990105be0 0x7f299019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f298effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29900ffb30 0x7f299019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f298effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29900ffb30 0x7f299019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.89:53826/0 (socket says 172.21.15.89:53826) 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f2987fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2990105be0 0x7f299019bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40772/0 (socket says 172.21.15.89:40772) 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.309+0000 7f298effd640 1 -- 172.21.15.89:0/1471321671 learned_addr learned my addr 172.21.15.89:0/1471321671 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.310+0000 7f298effd640 1 -- 172.21.15.89:0/1471321671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2990105be0 msgr2=0x7f299019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.310+0000 7f298effd640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2990105be0 0x7f299019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.310+0000 7f298effd640 1 -- 172.21.15.89:0/1471321671 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978009560 con 0x7f29900ffb30 2024-09-13T22:13:30.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.310+0000 7f298effd640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29900ffb30 0x7f299019b790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f298000c8a0 tx=0x7f298000cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:30.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.310+0000 7f298cff9640 1 -- 172.21.15.89:0/1471321671 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2980007b80 con 0x7f29900ffb30 2024-09-13T22:13:30.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.310+0000 7f298cff9640 1 -- 172.21.15.89:0/1471321671 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2980007ce0 con 0x7f29900ffb30 2024-09-13T22:13:30.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.310+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2990195b00 con 0x7f29900ffb30 2024-09-13T22:13:30.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.310+0000 7f298cff9640 1 -- 172.21.15.89:0/1471321671 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2980018810 con 0x7f29900ffb30 2024-09-13T22:13:30.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.311+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29901960a0 con 0x7f29900ffb30 2024-09-13T22:13:30.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.312+0000 7f298cff9640 1 -- 172.21.15.89:0/1471321671 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f2980018a80 con 0x7f29900ffb30 2024-09-13T22:13:30.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.312+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29901011e0 con 0x7f29900ffb30 2024-09-13T22:13:30.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.312+0000 7f298cff9640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f297006e730 0x7f2970070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.312+0000 7f298cff9640 1 -- 172.21.15.89:0/1471321671 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f298008e560 con 0x7f29900ffb30 2024-09-13T22:13:30.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.312+0000 7f2987fff640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f297006e730 0x7f2970070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.313+0000 7f2987fff640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f297006e730 0x7f2970070bf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2978009230 tx=0x7f29780058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:30.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.318+0000 7f298cff9640 1 -- 172.21.15.89:0/1471321671 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2980057510 con 0x7f29900ffb30 2024-09-13T22:13:30.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.508+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2990108070 con 0x7f297006e730 2024-09-13T22:13:30.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.509+0000 7f298cff9640 1 -- 172.21.15.89:0/1471321671 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f2990108070 con 0x7f297006e730 2024-09-13T22:13:30.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f297006e730 msgr2=0x7f2970070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f297006e730 0x7f2970070bf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2978009230 tx=0x7f29780058d0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29900ffb30 msgr2=0x7f299019b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29900ffb30 0x7f299019b790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f298000c8a0 tx=0x7f298000cd60 comp rx=0 tx=0).stop 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 shutdown_connections 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f297006e730 0x7f2970070bf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2990105be0 0x7f299019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 --2- 172.21.15.89:0/1471321671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29900ffb30 0x7f299019b790 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 >> 172.21.15.89:0/1471321671 conn(0x7f29900fb810 msgr2=0x7f29900fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 shutdown_connections 2024-09-13T22:13:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.511+0000 7f299527e640 1 -- 172.21.15.89:0/1471321671 wait complete. 2024-09-13T22:13:30.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.595+0000 7f37abad2640 1 -- 172.21.15.89:0/2191551409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a41049f0 msgr2=0x7f37a4104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.595+0000 7f37abad2640 1 --2- 172.21.15.89:0/2191551409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a41049f0 0x7f37a4104dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009880 tx=0x7f37a002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.595+0000 7f37abad2640 1 -- 172.21.15.89:0/2191551409 shutdown_connections 2024-09-13T22:13:30.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.595+0000 7f37abad2640 1 --2- 172.21.15.89:0/2191551409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a40fe9f0 0x7f37a40fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.595+0000 7f37abad2640 1 --2- 172.21.15.89:0/2191551409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a41049f0 0x7f37a4104dd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.595+0000 7f37abad2640 1 -- 172.21.15.89:0/2191551409 >> 172.21.15.89:0/2191551409 conn(0x7f37a40758a0 msgr2=0x7f37a40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.595+0000 7f37abad2640 1 -- 172.21.15.89:0/2191551409 shutdown_connections 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.595+0000 7f37abad2640 1 -- 172.21.15.89:0/2191551409 wait complete. 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37abad2640 1 Processor -- start 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37abad2640 1 -- start start 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37abad2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a40fe9f0 0x7f37a4194770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37abad2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a41049f0 0x7f37a4194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37abad2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a41951f0 con 0x7f37a40fe9f0 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37abad2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4195360 con 0x7f37a41049f0 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37a986e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a40fe9f0 0x7f37a4194770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37a986e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a40fe9f0 0x7f37a4194770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40790/0 (socket says 172.21.15.89:40790) 2024-09-13T22:13:30.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37a986e640 1 -- 172.21.15.89:0/413960761 learned_addr learned my addr 172.21.15.89:0/413960761 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.596+0000 7f37a906d640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a41049f0 0x7f37a4194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.597+0000 7f37a986e640 1 -- 172.21.15.89:0/413960761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a41049f0 msgr2=0x7f37a4194cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.597+0000 7f37a986e640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a41049f0 0x7f37a4194cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.597+0000 7f37a986e640 1 -- 172.21.15.89:0/413960761 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a0009560 con 0x7f37a40fe9f0 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.597+0000 7f37a986e640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a40fe9f0 0x7f37a4194770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006010 tx=0x7f37a00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.597+0000 7f379affd640 1 -- 172.21.15.89:0/413960761 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37a0004aa0 con 0x7f37a40fe9f0 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.597+0000 7f379affd640 1 -- 172.21.15.89:0/413960761 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37a0031470 con 0x7f37a40fe9f0 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.597+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a41955e0 con 0x7f37a40fe9f0 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.597+0000 7f379affd640 1 -- 172.21.15.89:0/413960761 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37a0003940 con 0x7f37a40fe9f0 2024-09-13T22:13:30.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.597+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a41a2000 con 0x7f37a40fe9f0 2024-09-13T22:13:30.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.598+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a4100130 con 0x7f37a40fe9f0 2024-09-13T22:13:30.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.599+0000 7f379affd640 1 -- 172.21.15.89:0/413960761 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f37a0031b90 con 0x7f37a40fe9f0 2024-09-13T22:13:30.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.599+0000 7f379affd640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f379006e720 0x7f3790070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.599+0000 7f379affd640 1 -- 172.21.15.89:0/413960761 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f37a00af770 con 0x7f37a40fe9f0 2024-09-13T22:13:30.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.599+0000 7f37a906d640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f379006e720 0x7f3790070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.600+0000 7f37a906d640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f379006e720 0x7f3790070be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37a4068520 tx=0x7f379400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:30.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.604+0000 7f379affd640 1 -- 172.21.15.89:0/413960761 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f37a00787d0 con 0x7f37a40fe9f0 2024-09-13T22:13:30.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.786+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f37a41955e0 con 0x7f379006e720 2024-09-13T22:13:30.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.797+0000 7f379affd640 1 -- 172.21.15.89:0/413960761 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f37a41955e0 con 0x7f379006e720 2024-09-13T22:13:30.800 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:13:30.800 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (2m) 48s ago 12m 16.1M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:13:30.800 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (12m) 48s ago 12m 7994k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:13:30.800 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (11m) 34s ago 11m 8124k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:13:30.800 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (12m) 48s ago 12m 6891k - 18.2.4-845-ge4e227b3 67ddd33fa72f d60019874236 2024-09-13T22:13:30.800 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (11m) 34s ago 11m 6903k - 18.2.4-845-ge4e227b3 67ddd33fa72f a040d47d7ea5 2024-09-13T22:13:30.800 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (113s) 48s ago 12m 76.5M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:13:30.800 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (7m) 48s ago 7m 17.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:13:30.800 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (7m) 48s ago 7m 15.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (7m) 34s ago 7m 161M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (7m) 34s ago 7m 17.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (3m) 48s ago 13m 472M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (3m) 34s ago 11m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (60s) 48s ago 14m 28.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (39s) 34s ago 11m 21.9M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (2m) 48s ago 12m 15.7M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (2m) 34s ago 11m 15.9M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (10m) 48s ago 10m 244M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 716f801bed39 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (10m) 48s ago 10m 259M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (9m) 48s ago 9m 222M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (9m) 34s ago 9m 285M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (9m) 34s ago 9m 249M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:13:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (8m) 34s ago 8m 254M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:13:30.802 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (2m) 48s ago 12m 54.2M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:13:30.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f379006e720 msgr2=0x7f3790070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f379006e720 0x7f3790070be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37a4068520 tx=0x7f379400b390 comp rx=0 tx=0).stop 2024-09-13T22:13:30.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a40fe9f0 msgr2=0x7f37a4194770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a40fe9f0 0x7f37a4194770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006010 tx=0x7f37a00055a0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 shutdown_connections 2024-09-13T22:13:30.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f379006e720 0x7f3790070be0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a41049f0 0x7f37a4194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 --2- 172.21.15.89:0/413960761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a40fe9f0 0x7f37a4194770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 >> 172.21.15.89:0/413960761 conn(0x7f37a40758a0 msgr2=0x7f37a40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:30.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 shutdown_connections 2024-09-13T22:13:30.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.800+0000 7f37abad2640 1 -- 172.21.15.89:0/413960761 wait complete. 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.881+0000 7fa0cb150640 1 -- 172.21.15.89:0/3291976578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 msgr2=0x7fa0c41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.881+0000 7fa0cb150640 1 --2- 172.21.15.89:0/3291976578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 0x7fa0c41047a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009880 tx=0x7fa0b402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.881+0000 7fa0cb150640 1 -- 172.21.15.89:0/3291976578 shutdown_connections 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.881+0000 7fa0cb150640 1 --2- 172.21.15.89:0/3291976578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 0x7fa0c41047a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.881+0000 7fa0cb150640 1 --2- 172.21.15.89:0/3291976578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c40ffda0 0x7fa0c4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.881+0000 7fa0cb150640 1 -- 172.21.15.89:0/3291976578 >> 172.21.15.89:0/3291976578 conn(0x7fa0c40fb840 msgr2=0x7fa0c40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.881+0000 7fa0cb150640 1 -- 172.21.15.89:0/3291976578 shutdown_connections 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.881+0000 7fa0cb150640 1 -- 172.21.15.89:0/3291976578 wait complete. 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0cb150640 1 Processor -- start 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0cb150640 1 -- start start 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0cb150640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c40ffda0 0x7fa0c419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0cb150640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 0x7fa0c419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0cb150640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4195930 con 0x7fa0c4100750 2024-09-13T22:13:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0cb150640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4195a70 con 0x7fa0c40ffda0 2024-09-13T22:13:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0bbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 0x7fa0c419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0bbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 0x7fa0c419be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40818/0 (socket says 172.21.15.89:40818) 2024-09-13T22:13:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0bbfff640 1 -- 172.21.15.89:0/3460405690 learned_addr learned my addr 172.21.15.89:0/3460405690 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:13:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.882+0000 7fa0c8eec640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c40ffda0 0x7fa0c419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.883+0000 7fa0bbfff640 1 -- 172.21.15.89:0/3460405690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c40ffda0 msgr2=0x7fa0c419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.883+0000 7fa0bbfff640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c40ffda0 0x7fa0c419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:30.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.883+0000 7fa0bbfff640 1 -- 172.21.15.89:0/3460405690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4009560 con 0x7fa0c4100750 2024-09-13T22:13:30.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.883+0000 7fa0bbfff640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 0x7fa0c419be10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4006010 tx=0x7fa0b40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:30.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.883+0000 7fa0b9ffb640 1 -- 172.21.15.89:0/3460405690 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b40048d0 con 0x7fa0c4100750 2024-09-13T22:13:30.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.883+0000 7fa0b9ffb640 1 -- 172.21.15.89:0/3460405690 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0b4031640 con 0x7fa0c4100750 2024-09-13T22:13:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.883+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c4195cf0 con 0x7fa0c4100750 2024-09-13T22:13:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.883+0000 7fa0b9ffb640 1 -- 172.21.15.89:0/3460405690 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b4003820 con 0x7fa0c4100750 2024-09-13T22:13:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.883+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c41961e0 con 0x7fa0c4100750 2024-09-13T22:13:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.884+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c4101280 con 0x7fa0c4100750 2024-09-13T22:13:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.885+0000 7fa0b9ffb640 1 -- 172.21.15.89:0/3460405690 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa0b40317b0 con 0x7fa0c4100750 2024-09-13T22:13:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.885+0000 7fa0b9ffb640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa0ac06e720 0x7fa0ac070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.885+0000 7fa0b9ffb640 1 -- 172.21.15.89:0/3460405690 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa0b40af850 con 0x7fa0c4100750 2024-09-13T22:13:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.885+0000 7fa0c8eec640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa0ac06e720 0x7fa0ac070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.886+0000 7fa0c8eec640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa0ac06e720 0x7fa0ac070be0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009bd0 tx=0x7fa0c0005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:30.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:30.889+0000 7fa0b9ffb640 1 -- 172.21.15.89:0/3460405690 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa0b4078830 con 0x7fa0c4100750 2024-09-13T22:13:31.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.118+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0c4196e90 con 0x7fa0c4100750 2024-09-13T22:13:31.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.119+0000 7fa0b9ffb640 1 -- 172.21.15.89:0/3460405690 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fa0b407bef0 con 0x7fa0c4100750 2024-09-13T22:13:31.121 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:13:31.121 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:13:31.121 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 10, 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T22:13:31.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:13:31.123 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:13:31.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa0ac06e720 msgr2=0x7fa0ac070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa0ac06e720 0x7fa0ac070be0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009bd0 tx=0x7fa0c0005f90 comp rx=0 tx=0).stop 2024-09-13T22:13:31.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 msgr2=0x7fa0c419be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 0x7fa0c419be10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4006010 tx=0x7fa0b40055a0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 shutdown_connections 2024-09-13T22:13:31.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa0ac06e720 0x7fa0ac070be0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c4100750 0x7fa0c419be10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 --2- 172.21.15.89:0/3460405690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c40ffda0 0x7fa0c419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 >> 172.21.15.89:0/3460405690 conn(0x7fa0c40fb840 msgr2=0x7fa0c40fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:31.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 shutdown_connections 2024-09-13T22:13:31.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.121+0000 7fa0cb150640 1 -- 172.21.15.89:0/3460405690 wait complete. 2024-09-13T22:13:31.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.202+0000 7f71bde41640 1 -- 172.21.15.89:0/3061439424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b81049f0 msgr2=0x7f71b8104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.202+0000 7f71bde41640 1 --2- 172.21.15.89:0/3061439424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b81049f0 0x7f71b8104dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009880 tx=0x7f71ac02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.202+0000 7f71bde41640 1 -- 172.21.15.89:0/3061439424 shutdown_connections 2024-09-13T22:13:31.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.202+0000 7f71bde41640 1 --2- 172.21.15.89:0/3061439424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71b80fe9f0 0x7f71b80fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.202+0000 7f71bde41640 1 --2- 172.21.15.89:0/3061439424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b81049f0 0x7f71b8104dd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.202+0000 7f71bde41640 1 -- 172.21.15.89:0/3061439424 >> 172.21.15.89:0/3061439424 conn(0x7f71b80758a0 msgr2=0x7f71b80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:31.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.202+0000 7f71bde41640 1 -- 172.21.15.89:0/3061439424 shutdown_connections 2024-09-13T22:13:31.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.202+0000 7f71bde41640 1 -- 172.21.15.89:0/3061439424 wait complete. 2024-09-13T22:13:31.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.202+0000 7f71bde41640 1 Processor -- start 2024-09-13T22:13:31.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71bde41640 1 -- start start 2024-09-13T22:13:31.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71bde41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b80fe9f0 0x7f71b8105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:31.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71bde41640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71b81049f0 0x7f71b8105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:31.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71bde41640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81063a0 con 0x7f71b80fe9f0 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71bde41640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81064e0 con 0x7f71b81049f0 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b80fe9f0 0x7f71b8105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b80fe9f0 0x7f71b8105920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40838/0 (socket says 172.21.15.89:40838) 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b77fe640 1 -- 172.21.15.89:0/499459967 learned_addr learned my addr 172.21.15.89:0/499459967 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b6ffd640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71b81049f0 0x7f71b8105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b77fe640 1 -- 172.21.15.89:0/499459967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71b81049f0 msgr2=0x7f71b8105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b77fe640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71b81049f0 0x7f71b8105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b77fe640 1 -- 172.21.15.89:0/499459967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac009560 con 0x7f71b80fe9f0 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b6ffd640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71b81049f0 0x7f71b8105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b77fe640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b80fe9f0 0x7f71b8105920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71ac006010 tx=0x7f71ac0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.203+0000 7f71b4ff9640 1 -- 172.21.15.89:0/499459967 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71ac004aa0 con 0x7f71b80fe9f0 2024-09-13T22:13:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.204+0000 7f71b4ff9640 1 -- 172.21.15.89:0/499459967 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71ac004c00 con 0x7f71b80fe9f0 2024-09-13T22:13:31.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.204+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b8106760 con 0x7f71b80fe9f0 2024-09-13T22:13:31.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.204+0000 7f71b4ff9640 1 -- 172.21.15.89:0/499459967 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71ac003a20 con 0x7f71b80fe9f0 2024-09-13T22:13:31.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.204+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b81a1f60 con 0x7f71b80fe9f0 2024-09-13T22:13:31.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.205+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b8100130 con 0x7f71b80fe9f0 2024-09-13T22:13:31.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.205+0000 7f71b4ff9640 1 -- 172.21.15.89:0/499459967 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f71ac031c90 con 0x7f71b80fe9f0 2024-09-13T22:13:31.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.205+0000 7f71b4ff9640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f71a006e720 0x7f71a0070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:31.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.206+0000 7f71b4ff9640 1 -- 172.21.15.89:0/499459967 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f71ac0afa60 con 0x7f71b80fe9f0 2024-09-13T22:13:31.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.206+0000 7f71b6ffd640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f71a006e720 0x7f71a0070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:31.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.206+0000 7f71b6ffd640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f71a006e720 0x7f71a0070be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f71b8107420 tx=0x7f71a8005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.210+0000 7f71b4ff9640 1 -- 172.21.15.89:0/499459967 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f71ac078a10 con 0x7f71b80fe9f0 2024-09-13T22:13:31.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.409+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f71b810bcb0 con 0x7f71b80fe9f0 2024-09-13T22:13:31.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.409+0000 7f71b4ff9640 1 -- 172.21.15.89:0/499459967 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f71ac040790 con 0x7f71b80fe9f0 2024-09-13T22:13:31.412 INFO:teuthology.orchestra.run.smithi089.stdout:e15 2024-09-13T22:13:31.412 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:13:31.412 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:13:31.412 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:13:31.412 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:13:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:13:31.412 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:13:31.412 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:13:31.412 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:13:31.413 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T22:13:31.414 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:13:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:13:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:13:31.415 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:13:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:13:31.415 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:13:31.415 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:13:31.415 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:13:31.416 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:13:31.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f71a006e720 msgr2=0x7f71a0070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f71a006e720 0x7f71a0070be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f71b8107420 tx=0x7f71a8005d30 comp rx=0 tx=0).stop 2024-09-13T22:13:31.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b80fe9f0 msgr2=0x7f71b8105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b80fe9f0 0x7f71b8105920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71ac006010 tx=0x7f71ac0055a0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 shutdown_connections 2024-09-13T22:13:31.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f71a006e720 0x7f71a0070be0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71b81049f0 0x7f71b8105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 --2- 172.21.15.89:0/499459967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71b80fe9f0 0x7f71b8105920 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 >> 172.21.15.89:0/499459967 conn(0x7f71b80758a0 msgr2=0x7f71b8067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:31.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 shutdown_connections 2024-09-13T22:13:31.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.412+0000 7f71bde41640 1 -- 172.21.15.89:0/499459967 wait complete. 2024-09-13T22:13:31.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.494+0000 7fed2f979640 1 -- 172.21.15.89:0/1081603270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed28100d90 msgr2=0x7fed28101170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.494+0000 7fed2f979640 1 --2- 172.21.15.89:0/1081603270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed28100d90 0x7fed28101170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed240098b0 tx=0x7fed2402a4d0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.494+0000 7fed2f979640 1 -- 172.21.15.89:0/1081603270 shutdown_connections 2024-09-13T22:13:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.494+0000 7fed2f979640 1 --2- 172.21.15.89:0/1081603270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed281016b0 0x7fed28109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.494+0000 7fed2f979640 1 --2- 172.21.15.89:0/1081603270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed28100d90 0x7fed28101170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.494+0000 7fed2f979640 1 -- 172.21.15.89:0/1081603270 >> 172.21.15.89:0/1081603270 conn(0x7fed280fa730 msgr2=0x7fed280fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.494+0000 7fed2f979640 1 -- 172.21.15.89:0/1081603270 shutdown_connections 2024-09-13T22:13:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.494+0000 7fed2f979640 1 -- 172.21.15.89:0/1081603270 wait complete. 2024-09-13T22:13:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2f979640 1 Processor -- start 2024-09-13T22:13:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2f979640 1 -- start start 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2f979640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed28100d90 0x7fed2819b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2f979640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed281016b0 0x7fed2819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2f979640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2819c3a0 con 0x7fed281016b0 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2f979640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28195930 con 0x7fed28100d90 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2cf14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed281016b0 0x7fed2819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2cf14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed281016b0 0x7fed2819bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40864/0 (socket says 172.21.15.89:40864) 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2cf14640 1 -- 172.21.15.89:0/1727308879 learned_addr learned my addr 172.21.15.89:0/1727308879 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2d715640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed28100d90 0x7fed2819b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2cf14640 1 -- 172.21.15.89:0/1727308879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed28100d90 msgr2=0x7fed2819b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2cf14640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed28100d90 0x7fed2819b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.495+0000 7fed2cf14640 1 -- 172.21.15.89:0/1727308879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed24009560 con 0x7fed281016b0 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.496+0000 7fed2cf14640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed281016b0 0x7fed2819bd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed1800d8d0 tx=0x7fed1800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.496+0000 7fed1e7fc640 1 -- 172.21.15.89:0/1727308879 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1800bea0 con 0x7fed281016b0 2024-09-13T22:13:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.496+0000 7fed1e7fc640 1 -- 172.21.15.89:0/1727308879 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed18009c00 con 0x7fed281016b0 2024-09-13T22:13:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.496+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed28195c10 con 0x7fed281016b0 2024-09-13T22:13:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.496+0000 7fed1e7fc640 1 -- 172.21.15.89:0/1727308879 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1800f710 con 0x7fed281016b0 2024-09-13T22:13:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.496+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed28196160 con 0x7fed281016b0 2024-09-13T22:13:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.497+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed28068c90 con 0x7fed281016b0 2024-09-13T22:13:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.497+0000 7fed1e7fc640 1 -- 172.21.15.89:0/1727308879 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fed1800f990 con 0x7fed281016b0 2024-09-13T22:13:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.498+0000 7fed1e7fc640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fed1406e730 0x7fed14070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.498+0000 7fed1e7fc640 1 -- 172.21.15.89:0/1727308879 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fed1808e620 con 0x7fed281016b0 2024-09-13T22:13:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.498+0000 7fed2d715640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fed1406e730 0x7fed14070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.498+0000 7fed2d715640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fed1406e730 0x7fed14070bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed24009880 tx=0x7fed240058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:31.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.502+0000 7fed1e7fc640 1 -- 172.21.15.89:0/1727308879 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed18057600 con 0x7fed281016b0 2024-09-13T22:13:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.686+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed2810cdb0 con 0x7fed1406e730 2024-09-13T22:13:31.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.687+0000 7fed1e7fc640 1 -- 172.21.15.89:0/1727308879 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fed2810cdb0 con 0x7fed1406e730 2024-09-13T22:13:31.689 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "4/23 daemons upgraded", 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading crash daemons", 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:13:31.690 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:13:31.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fed1406e730 msgr2=0x7fed14070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fed1406e730 0x7fed14070bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed24009880 tx=0x7fed240058d0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed281016b0 msgr2=0x7fed2819bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed281016b0 0x7fed2819bd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed1800d8d0 tx=0x7fed1800dd90 comp rx=0 tx=0).stop 2024-09-13T22:13:31.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 shutdown_connections 2024-09-13T22:13:31.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fed1406e730 0x7fed14070bf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed281016b0 0x7fed2819bd80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 --2- 172.21.15.89:0/1727308879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed28100d90 0x7fed2819b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 >> 172.21.15.89:0/1727308879 conn(0x7fed280fa730 msgr2=0x7fed28102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 shutdown_connections 2024-09-13T22:13:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.690+0000 7fed2f979640 1 -- 172.21.15.89:0/1727308879 wait complete. 2024-09-13T22:13:31.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.770+0000 7f4c0991e640 1 -- 172.21.15.89:0/2267533215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 msgr2=0x7f4c04100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.770+0000 7f4c0991e640 1 --2- 172.21.15.89:0/2267533215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 0x7f4c04100180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009880 tx=0x7f4bf402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.770+0000 7f4c0991e640 1 -- 172.21.15.89:0/2267533215 shutdown_connections 2024-09-13T22:13:31.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.770+0000 7f4c0991e640 1 --2- 172.21.15.89:0/2267533215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c04100750 0x7f4c041047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.770+0000 7f4c0991e640 1 --2- 172.21.15.89:0/2267533215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 0x7f4c04100180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.770+0000 7f4c0991e640 1 -- 172.21.15.89:0/2267533215 >> 172.21.15.89:0/2267533215 conn(0x7f4c040fb840 msgr2=0x7f4c040fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.770+0000 7f4c0991e640 1 -- 172.21.15.89:0/2267533215 shutdown_connections 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.770+0000 7f4c0991e640 1 -- 172.21.15.89:0/2267533215 wait complete. 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.770+0000 7f4c0991e640 1 Processor -- start 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c0991e640 1 -- start start 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c0991e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 0x7f4c0419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c0991e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c04100750 0x7f4c0419bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c0991e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04195a10 con 0x7f4c040ffda0 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c0991e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04195b50 con 0x7f4c04100750 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c02ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 0x7f4c0419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c02ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 0x7f4c0419b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40874/0 (socket says 172.21.15.89:40874) 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c02ffd640 1 -- 172.21.15.89:0/4223055996 learned_addr learned my addr 172.21.15.89:0/4223055996 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c027fc640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c04100750 0x7f4c0419bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:31.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c02ffd640 1 -- 172.21.15.89:0/4223055996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c04100750 msgr2=0x7f4c0419bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:31.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c02ffd640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c04100750 0x7f4c0419bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:31.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c02ffd640 1 -- 172.21.15.89:0/4223055996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf4009560 con 0x7f4c040ffda0 2024-09-13T22:13:31.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.771+0000 7f4c02ffd640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 0x7f4c0419b9b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bf402a9c0 tx=0x7f4bf40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:31.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.772+0000 7f4c0891c640 1 -- 172.21.15.89:0/4223055996 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf40048d0 con 0x7f4c040ffda0 2024-09-13T22:13:31.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.772+0000 7f4c0891c640 1 -- 172.21.15.89:0/4223055996 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bf4031640 con 0x7f4c040ffda0 2024-09-13T22:13:31.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.772+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c04195dd0 con 0x7f4c040ffda0 2024-09-13T22:13:31.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.772+0000 7f4c0891c640 1 -- 172.21.15.89:0/4223055996 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf40038d0 con 0x7f4c040ffda0 2024-09-13T22:13:31.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.772+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c041962c0 con 0x7f4c040ffda0 2024-09-13T22:13:31.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.773+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c04101280 con 0x7f4c040ffda0 2024-09-13T22:13:31.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.773+0000 7f4c0891c640 1 -- 172.21.15.89:0/4223055996 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f4bf4004a30 con 0x7f4c040ffda0 2024-09-13T22:13:31.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.774+0000 7f4c0891c640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4bec06e730 0x7f4bec070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:13:31.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.774+0000 7f4c0891c640 1 -- 172.21.15.89:0/4223055996 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4bf40af7e0 con 0x7f4c040ffda0 2024-09-13T22:13:31.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.774+0000 7f4c027fc640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4bec06e730 0x7f4bec070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:13:31.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.774+0000 7f4c027fc640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4bec06e730 0x7f4bec070bf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4c04197260 tx=0x7f4bf8005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:13:31.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:31.778+0000 7f4c0891c640 1 -- 172.21.15.89:0/4223055996 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4bf4078840 con 0x7f4c040ffda0 2024-09-13T22:13:31.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:31 smithi089 ceph-mon[109939]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:31 smithi089 ceph-mon[109939]: from='client.44123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:31 smithi089 ceph-mon[109939]: pgmap v30: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:31 smithi089 ceph-mon[109939]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:31 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3460405690' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:31 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/499459967' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:13:32.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.008+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4c04100180 con 0x7f4c040ffda0 2024-09-13T22:13:32.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.008+0000 7f4c0891c640 1 -- 172.21.15.89:0/4223055996 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4bf407bf00 con 0x7f4c040ffda0 2024-09-13T22:13:32.011 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:13:32.011 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:13:32.011 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:13:32.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4bec06e730 msgr2=0x7f4bec070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:32.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4bec06e730 0x7f4bec070bf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4c04197260 tx=0x7f4bf8005f90 comp rx=0 tx=0).stop 2024-09-13T22:13:32.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 msgr2=0x7f4c0419b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:13:32.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 0x7f4c0419b9b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bf402a9c0 tx=0x7f4bf40055a0 comp rx=0 tx=0).stop 2024-09-13T22:13:32.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 shutdown_connections 2024-09-13T22:13:32.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4bec06e730 0x7f4bec070bf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:32.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c04100750 0x7f4c0419bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:32.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 --2- 172.21.15.89:0/4223055996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c040ffda0 0x7f4c0419b9b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:13:32.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 >> 172.21.15.89:0/4223055996 conn(0x7f4c040fb840 msgr2=0x7f4c040fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:13:32.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 shutdown_connections 2024-09-13T22:13:32.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:13:32.010+0000 7f4c0991e640 1 -- 172.21.15.89:0/4223055996 wait complete. 2024-09-13T22:13:32.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:31 smithi159 ceph-mon[82000]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:32.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:31 smithi159 ceph-mon[82000]: from='client.44123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:32.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:31 smithi159 ceph-mon[82000]: pgmap v30: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:32.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:31 smithi159 ceph-mon[82000]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:32.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:32.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:32.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:31 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3460405690' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:32.126 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:31 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/499459967' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:13:33.220 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:32 smithi159 ceph-mon[82000]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:33.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:32 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/4223055996' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:13:33.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:32 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:33.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:32 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:13:33.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:32 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:33.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:32 smithi089 ceph-mon[109939]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:13:33.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:32 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/4223055996' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:13:33.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:32 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:33.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:32 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:13:33.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:32 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:34.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:33 smithi159 ceph-mon[82000]: Upgrade: Updating crash.smithi159 (2/2) 2024-09-13T22:13:34.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:33 smithi159 ceph-mon[82000]: Deploying daemon crash.smithi159 on smithi159 2024-09-13T22:13:34.031 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:33 smithi159 ceph-mon[82000]: pgmap v31: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:34.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:33 smithi089 ceph-mon[109939]: Upgrade: Updating crash.smithi159 (2/2) 2024-09-13T22:13:34.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:33 smithi089 ceph-mon[109939]: Deploying daemon crash.smithi159 on smithi159 2024-09-13T22:13:34.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:33 smithi089 ceph-mon[109939]: pgmap v31: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:35 smithi159 ceph-mon[82000]: pgmap v32: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:35 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:36.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:35 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:36.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:35 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:13:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:35 smithi089 ceph-mon[109939]: pgmap v32: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:35 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:35 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:35 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:13:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:13:37.100 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:13:37.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:37 smithi089 ceph-mon[109939]: pgmap v33: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:38.049 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:37 smithi159 ceph-mon[82000]: pgmap v33: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:39.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:39 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:39.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:39 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:39.845 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:39 smithi159 ceph-mon[82000]: pgmap v34: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:39.846 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:39 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:39.846 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:39 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:39.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:39 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:39.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:39 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:39.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:39 smithi089 ceph-mon[109939]: pgmap v34: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:39.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:39 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:39.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:39 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:41.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:41 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:41.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:41 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:41.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:41 smithi089 ceph-mon[109939]: pgmap v35: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:41.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:41 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:41.861 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:41 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:41.906 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:41 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:41.906 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:41 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:41.906 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:41 smithi159 ceph-mon[82000]: pgmap v35: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:41.906 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:41 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:41.906 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:41 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:43 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:43 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:43.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:43 smithi159 ceph-mon[82000]: pgmap v36: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:43.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:43 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:43.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:43 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:43.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:43 smithi089 ceph-mon[109939]: pgmap v36: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:45.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:45.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all crash 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]: dispatch 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]': finished 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]: dispatch 2024-09-13T22:13:45.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]': finished 2024-09-13T22:13:45.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T22:13:45.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T22:13:45.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: Upgrade: osd.0 is safe to restart 2024-09-13T22:13:45.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:45 smithi089 ceph-mon[109939]: pgmap v37: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:45.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all crash 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]: dispatch 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]': finished 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]: dispatch 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]': finished 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T22:13:45.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T22:13:45.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: Upgrade: osd.0 is safe to restart 2024-09-13T22:13:45.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:45 smithi159 ceph-mon[82000]: pgmap v37: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:46 smithi089 ceph-mon[109939]: Upgrade: Updating osd.0 2024-09-13T22:13:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:13:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:46 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:46 smithi089 ceph-mon[109939]: Deploying daemon osd.0 on smithi089 2024-09-13T22:13:47.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:46 smithi089 ceph-mon[109939]: pgmap v38: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:46 smithi159 ceph-mon[82000]: Upgrade: Updating osd.0 2024-09-13T22:13:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:46 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:46 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:13:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:46 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:13:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:46 smithi159 ceph-mon[82000]: Deploying daemon osd.0 on smithi089 2024-09-13T22:13:47.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:46 smithi159 ceph-mon[82000]: pgmap v38: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:49.100 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:48 smithi089 systemd[1]: Stopping Ceph osd.0 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:13:49.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:49 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[46186]: 2024-09-13T22:13:49.098+0000 7f7773183640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:13:49.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:49 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[46186]: 2024-09-13T22:13:49.098+0000 7f7773183640 -1 osd.0 49 *** Got signal Terminated *** 2024-09-13T22:13:49.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:49 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[46186]: 2024-09-13T22:13:49.098+0000 7f7773183640 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:13:49.899 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:49 smithi089 ceph-mon[109939]: pgmap v39: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:49.900 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:49 smithi089 ceph-mon[109939]: osd.0 marked itself down and dead 2024-09-13T22:13:50.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:49 smithi159 ceph-mon[82000]: pgmap v39: 65 pgs: 65 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:50.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:49 smithi159 ceph-mon[82000]: osd.0 marked itself down and dead 2024-09-13T22:13:50.241 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:49 smithi089 podman[120710]: 2024-09-13 22:13:49.999216801 +0000 UTC m=+1.006586179 container died 716f801bed39a09a0635ba06f97aa555b0df7625124713fe3ff11585d96f1ef1 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T22:13:50.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:50 smithi089 podman[120710]: 2024-09-13 22:13:50.332221531 +0000 UTC m=+1.339590910 container cleanup 716f801bed39a09a0635ba06f97aa555b0df7625124713fe3ff11585d96f1ef1 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-13T22:13:50.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:50 smithi089 bash[120710]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0 2024-09-13T22:13:50.952 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:50 smithi089 podman[120724]: 2024-09-13 22:13:50.533898722 +0000 UTC m=+0.536193807 container remove 716f801bed39a09a0635ba06f97aa555b0df7625124713fe3ff11585d96f1ef1 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:13:50.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:50 smithi089 ceph-mon[109939]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:13:50.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:50 smithi089 ceph-mon[109939]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T22:13:51.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:50 smithi159 ceph-mon[82000]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:13:51.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:50 smithi159 ceph-mon[82000]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T22:13:51.246 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:50 smithi089 podman[120814]: 2024-09-13 22:13:50.85435211 +0000 UTC m=+0.016241279 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:13:51.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:50 smithi089 podman[120814]: 2024-09-13 22:13:50.959670126 +0000 UTC m=+0.121559339 container create c806daf04a85ad539fb6ab6cbcfa779582547380d4da0ed2ed685de21ae6c0fe (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:13:51.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:51 smithi089 podman[120814]: 2024-09-13 22:13:51.179354588 +0000 UTC m=+0.341243761 container init c806daf04a85ad539fb6ab6cbcfa779582547380d4da0ed2ed685de21ae6c0fe (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-13T22:13:51.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:51 smithi089 podman[120814]: 2024-09-13 22:13:51.182818215 +0000 UTC m=+0.344707387 container start c806daf04a85ad539fb6ab6cbcfa779582547380d4da0ed2ed685de21ae6c0fe (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-13T22:13:51.655 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:51 smithi089 podman[120814]: 2024-09-13 22:13:51.25387775 +0000 UTC m=+0.415766914 container attach c806daf04a85ad539fb6ab6cbcfa779582547380d4da0ed2ed685de21ae6c0fe (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be) 2024-09-13T22:13:51.655 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:51 smithi089 podman[120814]: 2024-09-13 22:13:51.372590267 +0000 UTC m=+0.534479437 container died c806daf04a85ad539fb6ab6cbcfa779582547380d4da0ed2ed685de21ae6c0fe (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T22:13:51.939 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:51 smithi089 ceph-mon[109939]: pgmap v41: 65 pgs: 9 stale+active+clean, 56 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:51.939 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:51 smithi089 ceph-mon[109939]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T22:13:51.939 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:51.939 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:13:52.012 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:51 smithi159 ceph-mon[82000]: pgmap v41: 65 pgs: 9 stale+active+clean, 56 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:13:52.013 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:51 smithi159 ceph-mon[82000]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T22:13:52.013 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:52.013 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:13:52.246 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 podman[120837]: 2024-09-13 22:13:52.108213457 +0000 UTC m=+0.730164946 container remove c806daf04a85ad539fb6ab6cbcfa779582547380d4da0ed2ed685de21ae6c0fe (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T22:13:52.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T22:13:52.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 systemd[1]: Stopped Ceph osd.0 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:13:52.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.0.service: Consumed 58.304s CPU time. 2024-09-13T22:13:52.706 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 systemd[1]: Starting Ceph osd.0 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:13:52.706 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 podman[120937]: 2024-09-13 22:13:52.455886348 +0000 UTC m=+0.016177124 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:13:52.706 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 podman[120937]: 2024-09-13 22:13:52.575907765 +0000 UTC m=+0.136198537 container create 8c18990fa1999f1979c6254b58e392856ac0f1c83cde03b01f68a328e09865c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:13:52.977 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:52 smithi089 ceph-mon[109939]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T22:13:52.978 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 podman[120937]: 2024-09-13 22:13:52.845466377 +0000 UTC m=+0.405757148 container init 8c18990fa1999f1979c6254b58e392856ac0f1c83cde03b01f68a328e09865c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:13:52.978 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 podman[120937]: 2024-09-13 22:13:52.84885175 +0000 UTC m=+0.409142519 container start 8c18990fa1999f1979c6254b58e392856ac0f1c83cde03b01f68a328e09865c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T22:13:52.978 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 podman[120937]: 2024-09-13 22:13:52.920229722 +0000 UTC m=+0.480520491 container attach 8c18990fa1999f1979c6254b58e392856ac0f1c83cde03b01f68a328e09865c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-13T22:13:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:52 smithi159 ceph-mon[82000]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T22:13:53.248 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate[120951]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:13:53.249 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 bash[120937]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:13:53.249 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate[120951]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:13:53.249 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:52 smithi089 bash[120937]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:13:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:53 smithi089 ceph-mon[109939]: pgmap v43: 65 pgs: 14 active+undersized, 1 stale+active+clean, 8 active+undersized+degraded, 42 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-09-13T22:13:53.997 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:53 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate[120951]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T22:13:53.997 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:53 smithi089 bash[120937]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T22:13:53.997 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:53 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate[120951]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T22:13:53.998 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:53 smithi089 bash[120937]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T22:13:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:53 smithi159 ceph-mon[82000]: pgmap v43: 65 pgs: 14 active+undersized, 1 stale+active+clean, 8 active+undersized+degraded, 42 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate[120951]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 bash[120937]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate[120951]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 bash[120937]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate[120951]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 bash[120937]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate[120951]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 bash[120937]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate[120951]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 bash[120937]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T22:13:54.341 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 podman[120937]: 2024-09-13 22:13:54.031954827 +0000 UTC m=+1.592245596 container died 8c18990fa1999f1979c6254b58e392856ac0f1c83cde03b01f68a328e09865c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2) 2024-09-13T22:13:54.965 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 podman[121101]: 2024-09-13 22:13:54.632629732 +0000 UTC m=+0.594442671 container remove 8c18990fa1999f1979c6254b58e392856ac0f1c83cde03b01f68a328e09865c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T22:13:54.965 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 podman[121160]: 2024-09-13 22:13:54.741008534 +0000 UTC m=+0.016318168 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:13:54.965 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:54 smithi089 podman[121160]: 2024-09-13 22:13:54.867116295 +0000 UTC m=+0.142425917 container create 6efec6931e208a8a537c3e3e1b0a64f813b3cf0a575221b0572fb459072ba5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-ecab7be, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T22:13:55.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:55 smithi089 podman[121160]: 2024-09-13 22:13:55.111058071 +0000 UTC m=+0.386367693 container init 6efec6931e208a8a537c3e3e1b0a64f813b3cf0a575221b0572fb459072ba5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD) 2024-09-13T22:13:55.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:55 smithi089 podman[121160]: 2024-09-13 22:13:55.11452055 +0000 UTC m=+0.389830180 container start 6efec6931e208a8a537c3e3e1b0a64f813b3cf0a575221b0572fb459072ba5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T22:13:55.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:55 smithi089 ceph-osd[121178]: -- 172.21.15.89:0/4077170108 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ce59bc1e0 con 0x563ce5952000 2024-09-13T22:13:55.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:55 smithi089 bash[121160]: 6efec6931e208a8a537c3e3e1b0a64f813b3cf0a575221b0572fb459072ba5eb 2024-09-13T22:13:55.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:55 smithi089 systemd[1]: Started Ceph osd.0 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:13:55.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:55 smithi089 ceph-mon[109939]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:13:55.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:55 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:55.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:55 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:55.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:55 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:13:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:55 smithi159 ceph-mon[82000]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:13:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:55 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:55 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:13:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:55 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:13:57.396 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:13:57 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[121174]: 2024-09-13T22:13:57.012+0000 7f6caeab6640 -1 Falling back to public interface 2024-09-13T22:13:57.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:57 smithi089 ceph-mon[109939]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:13:58.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:57 smithi159 ceph-mon[82000]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:13:59.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:13:59 smithi089 ceph-mon[109939]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:13:59 smithi159 ceph-mon[82000]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:01.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:01 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:01.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:01 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:01.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:01 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:01.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:01 smithi089 ceph-mon[109939]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:01.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:01 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:01.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:01 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:01.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:01 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:01.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:01 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:01.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:01 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:01.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:01 smithi159 ceph-mon[82000]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:01.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:01 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:01.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:01 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:02.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.098+0000 7f3979f60640 1 -- 172.21.15.89:0/2499555627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39740fe9f0 msgr2=0x7f39740fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.098+0000 7f3979f60640 1 --2- 172.21.15.89:0/2499555627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39740fe9f0 0x7f39740fee50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f395c009880 tx=0x7f395c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.098+0000 7f3979f60640 1 -- 172.21.15.89:0/2499555627 shutdown_connections 2024-09-13T22:14:02.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.098+0000 7f3979f60640 1 --2- 172.21.15.89:0/2499555627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39740fe9f0 0x7f39740fee50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.098+0000 7f3979f60640 1 --2- 172.21.15.89:0/2499555627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39741049f0 0x7f3974104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.098+0000 7f3979f60640 1 -- 172.21.15.89:0/2499555627 >> 172.21.15.89:0/2499555627 conn(0x7f39740758a0 msgr2=0x7f39740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:02.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.099+0000 7f3979f60640 1 -- 172.21.15.89:0/2499555627 shutdown_connections 2024-09-13T22:14:02.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.099+0000 7f3979f60640 1 -- 172.21.15.89:0/2499555627 wait complete. 2024-09-13T22:14:02.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.099+0000 7f3979f60640 1 Processor -- start 2024-09-13T22:14:02.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.099+0000 7f3979f60640 1 -- start start 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f3979f60640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39740fe9f0 0x7f3974196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f3979f60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39741049f0 0x7f3974196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f3979f60640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3974197430 con 0x7f39741049f0 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f3979f60640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39741975a0 con 0x7f39740fe9f0 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f396bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39741049f0 0x7f3974196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f396bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39741049f0 0x7f3974196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59424/0 (socket says 172.21.15.89:59424) 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f396bfff640 1 -- 172.21.15.89:0/1276692000 learned_addr learned my addr 172.21.15.89:0/1276692000 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f39737fe640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39740fe9f0 0x7f3974196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f396bfff640 1 -- 172.21.15.89:0/1276692000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39740fe9f0 msgr2=0x7f3974196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f396bfff640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39740fe9f0 0x7f3974196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f396bfff640 1 -- 172.21.15.89:0/1276692000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c009560 con 0x7f39741049f0 2024-09-13T22:14:02.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f396bfff640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39741049f0 0x7f3974196e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f395c02a9c0 tx=0x7f395c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:02.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f39717fa640 1 -- 172.21.15.89:0/1276692000 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c004aa0 con 0x7f39741049f0 2024-09-13T22:14:02.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f39717fa640 1 -- 172.21.15.89:0/1276692000 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f395c004c00 con 0x7f39741049f0 2024-09-13T22:14:02.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.100+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397419f990 con 0x7f39741049f0 2024-09-13T22:14:02.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.101+0000 7f39717fa640 1 -- 172.21.15.89:0/1276692000 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c003980 con 0x7f39741049f0 2024-09-13T22:14:02.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.101+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397419fcf0 con 0x7f39741049f0 2024-09-13T22:14:02.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.102+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3974100130 con 0x7f39741049f0 2024-09-13T22:14:02.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.102+0000 7f39717fa640 1 -- 172.21.15.89:0/1276692000 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f395c003b20 con 0x7f39741049f0 2024-09-13T22:14:02.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.102+0000 7f39717fa640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f396006e730 0x7f3960070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:02.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.103+0000 7f39717fa640 1 -- 172.21.15.89:0/1276692000 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f395c0af8e0 con 0x7f39741049f0 2024-09-13T22:14:02.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.103+0000 7f39737fe640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f396006e730 0x7f3960070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:02.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.103+0000 7f39737fe640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f396006e730 0x7f3960070bf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3964005fd0 tx=0x7f3964005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:02.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.107+0000 7f39717fa640 1 -- 172.21.15.89:0/1276692000 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f395c078890 con 0x7f39741049f0 2024-09-13T22:14:02.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.295+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f397410bc60 con 0x7f396006e730 2024-09-13T22:14:02.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.297+0000 7f39717fa640 1 -- 172.21.15.89:0/1276692000 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f397410bc60 con 0x7f396006e730 2024-09-13T22:14:02.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.299+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f396006e730 msgr2=0x7f3960070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.299+0000 7f3979f60640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f396006e730 0x7f3960070bf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3964005fd0 tx=0x7f3964005850 comp rx=0 tx=0).stop 2024-09-13T22:14:02.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.299+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39741049f0 msgr2=0x7f3974196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.299+0000 7f3979f60640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39741049f0 0x7f3974196e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f395c02a9c0 tx=0x7f395c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.299+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 shutdown_connections 2024-09-13T22:14:02.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.299+0000 7f3979f60640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f396006e730 0x7f3960070bf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.299+0000 7f3979f60640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39741049f0 0x7f3974196e60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.299+0000 7f3979f60640 1 --2- 172.21.15.89:0/1276692000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39740fe9f0 0x7f3974196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.299+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 >> 172.21.15.89:0/1276692000 conn(0x7f39740758a0 msgr2=0x7f39740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:02.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.300+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 shutdown_connections 2024-09-13T22:14:02.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.300+0000 7f3979f60640 1 -- 172.21.15.89:0/1276692000 wait complete. 2024-09-13T22:14:02.310 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:14:02.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.385+0000 7f2cfb431640 1 -- 172.21.15.89:0/1093900738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf41049f0 msgr2=0x7f2cf4104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.385+0000 7f2cfb431640 1 --2- 172.21.15.89:0/1093900738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf41049f0 0x7f2cf4104dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009880 tx=0x7f2cf002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.385+0000 7f2cfb431640 1 -- 172.21.15.89:0/1093900738 shutdown_connections 2024-09-13T22:14:02.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.386+0000 7f2cfb431640 1 --2- 172.21.15.89:0/1093900738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf40fe9f0 0x7f2cf40fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.386+0000 7f2cfb431640 1 --2- 172.21.15.89:0/1093900738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf41049f0 0x7f2cf4104dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.386+0000 7f2cfb431640 1 -- 172.21.15.89:0/1093900738 >> 172.21.15.89:0/1093900738 conn(0x7f2cf40758a0 msgr2=0x7f2cf40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:02.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.386+0000 7f2cfb431640 1 -- 172.21.15.89:0/1093900738 shutdown_connections 2024-09-13T22:14:02.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.386+0000 7f2cfb431640 1 -- 172.21.15.89:0/1093900738 wait complete. 2024-09-13T22:14:02.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.386+0000 7f2cfb431640 1 Processor -- start 2024-09-13T22:14:02.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.386+0000 7f2cfb431640 1 -- start start 2024-09-13T22:14:02.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.386+0000 7f2cfb431640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf40fe9f0 0x7f2cf419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:02.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cfb431640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf41049f0 0x7f2cf419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cfb431640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4195910 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cfb431640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4195a80 con 0x7f2cf41049f0 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cf91cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf40fe9f0 0x7f2cf419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cf91cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf40fe9f0 0x7f2cf419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59444/0 (socket says 172.21.15.89:59444) 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cf91cd640 1 -- 172.21.15.89:0/1686691060 learned_addr learned my addr 172.21.15.89:0/1686691060 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cf89cc640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf41049f0 0x7f2cf419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cf91cd640 1 -- 172.21.15.89:0/1686691060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf41049f0 msgr2=0x7f2cf419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cf91cd640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf41049f0 0x7f2cf419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cf91cd640 1 -- 172.21.15.89:0/1686691060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0009560 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cf91cd640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf40fe9f0 0x7f2cf419b820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2cf002a9c0 tx=0x7f2cf00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.387+0000 7f2cea7fc640 1 -- 172.21.15.89:0/1686691060 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf00048d0 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.388+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf4195d00 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.388+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf41961f0 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.388+0000 7f2cea7fc640 1 -- 172.21.15.89:0/1686691060 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2cf0031640 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.388+0000 7f2cea7fc640 1 -- 172.21.15.89:0/1686691060 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf00038d0 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.389+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd8005250 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.390+0000 7f2cea7fc640 1 -- 172.21.15.89:0/1686691060 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f2cf0003b40 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.390+0000 7f2cea7fc640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2ce006e730 0x7f2ce0070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.391+0000 7f2cea7fc640 1 -- 172.21.15.89:0/1686691060 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2cf00af570 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.391+0000 7f2cf89cc640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2ce006e730 0x7f2ce0070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.391+0000 7f2cf89cc640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2ce006e730 0x7f2ce0070bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4103f70 tx=0x7f2ce4005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:02.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.397+0000 7f2cea7fc640 1 -- 172.21.15.89:0/1686691060 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2cf00785d0 con 0x7f2cf40fe9f0 2024-09-13T22:14:02.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.596+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cd8000bc0 con 0x7f2ce006e730 2024-09-13T22:14:02.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.597+0000 7f2cea7fc640 1 -- 172.21.15.89:0/1686691060 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2cd8000bc0 con 0x7f2ce006e730 2024-09-13T22:14:02.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.599+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2ce006e730 msgr2=0x7f2ce0070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2ce006e730 0x7f2ce0070bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4103f70 tx=0x7f2ce4005f90 comp rx=0 tx=0).stop 2024-09-13T22:14:02.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf40fe9f0 msgr2=0x7f2cf419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf40fe9f0 0x7f2cf419b820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2cf002a9c0 tx=0x7f2cf00055a0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 shutdown_connections 2024-09-13T22:14:02.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2ce006e730 0x7f2ce0070bf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf41049f0 0x7f2cf419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 --2- 172.21.15.89:0/1686691060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cf40fe9f0 0x7f2cf419b820 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 >> 172.21.15.89:0/1686691060 conn(0x7f2cf40758a0 msgr2=0x7f2cf40fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:02.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 shutdown_connections 2024-09-13T22:14:02.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.600+0000 7f2cfb431640 1 -- 172.21.15.89:0/1686691060 wait complete. 2024-09-13T22:14:02.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.683+0000 7fda8facf640 1 -- 172.21.15.89:0/1933926765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88101630 msgr2=0x7fda88109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.683+0000 7fda8facf640 1 --2- 172.21.15.89:0/1933926765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88101630 0x7fda88109b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda780098b0 tx=0x7fda7802a560 comp rx=0 tx=0).stop 2024-09-13T22:14:02.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.683+0000 7fda8facf640 1 -- 172.21.15.89:0/1933926765 shutdown_connections 2024-09-13T22:14:02.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.684+0000 7fda8facf640 1 --2- 172.21.15.89:0/1933926765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88101630 0x7fda88109b20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.684+0000 7fda8facf640 1 --2- 172.21.15.89:0/1933926765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda88100d10 0x7fda881010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.684+0000 7fda8facf640 1 -- 172.21.15.89:0/1933926765 >> 172.21.15.89:0/1933926765 conn(0x7fda880758a0 msgr2=0x7fda880fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.684+0000 7fda8facf640 1 -- 172.21.15.89:0/1933926765 shutdown_connections 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.684+0000 7fda8facf640 1 -- 172.21.15.89:0/1933926765 wait complete. 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.685+0000 7fda8facf640 1 Processor -- start 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.685+0000 7fda8facf640 1 -- start start 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.685+0000 7fda8facf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88100d10 0x7fda8819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.685+0000 7fda8facf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda88101630 0x7fda8819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.685+0000 7fda8facf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8819c410 con 0x7fda88100d10 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.685+0000 7fda8facf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda881959a0 con 0x7fda88101630 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.685+0000 7fda8d86b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88100d10 0x7fda8819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:02.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8d86b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88100d10 0x7fda8819b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59448/0 (socket says 172.21.15.89:59448) 2024-09-13T22:14:02.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8d86b640 1 -- 172.21.15.89:0/2367831249 learned_addr learned my addr 172.21.15.89:0/2367831249 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:02.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8d06a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda88101630 0x7fda8819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:02.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8d86b640 1 -- 172.21.15.89:0/2367831249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda88101630 msgr2=0x7fda8819bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8d86b640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda88101630 0x7fda8819bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8d86b640 1 -- 172.21.15.89:0/2367831249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78009560 con 0x7fda88100d10 2024-09-13T22:14:02.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8d06a640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda88101630 0x7fda8819bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:14:02.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8d86b640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88100d10 0x7fda8819b8b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fda8400e970 tx=0x7fda8400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:02.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda7effd640 1 -- 172.21.15.89:0/2367831249 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda8400cc90 con 0x7fda88100d10 2024-09-13T22:14:02.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda88195c80 con 0x7fda88100d10 2024-09-13T22:14:02.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda7effd640 1 -- 172.21.15.89:0/2367831249 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda8400cdf0 con 0x7fda88100d10 2024-09-13T22:14:02.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.686+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda881961a0 con 0x7fda88100d10 2024-09-13T22:14:02.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.687+0000 7fda7effd640 1 -- 172.21.15.89:0/2367831249 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda84010430 con 0x7fda88100d10 2024-09-13T22:14:02.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.689+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c005250 con 0x7fda88100d10 2024-09-13T22:14:02.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.689+0000 7fda7effd640 1 -- 172.21.15.89:0/2367831249 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fda840106a0 con 0x7fda88100d10 2024-09-13T22:14:02.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.690+0000 7fda7effd640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fda7406e730 0x7fda74070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:02.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.690+0000 7fda7effd640 1 -- 172.21.15.89:0/2367831249 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fda84014070 con 0x7fda88100d10 2024-09-13T22:14:02.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.690+0000 7fda8d06a640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fda7406e730 0x7fda74070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:02.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.690+0000 7fda8d06a640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fda7406e730 0x7fda74070bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fda78009880 tx=0x7fda780058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:02.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.696+0000 7fda7effd640 1 -- 172.21.15.89:0/2367831249 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fda84058d70 con 0x7fda88100d10 2024-09-13T22:14:02.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.902+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda6c000bc0 con 0x7fda7406e730 2024-09-13T22:14:02.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.912+0000 7fda7effd640 1 -- 172.21.15.89:0/2367831249 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fda6c000bc0 con 0x7fda7406e730 2024-09-13T22:14:02.914 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:14:02.914 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (2m) 2s ago 13m 25.8M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:14:02.914 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (13m) 2s ago 13m 8102k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:14:02.914 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (12m) 24s ago 12m 8174k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:14:02.914 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (32s) 2s ago 13m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:14:02.914 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (27s) 24s ago 12m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:14:02.914 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (2m) 2s ago 12m 77.9M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (7m) 2s ago 7m 18.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (7m) 2s ago 7m 15.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (7m) 24s ago 7m 161M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (7m) 24s ago 7m 17.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (4m) 2s ago 14m 494M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (3m) 24s ago 12m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (92s) 2s ago 14m 43.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (71s) 24s ago 12m 34.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (3m) 2s ago 13m 15.2M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (3m) 24s ago 12m 15.7M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (8s) 2s ago 11m 12.1M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (10m) 2s ago 10m 259M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f f9eb5106bdf9 2024-09-13T22:14:02.915 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (10m) 2s ago 10m 222M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:14:02.916 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (10m) 24s ago 10m 286M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:14:02.916 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (9m) 24s ago 9m 250M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:14:02.916 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (9m) 24s ago 9m 255M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:14:02.916 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (3m) 2s ago 12m 61.7M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.915+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fda7406e730 msgr2=0x7fda74070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.915+0000 7fda8facf640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fda7406e730 0x7fda74070bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fda78009880 tx=0x7fda780058d0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.915+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88100d10 msgr2=0x7fda8819b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.915+0000 7fda8facf640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88100d10 0x7fda8819b8b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fda8400e970 tx=0x7fda8400ed70 comp rx=0 tx=0).stop 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.915+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 shutdown_connections 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.915+0000 7fda8facf640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fda7406e730 0x7fda74070bf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.915+0000 7fda8facf640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda88101630 0x7fda8819bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.915+0000 7fda8facf640 1 --2- 172.21.15.89:0/2367831249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda88100d10 0x7fda8819b8b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.915+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 >> 172.21.15.89:0/2367831249 conn(0x7fda880758a0 msgr2=0x7fda88101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:02.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.916+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 shutdown_connections 2024-09-13T22:14:02.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:02.916+0000 7fda8facf640 1 -- 172.21.15.89:0/2367831249 wait complete. 2024-09-13T22:14:03.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.005+0000 7eff770f4640 1 -- 172.21.15.89:0/1374089787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 msgr2=0x7eff70101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.005+0000 7eff770f4640 1 --2- 172.21.15.89:0/1374089787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 0x7eff70101090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff64009880 tx=0x7eff6402a530 comp rx=0 tx=0).stop 2024-09-13T22:14:03.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.005+0000 7eff770f4640 1 -- 172.21.15.89:0/1374089787 shutdown_connections 2024-09-13T22:14:03.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.005+0000 7eff770f4640 1 --2- 172.21.15.89:0/1374089787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff701015d0 0x7eff70109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.005+0000 7eff770f4640 1 --2- 172.21.15.89:0/1374089787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 0x7eff70101090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.005+0000 7eff770f4640 1 -- 172.21.15.89:0/1374089787 >> 172.21.15.89:0/1374089787 conn(0x7eff700758a0 msgr2=0x7eff700fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:03.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.005+0000 7eff770f4640 1 -- 172.21.15.89:0/1374089787 shutdown_connections 2024-09-13T22:14:03.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.005+0000 7eff770f4640 1 -- 172.21.15.89:0/1374089787 wait complete. 2024-09-13T22:14:03.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.006+0000 7eff770f4640 1 Processor -- start 2024-09-13T22:14:03.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.006+0000 7eff770f4640 1 -- start start 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.006+0000 7eff770f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 0x7eff7019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.006+0000 7eff770f4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff701015d0 0x7eff7019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.006+0000 7eff770f4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7019c410 con 0x7eff70100cb0 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.006+0000 7eff770f4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff701959a0 con 0x7eff701015d0 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.006+0000 7eff74e90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 0x7eff7019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.006+0000 7eff74e90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 0x7eff7019b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59454/0 (socket says 172.21.15.89:59454) 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.006+0000 7eff74e90640 1 -- 172.21.15.89:0/4169988745 learned_addr learned my addr 172.21.15.89:0/4169988745 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.007+0000 7eff6ffff640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff701015d0 0x7eff7019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.007+0000 7eff74e90640 1 -- 172.21.15.89:0/4169988745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff701015d0 msgr2=0x7eff7019bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.007+0000 7eff74e90640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff701015d0 0x7eff7019bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.007+0000 7eff74e90640 1 -- 172.21.15.89:0/4169988745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff64009560 con 0x7eff70100cb0 2024-09-13T22:14:03.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.007+0000 7eff74e90640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 0x7eff7019b8b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff64006010 tx=0x7eff640055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:03.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.007+0000 7eff6dffb640 1 -- 172.21.15.89:0/4169988745 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff64004aa0 con 0x7eff70100cb0 2024-09-13T22:14:03.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.007+0000 7eff6dffb640 1 -- 172.21.15.89:0/4169988745 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff64031470 con 0x7eff70100cb0 2024-09-13T22:14:03.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.007+0000 7eff6dffb640 1 -- 172.21.15.89:0/4169988745 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff64003940 con 0x7eff70100cb0 2024-09-13T22:14:03.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.007+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff70195c20 con 0x7eff70100cb0 2024-09-13T22:14:03.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.008+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff70196110 con 0x7eff70100cb0 2024-09-13T22:14:03.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.009+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff70068510 con 0x7eff70100cb0 2024-09-13T22:14:03.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.009+0000 7eff6dffb640 1 -- 172.21.15.89:0/4169988745 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7eff6402ad50 con 0x7eff70100cb0 2024-09-13T22:14:03.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.010+0000 7eff6dffb640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7eff6006e720 0x7eff60070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.010+0000 7eff6dffb640 1 -- 172.21.15.89:0/4169988745 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7eff640af620 con 0x7eff70100cb0 2024-09-13T22:14:03.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.010+0000 7eff6ffff640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7eff6006e720 0x7eff60070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.011+0000 7eff6ffff640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7eff6006e720 0x7eff60070be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff70196e10 tx=0x7eff5c00b360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:03.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.018+0000 7eff6dffb640 1 -- 172.21.15.89:0/4169988745 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7eff64078680 con 0x7eff70100cb0 2024-09-13T22:14:03.247 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:14:03 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[121174]: 2024-09-13T22:14:03.029+0000 7f6caeab6640 -1 osd.0 49 log_to_monitors true 2024-09-13T22:14:03.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.265+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7eff70104340 con 0x7eff70100cb0 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.266+0000 7eff6dffb640 1 -- 172.21.15.89:0/4169988745 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7eff6407bd40 con 0x7eff70100cb0 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:14:03.268 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 5 2024-09-13T22:14:03.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:14:03.269 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:14:03.269 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:14:03.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:14:03.269 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:14:03.269 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 9, 2024-09-13T22:14:03.269 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T22:14:03.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:14:03.269 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:14:03.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.268+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7eff6006e720 msgr2=0x7eff60070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.268+0000 7eff770f4640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7eff6006e720 0x7eff60070be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff70196e10 tx=0x7eff5c00b360 comp rx=0 tx=0).stop 2024-09-13T22:14:03.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.268+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 msgr2=0x7eff7019b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.268+0000 7eff770f4640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 0x7eff7019b8b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff64006010 tx=0x7eff640055a0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.268+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 shutdown_connections 2024-09-13T22:14:03.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.268+0000 7eff770f4640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7eff6006e720 0x7eff60070be0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.268+0000 7eff770f4640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff701015d0 0x7eff7019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.268+0000 7eff770f4640 1 --2- 172.21.15.89:0/4169988745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff70100cb0 0x7eff7019b8b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.268+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 >> 172.21.15.89:0/4169988745 conn(0x7eff700758a0 msgr2=0x7eff70101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:03.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.269+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 shutdown_connections 2024-09-13T22:14:03.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.269+0000 7eff770f4640 1 -- 172.21.15.89:0/4169988745 wait complete. 2024-09-13T22:14:03.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.373+0000 7f0f134ed640 1 -- 172.21.15.89:0/3724216164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c105bf0 msgr2=0x7f0f0c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.373+0000 7f0f134ed640 1 --2- 172.21.15.89:0/3724216164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c105bf0 0x7f0f0c105fd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009880 tx=0x7f0f0802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.373+0000 7f0f134ed640 1 -- 172.21.15.89:0/3724216164 shutdown_connections 2024-09-13T22:14:03.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.373+0000 7f0f134ed640 1 --2- 172.21.15.89:0/3724216164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f0c0ffb40 0x7f0f0c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.373+0000 7f0f134ed640 1 --2- 172.21.15.89:0/3724216164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c105bf0 0x7f0f0c105fd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.373+0000 7f0f134ed640 1 -- 172.21.15.89:0/3724216164 >> 172.21.15.89:0/3724216164 conn(0x7f0f0c0fb7e0 msgr2=0x7f0f0c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:03.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.373+0000 7f0f134ed640 1 -- 172.21.15.89:0/3724216164 shutdown_connections 2024-09-13T22:14:03.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.373+0000 7f0f134ed640 1 -- 172.21.15.89:0/3724216164 wait complete. 2024-09-13T22:14:03.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f134ed640 1 Processor -- start 2024-09-13T22:14:03.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f134ed640 1 -- start start 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f134ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0ffb40 0x7f0f0c19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f134ed640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f0c105bf0 0x7f0f0c19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f134ed640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c19e580 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f134ed640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c197b00 con 0x7f0f0c105bf0 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f11289640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0ffb40 0x7f0f0c19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f11289640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0ffb40 0x7f0f0c19d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57728/0 (socket says 172.21.15.89:57728) 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f11289640 1 -- 172.21.15.89:0/454218909 learned_addr learned my addr 172.21.15.89:0/454218909 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f10a88640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f0c105bf0 0x7f0f0c19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f11289640 1 -- 172.21.15.89:0/454218909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f0c105bf0 msgr2=0x7f0f0c19def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f11289640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f0c105bf0 0x7f0f0c19def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.374+0000 7f0f11289640 1 -- 172.21.15.89:0/454218909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f08009560 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.375+0000 7f0f11289640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0ffb40 0x7f0f0c19d9b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f0802a9c0 tx=0x7f0f080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:03.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.375+0000 7f0f027fc640 1 -- 172.21.15.89:0/454218909 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f08004aa0 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.375+0000 7f0f027fc640 1 -- 172.21.15.89:0/454218909 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f08004c00 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.375+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c197d80 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.375+0000 7f0f027fc640 1 -- 172.21.15.89:0/454218909 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f08003980 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.375+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c198270 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.376+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c1011f0 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.377+0000 7f0f027fc640 1 -- 172.21.15.89:0/454218909 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f0f08003b00 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.377+0000 7f0f027fc640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f0ef806e730 0x7f0ef8070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.377+0000 7f0f027fc640 1 -- 172.21.15.89:0/454218909 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0f080af860 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.377+0000 7f0f10a88640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f0ef806e730 0x7f0ef8070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.378+0000 7f0f10a88640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f0ef806e730 0x7f0ef8070bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c199240 tx=0x7f0efc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:03.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.382+0000 7f0f027fc640 1 -- 172.21.15.89:0/454218909 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0f080788c0 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.615+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0f0c199090 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.615+0000 7f0f027fc640 1 -- 172.21.15.89:0/454218909 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f0f0807bf80 con 0x7f0f0c0ffb40 2024-09-13T22:14:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:14:03.617 INFO:teuthology.orchestra.run.smithi089.stdout:e15 2024-09-13T22:14:03.617 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:14:03.617 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:14:03.617 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:14:03.618 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:14:03.618 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:14:03.618 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:14:03.618 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:14:03.618 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:14:03.618 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:14:03.618 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:14:03.618 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:14:03.618 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:14:03.619 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:14:03.620 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:14:03.621 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:14:03.621 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:14:03.621 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:14:03.621 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:14:03.621 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:14:03.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.617+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f0ef806e730 msgr2=0x7f0ef8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.617+0000 7f0f134ed640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f0ef806e730 0x7f0ef8070bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c199240 tx=0x7f0efc00b410 comp rx=0 tx=0).stop 2024-09-13T22:14:03.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.617+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0ffb40 msgr2=0x7f0f0c19d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.617+0000 7f0f134ed640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0ffb40 0x7f0f0c19d9b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f0802a9c0 tx=0x7f0f080055a0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.617+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 shutdown_connections 2024-09-13T22:14:03.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.617+0000 7f0f134ed640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f0ef806e730 0x7f0ef8070bf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.617+0000 7f0f134ed640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f0c105bf0 0x7f0f0c19def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.617+0000 7f0f134ed640 1 --2- 172.21.15.89:0/454218909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0ffb40 0x7f0f0c19d9b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.617+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 >> 172.21.15.89:0/454218909 conn(0x7f0f0c0fb7e0 msgr2=0x7f0f0c072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.618+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 shutdown_connections 2024-09-13T22:14:03.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.618+0000 7f0f134ed640 1 -- 172.21.15.89:0/454218909 wait complete. 2024-09-13T22:14:03.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.705+0000 7f9f09710640 1 -- 172.21.15.89:0/1949949259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 msgr2=0x7f9f04104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.705+0000 7f9f09710640 1 --2- 172.21.15.89:0/1949949259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 0x7f9f04104dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009c20 tx=0x7f9efc02a970 comp rx=0 tx=0).stop 2024-09-13T22:14:03.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.705+0000 7f9f09710640 1 -- 172.21.15.89:0/1949949259 shutdown_connections 2024-09-13T22:14:03.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.705+0000 7f9f09710640 1 --2- 172.21.15.89:0/1949949259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f040fe9f0 0x7f9f040fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.705+0000 7f9f09710640 1 --2- 172.21.15.89:0/1949949259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 0x7f9f04104dd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.705+0000 7f9f09710640 1 -- 172.21.15.89:0/1949949259 >> 172.21.15.89:0/1949949259 conn(0x7f9f040758a0 msgr2=0x7f9f040fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:03.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.705+0000 7f9f09710640 1 -- 172.21.15.89:0/1949949259 shutdown_connections 2024-09-13T22:14:03.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.705+0000 7f9f09710640 1 -- 172.21.15.89:0/1949949259 wait complete. 2024-09-13T22:14:03.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f09710640 1 Processor -- start 2024-09-13T22:14:03.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f09710640 1 -- start start 2024-09-13T22:14:03.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f09710640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f040fe9f0 0x7f9f04196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f09710640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 0x7f9f04196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f09710640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f041974a0 con 0x7f9f041049f0 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f09710640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f041975e0 con 0x7f9f040fe9f0 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f027fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 0x7f9f04196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f027fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 0x7f9f04196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57758/0 (socket says 172.21.15.89:57758) 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f027fc640 1 -- 172.21.15.89:0/316754410 learned_addr learned my addr 172.21.15.89:0/316754410 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.706+0000 7f9f02ffd640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f040fe9f0 0x7f9f04196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.707+0000 7f9f027fc640 1 -- 172.21.15.89:0/316754410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f040fe9f0 msgr2=0x7f9f04196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.707+0000 7f9f027fc640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f040fe9f0 0x7f9f04196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.707+0000 7f9f027fc640 1 -- 172.21.15.89:0/316754410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc009900 con 0x7f9f041049f0 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.707+0000 7f9f027fc640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 0x7f9f04196e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00d8d0 tx=0x7f9eec00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.707+0000 7f9efbfff640 1 -- 172.21.15.89:0/316754410 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec00bea0 con 0x7f9f041049f0 2024-09-13T22:14:03.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.707+0000 7f9efbfff640 1 -- 172.21.15.89:0/316754410 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9eec009c00 con 0x7f9f041049f0 2024-09-13T22:14:03.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.707+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0419f9b0 con 0x7f9f041049f0 2024-09-13T22:14:03.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.707+0000 7f9efbfff640 1 -- 172.21.15.89:0/316754410 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec00f710 con 0x7f9f041049f0 2024-09-13T22:14:03.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.707+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0419fe50 con 0x7f9f041049f0 2024-09-13T22:14:03.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.708+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f04100130 con 0x7f9f041049f0 2024-09-13T22:14:03.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.709+0000 7f9efbfff640 1 -- 172.21.15.89:0/316754410 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f9eec00f940 con 0x7f9f041049f0 2024-09-13T22:14:03.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.709+0000 7f9efbfff640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ef006e730 0x7f9ef0070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.709+0000 7f9efbfff640 1 -- 172.21.15.89:0/316754410 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9eec08e580 con 0x7f9f041049f0 2024-09-13T22:14:03.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.709+0000 7f9f02ffd640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ef006e730 0x7f9ef0070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.710+0000 7f9f02ffd640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ef006e730 0x7f9ef0070bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9efc000f80 tx=0x7f9efc03d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:03.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.714+0000 7f9efbfff640 1 -- 172.21.15.89:0/316754410 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9eec057650 con 0x7f9f041049f0 2024-09-13T22:14:03.842 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:14:03 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[121174]: 2024-09-13T22:14:03.680+0000 7f6ca6850640 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:14:03.842 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:03 smithi089 ceph-mon[109939]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:03.842 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:03 smithi089 ceph-mon[109939]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:03.842 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:03 smithi089 ceph-mon[109939]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:03.842 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:03 smithi089 ceph-mon[109939]: from='osd.0 [v2:172.21.15.89:6802/20644342,v1:172.21.15.89:6803/20644342]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:14:03.843 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:03 smithi089 ceph-mon[109939]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:14:03.843 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:03 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/4169988745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:03.843 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:03 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/454218909' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:14:03.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.905+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f04101c70 con 0x7f9ef006e730 2024-09-13T22:14:03.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.906+0000 7f9efbfff640 1 -- 172.21.15.89:0/316754410 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9f04101c70 con 0x7f9ef006e730 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "crash" 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "7/23 daemons upgraded", 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:14:03.909 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:14:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ef006e730 msgr2=0x7f9ef0070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ef006e730 0x7f9ef0070bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9efc000f80 tx=0x7f9efc03d040 comp rx=0 tx=0).stop 2024-09-13T22:14:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 msgr2=0x7f9f04196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 0x7f9f04196e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00d8d0 tx=0x7f9eec00dd90 comp rx=0 tx=0).stop 2024-09-13T22:14:03.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 shutdown_connections 2024-09-13T22:14:03.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ef006e730 0x7f9ef0070bf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f041049f0 0x7f9f04196e80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 --2- 172.21.15.89:0/316754410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f040fe9f0 0x7f9f04196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 >> 172.21.15.89:0/316754410 conn(0x7f9f040758a0 msgr2=0x7f9f040fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:03.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 shutdown_connections 2024-09-13T22:14:03.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.908+0000 7f9f09710640 1 -- 172.21.15.89:0/316754410 wait complete. 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.993+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/942502561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e58104a40 msgr2=0x7f4e58104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.993+0000 7f4e5e7e2640 1 --2- 172.21.15.89:0/942502561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e58104a40 0x7f4e58104e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009880 tx=0x7f4e4802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.993+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/942502561 shutdown_connections 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.993+0000 7f4e5e7e2640 1 --2- 172.21.15.89:0/942502561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e580fea40 0x7f4e580feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.993+0000 7f4e5e7e2640 1 --2- 172.21.15.89:0/942502561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e58104a40 0x7f4e58104e20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.993+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/942502561 >> 172.21.15.89:0/942502561 conn(0x7f4e580fa700 msgr2=0x7f4e580fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.993+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/942502561 shutdown_connections 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.993+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/942502561 wait complete. 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e5e7e2640 1 Processor -- start 2024-09-13T22:14:03.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e5e7e2640 1 -- start start 2024-09-13T22:14:03.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e5e7e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e580fea40 0x7f4e58196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e5e7e2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e58104a40 0x7f4e58196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e5e7e2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581973f0 con 0x7f4e580fea40 2024-09-13T22:14:03.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e5e7e2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58197560 con 0x7f4e58104a40 2024-09-13T22:14:03.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e57fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e580fea40 0x7f4e58196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e57fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e580fea40 0x7f4e58196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57770/0 (socket says 172.21.15.89:57770) 2024-09-13T22:14:03.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e57fff640 1 -- 172.21.15.89:0/15532741 learned_addr learned my addr 172.21.15.89:0/15532741 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:03.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.994+0000 7f4e577fe640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e58104a40 0x7f4e58196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.995+0000 7f4e57fff640 1 -- 172.21.15.89:0/15532741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e58104a40 msgr2=0x7f4e58196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:03.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.995+0000 7f4e57fff640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e58104a40 0x7f4e58196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:03.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.995+0000 7f4e57fff640 1 -- 172.21.15.89:0/15532741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48009560 con 0x7f4e580fea40 2024-09-13T22:14:03.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.995+0000 7f4e57fff640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e580fea40 0x7f4e58196970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e4802a9c0 tx=0x7f4e480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:03.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.995+0000 7f4e557fa640 1 -- 172.21.15.89:0/15532741 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e48004aa0 con 0x7f4e580fea40 2024-09-13T22:14:03.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.995+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e581977e0 con 0x7f4e580fea40 2024-09-13T22:14:03.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.995+0000 7f4e557fa640 1 -- 172.21.15.89:0/15532741 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e48004c00 con 0x7f4e580fea40 2024-09-13T22:14:03.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.995+0000 7f4e557fa640 1 -- 172.21.15.89:0/15532741 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e48003ab0 con 0x7f4e580fea40 2024-09-13T22:14:03.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.995+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5819fcc0 con 0x7f4e580fea40 2024-09-13T22:14:03.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.996+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e58100180 con 0x7f4e580fea40 2024-09-13T22:14:03.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.997+0000 7f4e557fa640 1 -- 172.21.15.89:0/15532741 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f4e48003cb0 con 0x7f4e580fea40 2024-09-13T22:14:03.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.997+0000 7f4e557fa640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4e4406e730 0x7f4e44070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:03.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.997+0000 7f4e557fa640 1 -- 172.21.15.89:0/15532741 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4e480af7d0 con 0x7f4e580fea40 2024-09-13T22:14:03.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.997+0000 7f4e577fe640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4e4406e730 0x7f4e44070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:03.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:03.998+0000 7f4e577fe640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4e4406e730 0x7f4e44070bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005e10 tx=0x7f4e40005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:04.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.002+0000 7f4e557fa640 1 -- 172.21.15.89:0/15532741 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4e48078780 con 0x7f4e580fea40 2024-09-13T22:14:04.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:03 smithi159 ceph-mon[82000]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:04.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:03 smithi159 ceph-mon[82000]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:04.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:03 smithi159 ceph-mon[82000]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:04.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:03 smithi159 ceph-mon[82000]: from='osd.0 [v2:172.21.15.89:6802/20644342,v1:172.21.15.89:6803/20644342]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:14:04.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:03 smithi159 ceph-mon[82000]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:14:04.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:03 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/4169988745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:04.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:03 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/454218909' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:14:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.249+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4e581977e0 con 0x7f4e580fea40 2024-09-13T22:14:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.249+0000 7f4e557fa640 1 -- 172.21.15.89:0/15532741 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1406 (secure 0 0 0) 0x7f4e581977e0 con 0x7f4e580fea40 2024-09-13T22:14:04.250 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout: osd.0 (root=default,host=smithi089) is down 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-13T22:14:04.251 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-13T22:14:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-13T22:14:04.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.252+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4e4406e730 msgr2=0x7f4e44070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:04.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.252+0000 7f4e5e7e2640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4e4406e730 0x7f4e44070bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005e10 tx=0x7f4e40005da0 comp rx=0 tx=0).stop 2024-09-13T22:14:04.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.252+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e580fea40 msgr2=0x7f4e58196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:04.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.252+0000 7f4e5e7e2640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e580fea40 0x7f4e58196970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e4802a9c0 tx=0x7f4e480055a0 comp rx=0 tx=0).stop 2024-09-13T22:14:04.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.252+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 shutdown_connections 2024-09-13T22:14:04.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.252+0000 7f4e5e7e2640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4e4406e730 0x7f4e44070bf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:04.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.252+0000 7f4e5e7e2640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e58104a40 0x7f4e58196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:04.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.252+0000 7f4e5e7e2640 1 --2- 172.21.15.89:0/15532741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e580fea40 0x7f4e58196970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:04.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.252+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 >> 172.21.15.89:0/15532741 conn(0x7f4e580fa700 msgr2=0x7f4e580fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:04.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.253+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 shutdown_connections 2024-09-13T22:14:04.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:04.253+0000 7f4e5e7e2640 1 -- 172.21.15.89:0/15532741 wait complete. 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='osd.0 [v2:172.21.15.89:6802/20644342,v1:172.21.15.89:6803/20644342]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/15532741' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:14:04.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:14:04.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:04.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:14:04.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:04.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:04.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:04.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T22:14:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T22:14:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='osd.0 [v2:172.21.15.89:6802/20644342,v1:172.21.15.89:6803/20644342]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:14:05.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T22:14:05.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:14:05.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/15532741' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:14:05.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:05.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:05.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:14:05.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:14:05.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:05.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:14:05.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:05.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:05.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:05.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T22:14:05.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:05 smithi089 ceph-mon[109939]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:05.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:05 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T22:14:05.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:05 smithi089 ceph-mon[109939]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T22:14:05.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:05 smithi089 ceph-mon[109939]: pgmap v50: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:05.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:05 smithi089 ceph-mon[109939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:14:05.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:05 smithi089 ceph-mon[109939]: osd.0 [v2:172.21.15.89:6802/20644342,v1:172.21.15.89:6803/20644342] boot 2024-09-13T22:14:05.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:05 smithi089 ceph-mon[109939]: osdmap e53: 6 total, 6 up, 6 in 2024-09-13T22:14:05.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:05 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:14:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:05 smithi159 ceph-mon[82000]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:05 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T22:14:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:05 smithi159 ceph-mon[82000]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T22:14:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:05 smithi159 ceph-mon[82000]: pgmap v50: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:05 smithi159 ceph-mon[82000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:14:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:05 smithi159 ceph-mon[82000]: osd.0 [v2:172.21.15.89:6802/20644342,v1:172.21.15.89:6803/20644342] boot 2024-09-13T22:14:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:05 smithi159 ceph-mon[82000]: osdmap e53: 6 total, 6 up, 6 in 2024-09-13T22:14:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:05 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:14:06.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:06 smithi089 ceph-mon[109939]: osdmap e54: 6 total, 6 up, 6 in 2024-09-13T22:14:06.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:06.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:14:07.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:06 smithi159 ceph-mon[82000]: osdmap e54: 6 total, 6 up, 6 in 2024-09-13T22:14:07.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:07.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:14:07.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:07 smithi089 ceph-mon[109939]: pgmap v53: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:07 smithi159 ceph-mon[82000]: pgmap v53: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-13T22:14:08.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:08 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:08.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:08 smithi089 ceph-mon[109939]: mgrmap e39: smithi089.naneiw(active, since 92s), standbys: smithi159.ghpomd 2024-09-13T22:14:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:08 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:08 smithi159 ceph-mon[82000]: mgrmap e39: smithi089.naneiw(active, since 92s), standbys: smithi159.ghpomd 2024-09-13T22:14:09.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:09 smithi089 ceph-mon[109939]: pgmap v54: 65 pgs: 7 active+undersized, 2 active+undersized+degraded, 56 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/222 objects degraded (2.703%) 2024-09-13T22:14:10.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:09 smithi159 ceph-mon[82000]: pgmap v54: 65 pgs: 7 active+undersized, 2 active+undersized+degraded, 56 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/222 objects degraded (2.703%) 2024-09-13T22:14:11.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:10 smithi089 ceph-mon[109939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded) 2024-09-13T22:14:11.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:10 smithi159 ceph-mon[82000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded) 2024-09-13T22:14:12.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:11 smithi089 ceph-mon[109939]: pgmap v55: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 442 B/s wr, 0 op/s 2024-09-13T22:14:12.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:11 smithi159 ceph-mon[82000]: pgmap v55: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 442 B/s wr, 0 op/s 2024-09-13T22:14:14.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:13 smithi159 ceph-mon[82000]: pgmap v56: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-13T22:14:14.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:13 smithi089 ceph-mon[109939]: pgmap v56: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-13T22:14:16.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:15 smithi089 ceph-mon[109939]: pgmap v57: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 309 B/s wr, 0 op/s 2024-09-13T22:14:16.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:15 smithi159 ceph-mon[82000]: pgmap v57: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 309 B/s wr, 0 op/s 2024-09-13T22:14:17.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:17 smithi089 ceph-mon[109939]: pgmap v58: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 281 B/s wr, 0 op/s 2024-09-13T22:14:17.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:17 smithi159 ceph-mon[82000]: pgmap v58: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 281 B/s wr, 0 op/s 2024-09-13T22:14:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:19.944 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:19 smithi089 ceph-mon[109939]: pgmap v59: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:14:19.945 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:19 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T22:14:20.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:19 smithi159 ceph-mon[82000]: pgmap v59: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T22:14:20.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:19 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T22:14:20.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:20 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T22:14:20.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:20 smithi089 ceph-mon[109939]: Upgrade: osd.1 is safe to restart 2024-09-13T22:14:21.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:20 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T22:14:21.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:20 smithi159 ceph-mon[82000]: Upgrade: osd.1 is safe to restart 2024-09-13T22:14:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:21 smithi089 ceph-mon[109939]: pgmap v60: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:21 smithi089 ceph-mon[109939]: Upgrade: Updating osd.1 2024-09-13T22:14:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:14:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:14:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:21 smithi089 ceph-mon[109939]: Deploying daemon osd.1 on smithi089 2024-09-13T22:14:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:21.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:14:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:21 smithi159 ceph-mon[82000]: pgmap v60: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:21 smithi159 ceph-mon[82000]: Upgrade: Updating osd.1 2024-09-13T22:14:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:14:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:14:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:21 smithi159 ceph-mon[82000]: Deploying daemon osd.1 on smithi089 2024-09-13T22:14:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:14:23.724 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:23 smithi089 systemd[1]: Stopping Ceph osd.1 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:14:23.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:23 smithi089 ceph-mon[109939]: pgmap v61: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:23.997 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:23 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[53606]: 2024-09-13T22:14:23.816+0000 7f964adec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:14:23.997 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:23 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[53606]: 2024-09-13T22:14:23.816+0000 7f964adec640 -1 osd.1 54 *** Got signal Terminated *** 2024-09-13T22:14:23.997 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:23 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[53606]: 2024-09-13T22:14:23.816+0000 7f964adec640 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:14:24.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:23 smithi159 ceph-mon[82000]: pgmap v61: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:24.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:24 smithi089 ceph-mon[109939]: osd.1 marked itself down and dead 2024-09-13T22:14:25.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:24 smithi159 ceph-mon[82000]: osd.1 marked itself down and dead 2024-09-13T22:14:25.496 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:25 smithi089 podman[126126]: 2024-09-13 22:14:25.196998668 +0000 UTC m=+1.481434616 container died f9eb5106bdf9693ee2dea47caca40d6cd4c9e3e98bf90f060caf79966c4220ae (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-e4e227b, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T22:14:25.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:25 smithi089 ceph-mon[109939]: pgmap v62: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:25.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:25 smithi089 ceph-mon[109939]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:14:25.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:25 smithi089 ceph-mon[109939]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T22:14:25.953 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:25 smithi089 podman[126126]: 2024-09-13 22:14:25.641852991 +0000 UTC m=+1.926288979 container cleanup f9eb5106bdf9693ee2dea47caca40d6cd4c9e3e98bf90f060caf79966c4220ae (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:14:25.953 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:25 smithi089 bash[126126]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1 2024-09-13T22:14:26.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:25 smithi159 ceph-mon[82000]: pgmap v62: 65 pgs: 65 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:26.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:25 smithi159 ceph-mon[82000]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:14:26.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:25 smithi159 ceph-mon[82000]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T22:14:26.246 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:25 smithi089 podman[126143]: 2024-09-13 22:14:25.951993315 +0000 UTC m=+0.753759326 container remove f9eb5106bdf9693ee2dea47caca40d6cd4c9e3e98bf90f060caf79966c4220ae (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=reef-e4e227b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T22:14:26.565 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:26 smithi089 podman[126232]: 2024-09-13 22:14:26.168126707 +0000 UTC m=+0.016396576 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:14:26.565 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:26 smithi089 podman[126232]: 2024-09-13 22:14:26.269314663 +0000 UTC m=+0.117584519 container create bda595ee68afdf5a40c6d25fe7e6dba65e1b87f68fc422415793fcbb883ec9b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:14:26.565 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:26 smithi089 podman[126232]: 2024-09-13 22:14:26.48019757 +0000 UTC m=+0.328467423 container init bda595ee68afdf5a40c6d25fe7e6dba65e1b87f68fc422415793fcbb883ec9b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be) 2024-09-13T22:14:26.565 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:26 smithi089 podman[126232]: 2024-09-13 22:14:26.48344921 +0000 UTC m=+0.331719070 container start bda595ee68afdf5a40c6d25fe7e6dba65e1b87f68fc422415793fcbb883ec9b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_CLEAN=True, ceph=True) 2024-09-13T22:14:26.959 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:26 smithi089 ceph-mon[109939]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T22:14:26.960 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:26 smithi089 podman[126232]: 2024-09-13 22:14:26.563653483 +0000 UTC m=+0.411923350 container attach bda595ee68afdf5a40c6d25fe7e6dba65e1b87f68fc422415793fcbb883ec9b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T22:14:26.960 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:26 smithi089 podman[126232]: 2024-09-13 22:14:26.66871196 +0000 UTC m=+0.516981825 container died bda595ee68afdf5a40c6d25fe7e6dba65e1b87f68fc422415793fcbb883ec9b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:14:27.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:26 smithi159 ceph-mon[82000]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T22:14:27.732 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:27 smithi089 podman[126254]: 2024-09-13 22:14:27.284336195 +0000 UTC m=+0.606735619 container remove bda595ee68afdf5a40c6d25fe7e6dba65e1b87f68fc422415793fcbb883ec9b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:14:27.732 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:27 smithi089 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T22:14:27.732 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:27 smithi089 systemd[1]: Stopped Ceph osd.1 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:14:27.732 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:27 smithi089 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 3.715s CPU time. 2024-09-13T22:14:27.732 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:27 smithi089 systemd[1]: Starting Ceph osd.1 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:14:27.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:27 smithi089 ceph-mon[109939]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:27.988 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:27 smithi089 podman[126351]: 2024-09-13 22:14:27.633881884 +0000 UTC m=+0.015893544 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:14:27.989 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:27 smithi089 podman[126351]: 2024-09-13 22:14:27.752061437 +0000 UTC m=+0.134073133 container create 356703bc806b0cba62554fc0fd9810e69df0a23575cfdd801a081a2641dcf867 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:14:27.989 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:27 smithi089 podman[126351]: 2024-09-13 22:14:27.987931335 +0000 UTC m=+0.369942987 container init 356703bc806b0cba62554fc0fd9810e69df0a23575cfdd801a081a2641dcf867 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T22:14:28.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:27 smithi159 ceph-mon[82000]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:28.247 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:27 smithi089 podman[126351]: 2024-09-13 22:14:27.991372127 +0000 UTC m=+0.373383781 container start 356703bc806b0cba62554fc0fd9810e69df0a23575cfdd801a081a2641dcf867 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T22:14:28.247 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:28 smithi089 podman[126351]: 2024-09-13 22:14:28.096290215 +0000 UTC m=+0.478301883 container attach 356703bc806b0cba62554fc0fd9810e69df0a23575cfdd801a081a2641dcf867 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0) 2024-09-13T22:14:28.247 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:28 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate[126366]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:14:28.247 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:28 smithi089 bash[126351]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:14:28.247 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:28 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate[126366]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:14:28.247 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:28 smithi089 bash[126351]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:14:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:28 smithi089 ceph-mon[109939]: Health check failed: Degraded data redundancy: 29/222 objects degraded (13.063%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:29.138 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:28 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate[126366]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T22:14:29.138 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:28 smithi089 bash[126351]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T22:14:29.138 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:28 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate[126366]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T22:14:29.138 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:28 smithi089 bash[126351]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T22:14:29.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:28 smithi159 ceph-mon[82000]: Health check failed: Degraded data redundancy: 29/222 objects degraded (13.063%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:29.451 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate[126366]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T22:14:29.451 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 bash[126351]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T22:14:29.451 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate[126366]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T22:14:29.451 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 bash[126351]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T22:14:29.451 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate[126366]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T22:14:29.451 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 bash[126351]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T22:14:29.451 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate[126366]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T22:14:29.451 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 bash[126351]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T22:14:29.451 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate[126366]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T22:14:29.452 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 bash[126351]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T22:14:29.452 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 podman[126351]: 2024-09-13 22:14:29.165645947 +0000 UTC m=+1.547657599 container died 356703bc806b0cba62554fc0fd9810e69df0a23575cfdd801a081a2641dcf867 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-ecab7be) 2024-09-13T22:14:30.073 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:29 smithi089 ceph-mon[109939]: pgmap v66: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-13T22:14:30.073 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 podman[126502]: 2024-09-13 22:14:29.758577912 +0000 UTC m=+0.581541701 container remove 356703bc806b0cba62554fc0fd9810e69df0a23575cfdd801a081a2641dcf867 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, ceph=True) 2024-09-13T22:14:30.073 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 podman[126563]: 2024-09-13 22:14:29.868573092 +0000 UTC m=+0.016094638 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:14:30.073 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:29 smithi089 podman[126563]: 2024-09-13 22:14:29.96763308 +0000 UTC m=+0.115154616 container create 3d2a1d778a362e0a524f45b127afc24d58d7f2ec7579b4bea67c8dc7f38ccec8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T22:14:30.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:29 smithi159 ceph-mon[82000]: pgmap v66: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-13T22:14:30.396 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:30 smithi089 podman[126563]: 2024-09-13 22:14:30.178229469 +0000 UTC m=+0.325751004 container init 3d2a1d778a362e0a524f45b127afc24d58d7f2ec7579b4bea67c8dc7f38ccec8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T22:14:30.396 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:30 smithi089 podman[126563]: 2024-09-13 22:14:30.181540344 +0000 UTC m=+0.329061881 container start 3d2a1d778a362e0a524f45b127afc24d58d7f2ec7579b4bea67c8dc7f38ccec8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T22:14:30.396 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:30 smithi089 ceph-osd[126582]: -- 172.21.15.89:0/2528117324 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55850188c1e0 con 0x558500a8bc00 2024-09-13T22:14:30.746 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:30 smithi089 bash[126563]: 3d2a1d778a362e0a524f45b127afc24d58d7f2ec7579b4bea67c8dc7f38ccec8 2024-09-13T22:14:30.746 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:30 smithi089 systemd[1]: Started Ceph osd.1 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:14:31.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:31.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:31.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:14:31.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:31 smithi089 ceph-mon[109939]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:14:31.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:31 smithi159 ceph-mon[82000]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:32.246 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:32 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[126578]: 2024-09-13T22:14:32.065+0000 7fbd86eed640 -1 Falling back to public interface 2024-09-13T22:14:33.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:33 smithi089 ceph-mon[109939]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:34.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:33 smithi159 ceph-mon[82000]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.338+0000 7f48db18d640 1 -- 172.21.15.89:0/4234820192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 msgr2=0x7f48d4109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.338+0000 7f48db18d640 1 --2- 172.21.15.89:0/4234820192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 0x7f48d4109b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009880 tx=0x7f48c002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.338+0000 7f48db18d640 1 -- 172.21.15.89:0/4234820192 shutdown_connections 2024-09-13T22:14:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.338+0000 7f48db18d640 1 --2- 172.21.15.89:0/4234820192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 0x7f48d4109b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.338+0000 7f48db18d640 1 --2- 172.21.15.89:0/4234820192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48d4100d50 0x7f48d4101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.338+0000 7f48db18d640 1 -- 172.21.15.89:0/4234820192 >> 172.21.15.89:0/4234820192 conn(0x7f48d40fa730 msgr2=0x7f48d40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.338+0000 7f48db18d640 1 -- 172.21.15.89:0/4234820192 shutdown_connections 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.338+0000 7f48db18d640 1 -- 172.21.15.89:0/4234820192 wait complete. 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48db18d640 1 Processor -- start 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48db18d640 1 -- start start 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48db18d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48d4100d50 0x7f48d419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48db18d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 0x7f48d419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48db18d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d419c380 con 0x7f48d4101670 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48db18d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4195910 con 0x7f48d4100d50 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48d3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 0x7f48d419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48d3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 0x7f48d419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53164/0 (socket says 172.21.15.89:53164) 2024-09-13T22:14:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48d3fff640 1 -- 172.21.15.89:0/1069539402 learned_addr learned my addr 172.21.15.89:0/1069539402 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48d8f29640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48d4100d50 0x7f48d419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48d3fff640 1 -- 172.21.15.89:0/1069539402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48d4100d50 msgr2=0x7f48d419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48d3fff640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48d4100d50 0x7f48d419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.339+0000 7f48d3fff640 1 -- 172.21.15.89:0/1069539402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c0009560 con 0x7f48d4101670 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.340+0000 7f48d3fff640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 0x7f48d419bd60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48c0006010 tx=0x7f48c00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.340+0000 7f48d1ffb640 1 -- 172.21.15.89:0/1069539402 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c0004aa0 con 0x7f48d4101670 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.340+0000 7f48d1ffb640 1 -- 172.21.15.89:0/1069539402 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48c0031470 con 0x7f48d4101670 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.340+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d4195bf0 con 0x7f48d4101670 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.340+0000 7f48d1ffb640 1 -- 172.21.15.89:0/1069539402 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c0003940 con 0x7f48d4101670 2024-09-13T22:14:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.340+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d4196140 con 0x7f48d4101670 2024-09-13T22:14:34.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.341+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d4068cd0 con 0x7f48d4101670 2024-09-13T22:14:34.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.341+0000 7f48d1ffb640 1 -- 172.21.15.89:0/1069539402 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f48c0031b90 con 0x7f48d4101670 2024-09-13T22:14:34.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.342+0000 7f48d1ffb640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f48c406e600 0x7f48c4070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:34.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.342+0000 7f48d1ffb640 1 -- 172.21.15.89:0/1069539402 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f48c00af7e0 con 0x7f48d4101670 2024-09-13T22:14:34.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.342+0000 7f48d8f29640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f48c406e600 0x7f48c4070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:34.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.342+0000 7f48d8f29640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f48c406e600 0x7f48c4070ac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48c8005fd0 tx=0x7f48c8005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:34.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.346+0000 7f48d1ffb640 1 -- 172.21.15.89:0/1069539402 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f48c0078930 con 0x7f48d4101670 2024-09-13T22:14:34.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.551+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48d410cd70 con 0x7f48c406e600 2024-09-13T22:14:34.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.552+0000 7f48d1ffb640 1 -- 172.21.15.89:0/1069539402 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f48d410cd70 con 0x7f48c406e600 2024-09-13T22:14:34.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f48c406e600 msgr2=0x7f48c4070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f48c406e600 0x7f48c4070ac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48c8005fd0 tx=0x7f48c8005850 comp rx=0 tx=0).stop 2024-09-13T22:14:34.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 msgr2=0x7f48d419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 0x7f48d419bd60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48c0006010 tx=0x7f48c00055a0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 shutdown_connections 2024-09-13T22:14:34.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f48c406e600 0x7f48c4070ac0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4101670 0x7f48d419bd60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 --2- 172.21.15.89:0/1069539402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48d4100d50 0x7f48d419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 >> 172.21.15.89:0/1069539402 conn(0x7f48d40fa730 msgr2=0x7f48d4101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:34.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 shutdown_connections 2024-09-13T22:14:34.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.555+0000 7f48db18d640 1 -- 172.21.15.89:0/1069539402 wait complete. 2024-09-13T22:14:34.565 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:14:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.638+0000 7fb49c486640 1 -- 172.21.15.89:0/1445270641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4941029d0 msgr2=0x7fb494106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.638+0000 7fb49c486640 1 --2- 172.21.15.89:0/1445270641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4941029d0 0x7fb494106a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb484009880 tx=0x7fb48402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.639+0000 7fb49c486640 1 -- 172.21.15.89:0/1445270641 shutdown_connections 2024-09-13T22:14:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.639+0000 7fb49c486640 1 --2- 172.21.15.89:0/1445270641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4941029d0 0x7fb494106a20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.639+0000 7fb49c486640 1 --2- 172.21.15.89:0/1445270641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb494102020 0x7fb494102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.639+0000 7fb49c486640 1 -- 172.21.15.89:0/1445270641 >> 172.21.15.89:0/1445270641 conn(0x7fb4940fdb00 msgr2=0x7fb4940fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.639+0000 7fb49c486640 1 -- 172.21.15.89:0/1445270641 shutdown_connections 2024-09-13T22:14:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.639+0000 7fb49c486640 1 -- 172.21.15.89:0/1445270641 wait complete. 2024-09-13T22:14:34.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.639+0000 7fb49c486640 1 Processor -- start 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.639+0000 7fb49c486640 1 -- start start 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49c486640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb494102020 0x7fb494197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49c486640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4941029d0 0x7fb494198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49c486640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494198990 con 0x7fb494102020 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49c486640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49419c700 con 0x7fb4941029d0 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49a222640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb494102020 0x7fb494197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49a222640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb494102020 0x7fb494197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53180/0 (socket says 172.21.15.89:53180) 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49a222640 1 -- 172.21.15.89:0/86261540 learned_addr learned my addr 172.21.15.89:0/86261540 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb499a21640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4941029d0 0x7fb494198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49a222640 1 -- 172.21.15.89:0/86261540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4941029d0 msgr2=0x7fb494198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49a222640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4941029d0 0x7fb494198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49a222640 1 -- 172.21.15.89:0/86261540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484009560 con 0x7fb494102020 2024-09-13T22:14:34.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49a222640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb494102020 0x7fb494197dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb49000b420 tx=0x7fb49000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:34.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb48b7fe640 1 -- 172.21.15.89:0/86261540 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb490011800 con 0x7fb494102020 2024-09-13T22:14:34.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49419c9e0 con 0x7fb494102020 2024-09-13T22:14:34.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb48b7fe640 1 -- 172.21.15.89:0/86261540 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb490011e20 con 0x7fb494102020 2024-09-13T22:14:34.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb48b7fe640 1 -- 172.21.15.89:0/86261540 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb49000f2e0 con 0x7fb494102020 2024-09-13T22:14:34.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.640+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49419cf00 con 0x7fb494102020 2024-09-13T22:14:34.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.642+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494103500 con 0x7fb494102020 2024-09-13T22:14:34.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.642+0000 7fb48b7fe640 1 -- 172.21.15.89:0/86261540 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb490010380 con 0x7fb494102020 2024-09-13T22:14:34.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.643+0000 7fb48b7fe640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb48006e600 0x7fb480070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:34.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.643+0000 7fb48b7fe640 1 -- 172.21.15.89:0/86261540 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb49008e020 con 0x7fb494102020 2024-09-13T22:14:34.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.643+0000 7fb499a21640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb48006e600 0x7fb480070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:34.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.643+0000 7fb499a21640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb48006e600 0x7fb480070ac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb484000c00 tx=0x7fb484031420 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:34.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.647+0000 7fb48b7fe640 1 -- 172.21.15.89:0/86261540 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb490057170 con 0x7fb494102020 2024-09-13T22:14:34.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.842+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb494199120 con 0x7fb48006e600 2024-09-13T22:14:34.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.843+0000 7fb48b7fe640 1 -- 172.21.15.89:0/86261540 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb494199120 con 0x7fb48006e600 2024-09-13T22:14:34.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb48006e600 msgr2=0x7fb480070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb48006e600 0x7fb480070ac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb484000c00 tx=0x7fb484031420 comp rx=0 tx=0).stop 2024-09-13T22:14:34.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb494102020 msgr2=0x7fb494197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb494102020 0x7fb494197dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb49000b420 tx=0x7fb49000b8e0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 shutdown_connections 2024-09-13T22:14:34.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb48006e600 0x7fb480070ac0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4941029d0 0x7fb494198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 --2- 172.21.15.89:0/86261540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb494102020 0x7fb494197dc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 >> 172.21.15.89:0/86261540 conn(0x7fb4940fdb00 msgr2=0x7fb4940fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:34.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 shutdown_connections 2024-09-13T22:14:34.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.845+0000 7fb49c486640 1 -- 172.21.15.89:0/86261540 wait complete. 2024-09-13T22:14:34.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.927+0000 7f3f47213640 1 -- 172.21.15.89:0/2206430118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 msgr2=0x7f3f400fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.927+0000 7f3f47213640 1 --2- 172.21.15.89:0/2206430118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 0x7f3f400fee50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009880 tx=0x7f3f2c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.927+0000 7f3f47213640 1 -- 172.21.15.89:0/2206430118 shutdown_connections 2024-09-13T22:14:34.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.927+0000 7f3f47213640 1 --2- 172.21.15.89:0/2206430118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 0x7f3f400fee50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.927+0000 7f3f47213640 1 --2- 172.21.15.89:0/2206430118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f401049f0 0x7f3f40104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.927+0000 7f3f47213640 1 -- 172.21.15.89:0/2206430118 >> 172.21.15.89:0/2206430118 conn(0x7f3f400758a0 msgr2=0x7f3f400fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:34.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.927+0000 7f3f47213640 1 -- 172.21.15.89:0/2206430118 shutdown_connections 2024-09-13T22:14:34.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.927+0000 7f3f47213640 1 -- 172.21.15.89:0/2206430118 wait complete. 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f47213640 1 Processor -- start 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f47213640 1 -- start start 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f47213640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 0x7f3f4019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f47213640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f401049f0 0x7f3f4019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f47213640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4019c3d0 con 0x7f3f400fe9f0 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f47213640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40195960 con 0x7f3f401049f0 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f44faf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 0x7f3f4019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f44faf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 0x7f3f4019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53188/0 (socket says 172.21.15.89:53188) 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f44faf640 1 -- 172.21.15.89:0/1360947735 learned_addr learned my addr 172.21.15.89:0/1360947735 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.928+0000 7f3f3ffff640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f401049f0 0x7f3f4019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:34.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.929+0000 7f3f44faf640 1 -- 172.21.15.89:0/1360947735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f401049f0 msgr2=0x7f3f4019bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:34.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.929+0000 7f3f44faf640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f401049f0 0x7f3f4019bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:34.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.929+0000 7f3f44faf640 1 -- 172.21.15.89:0/1360947735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c009560 con 0x7f3f400fe9f0 2024-09-13T22:14:34.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.929+0000 7f3f44faf640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 0x7f3f4019b870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400d6f0 tx=0x7f3f3400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:34.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.929+0000 7f3f3dffb640 1 -- 172.21.15.89:0/1360947735 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f34009a30 con 0x7f3f400fe9f0 2024-09-13T22:14:34.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.929+0000 7f3f3dffb640 1 -- 172.21.15.89:0/1360947735 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f340054e0 con 0x7f3f400fe9f0 2024-09-13T22:14:34.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.929+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f40195c40 con 0x7f3f400fe9f0 2024-09-13T22:14:34.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.929+0000 7f3f3dffb640 1 -- 172.21.15.89:0/1360947735 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f34004e60 con 0x7f3f400fe9f0 2024-09-13T22:14:34.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.929+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f40196160 con 0x7f3f400fe9f0 2024-09-13T22:14:34.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.930+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f40100130 con 0x7f3f400fe9f0 2024-09-13T22:14:34.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.930+0000 7f3f3dffb640 1 -- 172.21.15.89:0/1360947735 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3f34009b90 con 0x7f3f400fe9f0 2024-09-13T22:14:34.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.931+0000 7f3f3dffb640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3f3006e600 0x7f3f30070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:34.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.931+0000 7f3f3dffb640 1 -- 172.21.15.89:0/1360947735 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3f3408e5f0 con 0x7f3f400fe9f0 2024-09-13T22:14:34.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.931+0000 7f3f3ffff640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3f3006e600 0x7f3f30070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:34.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.932+0000 7f3f3ffff640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3f3006e600 0x7f3f30070ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000c00 tx=0x7f3f2c005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:34.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:34.935+0000 7f3f3dffb640 1 -- 172.21.15.89:0/1360947735 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3f34057740 con 0x7f3f400fe9f0 2024-09-13T22:14:35.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.117+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f40106fd0 con 0x7f3f3006e600 2024-09-13T22:14:35.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.126+0000 7f3f3dffb640 1 -- 172.21.15.89:0/1360947735 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3f40106fd0 con 0x7f3f3006e600 2024-09-13T22:14:35.128 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:14:35.128 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (3m) 34s ago 13m 25.8M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:14:35.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (13m) 34s ago 13m 8102k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:14:35.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (13m) 56s ago 13m 8174k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:14:35.128 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (64s) 34s ago 13m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:14:35.128 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (59s) 56s ago 12m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (2m) 34s ago 13m 77.9M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (8m) 34s ago 8m 18.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (8m) 34s ago 8m 15.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (8m) 56s ago 8m 161M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (8m) 56s ago 8m 17.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (4m) 34s ago 14m 494M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (4m) 56s ago 12m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (2m) 34s ago 15m 43.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (103s) 56s ago 12m 34.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (3m) 34s ago 13m 15.2M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (3m) 56s ago 12m 15.7M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:14:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (40s) 34s ago 11m 12.1M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:14:35.130 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 starting - - - 1215M 2024-09-13T22:14:35.130 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (10m) 34s ago 10m 222M 1215M 18.2.4-845-ge4e227b3 67ddd33fa72f 9d74fd737dfc 2024-09-13T22:14:35.130 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (10m) 56s ago 10m 286M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:14:35.130 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (10m) 56s ago 10m 250M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:14:35.130 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (9m) 56s ago 9m 255M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:14:35.130 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (3m) 34s ago 13m 61.7M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:14:35.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.128+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3f3006e600 msgr2=0x7f3f30070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.128+0000 7f3f47213640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3f3006e600 0x7f3f30070ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000c00 tx=0x7f3f2c005e30 comp rx=0 tx=0).stop 2024-09-13T22:14:35.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.128+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 msgr2=0x7f3f4019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.128+0000 7f3f47213640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 0x7f3f4019b870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400d6f0 tx=0x7f3f3400dbb0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.129+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 shutdown_connections 2024-09-13T22:14:35.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.129+0000 7f3f47213640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3f3006e600 0x7f3f30070ac0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.129+0000 7f3f47213640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f401049f0 0x7f3f4019bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.129+0000 7f3f47213640 1 --2- 172.21.15.89:0/1360947735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400fe9f0 0x7f3f4019b870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.129+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 >> 172.21.15.89:0/1360947735 conn(0x7f3f400758a0 msgr2=0x7f3f400fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:35.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.129+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 shutdown_connections 2024-09-13T22:14:35.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.129+0000 7f3f47213640 1 -- 172.21.15.89:0/1360947735 wait complete. 2024-09-13T22:14:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.208+0000 7f54cc2ff640 1 -- 172.21.15.89:0/444590054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 msgr2=0x7f54c41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.208+0000 7f54cc2ff640 1 --2- 172.21.15.89:0/444590054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 0x7f54c41047a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009880 tx=0x7f54c002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.208+0000 7f54cc2ff640 1 -- 172.21.15.89:0/444590054 shutdown_connections 2024-09-13T22:14:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.208+0000 7f54cc2ff640 1 --2- 172.21.15.89:0/444590054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 0x7f54c41047a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.208+0000 7f54cc2ff640 1 --2- 172.21.15.89:0/444590054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40ffda0 0x7f54c4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.208+0000 7f54cc2ff640 1 -- 172.21.15.89:0/444590054 >> 172.21.15.89:0/444590054 conn(0x7f54c40fb840 msgr2=0x7f54c40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.208+0000 7f54cc2ff640 1 -- 172.21.15.89:0/444590054 shutdown_connections 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.208+0000 7f54cc2ff640 1 -- 172.21.15.89:0/444590054 wait complete. 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.209+0000 7f54cc2ff640 1 Processor -- start 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.209+0000 7f54cc2ff640 1 -- start start 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.209+0000 7f54cc2ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40ffda0 0x7f54c40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.209+0000 7f54cc2ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 0x7f54c4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.209+0000 7f54cc2ff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4073230 con 0x7f54c4100750 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.209+0000 7f54cc2ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40733a0 con 0x7f54c40ffda0 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.209+0000 7f54c989a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 0x7f54c4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.209+0000 7f54c989a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 0x7f54c4072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53206/0 (socket says 172.21.15.89:53206) 2024-09-13T22:14:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.209+0000 7f54c989a640 1 -- 172.21.15.89:0/3047070382 learned_addr learned my addr 172.21.15.89:0/3047070382 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.210+0000 7f54c989a640 1 -- 172.21.15.89:0/3047070382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40ffda0 msgr2=0x7f54c40727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.210+0000 7f54c989a640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40ffda0 0x7f54c40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.210+0000 7f54c989a640 1 -- 172.21.15.89:0/3047070382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009560 con 0x7f54c4100750 2024-09-13T22:14:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.210+0000 7f54c989a640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 0x7f54c4072cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54c002a9c0 tx=0x7f54c00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.210+0000 7f54bb7fe640 1 -- 172.21.15.89:0/3047070382 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c0004aa0 con 0x7f54c4100750 2024-09-13T22:14:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.210+0000 7f54bb7fe640 1 -- 172.21.15.89:0/3047070382 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54c0004c00 con 0x7f54c4100750 2024-09-13T22:14:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.210+0000 7f54bb7fe640 1 -- 172.21.15.89:0/3047070382 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c0003ab0 con 0x7f54c4100750 2024-09-13T22:14:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.210+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c4073620 con 0x7f54c4100750 2024-09-13T22:14:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.210+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c41a2010 con 0x7f54c4100750 2024-09-13T22:14:35.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.211+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c4101280 con 0x7f54c4100750 2024-09-13T22:14:35.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.212+0000 7f54bb7fe640 1 -- 172.21.15.89:0/3047070382 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f54c0031d20 con 0x7f54c4100750 2024-09-13T22:14:35.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.212+0000 7f54bb7fe640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f54b006e5f0 0x7f54b0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:35.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.212+0000 7f54bb7fe640 1 -- 172.21.15.89:0/3047070382 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f54c00af550 con 0x7f54c4100750 2024-09-13T22:14:35.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.212+0000 7f54ca09b640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f54b006e5f0 0x7f54b0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:35.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.213+0000 7f54ca09b640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f54b006e5f0 0x7f54b0070ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009710 tx=0x7f54b4006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:35.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.217+0000 7f54bb7fe640 1 -- 172.21.15.89:0/3047070382 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f54c0078720 con 0x7f54c4100750 2024-09-13T22:14:35.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.513+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f54c4100200 con 0x7f54c4100750 2024-09-13T22:14:35.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.517+0000 7f54bb7fe640 1 -- 172.21.15.89:0/3047070382 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7f54c007bde0 con 0x7f54c4100750 2024-09-13T22:14:35.518 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:14:35.518 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:14:35.518 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:14:35.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:14:35.518 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:14:35.518 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4, 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 8, 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:14:35.519 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:14:35.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f54b006e5f0 msgr2=0x7f54b0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f54b006e5f0 0x7f54b0070ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009710 tx=0x7f54b4006c90 comp rx=0 tx=0).stop 2024-09-13T22:14:35.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 msgr2=0x7f54c4072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 0x7f54c4072cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54c002a9c0 tx=0x7f54c00055a0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 shutdown_connections 2024-09-13T22:14:35.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f54b006e5f0 0x7f54b0070ab0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c4100750 0x7f54c4072cf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 --2- 172.21.15.89:0/3047070382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c40ffda0 0x7f54c40727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 >> 172.21.15.89:0/3047070382 conn(0x7f54c40fb840 msgr2=0x7f54c40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:35.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 shutdown_connections 2024-09-13T22:14:35.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.519+0000 7f54cc2ff640 1 -- 172.21.15.89:0/3047070382 wait complete. 2024-09-13T22:14:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.633+0000 7f00fdf22640 1 -- 172.21.15.89:0/2282445010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 msgr2=0x7f00f8109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.633+0000 7f00fdf22640 1 --2- 172.21.15.89:0/2282445010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 0x7f00f8109ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009880 tx=0x7f00ec02a530 comp rx=0 tx=0).stop 2024-09-13T22:14:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.633+0000 7f00fdf22640 1 -- 172.21.15.89:0/2282445010 shutdown_connections 2024-09-13T22:14:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.633+0000 7f00fdf22640 1 --2- 172.21.15.89:0/2282445010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 0x7f00f8109ac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.633+0000 7f00fdf22640 1 --2- 172.21.15.89:0/2282445010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f8100cb0 0x7f00f8101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.633+0000 7f00fdf22640 1 -- 172.21.15.89:0/2282445010 >> 172.21.15.89:0/2282445010 conn(0x7f00f80758a0 msgr2=0x7f00f80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.633+0000 7f00fdf22640 1 -- 172.21.15.89:0/2282445010 shutdown_connections 2024-09-13T22:14:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.633+0000 7f00fdf22640 1 -- 172.21.15.89:0/2282445010 wait complete. 2024-09-13T22:14:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.634+0000 7f00fdf22640 1 Processor -- start 2024-09-13T22:14:35.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.634+0000 7f00fdf22640 1 -- start start 2024-09-13T22:14:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.634+0000 7f00fdf22640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f8100cb0 0x7f00f819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.634+0000 7f00fdf22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 0x7f00f819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.634+0000 7f00fdf22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f819c300 con 0x7f00f81015d0 2024-09-13T22:14:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.634+0000 7f00fdf22640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8195920 con 0x7f00f8100cb0 2024-09-13T22:14:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.634+0000 7f00f6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 0x7f00f819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.634+0000 7f00f6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 0x7f00f819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53222/0 (socket says 172.21.15.89:53222) 2024-09-13T22:14:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.634+0000 7f00f6ffd640 1 -- 172.21.15.89:0/3425282224 learned_addr learned my addr 172.21.15.89:0/3425282224 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00f77fe640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f8100cb0 0x7f00f819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00f6ffd640 1 -- 172.21.15.89:0/3425282224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f8100cb0 msgr2=0x7f00f819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00f6ffd640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f8100cb0 0x7f00f819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00f6ffd640 1 -- 172.21.15.89:0/3425282224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009560 con 0x7f00f81015d0 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00f77fe640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f8100cb0 0x7f00f819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00f6ffd640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 0x7f00f819bd70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00ec006010 tx=0x7f00ec0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00f4ff9640 1 -- 172.21.15.89:0/3425282224 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00ec004aa0 con 0x7f00f81015d0 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f8195ba0 con 0x7f00f81015d0 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00f4ff9640 1 -- 172.21.15.89:0/3425282224 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00ec004c00 con 0x7f00f81015d0 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00f4ff9640 1 -- 172.21.15.89:0/3425282224 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00ec0039b0 con 0x7f00f81015d0 2024-09-13T22:14:35.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.635+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f8196090 con 0x7f00f81015d0 2024-09-13T22:14:35.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.637+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f8068510 con 0x7f00f81015d0 2024-09-13T22:14:35.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.637+0000 7f00f4ff9640 1 -- 172.21.15.89:0/3425282224 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f00ec02ad50 con 0x7f00f81015d0 2024-09-13T22:14:35.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.637+0000 7f00f4ff9640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f00e006e600 0x7f00e0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:35.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.637+0000 7f00f4ff9640 1 -- 172.21.15.89:0/3425282224 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f00ec0af400 con 0x7f00f81015d0 2024-09-13T22:14:35.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.637+0000 7f00f77fe640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f00e006e600 0x7f00e0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:35.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.638+0000 7f00f77fe640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f00e006e600 0x7f00e0070ac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f00e800baa0 tx=0x7f00e8005d90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.646+0000 7f00f4ff9640 1 -- 172.21.15.89:0/3425282224 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f00ec0785d0 con 0x7f00f81015d0 2024-09-13T22:14:35.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:35 smithi089 ceph-mon[109939]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:35.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:35 smithi089 ceph-mon[109939]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:35.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:35 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:35.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:35 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:35.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:35 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:35.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:35 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3047070382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:35.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.880+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f00f8104380 con 0x7f00f81015d0 2024-09-13T22:14:35.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.880+0000 7f00f4ff9640 1 -- 172.21.15.89:0/3425282224 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f00ec07bc90 con 0x7f00f81015d0 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:e15 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:14:35.883 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:14:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:14:35.885 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:14:35.886 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:14:35.886 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:14:35.886 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:14:35.886 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:14:35.886 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:14:35.886 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:14:35.886 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.883+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f00e006e600 msgr2=0x7f00e0070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.883+0000 7f00fdf22640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f00e006e600 0x7f00e0070ac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f00e800baa0 tx=0x7f00e8005d90 comp rx=0 tx=0).stop 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.883+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 msgr2=0x7f00f819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.883+0000 7f00fdf22640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 0x7f00f819bd70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00ec006010 tx=0x7f00ec0055a0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.884+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 shutdown_connections 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.884+0000 7f00fdf22640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f00e006e600 0x7f00e0070ac0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.884+0000 7f00fdf22640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00f81015d0 0x7f00f819bd70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.884+0000 7f00fdf22640 1 --2- 172.21.15.89:0/3425282224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f8100cb0 0x7f00f819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.884+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 >> 172.21.15.89:0/3425282224 conn(0x7f00f80758a0 msgr2=0x7f00f8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.884+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 shutdown_connections 2024-09-13T22:14:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.884+0000 7f00fdf22640 1 -- 172.21.15.89:0/3425282224 wait complete. 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.971+0000 7f29bfbd2640 1 -- 172.21.15.89:0/3719871628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b8105bf0 msgr2=0x7f29b8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.971+0000 7f29bfbd2640 1 --2- 172.21.15.89:0/3719871628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b8105bf0 0x7f29b8105fd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009880 tx=0x7f29b402a4d0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.971+0000 7f29bfbd2640 1 -- 172.21.15.89:0/3719871628 shutdown_connections 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.971+0000 7f29bfbd2640 1 --2- 172.21.15.89:0/3719871628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29b80ffb40 0x7f29b80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.971+0000 7f29bfbd2640 1 --2- 172.21.15.89:0/3719871628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b8105bf0 0x7f29b8105fd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.971+0000 7f29bfbd2640 1 -- 172.21.15.89:0/3719871628 >> 172.21.15.89:0/3719871628 conn(0x7f29b80fb860 msgr2=0x7f29b80fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.971+0000 7f29bfbd2640 1 -- 172.21.15.89:0/3719871628 shutdown_connections 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.971+0000 7f29bfbd2640 1 -- 172.21.15.89:0/3719871628 wait complete. 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.972+0000 7f29bfbd2640 1 Processor -- start 2024-09-13T22:14:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.972+0000 7f29bfbd2640 1 -- start start 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.972+0000 7f29bfbd2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b80ffb40 0x7f29b819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.972+0000 7f29bfbd2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29b8105bf0 0x7f29b819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.972+0000 7f29bfbd2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b8195a30 con 0x7f29b80ffb40 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.972+0000 7f29bfbd2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b8195b70 con 0x7f29b8105bf0 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.972+0000 7f29bd96e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b80ffb40 0x7f29b819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.972+0000 7f29bd96e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b80ffb40 0x7f29b819b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53240/0 (socket says 172.21.15.89:53240) 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.972+0000 7f29bd96e640 1 -- 172.21.15.89:0/103289171 learned_addr learned my addr 172.21.15.89:0/103289171 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29bd16d640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29b8105bf0 0x7f29b819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29bd96e640 1 -- 172.21.15.89:0/103289171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29b8105bf0 msgr2=0x7f29b819bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29bd96e640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29b8105bf0 0x7f29b819bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29bd96e640 1 -- 172.21.15.89:0/103289171 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4009560 con 0x7f29b80ffb40 2024-09-13T22:14:35.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29bd96e640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b80ffb40 0x7f29b819b9d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29b402a9f0 tx=0x7f29b40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:35.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29aeffd640 1 -- 172.21.15.89:0/103289171 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b4004aa0 con 0x7f29b80ffb40 2024-09-13T22:14:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29aeffd640 1 -- 172.21.15.89:0/103289171 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29b4004c00 con 0x7f29b80ffb40 2024-09-13T22:14:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b8195df0 con 0x7f29b80ffb40 2024-09-13T22:14:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29aeffd640 1 -- 172.21.15.89:0/103289171 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b4003ab0 con 0x7f29b80ffb40 2024-09-13T22:14:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.973+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b81962e0 con 0x7f29b80ffb40 2024-09-13T22:14:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.974+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b81011f0 con 0x7f29b80ffb40 2024-09-13T22:14:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.975+0000 7f29aeffd640 1 -- 172.21.15.89:0/103289171 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f29b4031d20 con 0x7f29b80ffb40 2024-09-13T22:14:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.975+0000 7f29aeffd640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f29a406e5f0 0x7f29a4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.975+0000 7f29bd16d640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f29a406e5f0 0x7f29a4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.975+0000 7f29aeffd640 1 -- 172.21.15.89:0/103289171 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f29b40af740 con 0x7f29b80ffb40 2024-09-13T22:14:35.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.976+0000 7f29bd16d640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f29a406e5f0 0x7f29a4070ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29a8006fd0 tx=0x7f29a8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:35.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:35.980+0000 7f29aeffd640 1 -- 172.21.15.89:0/103289171 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f29b40788b0 con 0x7f29b80ffb40 2024-09-13T22:14:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:35 smithi159 ceph-mon[82000]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:35 smithi159 ceph-mon[82000]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:35 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:35 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:35 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:35 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3047070382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:36.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.175+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29b810ce30 con 0x7f29a406e5f0 2024-09-13T22:14:36.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.177+0000 7f29aeffd640 1 -- 172.21.15.89:0/103289171 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f29b810ce30 con 0x7f29a406e5f0 2024-09-13T22:14:36.178 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "crash" 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "8/23 daemons upgraded", 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:14:36.179 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:14:36.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.179+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f29a406e5f0 msgr2=0x7f29a4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:36.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.179+0000 7f29bfbd2640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f29a406e5f0 0x7f29a4070ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29a8006fd0 tx=0x7f29a8008040 comp rx=0 tx=0).stop 2024-09-13T22:14:36.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.179+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b80ffb40 msgr2=0x7f29b819b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:36.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.179+0000 7f29bfbd2640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b80ffb40 0x7f29b819b9d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29b402a9f0 tx=0x7f29b40055a0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.180+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 shutdown_connections 2024-09-13T22:14:36.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.180+0000 7f29bfbd2640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f29a406e5f0 0x7f29a4070ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.180+0000 7f29bfbd2640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29b8105bf0 0x7f29b819bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.180+0000 7f29bfbd2640 1 --2- 172.21.15.89:0/103289171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29b80ffb40 0x7f29b819b9d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.180+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 >> 172.21.15.89:0/103289171 conn(0x7f29b80fb860 msgr2=0x7f29b80fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:36.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.180+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 shutdown_connections 2024-09-13T22:14:36.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.180+0000 7f29bfbd2640 1 -- 172.21.15.89:0/103289171 wait complete. 2024-09-13T22:14:36.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.270+0000 7fc94445a640 1 -- 172.21.15.89:0/1469225407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 msgr2=0x7fc93c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:36.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.270+0000 7fc94445a640 1 --2- 172.21.15.89:0/1469225407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 0x7fc93c0fee50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009880 tx=0x7fc92c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.270+0000 7fc94445a640 1 -- 172.21.15.89:0/1469225407 shutdown_connections 2024-09-13T22:14:36.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.270+0000 7fc94445a640 1 --2- 172.21.15.89:0/1469225407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 0x7fc93c0fee50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.270+0000 7fc94445a640 1 --2- 172.21.15.89:0/1469225407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc93c1049f0 0x7fc93c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.270+0000 7fc94445a640 1 -- 172.21.15.89:0/1469225407 >> 172.21.15.89:0/1469225407 conn(0x7fc93c0758a0 msgr2=0x7fc93c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:36.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.270+0000 7fc94445a640 1 -- 172.21.15.89:0/1469225407 shutdown_connections 2024-09-13T22:14:36.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.270+0000 7fc94445a640 1 -- 172.21.15.89:0/1469225407 wait complete. 2024-09-13T22:14:36.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.271+0000 7fc94445a640 1 Processor -- start 2024-09-13T22:14:36.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.271+0000 7fc94445a640 1 -- start start 2024-09-13T22:14:36.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.271+0000 7fc94445a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 0x7fc93c194710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:36.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.271+0000 7fc94445a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc93c1049f0 0x7fc93c194c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:36.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc94445a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c068bd0 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc94445a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c195190 con 0x7fc93c1049f0 2024-09-13T22:14:36.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc9421f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 0x7fc93c194710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:36.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc9421f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 0x7fc93c194710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53252/0 (socket says 172.21.15.89:53252) 2024-09-13T22:14:36.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc9421f6640 1 -- 172.21.15.89:0/1646148996 learned_addr learned my addr 172.21.15.89:0/1646148996 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:14:36.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc9419f5640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc93c1049f0 0x7fc93c194c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:36.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc9421f6640 1 -- 172.21.15.89:0/1646148996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc93c1049f0 msgr2=0x7fc93c194c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:36.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc9421f6640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc93c1049f0 0x7fc93c194c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc9421f6640 1 -- 172.21.15.89:0/1646148996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c009560 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc9419f5640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc93c1049f0 0x7fc93c194c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:14:36.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.272+0000 7fc9421f6640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 0x7fc93c194710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c8a0 tx=0x7fc93800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:36.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.273+0000 7fc9337fe640 1 -- 172.21.15.89:0/1646148996 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc938007b80 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.273+0000 7fc9337fe640 1 -- 172.21.15.89:0/1646148996 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc938007ce0 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.273+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c195470 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.273+0000 7fc9337fe640 1 -- 172.21.15.89:0/1646148996 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc938018810 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.273+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c1a1f50 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.274+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c103fc0 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.275+0000 7fc9337fe640 1 -- 172.21.15.89:0/1646148996 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc938018a80 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.275+0000 7fc9337fe640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc92806e5f0 0x7fc928070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:14:36.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.275+0000 7fc9337fe640 1 -- 172.21.15.89:0/1646148996 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc93808e820 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.276+0000 7fc9419f5640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc92806e5f0 0x7fc928070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:14:36.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.276+0000 7fc9419f5640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc92806e5f0 0x7fc928070ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009230 tx=0x7fc92c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:14:36.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.284+0000 7fc9337fe640 1 -- 172.21.15.89:0/1646148996 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc938057970 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.553+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc93c100130 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.553+0000 7fc9337fe640 1 -- 172.21.15.89:0/1646148996 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1182 (secure 0 0 0) 0x7fc93805b030 con 0x7fc93c0fe9f0 2024-09-13T22:14:36.555 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded 2024-09-13T22:14:36.555 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:14:36.555 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:14:36.555 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T22:14:36.555 INFO:teuthology.orchestra.run.smithi089.stdout: osd.1 (root=default,host=smithi089) is down 2024-09-13T22:14:36.555 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded 2024-09-13T22:14:36.555 INFO:teuthology.orchestra.run.smithi089.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-13T22:14:36.555 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-13T22:14:36.556 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-13T22:14:36.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc92806e5f0 msgr2=0x7fc928070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:36.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc92806e5f0 0x7fc928070ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009230 tx=0x7fc92c0058d0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 msgr2=0x7fc93c194710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:14:36.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 0x7fc93c194710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c8a0 tx=0x7fc93800cd60 comp rx=0 tx=0).stop 2024-09-13T22:14:36.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 shutdown_connections 2024-09-13T22:14:36.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc92806e5f0 0x7fc928070ab0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc93c1049f0 0x7fc93c194c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 --2- 172.21.15.89:0/1646148996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc93c0fe9f0 0x7fc93c194710 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:14:36.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 >> 172.21.15.89:0/1646148996 conn(0x7fc93c0758a0 msgr2=0x7fc93c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:14:36.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 shutdown_connections 2024-09-13T22:14:36.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:14:36.556+0000 7fc94445a640 1 -- 172.21.15.89:0/1646148996 wait complete. 2024-09-13T22:14:36.934 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:36 smithi089 ceph-mon[109939]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:36.934 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:36 smithi089 ceph-mon[109939]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:36.934 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:36 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3425282224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:14:36.934 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:36.934 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:36.934 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:36 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1646148996' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:14:36.934 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:36.935 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:14:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:36 smithi159 ceph-mon[82000]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:36 smithi159 ceph-mon[82000]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:37.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:36 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3425282224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:14:37.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:37.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:37.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:36 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1646148996' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:14:37.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:37.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:14:37.938 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:37 smithi089 ceph-mon[109939]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:37.938 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:37 smithi089 ceph-mon[109939]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:37 smithi159 ceph-mon[82000]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:14:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:37 smithi159 ceph-mon[82000]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:38.518 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:38 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[126578]: 2024-09-13T22:14:38.434+0000 7fbd86eed640 -1 osd.1 54 log_to_monitors true 2024-09-13T22:14:38.966 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:38 smithi089 ceph-mon[109939]: from='osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:14:39.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:38 smithi159 ceph-mon[82000]: from='osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:14:39.599 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:14:39 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[126578]: 2024-09-13T22:14:39.515+0000 7fbd7ac7f640 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:14:39.892 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:39 smithi089 ceph-mon[109939]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:39.892 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:39 smithi089 ceph-mon[109939]: from='osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T22:14:39.892 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:39 smithi089 ceph-mon[109939]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T22:14:39.892 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:39 smithi089 ceph-mon[109939]: from='osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:14:39.892 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:39 smithi089 ceph-mon[109939]: from='osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258]' entity='osd.1' 2024-09-13T22:14:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:39 smithi159 ceph-mon[82000]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:39 smithi159 ceph-mon[82000]: from='osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T22:14:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:39 smithi159 ceph-mon[82000]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T22:14:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:39 smithi159 ceph-mon[82000]: from='osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:14:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:39 smithi159 ceph-mon[82000]: from='osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258]' entity='osd.1' 2024-09-13T22:14:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:14:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:14:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:40.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:14:40.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:40.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:40.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:40.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T22:14:40.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:14:40.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258] boot 2024-09-13T22:14:40.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: osdmap e58: 6 total, 6 up, 6 in 2024-09-13T22:14:40.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:14:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:14:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:14:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:41.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:14:41.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:41.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:41.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:14:41.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T22:14:41.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:14:41.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: osd.1 [v2:172.21.15.89:6810/340772258,v1:172.21.15.89:6811/340772258] boot 2024-09-13T22:14:41.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: osdmap e58: 6 total, 6 up, 6 in 2024-09-13T22:14:41.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:14:42.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:41 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T22:14:42.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:41 smithi089 ceph-mon[109939]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T22:14:42.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:41 smithi089 ceph-mon[109939]: pgmap v74: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:42.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:41 smithi089 ceph-mon[109939]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T22:14:42.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:41 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T22:14:42.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:41 smithi159 ceph-mon[82000]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T22:14:42.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:41 smithi159 ceph-mon[82000]: pgmap v74: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:14:42.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:41 smithi159 ceph-mon[82000]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T22:14:43.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:42 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:43.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:42 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T22:14:44.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:43 smithi089 ceph-mon[109939]: pgmap v76: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16/222 objects degraded (7.207%) 2024-09-13T22:14:44.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:43 smithi159 ceph-mon[82000]: pgmap v76: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16/222 objects degraded (7.207%) 2024-09-13T22:14:45.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:44 smithi159 ceph-mon[82000]: pgmap v77: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:45.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:44 smithi159 ceph-mon[82000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-09-13T22:14:45.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:44 smithi089 ceph-mon[109939]: pgmap v77: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:44 smithi089 ceph-mon[109939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-09-13T22:14:47.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:47 smithi089 ceph-mon[109939]: pgmap v78: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:48.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:47 smithi159 ceph-mon[82000]: pgmap v78: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:49.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:49 smithi089 ceph-mon[109939]: pgmap v79: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:50.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:49 smithi159 ceph-mon[82000]: pgmap v79: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:51.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:51 smithi089 ceph-mon[109939]: pgmap v80: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:51.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:51.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:14:51.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:51 smithi159 ceph-mon[82000]: pgmap v80: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:14:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:53.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:53 smithi089 ceph-mon[109939]: pgmap v81: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:53 smithi159 ceph-mon[82000]: pgmap v81: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:55.821 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:55 smithi089 ceph-mon[109939]: pgmap v82: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:55.821 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:55 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T22:14:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:55 smithi159 ceph-mon[82000]: pgmap v82: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:55 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T22:14:56.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:56 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T22:14:56.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:56 smithi089 ceph-mon[109939]: Upgrade: osd.2 is safe to restart 2024-09-13T22:14:56.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:56 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:56.938 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:56 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:14:56.938 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:56 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:14:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:56 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T22:14:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:56 smithi159 ceph-mon[82000]: Upgrade: osd.2 is safe to restart 2024-09-13T22:14:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:56 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:14:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:56 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:14:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:56 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:14:57.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:57 smithi089 ceph-mon[109939]: Upgrade: Updating osd.2 2024-09-13T22:14:57.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:57 smithi089 ceph-mon[109939]: Deploying daemon osd.2 on smithi089 2024-09-13T22:14:57.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:57 smithi089 ceph-mon[109939]: pgmap v83: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:58.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:57 smithi159 ceph-mon[82000]: Upgrade: Updating osd.2 2024-09-13T22:14:58.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:57 smithi159 ceph-mon[82000]: Deploying daemon osd.2 on smithi089 2024-09-13T22:14:58.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:57 smithi159 ceph-mon[82000]: pgmap v83: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:59.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:14:59 smithi089 systemd[1]: Stopping Ceph osd.2 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:14:59.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:14:59 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[61195]: 2024-09-13T22:14:59.317+0000 7fc97d0b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:14:59.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:14:59 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[61195]: 2024-09-13T22:14:59.317+0000 7fc97d0b8640 -1 osd.2 59 *** Got signal Terminated *** 2024-09-13T22:14:59.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:14:59 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[61195]: 2024-09-13T22:14:59.317+0000 7fc97d0b8640 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:14:59.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:59 smithi089 ceph-mon[109939]: pgmap v84: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:14:59.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:14:59 smithi089 ceph-mon[109939]: osd.2 marked itself down and dead 2024-09-13T22:15:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:59 smithi159 ceph-mon[82000]: pgmap v84: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:14:59 smithi159 ceph-mon[82000]: osd.2 marked itself down and dead 2024-09-13T22:15:00.346 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:00 smithi089 podman[131506]: 2024-09-13 22:15:00.02464237 +0000 UTC m=+0.800875241 container died 9d74fd737dfc3336aa81a06af87c23be3c19063409f02946efff442f1abeabe1 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=reef-e4e227b) 2024-09-13T22:15:00.676 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:00 smithi089 podman[131506]: 2024-09-13 22:15:00.552239041 +0000 UTC m=+1.328471912 container cleanup 9d74fd737dfc3336aa81a06af87c23be3c19063409f02946efff442f1abeabe1 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=reef-e4e227b, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-13T22:15:00.676 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:00 smithi089 bash[131506]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2 2024-09-13T22:15:00.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:00 smithi089 ceph-mon[109939]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:15:00.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:00 smithi089 ceph-mon[109939]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T22:15:00.997 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:00 smithi089 podman[131522]: 2024-09-13 22:15:00.779569244 +0000 UTC m=+0.757469069 container remove 9d74fd737dfc3336aa81a06af87c23be3c19063409f02946efff442f1abeabe1 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2, RELEASE=reef-e4e227b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:15:01.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:00 smithi159 ceph-mon[82000]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:15:01.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:00 smithi159 ceph-mon[82000]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T22:15:01.474 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:01 smithi089 podman[131610]: 2024-09-13 22:15:01.124636035 +0000 UTC m=+0.015529119 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:15:01.475 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:01 smithi089 podman[131610]: 2024-09-13 22:15:01.230321209 +0000 UTC m=+0.121214298 container create 10484369d4c31be4a46fac3fca07324acb044ed2c1c6409ef04af774ca68de63 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:15:01.475 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:01 smithi089 podman[131610]: 2024-09-13 22:15:01.474351582 +0000 UTC m=+0.365244674 container init 10484369d4c31be4a46fac3fca07324acb044ed2c1c6409ef04af774ca68de63 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:15:01.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:01 smithi089 ceph-mon[109939]: pgmap v86: 65 pgs: 9 stale+active+clean, 56 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:01.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:01 smithi089 ceph-mon[109939]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T22:15:01.747 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:01 smithi089 podman[131610]: 2024-09-13 22:15:01.477804434 +0000 UTC m=+0.368697519 container start 10484369d4c31be4a46fac3fca07324acb044ed2c1c6409ef04af774ca68de63 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:15:01.747 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:01 smithi089 podman[131610]: 2024-09-13 22:15:01.557668746 +0000 UTC m=+0.448561847 container attach 10484369d4c31be4a46fac3fca07324acb044ed2c1c6409ef04af774ca68de63 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T22:15:01.748 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:01 smithi089 podman[131610]: 2024-09-13 22:15:01.663902075 +0000 UTC m=+0.554795172 container died 10484369d4c31be4a46fac3fca07324acb044ed2c1c6409ef04af774ca68de63 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS) 2024-09-13T22:15:02.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:01 smithi159 ceph-mon[82000]: pgmap v86: 65 pgs: 9 stale+active+clean, 56 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:02.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:01 smithi159 ceph-mon[82000]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T22:15:02.613 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:02 smithi089 podman[131634]: 2024-09-13 22:15:02.361976999 +0000 UTC m=+0.689360429 container remove 10484369d4c31be4a46fac3fca07324acb044ed2c1c6409ef04af774ca68de63 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux ) 2024-09-13T22:15:02.614 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:02 smithi089 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T22:15:02.614 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:02 smithi089 systemd[1]: Stopped Ceph osd.2 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:15:02.614 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:02 smithi089 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.2.service: Consumed 53.103s CPU time. 2024-09-13T22:15:02.954 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:02 smithi089 ceph-mon[109939]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:02.954 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:02 smithi089 systemd[1]: Starting Ceph osd.2 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:15:02.954 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:02 smithi089 podman[131734]: 2024-09-13 22:15:02.72560862 +0000 UTC m=+0.015897043 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:15:02.955 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:02 smithi089 podman[131734]: 2024-09-13 22:15:02.846784213 +0000 UTC m=+0.137072631 container create acbe4eda739c16fa84abefe85354cfddcb39378feb698fb2c5a5c00840414365 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T22:15:03.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:02 smithi159 ceph-mon[82000]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:03.246 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 podman[131734]: 2024-09-13 22:15:03.124344638 +0000 UTC m=+0.414633056 container init acbe4eda739c16fa84abefe85354cfddcb39378feb698fb2c5a5c00840414365 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T22:15:03.247 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 podman[131734]: 2024-09-13 22:15:03.127882654 +0000 UTC m=+0.418171080 container start acbe4eda739c16fa84abefe85354cfddcb39378feb698fb2c5a5c00840414365 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T22:15:03.247 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 podman[131734]: 2024-09-13 22:15:03.199241864 +0000 UTC m=+0.489530294 container attach acbe4eda739c16fa84abefe85354cfddcb39378feb698fb2c5a5c00840414365 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T22:15:03.742 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate[131750]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:15:03.743 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 bash[131734]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:15:03.743 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate[131750]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:15:03.743 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 bash[131734]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:15:03.994 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:03 smithi089 ceph-mon[109939]: pgmap v88: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-09-13T22:15:03.994 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate[131750]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T22:15:03.994 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 bash[131734]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T22:15:03.994 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate[131750]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T22:15:03.995 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:03 smithi089 bash[131734]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T22:15:04.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:03 smithi159 ceph-mon[82000]: pgmap v88: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-09-13T22:15:04.604 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate[131750]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T22:15:04.604 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 bash[131734]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T22:15:04.604 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate[131750]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T22:15:04.604 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 bash[131734]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T22:15:04.604 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate[131750]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T22:15:04.604 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 bash[131734]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T22:15:04.604 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate[131750]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T22:15:04.604 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 bash[131734]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T22:15:04.604 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate[131750]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T22:15:04.605 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 bash[131734]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T22:15:04.605 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 podman[131734]: 2024-09-13 22:15:04.302955061 +0000 UTC m=+1.593243480 container died acbe4eda739c16fa84abefe85354cfddcb39378feb698fb2c5a5c00840414365 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-13T22:15:05.238 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:04 smithi089 podman[131891]: 2024-09-13 22:15:04.894939575 +0000 UTC m=+0.585767172 container remove acbe4eda739c16fa84abefe85354cfddcb39378feb698fb2c5a5c00840414365 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:15:05.238 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:05 smithi089 podman[131950]: 2024-09-13 22:15:05.005629147 +0000 UTC m=+0.015891757 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:15:05.239 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:05 smithi089 podman[131950]: 2024-09-13 22:15:05.129117934 +0000 UTC m=+0.139380535 container create ffb294d5c14fc50ea0c373d55564ab19ab463b194698bbe652749a891ae9a7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T22:15:05.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:05 smithi089 podman[131950]: 2024-09-13 22:15:05.356547318 +0000 UTC m=+0.366809932 container init ffb294d5c14fc50ea0c373d55564ab19ab463b194698bbe652749a891ae9a7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T22:15:05.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:05 smithi089 podman[131950]: 2024-09-13 22:15:05.359804355 +0000 UTC m=+0.370066957 container start ffb294d5c14fc50ea0c373d55564ab19ab463b194698bbe652749a891ae9a7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T22:15:05.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:05 smithi089 ceph-osd[131969]: -- 172.21.15.89:0/473555295 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56495297a1e0 con 0x564952910000 2024-09-13T22:15:05.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:05 smithi089 bash[131950]: ffb294d5c14fc50ea0c373d55564ab19ab463b194698bbe652749a891ae9a7a8 2024-09-13T22:15:05.497 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:05 smithi089 systemd[1]: Started Ceph osd.2 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:15:05.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:05 smithi089 ceph-mon[109939]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:05.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:05 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:05.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:05 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:05.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:05 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:05 smithi159 ceph-mon[82000]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:05 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:05 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:05 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.648+0000 7f352a760640 1 -- 172.21.15.89:0/1368360710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 msgr2=0x7f35241047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.648+0000 7f352a760640 1 --2- 172.21.15.89:0/1368360710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 0x7f35241047a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f350c009880 tx=0x7f350c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.648+0000 7f352a760640 1 -- 172.21.15.89:0/1368360710 shutdown_connections 2024-09-13T22:15:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.648+0000 7f352a760640 1 --2- 172.21.15.89:0/1368360710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 0x7f35241047a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.648+0000 7f352a760640 1 --2- 172.21.15.89:0/1368360710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35240ffda0 0x7f3524100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.648+0000 7f352a760640 1 -- 172.21.15.89:0/1368360710 >> 172.21.15.89:0/1368360710 conn(0x7f35240fb840 msgr2=0x7f35240fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.648+0000 7f352a760640 1 -- 172.21.15.89:0/1368360710 shutdown_connections 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.648+0000 7f352a760640 1 -- 172.21.15.89:0/1368360710 wait complete. 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f352a760640 1 Processor -- start 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f352a760640 1 -- start start 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f352a760640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35240ffda0 0x7f35240727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f352a760640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 0x7f3524072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f352a760640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524074780 con 0x7f3524100750 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f352a760640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524073230 con 0x7f35240ffda0 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f351bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 0x7f3524072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f351bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 0x7f3524072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55238/0 (socket says 172.21.15.89:55238) 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f351bfff640 1 -- 172.21.15.89:0/2496802050 learned_addr learned my addr 172.21.15.89:0/2496802050 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f3523fff640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35240ffda0 0x7f35240727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f351bfff640 1 -- 172.21.15.89:0/2496802050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35240ffda0 msgr2=0x7f35240727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f351bfff640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35240ffda0 0x7f35240727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f351bfff640 1 -- 172.21.15.89:0/2496802050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009560 con 0x7f3524100750 2024-09-13T22:15:06.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f3523fff640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35240ffda0 0x7f35240727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:15:06.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.649+0000 7f351bfff640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 0x7f3524072cf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f350c02a9c0 tx=0x7f350c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:06.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.650+0000 7f3521ffb640 1 -- 172.21.15.89:0/2496802050 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f350c004aa0 con 0x7f3524100750 2024-09-13T22:15:06.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.650+0000 7f3521ffb640 1 -- 172.21.15.89:0/2496802050 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f350c004c00 con 0x7f3524100750 2024-09-13T22:15:06.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.650+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35240734b0 con 0x7f3524100750 2024-09-13T22:15:06.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.650+0000 7f3521ffb640 1 -- 172.21.15.89:0/2496802050 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f350c003ab0 con 0x7f3524100750 2024-09-13T22:15:06.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.650+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35241a1eb0 con 0x7f3524100750 2024-09-13T22:15:06.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.651+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3524101280 con 0x7f3524100750 2024-09-13T22:15:06.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.651+0000 7f3521ffb640 1 -- 172.21.15.89:0/2496802050 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f350c031d20 con 0x7f3524100750 2024-09-13T22:15:06.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.652+0000 7f3521ffb640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f351006e5f0 0x7f3510070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:06.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.652+0000 7f3521ffb640 1 -- 172.21.15.89:0/2496802050 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f350c0af6e0 con 0x7f3524100750 2024-09-13T22:15:06.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.652+0000 7f3523fff640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f351006e5f0 0x7f3510070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:06.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.652+0000 7f3523fff640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f351006e5f0 0x7f3510070ab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f351400abe0 tx=0x7f351400a5c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:06.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.656+0000 7f3521ffb640 1 -- 172.21.15.89:0/2496802050 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f350c0788b0 con 0x7f3524100750 2024-09-13T22:15:06.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.842+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f352410cdb0 con 0x7f351006e5f0 2024-09-13T22:15:06.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.843+0000 7f3521ffb640 1 -- 172.21.15.89:0/2496802050 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f352410cdb0 con 0x7f351006e5f0 2024-09-13T22:15:06.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.845+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f351006e5f0 msgr2=0x7f3510070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:06.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.845+0000 7f352a760640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f351006e5f0 0x7f3510070ab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f351400abe0 tx=0x7f351400a5c0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.845+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 msgr2=0x7f3524072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:06.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.845+0000 7f352a760640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 0x7f3524072cf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f350c02a9c0 tx=0x7f350c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.845+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 shutdown_connections 2024-09-13T22:15:06.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.845+0000 7f352a760640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f351006e5f0 0x7f3510070ab0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.845+0000 7f352a760640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3524100750 0x7f3524072cf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.845+0000 7f352a760640 1 --2- 172.21.15.89:0/2496802050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35240ffda0 0x7f35240727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.845+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 >> 172.21.15.89:0/2496802050 conn(0x7f35240fb840 msgr2=0x7f35240fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:06.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.846+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 shutdown_connections 2024-09-13T22:15:06.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.846+0000 7f352a760640 1 -- 172.21.15.89:0/2496802050 wait complete. 2024-09-13T22:15:06.856 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:15:06.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.934+0000 7ffa03b23640 1 -- 172.21.15.89:0/3141761473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc100d50 msgr2=0x7ff9fc101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:06.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.934+0000 7ffa03b23640 1 --2- 172.21.15.89:0/3141761473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc100d50 0x7ff9fc101130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009880 tx=0x7ff9ec02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.934+0000 7ffa03b23640 1 -- 172.21.15.89:0/3141761473 shutdown_connections 2024-09-13T22:15:06.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.934+0000 7ffa03b23640 1 --2- 172.21.15.89:0/3141761473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9fc101670 0x7ff9fc109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.934+0000 7ffa03b23640 1 --2- 172.21.15.89:0/3141761473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc100d50 0x7ff9fc101130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.934+0000 7ffa03b23640 1 -- 172.21.15.89:0/3141761473 >> 172.21.15.89:0/3141761473 conn(0x7ff9fc0fa730 msgr2=0x7ff9fc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:06.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.934+0000 7ffa03b23640 1 -- 172.21.15.89:0/3141761473 shutdown_connections 2024-09-13T22:15:06.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.934+0000 7ffa03b23640 1 -- 172.21.15.89:0/3141761473 wait complete. 2024-09-13T22:15:06.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa03b23640 1 Processor -- start 2024-09-13T22:15:06.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa03b23640 1 -- start start 2024-09-13T22:15:06.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa03b23640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9fc100d50 0x7ff9fc19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:06.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa03b23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc101670 0x7ff9fc19bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:06.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa03b23640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc19c320 con 0x7ff9fc101670 2024-09-13T22:15:06.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa03b23640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc1958b0 con 0x7ff9fc100d50 2024-09-13T22:15:06.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa010be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc101670 0x7ff9fc19bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:06.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa010be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc101670 0x7ff9fc19bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55266/0 (socket says 172.21.15.89:55266) 2024-09-13T22:15:06.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa010be640 1 -- 172.21.15.89:0/1100935428 learned_addr learned my addr 172.21.15.89:0/1100935428 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.935+0000 7ffa018bf640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9fc100d50 0x7ff9fc19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.936+0000 7ffa010be640 1 -- 172.21.15.89:0/1100935428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9fc100d50 msgr2=0x7ff9fc19b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.936+0000 7ffa010be640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9fc100d50 0x7ff9fc19b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.936+0000 7ffa010be640 1 -- 172.21.15.89:0/1100935428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec009560 con 0x7ff9fc101670 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.936+0000 7ffa010be640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc101670 0x7ff9fc19bd00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800d8d0 tx=0x7ff9f800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.936+0000 7ff9f2ffd640 1 -- 172.21.15.89:0/1100935428 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f800bea0 con 0x7ff9fc101670 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.936+0000 7ff9f2ffd640 1 -- 172.21.15.89:0/1100935428 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9f8009c00 con 0x7ff9fc101670 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.936+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc195b90 con 0x7ff9fc101670 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.936+0000 7ff9f2ffd640 1 -- 172.21.15.89:0/1100935428 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f800f710 con 0x7ff9fc101670 2024-09-13T22:15:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.936+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc1960e0 con 0x7ff9fc101670 2024-09-13T22:15:06.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.937+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc068cd0 con 0x7ff9fc101670 2024-09-13T22:15:06.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.938+0000 7ff9f2ffd640 1 -- 172.21.15.89:0/1100935428 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff9f8010460 con 0x7ff9fc101670 2024-09-13T22:15:06.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.938+0000 7ff9f2ffd640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff9e806e5f0 0x7ff9e8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:06.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.938+0000 7ff9f2ffd640 1 -- 172.21.15.89:0/1100935428 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff9f808e340 con 0x7ff9fc101670 2024-09-13T22:15:06.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.938+0000 7ffa018bf640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff9e806e5f0 0x7ff9e8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:06.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.939+0000 7ffa018bf640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff9e806e5f0 0x7ff9e8070ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009230 tx=0x7ff9ec0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:06.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:06.943+0000 7ff9f2ffd640 1 -- 172.21.15.89:0/1100935428 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff9f8057560 con 0x7ff9fc101670 2024-09-13T22:15:07.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.131+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9fc10cd50 con 0x7ff9e806e5f0 2024-09-13T22:15:07.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.132+0000 7ff9f2ffd640 1 -- 172.21.15.89:0/1100935428 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff9fc10cd50 con 0x7ff9e806e5f0 2024-09-13T22:15:07.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff9e806e5f0 msgr2=0x7ff9e8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff9e806e5f0 0x7ff9e8070ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009230 tx=0x7ff9ec0058d0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc101670 msgr2=0x7ff9fc19bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc101670 0x7ff9fc19bd00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800d8d0 tx=0x7ff9f800dd90 comp rx=0 tx=0).stop 2024-09-13T22:15:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 shutdown_connections 2024-09-13T22:15:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff9e806e5f0 0x7ff9e8070ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9fc101670 0x7ff9fc19bd00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 --2- 172.21.15.89:0/1100935428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9fc100d50 0x7ff9fc19b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 >> 172.21.15.89:0/1100935428 conn(0x7ff9fc0fa730 msgr2=0x7ff9fc101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 shutdown_connections 2024-09-13T22:15:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.135+0000 7ffa03b23640 1 -- 172.21.15.89:0/1100935428 wait complete. 2024-09-13T22:15:07.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.216+0000 7f3799f63640 1 -- 172.21.15.89:0/4243678572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 msgr2=0x7f3794104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.216+0000 7f3799f63640 1 --2- 172.21.15.89:0/4243678572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 0x7f3794104dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3784009880 tx=0x7f378402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.216+0000 7f3799f63640 1 -- 172.21.15.89:0/4243678572 shutdown_connections 2024-09-13T22:15:07.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.216+0000 7f3799f63640 1 --2- 172.21.15.89:0/4243678572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37940fe9f0 0x7f37940fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.216+0000 7f3799f63640 1 --2- 172.21.15.89:0/4243678572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 0x7f3794104dd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.216+0000 7f3799f63640 1 -- 172.21.15.89:0/4243678572 >> 172.21.15.89:0/4243678572 conn(0x7f37940758a0 msgr2=0x7f37940fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:07.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.216+0000 7f3799f63640 1 -- 172.21.15.89:0/4243678572 shutdown_connections 2024-09-13T22:15:07.219 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:06 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[131965]: 2024-09-13T22:15:06.994+0000 7f4a051bc640 -1 Falling back to public interface 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.216+0000 7f3799f63640 1 -- 172.21.15.89:0/4243678572 wait complete. 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.217+0000 7f3799f63640 1 Processor -- start 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.217+0000 7f3799f63640 1 -- start start 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.217+0000 7f3799f63640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37940fe9f0 0x7f3794105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.217+0000 7f3799f63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 0x7f3794105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.217+0000 7f3799f63640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37941063a0 con 0x7f37941049f0 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.217+0000 7f3799f63640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37941064e0 con 0x7f37940fe9f0 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.217+0000 7f3792ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 0x7f3794105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.217+0000 7f3792ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 0x7f3794105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55282/0 (socket says 172.21.15.89:55282) 2024-09-13T22:15:07.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.217+0000 7f3792ffd640 1 -- 172.21.15.89:0/1381639302 learned_addr learned my addr 172.21.15.89:0/1381639302 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:07.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f37937fe640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37940fe9f0 0x7f3794105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:07.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f3792ffd640 1 -- 172.21.15.89:0/1381639302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37940fe9f0 msgr2=0x7f3794105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f3792ffd640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37940fe9f0 0x7f3794105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f3792ffd640 1 -- 172.21.15.89:0/1381639302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784009560 con 0x7f37941049f0 2024-09-13T22:15:07.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f3792ffd640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 0x7f3794105e60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f378800d8d0 tx=0x7f378800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:07.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f3790ff9640 1 -- 172.21.15.89:0/1381639302 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f378800bea0 con 0x7f37941049f0 2024-09-13T22:15:07.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f3790ff9640 1 -- 172.21.15.89:0/1381639302 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3788009c00 con 0x7f37941049f0 2024-09-13T22:15:07.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37941a1c90 con 0x7f37941049f0 2024-09-13T22:15:07.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f3790ff9640 1 -- 172.21.15.89:0/1381639302 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f378800f710 con 0x7f37941049f0 2024-09-13T22:15:07.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.218+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37941a20a0 con 0x7f37941049f0 2024-09-13T22:15:07.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.219+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3794100130 con 0x7f37941049f0 2024-09-13T22:15:07.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.220+0000 7f3790ff9640 1 -- 172.21.15.89:0/1381639302 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3788010460 con 0x7f37941049f0 2024-09-13T22:15:07.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.220+0000 7f3790ff9640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f377c06e600 0x7f377c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:07.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.220+0000 7f3790ff9640 1 -- 172.21.15.89:0/1381639302 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f378808e400 con 0x7f37941049f0 2024-09-13T22:15:07.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.220+0000 7f37937fe640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f377c06e600 0x7f377c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:07.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.221+0000 7f37937fe640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f377c06e600 0x7f377c070ac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3784009230 tx=0x7f3784005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:07.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.225+0000 7f3790ff9640 1 -- 172.21.15.89:0/1381639302 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3788057600 con 0x7f37941049f0 2024-09-13T22:15:07.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.416+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f379410bcd0 con 0x7f377c06e600 2024-09-13T22:15:07.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.426+0000 7f3790ff9640 1 -- 172.21.15.89:0/1381639302 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f379410bcd0 con 0x7f377c06e600 2024-09-13T22:15:07.427 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:15:07.427 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (3m) 31s ago 14m 25.8M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:15:07.427 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (14m) 31s ago 14m 8372k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:15:07.427 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (13m) 88s ago 13m 8174k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:15:07.427 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (97s) 31s ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (92s) 88s ago 13m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (3m) 31s ago 13m 78.7M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (8m) 31s ago 8m 18.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (8m) 31s ago 8m 16.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (8m) 88s ago 8m 161M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (8m) 88s ago 8m 17.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (5m) 31s ago 15m 499M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (4m) 88s ago 13m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (2m) 31s ago 15m 46.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (2m) 88s ago 13m 34.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (4m) 31s ago 14m 15.6M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:15:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (4m) 88s ago 13m 15.7M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:15:07.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (72s) 31s ago 12m 93.0M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:15:07.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (37s) 31s ago 12m 12.1M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 3d2a1d778a36 2024-09-13T22:15:07.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 starting - - - 1215M 2024-09-13T22:15:07.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (11m) 88s ago 11m 286M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:15:07.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (10m) 88s ago 10m 250M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:15:07.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (10m) 88s ago 10m 255M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:15:07.429 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (4m) 31s ago 13m 63.9M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:15:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.428+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f377c06e600 msgr2=0x7f377c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.428+0000 7f3799f63640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f377c06e600 0x7f377c070ac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3784009230 tx=0x7f3784005a20 comp rx=0 tx=0).stop 2024-09-13T22:15:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.428+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 msgr2=0x7f3794105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.428+0000 7f3799f63640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 0x7f3794105e60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f378800d8d0 tx=0x7f378800dd90 comp rx=0 tx=0).stop 2024-09-13T22:15:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.428+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 shutdown_connections 2024-09-13T22:15:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.428+0000 7f3799f63640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f377c06e600 0x7f377c070ac0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.428+0000 7f3799f63640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37941049f0 0x7f3794105e60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.428+0000 7f3799f63640 1 --2- 172.21.15.89:0/1381639302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37940fe9f0 0x7f3794105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.428+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 >> 172.21.15.89:0/1381639302 conn(0x7f37940758a0 msgr2=0x7f3794067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:07.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.429+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 shutdown_connections 2024-09-13T22:15:07.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.429+0000 7f3799f63640 1 -- 172.21.15.89:0/1381639302 wait complete. 2024-09-13T22:15:07.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.515+0000 7fb6d88e5640 1 -- 172.21.15.89:0/1861276406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d40ffda0 msgr2=0x7fb6d4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.515+0000 7fb6d88e5640 1 --2- 172.21.15.89:0/1861276406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d40ffda0 0x7fb6d4100180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009880 tx=0x7fb6c402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.515+0000 7fb6d88e5640 1 -- 172.21.15.89:0/1861276406 shutdown_connections 2024-09-13T22:15:07.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.515+0000 7fb6d88e5640 1 --2- 172.21.15.89:0/1861276406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d4100750 0x7fb6d41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.515+0000 7fb6d88e5640 1 --2- 172.21.15.89:0/1861276406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d40ffda0 0x7fb6d4100180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.515+0000 7fb6d88e5640 1 -- 172.21.15.89:0/1861276406 >> 172.21.15.89:0/1861276406 conn(0x7fb6d40fb840 msgr2=0x7fb6d40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.515+0000 7fb6d88e5640 1 -- 172.21.15.89:0/1861276406 shutdown_connections 2024-09-13T22:15:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.515+0000 7fb6d88e5640 1 -- 172.21.15.89:0/1861276406 wait complete. 2024-09-13T22:15:07.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d88e5640 1 Processor -- start 2024-09-13T22:15:07.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d88e5640 1 -- start start 2024-09-13T22:15:07.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d88e5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d40ffda0 0x7fb6d40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:07.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d88e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d4100750 0x7fb6d4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:07.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d88e5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4073230 con 0x7fb6d4100750 2024-09-13T22:15:07.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d88e5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40733a0 con 0x7fb6d40ffda0 2024-09-13T22:15:07.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d1d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d4100750 0x7fb6d4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:07.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d1d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d4100750 0x7fb6d4072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55302/0 (socket says 172.21.15.89:55302) 2024-09-13T22:15:07.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d1d9b640 1 -- 172.21.15.89:0/4162752823 learned_addr learned my addr 172.21.15.89:0/4162752823 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:07.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d259c640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d40ffda0 0x7fb6d40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:07.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d1d9b640 1 -- 172.21.15.89:0/4162752823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d40ffda0 msgr2=0x7fb6d40727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d1d9b640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d40ffda0 0x7fb6d40727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.516+0000 7fb6d1d9b640 1 -- 172.21.15.89:0/4162752823 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009560 con 0x7fb6d4100750 2024-09-13T22:15:07.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.517+0000 7fb6d1d9b640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d4100750 0x7fb6d4072cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00b420 tx=0x7fb6bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:07.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.517+0000 7fb6cb7fe640 1 -- 172.21.15.89:0/4162752823 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6bc011800 con 0x7fb6d4100750 2024-09-13T22:15:07.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.517+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d41a1d90 con 0x7fb6d4100750 2024-09-13T22:15:07.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.517+0000 7fb6cb7fe640 1 -- 172.21.15.89:0/4162752823 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6bc011e20 con 0x7fb6d4100750 2024-09-13T22:15:07.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.517+0000 7fb6cb7fe640 1 -- 172.21.15.89:0/4162752823 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6bc00f2e0 con 0x7fb6d4100750 2024-09-13T22:15:07.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.517+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d41a20f0 con 0x7fb6d4100750 2024-09-13T22:15:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.518+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d4101280 con 0x7fb6d4100750 2024-09-13T22:15:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.518+0000 7fb6cb7fe640 1 -- 172.21.15.89:0/4162752823 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb6bc010380 con 0x7fb6d4100750 2024-09-13T22:15:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.519+0000 7fb6cb7fe640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb6c006e600 0x7fb6c0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.519+0000 7fb6cb7fe640 1 -- 172.21.15.89:0/4162752823 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb6bc08e020 con 0x7fb6d4100750 2024-09-13T22:15:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.519+0000 7fb6d259c640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb6c006e600 0x7fb6c0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.519+0000 7fb6d259c640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb6c006e600 0x7fb6c0070ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4006010 tx=0x7fb6c4000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.523+0000 7fb6cb7fe640 1 -- 172.21.15.89:0/4162752823 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb6bc057170 con 0x7fb6d4100750 2024-09-13T22:15:07.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.765+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb6d4108150 con 0x7fb6d4100750 2024-09-13T22:15:07.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:07 smithi089 ceph-mon[109939]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:07.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:07.767 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:15:07.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.766+0000 7fb6cb7fe640 1 -- 172.21.15.89:0/4162752823 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fb6bc05a830 con 0x7fb6d4100750 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 3, 2024-09-13T22:15:07.768 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:15:07.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:15:07.769 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:15:07.769 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:15:07.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:15:07.769 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:15:07.769 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 7, 2024-09-13T22:15:07.769 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T22:15:07.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:15:07.769 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:15:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb6c006e600 msgr2=0x7fb6c0070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb6c006e600 0x7fb6c0070ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4006010 tx=0x7fb6c4000bc0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d4100750 msgr2=0x7fb6d4072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d4100750 0x7fb6d4072cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00b420 tx=0x7fb6bc00b8e0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 shutdown_connections 2024-09-13T22:15:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb6c006e600 0x7fb6c0070ac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d4100750 0x7fb6d4072cf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 --2- 172.21.15.89:0/4162752823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d40ffda0 0x7fb6d40727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 >> 172.21.15.89:0/4162752823 conn(0x7fb6d40fb840 msgr2=0x7fb6d40fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 shutdown_connections 2024-09-13T22:15:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.768+0000 7fb6d88e5640 1 -- 172.21.15.89:0/4162752823 wait complete. 2024-09-13T22:15:07.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.850+0000 7ff6c5d93640 1 -- 172.21.15.89:0/3662603151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 msgr2=0x7ff6c0104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.850+0000 7ff6c5d93640 1 --2- 172.21.15.89:0/3662603151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 0x7ff6c0104dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009880 tx=0x7ff6b002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.851+0000 7ff6c5d93640 1 -- 172.21.15.89:0/3662603151 shutdown_connections 2024-09-13T22:15:07.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.851+0000 7ff6c5d93640 1 --2- 172.21.15.89:0/3662603151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c00fe9f0 0x7ff6c00fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.851+0000 7ff6c5d93640 1 --2- 172.21.15.89:0/3662603151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 0x7ff6c0104dd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.851+0000 7ff6c5d93640 1 -- 172.21.15.89:0/3662603151 >> 172.21.15.89:0/3662603151 conn(0x7ff6c00758a0 msgr2=0x7ff6c00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:07.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.851+0000 7ff6c5d93640 1 -- 172.21.15.89:0/3662603151 shutdown_connections 2024-09-13T22:15:07.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.851+0000 7ff6c5d93640 1 -- 172.21.15.89:0/3662603151 wait complete. 2024-09-13T22:15:07.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.851+0000 7ff6c5d93640 1 Processor -- start 2024-09-13T22:15:07.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6c5d93640 1 -- start start 2024-09-13T22:15:07.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6c5d93640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c00fe9f0 0x7ff6c019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:07.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6c5d93640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 0x7ff6c019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:07.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6c5d93640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0195900 con 0x7ff6c01049f0 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6c5d93640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0195a70 con 0x7ff6c00fe9f0 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6beffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 0x7ff6c019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6beffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 0x7ff6c019bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55314/0 (socket says 172.21.15.89:55314) 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6beffd640 1 -- 172.21.15.89:0/1443625247 learned_addr learned my addr 172.21.15.89:0/1443625247 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6bf7fe640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c00fe9f0 0x7ff6c019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6beffd640 1 -- 172.21.15.89:0/1443625247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c00fe9f0 msgr2=0x7ff6c019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6beffd640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c00fe9f0 0x7ff6c019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6beffd640 1 -- 172.21.15.89:0/1443625247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0009560 con 0x7ff6c01049f0 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6beffd640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 0x7ff6c019bd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400d6f0 tx=0x7ff6b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.852+0000 7ff6bcff9640 1 -- 172.21.15.89:0/1443625247 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b4009a30 con 0x7ff6c01049f0 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.853+0000 7ff6bcff9640 1 -- 172.21.15.89:0/1443625247 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6b40054e0 con 0x7ff6c01049f0 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.853+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c0195d50 con 0x7ff6c01049f0 2024-09-13T22:15:07.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.853+0000 7ff6bcff9640 1 -- 172.21.15.89:0/1443625247 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b4010460 con 0x7ff6c01049f0 2024-09-13T22:15:07.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.853+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c01962a0 con 0x7ff6c01049f0 2024-09-13T22:15:07.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.853+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c0100130 con 0x7ff6c01049f0 2024-09-13T22:15:07.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.854+0000 7ff6bcff9640 1 -- 172.21.15.89:0/1443625247 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff6b4009b90 con 0x7ff6c01049f0 2024-09-13T22:15:07.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.854+0000 7ff6bcff9640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff6a806e600 0x7ff6a8070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:07.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.855+0000 7ff6bcff9640 1 -- 172.21.15.89:0/1443625247 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff6b408e100 con 0x7ff6c01049f0 2024-09-13T22:15:07.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.855+0000 7ff6bf7fe640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff6a806e600 0x7ff6a8070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:07.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.855+0000 7ff6bf7fe640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff6a806e600 0x7ff6a8070ac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009230 tx=0x7ff6b0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:07.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:07.859+0000 7ff6bcff9640 1 -- 172.21.15.89:0/1443625247 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff6b4057380 con 0x7ff6c01049f0 2024-09-13T22:15:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:07 smithi159 ceph-mon[82000]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:15:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.062+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6c0196e40 con 0x7ff6c01049f0 2024-09-13T22:15:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.062+0000 7ff6bcff9640 1 -- 172.21.15.89:0/1443625247 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1915 (secure 0 0 0) 0x7ff6b4017790 con 0x7ff6c01049f0 2024-09-13T22:15:08.064 INFO:teuthology.orchestra.run.smithi089.stdout:e15 2024-09-13T22:15:08.064 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:15:08.064 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:15:08.064 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:15:08.064 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:15:08.064 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:15:08.064 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:15:08.065 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:15:08.066 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:15:08.067 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:15:08.068 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:15:08.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff6a806e600 msgr2=0x7ff6a8070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff6a806e600 0x7ff6a8070ac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009230 tx=0x7ff6b0005a20 comp rx=0 tx=0).stop 2024-09-13T22:15:08.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 msgr2=0x7ff6c019bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 0x7ff6c019bd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400d6f0 tx=0x7ff6b400dbb0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 shutdown_connections 2024-09-13T22:15:08.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff6a806e600 0x7ff6a8070ac0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6c01049f0 0x7ff6c019bd50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 --2- 172.21.15.89:0/1443625247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c00fe9f0 0x7ff6c019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 >> 172.21.15.89:0/1443625247 conn(0x7ff6c00758a0 msgr2=0x7ff6c0102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:08.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 shutdown_connections 2024-09-13T22:15:08.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.065+0000 7ff6c5d93640 1 -- 172.21.15.89:0/1443625247 wait complete. 2024-09-13T22:15:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.149+0000 7f5faeac1640 1 -- 172.21.15.89:0/3997690722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 msgr2=0x7f5fa8102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.149+0000 7f5faeac1640 1 --2- 172.21.15.89:0/3997690722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 0x7f5fa8102e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009880 tx=0x7f5f9402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.149+0000 7f5faeac1640 1 -- 172.21.15.89:0/3997690722 shutdown_connections 2024-09-13T22:15:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.149+0000 7f5faeac1640 1 --2- 172.21.15.89:0/3997690722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 0x7f5fa8102e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.149+0000 7f5faeac1640 1 --2- 172.21.15.89:0/3997690722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fa80fe410 0x7f5fa80fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.149+0000 7f5faeac1640 1 -- 172.21.15.89:0/3997690722 >> 172.21.15.89:0/3997690722 conn(0x7f5fa80f9e70 msgr2=0x7f5fa80fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.149+0000 7f5faeac1640 1 -- 172.21.15.89:0/3997690722 shutdown_connections 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.149+0000 7f5faeac1640 1 -- 172.21.15.89:0/3997690722 wait complete. 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5faeac1640 1 Processor -- start 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5faeac1640 1 -- start start 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5faeac1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fa80fe410 0x7f5fa819b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5faeac1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 0x7f5fa819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5faeac1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa819c3a0 con 0x7f5fa80fedc0 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5faeac1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8195930 con 0x7f5fa80fe410 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5fa7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 0x7f5fa819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5fa7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 0x7f5fa819bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55332/0 (socket says 172.21.15.89:55332) 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5fa7fff640 1 -- 172.21.15.89:0/3107218334 learned_addr learned my addr 172.21.15.89:0/3107218334 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5fac85d640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fa80fe410 0x7f5fa819b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5fa7fff640 1 -- 172.21.15.89:0/3107218334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fa80fe410 msgr2=0x7f5fa819b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5fa7fff640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fa80fe410 0x7f5fa819b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.150+0000 7f5fa7fff640 1 -- 172.21.15.89:0/3107218334 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f94009560 con 0x7f5fa80fedc0 2024-09-13T22:15:08.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.151+0000 7f5fa7fff640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 0x7f5fa819bd80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006010 tx=0x7f5f940055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:08.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.151+0000 7f5fa5ffb640 1 -- 172.21.15.89:0/3107218334 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f94004aa0 con 0x7f5fa80fedc0 2024-09-13T22:15:08.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.151+0000 7f5fa5ffb640 1 -- 172.21.15.89:0/3107218334 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f94031470 con 0x7f5fa80fedc0 2024-09-13T22:15:08.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.151+0000 7f5fa5ffb640 1 -- 172.21.15.89:0/3107218334 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f94003940 con 0x7f5fa80fedc0 2024-09-13T22:15:08.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.151+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa8195bb0 con 0x7f5fa80fedc0 2024-09-13T22:15:08.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.151+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa81960a0 con 0x7f5fa80fedc0 2024-09-13T22:15:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.152+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa80ff8f0 con 0x7f5fa80fedc0 2024-09-13T22:15:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.152+0000 7f5fa5ffb640 1 -- 172.21.15.89:0/3107218334 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5f94031b90 con 0x7f5fa80fedc0 2024-09-13T22:15:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.153+0000 7f5fa5ffb640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5f9806e600 0x7f5f98070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:08.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.153+0000 7f5fac85d640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5f9806e600 0x7f5f98070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:08.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.153+0000 7f5fa5ffb640 1 -- 172.21.15.89:0/3107218334 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5f940af700 con 0x7f5fa80fedc0 2024-09-13T22:15:08.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.154+0000 7f5fac85d640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5f9806e600 0x7f5f98070ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c005fd0 tx=0x7f5f9c00b490 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:08.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.157+0000 7f5fa5ffb640 1 -- 172.21.15.89:0/3107218334 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5f940788e0 con 0x7f5fa80fedc0 2024-09-13T22:15:08.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.364+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fa810abc0 con 0x7f5f9806e600 2024-09-13T22:15:08.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.365+0000 7f5fa5ffb640 1 -- 172.21.15.89:0/3107218334 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5fa810abc0 con 0x7f5f9806e600 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "crash" 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "8/23 daemons upgraded", 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:15:08.367 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:15:08.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5f9806e600 msgr2=0x7f5f98070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5f9806e600 0x7f5f98070ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c005fd0 tx=0x7f5f9c00b490 comp rx=0 tx=0).stop 2024-09-13T22:15:08.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 msgr2=0x7f5fa819bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 0x7f5fa819bd80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006010 tx=0x7f5f940055a0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 shutdown_connections 2024-09-13T22:15:08.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f5f9806e600 0x7f5f98070ac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fa80fedc0 0x7f5fa819bd80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 --2- 172.21.15.89:0/3107218334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fa80fe410 0x7f5fa819b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 >> 172.21.15.89:0/3107218334 conn(0x7f5fa80f9e70 msgr2=0x7f5fa80fb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:08.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 shutdown_connections 2024-09-13T22:15:08.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.368+0000 7f5faeac1640 1 -- 172.21.15.89:0/3107218334 wait complete. 2024-09-13T22:15:08.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.450+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2164444599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa80fea20 msgr2=0x7f2fa80fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.450+0000 7f2fb01d8640 1 --2- 172.21.15.89:0/2164444599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa80fea20 0x7f2fa80fee80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009880 tx=0x7f2f9802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.450+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2164444599 shutdown_connections 2024-09-13T22:15:08.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.450+0000 7f2fb01d8640 1 --2- 172.21.15.89:0/2164444599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa80fea20 0x7f2fa80fee80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.450+0000 7f2fb01d8640 1 --2- 172.21.15.89:0/2164444599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa8104a20 0x7f2fa8104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.450+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2164444599 >> 172.21.15.89:0/2164444599 conn(0x7f2fa80fa700 msgr2=0x7f2fa80fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.450+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2164444599 shutdown_connections 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.450+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2164444599 wait complete. 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.451+0000 7f2fb01d8640 1 Processor -- start 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.451+0000 7f2fb01d8640 1 -- start start 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.451+0000 7f2fb01d8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa80fea20 0x7f2fa8196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.451+0000 7f2fb01d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa8104a20 0x7f2fa8196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.451+0000 7f2fb01d8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8197530 con 0x7f2fa8104a20 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.451+0000 7f2fb01d8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa81976a0 con 0x7f2fa80fea20 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.451+0000 7f2fad773640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa8104a20 0x7f2fa8196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:08.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.451+0000 7f2fad773640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa8104a20 0x7f2fa8196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55354/0 (socket says 172.21.15.89:55354) 2024-09-13T22:15:08.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.451+0000 7f2fad773640 1 -- 172.21.15.89:0/2339648751 learned_addr learned my addr 172.21.15.89:0/2339648751 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:08.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.452+0000 7f2fad773640 1 -- 172.21.15.89:0/2339648751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa80fea20 msgr2=0x7f2fa8196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.452+0000 7f2fad773640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa80fea20 0x7f2fa8196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.452+0000 7f2fad773640 1 -- 172.21.15.89:0/2339648751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98009560 con 0x7f2fa8104a20 2024-09-13T22:15:08.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.452+0000 7f2fad773640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa8104a20 0x7f2fa8196ff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f9802a9c0 tx=0x7f2f980055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:08.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.452+0000 7f2f9effd640 1 -- 172.21.15.89:0/2339648751 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f98004aa0 con 0x7f2fa8104a20 2024-09-13T22:15:08.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.452+0000 7f2f9effd640 1 -- 172.21.15.89:0/2339648751 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f98004c00 con 0x7f2fa8104a20 2024-09-13T22:15:08.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.452+0000 7f2f9effd640 1 -- 172.21.15.89:0/2339648751 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f98003ab0 con 0x7f2fa8104a20 2024-09-13T22:15:08.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.452+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa8197920 con 0x7f2fa8104a20 2024-09-13T22:15:08.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.452+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa819fe50 con 0x7f2fa8104a20 2024-09-13T22:15:08.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.453+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa8100160 con 0x7f2fa8104a20 2024-09-13T22:15:08.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.454+0000 7f2f9effd640 1 -- 172.21.15.89:0/2339648751 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2f98003c10 con 0x7f2fa8104a20 2024-09-13T22:15:08.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.454+0000 7f2f9effd640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2f9406e5f0 0x7f2f94070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:08.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.454+0000 7f2f9effd640 1 -- 172.21.15.89:0/2339648751 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2f980af550 con 0x7f2fa8104a20 2024-09-13T22:15:08.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.454+0000 7f2fadf74640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2f9406e5f0 0x7f2f94070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:08.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.455+0000 7f2fadf74640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2f9406e5f0 0x7f2f94070ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400ab90 tx=0x7f2fa4009250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:08.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.458+0000 7f2f9effd640 1 -- 172.21.15.89:0/2339648751 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f98078720 con 0x7f2fa8104a20 2024-09-13T22:15:08.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.703+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2fa8197920 con 0x7f2fa8104a20 2024-09-13T22:15:08.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.704+0000 7f2f9effd640 1 -- 172.21.15.89:0/2339648751 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1074 (secure 0 0 0) 0x7f2fa8197920 con 0x7f2fa8104a20 2024-09-13T22:15:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded 2024-09-13T22:15:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:15:08.705 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:15:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T22:15:08.705 INFO:teuthology.orchestra.run.smithi089.stdout: osd.2 (root=default,host=smithi089) is down 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-13T22:15:08.706 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-13T22:15:08.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2f9406e5f0 msgr2=0x7f2f94070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2f9406e5f0 0x7f2f94070ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400ab90 tx=0x7f2fa4009250 comp rx=0 tx=0).stop 2024-09-13T22:15:08.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa8104a20 msgr2=0x7f2fa8196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:08.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa8104a20 0x7f2fa8196ff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f9802a9c0 tx=0x7f2f980055a0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 shutdown_connections 2024-09-13T22:15:08.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2f9406e5f0 0x7f2f94070ab0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fa8104a20 0x7f2fa8196ff0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 --2- 172.21.15.89:0/2339648751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa80fea20 0x7f2fa8196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:08.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 >> 172.21.15.89:0/2339648751 conn(0x7f2fa80fa700 msgr2=0x7f2fa80fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:08.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 shutdown_connections 2024-09-13T22:15:08.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:08.706+0000 7f2fb01d8640 1 -- 172.21.15.89:0/2339648751 wait complete. 2024-09-13T22:15:08.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:08 smithi089 ceph-mon[109939]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:08.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:08 smithi089 ceph-mon[109939]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:08.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:08 smithi089 ceph-mon[109939]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:08.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:08 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/4162752823' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:08.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:08 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1443625247' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:15:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:08 smithi159 ceph-mon[82000]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:08 smithi159 ceph-mon[82000]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:08 smithi159 ceph-mon[82000]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:08 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/4162752823' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:09.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:08 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1443625247' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:15:09.954 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:09 smithi089 ceph-mon[109939]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:09.954 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:09 smithi089 ceph-mon[109939]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:09.954 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:09 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2339648751' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:15:10.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:09 smithi159 ceph-mon[82000]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:10.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:09 smithi159 ceph-mon[82000]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:10.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:09 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2339648751' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:15:10.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:10 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:10.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:10 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:10.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:10 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:11.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:10 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:11.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:10 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:11.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:10 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:11.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:11 smithi089 ceph-mon[109939]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:11.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:11.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:11 smithi159 ceph-mon[82000]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:12.997 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:12 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[131965]: 2024-09-13T22:15:12.957+0000 7f4a051bc640 -1 osd.2 59 log_to_monitors true 2024-09-13T22:15:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:13 smithi089 ceph-mon[109939]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:13 smithi089 ceph-mon[109939]: from='osd.2 [v2:172.21.15.89:6818/2606015125,v1:172.21.15.89:6819/2606015125]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:15:13.997 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:15:13 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[131965]: 2024-09-13T22:15:13.661+0000 7f49f8f4e640 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:15:14.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:13 smithi159 ceph-mon[82000]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:14.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:13 smithi159 ceph-mon[82000]: from='osd.2 [v2:172.21.15.89:6818/2606015125,v1:172.21.15.89:6819/2606015125]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:15:14.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:14 smithi089 ceph-mon[109939]: from='osd.2 [v2:172.21.15.89:6818/2606015125,v1:172.21.15.89:6819/2606015125]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T22:15:14.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:14 smithi089 ceph-mon[109939]: osdmap e62: 6 total, 5 up, 6 in 2024-09-13T22:15:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:14 smithi089 ceph-mon[109939]: from='osd.2 [v2:172.21.15.89:6818/2606015125,v1:172.21.15.89:6819/2606015125]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:15:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:15:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:15:14.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:14 smithi159 ceph-mon[82000]: from='osd.2 [v2:172.21.15.89:6818/2606015125,v1:172.21.15.89:6819/2606015125]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T22:15:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:14 smithi159 ceph-mon[82000]: osdmap e62: 6 total, 5 up, 6 in 2024-09-13T22:15:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:14 smithi159 ceph-mon[82000]: from='osd.2 [v2:172.21.15.89:6818/2606015125,v1:172.21.15.89:6819/2606015125]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T22:15:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:15:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:15:15.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: osd.2 [v2:172.21.15.89:6818/2606015125,v1:172.21.15.89:6819/2606015125] boot 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T22:15:15.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T22:15:15.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:15 smithi089 ceph-mon[109939]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T22:15:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:15:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: osd.2 [v2:172.21.15.89:6818/2606015125,v1:172.21.15.89:6819/2606015125] boot 2024-09-13T22:15:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T22:15:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:15:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:16.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T22:15:16.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T22:15:16.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:15 smithi159 ceph-mon[82000]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T22:15:16.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:16 smithi089 ceph-mon[109939]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T22:15:17.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:16 smithi159 ceph-mon[82000]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T22:15:17.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:17 smithi089 ceph-mon[109939]: pgmap v98: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:17 smithi159 ceph-mon[82000]: pgmap v98: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-13T22:15:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:18 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:19.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:18 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:19.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:19 smithi089 ceph-mon[109939]: pgmap v99: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-09-13T22:15:20.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:19 smithi159 ceph-mon[82000]: pgmap v99: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-09-13T22:15:21.191 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:20 smithi089 ceph-mon[109939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded) 2024-09-13T22:15:21.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:20 smithi159 ceph-mon[82000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded) 2024-09-13T22:15:22.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:21 smithi089 ceph-mon[109939]: pgmap v100: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:22.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:22.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:15:22.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:21 smithi159 ceph-mon[82000]: pgmap v100: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:22.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:22.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:15:24.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:23 smithi089 ceph-mon[109939]: pgmap v101: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:24.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:23 smithi159 ceph-mon[82000]: pgmap v101: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:26.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:25 smithi089 ceph-mon[109939]: pgmap v102: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:26.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:25 smithi159 ceph-mon[82000]: pgmap v102: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:27.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:27 smithi089 ceph-mon[109939]: pgmap v103: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:28.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:27 smithi159 ceph-mon[82000]: pgmap v103: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:28.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:29.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:29 smithi089 ceph-mon[109939]: pgmap v104: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:30.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:29 smithi159 ceph-mon[82000]: pgmap v104: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:30.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:30 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T22:15:30.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:30 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T22:15:30.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:30 smithi089 ceph-mon[109939]: Upgrade: osd.3 is safe to restart 2024-09-13T22:15:31.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:30 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T22:15:31.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:30 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T22:15:31.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:30 smithi159 ceph-mon[82000]: Upgrade: osd.3 is safe to restart 2024-09-13T22:15:31.855 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:31 smithi159 ceph-mon[82000]: pgmap v105: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:31.855 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:31.855 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T22:15:31.855 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:15:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:31 smithi089 ceph-mon[109939]: pgmap v105: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T22:15:31.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:15:32.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:32 smithi159 ceph-mon[82000]: Upgrade: Updating osd.3 2024-09-13T22:15:32.913 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:32 smithi159 ceph-mon[82000]: Deploying daemon osd.3 on smithi159 2024-09-13T22:15:32.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:32 smithi089 ceph-mon[109939]: Upgrade: Updating osd.3 2024-09-13T22:15:32.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:32 smithi089 ceph-mon[109939]: Deploying daemon osd.3 on smithi159 2024-09-13T22:15:33.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:33 smithi159 ceph-mon[82000]: pgmap v106: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:33.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:33 smithi089 ceph-mon[109939]: pgmap v106: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:34.509 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:34 smithi159 systemd[1]: Stopping Ceph osd.3 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:15:34.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:34 smithi089 ceph-mon[109939]: osd.3 marked itself down and dead 2024-09-13T22:15:35.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:34 smithi159 ceph-mon[82000]: osd.3 marked itself down and dead 2024-09-13T22:15:35.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:34 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[41282]: 2024-09-13T22:15:34.545+0000 7f83c91b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:15:35.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:34 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[41282]: 2024-09-13T22:15:34.545+0000 7f83c91b3640 -1 osd.3 64 *** Got signal Terminated *** 2024-09-13T22:15:35.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:34 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[41282]: 2024-09-13T22:15:34.545+0000 7f83c91b3640 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:15:35.422 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:35 smithi159 podman[91007]: 2024-09-13 22:15:35.117594889 +0000 UTC m=+0.717959956 container died 8d30b6ee913098420a69f8590526c133d19fda2c9275d115fb92146af8bf3ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-e4e227b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T22:15:35.695 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:35 smithi159 podman[91007]: 2024-09-13 22:15:35.546997318 +0000 UTC m=+1.147362374 container cleanup 8d30b6ee913098420a69f8590526c133d19fda2c9275d115fb92146af8bf3ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-e4e227b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T22:15:35.695 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:35 smithi159 bash[91007]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3 2024-09-13T22:15:35.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:35 smithi089 ceph-mon[109939]: pgmap v107: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:35.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:35 smithi089 ceph-mon[109939]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:15:35.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:35 smithi089 ceph-mon[109939]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T22:15:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:35 smithi159 ceph-mon[82000]: pgmap v107: 65 pgs: 65 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:35 smithi159 ceph-mon[82000]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:15:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:35 smithi159 ceph-mon[82000]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T22:15:36.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:35 smithi159 podman[91022]: 2024-09-13 22:15:35.773549042 +0000 UTC m=+0.654976675 container remove 8d30b6ee913098420a69f8590526c133d19fda2c9275d115fb92146af8bf3ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-e4e227b) 2024-09-13T22:15:36.460 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:36 smithi159 podman[91114]: 2024-09-13 22:15:36.104235157 +0000 UTC m=+0.016225870 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:15:36.460 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:36 smithi159 podman[91114]: 2024-09-13 22:15:36.216080683 +0000 UTC m=+0.128071443 container create d00f3248f8730d3c7757e9d9755570292f727433c09f7b2177c5d0b4b6ea315a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-ecab7be) 2024-09-13T22:15:36.460 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:36 smithi159 podman[91114]: 2024-09-13 22:15:36.460014956 +0000 UTC m=+0.372005670 container init d00f3248f8730d3c7757e9d9755570292f727433c09f7b2177c5d0b4b6ea315a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T22:15:36.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T22:15:36.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 3]}]: dispatch 2024-09-13T22:15:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [0, 5]}]: dispatch 2024-09-13T22:15:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]: dispatch 2024-09-13T22:15:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 3]}]: dispatch 2024-09-13T22:15:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]: dispatch 2024-09-13T22:15:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]: dispatch 2024-09-13T22:15:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]: dispatch 2024-09-13T22:15:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:15:36.760 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:36 smithi159 podman[91114]: 2024-09-13 22:15:36.464479106 +0000 UTC m=+0.376469821 container start d00f3248f8730d3c7757e9d9755570292f727433c09f7b2177c5d0b4b6ea315a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T22:15:36.760 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:36 smithi159 podman[91114]: 2024-09-13 22:15:36.543583437 +0000 UTC m=+0.455574159 container attach d00f3248f8730d3c7757e9d9755570292f727433c09f7b2177c5d0b4b6ea315a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T22:15:36.761 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:36 smithi159 podman[91114]: 2024-09-13 22:15:36.652456547 +0000 UTC m=+0.564447263 container died d00f3248f8730d3c7757e9d9755570292f727433c09f7b2177c5d0b4b6ea315a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T22:15:36.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T22:15:36.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 3]}]: dispatch 2024-09-13T22:15:36.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [0, 5]}]: dispatch 2024-09-13T22:15:36.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]: dispatch 2024-09-13T22:15:36.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 3]}]: dispatch 2024-09-13T22:15:36.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]: dispatch 2024-09-13T22:15:36.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]: dispatch 2024-09-13T22:15:36.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]: dispatch 2024-09-13T22:15:36.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:36.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:15:37.507 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:37 smithi159 podman[91137]: 2024-09-13 22:15:37.282876166 +0000 UTC m=+0.619807165 container remove d00f3248f8730d3c7757e9d9755570292f727433c09f7b2177c5d0b4b6ea315a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T22:15:37.508 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:37 smithi159 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T22:15:37.508 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:37 smithi159 systemd[1]: Stopped Ceph osd.3 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:15:37.508 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:37 smithi159 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 10.985s CPU time. 2024-09-13T22:15:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:37 smithi159 ceph-mon[82000]: pgmap v110: 65 pgs: 16 stale+active+clean, 49 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 3]}]': finished 2024-09-13T22:15:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [0, 5]}]': finished 2024-09-13T22:15:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]': finished 2024-09-13T22:15:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 3]}]': finished 2024-09-13T22:15:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]': finished 2024-09-13T22:15:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]': finished 2024-09-13T22:15:37.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]': finished 2024-09-13T22:15:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:37 smithi159 ceph-mon[82000]: osdmap e67: 6 total, 5 up, 6 in 2024-09-13T22:15:37.760 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:37 smithi159 systemd[1]: Starting Ceph osd.3 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:15:37.760 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:37 smithi159 podman[91235]: 2024-09-13 22:15:37.622161244 +0000 UTC m=+0.016455662 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:15:37.760 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:37 smithi159 podman[91235]: 2024-09-13 22:15:37.733811639 +0000 UTC m=+0.128106057 container create a3e629c6293b0cc94b0e330f3fc8c6fa737601f45e4a0c97161a1c4c6b63edc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T22:15:37.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:37 smithi089 ceph-mon[109939]: pgmap v110: 65 pgs: 16 stale+active+clean, 49 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:15:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 3]}]': finished 2024-09-13T22:15:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [0, 5]}]': finished 2024-09-13T22:15:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]': finished 2024-09-13T22:15:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 3]}]': finished 2024-09-13T22:15:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]': finished 2024-09-13T22:15:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]': finished 2024-09-13T22:15:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3]}]': finished 2024-09-13T22:15:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:37 smithi089 ceph-mon[109939]: osdmap e67: 6 total, 5 up, 6 in 2024-09-13T22:15:38.118 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:37 smithi159 podman[91235]: 2024-09-13 22:15:37.986486805 +0000 UTC m=+0.380781221 container init a3e629c6293b0cc94b0e330f3fc8c6fa737601f45e4a0c97161a1c4c6b63edc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T22:15:38.118 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:37 smithi159 podman[91235]: 2024-09-13 22:15:37.989844526 +0000 UTC m=+0.384138947 container start a3e629c6293b0cc94b0e330f3fc8c6fa737601f45e4a0c97161a1c4c6b63edc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T22:15:38.118 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:38 smithi159 podman[91235]: 2024-09-13 22:15:38.069704854 +0000 UTC m=+0.463999291 container attach a3e629c6293b0cc94b0e330f3fc8c6fa737601f45e4a0c97161a1c4c6b63edc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T22:15:38.509 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:38 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate[91251]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:15:38.509 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:38 smithi159 bash[91235]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:15:38.509 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:38 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate[91251]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:15:38.509 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:38 smithi159 bash[91235]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:15:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.815+0000 7fab851ab640 1 -- 172.21.15.89:0/3243978386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 msgr2=0x7fab80104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.815+0000 7fab851ab640 1 --2- 172.21.15.89:0/3243978386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 0x7fab80104dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab70009880 tx=0x7fab7002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.815+0000 7fab851ab640 1 -- 172.21.15.89:0/3243978386 shutdown_connections 2024-09-13T22:15:38.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.815+0000 7fab851ab640 1 --2- 172.21.15.89:0/3243978386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab800fe9f0 0x7fab800fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.815+0000 7fab851ab640 1 --2- 172.21.15.89:0/3243978386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 0x7fab80104dd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.815+0000 7fab851ab640 1 -- 172.21.15.89:0/3243978386 >> 172.21.15.89:0/3243978386 conn(0x7fab800758a0 msgr2=0x7fab800fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.815+0000 7fab851ab640 1 -- 172.21.15.89:0/3243978386 shutdown_connections 2024-09-13T22:15:38.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.815+0000 7fab851ab640 1 -- 172.21.15.89:0/3243978386 wait complete. 2024-09-13T22:15:38.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab851ab640 1 Processor -- start 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab851ab640 1 -- start start 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab851ab640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab800fe9f0 0x7fab80196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab851ab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 0x7fab80196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab851ab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80197450 con 0x7fab801049f0 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab851ab640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab801975c0 con 0x7fab800fe9f0 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab7e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 0x7fab80196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab7e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 0x7fab80196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32904/0 (socket says 172.21.15.89:32904) 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab7e59c640 1 -- 172.21.15.89:0/505937114 learned_addr learned my addr 172.21.15.89:0/505937114 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.816+0000 7fab7ed9d640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab800fe9f0 0x7fab80196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.817+0000 7fab7e59c640 1 -- 172.21.15.89:0/505937114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab800fe9f0 msgr2=0x7fab80196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:38.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.817+0000 7fab7e59c640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab800fe9f0 0x7fab80196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:38.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.817+0000 7fab7e59c640 1 -- 172.21.15.89:0/505937114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70009560 con 0x7fab801049f0 2024-09-13T22:15:38.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.817+0000 7fab7e59c640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 0x7fab80196e80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab7400e970 tx=0x7fab7400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:38.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.817+0000 7fab67fff640 1 -- 172.21.15.89:0/505937114 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab7400cc90 con 0x7fab801049f0 2024-09-13T22:15:38.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.817+0000 7fab67fff640 1 -- 172.21.15.89:0/505937114 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab7400cdf0 con 0x7fab801049f0 2024-09-13T22:15:38.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.817+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8019f9b0 con 0x7fab801049f0 2024-09-13T22:15:38.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.817+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab80194a10 con 0x7fab801049f0 2024-09-13T22:15:38.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.818+0000 7fab67fff640 1 -- 172.21.15.89:0/505937114 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab74010430 con 0x7fab801049f0 2024-09-13T22:15:38.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.819+0000 7fab67fff640 1 -- 172.21.15.89:0/505937114 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fab740046c0 con 0x7fab801049f0 2024-09-13T22:15:38.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.819+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab80100130 con 0x7fab801049f0 2024-09-13T22:15:38.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.820+0000 7fab67fff640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fab6806e5f0 0x7fab68070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.820+0000 7fab67fff640 1 -- 172.21.15.89:0/505937114 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6836+0+0 (secure 0 0 0) 0x7fab74014070 con 0x7fab801049f0 2024-09-13T22:15:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.820+0000 7fab7ed9d640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fab6806e5f0 0x7fab68070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:38.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.821+0000 7fab7ed9d640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fab6806e5f0 0x7fab68070ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab70009230 tx=0x7fab700058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:38.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:38.825+0000 7fab67fff640 1 -- 172.21.15.89:0/505937114 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fab74057d30 con 0x7fab801049f0 2024-09-13T22:15:38.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:38 smithi089 ceph-mon[109939]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T22:15:38.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:38 smithi089 ceph-mon[109939]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T22:15:39.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:38 smithi159 ceph-mon[82000]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T22:15:39.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:38 smithi159 ceph-mon[82000]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T22:15:39.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:38 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate[91251]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T22:15:39.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:38 smithi159 bash[91235]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T22:15:39.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:38 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate[91251]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T22:15:39.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:38 smithi159 bash[91235]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T22:15:39.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.045+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab80197780 con 0x7fab6806e5f0 2024-09-13T22:15:39.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.047+0000 7fab67fff640 1 -- 172.21.15.89:0/505937114 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fab80197780 con 0x7fab6806e5f0 2024-09-13T22:15:39.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fab6806e5f0 msgr2=0x7fab68070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fab6806e5f0 0x7fab68070ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab70009230 tx=0x7fab700058d0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 msgr2=0x7fab80196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 0x7fab80196e80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab7400e970 tx=0x7fab7400ed70 comp rx=0 tx=0).stop 2024-09-13T22:15:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 shutdown_connections 2024-09-13T22:15:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fab6806e5f0 0x7fab68070ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab801049f0 0x7fab80196e80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 --2- 172.21.15.89:0/505937114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab800fe9f0 0x7fab80196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 >> 172.21.15.89:0/505937114 conn(0x7fab800758a0 msgr2=0x7fab800fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 shutdown_connections 2024-09-13T22:15:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.049+0000 7fab851ab640 1 -- 172.21.15.89:0/505937114 wait complete. 2024-09-13T22:15:39.062 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:15:39.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.155+0000 7f5780773640 1 -- 172.21.15.89:0/2461584060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 msgr2=0x7f5778101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.155+0000 7f5780773640 1 --2- 172.21.15.89:0/2461584060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 0x7f5778101130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5774009880 tx=0x7f577402a530 comp rx=0 tx=0).stop 2024-09-13T22:15:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.155+0000 7f5780773640 1 -- 172.21.15.89:0/2461584060 shutdown_connections 2024-09-13T22:15:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.155+0000 7f5780773640 1 --2- 172.21.15.89:0/2461584060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5778101670 0x7f5778109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.155+0000 7f5780773640 1 --2- 172.21.15.89:0/2461584060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 0x7f5778101130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.155+0000 7f5780773640 1 -- 172.21.15.89:0/2461584060 >> 172.21.15.89:0/2461584060 conn(0x7f57780758a0 msgr2=0x7f57780fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.155+0000 7f5780773640 1 -- 172.21.15.89:0/2461584060 shutdown_connections 2024-09-13T22:15:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.155+0000 7f5780773640 1 -- 172.21.15.89:0/2461584060 wait complete. 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f5780773640 1 Processor -- start 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f5780773640 1 -- start start 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f5780773640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 0x7f57780fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f5780773640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5778101670 0x7f57780feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f5780773640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57780ff430 con 0x7f5778100d50 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f5780773640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57780ff5a0 con 0x7f5778101670 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f577e50f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 0x7f57780fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f577e50f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 0x7f57780fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32922/0 (socket says 172.21.15.89:32922) 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f577e50f640 1 -- 172.21.15.89:0/2378183485 learned_addr learned my addr 172.21.15.89:0/2378183485 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.156+0000 7f577dd0e640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5778101670 0x7f57780feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:39.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.157+0000 7f577e50f640 1 -- 172.21.15.89:0/2378183485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5778101670 msgr2=0x7f57780feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.157+0000 7f577e50f640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5778101670 0x7f57780feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.157+0000 7f577e50f640 1 -- 172.21.15.89:0/2378183485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5774009560 con 0x7f5778100d50 2024-09-13T22:15:39.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.157+0000 7f577e50f640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 0x7f57780fe9b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5774006010 tx=0x7f5774032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:39.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.157+0000 7f576f7fe640 1 -- 172.21.15.89:0/2378183485 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5774005220 con 0x7f5778100d50 2024-09-13T22:15:39.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.157+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57780ff820 con 0x7f5778100d50 2024-09-13T22:15:39.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.157+0000 7f576f7fe640 1 -- 172.21.15.89:0/2378183485 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5774005d50 con 0x7f5778100d50 2024-09-13T22:15:39.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.157+0000 7f576f7fe640 1 -- 172.21.15.89:0/2378183485 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57740038f0 con 0x7f5778100d50 2024-09-13T22:15:39.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.157+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57781a1f80 con 0x7f5778100d50 2024-09-13T22:15:39.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.158+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5778068470 con 0x7f5778100d50 2024-09-13T22:15:39.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.159+0000 7f576f7fe640 1 -- 172.21.15.89:0/2378183485 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f577402ad50 con 0x7f5778100d50 2024-09-13T22:15:39.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.159+0000 7f576f7fe640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f576406e600 0x7f5764070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:39.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.159+0000 7f576f7fe640 1 -- 172.21.15.89:0/2378183485 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f57740aeef0 con 0x7f5778100d50 2024-09-13T22:15:39.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.159+0000 7f577dd0e640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f576406e600 0x7f5764070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:39.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.160+0000 7f577dd0e640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f576406e600 0x7f5764070ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5778100130 tx=0x7f5768005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.164+0000 7f576f7fe640 1 -- 172.21.15.89:0/2378183485 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5774078030 con 0x7f5778100d50 2024-09-13T22:15:39.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.392+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57780ff820 con 0x7f576406e600 2024-09-13T22:15:39.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.393+0000 7f576f7fe640 1 -- 172.21.15.89:0/2378183485 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f57780ff820 con 0x7f576406e600 2024-09-13T22:15:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f576406e600 msgr2=0x7f5764070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f576406e600 0x7f5764070ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5778100130 tx=0x7f5768005f90 comp rx=0 tx=0).stop 2024-09-13T22:15:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 msgr2=0x7f57780fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 0x7f57780fe9b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5774006010 tx=0x7f5774032bb0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 shutdown_connections 2024-09-13T22:15:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f576406e600 0x7f5764070ac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5778101670 0x7f57780feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 --2- 172.21.15.89:0/2378183485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5778100d50 0x7f57780fe9b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 >> 172.21.15.89:0/2378183485 conn(0x7f57780758a0 msgr2=0x7f5778101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 shutdown_connections 2024-09-13T22:15:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.396+0000 7f5780773640 1 -- 172.21.15.89:0/2378183485 wait complete. 2024-09-13T22:15:39.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.486+0000 7fad90431640 1 -- 172.21.15.89:0/186254024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad881049f0 msgr2=0x7fad88104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.486+0000 7fad90431640 1 --2- 172.21.15.89:0/186254024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad881049f0 0x7fad88104dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fad84009880 tx=0x7fad8402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.486+0000 7fad90431640 1 -- 172.21.15.89:0/186254024 shutdown_connections 2024-09-13T22:15:39.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.486+0000 7fad90431640 1 --2- 172.21.15.89:0/186254024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad880fe9f0 0x7fad880fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.486+0000 7fad90431640 1 --2- 172.21.15.89:0/186254024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad881049f0 0x7fad88104dd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.486+0000 7fad90431640 1 -- 172.21.15.89:0/186254024 >> 172.21.15.89:0/186254024 conn(0x7fad880758a0 msgr2=0x7fad880fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:39.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.486+0000 7fad90431640 1 -- 172.21.15.89:0/186254024 shutdown_connections 2024-09-13T22:15:39.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.486+0000 7fad90431640 1 -- 172.21.15.89:0/186254024 wait complete. 2024-09-13T22:15:39.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad90431640 1 Processor -- start 2024-09-13T22:15:39.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad90431640 1 -- start start 2024-09-13T22:15:39.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad90431640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad880fe9f0 0x7fad8819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:39.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad90431640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881049f0 0x7fad8819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:39.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad90431640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88197ac0 con 0x7fad880fe9f0 2024-09-13T22:15:39.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad90431640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88197c00 con 0x7fad881049f0 2024-09-13T22:15:39.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad8e1cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad880fe9f0 0x7fad8819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad8e1cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad880fe9f0 0x7fad8819da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32948/0 (socket says 172.21.15.89:32948) 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad8e1cd640 1 -- 172.21.15.89:0/3212007386 learned_addr learned my addr 172.21.15.89:0/3212007386 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad8e1cd640 1 -- 172.21.15.89:0/3212007386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881049f0 msgr2=0x7fad8819dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad8e1cd640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881049f0 0x7fad8819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.487+0000 7fad8e1cd640 1 -- 172.21.15.89:0/3212007386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84009560 con 0x7fad880fe9f0 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.488+0000 7fad8e1cd640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad880fe9f0 0x7fad8819da60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad8402a9c0 tx=0x7fad840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.488+0000 7fad7f7fe640 1 -- 172.21.15.89:0/3212007386 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad84004aa0 con 0x7fad880fe9f0 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.488+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad88197e80 con 0x7fad880fe9f0 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.488+0000 7fad7f7fe640 1 -- 172.21.15.89:0/3212007386 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad84004c00 con 0x7fad880fe9f0 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.488+0000 7fad7f7fe640 1 -- 172.21.15.89:0/3212007386 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad84003980 con 0x7fad880fe9f0 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.488+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad88198370 con 0x7fad880fe9f0 2024-09-13T22:15:39.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.489+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad88100130 con 0x7fad880fe9f0 2024-09-13T22:15:39.493 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate[91251]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T22:15:39.493 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 bash[91235]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T22:15:39.493 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate[91251]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T22:15:39.493 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 bash[91235]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T22:15:39.493 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate[91251]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T22:15:39.493 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 bash[91235]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T22:15:39.494 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate[91251]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T22:15:39.494 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 bash[91235]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T22:15:39.494 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate[91251]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T22:15:39.494 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 bash[91235]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T22:15:39.494 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 podman[91235]: 2024-09-13 22:15:39.175039401 +0000 UTC m=+1.569333834 container died a3e629c6293b0cc94b0e330f3fc8c6fa737601f45e4a0c97161a1c4c6b63edc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T22:15:39.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.489+0000 7fad7f7fe640 1 -- 172.21.15.89:0/3212007386 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fad84003bc0 con 0x7fad880fe9f0 2024-09-13T22:15:39.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.490+0000 7fad7f7fe640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fad7406e5f0 0x7fad74070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:39.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.490+0000 7fad7f7fe640 1 -- 172.21.15.89:0/3212007386 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6836+0+0 (secure 0 0 0) 0x7fad840af810 con 0x7fad880fe9f0 2024-09-13T22:15:39.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.490+0000 7fad8d9cc640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fad7406e5f0 0x7fad74070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:39.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.491+0000 7fad8d9cc640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fad7406e5f0 0x7fad74070ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad78005fd0 tx=0x7fad78005c70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:39.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.495+0000 7fad7f7fe640 1 -- 172.21.15.89:0/3212007386 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fad84078830 con 0x7fad880fe9f0 2024-09-13T22:15:39.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.703+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad8810bc60 con 0x7fad7406e5f0 2024-09-13T22:15:39.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.714+0000 7fad7f7fe640 1 -- 172.21.15.89:0/3212007386 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fad8810bc60 con 0x7fad7406e5f0 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (4m) 29s ago 14m 25.8M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (14m) 29s ago 14m 8572k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (14m) 2m ago 14m 8174k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (2m) 29s ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (2m) 2m ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (4m) 29s ago 14m 80.6M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (9m) 29s ago 9m 18.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (9m) 29s ago 9m 16.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (9m) 2m ago 9m 161M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:15:39.717 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (9m) 2m ago 9m 17.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (5m) 29s ago 16m 500M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (5m) 2m ago 13m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (3m) 29s ago 16m 47.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (2m) 2m ago 13m 34.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (5m) 29s ago 14m 15.4M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (4m) 2m ago 13m 15.7M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (104s) 29s ago 13m 93.5M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (69s) 29s ago 12m 105M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 3d2a1d778a36 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (34s) 29s ago 12m 12.1M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 ffb294d5c14f 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (11m) 2m ago 11m 286M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f 8d30b6ee9130 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (11m) 2m ago 11m 250M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (10m) 2m ago 10m 255M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:15:39.718 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (4m) 29s ago 14m 63.9M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:15:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fad7406e5f0 msgr2=0x7fad74070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fad7406e5f0 0x7fad74070ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad78005fd0 tx=0x7fad78005c70 comp rx=0 tx=0).stop 2024-09-13T22:15:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad880fe9f0 msgr2=0x7fad8819da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad880fe9f0 0x7fad8819da60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad8402a9c0 tx=0x7fad840055a0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 shutdown_connections 2024-09-13T22:15:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fad7406e5f0 0x7fad74070ab0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881049f0 0x7fad8819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 --2- 172.21.15.89:0/3212007386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad880fe9f0 0x7fad8819da60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 >> 172.21.15.89:0/3212007386 conn(0x7fad880758a0 msgr2=0x7fad88067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 shutdown_connections 2024-09-13T22:15:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.717+0000 7fad90431640 1 -- 172.21.15.89:0/3212007386 wait complete. 2024-09-13T22:15:39.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:39 smithi159 ceph-mon[82000]: pgmap v113: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-09-13T22:15:39.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:39 smithi159 ceph-mon[82000]: Health check failed: Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:39.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.814+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3753427386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 msgr2=0x7fb9c80fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.814+0000 7fb9cfc12640 1 --2- 172.21.15.89:0/3753427386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 0x7fb9c80fee50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009880 tx=0x7fb9b802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.814+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3753427386 shutdown_connections 2024-09-13T22:15:39.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.814+0000 7fb9cfc12640 1 --2- 172.21.15.89:0/3753427386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 0x7fb9c80fee50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.814+0000 7fb9cfc12640 1 --2- 172.21.15.89:0/3753427386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c81049f0 0x7fb9c8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.814+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3753427386 >> 172.21.15.89:0/3753427386 conn(0x7fb9c80758a0 msgr2=0x7fb9c80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:39.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.814+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3753427386 shutdown_connections 2024-09-13T22:15:39.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.814+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3753427386 wait complete. 2024-09-13T22:15:39.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cfc12640 1 Processor -- start 2024-09-13T22:15:39.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cfc12640 1 -- start start 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cfc12640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 0x7fb9c8196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cfc12640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c81049f0 0x7fb9c8196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cfc12640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8197490 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cfc12640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8197600 con 0x7fb9c81049f0 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cd9ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 0x7fb9c8196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cd9ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 0x7fb9c8196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32964/0 (socket says 172.21.15.89:32964) 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cd9ae640 1 -- 172.21.15.89:0/3818522558 learned_addr learned my addr 172.21.15.89:0/3818522558 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cd9ae640 1 -- 172.21.15.89:0/3818522558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c81049f0 msgr2=0x7fb9c8196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cd9ae640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c81049f0 0x7fb9c8196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.815+0000 7fb9cd9ae640 1 -- 172.21.15.89:0/3818522558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b8009560 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.816+0000 7fb9cd9ae640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 0x7fb9c8196980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400c8f0 tx=0x7fb9c400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.816+0000 7fb9beffd640 1 -- 172.21.15.89:0/3818522558 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9c4007b80 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.816+0000 7fb9beffd640 1 -- 172.21.15.89:0/3818522558 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9c40054e0 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.816+0000 7fb9beffd640 1 -- 172.21.15.89:0/3818522558 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9c400f450 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.816+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c819f9f0 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.816+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c819fe60 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.817+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c8100130 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.818+0000 7fb9beffd640 1 -- 172.21.15.89:0/3818522558 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb9c4004f60 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.818+0000 7fb9beffd640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb9b406e5f0 0x7fb9b4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.818+0000 7fb9beffd640 1 -- 172.21.15.89:0/3818522558 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6844+0+0 (secure 0 0 0) 0x7fb9c408e610 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.818+0000 7fb9cd1ad640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb9b406e5f0 0x7fb9b4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.819+0000 7fb9cd1ad640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb9b406e5f0 0x7fb9b4070ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8068470 tx=0x7fb9b8000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:39.823+0000 7fb9beffd640 1 -- 172.21.15.89:0/3818522558 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb9c4057630 con 0x7fb9c80fe9f0 2024-09-13T22:15:39.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:39 smithi089 ceph-mon[109939]: pgmap v113: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-09-13T22:15:39.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:39 smithi089 ceph-mon[109939]: Health check failed: Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:40.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.071+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9c8107000 con 0x7fb9c80fe9f0 2024-09-13T22:15:40.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.071+0000 7fb9beffd640 1 -- 172.21.15.89:0/3818522558 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fb9c401d360 con 0x7fb9c80fe9f0 2024-09-13T22:15:40.073 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2, 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 3 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:15:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:15:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:15:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6, 2024-09-13T22:15:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 7 2024-09-13T22:15:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:15:40.075 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb9b406e5f0 msgr2=0x7fb9b4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb9b406e5f0 0x7fb9b4070ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8068470 tx=0x7fb9b8000bc0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 msgr2=0x7fb9c8196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 0x7fb9c8196980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400c8f0 tx=0x7fb9c400cdb0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 shutdown_connections 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb9b406e5f0 0x7fb9b4070ab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c81049f0 0x7fb9c8196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 --2- 172.21.15.89:0/3818522558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c80fe9f0 0x7fb9c8196980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 >> 172.21.15.89:0/3818522558 conn(0x7fb9c80758a0 msgr2=0x7fb9c80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 shutdown_connections 2024-09-13T22:15:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.073+0000 7fb9cfc12640 1 -- 172.21.15.89:0/3818522558 wait complete. 2024-09-13T22:15:40.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.153+0000 7f62bdd39640 1 -- 172.21.15.89:0/1927736721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b80fe9f0 msgr2=0x7f62b80fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.153+0000 7f62bdd39640 1 --2- 172.21.15.89:0/1927736721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b80fe9f0 0x7f62b80fee50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009880 tx=0x7f62a802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.153+0000 7f62bdd39640 1 -- 172.21.15.89:0/1927736721 shutdown_connections 2024-09-13T22:15:40.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.153+0000 7f62bdd39640 1 --2- 172.21.15.89:0/1927736721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b80fe9f0 0x7f62b80fee50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.153+0000 7f62bdd39640 1 --2- 172.21.15.89:0/1927736721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62b81049f0 0x7f62b8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.153+0000 7f62bdd39640 1 -- 172.21.15.89:0/1927736721 >> 172.21.15.89:0/1927736721 conn(0x7f62b80758a0 msgr2=0x7f62b80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:40.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.153+0000 7f62bdd39640 1 -- 172.21.15.89:0/1927736721 shutdown_connections 2024-09-13T22:15:40.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.153+0000 7f62bdd39640 1 -- 172.21.15.89:0/1927736721 wait complete. 2024-09-13T22:15:40.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.153+0000 7f62bdd39640 1 Processor -- start 2024-09-13T22:15:40.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62bdd39640 1 -- start start 2024-09-13T22:15:40.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62bdd39640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62b80fe9f0 0x7f62b80fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:40.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62bdd39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b81049f0 0x7f62b80fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:40.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62bdd39640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80fb800 con 0x7f62b81049f0 2024-09-13T22:15:40.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62bdd39640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80fb970 con 0x7f62b80fe9f0 2024-09-13T22:15:40.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62b6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b81049f0 0x7f62b80fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:40.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62b6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b81049f0 0x7f62b80fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32988/0 (socket says 172.21.15.89:32988) 2024-09-13T22:15:40.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62b6ffd640 1 -- 172.21.15.89:0/1336483559 learned_addr learned my addr 172.21.15.89:0/1336483559 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:40.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62b77fe640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62b80fe9f0 0x7f62b80fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:40.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62b6ffd640 1 -- 172.21.15.89:0/1336483559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62b80fe9f0 msgr2=0x7f62b80fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62b6ffd640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62b80fe9f0 0x7f62b80fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62b6ffd640 1 -- 172.21.15.89:0/1336483559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a8009560 con 0x7f62b81049f0 2024-09-13T22:15:40.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.154+0000 7f62b6ffd640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b81049f0 0x7f62b80fb2c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62a802a9c0 tx=0x7f62a80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:40.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.155+0000 7f62b4ff9640 1 -- 172.21.15.89:0/1336483559 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a8004aa0 con 0x7f62b81049f0 2024-09-13T22:15:40.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.155+0000 7f62b4ff9640 1 -- 172.21.15.89:0/1336483559 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62a8004c00 con 0x7f62b81049f0 2024-09-13T22:15:40.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.155+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b80fbbf0 con 0x7f62b81049f0 2024-09-13T22:15:40.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.155+0000 7f62b4ff9640 1 -- 172.21.15.89:0/1336483559 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a8003ab0 con 0x7f62b81049f0 2024-09-13T22:15:40.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.155+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b81a2050 con 0x7f62b81049f0 2024-09-13T22:15:40.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.156+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b8100130 con 0x7f62b81049f0 2024-09-13T22:15:40.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.156+0000 7f62b4ff9640 1 -- 172.21.15.89:0/1336483559 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f62a8031d20 con 0x7f62b81049f0 2024-09-13T22:15:40.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.157+0000 7f62b4ff9640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f62a006e5f0 0x7f62a0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:40.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.157+0000 7f62b4ff9640 1 -- 172.21.15.89:0/1336483559 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6844+0+0 (secure 0 0 0) 0x7f62a80af700 con 0x7f62b81049f0 2024-09-13T22:15:40.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.157+0000 7f62b77fe640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f62a006e5f0 0x7f62a0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:40.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.157+0000 7f62b77fe640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f62a006e5f0 0x7f62a0070ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00a810 tx=0x7f62ac008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:40.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.161+0000 7f62b4ff9640 1 -- 172.21.15.89:0/1336483559 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f62a8078720 con 0x7f62b81049f0 2024-09-13T22:15:40.200 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:39 smithi159 podman[91387]: 2024-09-13 22:15:39.874420933 +0000 UTC m=+0.687307420 container remove a3e629c6293b0cc94b0e330f3fc8c6fa737601f45e4a0c97161a1c4c6b63edc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be) 2024-09-13T22:15:40.200 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:40 smithi159 podman[91446]: 2024-09-13 22:15:39.985046148 +0000 UTC m=+0.016228066 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:15:40.200 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:40 smithi159 podman[91446]: 2024-09-13 22:15:40.091919417 +0000 UTC m=+0.123101325 container create 6724e7895aeb9e5d1e45ac08afbe35aa6c02b52bd5f37ab62bef439dced6b2f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be) 2024-09-13T22:15:40.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.365+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f62b80fbbf0 con 0x7f62b81049f0 2024-09-13T22:15:40.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.365+0000 7f62b4ff9640 1 -- 172.21.15.89:0/1336483559 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f62a8040790 con 0x7f62b81049f0 2024-09-13T22:15:40.368 INFO:teuthology.orchestra.run.smithi089.stdout:e15 2024-09-13T22:15:40.368 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:15:40.368 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:15:40.368 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:15:40.368 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:15:40.368 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:15:40.368 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:15:40.369 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:15:40.370 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T22:15:40.371 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:15:40.371 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:15:40.371 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:15:40.371 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:15:40.371 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:15:40.371 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:15:40.371 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:15:40.371 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.368+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f62a006e5f0 msgr2=0x7f62a0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.368+0000 7f62bdd39640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f62a006e5f0 0x7f62a0070ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00a810 tx=0x7f62ac008040 comp rx=0 tx=0).stop 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.368+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b81049f0 msgr2=0x7f62b80fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.368+0000 7f62bdd39640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b81049f0 0x7f62b80fb2c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62a802a9c0 tx=0x7f62a80055a0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.368+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 shutdown_connections 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.368+0000 7f62bdd39640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f62a006e5f0 0x7f62a0070ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.368+0000 7f62bdd39640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b81049f0 0x7f62b80fb2c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.368+0000 7f62bdd39640 1 --2- 172.21.15.89:0/1336483559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62b80fe9f0 0x7f62b80fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.368+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 >> 172.21.15.89:0/1336483559 conn(0x7f62b80758a0 msgr2=0x7f62b8067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.369+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 shutdown_connections 2024-09-13T22:15:40.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.369+0000 7f62bdd39640 1 -- 172.21.15.89:0/1336483559 wait complete. 2024-09-13T22:15:40.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.449+0000 7fa609263640 1 -- 172.21.15.89:0/3486322377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 msgr2=0x7fa6040fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.449+0000 7fa609263640 1 --2- 172.21.15.89:0/3486322377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 0x7fa6040fee50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009880 tx=0x7fa5ec02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.449+0000 7fa609263640 1 -- 172.21.15.89:0/3486322377 shutdown_connections 2024-09-13T22:15:40.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.449+0000 7fa609263640 1 --2- 172.21.15.89:0/3486322377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 0x7fa6040fee50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.449+0000 7fa609263640 1 --2- 172.21.15.89:0/3486322377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6041049f0 0x7fa604104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.449+0000 7fa609263640 1 -- 172.21.15.89:0/3486322377 >> 172.21.15.89:0/3486322377 conn(0x7fa6040758a0 msgr2=0x7fa6040fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:40.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.449+0000 7fa609263640 1 -- 172.21.15.89:0/3486322377 shutdown_connections 2024-09-13T22:15:40.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.449+0000 7fa609263640 1 -- 172.21.15.89:0/3486322377 wait complete. 2024-09-13T22:15:40.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.450+0000 7fa609263640 1 Processor -- start 2024-09-13T22:15:40.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.450+0000 7fa609263640 1 -- start start 2024-09-13T22:15:40.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.450+0000 7fa609263640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 0x7fa60419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:40.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.450+0000 7fa609263640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6041049f0 0x7fa60419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:40.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.450+0000 7fa609263640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa604197b40 con 0x7fa6040fe9f0 2024-09-13T22:15:40.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.450+0000 7fa609263640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa604197cb0 con 0x7fa6041049f0 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.450+0000 7fa602ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 0x7fa60419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.450+0000 7fa602ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 0x7fa60419da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33002/0 (socket says 172.21.15.89:33002) 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa602ffd640 1 -- 172.21.15.89:0/1368334834 learned_addr learned my addr 172.21.15.89:0/1368334834 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa6027fc640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6041049f0 0x7fa60419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa602ffd640 1 -- 172.21.15.89:0/1368334834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6041049f0 msgr2=0x7fa60419df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa602ffd640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6041049f0 0x7fa60419df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa602ffd640 1 -- 172.21.15.89:0/1368334834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec009560 con 0x7fa6040fe9f0 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa602ffd640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 0x7fa60419da50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400cc60 tx=0x7fa5f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa5fbfff640 1 -- 172.21.15.89:0/1368334834 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f4004b20 con 0x7fa6040fe9f0 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa5fbfff640 1 -- 172.21.15.89:0/1368334834 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5f4004c80 con 0x7fa6040fe9f0 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa604197f90 con 0x7fa6040fe9f0 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa5fbfff640 1 -- 172.21.15.89:0/1368334834 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f400f750 con 0x7fa6040fe9f0 2024-09-13T22:15:40.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.451+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6041984b0 con 0x7fa6040fe9f0 2024-09-13T22:15:40.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.452+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa604100130 con 0x7fa6040fe9f0 2024-09-13T22:15:40.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.453+0000 7fa5fbfff640 1 -- 172.21.15.89:0/1368334834 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa5f4005020 con 0x7fa6040fe9f0 2024-09-13T22:15:40.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.453+0000 7fa5fbfff640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa5f006e5f0 0x7fa5f0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:40.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.453+0000 7fa6027fc640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa5f006e5f0 0x7fa5f0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:40.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.453+0000 7fa5fbfff640 1 -- 172.21.15.89:0/1368334834 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6848+0+0 (secure 0 0 0) 0x7fa5f408ea40 con 0x7fa6040fe9f0 2024-09-13T22:15:40.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.454+0000 7fa6027fc640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa5f006e5f0 0x7fa5f0070ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009230 tx=0x7fa5ec0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:40.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.458+0000 7fa5fbfff640 1 -- 172.21.15.89:0/1368334834 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa5f4057a90 con 0x7fa6040fe9f0 2024-09-13T22:15:40.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.644+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6041990f0 con 0x7fa5f006e5f0 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.646+0000 7fa5fbfff640 1 -- 172.21.15.89:0/1368334834 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa6041990f0 con 0x7fa5f006e5f0 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stdout: "crash" 2024-09-13T22:15:40.648 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:15:40.649 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "9/23 daemons upgraded", 2024-09-13T22:15:40.649 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T22:15:40.649 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:15:40.649 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:15:40.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.647+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa5f006e5f0 msgr2=0x7fa5f0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.647+0000 7fa609263640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa5f006e5f0 0x7fa5f0070ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009230 tx=0x7fa5ec0058d0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.647+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 msgr2=0x7fa60419da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.647+0000 7fa609263640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 0x7fa60419da50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400cc60 tx=0x7fa5f400a620 comp rx=0 tx=0).stop 2024-09-13T22:15:40.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.648+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 shutdown_connections 2024-09-13T22:15:40.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.648+0000 7fa609263640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa5f006e5f0 0x7fa5f0070ab0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.648+0000 7fa609263640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6041049f0 0x7fa60419df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.648+0000 7fa609263640 1 --2- 172.21.15.89:0/1368334834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6040fe9f0 0x7fa60419da50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.648+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 >> 172.21.15.89:0/1368334834 conn(0x7fa6040758a0 msgr2=0x7fa604102160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:40.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.648+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 shutdown_connections 2024-09-13T22:15:40.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.648+0000 7fa609263640 1 -- 172.21.15.89:0/1368334834 wait complete. 2024-09-13T22:15:40.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.728+0000 7f4f7e463640 1 -- 172.21.15.89:0/3189490119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78100c60 msgr2=0x7f4f78101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.728+0000 7f4f7e463640 1 --2- 172.21.15.89:0/3189490119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78100c60 0x7f4f78101040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f680098b0 tx=0x7f4f6802a4d0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.728+0000 7f4f7e463640 1 -- 172.21.15.89:0/3189490119 shutdown_connections 2024-09-13T22:15:40.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.728+0000 7f4f7e463640 1 --2- 172.21.15.89:0/3189490119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f78101610 0x7f4f78109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.728+0000 7f4f7e463640 1 --2- 172.21.15.89:0/3189490119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78100c60 0x7f4f78101040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.728+0000 7f4f7e463640 1 -- 172.21.15.89:0/3189490119 >> 172.21.15.89:0/3189490119 conn(0x7f4f780fa730 msgr2=0x7f4f780fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:40.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.728+0000 7f4f7e463640 1 -- 172.21.15.89:0/3189490119 shutdown_connections 2024-09-13T22:15:40.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.729+0000 7f4f7e463640 1 -- 172.21.15.89:0/3189490119 wait complete. 2024-09-13T22:15:40.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.729+0000 7f4f7e463640 1 Processor -- start 2024-09-13T22:15:40.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.729+0000 7f4f7e463640 1 -- start start 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.729+0000 7f4f7e463640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f78100c60 0x7f4f7819b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.729+0000 7f4f7e463640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78101610 0x7f4f7819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.729+0000 7f4f7e463640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7819c3a0 con 0x7f4f78101610 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.729+0000 7f4f7e463640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78195930 con 0x7f4f78100c60 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f777fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78101610 0x7f4f7819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f777fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78101610 0x7f4f7819bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33020/0 (socket says 172.21.15.89:33020) 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f777fe640 1 -- 172.21.15.89:0/2061642919 learned_addr learned my addr 172.21.15.89:0/2061642919 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f77fff640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f78100c60 0x7f4f7819b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f777fe640 1 -- 172.21.15.89:0/2061642919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f78100c60 msgr2=0x7f4f7819b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f777fe640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f78100c60 0x7f4f7819b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f777fe640 1 -- 172.21.15.89:0/2061642919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f68009560 con 0x7f4f78101610 2024-09-13T22:15:40.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f777fe640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78101610 0x7f4f7819bd80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d6f0 tx=0x7f4f6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:40.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f757fa640 1 -- 172.21.15.89:0/2061642919 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f6c009a30 con 0x7f4f78101610 2024-09-13T22:15:40.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f78195c10 con 0x7f4f78101610 2024-09-13T22:15:40.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f757fa640 1 -- 172.21.15.89:0/2061642919 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f6c0054e0 con 0x7f4f78101610 2024-09-13T22:15:40.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f757fa640 1 -- 172.21.15.89:0/2061642919 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f6c010460 con 0x7f4f78101610 2024-09-13T22:15:40.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.730+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f78196160 con 0x7f4f78101610 2024-09-13T22:15:40.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.731+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f78068d30 con 0x7f4f78101610 2024-09-13T22:15:40.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.732+0000 7f4f757fa640 1 -- 172.21.15.89:0/2061642919 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4f6c009b90 con 0x7f4f78101610 2024-09-13T22:15:40.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.732+0000 7f4f757fa640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4f6006e5f0 0x7f4f60070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:15:40.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.732+0000 7f4f757fa640 1 -- 172.21.15.89:0/2061642919 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6848+0+0 (secure 0 0 0) 0x7f4f6c08e360 con 0x7f4f78101610 2024-09-13T22:15:40.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.732+0000 7f4f77fff640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4f6006e5f0 0x7f4f60070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:15:40.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.733+0000 7f4f77fff640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4f6006e5f0 0x7f4f60070ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009880 tx=0x7f4f680058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:15:40.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.737+0000 7f4f757fa640 1 -- 172.21.15.89:0/2061642919 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f6c0573b0 con 0x7f4f78101610 2024-09-13T22:15:40.740 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:40 smithi159 podman[91446]: 2024-09-13 22:15:40.352577583 +0000 UTC m=+0.383759492 container init 6724e7895aeb9e5d1e45ac08afbe35aa6c02b52bd5f37ab62bef439dced6b2f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T22:15:40.740 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:40 smithi159 podman[91446]: 2024-09-13 22:15:40.356740693 +0000 UTC m=+0.387922603 container start 6724e7895aeb9e5d1e45ac08afbe35aa6c02b52bd5f37ab62bef439dced6b2f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T22:15:40.740 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-osd[91467]: -- 172.21.15.159:0/2697370475 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5596b2f581e0 con 0x5596b216dc00 2024-09-13T22:15:40.740 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:40 smithi159 bash[91446]: 6724e7895aeb9e5d1e45ac08afbe35aa6c02b52bd5f37ab62bef439dced6b2f6 2024-09-13T22:15:40.740 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:40 smithi159 systemd[1]: Started Ceph osd.3 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:15:40.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.966+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4f78104310 con 0x7f4f78101610 2024-09-13T22:15:40.969 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:40.969 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:40.969 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:40.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T22:15:40.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3818522558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:40.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T22:15:40.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1336483559' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:15:40.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:40.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:40.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:40 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:40.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.967+0000 7f4f757fa640 1 -- 172.21.15.89:0/2061642919 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+852 (secure 0 0 0) 0x7f4f6c017370 con 0x7f4f78101610 2024-09-13T22:15:40.970 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout: osd.3 (root=default,host=smithi159) is down 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-13T22:15:40.971 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-13T22:15:40.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4f6006e5f0 msgr2=0x7f4f60070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4f6006e5f0 0x7f4f60070ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009880 tx=0x7f4f680058d0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78101610 msgr2=0x7f4f7819bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:15:40.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78101610 0x7f4f7819bd80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d6f0 tx=0x7f4f6c00dbb0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 shutdown_connections 2024-09-13T22:15:40.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4f6006e5f0 0x7f4f60070ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f78101610 0x7f4f7819bd80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 --2- 172.21.15.89:0/2061642919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f78100c60 0x7f4f7819b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:15:40.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 >> 172.21.15.89:0/2061642919 conn(0x7f4f780fa730 msgr2=0x7f4f78101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:15:40.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 shutdown_connections 2024-09-13T22:15:40.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:15:40.969+0000 7f4f7e463640 1 -- 172.21.15.89:0/2061642919 wait complete. 2024-09-13T22:15:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T22:15:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3818522558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T22:15:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1336483559' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:15:41.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:41.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:41.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:40 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:41.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:41 smithi089 ceph-mon[109939]: pgmap v117: 65 pgs: 7 remapped+peering, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T22:15:41.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:41 smithi089 ceph-mon[109939]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:41.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:41 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2061642919' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:15:41.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:41 smithi089 ceph-mon[109939]: osdmap e72: 6 total, 5 up, 6 in 2024-09-13T22:15:41.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:41 smithi089 ceph-mon[109939]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-13T22:15:42.001 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:41 smithi159 ceph-mon[82000]: pgmap v117: 65 pgs: 7 remapped+peering, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T22:15:42.002 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:41 smithi159 ceph-mon[82000]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:42.002 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:41 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2061642919' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:15:42.002 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:41 smithi159 ceph-mon[82000]: osdmap e72: 6 total, 5 up, 6 in 2024-09-13T22:15:42.002 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:41 smithi159 ceph-mon[82000]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-13T22:15:42.259 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:42 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[91463]: 2024-09-13T22:15:42.230+0000 7f09823e7640 -1 Falling back to public interface 2024-09-13T22:15:43.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:43 smithi089 ceph-mon[109939]: pgmap v119: 65 pgs: 7 remapped+peering, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T22:15:43.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:43 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:43.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:43 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:44.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:43 smithi159 ceph-mon[82000]: pgmap v119: 65 pgs: 7 remapped+peering, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T22:15:44.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:43 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:44.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:43 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:45.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:44 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:44 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:44 smithi089 ceph-mon[109939]: pgmap v120: 65 pgs: 7 active+clean+remapped, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%); 5/222 objects misplaced (2.252%); 693 KiB/s, 131 objects/s recovering 2024-09-13T22:15:45.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:44 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:45.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:44 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:45.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:44 smithi159 ceph-mon[82000]: pgmap v120: 65 pgs: 7 active+clean+remapped, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%); 5/222 objects misplaced (2.252%); 693 KiB/s, 131 objects/s recovering 2024-09-13T22:15:46.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:45 smithi089 ceph-mon[109939]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-13T22:15:46.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:45 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 48/222 objects degraded (21.622%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:46.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:45 smithi159 ceph-mon[82000]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-13T22:15:46.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:45 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 48/222 objects degraded (21.622%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:47.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:46 smithi159 ceph-mon[82000]: pgmap v121: 65 pgs: 7 active+clean+remapped, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%); 5/222 objects misplaced (2.252%); 594 KiB/s, 112 objects/s recovering 2024-09-13T22:15:47.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:46 smithi089 ceph-mon[109939]: pgmap v121: 65 pgs: 7 active+clean+remapped, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%); 5/222 objects misplaced (2.252%); 594 KiB/s, 112 objects/s recovering 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T22:15:48.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T22:15:48.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:48 smithi089 ceph-mon[109939]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T22:15:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:15:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:15:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:48.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:48.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:48.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:48.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:15:48.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T22:15:48.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T22:15:48.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-mon[82000]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T22:15:49.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:48 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[91463]: 2024-09-13T22:15:48.656+0000 7f09823e7640 -1 osd.3 64 log_to_monitors true 2024-09-13T22:15:49.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:49 smithi089 ceph-mon[109939]: pgmap v122: 65 pgs: 7 active+clean+remapped, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%); 5/222 objects misplaced (2.252%); 495 KiB/s, 93 objects/s recovering 2024-09-13T22:15:49.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:49 smithi089 ceph-mon[109939]: from='osd.3 [v2:172.21.15.159:6800/613518042,v1:172.21.15.159:6801/613518042]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:15:49.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:49 smithi089 ceph-mon[109939]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:15:49.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:49 smithi159 ceph-mon[82000]: pgmap v122: 65 pgs: 7 active+clean+remapped, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%); 5/222 objects misplaced (2.252%); 495 KiB/s, 93 objects/s recovering 2024-09-13T22:15:49.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:49 smithi159 ceph-mon[82000]: from='osd.3 [v2:172.21.15.159:6800/613518042,v1:172.21.15.159:6801/613518042]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:15:49.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:49 smithi159 ceph-mon[82000]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:15:49.510 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:15:49 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[91463]: 2024-09-13T22:15:49.177+0000 7f0976179640 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:15:50.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:50 smithi089 ceph-mon[109939]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T22:15:50.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:50 smithi089 ceph-mon[109939]: from='osd.3 [v2:172.21.15.159:6800/613518042,v1:172.21.15.159:6801/613518042]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:15:50.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:50 smithi089 ceph-mon[109939]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T22:15:50.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:50 smithi089 ceph-mon[109939]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:15:50.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:50 smithi159 ceph-mon[82000]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T22:15:50.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:50 smithi159 ceph-mon[82000]: from='osd.3 [v2:172.21.15.159:6800/613518042,v1:172.21.15.159:6801/613518042]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:15:50.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:50 smithi159 ceph-mon[82000]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T22:15:50.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:50 smithi159 ceph-mon[82000]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:15:51.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:51 smithi089 ceph-mon[109939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:15:51.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:51 smithi089 ceph-mon[109939]: osd.3 [v2:172.21.15.159:6800/613518042,v1:172.21.15.159:6801/613518042] boot 2024-09-13T22:15:51.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:51 smithi089 ceph-mon[109939]: osdmap e74: 6 total, 6 up, 6 in 2024-09-13T22:15:51.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:15:51.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:51 smithi089 ceph-mon[109939]: osdmap e75: 6 total, 6 up, 6 in 2024-09-13T22:15:51.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:51 smithi089 ceph-mon[109939]: pgmap v126: 65 pgs: 7 active+clean+remapped, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%); 5/222 objects misplaced (2.252%) 2024-09-13T22:15:51.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:51 smithi159 ceph-mon[82000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:15:51.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:51 smithi159 ceph-mon[82000]: osd.3 [v2:172.21.15.159:6800/613518042,v1:172.21.15.159:6801/613518042] boot 2024-09-13T22:15:51.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:51 smithi159 ceph-mon[82000]: osdmap e74: 6 total, 6 up, 6 in 2024-09-13T22:15:51.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:15:51.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:51 smithi159 ceph-mon[82000]: osdmap e75: 6 total, 6 up, 6 in 2024-09-13T22:15:51.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:51 smithi159 ceph-mon[82000]: pgmap v126: 65 pgs: 7 active+clean+remapped, 19 active+undersized, 16 active+undersized+degraded, 23 active+clean; 201 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%); 5/222 objects misplaced (2.252%) 2024-09-13T22:15:52.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:52 smithi089 ceph-mon[109939]: osdmap e76: 6 total, 6 up, 6 in 2024-09-13T22:15:52.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:52 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:52.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:52 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:15:52.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:52 smithi159 ceph-mon[82000]: osdmap e76: 6 total, 6 up, 6 in 2024-09-13T22:15:52.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:52 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:15:52.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:52 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:15:53.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:53 smithi089 ceph-mon[109939]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T22:15:53.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:53 smithi089 ceph-mon[109939]: pgmap v129: 65 pgs: 7 active+clean+remapped, 13 active+undersized, 14 active+undersized+degraded, 31 active+clean; 201 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 42/222 objects degraded (18.919%); 5/222 objects misplaced (2.252%) 2024-09-13T22:15:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:53 smithi159 ceph-mon[82000]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T22:15:53.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:53 smithi159 ceph-mon[82000]: pgmap v129: 65 pgs: 7 active+clean+remapped, 13 active+undersized, 14 active+undersized+degraded, 31 active+clean; 201 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 42/222 objects degraded (18.919%); 5/222 objects misplaced (2.252%) 2024-09-13T22:15:54.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:54 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 42/222 objects degraded (18.919%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:54.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:54 smithi089 ceph-mon[109939]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T22:15:54.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:54 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 42/222 objects degraded (18.919%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T22:15:54.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:54 smithi159 ceph-mon[82000]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T22:15:55.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:55 smithi089 ceph-mon[109939]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T22:15:55.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:55 smithi089 ceph-mon[109939]: pgmap v132: 65 pgs: 1 peering, 2 active+recovering+undersized+remapped, 62 active+clean; 201 MiB data, 998 MiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s, 343 objects/s recovering 2024-09-13T22:15:55.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:55 smithi089 ceph-mon[109939]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T22:15:55.753 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:55 smithi159 ceph-mon[82000]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T22:15:55.753 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:55 smithi159 ceph-mon[82000]: pgmap v132: 65 pgs: 1 peering, 2 active+recovering+undersized+remapped, 62 active+clean; 201 MiB data, 998 MiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s, 343 objects/s recovering 2024-09-13T22:15:55.753 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:55 smithi159 ceph-mon[82000]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T22:15:56.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:56 smithi089 ceph-mon[109939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 42/222 objects degraded (18.919%), 14 pgs degraded) 2024-09-13T22:15:56.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:56 smithi089 ceph-mon[109939]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T22:15:56.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:56 smithi159 ceph-mon[82000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 42/222 objects degraded (18.919%), 14 pgs degraded) 2024-09-13T22:15:56.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:56 smithi159 ceph-mon[82000]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T22:15:57.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:57 smithi089 ceph-mon[109939]: pgmap v135: 65 pgs: 1 peering, 2 active+recovering+undersized+remapped, 62 active+clean; 201 MiB data, 998 MiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s, 343 objects/s recovering 2024-09-13T22:15:57.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:57 smithi159 ceph-mon[82000]: pgmap v135: 65 pgs: 1 peering, 2 active+recovering+undersized+remapped, 62 active+clean; 201 MiB data, 998 MiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s, 343 objects/s recovering 2024-09-13T22:15:59.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:15:59 smithi089 ceph-mon[109939]: pgmap v136: 65 pgs: 1 peering, 2 active+recovering+undersized+remapped, 62 active+clean; 201 MiB data, 998 MiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s, 261 objects/s recovering 2024-09-13T22:16:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:15:59 smithi159 ceph-mon[82000]: pgmap v136: 65 pgs: 1 peering, 2 active+recovering+undersized+remapped, 62 active+clean; 201 MiB data, 998 MiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s, 261 objects/s recovering 2024-09-13T22:16:01.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:01 smithi089 ceph-mon[109939]: pgmap v137: 65 pgs: 65 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 120 objects/s recovering 2024-09-13T22:16:02.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:01 smithi159 ceph-mon[82000]: pgmap v137: 65 pgs: 65 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 120 objects/s recovering 2024-09-13T22:16:02.971 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:02 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T22:16:02.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:02 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T22:16:03.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:03 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T22:16:03.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:03 smithi089 ceph-mon[109939]: Upgrade: osd.4 is safe to restart 2024-09-13T22:16:03.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:03 smithi089 ceph-mon[109939]: pgmap v138: 65 pgs: 65 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 93 objects/s recovering 2024-09-13T22:16:04.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:03 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T22:16:04.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:03 smithi159 ceph-mon[82000]: Upgrade: osd.4 is safe to restart 2024-09-13T22:16:04.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:03 smithi159 ceph-mon[82000]: pgmap v138: 65 pgs: 65 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 93 objects/s recovering 2024-09-13T22:16:05.068 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:04 smithi159 ceph-mon[82000]: Upgrade: Updating osd.4 2024-09-13T22:16:05.068 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:05.069 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T22:16:05.069 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:04 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:05.069 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:04 smithi159 ceph-mon[82000]: Deploying daemon osd.4 on smithi159 2024-09-13T22:16:05.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:04 smithi089 ceph-mon[109939]: Upgrade: Updating osd.4 2024-09-13T22:16:05.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:05.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T22:16:05.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:04 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:05.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:04 smithi089 ceph-mon[109939]: Deploying daemon osd.4 on smithi159 2024-09-13T22:16:06.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:05 smithi159 ceph-mon[82000]: pgmap v139: 65 pgs: 65 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 81 objects/s recovering 2024-09-13T22:16:06.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:05 smithi089 ceph-mon[109939]: pgmap v139: 65 pgs: 65 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 81 objects/s recovering 2024-09-13T22:16:06.759 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:06 smithi159 systemd[1]: Stopping Ceph osd.4 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:16:07.259 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:06 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[48145]: 2024-09-13T22:16:06.871+0000 7fe04d019640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:16:07.334 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:06 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[48145]: 2024-09-13T22:16:06.871+0000 7fe04d019640 -1 osd.4 81 *** Got signal Terminated *** 2024-09-13T22:16:07.334 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:06 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[48145]: 2024-09-13T22:16:06.871+0000 7fe04d019640 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:16:07.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:07 smithi089 ceph-mon[109939]: pgmap v140: 65 pgs: 65 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 73 objects/s recovering 2024-09-13T22:16:07.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:07.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:16:07.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:07.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:07 smithi089 ceph-mon[109939]: osd.4 marked itself down and dead 2024-09-13T22:16:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:07 smithi159 ceph-mon[82000]: pgmap v140: 65 pgs: 65 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 73 objects/s recovering 2024-09-13T22:16:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:16:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:07 smithi159 ceph-mon[82000]: osd.4 marked itself down and dead 2024-09-13T22:16:08.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:08 smithi159 podman[96348]: 2024-09-13 22:16:08.232049141 +0000 UTC m=+1.493779624 container died d2bdb10f2f198bfbaf68ca55314b84507f96739155e39e087121a92de0e88dc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=reef-e4e227b, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T22:16:08.898 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:08 smithi159 ceph-mon[82000]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:16:08.898 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:08 smithi159 ceph-mon[82000]: osdmap e82: 6 total, 5 up, 6 in 2024-09-13T22:16:08.899 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:08 smithi159 podman[96348]: 2024-09-13 22:16:08.580107522 +0000 UTC m=+1.841838015 container cleanup d2bdb10f2f198bfbaf68ca55314b84507f96739155e39e087121a92de0e88dc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=reef-e4e227b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T22:16:08.899 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:08 smithi159 bash[96348]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4 2024-09-13T22:16:08.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:08 smithi089 ceph-mon[109939]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:16:08.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:08 smithi089 ceph-mon[109939]: osdmap e82: 6 total, 5 up, 6 in 2024-09-13T22:16:09.257 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:08 smithi159 podman[96364]: 2024-09-13 22:16:08.897998098 +0000 UTC m=+0.667612588 container remove d2bdb10f2f198bfbaf68ca55314b84507f96739155e39e087121a92de0e88dc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-e4e227b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T22:16:09.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:09 smithi159 podman[96452]: 2024-09-13 22:16:09.159420955 +0000 UTC m=+0.016325351 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:16:09.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:09 smithi159 podman[96452]: 2024-09-13 22:16:09.282304089 +0000 UTC m=+0.139208481 container create 03faf9c83939acbba5910051e2172b7bc0bc624cf665932e97ffd94940657894 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731) 2024-09-13T22:16:09.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:09 smithi159 podman[96452]: 2024-09-13 22:16:09.50143363 +0000 UTC m=+0.358338028 container init 03faf9c83939acbba5910051e2172b7bc0bc624cf665932e97ffd94940657894 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:16:09.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:09 smithi159 podman[96452]: 2024-09-13 22:16:09.504823172 +0000 UTC m=+0.361727586 container start 03faf9c83939acbba5910051e2172b7bc0bc624cf665932e97ffd94940657894 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T22:16:10.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:09 smithi159 ceph-mon[82000]: pgmap v142: 65 pgs: 5 stale+active+clean, 60 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 75 objects/s recovering 2024-09-13T22:16:10.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:09 smithi159 ceph-mon[82000]: osdmap e83: 6 total, 5 up, 6 in 2024-09-13T22:16:10.010 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:09 smithi159 podman[96452]: 2024-09-13 22:16:09.593330961 +0000 UTC m=+0.450235354 container attach 03faf9c83939acbba5910051e2172b7bc0bc624cf665932e97ffd94940657894 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T22:16:10.010 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:09 smithi159 podman[96452]: 2024-09-13 22:16:09.692440122 +0000 UTC m=+0.549344518 container died 03faf9c83939acbba5910051e2172b7bc0bc624cf665932e97ffd94940657894 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T22:16:10.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:09 smithi089 ceph-mon[109939]: pgmap v142: 65 pgs: 5 stale+active+clean, 60 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 0 B/s, 75 objects/s recovering 2024-09-13T22:16:10.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:09 smithi089 ceph-mon[109939]: osdmap e83: 6 total, 5 up, 6 in 2024-09-13T22:16:10.723 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:10 smithi159 podman[96475]: 2024-09-13 22:16:10.305334389 +0000 UTC m=+0.607167387 container remove 03faf9c83939acbba5910051e2172b7bc0bc624cf665932e97ffd94940657894 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T22:16:10.723 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:10 smithi159 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T22:16:10.724 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:10 smithi159 systemd[1]: Stopped Ceph osd.4 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:16:10.724 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:10 smithi159 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 90ms CPU time. 2024-09-13T22:16:10.724 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:10 smithi159 systemd[1]: Starting Ceph osd.4 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:16:10.998 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:10 smithi159 ceph-mon[82000]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T22:16:10.999 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:10 smithi159 ceph-mon[82000]: Health check failed: Degraded data redundancy: 19/222 objects degraded (8.559%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:10.999 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:10 smithi159 podman[96574]: 2024-09-13 22:16:10.72282976 +0000 UTC m=+0.098226085 container create f48750f177ab0d87d20a991d10a0461d2b9e89188fc439efc3f0b10b3f90cd33 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:16:10.999 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:10 smithi159 podman[96574]: 2024-09-13 22:16:10.640622695 +0000 UTC m=+0.016019033 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:16:10.999 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:10 smithi159 podman[96574]: 2024-09-13 22:16:10.967550656 +0000 UTC m=+0.342946990 container init f48750f177ab0d87d20a991d10a0461d2b9e89188fc439efc3f0b10b3f90cd33 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T22:16:10.999 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:10 smithi159 podman[96574]: 2024-09-13 22:16:10.97081432 +0000 UTC m=+0.346210644 container start f48750f177ab0d87d20a991d10a0461d2b9e89188fc439efc3f0b10b3f90cd33 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:16:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.063+0000 7f77a4f03640 1 -- 172.21.15.89:0/3036457275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0101630 msgr2=0x7f77a0109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.063+0000 7f77a4f03640 1 --2- 172.21.15.89:0/3036457275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0101630 0x7f77a0109b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f77880098b0 tx=0x7f778802a560 comp rx=0 tx=0).stop 2024-09-13T22:16:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.063+0000 7f77a4f03640 1 -- 172.21.15.89:0/3036457275 shutdown_connections 2024-09-13T22:16:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.063+0000 7f77a4f03640 1 --2- 172.21.15.89:0/3036457275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0101630 0x7f77a0109b20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.063+0000 7f77a4f03640 1 --2- 172.21.15.89:0/3036457275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77a0100d10 0x7f77a01010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.063+0000 7f77a4f03640 1 -- 172.21.15.89:0/3036457275 >> 172.21.15.89:0/3036457275 conn(0x7f77a00758a0 msgr2=0x7f77a00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.063+0000 7f77a4f03640 1 -- 172.21.15.89:0/3036457275 shutdown_connections 2024-09-13T22:16:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.063+0000 7f77a4f03640 1 -- 172.21.15.89:0/3036457275 wait complete. 2024-09-13T22:16:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.064+0000 7f77a4f03640 1 Processor -- start 2024-09-13T22:16:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.064+0000 7f77a4f03640 1 -- start start 2024-09-13T22:16:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f77a4f03640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0100d10 0x7f77a00fe970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f77a4f03640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77a0101630 0x7f77a00feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f77a4f03640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00ff3f0 con 0x7f77a0100d10 2024-09-13T22:16:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f77a4f03640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00ff560 con 0x7f77a0101630 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f779e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0100d10 0x7f77a00fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f779e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0100d10 0x7f77a00fe970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42700/0 (socket says 172.21.15.89:42700) 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f779e59c640 1 -- 172.21.15.89:0/2879800584 learned_addr learned my addr 172.21.15.89:0/2879800584 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f779dd9b640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77a0101630 0x7f77a00feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f779e59c640 1 -- 172.21.15.89:0/2879800584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77a0101630 msgr2=0x7f77a00feeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f779e59c640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77a0101630 0x7f77a00feeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f779e59c640 1 -- 172.21.15.89:0/2879800584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788009560 con 0x7f77a0100d10 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f779e59c640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0100d10 0x7f77a00fe970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f779800eb10 tx=0x7f779800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f77977fe640 1 -- 172.21.15.89:0/2879800584 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7798004b20 con 0x7f77a0100d10 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f77977fe640 1 -- 172.21.15.89:0/2879800584 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7798004c80 con 0x7f77a0100d10 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a01a1d20 con 0x7f77a0100d10 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.065+0000 7f77977fe640 1 -- 172.21.15.89:0/2879800584 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7798010640 con 0x7f77a0100d10 2024-09-13T22:16:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.066+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a01a2080 con 0x7f77a0100d10 2024-09-13T22:16:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.067+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a00684b0 con 0x7f77a0100d10 2024-09-13T22:16:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.067+0000 7f77977fe640 1 -- 172.21.15.89:0/2879800584 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f77980055e0 con 0x7f77a0100d10 2024-09-13T22:16:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.068+0000 7f77977fe640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f778c06e600 0x7f778c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.068+0000 7f779dd9b640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f778c06e600 0x7f778c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.068+0000 7f77977fe640 1 -- 172.21.15.89:0/2879800584 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f7798014070 con 0x7f77a0100d10 2024-09-13T22:16:11.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.068+0000 7f779dd9b640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f778c06e600 0x7f778c070ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7788009880 tx=0x7f7788005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:11.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.072+0000 7f77977fe640 1 -- 172.21.15.89:0/2879800584 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7798057f20 con 0x7f77a0100d10 2024-09-13T22:16:11.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:10 smithi089 ceph-mon[109939]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T22:16:11.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:10 smithi089 ceph-mon[109939]: Health check failed: Degraded data redundancy: 19/222 objects degraded (8.559%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:11.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.256+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77a010cda0 con 0x7f778c06e600 2024-09-13T22:16:11.261 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:11 smithi159 podman[96574]: 2024-09-13 22:16:11.092670585 +0000 UTC m=+0.468066929 container attach f48750f177ab0d87d20a991d10a0461d2b9e89188fc439efc3f0b10b3f90cd33 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be) 2024-09-13T22:16:11.261 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:11 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate[96589]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:16:11.261 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:11 smithi159 bash[96574]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:16:11.261 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:11 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate[96589]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:16:11.261 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:11 smithi159 bash[96574]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:16:11.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.258+0000 7f77977fe640 1 -- 172.21.15.89:0/2879800584 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f77a010cda0 con 0x7f778c06e600 2024-09-13T22:16:11.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f778c06e600 msgr2=0x7f778c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f778c06e600 0x7f778c070ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7788009880 tx=0x7f7788005a20 comp rx=0 tx=0).stop 2024-09-13T22:16:11.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0100d10 msgr2=0x7f77a00fe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0100d10 0x7f77a00fe970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f779800eb10 tx=0x7f779800c2d0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 shutdown_connections 2024-09-13T22:16:11.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f778c06e600 0x7f778c070ac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77a0101630 0x7f77a00feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 --2- 172.21.15.89:0/2879800584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77a0100d10 0x7f77a00fe970 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 >> 172.21.15.89:0/2879800584 conn(0x7f77a00758a0 msgr2=0x7f77a0101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:11.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 shutdown_connections 2024-09-13T22:16:11.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.260+0000 7f77a4f03640 1 -- 172.21.15.89:0/2879800584 wait complete. 2024-09-13T22:16:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:16:11.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 -- 172.21.15.89:0/3067581359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 msgr2=0x7fc3980fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 --2- 172.21.15.89:0/3067581359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 0x7fc3980fee50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc388009880 tx=0x7fc38802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 -- 172.21.15.89:0/3067581359 shutdown_connections 2024-09-13T22:16:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 --2- 172.21.15.89:0/3067581359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 0x7fc3980fee50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 --2- 172.21.15.89:0/3067581359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3981049f0 0x7fc398104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 -- 172.21.15.89:0/3067581359 >> 172.21.15.89:0/3067581359 conn(0x7fc3980758a0 msgr2=0x7fc3980fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 -- 172.21.15.89:0/3067581359 shutdown_connections 2024-09-13T22:16:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 -- 172.21.15.89:0/3067581359 wait complete. 2024-09-13T22:16:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 Processor -- start 2024-09-13T22:16:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 -- start start 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 0x7fc39819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.343+0000 7fc39f119640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3981049f0 0x7fc39819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39f119640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39819c4c0 con 0x7fc3980fe9f0 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39f119640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc398195a50 con 0x7fc3981049f0 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39ceb5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 0x7fc39819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39ceb5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 0x7fc39819b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42714/0 (socket says 172.21.15.89:42714) 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39ceb5640 1 -- 172.21.15.89:0/1702080640 learned_addr learned my addr 172.21.15.89:0/1702080640 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc38ffff640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3981049f0 0x7fc39819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39ceb5640 1 -- 172.21.15.89:0/1702080640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3981049f0 msgr2=0x7fc39819bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39ceb5640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3981049f0 0x7fc39819bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39ceb5640 1 -- 172.21.15.89:0/1702080640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388009560 con 0x7fc3980fe9f0 2024-09-13T22:16:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc38ffff640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3981049f0 0x7fc39819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:16:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39ceb5640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 0x7fc39819b960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc39400b420 tx=0x7fc39400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc38dffb640 1 -- 172.21.15.89:0/1702080640 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc394011800 con 0x7fc3980fe9f0 2024-09-13T22:16:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc38dffb640 1 -- 172.21.15.89:0/1702080640 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc394011e20 con 0x7fc3980fe9f0 2024-09-13T22:16:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc398195d30 con 0x7fc3980fe9f0 2024-09-13T22:16:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.344+0000 7fc38dffb640 1 -- 172.21.15.89:0/1702080640 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc39400f2e0 con 0x7fc3980fe9f0 2024-09-13T22:16:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.345+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc398196250 con 0x7fc3980fe9f0 2024-09-13T22:16:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.346+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc398100130 con 0x7fc3980fe9f0 2024-09-13T22:16:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.346+0000 7fc38dffb640 1 -- 172.21.15.89:0/1702080640 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc394010380 con 0x7fc3980fe9f0 2024-09-13T22:16:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.346+0000 7fc38dffb640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc38006e5f0 0x7fc380070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.347+0000 7fc38dffb640 1 -- 172.21.15.89:0/1702080640 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fc39408e0f0 con 0x7fc3980fe9f0 2024-09-13T22:16:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.347+0000 7fc38ffff640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc38006e5f0 0x7fc380070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.347+0000 7fc38ffff640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc38006e5f0 0x7fc380070ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc388000c00 tx=0x7fc388005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:11.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.351+0000 7fc38dffb640 1 -- 172.21.15.89:0/1702080640 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc394057170 con 0x7fc3980fe9f0 2024-09-13T22:16:11.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.532+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc39810bd30 con 0x7fc38006e5f0 2024-09-13T22:16:11.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.533+0000 7fc38dffb640 1 -- 172.21.15.89:0/1702080640 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc39810bd30 con 0x7fc38006e5f0 2024-09-13T22:16:11.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc38006e5f0 msgr2=0x7fc380070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc38006e5f0 0x7fc380070ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc388000c00 tx=0x7fc388005a20 comp rx=0 tx=0).stop 2024-09-13T22:16:11.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 msgr2=0x7fc39819b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 0x7fc39819b960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc39400b420 tx=0x7fc39400b8e0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 shutdown_connections 2024-09-13T22:16:11.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc38006e5f0 0x7fc380070ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3981049f0 0x7fc39819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 --2- 172.21.15.89:0/1702080640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3980fe9f0 0x7fc39819b960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 >> 172.21.15.89:0/1702080640 conn(0x7fc3980758a0 msgr2=0x7fc398067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:11.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 shutdown_connections 2024-09-13T22:16:11.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.535+0000 7fc39f119640 1 -- 172.21.15.89:0/1702080640 wait complete. 2024-09-13T22:16:11.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.616+0000 7f49c6f85640 1 -- 172.21.15.89:0/3730241592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 msgr2=0x7f49c0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.616+0000 7f49c6f85640 1 --2- 172.21.15.89:0/3730241592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 0x7f49c0104e10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009880 tx=0x7f49b402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.616+0000 7f49c6f85640 1 -- 172.21.15.89:0/3730241592 shutdown_connections 2024-09-13T22:16:11.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.616+0000 7f49c6f85640 1 --2- 172.21.15.89:0/3730241592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c00fea30 0x7f49c00fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.616+0000 7f49c6f85640 1 --2- 172.21.15.89:0/3730241592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 0x7f49c0104e10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.616+0000 7f49c6f85640 1 -- 172.21.15.89:0/3730241592 >> 172.21.15.89:0/3730241592 conn(0x7f49c00fa730 msgr2=0x7f49c00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:11.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.616+0000 7f49c6f85640 1 -- 172.21.15.89:0/3730241592 shutdown_connections 2024-09-13T22:16:11.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.616+0000 7f49c6f85640 1 -- 172.21.15.89:0/3730241592 wait complete. 2024-09-13T22:16:11.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49c6f85640 1 Processor -- start 2024-09-13T22:16:11.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49c6f85640 1 -- start start 2024-09-13T22:16:11.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49c6f85640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c00fea30 0x7f49c0194830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49c6f85640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 0x7f49c0194d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49c6f85640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c01952b0 con 0x7f49c0104a30 2024-09-13T22:16:11.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49c6f85640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0195420 con 0x7f49c00fea30 2024-09-13T22:16:11.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49bffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 0x7f49c0194d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49bffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 0x7f49c0194d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42736/0 (socket says 172.21.15.89:42736) 2024-09-13T22:16:11.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49bffff640 1 -- 172.21.15.89:0/3027950166 learned_addr learned my addr 172.21.15.89:0/3027950166 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:11.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49c4d21640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c00fea30 0x7f49c0194830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49bffff640 1 -- 172.21.15.89:0/3027950166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c00fea30 msgr2=0x7f49c0194830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49bffff640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c00fea30 0x7f49c0194830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49bffff640 1 -- 172.21.15.89:0/3027950166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4009560 con 0x7f49c0104a30 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49c4d21640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c00fea30 0x7f49c0194830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.617+0000 7f49bffff640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 0x7f49c0194d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00b420 tx=0x7f49ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.618+0000 7f49bdffb640 1 -- 172.21.15.89:0/3027950166 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ac011800 con 0x7f49c0104a30 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.618+0000 7f49bdffb640 1 -- 172.21.15.89:0/3027950166 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49ac011e20 con 0x7f49c0104a30 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.618+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c01a1ea0 con 0x7f49c0104a30 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.618+0000 7f49bdffb640 1 -- 172.21.15.89:0/3027950166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ac00f2e0 con 0x7f49c0104a30 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.618+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c01a2200 con 0x7f49c0104a30 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.619+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c0100170 con 0x7f49c0104a30 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.619+0000 7f49bdffb640 1 -- 172.21.15.89:0/3027950166 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f49ac010380 con 0x7f49c0104a30 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.620+0000 7f49bdffb640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f49b006e5f0 0x7f49b0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.620+0000 7f49bdffb640 1 -- 172.21.15.89:0/3027950166 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f49ac08dfe0 con 0x7f49c0104a30 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.620+0000 7f49c4d21640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f49b006e5f0 0x7f49b0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.620+0000 7f49c4d21640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f49b006e5f0 0x7f49b0070ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49b4006010 tx=0x7f49b4005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:11.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.624+0000 7f49bdffb640 1 -- 172.21.15.89:0/3027950166 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f49ac0570e0 con 0x7f49c0104a30 2024-09-13T22:16:11.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.802+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f49c0107040 con 0x7f49b006e5f0 2024-09-13T22:16:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.812+0000 7f49bdffb640 1 -- 172.21.15.89:0/3027950166 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f49c0107040 con 0x7f49b006e5f0 2024-09-13T22:16:11.813 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:16:11.813 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (4m) 61s ago 15m 25.8M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:16:11.813 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (15m) 61s ago 15m 8572k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:16:11.813 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (14m) 28s ago 14m 8346k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:16:11.813 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (2m) 61s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:16:11.813 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (2m) 28s ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (4m) 61s ago 15m 80.6M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (9m) 61s ago 9m 18.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (9m) 61s ago 9m 16.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (9m) 28s ago 9m 160M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (9m) 28s ago 9m 18.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (6m) 61s ago 16m 500M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (5m) 28s ago 14m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (3m) 61s ago 16m 47.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (3m) 28s ago 14m 37.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (5m) 61s ago 15m 15.4M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:16:11.814 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (5m) 28s ago 14m 15.5M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:16:11.815 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (2m) 61s ago 13m 93.5M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:16:11.815 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (101s) 61s ago 13m 105M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 3d2a1d778a36 2024-09-13T22:16:11.815 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (66s) 61s ago 12m 12.1M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 ffb294d5c14f 2024-09-13T22:16:11.815 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (31s) 28s ago 12m 12.7M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 6724e7895aeb 2024-09-13T22:16:11.815 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (11m) 28s ago 11m 249M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d2bdb10f2f19 2024-09-13T22:16:11.815 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (11m) 28s ago 11m 255M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:16:11.815 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (5m) 61s ago 14m 63.9M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:16:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f49b006e5f0 msgr2=0x7f49b0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f49b006e5f0 0x7f49b0070ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49b4006010 tx=0x7f49b4005e60 comp rx=0 tx=0).stop 2024-09-13T22:16:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 msgr2=0x7f49c0194d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 0x7f49c0194d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00b420 tx=0x7f49ac00b8e0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 shutdown_connections 2024-09-13T22:16:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f49b006e5f0 0x7f49b0070ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49c0104a30 0x7f49c0194d70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 --2- 172.21.15.89:0/3027950166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c00fea30 0x7f49c0194830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 >> 172.21.15.89:0/3027950166 conn(0x7f49c00fa730 msgr2=0x7f49c00fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:11.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 shutdown_connections 2024-09-13T22:16:11.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.814+0000 7f49c6f85640 1 -- 172.21.15.89:0/3027950166 wait complete. 2024-09-13T22:16:11.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.893+0000 7fdceb628640 1 -- 172.21.15.89:0/2001518112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 msgr2=0x7fdce4104790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.893+0000 7fdceb628640 1 --2- 172.21.15.89:0/2001518112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 0x7fdce4104790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009880 tx=0x7fdce002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.893+0000 7fdceb628640 1 -- 172.21.15.89:0/2001518112 shutdown_connections 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.893+0000 7fdceb628640 1 --2- 172.21.15.89:0/2001518112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 0x7fdce4104790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.893+0000 7fdceb628640 1 --2- 172.21.15.89:0/2001518112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce40fe2a0 0x7fdce40fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.893+0000 7fdceb628640 1 -- 172.21.15.89:0/2001518112 >> 172.21.15.89:0/2001518112 conn(0x7fdce40f9e70 msgr2=0x7fdce40fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.893+0000 7fdceb628640 1 -- 172.21.15.89:0/2001518112 shutdown_connections 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.893+0000 7fdceb628640 1 -- 172.21.15.89:0/2001518112 wait complete. 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdceb628640 1 Processor -- start 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdceb628640 1 -- start start 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdceb628640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce40fe2a0 0x7fdce419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdceb628640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 0x7fdce419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdceb628640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce419c4b0 con 0x7fdce40fec50 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdceb628640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce4195a40 con 0x7fdce40fe2a0 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdce8bc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 0x7fdce419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdce8bc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 0x7fdce419be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42750/0 (socket says 172.21.15.89:42750) 2024-09-13T22:16:11.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdce8bc3640 1 -- 172.21.15.89:0/3073671971 learned_addr learned my addr 172.21.15.89:0/3073671971 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:11.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdce93c4640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce40fe2a0 0x7fdce419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdce8bc3640 1 -- 172.21.15.89:0/3073671971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce40fe2a0 msgr2=0x7fdce419b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:11.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdce8bc3640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce40fe2a0 0x7fdce419b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:11.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdce8bc3640 1 -- 172.21.15.89:0/3073671971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce0009560 con 0x7fdce40fec50 2024-09-13T22:16:11.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.894+0000 7fdce8bc3640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 0x7fdce419be90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdce002a9c0 tx=0x7fdce00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:11.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.895+0000 7fdcd67fc640 1 -- 172.21.15.89:0/3073671971 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdce0004aa0 con 0x7fdce40fec50 2024-09-13T22:16:11.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.895+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce4195cc0 con 0x7fdce40fec50 2024-09-13T22:16:11.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.895+0000 7fdcd67fc640 1 -- 172.21.15.89:0/3073671971 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdce0004c00 con 0x7fdce40fec50 2024-09-13T22:16:11.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.895+0000 7fdcd67fc640 1 -- 172.21.15.89:0/3073671971 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdce0003ab0 con 0x7fdce40fec50 2024-09-13T22:16:11.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.895+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce41961b0 con 0x7fdce40fec50 2024-09-13T22:16:11.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.896+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce4101360 con 0x7fdce40fec50 2024-09-13T22:16:11.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.896+0000 7fdcd67fc640 1 -- 172.21.15.89:0/3073671971 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdce0003ce0 con 0x7fdce40fec50 2024-09-13T22:16:11.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.897+0000 7fdcd67fc640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdcd006e5f0 0x7fdcd0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:11.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.897+0000 7fdcd67fc640 1 -- 172.21.15.89:0/3073671971 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fdce00af860 con 0x7fdce40fec50 2024-09-13T22:16:11.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.897+0000 7fdce93c4640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdcd006e5f0 0x7fdcd0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:11.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.897+0000 7fdce93c4640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdcd006e5f0 0x7fdcd0070ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009f20 tx=0x7fdcd80094f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:11.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:11.901+0000 7fdcd67fc640 1 -- 172.21.15.89:0/3073671971 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdce00788e0 con 0x7fdce40fec50 2024-09-13T22:16:12.130 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:11 smithi159 ceph-mon[82000]: pgmap v144: 65 pgs: 6 active+undersized, 16 peering, 1 stale+active+clean, 5 active+undersized+degraded, 37 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 19/222 objects degraded (8.559%) 2024-09-13T22:16:12.130 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:11 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate[96589]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T22:16:12.130 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:11 smithi159 bash[96574]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T22:16:12.130 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:11 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate[96589]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T22:16:12.130 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:11 smithi159 bash[96574]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T22:16:12.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.154+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdce40fe700 con 0x7fdce40fec50 2024-09-13T22:16:12.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:11 smithi089 ceph-mon[109939]: pgmap v144: 65 pgs: 6 active+undersized, 16 peering, 1 stale+active+clean, 5 active+undersized+degraded, 37 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 19/222 objects degraded (8.559%) 2024-09-13T22:16:12.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.154+0000 7fdcd67fc640 1 -- 172.21.15.89:0/3073671971 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fdce007bfa0 con 0x7fdce40fec50 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:16:12.156 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:16:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:16:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:16:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 5, 2024-09-13T22:16:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 8 2024-09-13T22:16:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:16:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdcd006e5f0 msgr2=0x7fdcd0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdcd006e5f0 0x7fdcd0070ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009f20 tx=0x7fdcd80094f0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 msgr2=0x7fdce419be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 0x7fdce419be90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdce002a9c0 tx=0x7fdce00055a0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 shutdown_connections 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdcd006e5f0 0x7fdcd0070ab0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce40fec50 0x7fdce419be90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 --2- 172.21.15.89:0/3073671971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdce40fe2a0 0x7fdce419b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 >> 172.21.15.89:0/3073671971 conn(0x7fdce40f9e70 msgr2=0x7fdce40fb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 shutdown_connections 2024-09-13T22:16:12.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.156+0000 7fdceb628640 1 -- 172.21.15.89:0/3073671971 wait complete. 2024-09-13T22:16:12.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.237+0000 7f81384c3640 1 -- 172.21.15.89:0/1514963037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81300ffda0 msgr2=0x7f8130100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.237+0000 7f81384c3640 1 --2- 172.21.15.89:0/1514963037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81300ffda0 0x7f8130100180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f812c009880 tx=0x7f812c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.237+0000 7f81384c3640 1 -- 172.21.15.89:0/1514963037 shutdown_connections 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.237+0000 7f81384c3640 1 --2- 172.21.15.89:0/1514963037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8130100750 0x7f81301047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.237+0000 7f81384c3640 1 --2- 172.21.15.89:0/1514963037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81300ffda0 0x7f8130100180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.237+0000 7f81384c3640 1 -- 172.21.15.89:0/1514963037 >> 172.21.15.89:0/1514963037 conn(0x7f81300fb840 msgr2=0x7f81300fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.237+0000 7f81384c3640 1 -- 172.21.15.89:0/1514963037 shutdown_connections 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.237+0000 7f81384c3640 1 -- 172.21.15.89:0/1514963037 wait complete. 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f81384c3640 1 Processor -- start 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f81384c3640 1 -- start start 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f81384c3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81300ffda0 0x7f813019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f81384c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8130100750 0x7f813019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f81384c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8130195a10 con 0x7f8130100750 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f81384c3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8130195b50 con 0x7f81300ffda0 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f8135a5e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8130100750 0x7f813019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f8135a5e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8130100750 0x7f813019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42758/0 (socket says 172.21.15.89:42758) 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f8135a5e640 1 -- 172.21.15.89:0/375252164 learned_addr learned my addr 172.21.15.89:0/375252164 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.238+0000 7f813625f640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81300ffda0 0x7f813019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.239+0000 7f8135a5e640 1 -- 172.21.15.89:0/375252164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81300ffda0 msgr2=0x7f813019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.239+0000 7f8135a5e640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81300ffda0 0x7f813019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.239+0000 7f8135a5e640 1 -- 172.21.15.89:0/375252164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c009560 con 0x7f8130100750 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.239+0000 7f8135a5e640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8130100750 0x7f813019bef0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f812000d6f0 tx=0x7f812000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.239+0000 7f81277fe640 1 -- 172.21.15.89:0/375252164 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8120009a30 con 0x7f8130100750 2024-09-13T22:16:12.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.239+0000 7f81277fe640 1 -- 172.21.15.89:0/375252164 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81200054e0 con 0x7f8130100750 2024-09-13T22:16:12.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.239+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8130195e30 con 0x7f8130100750 2024-09-13T22:16:12.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.239+0000 7f81277fe640 1 -- 172.21.15.89:0/375252164 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8120010460 con 0x7f8130100750 2024-09-13T22:16:12.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.239+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8130196380 con 0x7f8130100750 2024-09-13T22:16:12.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.240+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8130101280 con 0x7f8130100750 2024-09-13T22:16:12.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.240+0000 7f81277fe640 1 -- 172.21.15.89:0/375252164 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8120009b90 con 0x7f8130100750 2024-09-13T22:16:12.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.241+0000 7f81277fe640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f811c06e5f0 0x7f811c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:12.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.241+0000 7f81277fe640 1 -- 172.21.15.89:0/375252164 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f812008e1d0 con 0x7f8130100750 2024-09-13T22:16:12.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.241+0000 7f813625f640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f811c06e5f0 0x7f811c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:12.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.241+0000 7f813625f640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f811c06e5f0 0x7f811c070ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f812c009230 tx=0x7f812c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:12.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.245+0000 7f81277fe640 1 -- 172.21.15.89:0/375252164 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8120057380 con 0x7f8130100750 2024-09-13T22:16:12.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.444+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8130196f70 con 0x7f8130100750 2024-09-13T22:16:12.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.444+0000 7f81277fe640 1 -- 172.21.15.89:0/375252164 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f8120017790 con 0x7f8130100750 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:e15 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:16:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:16:12.447 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:16:12.448 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:16:12.449 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:16:12.449 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:16:12.449 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:16:12.449 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f811c06e5f0 msgr2=0x7f811c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f811c06e5f0 0x7f811c070ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f812c009230 tx=0x7f812c0058d0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8130100750 msgr2=0x7f813019bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8130100750 0x7f813019bef0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f812000d6f0 tx=0x7f812000dbb0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 shutdown_connections 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f811c06e5f0 0x7f811c070ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8130100750 0x7f813019bef0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 --2- 172.21.15.89:0/375252164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81300ffda0 0x7f813019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 >> 172.21.15.89:0/375252164 conn(0x7f81300fb840 msgr2=0x7f81300fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:12.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 shutdown_connections 2024-09-13T22:16:12.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.446+0000 7f81384c3640 1 -- 172.21.15.89:0/375252164 wait complete. 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate[96589]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 bash[96574]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate[96589]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 bash[96574]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate[96589]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 bash[96574]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate[96589]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 bash[96574]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate[96589]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 bash[96574]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T22:16:12.464 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 podman[96574]: 2024-09-13 22:16:12.158319268 +0000 UTC m=+1.533715607 container died f48750f177ab0d87d20a991d10a0461d2b9e89188fc439efc3f0b10b3f90cd33 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:16:12.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.528+0000 7f8238679640 1 -- 172.21.15.89:0/1164098187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 msgr2=0x7f82300fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.528+0000 7f8238679640 1 --2- 172.21.15.89:0/1164098187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 0x7f82300fee90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8220009880 tx=0x7f822002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.528+0000 7f8238679640 1 -- 172.21.15.89:0/1164098187 shutdown_connections 2024-09-13T22:16:12.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.528+0000 7f8238679640 1 --2- 172.21.15.89:0/1164098187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 0x7f82300fee90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.528+0000 7f8238679640 1 --2- 172.21.15.89:0/1164098187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8230104a30 0x7f8230104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.528+0000 7f8238679640 1 -- 172.21.15.89:0/1164098187 >> 172.21.15.89:0/1164098187 conn(0x7f82300fa730 msgr2=0x7f82300fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.528+0000 7f8238679640 1 -- 172.21.15.89:0/1164098187 shutdown_connections 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.528+0000 7f8238679640 1 -- 172.21.15.89:0/1164098187 wait complete. 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8238679640 1 Processor -- start 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8238679640 1 -- start start 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8238679640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 0x7f823019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8238679640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8230104a30 0x7f823019bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8238679640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823019c520 con 0x7f82300fea30 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8238679640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8230195ab0 con 0x7f8230104a30 2024-09-13T22:16:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8236415640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 0x7f823019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8236415640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 0x7f823019b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42772/0 (socket says 172.21.15.89:42772) 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8236415640 1 -- 172.21.15.89:0/212033561 learned_addr learned my addr 172.21.15.89:0/212033561 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8235c14640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8230104a30 0x7f823019bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8236415640 1 -- 172.21.15.89:0/212033561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8230104a30 msgr2=0x7f823019bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8236415640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8230104a30 0x7f823019bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.529+0000 7f8236415640 1 -- 172.21.15.89:0/212033561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8220009560 con 0x7f82300fea30 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.530+0000 7f8236415640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 0x7f823019b9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f822c00b420 tx=0x7f822c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.530+0000 7f82277fe640 1 -- 172.21.15.89:0/212033561 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f822c011800 con 0x7f82300fea30 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.530+0000 7f82277fe640 1 -- 172.21.15.89:0/212033561 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f822c011e20 con 0x7f82300fea30 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.530+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8230195d90 con 0x7f82300fea30 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.530+0000 7f82277fe640 1 -- 172.21.15.89:0/212033561 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f822c00f2e0 con 0x7f82300fea30 2024-09-13T22:16:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.530+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82301962b0 con 0x7f82300fea30 2024-09-13T22:16:12.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.531+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8230100170 con 0x7f82300fea30 2024-09-13T22:16:12.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.531+0000 7f82277fe640 1 -- 172.21.15.89:0/212033561 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f822c010380 con 0x7f82300fea30 2024-09-13T22:16:12.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.532+0000 7f82277fe640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f821c06e5f0 0x7f821c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:12.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.532+0000 7f82277fe640 1 -- 172.21.15.89:0/212033561 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f822c08e0f0 con 0x7f82300fea30 2024-09-13T22:16:12.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.532+0000 7f8235c14640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f821c06e5f0 0x7f821c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:12.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.532+0000 7f8235c14640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f821c06e5f0 0x7f821c070ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8220000c00 tx=0x7f8220005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:12.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.536+0000 7f82277fe640 1 -- 172.21.15.89:0/212033561 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f822c057170 con 0x7f82300fea30 2024-09-13T22:16:12.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.723+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f823010bd20 con 0x7f821c06e5f0 2024-09-13T22:16:12.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.724+0000 7f82277fe640 1 -- 172.21.15.89:0/212033561 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f823010bd20 con 0x7f821c06e5f0 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "crash" 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "10/23 daemons upgraded", 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:16:12.726 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:16:12.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.726+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f821c06e5f0 msgr2=0x7f821c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.726+0000 7f8238679640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f821c06e5f0 0x7f821c070ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8220000c00 tx=0x7f8220005a20 comp rx=0 tx=0).stop 2024-09-13T22:16:12.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.726+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 msgr2=0x7f823019b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.726+0000 7f8238679640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 0x7f823019b9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f822c00b420 tx=0x7f822c00b8e0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.726+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 shutdown_connections 2024-09-13T22:16:12.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.726+0000 7f8238679640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f821c06e5f0 0x7f821c070ab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.726+0000 7f8238679640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8230104a30 0x7f823019bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.726+0000 7f8238679640 1 --2- 172.21.15.89:0/212033561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82300fea30 0x7f823019b9c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.726+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 >> 172.21.15.89:0/212033561 conn(0x7f82300fa730 msgr2=0x7f82300fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:12.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.727+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 shutdown_connections 2024-09-13T22:16:12.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.727+0000 7f8238679640 1 -- 172.21.15.89:0/212033561 wait complete. 2024-09-13T22:16:12.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.806+0000 7f3d12ad2640 1 -- 172.21.15.89:0/2277956786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c0fea30 msgr2=0x7f3d0c0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.806+0000 7f3d12ad2640 1 --2- 172.21.15.89:0/2277956786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c0fea30 0x7f3d0c0fee90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009880 tx=0x7f3cf802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.806+0000 7f3d12ad2640 1 -- 172.21.15.89:0/2277956786 shutdown_connections 2024-09-13T22:16:12.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.806+0000 7f3d12ad2640 1 --2- 172.21.15.89:0/2277956786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c0fea30 0x7f3d0c0fee90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.806+0000 7f3d12ad2640 1 --2- 172.21.15.89:0/2277956786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d0c104a30 0x7f3d0c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.806+0000 7f3d12ad2640 1 -- 172.21.15.89:0/2277956786 >> 172.21.15.89:0/2277956786 conn(0x7f3d0c0fa730 msgr2=0x7f3d0c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:12.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.806+0000 7f3d12ad2640 1 -- 172.21.15.89:0/2277956786 shutdown_connections 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.806+0000 7f3d12ad2640 1 -- 172.21.15.89:0/2277956786 wait complete. 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d12ad2640 1 Processor -- start 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d12ad2640 1 -- start start 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d12ad2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d0c0fea30 0x7f3d0c19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d12ad2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c104a30 0x7f3d0c19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d12ad2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c19e580 con 0x7f3d0c104a30 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d12ad2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c197b00 con 0x7f3d0c0fea30 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d0bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c104a30 0x7f3d0c19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d0bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c104a30 0x7f3d0c19def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42792/0 (socket says 172.21.15.89:42792) 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d0bfff640 1 -- 172.21.15.89:0/4171820075 learned_addr learned my addr 172.21.15.89:0/4171820075 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.807+0000 7f3d1086e640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d0c0fea30 0x7f3d0c19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:12.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.808+0000 7f3d0bfff640 1 -- 172.21.15.89:0/4171820075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d0c0fea30 msgr2=0x7f3d0c19d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:12.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.808+0000 7f3d0bfff640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d0c0fea30 0x7f3d0c19d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:12.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.808+0000 7f3d0bfff640 1 -- 172.21.15.89:0/4171820075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8009560 con 0x7f3d0c104a30 2024-09-13T22:16:12.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.808+0000 7f3d0bfff640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c104a30 0x7f3d0c19def0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8006010 tx=0x7f3cf80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:12.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.808+0000 7f3d09ffb640 1 -- 172.21.15.89:0/4171820075 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf8004aa0 con 0x7f3d0c104a30 2024-09-13T22:16:12.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.808+0000 7f3d09ffb640 1 -- 172.21.15.89:0/4171820075 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cf8031470 con 0x7f3d0c104a30 2024-09-13T22:16:12.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.808+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c197d80 con 0x7f3d0c104a30 2024-09-13T22:16:12.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.808+0000 7f3d09ffb640 1 -- 172.21.15.89:0/4171820075 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf8003940 con 0x7f3d0c104a30 2024-09-13T22:16:12.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.808+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c198270 con 0x7f3d0c104a30 2024-09-13T22:16:12.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.809+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c100170 con 0x7f3d0c104a30 2024-09-13T22:16:12.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.810+0000 7f3d09ffb640 1 -- 172.21.15.89:0/4171820075 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3cf8031b90 con 0x7f3d0c104a30 2024-09-13T22:16:12.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.810+0000 7f3d09ffb640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3cfc06e600 0x7f3cfc070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:12.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.810+0000 7f3d09ffb640 1 -- 172.21.15.89:0/4171820075 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f3cf80af740 con 0x7f3d0c104a30 2024-09-13T22:16:12.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.810+0000 7f3d1086e640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3cfc06e600 0x7f3cfc070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:12.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.811+0000 7f3d1086e640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3cfc06e600 0x7f3cfc070ac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d00005fd0 tx=0x7f3d0000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:12.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:12.815+0000 7f3d09ffb640 1 -- 172.21.15.89:0/4171820075 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3cf80788f0 con 0x7f3d0c104a30 2024-09-13T22:16:12.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:12 smithi089 ceph-mon[109939]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:12 smithi089 ceph-mon[109939]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:12 smithi089 ceph-mon[109939]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:12 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3073671971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:12.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:12 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/375252164' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:16:13.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.046+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3d0c0fee90 con 0x7f3d0c104a30 2024-09-13T22:16:13.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.046+0000 7f3d09ffb640 1 -- 172.21.15.89:0/4171820075 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1188 (secure 0 0 0) 0x7f3cf8004c00 con 0x7f3d0c104a30 2024-09-13T22:16:13.047 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 3 pgs peering; Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded 2024-09-13T22:16:13.047 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout: osd.4 (root=default,host=smithi159) is down 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.f is stuck peering for 5m, current state peering, last acting [0,5] 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout: pg 3.3 is stuck peering for 5m, current state peering, last acting [0,3] 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout: pg 3.9 is stuck peering for 5m, current state peering, last acting [2,5] 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 23/222 objects degraded (10.360%), 7 pgs degraded 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-13T22:16:13.048 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-13T22:16:13.049 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-13T22:16:13.049 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-13T22:16:13.049 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-13T22:16:13.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3cfc06e600 msgr2=0x7f3cfc070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:13.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3cfc06e600 0x7f3cfc070ac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d00005fd0 tx=0x7f3d0000b390 comp rx=0 tx=0).stop 2024-09-13T22:16:13.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c104a30 msgr2=0x7f3d0c19def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:13.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c104a30 0x7f3d0c19def0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8006010 tx=0x7f3cf80055a0 comp rx=0 tx=0).stop 2024-09-13T22:16:13.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 shutdown_connections 2024-09-13T22:16:13.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3cfc06e600 0x7f3cfc070ac0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:13.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c104a30 0x7f3d0c19def0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:13.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 --2- 172.21.15.89:0/4171820075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d0c0fea30 0x7f3d0c19d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:13.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 >> 172.21.15.89:0/4171820075 conn(0x7f3d0c0fa730 msgr2=0x7f3d0c0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:13.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 shutdown_connections 2024-09-13T22:16:13.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:13.048+0000 7f3d12ad2640 1 -- 172.21.15.89:0/4171820075 wait complete. 2024-09-13T22:16:13.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-mon[82000]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:13.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-mon[82000]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:13.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-mon[82000]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:13.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3073671971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:13.097 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:12 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/375252164' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:16:13.098 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 podman[96725]: 2024-09-13 22:16:12.780189676 +0000 UTC m=+0.615590014 container remove f48750f177ab0d87d20a991d10a0461d2b9e89188fc439efc3f0b10b3f90cd33 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T22:16:13.098 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 podman[96784]: 2024-09-13 22:16:12.981125262 +0000 UTC m=+0.104482437 container create 18175379d0ae3318546dda03ff5adf706e8a81fa5f9179894f67ab60fe6af9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T22:16:13.098 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:12 smithi159 podman[96784]: 2024-09-13 22:16:12.892706628 +0000 UTC m=+0.016063770 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:16:13.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:13 smithi159 podman[96784]: 2024-09-13 22:16:13.200208554 +0000 UTC m=+0.323565688 container init 18175379d0ae3318546dda03ff5adf706e8a81fa5f9179894f67ab60fe6af9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T22:16:13.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:13 smithi159 podman[96784]: 2024-09-13 22:16:13.203449563 +0000 UTC m=+0.326806697 container start 18175379d0ae3318546dda03ff5adf706e8a81fa5f9179894f67ab60fe6af9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T22:16:13.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:13 smithi159 ceph-osd[96804]: -- 172.21.15.159:0/936632606 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cd584461e0 con 0x55cd5842e000 2024-09-13T22:16:13.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:13 smithi159 bash[96784]: 18175379d0ae3318546dda03ff5adf706e8a81fa5f9179894f67ab60fe6af9e4 2024-09-13T22:16:13.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:13 smithi159 systemd[1]: Started Ceph osd.4 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:16:14.137 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:13 smithi159 ceph-mon[82000]: pgmap v145: 65 pgs: 9 active+undersized, 16 peering, 7 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-09-13T22:16:14.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:13 smithi159 ceph-mon[82000]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:14.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:13 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/4171820075' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:16:14.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:14.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:14.138 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:13 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:14.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:13 smithi089 ceph-mon[109939]: pgmap v145: 65 pgs: 9 active+undersized, 16 peering, 7 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-09-13T22:16:14.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:13 smithi089 ceph-mon[109939]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:14.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:13 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/4171820075' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:16:14.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:14.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:14.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:13 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:14.865 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:14 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:16:14.832+0000 7fd749120640 -1 Falling back to public interface 2024-09-13T22:16:15.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:14 smithi089 ceph-mon[109939]: pgmap v146: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 37/222 objects degraded (16.667%) 2024-09-13T22:16:15.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:14 smithi089 ceph-mon[109939]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T22:16:15.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:14 smithi159 ceph-mon[82000]: pgmap v146: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 37/222 objects degraded (16.667%) 2024-09-13T22:16:15.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:14 smithi159 ceph-mon[82000]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T22:16:17.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:17.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:17.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:17 smithi159 ceph-mon[82000]: pgmap v147: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 37/222 objects degraded (16.667%) 2024-09-13T22:16:17.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:17.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:17 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:17.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:17.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:17.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:17 smithi089 ceph-mon[109939]: pgmap v147: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 37/222 objects degraded (16.667%) 2024-09-13T22:16:17.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:17.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:17 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:19.911 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:19 smithi159 ceph-mon[82000]: pgmap v148: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 37/222 objects degraded (16.667%) 2024-09-13T22:16:19.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:19 smithi089 ceph-mon[109939]: pgmap v148: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 37/222 objects degraded (16.667%) 2024-09-13T22:16:21.150 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:16:20.897+0000 7fd749120640 -1 osd.4 81 log_to_monitors true 2024-09-13T22:16:21.150 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:16:20.989+0000 7fd73ceb2640 -1 osd.4 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:21.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T22:16:21.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T22:16:21.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T22:16:21.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 37/222 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:21.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: pgmap v149: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 37/222 objects degraded (16.667%) 2024-09-13T22:16:21.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='osd.4 [v2:172.21.15.159:6808/3224171132,v1:172.21.15.159:6809/3224171132]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:16:21.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:20 smithi159 ceph-mon[82000]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:21.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T22:16:21.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T22:16:21.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T22:16:21.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 37/222 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:21.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: pgmap v149: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 201 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 37/222 objects degraded (16.667%) 2024-09-13T22:16:21.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='osd.4 [v2:172.21.15.159:6808/3224171132,v1:172.21.15.159:6809/3224171132]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:16:21.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:20 smithi089 ceph-mon[109939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:16:22.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:21 smithi089 ceph-mon[109939]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T22:16:22.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:21 smithi089 ceph-mon[109939]: osdmap e84: 6 total, 5 up, 6 in 2024-09-13T22:16:22.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:21 smithi089 ceph-mon[109939]: from='osd.4 [v2:172.21.15.159:6808/3224171132,v1:172.21.15.159:6809/3224171132]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:16:22.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:21 smithi089 ceph-mon[109939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:16:22.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:22.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:16:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:21 smithi159 ceph-mon[82000]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T22:16:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:21 smithi159 ceph-mon[82000]: osdmap e84: 6 total, 5 up, 6 in 2024-09-13T22:16:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:21 smithi159 ceph-mon[82000]: from='osd.4 [v2:172.21.15.159:6808/3224171132,v1:172.21.15.159:6809/3224171132]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:16:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:21 smithi159 ceph-mon[82000]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:16:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:16:23.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:22 smithi089 ceph-mon[109939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:16:23.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:22 smithi089 ceph-mon[109939]: osd.4 [v2:172.21.15.159:6808/3224171132,v1:172.21.15.159:6809/3224171132] boot 2024-09-13T22:16:23.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:22 smithi089 ceph-mon[109939]: osdmap e85: 6 total, 6 up, 6 in 2024-09-13T22:16:23.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:22 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:16:23.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:22 smithi089 ceph-mon[109939]: pgmap v152: 65 pgs: 4 peering, 15 active+undersized, 13 active+undersized+degraded, 33 active+clean; 201 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 34/222 objects degraded (15.315%) 2024-09-13T22:16:23.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:22 smithi089 ceph-mon[109939]: osdmap e86: 6 total, 6 up, 6 in 2024-09-13T22:16:23.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:22 smithi159 ceph-mon[82000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:16:23.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:22 smithi159 ceph-mon[82000]: osd.4 [v2:172.21.15.159:6808/3224171132,v1:172.21.15.159:6809/3224171132] boot 2024-09-13T22:16:23.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:22 smithi159 ceph-mon[82000]: osdmap e85: 6 total, 6 up, 6 in 2024-09-13T22:16:23.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:22 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:16:23.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:22 smithi159 ceph-mon[82000]: pgmap v152: 65 pgs: 4 peering, 15 active+undersized, 13 active+undersized+degraded, 33 active+clean; 201 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 34/222 objects degraded (15.315%) 2024-09-13T22:16:23.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:22 smithi159 ceph-mon[82000]: osdmap e86: 6 total, 6 up, 6 in 2024-09-13T22:16:25.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:25 smithi089 ceph-mon[109939]: pgmap v154: 65 pgs: 4 peering, 3 active+undersized, 2 active+undersized+degraded, 56 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 3/222 objects degraded (1.351%) 2024-09-13T22:16:25.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:25 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:26.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:25 smithi159 ceph-mon[82000]: pgmap v154: 65 pgs: 4 peering, 3 active+undersized, 2 active+undersized+degraded, 56 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 3/222 objects degraded (1.351%) 2024-09-13T22:16:26.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:25 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:26.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:26 smithi089 ceph-mon[109939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded) 2024-09-13T22:16:27.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:26 smithi159 ceph-mon[82000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded) 2024-09-13T22:16:27.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:27 smithi089 ceph-mon[109939]: pgmap v155: 65 pgs: 4 peering, 61 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:28.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:27 smithi159 ceph-mon[82000]: pgmap v155: 65 pgs: 4 peering, 61 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:29.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:29 smithi089 ceph-mon[109939]: pgmap v156: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:30.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:29 smithi159 ceph-mon[82000]: pgmap v156: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:31.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:31 smithi089 ceph-mon[109939]: pgmap v157: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:32.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:31 smithi159 ceph-mon[82000]: pgmap v157: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:33.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:33 smithi089 ceph-mon[109939]: pgmap v158: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:34.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:33 smithi159 ceph-mon[82000]: pgmap v158: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:35 smithi159 ceph-mon[82000]: pgmap v159: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:36.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:35 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T22:16:36.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:35 smithi089 ceph-mon[109939]: pgmap v159: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:36.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:35 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T22:16:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:36 smithi159 ceph-mon[82000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T22:16:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:36 smithi159 ceph-mon[82000]: Upgrade: osd.5 is safe to restart 2024-09-13T22:16:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T22:16:37.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:37.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:37.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:16:37.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:37.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:36 smithi089 ceph-mon[109939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T22:16:37.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:36 smithi089 ceph-mon[109939]: Upgrade: osd.5 is safe to restart 2024-09-13T22:16:37.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:37.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T22:16:37.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:37.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:37.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:16:37.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:37 smithi159 ceph-mon[82000]: Upgrade: Updating osd.5 2024-09-13T22:16:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:37 smithi159 ceph-mon[82000]: Deploying daemon osd.5 on smithi159 2024-09-13T22:16:38.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:37 smithi159 ceph-mon[82000]: pgmap v160: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:38.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:37 smithi089 ceph-mon[109939]: Upgrade: Updating osd.5 2024-09-13T22:16:38.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:37 smithi089 ceph-mon[109939]: Deploying daemon osd.5 on smithi159 2024-09-13T22:16:38.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:37 smithi089 ceph-mon[109939]: pgmap v160: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:39.755 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:39 smithi159 systemd[1]: Stopping Ceph osd.5 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:16:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:39 smithi159 ceph-mon[82000]: pgmap v161: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:40.009 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:39 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[54928]: 2024-09-13T22:16:39.777+0000 7f1088dda640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:16:40.009 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:39 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[54928]: 2024-09-13T22:16:39.777+0000 7f1088dda640 -1 osd.5 86 *** Got signal Terminated *** 2024-09-13T22:16:40.009 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:39 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[54928]: 2024-09-13T22:16:39.777+0000 7f1088dda640 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:16:40.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:39 smithi089 ceph-mon[109939]: pgmap v161: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:41.137 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:40 smithi159 ceph-mon[82000]: osd.5 marked itself down and dead 2024-09-13T22:16:41.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:40 smithi089 ceph-mon[109939]: osd.5 marked itself down and dead 2024-09-13T22:16:41.412 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:41 smithi159 podman[101520]: 2024-09-13 22:16:41.136854995 +0000 UTC m=+1.476916499 container died d5a41b08cb913645d333d8fa5807e4356e331db238bb1ab08cdea2a796afddfa (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=reef-e4e227b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T22:16:41.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:41 smithi159 podman[101520]: 2024-09-13 22:16:41.502908105 +0000 UTC m=+1.842969607 container cleanup d5a41b08cb913645d333d8fa5807e4356e331db238bb1ab08cdea2a796afddfa (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T22:16:41.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:41 smithi159 bash[101520]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5 2024-09-13T22:16:42.118 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:41 smithi159 ceph-mon[82000]: pgmap v162: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:42.118 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:41 smithi159 ceph-mon[82000]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:16:42.118 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:41 smithi159 ceph-mon[82000]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T22:16:42.118 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:41 smithi159 ceph-mon[82000]: osdmap e87: 6 total, 5 up, 6 in 2024-09-13T22:16:42.119 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:41 smithi159 podman[101535]: 2024-09-13 22:16:41.791510258 +0000 UTC m=+0.651987237 container remove d5a41b08cb913645d333d8fa5807e4356e331db238bb1ab08cdea2a796afddfa (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T22:16:42.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:41 smithi089 ceph-mon[109939]: pgmap v162: 65 pgs: 65 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:42.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:41 smithi089 ceph-mon[109939]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T22:16:42.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:41 smithi089 ceph-mon[109939]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T22:16:42.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:41 smithi089 ceph-mon[109939]: osdmap e87: 6 total, 5 up, 6 in 2024-09-13T22:16:42.374 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:42 smithi159 podman[101620]: 2024-09-13 22:16:42.020701341 +0000 UTC m=+0.016495337 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:16:42.375 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:42 smithi159 podman[101620]: 2024-09-13 22:16:42.130165737 +0000 UTC m=+0.125959763 container create bd3a60b705cd97a9dab38b0d8d40ba67f97e2fc521a1a4123c7128b2b3e5f9c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T22:16:42.375 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:42 smithi159 podman[101620]: 2024-09-13 22:16:42.374417825 +0000 UTC m=+0.370211808 container init bd3a60b705cd97a9dab38b0d8d40ba67f97e2fc521a1a4123c7128b2b3e5f9c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T22:16:42.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:42 smithi159 podman[101620]: 2024-09-13 22:16:42.377919486 +0000 UTC m=+0.373713472 container start bd3a60b705cd97a9dab38b0d8d40ba67f97e2fc521a1a4123c7128b2b3e5f9c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T22:16:42.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:42 smithi159 podman[101620]: 2024-09-13 22:16:42.466344837 +0000 UTC m=+0.462138835 container attach bd3a60b705cd97a9dab38b0d8d40ba67f97e2fc521a1a4123c7128b2b3e5f9c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-13T22:16:42.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:42 smithi159 podman[101620]: 2024-09-13 22:16:42.571333581 +0000 UTC m=+0.567127575 container died bd3a60b705cd97a9dab38b0d8d40ba67f97e2fc521a1a4123c7128b2b3e5f9c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-13T22:16:42.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:42 smithi089 ceph-mon[109939]: osdmap e88: 6 total, 5 up, 6 in 2024-09-13T22:16:43.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.141+0000 7fd13dc61640 1 -- 172.21.15.89:0/3008197409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138100d00 msgr2=0x7fd1381010e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.141+0000 7fd13dc61640 1 --2- 172.21.15.89:0/3008197409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138100d00 0x7fd1381010e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd128009880 tx=0x7fd12802a530 comp rx=0 tx=0).stop 2024-09-13T22:16:43.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.142+0000 7fd13dc61640 1 -- 172.21.15.89:0/3008197409 shutdown_connections 2024-09-13T22:16:43.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.142+0000 7fd13dc61640 1 --2- 172.21.15.89:0/3008197409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd138101620 0x7fd138109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.142+0000 7fd13dc61640 1 --2- 172.21.15.89:0/3008197409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138100d00 0x7fd1381010e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.142+0000 7fd13dc61640 1 -- 172.21.15.89:0/3008197409 >> 172.21.15.89:0/3008197409 conn(0x7fd1380fa700 msgr2=0x7fd1380fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.142+0000 7fd13dc61640 1 -- 172.21.15.89:0/3008197409 shutdown_connections 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.142+0000 7fd13dc61640 1 -- 172.21.15.89:0/3008197409 wait complete. 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.142+0000 7fd13dc61640 1 Processor -- start 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd13dc61640 1 -- start start 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd13dc61640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd138100d00 0x7fd1380fe960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd13dc61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138101620 0x7fd1380feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd13dc61640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380ff3e0 con 0x7fd138101620 2024-09-13T22:16:43.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd13dc61640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380ff550 con 0x7fd138100d00 2024-09-13T22:16:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd136ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138101620 0x7fd1380feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd136ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138101620 0x7fd1380feea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34162/0 (socket says 172.21.15.89:34162) 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd136ffd640 1 -- 172.21.15.89:0/2404385652 learned_addr learned my addr 172.21.15.89:0/2404385652 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd1377fe640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd138100d00 0x7fd1380fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd136ffd640 1 -- 172.21.15.89:0/2404385652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd138100d00 msgr2=0x7fd1380fe960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd136ffd640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd138100d00 0x7fd1380fe960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd136ffd640 1 -- 172.21.15.89:0/2404385652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128009560 con 0x7fd138101620 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.143+0000 7fd136ffd640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138101620 0x7fd1380feea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c8c0 tx=0x7fd12c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.144+0000 7fd134ff9640 1 -- 172.21.15.89:0/2404385652 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12c00aea0 con 0x7fd138101620 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.144+0000 7fd134ff9640 1 -- 172.21.15.89:0/2404385652 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd12c007e70 con 0x7fd138101620 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.144+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1381a1cd0 con 0x7fd138101620 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.144+0000 7fd134ff9640 1 -- 172.21.15.89:0/2404385652 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12c0049d0 con 0x7fd138101620 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.144+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1381a2030 con 0x7fd138101620 2024-09-13T22:16:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.145+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd138068d30 con 0x7fd138101620 2024-09-13T22:16:43.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.145+0000 7fd134ff9640 1 -- 172.21.15.89:0/2404385652 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd12c0041f0 con 0x7fd138101620 2024-09-13T22:16:43.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.146+0000 7fd134ff9640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd12006e5f0 0x7fd120070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.146+0000 7fd134ff9640 1 -- 172.21.15.89:0/2404385652 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fd12c08e3d0 con 0x7fd138101620 2024-09-13T22:16:43.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.146+0000 7fd1377fe640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd12006e5f0 0x7fd120070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.146+0000 7fd1377fe640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd12006e5f0 0x7fd120070ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd128009230 tx=0x7fd1280058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:43.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.150+0000 7fd134ff9640 1 -- 172.21.15.89:0/2404385652 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd12c057580 con 0x7fd138101620 2024-09-13T22:16:43.187 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:42 smithi159 ceph-mon[82000]: osdmap e88: 6 total, 5 up, 6 in 2024-09-13T22:16:43.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.332+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1380ff710 con 0x7fd12006e5f0 2024-09-13T22:16:43.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.333+0000 7fd134ff9640 1 -- 172.21.15.89:0/2404385652 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd1380ff710 con 0x7fd12006e5f0 2024-09-13T22:16:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd12006e5f0 msgr2=0x7fd120070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd12006e5f0 0x7fd120070ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd128009230 tx=0x7fd1280058d0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138101620 msgr2=0x7fd1380feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138101620 0x7fd1380feea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c8c0 tx=0x7fd12c00cd80 comp rx=0 tx=0).stop 2024-09-13T22:16:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 shutdown_connections 2024-09-13T22:16:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd12006e5f0 0x7fd120070ab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd138101620 0x7fd1380feea0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 --2- 172.21.15.89:0/2404385652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd138100d00 0x7fd1380fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 >> 172.21.15.89:0/2404385652 conn(0x7fd1380fa700 msgr2=0x7fd138101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:43.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 shutdown_connections 2024-09-13T22:16:43.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.335+0000 7fd13dc61640 1 -- 172.21.15.89:0/2404385652 wait complete. 2024-09-13T22:16:43.345 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:16:43.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.416+0000 7fa7591e8640 1 -- 172.21.15.89:0/470338152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 msgr2=0x7fa754105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.416+0000 7fa7591e8640 1 --2- 172.21.15.89:0/470338152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 0x7fa754105fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa744009c20 tx=0x7fa74402a970 comp rx=0 tx=0).stop 2024-09-13T22:16:43.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.416+0000 7fa7591e8640 1 -- 172.21.15.89:0/470338152 shutdown_connections 2024-09-13T22:16:43.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.416+0000 7fa7591e8640 1 --2- 172.21.15.89:0/470338152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7540ffb50 0x7fa7540fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.416+0000 7fa7591e8640 1 --2- 172.21.15.89:0/470338152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 0x7fa754105fe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.416+0000 7fa7591e8640 1 -- 172.21.15.89:0/470338152 >> 172.21.15.89:0/470338152 conn(0x7fa7540fb830 msgr2=0x7fa7540fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:43.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.416+0000 7fa7591e8640 1 -- 172.21.15.89:0/470338152 shutdown_connections 2024-09-13T22:16:43.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.416+0000 7fa7591e8640 1 -- 172.21.15.89:0/470338152 wait complete. 2024-09-13T22:16:43.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.417+0000 7fa7591e8640 1 Processor -- start 2024-09-13T22:16:43.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa7591e8640 1 -- start start 2024-09-13T22:16:43.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa7591e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7540ffb50 0x7fa75419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa7591e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 0x7fa75419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa7591e8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75419c360 con 0x7fa754105c00 2024-09-13T22:16:43.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa7591e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754195940 con 0x7fa7540ffb50 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa75259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 0x7fa75419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa75259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 0x7fa75419bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58796/0 (socket says 172.21.15.89:58796) 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa75259c640 1 -- 172.21.15.89:0/653054080 learned_addr learned my addr 172.21.15.89:0/653054080 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa752d9d640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7540ffb50 0x7fa75419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa75259c640 1 -- 172.21.15.89:0/653054080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7540ffb50 msgr2=0x7fa75419b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa75259c640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7540ffb50 0x7fa75419b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa75259c640 1 -- 172.21.15.89:0/653054080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009900 con 0x7fa754105c00 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.418+0000 7fa75259c640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 0x7fa75419bd40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00d6f0 tx=0x7fa73c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.419+0000 7fa74bfff640 1 -- 172.21.15.89:0/653054080 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa73c009a30 con 0x7fa754105c00 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.419+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa754195c20 con 0x7fa754105c00 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.419+0000 7fa74bfff640 1 -- 172.21.15.89:0/653054080 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa73c0054e0 con 0x7fa754105c00 2024-09-13T22:16:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.419+0000 7fa74bfff640 1 -- 172.21.15.89:0/653054080 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa73c010460 con 0x7fa754105c00 2024-09-13T22:16:43.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.419+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7541961f0 con 0x7fa754105c00 2024-09-13T22:16:43.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.420+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa754101200 con 0x7fa754105c00 2024-09-13T22:16:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.420+0000 7fa74bfff640 1 -- 172.21.15.89:0/653054080 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa73c009b90 con 0x7fa754105c00 2024-09-13T22:16:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.421+0000 7fa74bfff640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa74006e5f0 0x7fa740070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.421+0000 7fa74bfff640 1 -- 172.21.15.89:0/653054080 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fa73c08e1a0 con 0x7fa754105c00 2024-09-13T22:16:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.421+0000 7fa752d9d640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa74006e5f0 0x7fa740070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.421+0000 7fa752d9d640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa74006e5f0 0x7fa740070ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa744000f80 tx=0x7fa74403d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:43.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.425+0000 7fa74bfff640 1 -- 172.21.15.89:0/653054080 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa73c057350 con 0x7fa754105c00 2024-09-13T22:16:43.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 podman[101643]: 2024-09-13 22:16:43.186946841 +0000 UTC m=+0.609147641 container remove bd3a60b705cd97a9dab38b0d8d40ba67f97e2fc521a1a4123c7128b2b3e5f9c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T22:16:43.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T22:16:43.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 systemd[1]: Stopped Ceph osd.5 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:16:43.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 systemd[1]: ceph-39489060-721b-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 1.043s CPU time. 2024-09-13T22:16:43.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 systemd[1]: Starting Ceph osd.5 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:16:43.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.624+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa754108090 con 0x7fa74006e5f0 2024-09-13T22:16:43.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.625+0000 7fa74bfff640 1 -- 172.21.15.89:0/653054080 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa754108090 con 0x7fa74006e5f0 2024-09-13T22:16:43.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa74006e5f0 msgr2=0x7fa740070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa74006e5f0 0x7fa740070ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa744000f80 tx=0x7fa74403d040 comp rx=0 tx=0).stop 2024-09-13T22:16:43.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 msgr2=0x7fa75419bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 0x7fa75419bd40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00d6f0 tx=0x7fa73c00dbb0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 shutdown_connections 2024-09-13T22:16:43.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa74006e5f0 0x7fa740070ab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa754105c00 0x7fa75419bd40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 --2- 172.21.15.89:0/653054080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7540ffb50 0x7fa75419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 >> 172.21.15.89:0/653054080 conn(0x7fa7540fb830 msgr2=0x7fa7540fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:43.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 shutdown_connections 2024-09-13T22:16:43.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.627+0000 7fa7591e8640 1 -- 172.21.15.89:0/653054080 wait complete. 2024-09-13T22:16:43.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 -- 172.21.15.89:0/1446323924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c41049f0 msgr2=0x7fe5c4104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 --2- 172.21.15.89:0/1446323924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c41049f0 0x7fe5c4104dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009880 tx=0x7fe5b802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 -- 172.21.15.89:0/1446323924 shutdown_connections 2024-09-13T22:16:43.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 --2- 172.21.15.89:0/1446323924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c40fe9f0 0x7fe5c40fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 --2- 172.21.15.89:0/1446323924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c41049f0 0x7fe5c4104dd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 -- 172.21.15.89:0/1446323924 >> 172.21.15.89:0/1446323924 conn(0x7fe5c40758a0 msgr2=0x7fe5c40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:43.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 -- 172.21.15.89:0/1446323924 shutdown_connections 2024-09-13T22:16:43.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 -- 172.21.15.89:0/1446323924 wait complete. 2024-09-13T22:16:43.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 Processor -- start 2024-09-13T22:16:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.710+0000 7fe5cc473640 1 -- start start 2024-09-13T22:16:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5cc473640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c40fe9f0 0x7fe5c4197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5cc473640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c41049f0 0x7fe5c4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5cc473640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4198ab0 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5cc473640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c419c820 con 0x7fe5c41049f0 2024-09-13T22:16:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5ca20f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c40fe9f0 0x7fe5c4197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5ca20f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c40fe9f0 0x7fe5c4197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58816/0 (socket says 172.21.15.89:58816) 2024-09-13T22:16:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5ca20f640 1 -- 172.21.15.89:0/2273697318 learned_addr learned my addr 172.21.15.89:0/2273697318 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:43.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5c9a0e640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c41049f0 0x7fe5c4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5ca20f640 1 -- 172.21.15.89:0/2273697318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c41049f0 msgr2=0x7fe5c4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5ca20f640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c41049f0 0x7fe5c4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5ca20f640 1 -- 172.21.15.89:0/2273697318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b8009560 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5c9a0e640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c41049f0 0x7fe5c4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:16:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5ca20f640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c40fe9f0 0x7fe5c4197ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5b802a9c0 tx=0x7fe5b80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5b77fe640 1 -- 172.21.15.89:0/2273697318 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5b8004aa0 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5b77fe640 1 -- 172.21.15.89:0/2273697318 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5b8004c00 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c419caa0 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.711+0000 7fe5b77fe640 1 -- 172.21.15.89:0/2273697318 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5b8003ab0 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.712+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c419cf90 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.713+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c4100130 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.713+0000 7fe5b77fe640 1 -- 172.21.15.89:0/2273697318 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe5b8003c10 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.714+0000 7fe5b77fe640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fe5b006e5f0 0x7fe5b0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.714+0000 7fe5b77fe640 1 -- 172.21.15.89:0/2273697318 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fe5b80af7b0 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.714+0000 7fe5c9a0e640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fe5b006e5f0 0x7fe5b0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.714+0000 7fe5c9a0e640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fe5b006e5f0 0x7fe5b0070ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4199490 tx=0x7fe5c0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:43.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.718+0000 7fe5b77fe640 1 -- 172.21.15.89:0/2273697318 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe5b80788b0 con 0x7fe5c40fe9f0 2024-09-13T22:16:43.875 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:43 smithi159 ceph-mon[82000]: pgmap v165: 65 pgs: 7 peering, 9 stale+active+clean, 49 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:43.875 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:43 smithi159 ceph-mon[82000]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-13T22:16:43.875 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 podman[101741]: 2024-09-13 22:16:43.518920143 +0000 UTC m=+0.016323189 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:16:43.876 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 podman[101741]: 2024-09-13 22:16:43.629685318 +0000 UTC m=+0.127088393 container create 67c473d62c7e04928f09e494c5b19d5c68c7a8e564e94116a65c823120151c5d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T22:16:43.876 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 podman[101741]: 2024-09-13 22:16:43.874853897 +0000 UTC m=+0.372256933 container init 67c473d62c7e04928f09e494c5b19d5c68c7a8e564e94116a65c823120151c5d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=) 2024-09-13T22:16:43.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.892+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5c41992b0 con 0x7fe5b006e5f0 2024-09-13T22:16:43.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.901+0000 7fe5b77fe640 1 -- 172.21.15.89:0/2273697318 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fe5c41992b0 con 0x7fe5b006e5f0 2024-09-13T22:16:43.902 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:16:43.902 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (5m) 93s ago 15m 25.8M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (16m) 93s ago 16m 8572k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (15m) 27s ago 15m 8698k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (3m) 93s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (3m) 27s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (5m) 93s ago 15m 80.6M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (10m) 93s ago 10m 18.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (10m) 93s ago 10m 16.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f 4cda63d70cfd 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (10m) 27s ago 10m 160M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (10m) 27s ago 10m 19.0M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:16:43.903 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (7m) 93s ago 17m 500M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (6m) 27s ago 14m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (4m) 93s ago 17m 47.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (3m) 27s ago 14m 38.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (6m) 93s ago 15m 15.4M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (6m) 27s ago 15m 15.7M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (2m) 93s ago 14m 93.5M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (2m) 93s ago 13m 105M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 3d2a1d778a36 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (98s) 93s ago 13m 12.1M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 ffb294d5c14f 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (63s) 27s ago 12m 145M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 6724e7895aeb 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (31s) 27s ago 12m 11.8M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 18175379d0ae 2024-09-13T22:16:43.904 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (11m) 27s ago 11m 253M 2240M 18.2.4-845-ge4e227b3 67ddd33fa72f d5a41b08cb91 2024-09-13T22:16:43.905 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (5m) 93s ago 15m 63.9M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:16:43.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fe5b006e5f0 msgr2=0x7fe5b0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fe5b006e5f0 0x7fe5b0070ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4199490 tx=0x7fe5c0008040 comp rx=0 tx=0).stop 2024-09-13T22:16:43.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c40fe9f0 msgr2=0x7fe5c4197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c40fe9f0 0x7fe5c4197ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5b802a9c0 tx=0x7fe5b80055a0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 shutdown_connections 2024-09-13T22:16:43.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fe5b006e5f0 0x7fe5b0070ab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c41049f0 0x7fe5c4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 --2- 172.21.15.89:0/2273697318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5c40fe9f0 0x7fe5c4197ee0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 >> 172.21.15.89:0/2273697318 conn(0x7fe5c40758a0 msgr2=0x7fe5c4102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:43.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 shutdown_connections 2024-09-13T22:16:43.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.903+0000 7fe5cc473640 1 -- 172.21.15.89:0/2273697318 wait complete. 2024-09-13T22:16:43.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.982+0000 7f4c87bee640 1 -- 172.21.15.89:0/4245787360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 msgr2=0x7f4c800fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.982+0000 7f4c87bee640 1 --2- 172.21.15.89:0/4245787360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 0x7f4c800fee30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009880 tx=0x7f4c7c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:43 smithi089 ceph-mon[109939]: pgmap v165: 65 pgs: 7 peering, 9 stale+active+clean, 49 active+clean; 201 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:16:43.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:43 smithi089 ceph-mon[109939]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.982+0000 7f4c87bee640 1 -- 172.21.15.89:0/4245787360 shutdown_connections 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.982+0000 7f4c87bee640 1 --2- 172.21.15.89:0/4245787360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c800ff400 0x7f4c801038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.982+0000 7f4c87bee640 1 --2- 172.21.15.89:0/4245787360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 0x7f4c800fee30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.982+0000 7f4c87bee640 1 -- 172.21.15.89:0/4245787360 >> 172.21.15.89:0/4245787360 conn(0x7f4c800fa730 msgr2=0x7f4c800fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.982+0000 7f4c87bee640 1 -- 172.21.15.89:0/4245787360 shutdown_connections 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.982+0000 7f4c87bee640 1 -- 172.21.15.89:0/4245787360 wait complete. 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c87bee640 1 Processor -- start 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c87bee640 1 -- start start 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c87bee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 0x7f4c8019c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c87bee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c800ff400 0x7f4c8019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c87bee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8019cc70 con 0x7f4c800fea50 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c87bee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c801a09e0 con 0x7f4c800ff400 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c8598a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 0x7f4c8019c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c8598a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 0x7f4c8019c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58826/0 (socket says 172.21.15.89:58826) 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c8598a640 1 -- 172.21.15.89:0/1745347991 learned_addr learned my addr 172.21.15.89:0/1745347991 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.983+0000 7f4c85189640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c800ff400 0x7f4c8019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.984+0000 7f4c8598a640 1 -- 172.21.15.89:0/1745347991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c800ff400 msgr2=0x7f4c8019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.984+0000 7f4c8598a640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c800ff400 0x7f4c8019c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.984+0000 7f4c8598a640 1 -- 172.21.15.89:0/1745347991 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c009560 con 0x7f4c800fea50 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.984+0000 7f4c8598a640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 0x7f4c8019c0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c006010 tx=0x7f4c7c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:43.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.984+0000 7f4c76ffd640 1 -- 172.21.15.89:0/1745347991 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7c004aa0 con 0x7f4c800fea50 2024-09-13T22:16:43.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.984+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c801a0c60 con 0x7f4c800fea50 2024-09-13T22:16:43.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.984+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c801a1150 con 0x7f4c800fea50 2024-09-13T22:16:43.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.984+0000 7f4c76ffd640 1 -- 172.21.15.89:0/1745347991 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c7c031470 con 0x7f4c800fea50 2024-09-13T22:16:43.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.984+0000 7f4c76ffd640 1 -- 172.21.15.89:0/1745347991 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7c003940 con 0x7f4c800fea50 2024-09-13T22:16:43.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.985+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c80068d30 con 0x7f4c800fea50 2024-09-13T22:16:43.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.986+0000 7f4c76ffd640 1 -- 172.21.15.89:0/1745347991 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4c7c031b90 con 0x7f4c800fea50 2024-09-13T22:16:43.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.986+0000 7f4c76ffd640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4c6c06e600 0x7f4c6c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:43.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.986+0000 7f4c76ffd640 1 -- 172.21.15.89:0/1745347991 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f4c7c0af780 con 0x7f4c800fea50 2024-09-13T22:16:43.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.986+0000 7f4c85189640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4c6c06e600 0x7f4c6c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:43.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.987+0000 7f4c85189640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4c6c06e600 0x7f4c6c070ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c8019d650 tx=0x7f4c7000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:43.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:43.990+0000 7f4c76ffd640 1 -- 172.21.15.89:0/1745347991 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4c7c078930 con 0x7f4c800fea50 2024-09-13T22:16:44.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.222+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c800fee30 con 0x7f4c800fea50 2024-09-13T22:16:44.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.223+0000 7f4c76ffd640 1 -- 172.21.15.89:0/1745347991 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f4c7c004c00 con 0x7f4c800fea50 2024-09-13T22:16:44.224 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:16:44.224 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:16:44.224 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:16:44.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:16:44.224 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:16:44.224 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:16:44.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4, 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 9 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:16:44.225 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:16:44.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4c6c06e600 msgr2=0x7f4c6c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4c6c06e600 0x7f4c6c070ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c8019d650 tx=0x7f4c7000b390 comp rx=0 tx=0).stop 2024-09-13T22:16:44.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 msgr2=0x7f4c8019c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 0x7f4c8019c0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c006010 tx=0x7f4c7c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 shutdown_connections 2024-09-13T22:16:44.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f4c6c06e600 0x7f4c6c070ac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c800ff400 0x7f4c8019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 --2- 172.21.15.89:0/1745347991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c800fea50 0x7f4c8019c0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 >> 172.21.15.89:0/1745347991 conn(0x7f4c800fa730 msgr2=0x7f4c80111040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:44.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 shutdown_connections 2024-09-13T22:16:44.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.225+0000 7f4c87bee640 1 -- 172.21.15.89:0/1745347991 wait complete. 2024-09-13T22:16:44.259 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 podman[101741]: 2024-09-13 22:16:43.878597793 +0000 UTC m=+0.376000835 container start 67c473d62c7e04928f09e494c5b19d5c68c7a8e564e94116a65c823120151c5d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T22:16:44.259 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:43 smithi159 podman[101741]: 2024-09-13 22:16:43.965995127 +0000 UTC m=+0.463398177 container attach 67c473d62c7e04928f09e494c5b19d5c68c7a8e564e94116a65c823120151c5d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be) 2024-09-13T22:16:44.259 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:44 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate[101756]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:16:44.259 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:44 smithi159 bash[101741]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:16:44.259 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:44 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate[101756]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:16:44.259 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:44 smithi159 bash[101741]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T22:16:44.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.306+0000 7fdbb19a9640 1 -- 172.21.15.89:0/786215356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 msgr2=0x7fdbac104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.306+0000 7fdbb19a9640 1 --2- 172.21.15.89:0/786215356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 0x7fdbac104e20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009c20 tx=0x7fdba402a970 comp rx=0 tx=0).stop 2024-09-13T22:16:44.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.306+0000 7fdbb19a9640 1 -- 172.21.15.89:0/786215356 shutdown_connections 2024-09-13T22:16:44.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.306+0000 7fdbb19a9640 1 --2- 172.21.15.89:0/786215356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0fea40 0x7fdbac0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.306+0000 7fdbb19a9640 1 --2- 172.21.15.89:0/786215356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 0x7fdbac104e20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.306+0000 7fdbb19a9640 1 -- 172.21.15.89:0/786215356 >> 172.21.15.89:0/786215356 conn(0x7fdbac0fa700 msgr2=0x7fdbac0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:44.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.306+0000 7fdbb19a9640 1 -- 172.21.15.89:0/786215356 shutdown_connections 2024-09-13T22:16:44.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.306+0000 7fdbb19a9640 1 -- 172.21.15.89:0/786215356 wait complete. 2024-09-13T22:16:44.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.306+0000 7fdbb19a9640 1 Processor -- start 2024-09-13T22:16:44.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbb19a9640 1 -- start start 2024-09-13T22:16:44.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbb19a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0fea40 0x7fdbac197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:44.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbb19a9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 0x7fdbac198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:44.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbb19a9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac1989f0 con 0x7fdbac104a40 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbb19a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac19c760 con 0x7fdbac0fea40 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbaa7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 0x7fdbac198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbaa7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 0x7fdbac198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58836/0 (socket says 172.21.15.89:58836) 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbaa7fc640 1 -- 172.21.15.89:0/3357180428 learned_addr learned my addr 172.21.15.89:0/3357180428 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbaaffd640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0fea40 0x7fdbac197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbaa7fc640 1 -- 172.21.15.89:0/3357180428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0fea40 msgr2=0x7fdbac197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbaa7fc640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0fea40 0x7fdbac197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbaa7fc640 1 -- 172.21.15.89:0/3357180428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4009900 con 0x7fdbac104a40 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbaa7fc640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 0x7fdbac198360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400b420 tx=0x7fdb9400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.307+0000 7fdbb09a7640 1 -- 172.21.15.89:0/3357180428 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb94011800 con 0x7fdbac104a40 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.308+0000 7fdbb09a7640 1 -- 172.21.15.89:0/3357180428 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb94011e20 con 0x7fdbac104a40 2024-09-13T22:16:44.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.308+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac19ca40 con 0x7fdbac104a40 2024-09-13T22:16:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.308+0000 7fdbb09a7640 1 -- 172.21.15.89:0/3357180428 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb9400f2e0 con 0x7fdbac104a40 2024-09-13T22:16:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.308+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac19cf90 con 0x7fdbac104a40 2024-09-13T22:16:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.309+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac100180 con 0x7fdbac104a40 2024-09-13T22:16:44.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.309+0000 7fdbb09a7640 1 -- 172.21.15.89:0/3357180428 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdb94010380 con 0x7fdbac104a40 2024-09-13T22:16:44.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.310+0000 7fdbb09a7640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdb9806e600 0x7fdb98070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:44.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.310+0000 7fdbb09a7640 1 -- 172.21.15.89:0/3357180428 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fdb9408e060 con 0x7fdbac104a40 2024-09-13T22:16:44.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.310+0000 7fdbaaffd640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdb9806e600 0x7fdb98070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:44.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.310+0000 7fdbaaffd640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdb9806e600 0x7fdb98070ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdba4000f80 tx=0x7fdba4009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:44.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.314+0000 7fdbb09a7640 1 -- 172.21.15.89:0/3357180428 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdb94057160 con 0x7fdbac104a40 2024-09-13T22:16:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.517+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdbac0fef20 con 0x7fdbac104a40 2024-09-13T22:16:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.517+0000 7fdbb09a7640 1 -- 172.21.15.89:0/3357180428 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fdb9405a820 con 0x7fdbac104a40 2024-09-13T22:16:44.520 INFO:teuthology.orchestra.run.smithi089.stdout:e15 2024-09-13T22:16:44.520 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:16:44.520 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:16:44.520 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:16:44.520 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:16:44.520 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:16:44.521 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:16:44.521 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:16:44.521 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:16:44.521 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:16:44.521 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:16:44.521 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:16:44.522 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:16:44.522 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:16:44.522 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:16:44.522 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:16:44.522 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:16:44.523 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:16:44.523 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:16:44.523 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:16:44.523 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:16:44.523 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:16:44.523 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:16:44.524 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:16:44.524 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:16:44.524 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:16:44.524 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:16:44.524 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:16:44.524 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:16:44.525 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:16:44.525 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:16:44.525 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:16:44.525 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:16:44.525 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:16:44.526 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T22:16:44.526 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:16:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:16:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:16:44.526 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:16:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:16:44.526 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.89:6828/4253852693,v1:172.21.15.89:6829/4253852693] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:16:44.527 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:14512} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/684466941,v1:172.21.15.89:6827/684466941] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:16:44.527 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:16:44.528 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 15 2024-09-13T22:16:44.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.519+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdb9806e600 msgr2=0x7fdb98070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.519+0000 7fdbb19a9640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdb9806e600 0x7fdb98070ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdba4000f80 tx=0x7fdba4009360 comp rx=0 tx=0).stop 2024-09-13T22:16:44.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.519+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 msgr2=0x7fdbac198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.519+0000 7fdbb19a9640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 0x7fdbac198360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400b420 tx=0x7fdb9400b8e0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.520+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 shutdown_connections 2024-09-13T22:16:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.520+0000 7fdbb19a9640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fdb9806e600 0x7fdb98070ac0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.520+0000 7fdbb19a9640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbac104a40 0x7fdbac198360 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.520+0000 7fdbb19a9640 1 --2- 172.21.15.89:0/3357180428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbac0fea40 0x7fdbac197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.520+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 >> 172.21.15.89:0/3357180428 conn(0x7fdbac0fa700 msgr2=0x7fdbac0fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.520+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 shutdown_connections 2024-09-13T22:16:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.520+0000 7fdbb19a9640 1 -- 172.21.15.89:0/3357180428 wait complete. 2024-09-13T22:16:44.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.600+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/2959949089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d440fe9f0 msgr2=0x7f8d440fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.600+0000 7f8d4c6c1640 1 --2- 172.21.15.89:0/2959949089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d440fe9f0 0x7f8d440fee50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009880 tx=0x7f8d3402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.601+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/2959949089 shutdown_connections 2024-09-13T22:16:44.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.601+0000 7f8d4c6c1640 1 --2- 172.21.15.89:0/2959949089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d440fe9f0 0x7f8d440fee50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.601+0000 7f8d4c6c1640 1 --2- 172.21.15.89:0/2959949089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d441049f0 0x7f8d44104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.601+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/2959949089 >> 172.21.15.89:0/2959949089 conn(0x7f8d440758a0 msgr2=0x7f8d440fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:44.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.601+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/2959949089 shutdown_connections 2024-09-13T22:16:44.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.601+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/2959949089 wait complete. 2024-09-13T22:16:44.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.601+0000 7f8d4c6c1640 1 Processor -- start 2024-09-13T22:16:44.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.601+0000 7f8d4c6c1640 1 -- start start 2024-09-13T22:16:44.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d4c6c1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d440fe9f0 0x7f8d4419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:44.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d4c6c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d441049f0 0x7f8d4419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:44.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d4c6c1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44197b40 con 0x7f8d441049f0 2024-09-13T22:16:44.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d4c6c1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44197cb0 con 0x7f8d440fe9f0 2024-09-13T22:16:44.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d49c5c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d441049f0 0x7f8d4419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:44.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d49c5c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d441049f0 0x7f8d4419df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58858/0 (socket says 172.21.15.89:58858) 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d49c5c640 1 -- 172.21.15.89:0/1744473135 learned_addr learned my addr 172.21.15.89:0/1744473135 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d4a45d640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d440fe9f0 0x7f8d4419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d49c5c640 1 -- 172.21.15.89:0/1744473135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d440fe9f0 msgr2=0x7f8d4419da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d49c5c640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d440fe9f0 0x7f8d4419da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d49c5c640 1 -- 172.21.15.89:0/1744473135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34009560 con 0x7f8d441049f0 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d49c5c640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d441049f0 0x7f8d4419df90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d3402a9c0 tx=0x7f8d340055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.602+0000 7f8d3b7fe640 1 -- 172.21.15.89:0/1744473135 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d34004aa0 con 0x7f8d441049f0 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.603+0000 7f8d3b7fe640 1 -- 172.21.15.89:0/1744473135 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d34004c00 con 0x7f8d441049f0 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.603+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d44197f30 con 0x7f8d441049f0 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.603+0000 7f8d3b7fe640 1 -- 172.21.15.89:0/1744473135 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d34003980 con 0x7f8d441049f0 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.603+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d44198420 con 0x7f8d441049f0 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.604+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d44100130 con 0x7f8d441049f0 2024-09-13T22:16:44.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.604+0000 7f8d3b7fe640 1 -- 172.21.15.89:0/1744473135 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8d34003b20 con 0x7f8d441049f0 2024-09-13T22:16:44.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.605+0000 7f8d3b7fe640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f8d3006e5f0 0x7f8d30070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:44.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.605+0000 7f8d3b7fe640 1 -- 172.21.15.89:0/1744473135 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f8d340af730 con 0x7f8d441049f0 2024-09-13T22:16:44.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.605+0000 7f8d4a45d640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f8d3006e5f0 0x7f8d30070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:44.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.605+0000 7f8d4a45d640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f8d3006e5f0 0x7f8d30070ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d40005fd0 tx=0x7f8d40005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:44.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.609+0000 7f8d3b7fe640 1 -- 172.21.15.89:0/1744473135 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8d34078830 con 0x7f8d441049f0 2024-09-13T22:16:44.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.792+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d44199080 con 0x7f8d3006e5f0 2024-09-13T22:16:44.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.794+0000 7f8d3b7fe640 1 -- 172.21.15.89:0/1744473135 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8d44199080 con 0x7f8d3006e5f0 2024-09-13T22:16:44.795 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:16:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:16:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:16:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:16:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:16:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:16:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T22:16:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "crash" 2024-09-13T22:16:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:16:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "11/23 daemons upgraded", 2024-09-13T22:16:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T22:16:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:16:44.796 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:16:44.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f8d3006e5f0 msgr2=0x7f8d30070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f8d3006e5f0 0x7f8d30070ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d40005fd0 tx=0x7f8d40005850 comp rx=0 tx=0).stop 2024-09-13T22:16:44.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d441049f0 msgr2=0x7f8d4419df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d441049f0 0x7f8d4419df90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d3402a9c0 tx=0x7f8d340055a0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 shutdown_connections 2024-09-13T22:16:44.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f8d3006e5f0 0x7f8d30070ab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d441049f0 0x7f8d4419df90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 --2- 172.21.15.89:0/1744473135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d440fe9f0 0x7f8d4419da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 >> 172.21.15.89:0/1744473135 conn(0x7f8d440758a0 msgr2=0x7f8d44102180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:44.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 shutdown_connections 2024-09-13T22:16:44.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.796+0000 7f8d4c6c1640 1 -- 172.21.15.89:0/1744473135 wait complete. 2024-09-13T22:16:44.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.876+0000 7f157bde6640 1 -- 172.21.15.89:0/1179275682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 msgr2=0x7f1574101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.876+0000 7f157bde6640 1 --2- 172.21.15.89:0/1179275682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 0x7f1574101040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15680098b0 tx=0x7f156802a4d0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.876+0000 7f157bde6640 1 -- 172.21.15.89:0/1179275682 shutdown_connections 2024-09-13T22:16:44.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.876+0000 7f157bde6640 1 --2- 172.21.15.89:0/1179275682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1574101610 0x7f1574109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.876+0000 7f157bde6640 1 --2- 172.21.15.89:0/1179275682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 0x7f1574101040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.876+0000 7f157bde6640 1 -- 172.21.15.89:0/1179275682 >> 172.21.15.89:0/1179275682 conn(0x7f15740fa730 msgr2=0x7f15740fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:44.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:44 smithi089 ceph-mon[109939]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:44.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:44 smithi089 ceph-mon[109939]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:44.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:44 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1745347991' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:44.880 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:44 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3357180428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.876+0000 7f157bde6640 1 -- 172.21.15.89:0/1179275682 shutdown_connections 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.877+0000 7f157bde6640 1 -- 172.21.15.89:0/1179275682 wait complete. 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.877+0000 7f157bde6640 1 Processor -- start 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.877+0000 7f157bde6640 1 -- start start 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.877+0000 7f157bde6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 0x7f157419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.877+0000 7f157bde6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1574101610 0x7f157419be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.877+0000 7f157bde6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157419c4a0 con 0x7f1574100c60 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.877+0000 7f157bde6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574195a30 con 0x7f1574101610 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1579b82640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 0x7f157419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1579b82640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 0x7f157419b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58876/0 (socket says 172.21.15.89:58876) 2024-09-13T22:16:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1579b82640 1 -- 172.21.15.89:0/2502027069 learned_addr learned my addr 172.21.15.89:0/2502027069 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1579381640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1574101610 0x7f157419be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1579b82640 1 -- 172.21.15.89:0/2502027069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1574101610 msgr2=0x7f157419be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1579b82640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1574101610 0x7f157419be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1579b82640 1 -- 172.21.15.89:0/2502027069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1568009560 con 0x7f1574100c60 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1579b82640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 0x7f157419b940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1568006010 tx=0x7f15680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1566ffd640 1 -- 172.21.15.89:0/2502027069 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1568004aa0 con 0x7f1574100c60 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1574195cb0 con 0x7f1574100c60 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1566ffd640 1 -- 172.21.15.89:0/2502027069 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1568004c00 con 0x7f1574100c60 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.878+0000 7f1566ffd640 1 -- 172.21.15.89:0/2502027069 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1568003940 con 0x7f1574100c60 2024-09-13T22:16:44.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.879+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15741961a0 con 0x7f1574100c60 2024-09-13T22:16:44.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.880+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1574068d30 con 0x7f1574100c60 2024-09-13T22:16:44.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.880+0000 7f1566ffd640 1 -- 172.21.15.89:0/2502027069 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1568031b90 con 0x7f1574100c60 2024-09-13T22:16:44.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.881+0000 7f1566ffd640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f156006e5f0 0x7f1560070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:16:44.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.881+0000 7f1566ffd640 1 -- 172.21.15.89:0/2502027069 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f15680af870 con 0x7f1574100c60 2024-09-13T22:16:44.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.881+0000 7f1579381640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f156006e5f0 0x7f1560070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:16:44.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.881+0000 7f1579381640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f156006e5f0 0x7f1560070ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1574196ea0 tx=0x7f1570009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:16:44.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:44.885+0000 7f1566ffd640 1 -- 172.21.15.89:0/2502027069 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f15680788f0 con 0x7f1574100c60 2024-09-13T22:16:45.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:44 smithi159 ceph-mon[82000]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:45.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:44 smithi159 ceph-mon[82000]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:45.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:44 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1745347991' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:45.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:44 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3357180428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:16:45.009 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:44 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate[101756]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T22:16:45.010 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:44 smithi159 bash[101741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T22:16:45.010 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:44 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate[101756]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T22:16:45.010 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:44 smithi159 bash[101741]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T22:16:45.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.115+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f15741043f0 con 0x7f1574100c60 2024-09-13T22:16:45.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.115+0000 7f1566ffd640 1 -- 172.21.15.89:0/2502027069 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1674 (secure 0 0 0) 0x7f156807bfb0 con 0x7f1574100c60 2024-09-13T22:16:45.117 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 4 pgs peering; Degraded data redundancy: 25/222 objects degraded (11.261%), 10 pgs degraded 2024-09-13T22:16:45.117 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:16:45.117 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:16:45.117 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T22:16:45.117 INFO:teuthology.orchestra.run.smithi089.stdout: osd.5 (root=default,host=smithi159) is down 2024-09-13T22:16:45.117 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T22:16:45.117 INFO:teuthology.orchestra.run.smithi089.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T22:16:45.117 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 4 pgs peering 2024-09-13T22:16:45.117 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.18 is stuck peering for 6m, current state peering, last acting [4,3] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 3.e is stuck peering for 6m, current state peering, last acting [4,1] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 3.1c is stuck peering for 6m, current state peering, last acting [4,1] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 3.1d is stuck peering for 6m, current state peering, last acting [4,1] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 25/222 objects degraded (11.261%), 10 pgs degraded 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-13T22:16:45.118 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-13T22:16:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f156006e5f0 msgr2=0x7f1560070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f156006e5f0 0x7f1560070ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1574196ea0 tx=0x7f1570009110 comp rx=0 tx=0).stop 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 msgr2=0x7f157419b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 0x7f157419b940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1568006010 tx=0x7f15680055a0 comp rx=0 tx=0).stop 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 shutdown_connections 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f156006e5f0 0x7f1560070ab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1574101610 0x7f157419be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 --2- 172.21.15.89:0/2502027069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574100c60 0x7f157419b940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 >> 172.21.15.89:0/2502027069 conn(0x7f15740fa730 msgr2=0x7f1574101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 shutdown_connections 2024-09-13T22:16:45.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:16:45.118+0000 7f157bde6640 1 -- 172.21.15.89:0/2502027069 wait complete. 2024-09-13T22:16:45.371 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate[101756]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T22:16:45.371 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 bash[101741]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T22:16:45.371 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate[101756]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T22:16:45.371 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 bash[101741]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T22:16:45.371 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate[101756]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T22:16:45.371 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 bash[101741]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T22:16:45.371 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate[101756]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T22:16:45.372 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 bash[101741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T22:16:45.372 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate[101756]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T22:16:45.372 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 bash[101741]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T22:16:45.372 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 podman[101741]: 2024-09-13 22:16:45.055269245 +0000 UTC m=+1.552672282 container died 67c473d62c7e04928f09e494c5b19d5c68c7a8e564e94116a65c823120151c5d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:16:46.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-mon[82000]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:46.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-mon[82000]: pgmap v166: 65 pgs: 12 active+undersized, 7 peering, 10 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 25/222 objects degraded (11.261%) 2024-09-13T22:16:46.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-mon[82000]: Health check failed: Degraded data redundancy: 25/222 objects degraded (11.261%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:46.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-mon[82000]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:46.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:45 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2502027069' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:16:46.010 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 podman[101902]: 2024-09-13 22:16:45.703207755 +0000 UTC m=+0.637465787 container remove 67c473d62c7e04928f09e494c5b19d5c68c7a8e564e94116a65c823120151c5d (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-activate, RELEASE=squid-ecab7be, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T22:16:46.010 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 podman[101962]: 2024-09-13 22:16:45.813884526 +0000 UTC m=+0.016075260 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:16:46.010 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:45 smithi159 podman[101962]: 2024-09-13 22:16:45.920693112 +0000 UTC m=+0.122883836 container create c11707471acc02dc3356b91bb7bc71845e8c5f9b0d88e5747e9f2513f3948873 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T22:16:46.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:45 smithi089 ceph-mon[109939]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:46.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:45 smithi089 ceph-mon[109939]: pgmap v166: 65 pgs: 12 active+undersized, 7 peering, 10 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 25/222 objects degraded (11.261%) 2024-09-13T22:16:46.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:45 smithi089 ceph-mon[109939]: Health check failed: Degraded data redundancy: 25/222 objects degraded (11.261%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:46.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:45 smithi089 ceph-mon[109939]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:46.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:45 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2502027069' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:16:46.511 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:46 smithi159 podman[101962]: 2024-09-13 22:16:46.198329973 +0000 UTC m=+0.400520706 container init c11707471acc02dc3356b91bb7bc71845e8c5f9b0d88e5747e9f2513f3948873 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-13T22:16:46.511 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:46 smithi159 podman[101962]: 2024-09-13 22:16:46.20161921 +0000 UTC m=+0.403809937 container start c11707471acc02dc3356b91bb7bc71845e8c5f9b0d88e5747e9f2513f3948873 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T22:16:46.511 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:46 smithi159 ceph-osd[101981]: -- 172.21.15.159:0/2575991751 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea2b4541e0 con 0x55ea2a669c00 2024-09-13T22:16:46.511 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:46 smithi159 bash[101962]: c11707471acc02dc3356b91bb7bc71845e8c5f9b0d88e5747e9f2513f3948873 2024-09-13T22:16:46.511 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:46 smithi159 systemd[1]: Started Ceph osd.5 for 39489060-721b-11ef-bceb-c7b262605968. 2024-09-13T22:16:47.604 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:47 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:47.604 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:47 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:47.605 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:47 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:47.605 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:47 smithi159 ceph-mon[82000]: pgmap v167: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:47.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:47 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:47.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:47 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:47.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:47 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:47.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:47 smithi089 ceph-mon[109939]: pgmap v167: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:48.342 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:48 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:16:48.081+0000 7f4f75ea3640 -1 Falling back to public interface 2024-09-13T22:16:48.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:48 smithi089 ceph-mon[109939]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-13T22:16:48.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:48 smithi159 ceph-mon[82000]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-13T22:16:49.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:49 smithi089 ceph-mon[109939]: pgmap v168: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:49 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:49.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:49 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:49 smithi159 ceph-mon[82000]: pgmap v168: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:49 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:49.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:49 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:50.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:50.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:50 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:51.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:51.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:51.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:50 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T22:16:51.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:51 smithi089 ceph-mon[109939]: pgmap v169: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:51.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:51.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:16:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:51 smithi159 ceph-mon[82000]: pgmap v169: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:16:53.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: pgmap v170: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:53.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T22:16:53.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:53 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T22:16:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: pgmap v170: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T22:16:54.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T22:16:54.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T22:16:54.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T22:16:54.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T22:16:54.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T22:16:54.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T22:16:54.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T22:16:54.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T22:16:54.011 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:53 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T22:16:54.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:54 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:16:54.181+0000 7f4f75ea3640 -1 osd.5 86 log_to_monitors true 2024-09-13T22:16:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:54 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all osd 2024-09-13T22:16:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:54 smithi089 ceph-mon[109939]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T22:16:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:54 smithi089 ceph-mon[109939]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T22:16:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:54 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T22:16:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:54 smithi089 ceph-mon[109939]: osdmap e89: 6 total, 5 up, 6 in 2024-09-13T22:16:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:54 smithi089 ceph-mon[109939]: from='osd.5 [v2:172.21.15.159:6816/3119157464,v1:172.21.15.159:6817/3119157464]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:16:54.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:54 smithi089 ceph-mon[109939]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:16:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:54 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all osd 2024-09-13T22:16:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:54 smithi159 ceph-mon[82000]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T22:16:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:54 smithi159 ceph-mon[82000]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T22:16:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:54 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T22:16:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:54 smithi159 ceph-mon[82000]: osdmap e89: 6 total, 5 up, 6 in 2024-09-13T22:16:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:54 smithi159 ceph-mon[82000]: from='osd.5 [v2:172.21.15.159:6816/3119157464,v1:172.21.15.159:6817/3119157464]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:16:55.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:54 smithi159 ceph-mon[82000]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:16:55.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:16:55 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:16:55.082+0000 7f4f69c35640 -1 osd.5 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:16:55.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:55 smithi089 ceph-mon[109939]: pgmap v172: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:55.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:55 smithi089 ceph-mon[109939]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T22:16:55.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:55 smithi089 ceph-mon[109939]: osdmap e90: 6 total, 5 up, 6 in 2024-09-13T22:16:55.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:55 smithi089 ceph-mon[109939]: from='osd.5 [v2:172.21.15.159:6816/3119157464,v1:172.21.15.159:6817/3119157464]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:16:55.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:55 smithi089 ceph-mon[109939]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:16:55.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:55 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:55.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:55 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.euhfjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:16:55.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:55 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:55 smithi159 ceph-mon[82000]: pgmap v172: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 906 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:55 smithi159 ceph-mon[82000]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T22:16:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:55 smithi159 ceph-mon[82000]: osdmap e90: 6 total, 5 up, 6 in 2024-09-13T22:16:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:55 smithi159 ceph-mon[82000]: from='osd.5 [v2:172.21.15.159:6816/3119157464,v1:172.21.15.159:6817/3119157464]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:16:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:55 smithi159 ceph-mon[82000]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-13T22:16:56.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:55 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:16:56.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:55 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.euhfjz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:16:56.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:55 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:56.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:56 smithi089 ceph-mon[109939]: Upgrade: Updating mds.cephfs.smithi089.euhfjz 2024-09-13T22:16:56.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:56 smithi089 ceph-mon[109939]: Deploying daemon mds.cephfs.smithi089.euhfjz on smithi089 2024-09-13T22:16:56.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:56 smithi089 ceph-mon[109939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:16:56.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:56 smithi089 ceph-mon[109939]: osd.5 [v2:172.21.15.159:6816/3119157464,v1:172.21.15.159:6817/3119157464] boot 2024-09-13T22:16:56.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:56 smithi089 ceph-mon[109939]: osdmap e91: 6 total, 6 up, 6 in 2024-09-13T22:16:56.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:56 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:16:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:56 smithi159 ceph-mon[82000]: Upgrade: Updating mds.cephfs.smithi089.euhfjz 2024-09-13T22:16:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:56 smithi159 ceph-mon[82000]: Deploying daemon mds.cephfs.smithi089.euhfjz on smithi089 2024-09-13T22:16:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:56 smithi159 ceph-mon[82000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T22:16:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:56 smithi159 ceph-mon[82000]: osd.5 [v2:172.21.15.159:6816/3119157464,v1:172.21.15.159:6817/3119157464] boot 2024-09-13T22:16:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:56 smithi159 ceph-mon[82000]: osdmap e91: 6 total, 6 up, 6 in 2024-09-13T22:16:57.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:56 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:16:57.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:57 smithi089 ceph-mon[109939]: pgmap v175: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:57.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:57 smithi089 ceph-mon[109939]: osdmap e92: 6 total, 6 up, 6 in 2024-09-13T22:16:58.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:57 smithi159 ceph-mon[82000]: pgmap v175: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:16:58.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:57 smithi159 ceph-mon[82000]: osdmap e92: 6 total, 6 up, 6 in 2024-09-13T22:16:58.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:58 smithi089 ceph-mon[109939]: osdmap e93: 6 total, 6 up, 6 in 2024-09-13T22:16:58.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:58 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 2 up:standby 2024-09-13T22:16:59.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:58 smithi159 ceph-mon[82000]: osdmap e93: 6 total, 6 up, 6 in 2024-09-13T22:16:59.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:58 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 2 up:standby 2024-09-13T22:16:59.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:16:59 smithi089 ceph-mon[109939]: pgmap v178: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:17:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:16:59 smithi159 ceph-mon[82000]: pgmap v178: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T22:17:00.930 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:00 smithi089 ceph-mon[109939]: Health check update: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T22:17:01.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:00 smithi159 ceph-mon[82000]: Health check update: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T22:17:02.060 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:01 smithi089 ceph-mon[109939]: pgmap v179: 65 pgs: 1 active+undersized, 2 active+undersized+degraded, 62 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3/222 objects degraded (1.351%) 2024-09-13T22:17:02.060 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:01 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:02.060 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:01 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:02.060 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:01 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:02.160 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:01 smithi159 ceph-mon[82000]: pgmap v179: 65 pgs: 1 active+undersized, 2 active+undersized+degraded, 62 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3/222 objects degraded (1.351%) 2024-09-13T22:17:02.160 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:01 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:02.161 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:01 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:02.161 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:01 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:03.011 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:02 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] up:boot 2024-09-13T22:17:03.011 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:02 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:17:03.011 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:02 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:17:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:02 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] up:boot 2024-09-13T22:17:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:02 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:17:03.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:02 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:17:03.883 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:03 smithi089 ceph-mon[109939]: pgmap v180: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:03.883 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:03 smithi089 ceph-mon[109939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded) 2024-09-13T22:17:04.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:03 smithi159 ceph-mon[82000]: pgmap v180: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:04.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:03 smithi159 ceph-mon[82000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 2 pgs degraded) 2024-09-13T22:17:06.102 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:05 smithi089 ceph-mon[109939]: pgmap v181: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:06.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:05 smithi159 ceph-mon[82000]: pgmap v181: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:07.941 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:07.941 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:17:07.941 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:07.941 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:07.941 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:07 smithi089 ceph-mon[109939]: pgmap v182: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:07.941 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:07.941 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:17:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:07 smithi159 ceph-mon[82000]: pgmap v182: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:08.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:09.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:09 smithi089 ceph-mon[109939]: pgmap v183: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:10.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:09 smithi159 ceph-mon[82000]: pgmap v183: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:11.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: pgmap v184: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:11.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:11.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:11 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: pgmap v184: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:12.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:12.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:12.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:12.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:12.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:12.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:12.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:11 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:12.969 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:12.969 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:12.969 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.egpifu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:17:12.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.egpifu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:17:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:13.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:13 smithi159 ceph-mon[82000]: Upgrade: Updating mds.cephfs.smithi089.egpifu 2024-09-13T22:17:13.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:13 smithi159 ceph-mon[82000]: Deploying daemon mds.cephfs.smithi089.egpifu on smithi089 2024-09-13T22:17:13.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:13 smithi159 ceph-mon[82000]: pgmap v185: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:13.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:13 smithi089 ceph-mon[109939]: Upgrade: Updating mds.cephfs.smithi089.egpifu 2024-09-13T22:17:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:13 smithi089 ceph-mon[109939]: Deploying daemon mds.cephfs.smithi089.egpifu on smithi089 2024-09-13T22:17:13.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:13 smithi089 ceph-mon[109939]: pgmap v185: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:15.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.205+0000 7f986182d640 1 -- 172.21.15.89:0/4186980898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 msgr2=0x7f985c109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.205+0000 7f986182d640 1 --2- 172.21.15.89:0/4186980898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 0x7f985c109b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f984c009880 tx=0x7f984c02a530 comp rx=0 tx=0).stop 2024-09-13T22:17:15.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.205+0000 7f986182d640 1 -- 172.21.15.89:0/4186980898 shutdown_connections 2024-09-13T22:17:15.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.205+0000 7f986182d640 1 --2- 172.21.15.89:0/4186980898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 0x7f985c109b80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.205+0000 7f986182d640 1 --2- 172.21.15.89:0/4186980898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c100d70 0x7f985c101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.205+0000 7f986182d640 1 -- 172.21.15.89:0/4186980898 >> 172.21.15.89:0/4186980898 conn(0x7f985c0758a0 msgr2=0x7f985c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.205+0000 7f986182d640 1 -- 172.21.15.89:0/4186980898 shutdown_connections 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.205+0000 7f986182d640 1 -- 172.21.15.89:0/4186980898 wait complete. 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.205+0000 7f986182d640 1 Processor -- start 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f986182d640 1 -- start start 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f986182d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c100d70 0x7f985c19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f986182d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 0x7f985c19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f986182d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c19c490 con 0x7f985c101690 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f986182d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c195a20 con 0x7f985c100d70 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f985a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 0x7f985c19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f985a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 0x7f985c19be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46968/0 (socket says 172.21.15.89:46968) 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f985a7fc640 1 -- 172.21.15.89:0/2461190227 learned_addr learned my addr 172.21.15.89:0/2461190227 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:15.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f985affd640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c100d70 0x7f985c19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:15.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f985a7fc640 1 -- 172.21.15.89:0/2461190227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c100d70 msgr2=0x7f985c19b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f985a7fc640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c100d70 0x7f985c19b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.206+0000 7f985a7fc640 1 -- 172.21.15.89:0/2461190227 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c009560 con 0x7f985c101690 2024-09-13T22:17:15.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.207+0000 7f985a7fc640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 0x7f985c19be70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f984c005940 tx=0x7f984c032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:15.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.207+0000 7f986082b640 1 -- 172.21.15.89:0/2461190227 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984c005220 con 0x7f985c101690 2024-09-13T22:17:15.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.207+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c195ca0 con 0x7f985c101690 2024-09-13T22:17:15.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.207+0000 7f986082b640 1 -- 172.21.15.89:0/2461190227 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f984c005380 con 0x7f985c101690 2024-09-13T22:17:15.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.207+0000 7f986082b640 1 -- 172.21.15.89:0/2461190227 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984c003a50 con 0x7f985c101690 2024-09-13T22:17:15.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.207+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c196190 con 0x7f985c101690 2024-09-13T22:17:15.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.208+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c068450 con 0x7f985c101690 2024-09-13T22:17:15.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.208+0000 7f986082b640 1 -- 172.21.15.89:0/2461190227 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f984c02ad50 con 0x7f985c101690 2024-09-13T22:17:15.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.209+0000 7f986082b640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f984406e5f0 0x7f9844070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:15.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.209+0000 7f986082b640 1 -- 172.21.15.89:0/2461190227 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f984c0af1d0 con 0x7f985c101690 2024-09-13T22:17:15.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.209+0000 7f985affd640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f984406e5f0 0x7f9844070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:15.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.209+0000 7f985affd640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f984406e5f0 0x7f9844070ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f985000a400 tx=0x7f985000d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:15.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.213+0000 7f986082b640 1 -- 172.21.15.89:0/2461190227 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f984c078310 con 0x7f985c101690 2024-09-13T22:17:15.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.395+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f985c10ce00 con 0x7f984406e5f0 2024-09-13T22:17:15.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.396+0000 7f986082b640 1 -- 172.21.15.89:0/2461190227 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f985c10ce00 con 0x7f984406e5f0 2024-09-13T22:17:15.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.398+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f984406e5f0 msgr2=0x7f9844070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.398+0000 7f986182d640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f984406e5f0 0x7f9844070ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f985000a400 tx=0x7f985000d040 comp rx=0 tx=0).stop 2024-09-13T22:17:15.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.398+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 msgr2=0x7f985c19be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.398+0000 7f986182d640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 0x7f985c19be70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f984c005940 tx=0x7f984c032bd0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.398+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 shutdown_connections 2024-09-13T22:17:15.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.398+0000 7f986182d640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f984406e5f0 0x7f9844070ab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.398+0000 7f986182d640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c101690 0x7f985c19be70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.398+0000 7f986182d640 1 --2- 172.21.15.89:0/2461190227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f985c100d70 0x7f985c19b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.398+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 >> 172.21.15.89:0/2461190227 conn(0x7f985c0758a0 msgr2=0x7f985c101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:15.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.399+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 shutdown_connections 2024-09-13T22:17:15.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.399+0000 7f986182d640 1 -- 172.21.15.89:0/2461190227 wait complete. 2024-09-13T22:17:15.408 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:17:15.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.480+0000 7fd9669a1640 1 -- 172.21.15.89:0/3866941437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 msgr2=0x7fd9600fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.480+0000 7fd9669a1640 1 --2- 172.21.15.89:0/3866941437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 0x7fd9600fee50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd954009880 tx=0x7fd95402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.481+0000 7fd9669a1640 1 -- 172.21.15.89:0/3866941437 shutdown_connections 2024-09-13T22:17:15.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.481+0000 7fd9669a1640 1 --2- 172.21.15.89:0/3866941437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 0x7fd9600fee50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.481+0000 7fd9669a1640 1 --2- 172.21.15.89:0/3866941437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9601049f0 0x7fd960104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.481+0000 7fd9669a1640 1 -- 172.21.15.89:0/3866941437 >> 172.21.15.89:0/3866941437 conn(0x7fd9600758a0 msgr2=0x7fd9600fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:15.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.481+0000 7fd9669a1640 1 -- 172.21.15.89:0/3866941437 shutdown_connections 2024-09-13T22:17:15.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.481+0000 7fd9669a1640 1 -- 172.21.15.89:0/3866941437 wait complete. 2024-09-13T22:17:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.481+0000 7fd9669a1640 1 Processor -- start 2024-09-13T22:17:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.481+0000 7fd9669a1640 1 -- start start 2024-09-13T22:17:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd9669a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 0x7fd960196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd9669a1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9601049f0 0x7fd960196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd9669a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9601974e0 con 0x7fd9600fe9f0 2024-09-13T22:17:15.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd9669a1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960197650 con 0x7fd9601049f0 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd95ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 0x7fd960196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd95ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 0x7fd960196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47000/0 (socket says 172.21.15.89:47000) 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd95ffff640 1 -- 172.21.15.89:0/171004027 learned_addr learned my addr 172.21.15.89:0/171004027 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd95f7fe640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9601049f0 0x7fd960196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd95ffff640 1 -- 172.21.15.89:0/171004027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9601049f0 msgr2=0x7fd960196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd95ffff640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9601049f0 0x7fd960196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd95ffff640 1 -- 172.21.15.89:0/171004027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954009560 con 0x7fd9600fe9f0 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.482+0000 7fd95ffff640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 0x7fd960196a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd95000b420 tx=0x7fd95000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.483+0000 7fd95d7fa640 1 -- 172.21.15.89:0/171004027 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd950011800 con 0x7fd9600fe9f0 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.483+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96019fad0 con 0x7fd9600fe9f0 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.483+0000 7fd95d7fa640 1 -- 172.21.15.89:0/171004027 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd950011e20 con 0x7fd9600fe9f0 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.483+0000 7fd95d7fa640 1 -- 172.21.15.89:0/171004027 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd95000f2e0 con 0x7fd9600fe9f0 2024-09-13T22:17:15.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.483+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96019fee0 con 0x7fd9600fe9f0 2024-09-13T22:17:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.484+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd960100130 con 0x7fd9600fe9f0 2024-09-13T22:17:15.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.484+0000 7fd95d7fa640 1 -- 172.21.15.89:0/171004027 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd950010380 con 0x7fd9600fe9f0 2024-09-13T22:17:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.485+0000 7fd95d7fa640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd94806e5f0 0x7fd948070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.485+0000 7fd95d7fa640 1 -- 172.21.15.89:0/171004027 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fd95008e050 con 0x7fd9600fe9f0 2024-09-13T22:17:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.485+0000 7fd95f7fe640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd94806e5f0 0x7fd948070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:15.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.485+0000 7fd95f7fe640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd94806e5f0 0x7fd948070ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd954000c00 tx=0x7fd954005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:15.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.489+0000 7fd95d7fa640 1 -- 172.21.15.89:0/171004027 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd950057150 con 0x7fd9600fe9f0 2024-09-13T22:17:15.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.672+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd960068290 con 0x7fd94806e5f0 2024-09-13T22:17:15.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.673+0000 7fd95d7fa640 1 -- 172.21.15.89:0/171004027 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd960068290 con 0x7fd94806e5f0 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd94806e5f0 msgr2=0x7fd948070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd94806e5f0 0x7fd948070ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd954000c00 tx=0x7fd954005a20 comp rx=0 tx=0).stop 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 msgr2=0x7fd960196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 0x7fd960196a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd95000b420 tx=0x7fd95000b8e0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 shutdown_connections 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd94806e5f0 0x7fd948070ab0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9601049f0 0x7fd960196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 --2- 172.21.15.89:0/171004027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9600fe9f0 0x7fd960196a60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 >> 172.21.15.89:0/171004027 conn(0x7fd9600758a0 msgr2=0x7fd9600fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 shutdown_connections 2024-09-13T22:17:15.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.675+0000 7fd9669a1640 1 -- 172.21.15.89:0/171004027 wait complete. 2024-09-13T22:17:15.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:15 smithi089 ceph-mon[109939]: pgmap v186: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:15.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:15 smithi089 ceph-mon[109939]: osdmap e94: 6 total, 6 up, 6 in 2024-09-13T22:17:15.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:15 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 2 up:standby 2024-09-13T22:17:15.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.756+0000 7f2960910640 1 -- 172.21.15.89:0/2266769212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c1049f0 msgr2=0x7f295c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.756+0000 7f2960910640 1 --2- 172.21.15.89:0/2266769212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c1049f0 0x7f295c104dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2954009880 tx=0x7f295402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.757+0000 7f2960910640 1 -- 172.21.15.89:0/2266769212 shutdown_connections 2024-09-13T22:17:15.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.757+0000 7f2960910640 1 --2- 172.21.15.89:0/2266769212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f295c0fe9f0 0x7f295c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.757+0000 7f2960910640 1 --2- 172.21.15.89:0/2266769212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c1049f0 0x7f295c104dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.757+0000 7f2960910640 1 -- 172.21.15.89:0/2266769212 >> 172.21.15.89:0/2266769212 conn(0x7f295c0758a0 msgr2=0x7f295c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:15.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.757+0000 7f2960910640 1 -- 172.21.15.89:0/2266769212 shutdown_connections 2024-09-13T22:17:15.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.757+0000 7f2960910640 1 -- 172.21.15.89:0/2266769212 wait complete. 2024-09-13T22:17:15.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.757+0000 7f2960910640 1 Processor -- start 2024-09-13T22:17:15.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.757+0000 7f2960910640 1 -- start start 2024-09-13T22:17:15.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f2960910640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c0fe9f0 0x7f295c19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:15.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f2960910640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f295c1049f0 0x7f295c19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:15.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f2960910640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c19c490 con 0x7f295c0fe9f0 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f2960910640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c195a70 con 0x7f295c1049f0 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f295a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c0fe9f0 0x7f295c19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f295a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c0fe9f0 0x7f295c19b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47012/0 (socket says 172.21.15.89:47012) 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f295a59c640 1 -- 172.21.15.89:0/1043256842 learned_addr learned my addr 172.21.15.89:0/1043256842 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f2959d9b640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f295c1049f0 0x7f295c19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f295a59c640 1 -- 172.21.15.89:0/1043256842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f295c1049f0 msgr2=0x7f295c19be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f295a59c640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f295c1049f0 0x7f295c19be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f295a59c640 1 -- 172.21.15.89:0/1043256842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954009560 con 0x7f295c0fe9f0 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f295a59c640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c0fe9f0 0x7f295c19b930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f295402a9c0 tx=0x7f29540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.758+0000 7f294b7fe640 1 -- 172.21.15.89:0/1043256842 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2954004aa0 con 0x7f295c0fe9f0 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.759+0000 7f294b7fe640 1 -- 172.21.15.89:0/1043256842 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2954004c00 con 0x7f295c0fe9f0 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.759+0000 7f294b7fe640 1 -- 172.21.15.89:0/1043256842 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2954003ab0 con 0x7f295c0fe9f0 2024-09-13T22:17:15.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.759+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295c195cf0 con 0x7f295c0fe9f0 2024-09-13T22:17:15.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.759+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c1961e0 con 0x7f295c0fe9f0 2024-09-13T22:17:15.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.760+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295c100130 con 0x7f295c0fe9f0 2024-09-13T22:17:15.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.760+0000 7f294b7fe640 1 -- 172.21.15.89:0/1043256842 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2954003c10 con 0x7f295c0fe9f0 2024-09-13T22:17:15.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.760+0000 7f294b7fe640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f294406e5f0 0x7f2944070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:15.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.761+0000 7f294b7fe640 1 -- 172.21.15.89:0/1043256842 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f29540af7b0 con 0x7f295c0fe9f0 2024-09-13T22:17:15.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.761+0000 7f2959d9b640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f294406e5f0 0x7f2944070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:15.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.761+0000 7f2959d9b640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f294406e5f0 0x7f2944070ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f295c196e90 tx=0x7f29500094f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:15.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.765+0000 7f294b7fe640 1 -- 172.21.15.89:0/1043256842 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f29540788b0 con 0x7f295c0fe9f0 2024-09-13T22:17:15.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.942+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f295c10bd50 con 0x7f294406e5f0 2024-09-13T22:17:15.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.952+0000 7f294b7fe640 1 -- 172.21.15.89:0/1043256842 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f295c10bd50 con 0x7f294406e5f0 2024-09-13T22:17:15.953 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:17:15.953 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (6m) 9s ago 16m 25.3M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:17:15.953 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (16m) 9s ago 16m 9051k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:17:15.953 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (15m) 26s ago 15m 8908k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:17:15.953 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (3m) 9s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (3m) 26s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (5m) 9s ago 16m 80.0M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (10m) 9s ago 10m 19.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f ccc1fb112e4a 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (14s) 9s ago 10m 11.8M - 19.1.1-324-gecab7be5 0652ff2b5d78 007f4687420d 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (10m) 26s ago 10m 160M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6396fe00eb36 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (10m) 26s ago 10m 19.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (7m) 9s ago 17m 504M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (6m) 26s ago 15m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (4m) 9s ago 17m 52.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (4m) 26s ago 15m 40.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (6m) 9s ago 16m 15.2M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:17:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (6m) 26s ago 15m 15.5M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:17:15.955 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (3m) 9s ago 14m 163M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:17:15.955 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (2m) 9s ago 14m 138M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 3d2a1d778a36 2024-09-13T22:17:15.955 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (2m) 9s ago 13m 133M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 ffb294d5c14f 2024-09-13T22:17:15.955 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (95s) 26s ago 13m 146M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 6724e7895aeb 2024-09-13T22:17:15.955 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (63s) 26s ago 12m 94.2M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 18175379d0ae 2024-09-13T22:17:15.955 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (30s) 26s ago 12m 11.6M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 c11707471acc 2024-09-13T22:17:15.955 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (6m) 9s ago 15m 66.0M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:17:15.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f294406e5f0 msgr2=0x7f2944070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f294406e5f0 0x7f2944070ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f295c196e90 tx=0x7f29500094f0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c0fe9f0 msgr2=0x7f295c19b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:15.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c0fe9f0 0x7f295c19b930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f295402a9c0 tx=0x7f29540055a0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 shutdown_connections 2024-09-13T22:17:15.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f294406e5f0 0x7f2944070ab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f295c1049f0 0x7f295c19be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 --2- 172.21.15.89:0/1043256842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f295c0fe9f0 0x7f295c19b930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:15.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 >> 172.21.15.89:0/1043256842 conn(0x7f295c0758a0 msgr2=0x7f295c067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:15.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 shutdown_connections 2024-09-13T22:17:15.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:15.954+0000 7f2960910640 1 -- 172.21.15.89:0/1043256842 wait complete. 2024-09-13T22:17:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:15 smithi159 ceph-mon[82000]: pgmap v186: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:15 smithi159 ceph-mon[82000]: osdmap e94: 6 total, 6 up, 6 in 2024-09-13T22:17:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:15 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 2 up:standby 2024-09-13T22:17:16.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.035+0000 7f756499f640 1 -- 172.21.15.89:0/1900910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 msgr2=0x7f7560109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.035+0000 7f756499f640 1 --2- 172.21.15.89:0/1900910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 0x7f7560109ac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7554009880 tx=0x7f755402a530 comp rx=0 tx=0).stop 2024-09-13T22:17:16.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.036+0000 7f756499f640 1 -- 172.21.15.89:0/1900910 shutdown_connections 2024-09-13T22:17:16.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.036+0000 7f756499f640 1 --2- 172.21.15.89:0/1900910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 0x7f7560109ac0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.036+0000 7f756499f640 1 --2- 172.21.15.89:0/1900910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7560100cb0 0x7f7560101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.036+0000 7f756499f640 1 -- 172.21.15.89:0/1900910 >> 172.21.15.89:0/1900910 conn(0x7f75600fa730 msgr2=0x7f75600fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:16.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.036+0000 7f756499f640 1 -- 172.21.15.89:0/1900910 shutdown_connections 2024-09-13T22:17:16.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.036+0000 7f756499f640 1 -- 172.21.15.89:0/1900910 wait complete. 2024-09-13T22:17:16.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.036+0000 7f756499f640 1 Processor -- start 2024-09-13T22:17:16.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f756499f640 1 -- start start 2024-09-13T22:17:16.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f756499f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7560100cb0 0x7f7560197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f756499f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 0x7f75601983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f756499f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7560198a60 con 0x7f75601015d0 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f756499f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756019c7d0 con 0x7f7560100cb0 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f755dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 0x7f75601983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f755dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 0x7f75601983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47032/0 (socket says 172.21.15.89:47032) 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f755dd9b640 1 -- 172.21.15.89:0/4091886175 learned_addr learned my addr 172.21.15.89:0/4091886175 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f755e59c640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7560100cb0 0x7f7560197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f755dd9b640 1 -- 172.21.15.89:0/4091886175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7560100cb0 msgr2=0x7f7560197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f755dd9b640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7560100cb0 0x7f7560197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.037+0000 7f755dd9b640 1 -- 172.21.15.89:0/4091886175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7554009560 con 0x7f75601015d0 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.038+0000 7f755dd9b640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 0x7f75601983d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f755402aa50 tx=0x7f75540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:16.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.038+0000 7f754f7fe640 1 -- 172.21.15.89:0/4091886175 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75540048d0 con 0x7f75601015d0 2024-09-13T22:17:16.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.038+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756019ca50 con 0x7f75601015d0 2024-09-13T22:17:16.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.038+0000 7f754f7fe640 1 -- 172.21.15.89:0/4091886175 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7554031640 con 0x7f75601015d0 2024-09-13T22:17:16.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.038+0000 7f754f7fe640 1 -- 172.21.15.89:0/4091886175 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7554003890 con 0x7f75601015d0 2024-09-13T22:17:16.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.038+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756019cf40 con 0x7f75601015d0 2024-09-13T22:17:16.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.039+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7560068d30 con 0x7f75601015d0 2024-09-13T22:17:16.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.040+0000 7f754f7fe640 1 -- 172.21.15.89:0/4091886175 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f755402ad50 con 0x7f75601015d0 2024-09-13T22:17:16.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.040+0000 7f754f7fe640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f754806e5f0 0x7f7548070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.040+0000 7f754f7fe640 1 -- 172.21.15.89:0/4091886175 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f75540af540 con 0x7f75601015d0 2024-09-13T22:17:16.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.041+0000 7f755e59c640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f754806e5f0 0x7f7548070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.041+0000 7f755e59c640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f754806e5f0 0x7f7548070ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7550009990 tx=0x7f7550009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:16.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.045+0000 7f754f7fe640 1 -- 172.21.15.89:0/4091886175 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7554078520 con 0x7f75601015d0 2024-09-13T22:17:16.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.283+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7560109560 con 0x7f75601015d0 2024-09-13T22:17:16.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.284+0000 7f754f7fe640 1 -- 172.21.15.89:0/4091886175 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f755407bbe0 con 0x7f75601015d0 2024-09-13T22:17:16.285 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:17:16.285 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:17:16.285 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:17:16.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:17:16.285 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2, 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2, 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 11 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:17:16.286 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.286+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f754806e5f0 msgr2=0x7f7548070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.286+0000 7f756499f640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f754806e5f0 0x7f7548070ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7550009990 tx=0x7f7550009110 comp rx=0 tx=0).stop 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.286+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 msgr2=0x7f75601983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.286+0000 7f756499f640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 0x7f75601983d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f755402aa50 tx=0x7f75540055a0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.286+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 shutdown_connections 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.286+0000 7f756499f640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f754806e5f0 0x7f7548070ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.286+0000 7f756499f640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75601015d0 0x7f75601983d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.286+0000 7f756499f640 1 --2- 172.21.15.89:0/4091886175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7560100cb0 0x7f7560197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.286+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 >> 172.21.15.89:0/4091886175 conn(0x7f75600fa730 msgr2=0x7f75600fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:16.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.287+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 shutdown_connections 2024-09-13T22:17:16.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.287+0000 7f756499f640 1 -- 172.21.15.89:0/4091886175 wait complete. 2024-09-13T22:17:16.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.368+0000 7f0793fcc640 1 -- 172.21.15.89:0/3851508379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 msgr2=0x7f078c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.368+0000 7f0793fcc640 1 --2- 172.21.15.89:0/3851508379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 0x7f078c104dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0788009880 tx=0x7f078802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.368+0000 7f0793fcc640 1 -- 172.21.15.89:0/3851508379 shutdown_connections 2024-09-13T22:17:16.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.368+0000 7f0793fcc640 1 --2- 172.21.15.89:0/3851508379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c0fe9f0 0x7f078c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.368+0000 7f0793fcc640 1 --2- 172.21.15.89:0/3851508379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 0x7f078c104dd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.368+0000 7f0793fcc640 1 -- 172.21.15.89:0/3851508379 >> 172.21.15.89:0/3851508379 conn(0x7f078c0758a0 msgr2=0x7f078c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:16.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.368+0000 7f0793fcc640 1 -- 172.21.15.89:0/3851508379 shutdown_connections 2024-09-13T22:17:16.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.368+0000 7f0793fcc640 1 -- 172.21.15.89:0/3851508379 wait complete. 2024-09-13T22:17:16.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.369+0000 7f0793fcc640 1 Processor -- start 2024-09-13T22:17:16.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.369+0000 7f0793fcc640 1 -- start start 2024-09-13T22:17:16.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.369+0000 7f0793fcc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c0fe9f0 0x7f078c105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.369+0000 7f0793fcc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 0x7f078c105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.369+0000 7f0793fcc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1063a0 con 0x7f078c1049f0 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.369+0000 7f0793fcc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1064e0 con 0x7f078c0fe9f0 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0791567640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 0x7f078c105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0791567640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 0x7f078c105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47042/0 (socket says 172.21.15.89:47042) 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0791567640 1 -- 172.21.15.89:0/2876568526 learned_addr learned my addr 172.21.15.89:0/2876568526 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0791d68640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c0fe9f0 0x7f078c105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0791567640 1 -- 172.21.15.89:0/2876568526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c0fe9f0 msgr2=0x7f078c105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0791567640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c0fe9f0 0x7f078c105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0791567640 1 -- 172.21.15.89:0/2876568526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0788009560 con 0x7f078c1049f0 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0791567640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 0x7f078c105e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c8a0 tx=0x7f077c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0782ffd640 1 -- 172.21.15.89:0/2876568526 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f077c007b80 con 0x7f078c1049f0 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0782ffd640 1 -- 172.21.15.89:0/2876568526 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f077c007ce0 con 0x7f078c1049f0 2024-09-13T22:17:16.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c1a1c30 con 0x7f078c1049f0 2024-09-13T22:17:16.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0782ffd640 1 -- 172.21.15.89:0/2876568526 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f077c018810 con 0x7f078c1049f0 2024-09-13T22:17:16.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.370+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c1a1f90 con 0x7f078c1049f0 2024-09-13T22:17:16.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.371+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c100130 con 0x7f078c1049f0 2024-09-13T22:17:16.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.372+0000 7f0782ffd640 1 -- 172.21.15.89:0/2876568526 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f077c018a80 con 0x7f078c1049f0 2024-09-13T22:17:16.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.372+0000 7f0782ffd640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f077806e600 0x7f0778070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.373+0000 7f0791d68640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f077806e600 0x7f0778070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.373+0000 7f0782ffd640 1 -- 172.21.15.89:0/2876568526 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f077c08e8f0 con 0x7f078c1049f0 2024-09-13T22:17:16.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.373+0000 7f0791d68640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f077806e600 0x7f0778070ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0788009230 tx=0x7f0788005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:16.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.377+0000 7f0782ffd640 1 -- 172.21.15.89:0/2876568526 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f077c057970 con 0x7f078c1049f0 2024-09-13T22:17:16.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.587+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f078c0fee50 con 0x7f078c1049f0 2024-09-13T22:17:16.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.587+0000 7f0782ffd640 1 -- 172.21.15.89:0/2876568526 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1742 (secure 0 0 0) 0x7f077c05b030 con 0x7f078c1049f0 2024-09-13T22:17:16.589 INFO:teuthology.orchestra.run.smithi089.stdout:e18 2024-09-13T22:17:16.589 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T22:17:14:692510+0000 2024-09-13T22:17:16.589 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:17:16.589 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:17:16.589 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:17:16.589 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:17:16.589 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:17:16.589 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:17:16.589 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 15 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:06:34.551891+0000 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 46 2024-09-13T22:17:16.590 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24247} 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:17:16.591 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T22:17:16.592 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{0:24247} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.159:6824/782752998,v1:172.21.15.159:6825/782752998] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:17:16.592 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:17:16.592 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:17:16.592 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:17:16.592 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:17:16.592 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:24255} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:17:16.592 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:17:16.593 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 18 2024-09-13T22:17:16.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f077806e600 msgr2=0x7f0778070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f077806e600 0x7f0778070ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0788009230 tx=0x7f0788005a20 comp rx=0 tx=0).stop 2024-09-13T22:17:16.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 msgr2=0x7f078c105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 0x7f078c105e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c8a0 tx=0x7f077c00cd60 comp rx=0 tx=0).stop 2024-09-13T22:17:16.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 shutdown_connections 2024-09-13T22:17:16.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f077806e600 0x7f0778070ac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c1049f0 0x7f078c105e60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 --2- 172.21.15.89:0/2876568526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c0fe9f0 0x7f078c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 >> 172.21.15.89:0/2876568526 conn(0x7f078c0758a0 msgr2=0x7f078c067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:16.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 shutdown_connections 2024-09-13T22:17:16.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.589+0000 7f0793fcc640 1 -- 172.21.15.89:0/2876568526 wait complete. 2024-09-13T22:17:16.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.682+0000 7f04dfac2640 1 -- 172.21.15.89:0/3349544832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d81049f0 msgr2=0x7f04d8104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.682+0000 7f04dfac2640 1 --2- 172.21.15.89:0/3349544832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d81049f0 0x7f04d8104dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009880 tx=0x7f04d402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.682+0000 7f04dfac2640 1 -- 172.21.15.89:0/3349544832 shutdown_connections 2024-09-13T22:17:16.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.682+0000 7f04dfac2640 1 --2- 172.21.15.89:0/3349544832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d80fe9f0 0x7f04d80fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.682+0000 7f04dfac2640 1 --2- 172.21.15.89:0/3349544832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d81049f0 0x7f04d8104dd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.682+0000 7f04dfac2640 1 -- 172.21.15.89:0/3349544832 >> 172.21.15.89:0/3349544832 conn(0x7f04d80758a0 msgr2=0x7f04d80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:16.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.682+0000 7f04dfac2640 1 -- 172.21.15.89:0/3349544832 shutdown_connections 2024-09-13T22:17:16.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.682+0000 7f04dfac2640 1 -- 172.21.15.89:0/3349544832 wait complete. 2024-09-13T22:17:16.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dfac2640 1 Processor -- start 2024-09-13T22:17:16.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dfac2640 1 -- start start 2024-09-13T22:17:16.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dfac2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d80fe9f0 0x7f04d819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dfac2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d81049f0 0x7f04d819ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dfac2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d819b350 con 0x7f04d80fe9f0 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dfac2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d81948e0 con 0x7f04d81049f0 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dd85e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d80fe9f0 0x7f04d819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dd85e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d80fe9f0 0x7f04d819a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47056/0 (socket says 172.21.15.89:47056) 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dd85e640 1 -- 172.21.15.89:0/1505023527 learned_addr learned my addr 172.21.15.89:0/1505023527 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dd05d640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d81049f0 0x7f04d819ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dd85e640 1 -- 172.21.15.89:0/1505023527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d81049f0 msgr2=0x7f04d819ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dd85e640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d81049f0 0x7f04d819ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.683+0000 7f04dd85e640 1 -- 172.21.15.89:0/1505023527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4009560 con 0x7f04d80fe9f0 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.684+0000 7f04dd85e640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d80fe9f0 0x7f04d819a7f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f04d402a9c0 tx=0x7f04d40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.684+0000 7f04ceffd640 1 -- 172.21.15.89:0/1505023527 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04d403e070 con 0x7f04d80fe9f0 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.684+0000 7f04ceffd640 1 -- 172.21.15.89:0/1505023527 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04d4031640 con 0x7f04d80fe9f0 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.684+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d8194b60 con 0x7f04d80fe9f0 2024-09-13T22:17:16.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.684+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d8195050 con 0x7f04d80fe9f0 2024-09-13T22:17:16.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.684+0000 7f04ceffd640 1 -- 172.21.15.89:0/1505023527 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04d4003890 con 0x7f04d80fe9f0 2024-09-13T22:17:16.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.685+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d8100130 con 0x7f04d80fe9f0 2024-09-13T22:17:16.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.685+0000 7f04ceffd640 1 -- 172.21.15.89:0/1505023527 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f04d4004aa0 con 0x7f04d80fe9f0 2024-09-13T22:17:16.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.686+0000 7f04ceffd640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f04c406e5f0 0x7f04c4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.686+0000 7f04ceffd640 1 -- 172.21.15.89:0/1505023527 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f04d40b0be0 con 0x7f04d80fe9f0 2024-09-13T22:17:16.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.686+0000 7f04dd05d640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f04c406e5f0 0x7f04c4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.686+0000 7f04dd05d640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f04c406e5f0 0x7f04c4070ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04d8195d50 tx=0x7f04c8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:16.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.690+0000 7f04ceffd640 1 -- 172.21.15.89:0/1505023527 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f04d4079c60 con 0x7f04d80fe9f0 2024-09-13T22:17:16.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.883+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04d810bce0 con 0x7f04c406e5f0 2024-09-13T22:17:16.885 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:16 smithi089 ceph-mon[109939]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:16.885 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:16 smithi089 ceph-mon[109939]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:16.885 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:16 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/4091886175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:16.885 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:16 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2876568526' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.884+0000 7f04ceffd640 1 -- 172.21.15.89:0/1505023527 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f04d810bce0 con 0x7f04c406e5f0 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "osd", 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T22:17:16.886 INFO:teuthology.orchestra.run.smithi089.stdout: "crash" 2024-09-13T22:17:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:17:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "13/23 daemons upgraded", 2024-09-13T22:17:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T22:17:16.887 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:17:16.887 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:17:16.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f04c406e5f0 msgr2=0x7f04c4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f04c406e5f0 0x7f04c4070ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04d8195d50 tx=0x7f04c8008040 comp rx=0 tx=0).stop 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d80fe9f0 msgr2=0x7f04d819a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d80fe9f0 0x7f04d819a7f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f04d402a9c0 tx=0x7f04d40055a0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 shutdown_connections 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f04c406e5f0 0x7f04c4070ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d81049f0 0x7f04d819ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 --2- 172.21.15.89:0/1505023527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04d80fe9f0 0x7f04d819a7f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 >> 172.21.15.89:0/1505023527 conn(0x7f04d80758a0 msgr2=0x7f04d80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 shutdown_connections 2024-09-13T22:17:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.887+0000 7f04dfac2640 1 -- 172.21.15.89:0/1505023527 wait complete. 2024-09-13T22:17:16.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.973+0000 7f7ea0931640 1 -- 172.21.15.89:0/1561746906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c0fe9f0 msgr2=0x7f7e9c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.973+0000 7f7ea0931640 1 --2- 172.21.15.89:0/1561746906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c0fe9f0 0x7f7e9c0fee50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009880 tx=0x7f7e8402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.973+0000 7f7ea0931640 1 -- 172.21.15.89:0/1561746906 shutdown_connections 2024-09-13T22:17:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.973+0000 7f7ea0931640 1 --2- 172.21.15.89:0/1561746906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c0fe9f0 0x7f7e9c0fee50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.973+0000 7f7ea0931640 1 --2- 172.21.15.89:0/1561746906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9c1049f0 0x7f7e9c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.973+0000 7f7ea0931640 1 -- 172.21.15.89:0/1561746906 >> 172.21.15.89:0/1561746906 conn(0x7f7e9c0758a0 msgr2=0x7f7e9c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.973+0000 7f7ea0931640 1 -- 172.21.15.89:0/1561746906 shutdown_connections 2024-09-13T22:17:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.973+0000 7f7ea0931640 1 -- 172.21.15.89:0/1561746906 wait complete. 2024-09-13T22:17:16.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7ea0931640 1 Processor -- start 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7ea0931640 1 -- start start 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7ea0931640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9c0fe9f0 0x7f7e9c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7ea0931640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c1049f0 0x7f7e9c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7ea0931640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c195910 con 0x7f7e9c1049f0 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7ea0931640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c195a80 con 0x7f7e9c0fe9f0 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7e93fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c1049f0 0x7f7e9c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7e93fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c1049f0 0x7f7e9c19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47074/0 (socket says 172.21.15.89:47074) 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7e93fff640 1 -- 172.21.15.89:0/1247877532 learned_addr learned my addr 172.21.15.89:0/1247877532 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.974+0000 7f7e9a59c640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9c0fe9f0 0x7f7e9c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.975+0000 7f7e93fff640 1 -- 172.21.15.89:0/1247877532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9c0fe9f0 msgr2=0x7f7e9c19b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.975+0000 7f7e93fff640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9c0fe9f0 0x7f7e9c19b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:16.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.975+0000 7f7e93fff640 1 -- 172.21.15.89:0/1247877532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84009560 con 0x7f7e9c1049f0 2024-09-13T22:17:16.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.975+0000 7f7e93fff640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c1049f0 0x7f7e9c19bd60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7e8402a9c0 tx=0x7f7e840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:16.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.975+0000 7f7e937fe640 1 -- 172.21.15.89:0/1247877532 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e84004aa0 con 0x7f7e9c1049f0 2024-09-13T22:17:16.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.975+0000 7f7e937fe640 1 -- 172.21.15.89:0/1247877532 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e84004c00 con 0x7f7e9c1049f0 2024-09-13T22:17:16.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.975+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c195d00 con 0x7f7e9c1049f0 2024-09-13T22:17:16.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.975+0000 7f7e937fe640 1 -- 172.21.15.89:0/1247877532 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e84003980 con 0x7f7e9c1049f0 2024-09-13T22:17:16.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.975+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c1961a0 con 0x7f7e9c1049f0 2024-09-13T22:17:16.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.976+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c100130 con 0x7f7e9c1049f0 2024-09-13T22:17:16.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.977+0000 7f7e937fe640 1 -- 172.21.15.89:0/1247877532 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7e84003bf0 con 0x7f7e9c1049f0 2024-09-13T22:17:16.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.977+0000 7f7e937fe640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7e8806e5f0 0x7f7e88070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:16.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.978+0000 7f7e937fe640 1 -- 172.21.15.89:0/1247877532 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f7e840af820 con 0x7f7e9c1049f0 2024-09-13T22:17:16.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.978+0000 7f7e9a59c640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7e8806e5f0 0x7f7e88070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:16.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.978+0000 7f7e9a59c640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7e8806e5f0 0x7f7e88070ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c005fd0 tx=0x7f7e8c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:16.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:16.982+0000 7f7e937fe640 1 -- 172.21.15.89:0/1247877532 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7e840789c0 con 0x7f7e9c1049f0 2024-09-13T22:17:17.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:16 smithi159 ceph-mon[82000]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:17.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:16 smithi159 ceph-mon[82000]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:17.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:16 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/4091886175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:17.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:16 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2876568526' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:17:17.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.230+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7e9c10bc80 con 0x7f7e9c1049f0 2024-09-13T22:17:17.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.231+0000 7f7e937fe640 1 -- 172.21.15.89:0/1247877532 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7e8407c080 con 0x7f7e9c1049f0 2024-09-13T22:17:17.233 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:17:17.233 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:17:17.233 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:17:17.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.233+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7e8806e5f0 msgr2=0x7f7e88070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:17.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.233+0000 7f7ea0931640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7e8806e5f0 0x7f7e88070ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c005fd0 tx=0x7f7e8c00b390 comp rx=0 tx=0).stop 2024-09-13T22:17:17.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.233+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c1049f0 msgr2=0x7f7e9c19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:17.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.233+0000 7f7ea0931640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c1049f0 0x7f7e9c19bd60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7e8402a9c0 tx=0x7f7e840055a0 comp rx=0 tx=0).stop 2024-09-13T22:17:17.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.233+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 shutdown_connections 2024-09-13T22:17:17.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.233+0000 7f7ea0931640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7e8806e5f0 0x7f7e88070ab0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:17.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.233+0000 7f7ea0931640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9c1049f0 0x7f7e9c19bd60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:17.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.233+0000 7f7ea0931640 1 --2- 172.21.15.89:0/1247877532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9c0fe9f0 0x7f7e9c19b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:17.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.234+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 >> 172.21.15.89:0/1247877532 conn(0x7f7e9c0758a0 msgr2=0x7f7e9c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:17.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.234+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 shutdown_connections 2024-09-13T22:17:17.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:17.234+0000 7f7ea0931640 1 -- 172.21.15.89:0/1247877532 wait complete. 2024-09-13T22:17:17.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:17 smithi089 ceph-mon[109939]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:17.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:17 smithi089 ceph-mon[109939]: pgmap v188: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:17.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:17 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1247877532' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:17:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:17 smithi159 ceph-mon[82000]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:17 smithi159 ceph-mon[82000]: pgmap v188: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:17 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1247877532' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:17:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:18 smithi089 ceph-mon[109939]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:18 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.89:6828/246571303,v1:172.21.15.89:6829/246571303] up:boot 2024-09-13T22:17:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:18 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:17:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:18 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:17:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:18 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:18.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:18 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:18.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:18 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:19.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:18 smithi159 ceph-mon[82000]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:19.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:18 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.89:6828/246571303,v1:172.21.15.89:6829/246571303] up:boot 2024-09-13T22:17:19.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:18 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi159.hqlvpx=up:active} 3 up:standby 2024-09-13T22:17:19.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:18 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:17:19.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:18 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:19.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:18 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:19.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:18 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:20.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:19 smithi089 ceph-mon[109939]: pgmap v189: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:20.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:19 smithi159 ceph-mon[82000]: pgmap v189: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:22.212 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:21 smithi089 ceph-mon[109939]: pgmap v190: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:22.212 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:17:22.231 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:21 smithi159 ceph-mon[82000]: pgmap v190: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:22.232 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:17:23.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:23 smithi089 ceph-mon[109939]: pgmap v191: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:23.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:23 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:23.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:23 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:23.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:23 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:23.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:23 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:24.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:23 smithi159 ceph-mon[82000]: pgmap v191: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:24.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:23 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:24.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:23 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:24.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:23 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:24.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:23 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:25.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:25 smithi089 ceph-mon[109939]: pgmap v192: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:26.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:25 smithi159 ceph-mon[82000]: pgmap v192: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:27.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:27.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: pgmap v193: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:27.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:27.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:27.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:27.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:27.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:27.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:27.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:27.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:27.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: pgmap v193: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:29.428 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:29 smithi159 ceph-mon[82000]: Upgrade: Updating mds.cephfs.smithi159.hqlvpx 2024-09-13T22:17:29.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:29 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:29.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:29 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.hqlvpx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:17:29.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:29 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:29.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:29 smithi159 ceph-mon[82000]: Deploying daemon mds.cephfs.smithi159.hqlvpx on smithi159 2024-09-13T22:17:29.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:29 smithi159 ceph-mon[82000]: pgmap v194: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:29.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:29 smithi089 ceph-mon[109939]: Upgrade: Updating mds.cephfs.smithi159.hqlvpx 2024-09-13T22:17:29.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:29 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:29.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:29 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.hqlvpx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:17:29.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:29 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:29.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:29 smithi089 ceph-mon[109939]: Deploying daemon mds.cephfs.smithi159.hqlvpx on smithi159 2024-09-13T22:17:29.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:29 smithi089 ceph-mon[109939]: pgmap v194: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:17:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:29 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089[109935]: 2024-09-13T22:17:29.966+0000 7f7beabad640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:17:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:30 smithi089 ceph-mon[109939]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T22:17:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:30 smithi089 ceph-mon[109939]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:17:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:30 smithi089 ceph-mon[109939]: osdmap e95: 6 total, 6 up, 6 in 2024-09-13T22:17:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:30 smithi089 ceph-mon[109939]: Standby daemon mds.cephfs.smithi159.rowsot assigned to filesystem cephfs as rank 0 2024-09-13T22:17:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:30 smithi089 ceph-mon[109939]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T22:17:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:30 smithi089 ceph-mon[109939]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T22:17:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:30 smithi089 ceph-mon[109939]: fsmap cephfs:1/1 {0=cephfs.smithi159.rowsot=up:replay} 2 up:standby 2024-09-13T22:17:30.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:30 smithi159 ceph-mon[82000]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T22:17:30.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:30 smithi159 ceph-mon[82000]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:17:30.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:30 smithi159 ceph-mon[82000]: osdmap e95: 6 total, 6 up, 6 in 2024-09-13T22:17:30.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:30 smithi159 ceph-mon[82000]: Standby daemon mds.cephfs.smithi159.rowsot assigned to filesystem cephfs as rank 0 2024-09-13T22:17:30.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:30 smithi159 ceph-mon[82000]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T22:17:30.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:30 smithi159 ceph-mon[82000]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T22:17:30.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:30 smithi159 ceph-mon[82000]: fsmap cephfs:1/1 {0=cephfs.smithi159.rowsot=up:replay} 2 up:standby 2024-09-13T22:17:31.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:31 smithi089 ceph-mon[109939]: pgmap v196: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-13T22:17:31.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:31 smithi159 ceph-mon[82000]: pgmap v196: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-13T22:17:32.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:32 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:17:32.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:32 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:17:33.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:33 smithi089 ceph-mon[109939]: pgmap v197: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-13T22:17:34.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:33 smithi159 ceph-mon[82000]: pgmap v197: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-13T22:17:35.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:35 smithi089 ceph-mon[109939]: pgmap v198: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T22:17:36.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:35 smithi159 ceph-mon[82000]: pgmap v198: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T22:17:37.811 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:37.811 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:17:37.811 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:37 smithi159 ceph-mon[82000]: pgmap v199: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-13T22:17:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:17:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:37 smithi089 ceph-mon[109939]: pgmap v199: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-13T22:17:38.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:38 smithi089 ceph-mon[109939]: reconnect by client.24277 v1:192.168.0.1:0/234772953 after 0.000999981 2024-09-13T22:17:38.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:38 smithi089 ceph-mon[109939]: reconnect by client.14530 v1:192.168.0.1:0/2270496495 after 0.000999981 2024-09-13T22:17:38.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:38 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:reconnect 2024-09-13T22:17:38.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:38 smithi089 ceph-mon[109939]: fsmap cephfs:1/1 {0=cephfs.smithi159.rowsot=up:reconnect} 2 up:standby 2024-09-13T22:17:39.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:38 smithi159 ceph-mon[82000]: reconnect by client.24277 v1:192.168.0.1:0/234772953 after 0.000999981 2024-09-13T22:17:39.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:38 smithi159 ceph-mon[82000]: reconnect by client.14530 v1:192.168.0.1:0/2270496495 after 0.000999981 2024-09-13T22:17:39.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:38 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:reconnect 2024-09-13T22:17:39.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:38 smithi159 ceph-mon[82000]: fsmap cephfs:1/1 {0=cephfs.smithi159.rowsot=up:reconnect} 2 up:standby 2024-09-13T22:17:39.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:39 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:rejoin 2024-09-13T22:17:39.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:39 smithi089 ceph-mon[109939]: fsmap cephfs:1/1 {0=cephfs.smithi159.rowsot=up:rejoin} 2 up:standby 2024-09-13T22:17:39.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:39 smithi089 ceph-mon[109939]: pgmap v200: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-13T22:17:39.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:39 smithi089 ceph-mon[109939]: daemon mds.cephfs.smithi159.rowsot is now active in filesystem cephfs as rank 0 2024-09-13T22:17:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:39 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:rejoin 2024-09-13T22:17:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:39 smithi159 ceph-mon[82000]: fsmap cephfs:1/1 {0=cephfs.smithi159.rowsot=up:rejoin} 2 up:standby 2024-09-13T22:17:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:39 smithi159 ceph-mon[82000]: pgmap v200: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-13T22:17:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:39 smithi159 ceph-mon[82000]: daemon mds.cephfs.smithi159.rowsot is now active in filesystem cephfs as rank 0 2024-09-13T22:17:40.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:40 smithi089 ceph-mon[109939]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T22:17:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:40 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:active 2024-09-13T22:17:40.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:40 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi159.rowsot=up:active} 2 up:standby 2024-09-13T22:17:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:40 smithi159 ceph-mon[82000]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T22:17:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:40 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] up:active 2024-09-13T22:17:41.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:40 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi159.rowsot=up:active} 2 up:standby 2024-09-13T22:17:41.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:41 smithi089 ceph-mon[109939]: pgmap v201: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 191 B/s wr, 6 op/s 2024-09-13T22:17:42.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:41 smithi159 ceph-mon[82000]: pgmap v201: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 191 B/s wr, 6 op/s 2024-09-13T22:17:43.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:43 smithi089 ceph-mon[109939]: pgmap v202: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:17:44.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:43 smithi159 ceph-mon[82000]: pgmap v202: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:17:45.187 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:44 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:45.187 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:44 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:45.187 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:44 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:45.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:44 smithi159 ceph-mon[82000]: pgmap v203: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.4 KiB/s wr, 10 op/s 2024-09-13T22:17:45.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:44 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.159:6824/1327575252,v1:172.21.15.159:6825/1327575252] up:boot 2024-09-13T22:17:45.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:44 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi159.rowsot=up:active} 3 up:standby 2024-09-13T22:17:45.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:44 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:17:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:44 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:44 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:44 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:44 smithi089 ceph-mon[109939]: pgmap v203: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.4 KiB/s wr, 10 op/s 2024-09-13T22:17:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:44 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.159:6824/1327575252,v1:172.21.15.159:6825/1327575252] up:boot 2024-09-13T22:17:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:44 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi159.rowsot=up:active} 3 up:standby 2024-09-13T22:17:45.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:44 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:17:47.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.329+0000 7f16adbd4640 1 -- 172.21.15.89:0/3601368512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8100c50 msgr2=0x7f16a8101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.329+0000 7f16adbd4640 1 --2- 172.21.15.89:0/3601368512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8100c50 0x7f16a8101030 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16980098b0 tx=0x7f169802a4d0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.329+0000 7f16adbd4640 1 -- 172.21.15.89:0/3601368512 shutdown_connections 2024-09-13T22:17:47.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.329+0000 7f16adbd4640 1 --2- 172.21.15.89:0/3601368512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a8101600 0x7f16a8109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.329+0000 7f16adbd4640 1 --2- 172.21.15.89:0/3601368512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8100c50 0x7f16a8101030 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.329+0000 7f16adbd4640 1 -- 172.21.15.89:0/3601368512 >> 172.21.15.89:0/3601368512 conn(0x7f16a80fa700 msgr2=0x7f16a80fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.329+0000 7f16adbd4640 1 -- 172.21.15.89:0/3601368512 shutdown_connections 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.329+0000 7f16adbd4640 1 -- 172.21.15.89:0/3601368512 wait complete. 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.329+0000 7f16adbd4640 1 Processor -- start 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16adbd4640 1 -- start start 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16adbd4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a8100c50 0x7f16a819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16adbd4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8101600 0x7f16a819be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16adbd4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8195940 con 0x7f16a8101600 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16adbd4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8195a80 con 0x7f16a8100c50 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16a6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8101600 0x7f16a819be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16a6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8101600 0x7f16a819be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55064/0 (socket says 172.21.15.89:55064) 2024-09-13T22:17:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16a6ffd640 1 -- 172.21.15.89:0/1162108294 learned_addr learned my addr 172.21.15.89:0/1162108294 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16a77fe640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a8100c50 0x7f16a819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16a6ffd640 1 -- 172.21.15.89:0/1162108294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a8100c50 msgr2=0x7f16a819b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16a6ffd640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a8100c50 0x7f16a819b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16a6ffd640 1 -- 172.21.15.89:0/1162108294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698009560 con 0x7f16a8101600 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.330+0000 7f16a6ffd640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8101600 0x7f16a819be20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f169c00e970 tx=0x7f169c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.331+0000 7f16a4ff9640 1 -- 172.21.15.89:0/1162108294 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f169c00cc90 con 0x7f16a8101600 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.331+0000 7f16a4ff9640 1 -- 172.21.15.89:0/1162108294 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f169c00cdf0 con 0x7f16a8101600 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.331+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a8195d60 con 0x7f16a8101600 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.331+0000 7f16a4ff9640 1 -- 172.21.15.89:0/1162108294 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f169c010430 con 0x7f16a8101600 2024-09-13T22:17:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.331+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a81962b0 con 0x7f16a8101600 2024-09-13T22:17:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.332+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8068d30 con 0x7f16a8101600 2024-09-13T22:17:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.332+0000 7f16a4ff9640 1 -- 172.21.15.89:0/1162108294 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f169c0046c0 con 0x7f16a8101600 2024-09-13T22:17:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.333+0000 7f16a4ff9640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f169006e600 0x7f1690070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.333+0000 7f16a4ff9640 1 -- 172.21.15.89:0/1162108294 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f169c014070 con 0x7f16a8101600 2024-09-13T22:17:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.333+0000 7f16a77fe640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f169006e600 0x7f1690070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:47.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.333+0000 7f16a77fe640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f169006e600 0x7f1690070ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1698009880 tx=0x7f1698005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:47.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.337+0000 7f16a4ff9640 1 -- 172.21.15.89:0/1162108294 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f169c057d70 con 0x7f16a8101600 2024-09-13T22:17:47.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.522+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16a810cdc0 con 0x7f169006e600 2024-09-13T22:17:47.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.523+0000 7f16a4ff9640 1 -- 172.21.15.89:0/1162108294 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f16a810cdc0 con 0x7f169006e600 2024-09-13T22:17:47.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f169006e600 msgr2=0x7f1690070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f169006e600 0x7f1690070ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1698009880 tx=0x7f1698005a20 comp rx=0 tx=0).stop 2024-09-13T22:17:47.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8101600 msgr2=0x7f16a819be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8101600 0x7f16a819be20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f169c00e970 tx=0x7f169c00ed70 comp rx=0 tx=0).stop 2024-09-13T22:17:47.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 shutdown_connections 2024-09-13T22:17:47.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f169006e600 0x7f1690070ac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a8101600 0x7f16a819be20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 --2- 172.21.15.89:0/1162108294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16a8100c50 0x7f16a819b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 >> 172.21.15.89:0/1162108294 conn(0x7f16a80fa700 msgr2=0x7f16a8101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:47.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 shutdown_connections 2024-09-13T22:17:47.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.525+0000 7f16adbd4640 1 -- 172.21.15.89:0/1162108294 wait complete. 2024-09-13T22:17:47.535 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:17:47.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.607+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2974407946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 msgr2=0x7f96a4101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.607+0000 7f96ab2bb640 1 --2- 172.21.15.89:0/2974407946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 0x7f96a4101130 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009880 tx=0x7f96a002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.607+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2974407946 shutdown_connections 2024-09-13T22:17:47.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.607+0000 7f96ab2bb640 1 --2- 172.21.15.89:0/2974407946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a4101670 0x7f96a4109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.607+0000 7f96ab2bb640 1 --2- 172.21.15.89:0/2974407946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 0x7f96a4101130 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.607+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2974407946 >> 172.21.15.89:0/2974407946 conn(0x7f96a40fa730 msgr2=0x7f96a40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:47.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.607+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2974407946 shutdown_connections 2024-09-13T22:17:47.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.607+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2974407946 wait complete. 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96ab2bb640 1 Processor -- start 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96ab2bb640 1 -- start start 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96ab2bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 0x7f96a419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96ab2bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a4101670 0x7f96a419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96ab2bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a419c340 con 0x7f96a4100d50 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96ab2bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a41958d0 con 0x7f96a4101670 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96a9057640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 0x7f96a419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96a9057640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 0x7f96a419b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55082/0 (socket says 172.21.15.89:55082) 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96a9057640 1 -- 172.21.15.89:0/2860350335 learned_addr learned my addr 172.21.15.89:0/2860350335 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96a8856640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a4101670 0x7f96a419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:47.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96a9057640 1 -- 172.21.15.89:0/2860350335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a4101670 msgr2=0x7f96a419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96a9057640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a4101670 0x7f96a419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.608+0000 7f96a9057640 1 -- 172.21.15.89:0/2860350335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0009560 con 0x7f96a4100d50 2024-09-13T22:17:47.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.609+0000 7f96a9057640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 0x7f96a419b7e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96a002a9c0 tx=0x7f96a00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:47.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.609+0000 7f969a7fc640 1 -- 172.21.15.89:0/2860350335 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a0004aa0 con 0x7f96a4100d50 2024-09-13T22:17:47.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.609+0000 7f969a7fc640 1 -- 172.21.15.89:0/2860350335 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96a0004c00 con 0x7f96a4100d50 2024-09-13T22:17:47.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.609+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a4195bb0 con 0x7f96a4100d50 2024-09-13T22:17:47.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.609+0000 7f969a7fc640 1 -- 172.21.15.89:0/2860350335 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a0003980 con 0x7f96a4100d50 2024-09-13T22:17:47.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.609+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a4196100 con 0x7f96a4100d50 2024-09-13T22:17:47.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.610+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a4068cd0 con 0x7f96a4100d50 2024-09-13T22:17:47.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.610+0000 7f969a7fc640 1 -- 172.21.15.89:0/2860350335 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f96a0003bf0 con 0x7f96a4100d50 2024-09-13T22:17:47.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.611+0000 7f969a7fc640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f969006e5f0 0x7f9690070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:47.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.611+0000 7f96a8856640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f969006e5f0 0x7f9690070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:47.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.611+0000 7f969a7fc640 1 -- 172.21.15.89:0/2860350335 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f96a00af720 con 0x7f96a4100d50 2024-09-13T22:17:47.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.611+0000 7f96a8856640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f969006e5f0 0x7f9690070ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96a4196d40 tx=0x7f969400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:47.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.615+0000 7f969a7fc640 1 -- 172.21.15.89:0/2860350335 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f96a0078800 con 0x7f96a4100d50 2024-09-13T22:17:47.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.798+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96a41043c0 con 0x7f969006e5f0 2024-09-13T22:17:47.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.800+0000 7f969a7fc640 1 -- 172.21.15.89:0/2860350335 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f96a41043c0 con 0x7f969006e5f0 2024-09-13T22:17:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f969006e5f0 msgr2=0x7f9690070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f969006e5f0 0x7f9690070ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96a4196d40 tx=0x7f969400b390 comp rx=0 tx=0).stop 2024-09-13T22:17:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 msgr2=0x7f96a419b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 0x7f96a419b7e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96a002a9c0 tx=0x7f96a00055a0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 shutdown_connections 2024-09-13T22:17:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f969006e5f0 0x7f9690070ab0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96a4101670 0x7f96a419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 --2- 172.21.15.89:0/2860350335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a4100d50 0x7f96a419b7e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 >> 172.21.15.89:0/2860350335 conn(0x7f96a40fa730 msgr2=0x7f96a4101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 shutdown_connections 2024-09-13T22:17:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.802+0000 7f96ab2bb640 1 -- 172.21.15.89:0/2860350335 wait complete. 2024-09-13T22:17:47.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.881+0000 7fd2917a2640 1 -- 172.21.15.89:0/3484992145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c101620 msgr2=0x7fd28c109b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.881+0000 7fd2917a2640 1 --2- 172.21.15.89:0/3484992145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c101620 0x7fd28c109b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd280009880 tx=0x7fd28002a530 comp rx=0 tx=0).stop 2024-09-13T22:17:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.881+0000 7fd2917a2640 1 -- 172.21.15.89:0/3484992145 shutdown_connections 2024-09-13T22:17:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.881+0000 7fd2917a2640 1 --2- 172.21.15.89:0/3484992145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c101620 0x7fd28c109b10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.881+0000 7fd2917a2640 1 --2- 172.21.15.89:0/3484992145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28c100d00 0x7fd28c1010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.881+0000 7fd2917a2640 1 -- 172.21.15.89:0/3484992145 >> 172.21.15.89:0/3484992145 conn(0x7fd28c0fa700 msgr2=0x7fd28c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.881+0000 7fd2917a2640 1 -- 172.21.15.89:0/3484992145 shutdown_connections 2024-09-13T22:17:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.881+0000 7fd2917a2640 1 -- 172.21.15.89:0/3484992145 wait complete. 2024-09-13T22:17:47.884 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:47 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:47.885 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:47 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:47.885 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:47 smithi089 ceph-mon[109939]: pgmap v204: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T22:17:47.885 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:47 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:47.885 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:47 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd2917a2640 1 Processor -- start 2024-09-13T22:17:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd2917a2640 1 -- start start 2024-09-13T22:17:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd2917a2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c100d00 0x7fd28c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd2917a2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28c101620 0x7fd28c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd2917a2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c19c400 con 0x7fd28c100d00 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd2917a2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c195990 con 0x7fd28c101620 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd28affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c100d00 0x7fd28c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd28affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c100d00 0x7fd28c19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55094/0 (socket says 172.21.15.89:55094) 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd28affd640 1 -- 172.21.15.89:0/2225336429 learned_addr learned my addr 172.21.15.89:0/2225336429 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd28a7fc640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28c101620 0x7fd28c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd28affd640 1 -- 172.21.15.89:0/2225336429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28c101620 msgr2=0x7fd28c19bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd28affd640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28c101620 0x7fd28c19bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.882+0000 7fd28affd640 1 -- 172.21.15.89:0/2225336429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd280009560 con 0x7fd28c100d00 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.883+0000 7fd28affd640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c100d00 0x7fd28c19b8a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d6f0 tx=0x7fd27c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.883+0000 7fd273fff640 1 -- 172.21.15.89:0/2225336429 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c009a30 con 0x7fd28c100d00 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.883+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c195c70 con 0x7fd28c100d00 2024-09-13T22:17:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.883+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c196190 con 0x7fd28c100d00 2024-09-13T22:17:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.883+0000 7fd273fff640 1 -- 172.21.15.89:0/2225336429 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd27c0054e0 con 0x7fd28c100d00 2024-09-13T22:17:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.883+0000 7fd273fff640 1 -- 172.21.15.89:0/2225336429 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c010460 con 0x7fd28c100d00 2024-09-13T22:17:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.884+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd278005250 con 0x7fd28c100d00 2024-09-13T22:17:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.885+0000 7fd273fff640 1 -- 172.21.15.89:0/2225336429 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd27c004ec0 con 0x7fd28c100d00 2024-09-13T22:17:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.885+0000 7fd273fff640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd27406e5f0 0x7fd274070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.885+0000 7fd273fff640 1 -- 172.21.15.89:0/2225336429 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6703+0+0 (secure 0 0 0) 0x7fd27c08e150 con 0x7fd28c100d00 2024-09-13T22:17:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.885+0000 7fd28a7fc640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd27406e5f0 0x7fd274070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:47.890 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:47 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:47.890 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:47 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:47.891 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:47 smithi159 ceph-mon[82000]: pgmap v204: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T22:17:47.891 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:47 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:47.891 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:47 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:47.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.886+0000 7fd28a7fc640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd27406e5f0 0x7fd274070ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd280009230 tx=0x7fd2800058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:47.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:47.890+0000 7fd273fff640 1 -- 172.21.15.89:0/2225336429 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd27c0572b0 con 0x7fd28c100d00 2024-09-13T22:17:48.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.064+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd278000bc0 con 0x7fd27406e5f0 2024-09-13T22:17:48.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.073+0000 7fd273fff640 1 -- 172.21.15.89:0/2225336429 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fd278000bc0 con 0x7fd27406e5f0 2024-09-13T22:17:48.076 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:17:48.076 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (6m) 25s ago 16m 25.3M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:17:48.077 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (17m) 25s ago 17m 9072k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:17:48.077 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (16m) 1s ago 16m 9248k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:17:48.077 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (4m) 25s ago 17m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:17:48.077 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (4m) 1s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:17:48.077 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (6m) 25s ago 16m 82.1M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:17:48.078 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (30s) 25s ago 11m 12.9M - 19.1.1-324-gecab7be5 0652ff2b5d78 8e7c4b78b682 2024-09-13T22:17:48.078 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (47s) 25s ago 11m 13.8M - 19.1.1-324-gecab7be5 0652ff2b5d78 007f4687420d 2024-09-13T22:17:48.078 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (4s) 1s ago 11m 14.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 6795ed6657dc 2024-09-13T22:17:48.078 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (11m) 1s ago 11m 87.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 93cac6dca408 2024-09-13T22:17:48.078 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (8m) 25s ago 18m 505M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:17:48.078 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (7m) 1s ago 15m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:17:48.078 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (5m) 25s ago 18m 53.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:17:48.079 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (4m) 1s ago 15m 41.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:17:48.079 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 25s ago 16m 15.1M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:17:48.079 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (7m) 1s ago 16m 16.2M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:17:48.079 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (3m) 25s ago 15m 163M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:17:48.079 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (3m) 25s ago 14m 138M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 3d2a1d778a36 2024-09-13T22:17:48.079 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (2m) 25s ago 14m 133M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 ffb294d5c14f 2024-09-13T22:17:48.080 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (2m) 1s ago 13m 141M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 6724e7895aeb 2024-09-13T22:17:48.080 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (95s) 1s ago 13m 97.7M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 18175379d0ae 2024-09-13T22:17:48.080 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (62s) 1s ago 12m 106M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 c11707471acc 2024-09-13T22:17:48.080 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (6m) 25s ago 16m 66.0M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:17:48.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd27406e5f0 msgr2=0x7fd274070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd27406e5f0 0x7fd274070ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd280009230 tx=0x7fd2800058d0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c100d00 msgr2=0x7fd28c19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c100d00 0x7fd28c19b8a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d6f0 tx=0x7fd27c00dbb0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 shutdown_connections 2024-09-13T22:17:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd27406e5f0 0x7fd274070ab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28c101620 0x7fd28c19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 --2- 172.21.15.89:0/2225336429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28c100d00 0x7fd28c19b8a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 >> 172.21.15.89:0/2225336429 conn(0x7fd28c0fa700 msgr2=0x7fd28c101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:48.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 shutdown_connections 2024-09-13T22:17:48.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.076+0000 7fd2917a2640 1 -- 172.21.15.89:0/2225336429 wait complete. 2024-09-13T22:17:48.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.155+0000 7fb3d97d6640 1 -- 172.21.15.89:0/3038628833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 msgr2=0x7fb3d40feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.155+0000 7fb3d97d6640 1 --2- 172.21.15.89:0/3038628833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 0x7fb3d40feed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009880 tx=0x7fb3c402a530 comp rx=0 tx=0).stop 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.155+0000 7fb3d97d6640 1 -- 172.21.15.89:0/3038628833 shutdown_connections 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.155+0000 7fb3d97d6640 1 --2- 172.21.15.89:0/3038628833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d40ff410 0x7fb3d41038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.155+0000 7fb3d97d6640 1 --2- 172.21.15.89:0/3038628833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 0x7fb3d40feed0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.155+0000 7fb3d97d6640 1 -- 172.21.15.89:0/3038628833 >> 172.21.15.89:0/3038628833 conn(0x7fb3d40fa700 msgr2=0x7fb3d40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.155+0000 7fb3d97d6640 1 -- 172.21.15.89:0/3038628833 shutdown_connections 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.155+0000 7fb3d97d6640 1 -- 172.21.15.89:0/3038628833 wait complete. 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d97d6640 1 Processor -- start 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d97d6640 1 -- start start 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d97d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 0x7fb3d419c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:48.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d97d6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d40ff410 0x7fb3d419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d97d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d419cd10 con 0x7fb3d40feaf0 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d97d6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d41a0a80 con 0x7fb3d40ff410 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 0x7fb3d419c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 0x7fb3d419c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55122/0 (socket says 172.21.15.89:55122) 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d2ffd640 1 -- 172.21.15.89:0/264713552 learned_addr learned my addr 172.21.15.89:0/264713552 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3cbfff640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d40ff410 0x7fb3d419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d2ffd640 1 -- 172.21.15.89:0/264713552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d40ff410 msgr2=0x7fb3d419c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d2ffd640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d40ff410 0x7fb3d419c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.156+0000 7fb3d2ffd640 1 -- 172.21.15.89:0/264713552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c4009560 con 0x7fb3d40feaf0 2024-09-13T22:17:48.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.157+0000 7fb3d2ffd640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 0x7fb3d419c140 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4006010 tx=0x7fb3c40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:48.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.157+0000 7fb3d0ff9640 1 -- 172.21.15.89:0/264713552 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3c4004aa0 con 0x7fb3d40feaf0 2024-09-13T22:17:48.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.157+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d41a0d00 con 0x7fb3d40feaf0 2024-09-13T22:17:48.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.157+0000 7fb3d0ff9640 1 -- 172.21.15.89:0/264713552 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3c4004c00 con 0x7fb3d40feaf0 2024-09-13T22:17:48.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.157+0000 7fb3d0ff9640 1 -- 172.21.15.89:0/264713552 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3c4003a20 con 0x7fb3d40feaf0 2024-09-13T22:17:48.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.157+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d41a11f0 con 0x7fb3d40feaf0 2024-09-13T22:17:48.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.158+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d4068d30 con 0x7fb3d40feaf0 2024-09-13T22:17:48.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.158+0000 7fb3d0ff9640 1 -- 172.21.15.89:0/264713552 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb3c402ad50 con 0x7fb3d40feaf0 2024-09-13T22:17:48.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.159+0000 7fb3d0ff9640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb3c006e600 0x7fb3c0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:48.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.159+0000 7fb3d0ff9640 1 -- 172.21.15.89:0/264713552 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6703+0+0 (secure 0 0 0) 0x7fb3c40af5f0 con 0x7fb3d40feaf0 2024-09-13T22:17:48.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.159+0000 7fb3cbfff640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb3c006e600 0x7fb3c0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:48.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.160+0000 7fb3cbfff640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb3c006e600 0x7fb3c0070ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb3d419d6f0 tx=0x7fb3bc005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:48.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.163+0000 7fb3d0ff9640 1 -- 172.21.15.89:0/264713552 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb3c4078750 con 0x7fb3d40feaf0 2024-09-13T22:17:48.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.396+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb3d41133f0 con 0x7fb3d40feaf0 2024-09-13T22:17:48.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.396+0000 7fb3d0ff9640 1 -- 172.21.15.89:0/264713552 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7fb3c407be10 con 0x7fb3d40feaf0 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:17:48.399 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:17:48.400 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T22:17:48.400 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 3 2024-09-13T22:17:48.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:17:48.400 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:17:48.400 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T22:17:48.400 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 13 2024-09-13T22:17:48.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:17:48.400 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:17:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb3c006e600 msgr2=0x7fb3c0070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb3c006e600 0x7fb3c0070ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb3d419d6f0 tx=0x7fb3bc005f50 comp rx=0 tx=0).stop 2024-09-13T22:17:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 msgr2=0x7fb3d419c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 0x7fb3d419c140 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4006010 tx=0x7fb3c40055a0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 shutdown_connections 2024-09-13T22:17:48.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb3c006e600 0x7fb3c0070ac0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d40ff410 0x7fb3d419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 --2- 172.21.15.89:0/264713552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d40feaf0 0x7fb3d419c140 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 >> 172.21.15.89:0/264713552 conn(0x7fb3d40fa700 msgr2=0x7fb3d410d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:48.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 shutdown_connections 2024-09-13T22:17:48.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.399+0000 7fb3d97d6640 1 -- 172.21.15.89:0/264713552 wait complete. 2024-09-13T22:17:48.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.479+0000 7f99d802c640 1 -- 172.21.15.89:0/69904651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 msgr2=0x7f99d00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.479+0000 7f99d802c640 1 --2- 172.21.15.89:0/69904651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 0x7f99d00fee90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009880 tx=0x7f99c002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.479+0000 7f99d802c640 1 -- 172.21.15.89:0/69904651 shutdown_connections 2024-09-13T22:17:48.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.479+0000 7f99d802c640 1 --2- 172.21.15.89:0/69904651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 0x7f99d00fee90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.479+0000 7f99d802c640 1 --2- 172.21.15.89:0/69904651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99d0104a30 0x7f99d0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.479+0000 7f99d802c640 1 -- 172.21.15.89:0/69904651 >> 172.21.15.89:0/69904651 conn(0x7f99d00fa730 msgr2=0x7f99d00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:48.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.479+0000 7f99d802c640 1 -- 172.21.15.89:0/69904651 shutdown_connections 2024-09-13T22:17:48.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.479+0000 7f99d802c640 1 -- 172.21.15.89:0/69904651 wait complete. 2024-09-13T22:17:48.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.480+0000 7f99d802c640 1 Processor -- start 2024-09-13T22:17:48.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.480+0000 7f99d802c640 1 -- start start 2024-09-13T22:17:48.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.480+0000 7f99d802c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 0x7f99d0196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:48.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d802c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99d0104a30 0x7f99d0196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:48.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d802c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d0197470 con 0x7f99d00fea30 2024-09-13T22:17:48.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d802c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d01975e0 con 0x7f99d0104a30 2024-09-13T22:17:48.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d5dc8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 0x7f99d0196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:48.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d5dc8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 0x7f99d0196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55148/0 (socket says 172.21.15.89:55148) 2024-09-13T22:17:48.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d5dc8640 1 -- 172.21.15.89:0/3152204190 learned_addr learned my addr 172.21.15.89:0/3152204190 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d55c7640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99d0104a30 0x7f99d0196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d5dc8640 1 -- 172.21.15.89:0/3152204190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99d0104a30 msgr2=0x7f99d0196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d5dc8640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99d0104a30 0x7f99d0196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d5dc8640 1 -- 172.21.15.89:0/3152204190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0009560 con 0x7f99d00fea30 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d5dc8640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 0x7f99d0196960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00d6f0 tx=0x7f99cc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99c6ffd640 1 -- 172.21.15.89:0/3152204190 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99cc009a30 con 0x7f99d00fea30 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99c6ffd640 1 -- 172.21.15.89:0/3152204190 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99cc0054e0 con 0x7f99d00fea30 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.481+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d019f9d0 con 0x7f99d00fea30 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.482+0000 7f99c6ffd640 1 -- 172.21.15.89:0/3152204190 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99cc010460 con 0x7f99d00fea30 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.482+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d019fde0 con 0x7f99d00fea30 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.483+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d0100170 con 0x7f99d00fea30 2024-09-13T22:17:48.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.483+0000 7f99c6ffd640 1 -- 172.21.15.89:0/3152204190 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f99cc009b90 con 0x7f99d00fea30 2024-09-13T22:17:48.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.484+0000 7f99c6ffd640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99bc06e5f0 0x7f99bc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:48.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.484+0000 7f99c6ffd640 1 -- 172.21.15.89:0/3152204190 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f99cc08e220 con 0x7f99d00fea30 2024-09-13T22:17:48.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.484+0000 7f99d55c7640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99bc06e5f0 0x7f99bc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:48.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.484+0000 7f99d55c7640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99bc06e5f0 0x7f99bc070ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009230 tx=0x7f99c00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:48.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.488+0000 7f99c6ffd640 1 -- 172.21.15.89:0/3152204190 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f99cc057380 con 0x7f99d00fea30 2024-09-13T22:17:48.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.718+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f99d0068a70 con 0x7f99d00fea30 2024-09-13T22:17:48.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.719+0000 7f99c6ffd640 1 -- 172.21.15.89:0/3152204190 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1931 (secure 0 0 0) 0x7f99cc0177a0 con 0x7f99d00fea30 2024-09-13T22:17:48.721 INFO:teuthology.orchestra.run.smithi089.stdout:e25 2024-09-13T22:17:48.721 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T22:17:44:653771+0000 2024-09-13T22:17:48.721 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:17:48.721 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:17:48.721 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:17:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 24 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:17:39.642388+0000 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:17:48.722 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 95 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=24255} 2024-09-13T22:17:48.723 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 24255 members: 24255 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{0:24255} state up:active seq 170 join_fscid=1 addr [v2:172.21.15.159:6826/2640700709,v1:172.21.15.159:6827/2640700709] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:17:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:17:48.725 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:17:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:17:48.725 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:17:48.725 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6828/246571303,v1:172.21.15.89:6829/246571303] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:17:48.725 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{-1:44291} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/1327575252,v1:172.21.15.159:6825/1327575252] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 25 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.721+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99bc06e5f0 msgr2=0x7f99bc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.721+0000 7f99d802c640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99bc06e5f0 0x7f99bc070ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009230 tx=0x7f99c00058d0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.721+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 msgr2=0x7f99d0196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.721+0000 7f99d802c640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 0x7f99d0196960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00d6f0 tx=0x7f99cc00dbb0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.722+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 shutdown_connections 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.722+0000 7f99d802c640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99bc06e5f0 0x7f99bc070ab0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.722+0000 7f99d802c640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99d0104a30 0x7f99d0196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.722+0000 7f99d802c640 1 --2- 172.21.15.89:0/3152204190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99d00fea30 0x7f99d0196960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.722+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 >> 172.21.15.89:0/3152204190 conn(0x7f99d00fa730 msgr2=0x7f99d00fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.722+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 shutdown_connections 2024-09-13T22:17:48.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.722+0000 7f99d802c640 1 -- 172.21.15.89:0/3152204190 wait complete. 2024-09-13T22:17:48.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:48 smithi089 ceph-mon[109939]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:48.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:48 smithi089 ceph-mon[109939]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:48.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:48 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/264713552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.806+0000 7f929327a640 1 -- 172.21.15.89:0/2931330825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 msgr2=0x7f928c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.806+0000 7f929327a640 1 --2- 172.21.15.89:0/2931330825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 0x7f928c1038d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f927c009880 tx=0x7f927c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.806+0000 7f929327a640 1 -- 172.21.15.89:0/2931330825 shutdown_connections 2024-09-13T22:17:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.806+0000 7f929327a640 1 --2- 172.21.15.89:0/2931330825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 0x7f928c1038d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.806+0000 7f929327a640 1 --2- 172.21.15.89:0/2931330825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0fea50 0x7f928c0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.806+0000 7f929327a640 1 -- 172.21.15.89:0/2931330825 >> 172.21.15.89:0/2931330825 conn(0x7f928c0fa730 msgr2=0x7f928c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.806+0000 7f929327a640 1 -- 172.21.15.89:0/2931330825 shutdown_connections 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.806+0000 7f929327a640 1 -- 172.21.15.89:0/2931330825 wait complete. 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f929327a640 1 Processor -- start 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f929327a640 1 -- start start 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f929327a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0fea50 0x7f928c19c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f929327a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 0x7f928c19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f929327a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c19cc90 con 0x7f928c0ff400 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f929327a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c1a0a00 con 0x7f928c0fea50 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f9290815640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 0x7f928c19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f9290815640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 0x7f928c19c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55162/0 (socket says 172.21.15.89:55162) 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f9290815640 1 -- 172.21.15.89:0/2614650670 learned_addr learned my addr 172.21.15.89:0/2614650670 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f9291016640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0fea50 0x7f928c19c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f9290815640 1 -- 172.21.15.89:0/2614650670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0fea50 msgr2=0x7f928c19c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:48.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f9290815640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0fea50 0x7f928c19c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.807+0000 7f9290815640 1 -- 172.21.15.89:0/2614650670 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009560 con 0x7f928c0ff400 2024-09-13T22:17:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.808+0000 7f9290815640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 0x7f928c19c600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f927c02a9c0 tx=0x7f927c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.808+0000 7f92827fc640 1 -- 172.21.15.89:0/2614650670 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f927c004aa0 con 0x7f928c0ff400 2024-09-13T22:17:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.808+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c1a0c80 con 0x7f928c0ff400 2024-09-13T22:17:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.808+0000 7f92827fc640 1 -- 172.21.15.89:0/2614650670 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f927c004c00 con 0x7f928c0ff400 2024-09-13T22:17:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.808+0000 7f92827fc640 1 -- 172.21.15.89:0/2614650670 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f927c003980 con 0x7f928c0ff400 2024-09-13T22:17:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.808+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c1a1170 con 0x7f928c0ff400 2024-09-13T22:17:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.809+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c068d30 con 0x7f928c0ff400 2024-09-13T22:17:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.809+0000 7f92827fc640 1 -- 172.21.15.89:0/2614650670 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f927c003bf0 con 0x7f928c0ff400 2024-09-13T22:17:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.810+0000 7f92827fc640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f927806e5f0 0x7f9278070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.810+0000 7f92827fc640 1 -- 172.21.15.89:0/2614650670 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f927c0af7b0 con 0x7f928c0ff400 2024-09-13T22:17:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.810+0000 7f9291016640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f927806e5f0 0x7f9278070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.810+0000 7f9291016640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f927806e5f0 0x7f9278070ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9288005fd0 tx=0x7f928800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:48.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.814+0000 7f92827fc640 1 -- 172.21.15.89:0/2614650670 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f927c078890 con 0x7f928c0ff400 2024-09-13T22:17:48.887 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:48 smithi159 ceph-mon[82000]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:48.887 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:48 smithi159 ceph-mon[82000]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:48.888 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:48 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/264713552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:48.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.994+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f928c1133d0 con 0x7f927806e5f0 2024-09-13T22:17:48.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.995+0000 7f92827fc640 1 -- 172.21.15.89:0/2614650670 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f928c1133d0 con 0x7f927806e5f0 2024-09-13T22:17:48.997 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:17:48.997 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:17:48.997 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:17:48.997 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:17:48.997 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:17:48.998 INFO:teuthology.orchestra.run.smithi089.stdout: "osd", 2024-09-13T22:17:48.998 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:17:48.998 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T22:17:48.998 INFO:teuthology.orchestra.run.smithi089.stdout: "crash" 2024-09-13T22:17:48.998 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:17:48.998 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "15/23 daemons upgraded", 2024-09-13T22:17:48.998 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T22:17:48.998 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:17:48.998 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f927806e5f0 msgr2=0x7f9278070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f927806e5f0 0x7f9278070ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9288005fd0 tx=0x7f928800b390 comp rx=0 tx=0).stop 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 msgr2=0x7f928c19c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 0x7f928c19c600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f927c02a9c0 tx=0x7f927c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 shutdown_connections 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f927806e5f0 0x7f9278070ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ff400 0x7f928c19c600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 --2- 172.21.15.89:0/2614650670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f928c0fea50 0x7f928c19c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 >> 172.21.15.89:0/2614650670 conn(0x7f928c0fa730 msgr2=0x7f928c111040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 shutdown_connections 2024-09-13T22:17:49.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:48.997+0000 7f929327a640 1 -- 172.21.15.89:0/2614650670 wait complete. 2024-09-13T22:17:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.077+0000 7fc1e76a1640 1 -- 172.21.15.89:0/661044397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e0105bf0 msgr2=0x7fc1e0105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.077+0000 7fc1e76a1640 1 --2- 172.21.15.89:0/661044397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e0105bf0 0x7fc1e0105fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009880 tx=0x7fc1dc02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 -- 172.21.15.89:0/661044397 shutdown_connections 2024-09-13T22:17:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 --2- 172.21.15.89:0/661044397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e00ffb40 0x7fc1e00fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 --2- 172.21.15.89:0/661044397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e0105bf0 0x7fc1e0105fd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 -- 172.21.15.89:0/661044397 >> 172.21.15.89:0/661044397 conn(0x7fc1e00fb7e0 msgr2=0x7fc1e00fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 -- 172.21.15.89:0/661044397 shutdown_connections 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 -- 172.21.15.89:0/661044397 wait complete. 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 Processor -- start 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 -- start start 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ffb40 0x7fc1e00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.078+0000 7fc1e76a1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e0105bf0 0x7fc1e0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e76a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0073230 con 0x7fc1e00ffb40 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e76a1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00733a0 con 0x7fc1e0105bf0 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e543d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ffb40 0x7fc1e00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e543d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ffb40 0x7fc1e00727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55184/0 (socket says 172.21.15.89:55184) 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e543d640 1 -- 172.21.15.89:0/440179788 learned_addr learned my addr 172.21.15.89:0/440179788 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e4c3c640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e0105bf0 0x7fc1e0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e543d640 1 -- 172.21.15.89:0/440179788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e0105bf0 msgr2=0x7fc1e0072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e543d640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e0105bf0 0x7fc1e0072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e543d640 1 -- 172.21.15.89:0/440179788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc009560 con 0x7fc1e00ffb40 2024-09-13T22:17:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e543d640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ffb40 0x7fc1e00727b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc02a9c0 tx=0x7fc1dc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1d67fc640 1 -- 172.21.15.89:0/440179788 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc004aa0 con 0x7fc1e00ffb40 2024-09-13T22:17:49.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1d67fc640 1 -- 172.21.15.89:0/440179788 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1dc004c00 con 0x7fc1e00ffb40 2024-09-13T22:17:49.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1d67fc640 1 -- 172.21.15.89:0/440179788 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc003980 con 0x7fc1e00ffb40 2024-09-13T22:17:49.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.079+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e0073620 con 0x7fc1e00ffb40 2024-09-13T22:17:49.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.080+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e01a1f50 con 0x7fc1e00ffb40 2024-09-13T22:17:49.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.080+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e01011f0 con 0x7fc1e00ffb40 2024-09-13T22:17:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.082+0000 7fc1d67fc640 1 -- 172.21.15.89:0/440179788 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc1dc003ae0 con 0x7fc1e00ffb40 2024-09-13T22:17:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.082+0000 7fc1d67fc640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc1cc06e5f0 0x7fc1cc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:17:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.082+0000 7fc1d67fc640 1 -- 172.21.15.89:0/440179788 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6703+0+0 (secure 0 0 0) 0x7fc1dc0b0030 con 0x7fc1e00ffb40 2024-09-13T22:17:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.083+0000 7fc1e4c3c640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc1cc06e5f0 0x7fc1cc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:17:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.083+0000 7fc1e4c3c640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc1cc06e5f0 0x7fc1cc070ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0073f30 tx=0x7fc1d000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:17:49.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.086+0000 7fc1d67fc640 1 -- 172.21.15.89:0/440179788 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc1dc079180 con 0x7fc1e00ffb40 2024-09-13T22:17:49.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.317+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc1e00fffa0 con 0x7fc1e00ffb40 2024-09-13T22:17:49.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.317+0000 7fc1d67fc640 1 -- 172.21.15.89:0/440179788 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc1dc07c840 con 0x7fc1e00ffb40 2024-09-13T22:17:49.320 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:17:49.320 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:17:49.320 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:17:49.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.319+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc1cc06e5f0 msgr2=0x7fc1cc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:49.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.319+0000 7fc1e76a1640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc1cc06e5f0 0x7fc1cc070ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0073f30 tx=0x7fc1d000b390 comp rx=0 tx=0).stop 2024-09-13T22:17:49.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.319+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ffb40 msgr2=0x7fc1e00727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:17:49.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.319+0000 7fc1e76a1640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ffb40 0x7fc1e00727b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc02a9c0 tx=0x7fc1dc0055a0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.320+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 shutdown_connections 2024-09-13T22:17:49.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.320+0000 7fc1e76a1640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc1cc06e5f0 0x7fc1cc070ab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.320+0000 7fc1e76a1640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e0105bf0 0x7fc1e0072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.320+0000 7fc1e76a1640 1 --2- 172.21.15.89:0/440179788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ffb40 0x7fc1e00727b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:17:49.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.320+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 >> 172.21.15.89:0/440179788 conn(0x7fc1e00fb7e0 msgr2=0x7fc1e00fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:17:49.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.320+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 shutdown_connections 2024-09-13T22:17:49.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:17:49.320+0000 7fc1e76a1640 1 -- 172.21.15.89:0/440179788 wait complete. 2024-09-13T22:17:49.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:49 smithi089 ceph-mon[109939]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:49.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:49 smithi089 ceph-mon[109939]: pgmap v205: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T22:17:49.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:49 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3152204190' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:17:49.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:49 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/440179788' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:17:50.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:49 smithi159 ceph-mon[82000]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:50.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:49 smithi159 ceph-mon[82000]: pgmap v205: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T22:17:50.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:49 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3152204190' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:17:50.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:49 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/440179788' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:17:50.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:50.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:50.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:50.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:50.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:50.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:50.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:50.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:50.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:50.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:50.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:50 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:50.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:50.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:50 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:17:51.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:51 smithi089 ceph-mon[109939]: pgmap v206: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T22:17:51.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:51.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:17:51.998 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:51 smithi159 ceph-mon[82000]: pgmap v206: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T22:17:51.998 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:51.998 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:17:53.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:52 smithi159 ceph-mon[82000]: Upgrade: Updating mds.cephfs.smithi159.rowsot 2024-09-13T22:17:53.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:52 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:53.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:52 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.rowsot", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:17:53.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:52 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:53.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:52 smithi159 ceph-mon[82000]: Deploying daemon mds.cephfs.smithi159.rowsot on smithi159 2024-09-13T22:17:53.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:52 smithi089 ceph-mon[109939]: Upgrade: Updating mds.cephfs.smithi159.rowsot 2024-09-13T22:17:53.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:52 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:17:53.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:52 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.rowsot", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:17:53.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:52 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:53.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:52 smithi089 ceph-mon[109939]: Deploying daemon mds.cephfs.smithi159.rowsot on smithi159 2024-09-13T22:17:54.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:53 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089[109935]: 2024-09-13T22:17:53.779+0000 7f7beabad640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:17:54.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:53 smithi089 ceph-mon[109939]: pgmap v207: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T22:17:54.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:53 smithi089 ceph-mon[109939]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T22:17:54.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:53 smithi089 ceph-mon[109939]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:17:54.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:53 smithi089 ceph-mon[109939]: osdmap e96: 6 total, 6 up, 6 in 2024-09-13T22:17:54.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:53 smithi089 ceph-mon[109939]: Standby daemon mds.cephfs.smithi089.euhfjz assigned to filesystem cephfs as rank 0 2024-09-13T22:17:54.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:53 smithi089 ceph-mon[109939]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T22:17:54.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:53 smithi089 ceph-mon[109939]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T22:17:54.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:53 smithi089 ceph-mon[109939]: fsmap cephfs:1/1 {0=cephfs.smithi089.euhfjz=up:replay} 2 up:standby 2024-09-13T22:17:54.259 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[91463]: 2024-09-13T22:17:53.803+0000 7f0960144640 -1 bdev(0x5596b2fb8c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 3 2024-09-13T22:17:54.259 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[91463]: 2024-09-13T22:17:53.803+0000 7f095d93f640 -1 bdev(0x5596b2fb8c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-09-13T22:17:54.259 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[91463]: 2024-09-13T22:17:53.804+0000 7f096394b640 -1 bdev(0x5596b2fb8c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 8 2024-09-13T22:17:54.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-mon[82000]: pgmap v207: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T22:17:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-mon[82000]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T22:17:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-mon[82000]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:17:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-mon[82000]: osdmap e96: 6 total, 6 up, 6 in 2024-09-13T22:17:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-mon[82000]: Standby daemon mds.cephfs.smithi089.euhfjz assigned to filesystem cephfs as rank 0 2024-09-13T22:17:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-mon[82000]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T22:17:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-mon[82000]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T22:17:54.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:53 smithi159 ceph-mon[82000]: fsmap cephfs:1/1 {0=cephfs.smithi089.euhfjz=up:replay} 2 up:standby 2024-09-13T22:17:56.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:55 smithi089 ceph-mon[109939]: pgmap v209: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 0 op/s 2024-09-13T22:17:56.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:55 smithi159 ceph-mon[82000]: pgmap v209: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 0 op/s 2024-09-13T22:17:58.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:57 smithi089 ceph-mon[109939]: pgmap v210: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 1 op/s 2024-09-13T22:17:58.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:57 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:17:58.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:57 smithi159 ceph-mon[82000]: pgmap v210: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 1 op/s 2024-09-13T22:17:58.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:57 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:18:00.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:17:59 smithi089 ceph-mon[109939]: pgmap v211: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 1 op/s 2024-09-13T22:18:00.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:17:59 smithi159 ceph-mon[82000]: pgmap v211: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 1 op/s 2024-09-13T22:18:01.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:01 smithi089 ceph-mon[109939]: pgmap v212: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-13T22:18:01.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:01 smithi159 ceph-mon[82000]: pgmap v212: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-13T22:18:02.660 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:02 smithi159 ceph-mon[82000]: reconnect by client.14530 v1:192.168.0.1:0/2270496495 after 0 2024-09-13T22:18:02.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:02 smithi159 ceph-mon[82000]: reconnect by client.24277 v1:192.168.0.1:0/234772953 after 0.000999977 2024-09-13T22:18:02.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:02 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] up:reconnect 2024-09-13T22:18:02.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:02 smithi159 ceph-mon[82000]: fsmap cephfs:1/1 {0=cephfs.smithi089.euhfjz=up:reconnect} 2 up:standby 2024-09-13T22:18:02.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:02 smithi089 ceph-mon[109939]: reconnect by client.14530 v1:192.168.0.1:0/2270496495 after 0 2024-09-13T22:18:02.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:02 smithi089 ceph-mon[109939]: reconnect by client.24277 v1:192.168.0.1:0/234772953 after 0.000999977 2024-09-13T22:18:02.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:02 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] up:reconnect 2024-09-13T22:18:02.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:02 smithi089 ceph-mon[109939]: fsmap cephfs:1/1 {0=cephfs.smithi089.euhfjz=up:reconnect} 2 up:standby 2024-09-13T22:18:03.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:03 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] up:rejoin 2024-09-13T22:18:03.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:03 smithi089 ceph-mon[109939]: fsmap cephfs:1/1 {0=cephfs.smithi089.euhfjz=up:rejoin} 2 up:standby 2024-09-13T22:18:03.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:03 smithi089 ceph-mon[109939]: daemon mds.cephfs.smithi089.euhfjz is now active in filesystem cephfs as rank 0 2024-09-13T22:18:03.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:03 smithi089 ceph-mon[109939]: pgmap v213: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-13T22:18:03.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:03 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] up:rejoin 2024-09-13T22:18:03.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:03 smithi159 ceph-mon[82000]: fsmap cephfs:1/1 {0=cephfs.smithi089.euhfjz=up:rejoin} 2 up:standby 2024-09-13T22:18:03.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:03 smithi159 ceph-mon[82000]: daemon mds.cephfs.smithi089.euhfjz is now active in filesystem cephfs as rank 0 2024-09-13T22:18:03.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:03 smithi159 ceph-mon[82000]: pgmap v213: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-13T22:18:04.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:04 smithi159 ceph-mon[82000]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T22:18:04.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:04 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] up:active 2024-09-13T22:18:04.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:04 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 2 up:standby 2024-09-13T22:18:04.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:04 smithi089 ceph-mon[109939]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T22:18:04.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:04 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] up:active 2024-09-13T22:18:04.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:04 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 2 up:standby 2024-09-13T22:18:05.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:05 smithi089 ceph-mon[109939]: pgmap v214: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 188 B/s wr, 9 op/s 2024-09-13T22:18:05.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:05 smithi159 ceph-mon[82000]: pgmap v214: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 188 B/s wr, 9 op/s 2024-09-13T22:18:06.911 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:06.911 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:06.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:06.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:06 smithi159 ceph-mon[82000]: mds.? [v2:172.21.15.159:6826/916810058,v1:172.21.15.159:6827/916810058] up:boot 2024-09-13T22:18:06.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:06 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:18:06.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:18:06.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:06.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:06.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:06.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:06 smithi089 ceph-mon[109939]: mds.? [v2:172.21.15.159:6826/916810058,v1:172.21.15.159:6827/916810058] up:boot 2024-09-13T22:18:06.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:06 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:18:06.998 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:18:07.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:07 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:18:07.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:07 smithi159 ceph-mon[82000]: pgmap v215: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-13T22:18:07.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:07 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:18:07.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:07 smithi089 ceph-mon[109939]: pgmap v215: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-13T22:18:09.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:09 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:09 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:09 smithi089 ceph-mon[109939]: pgmap v216: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-13T22:18:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:09 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:09.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:09 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:09 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:09 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:09 smithi159 ceph-mon[82000]: pgmap v216: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-13T22:18:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:09 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:09.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:09 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:11.902 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:11 smithi159 ceph-mon[82000]: pgmap v217: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-13T22:18:11.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:11 smithi089 ceph-mon[109939]: pgmap v217: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-13T22:18:13.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:13.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:13.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:13.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:13.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all mds 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.egpifu"}]': finished 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:18:13.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.euhfjz"}]': finished 2024-09-13T22:18:13.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:18:13.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.hqlvpx"}]': finished 2024-09-13T22:18:13.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:18:13.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.rowsot"}]': finished 2024-09-13T22:18:13.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T22:18:13.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T22:18:13.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:12 smithi089 ceph-mon[109939]: pgmap v218: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-13T22:18:13.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:13.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:13.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all mds 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.egpifu"}]: dispatch 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.egpifu"}]': finished 2024-09-13T22:18:13.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.euhfjz"}]: dispatch 2024-09-13T22:18:13.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.euhfjz"}]': finished 2024-09-13T22:18:13.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.hqlvpx"}]: dispatch 2024-09-13T22:18:13.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.hqlvpx"}]': finished 2024-09-13T22:18:13.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.rowsot"}]: dispatch 2024-09-13T22:18:13.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.rowsot"}]': finished 2024-09-13T22:18:13.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T22:18:13.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T22:18:13.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:12 smithi159 ceph-mon[82000]: pgmap v218: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-13T22:18:14.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T22:18:14.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:14 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:18:14.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:14.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:14 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all rgw 2024-09-13T22:18:14.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:14.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:14.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:14 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T22:18:14.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:14.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:14 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:14.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T22:18:14.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:14 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:18:14.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:14.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:14 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all rgw 2024-09-13T22:18:14.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:14.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:14.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:14 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T22:18:14.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:14.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:14 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:15.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:15 smithi089 ceph-mon[109939]: pgmap v219: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-13T22:18:15.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:15 smithi159 ceph-mon[82000]: pgmap v219: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-13T22:18:17.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:17 smithi089 ceph-mon[109939]: pgmap v220: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-09-13T22:18:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:17 smithi159 ceph-mon[82000]: pgmap v220: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-09-13T22:18:19.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.405+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/1276503161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 msgr2=0x7f1b981047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.405+0000 7f1b9cd2c640 1 --2- 172.21.15.89:0/1276503161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 0x7f1b981047a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c009880 tx=0x7f1b8c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.405+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/1276503161 shutdown_connections 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.405+0000 7f1b9cd2c640 1 --2- 172.21.15.89:0/1276503161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 0x7f1b981047a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.405+0000 7f1b9cd2c640 1 --2- 172.21.15.89:0/1276503161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b980ffda0 0x7f1b98100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.405+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/1276503161 >> 172.21.15.89:0/1276503161 conn(0x7f1b980fb840 msgr2=0x7f1b980fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.405+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/1276503161 shutdown_connections 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.405+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/1276503161 wait complete. 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b9cd2c640 1 Processor -- start 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b9cd2c640 1 -- start start 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b9cd2c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b980ffda0 0x7f1b9819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b9cd2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 0x7f1b9819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b9cd2c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9819c480 con 0x7f1b98100750 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b9cd2c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98195a10 con 0x7f1b980ffda0 2024-09-13T22:18:19.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b95d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 0x7f1b9819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b95d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 0x7f1b9819be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59242/0 (socket says 172.21.15.89:59242) 2024-09-13T22:18:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b95d9b640 1 -- 172.21.15.89:0/939025982 learned_addr learned my addr 172.21.15.89:0/939025982 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.406+0000 7f1b9659c640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b980ffda0 0x7f1b9819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.407+0000 7f1b95d9b640 1 -- 172.21.15.89:0/939025982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b980ffda0 msgr2=0x7f1b9819b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.407+0000 7f1b95d9b640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b980ffda0 0x7f1b9819b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.407+0000 7f1b95d9b640 1 -- 172.21.15.89:0/939025982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c009560 con 0x7f1b98100750 2024-09-13T22:18:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.407+0000 7f1b95d9b640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 0x7f1b9819be60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c02a9c0 tx=0x7f1b8c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:19.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.407+0000 7f1b877fe640 1 -- 172.21.15.89:0/939025982 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b8c004aa0 con 0x7f1b98100750 2024-09-13T22:18:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.407+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b98195c90 con 0x7f1b98100750 2024-09-13T22:18:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.407+0000 7f1b877fe640 1 -- 172.21.15.89:0/939025982 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b8c004c00 con 0x7f1b98100750 2024-09-13T22:18:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.407+0000 7f1b877fe640 1 -- 172.21.15.89:0/939025982 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b8c003ab0 con 0x7f1b98100750 2024-09-13T22:18:19.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.407+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b98196180 con 0x7f1b98100750 2024-09-13T22:18:19.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.408+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b98101280 con 0x7f1b98100750 2024-09-13T22:18:19.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.408+0000 7f1b877fe640 1 -- 172.21.15.89:0/939025982 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1b8c003ce0 con 0x7f1b98100750 2024-09-13T22:18:19.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.409+0000 7f1b877fe640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1b8006e5f0 0x7f1b80070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:19.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.409+0000 7f1b9659c640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1b8006e5f0 0x7f1b80070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:19.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.409+0000 7f1b877fe640 1 -- 172.21.15.89:0/939025982 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f1b8c0af910 con 0x7f1b98100750 2024-09-13T22:18:19.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.410+0000 7f1b9659c640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1b8006e5f0 0x7f1b80070ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009890 tx=0x7f1b88008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:19.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.414+0000 7f1b877fe640 1 -- 172.21.15.89:0/939025982 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1b8c0788e0 con 0x7f1b98100750 2024-09-13T22:18:19.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.598+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b9810ce30 con 0x7f1b8006e5f0 2024-09-13T22:18:19.599 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:19 smithi089 ceph-mon[109939]: Upgrade: Updating ceph-exporter.smithi089 (1/2) 2024-09-13T22:18:19.599 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:19 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:19.599 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:19 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:18:19.599 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:19 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:19.599 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:19 smithi089 ceph-mon[109939]: Deploying daemon ceph-exporter.smithi089 on smithi089 2024-09-13T22:18:19.599 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:19 smithi089 ceph-mon[109939]: pgmap v221: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-13T22:18:19.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.599+0000 7f1b877fe640 1 -- 172.21.15.89:0/939025982 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f1b9810ce30 con 0x7f1b8006e5f0 2024-09-13T22:18:19.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1b8006e5f0 msgr2=0x7f1b80070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1b8006e5f0 0x7f1b80070ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009890 tx=0x7f1b88008040 comp rx=0 tx=0).stop 2024-09-13T22:18:19.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 msgr2=0x7f1b9819be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 0x7f1b9819be60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c02a9c0 tx=0x7f1b8c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 shutdown_connections 2024-09-13T22:18:19.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1b8006e5f0 0x7f1b80070ab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b98100750 0x7f1b9819be60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 --2- 172.21.15.89:0/939025982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b980ffda0 0x7f1b9819b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 >> 172.21.15.89:0/939025982 conn(0x7f1b980fb840 msgr2=0x7f1b980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:19.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 shutdown_connections 2024-09-13T22:18:19.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.601+0000 7f1b9cd2c640 1 -- 172.21.15.89:0/939025982 wait complete. 2024-09-13T22:18:19.610 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.683+0000 7fa64e4b2640 1 -- 172.21.15.89:0/1244900805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 msgr2=0x7fa6480fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.683+0000 7fa64e4b2640 1 --2- 172.21.15.89:0/1244900805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 0x7fa6480fee50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009880 tx=0x7fa63c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.684+0000 7fa64e4b2640 1 -- 172.21.15.89:0/1244900805 shutdown_connections 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.684+0000 7fa64e4b2640 1 --2- 172.21.15.89:0/1244900805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 0x7fa6480fee50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.684+0000 7fa64e4b2640 1 --2- 172.21.15.89:0/1244900805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6481049f0 0x7fa648104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.684+0000 7fa64e4b2640 1 -- 172.21.15.89:0/1244900805 >> 172.21.15.89:0/1244900805 conn(0x7fa6480758a0 msgr2=0x7fa6480fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.684+0000 7fa64e4b2640 1 -- 172.21.15.89:0/1244900805 shutdown_connections 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.684+0000 7fa64e4b2640 1 -- 172.21.15.89:0/1244900805 wait complete. 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.684+0000 7fa64e4b2640 1 Processor -- start 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.684+0000 7fa64e4b2640 1 -- start start 2024-09-13T22:18:19.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa64e4b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 0x7fa64819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa64e4b2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6481049f0 0x7fa64819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa64e4b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64819c4a0 con 0x7fa6480fe9f0 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa64e4b2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648195970 con 0x7fa6481049f0 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa647fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 0x7fa64819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa647fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 0x7fa64819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59262/0 (socket says 172.21.15.89:59262) 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa647fff640 1 -- 172.21.15.89:0/2902690492 learned_addr learned my addr 172.21.15.89:0/2902690492 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa6477fe640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6481049f0 0x7fa64819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa647fff640 1 -- 172.21.15.89:0/2902690492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6481049f0 msgr2=0x7fa64819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa647fff640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6481049f0 0x7fa64819be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa647fff640 1 -- 172.21.15.89:0/2902690492 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c009560 con 0x7fa6480fe9f0 2024-09-13T22:18:19.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa647fff640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 0x7fa64819b910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa63800c8a0 tx=0x7fa63800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:19.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa6457fa640 1 -- 172.21.15.89:0/2902690492 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa638007b80 con 0x7fa6480fe9f0 2024-09-13T22:18:19.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa6457fa640 1 -- 172.21.15.89:0/2902690492 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa638007ce0 con 0x7fa6480fe9f0 2024-09-13T22:18:19.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa648195c50 con 0x7fa6480fe9f0 2024-09-13T22:18:19.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa6457fa640 1 -- 172.21.15.89:0/2902690492 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa638018810 con 0x7fa6480fe9f0 2024-09-13T22:18:19.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.685+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa648196170 con 0x7fa6480fe9f0 2024-09-13T22:18:19.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.687+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa648100130 con 0x7fa6480fe9f0 2024-09-13T22:18:19.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.687+0000 7fa6457fa640 1 -- 172.21.15.89:0/2902690492 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa63800f450 con 0x7fa6480fe9f0 2024-09-13T22:18:19.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.687+0000 7fa6457fa640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa63006e5f0 0x7fa630070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:19.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.687+0000 7fa6457fa640 1 -- 172.21.15.89:0/2902690492 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fa63808ea30 con 0x7fa6480fe9f0 2024-09-13T22:18:19.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.687+0000 7fa6477fe640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa63006e5f0 0x7fa630070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:19.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.688+0000 7fa6477fe640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa63006e5f0 0x7fa630070ab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa63c000c00 tx=0x7fa63c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:19.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.692+0000 7fa6457fa640 1 -- 172.21.15.89:0/2902690492 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa638057a00 con 0x7fa6480fe9f0 2024-09-13T22:18:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:19 smithi159 ceph-mon[82000]: Upgrade: Updating ceph-exporter.smithi089 (1/2) 2024-09-13T22:18:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:19 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:19 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:18:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:19 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:19 smithi159 ceph-mon[82000]: Deploying daemon ceph-exporter.smithi089 on smithi089 2024-09-13T22:18:19.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:19 smithi159 ceph-mon[82000]: pgmap v221: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-13T22:18:19.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.889+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa64810bc60 con 0x7fa63006e5f0 2024-09-13T22:18:19.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.890+0000 7fa6457fa640 1 -- 172.21.15.89:0/2902690492 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fa64810bc60 con 0x7fa63006e5f0 2024-09-13T22:18:19.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.892+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa63006e5f0 msgr2=0x7fa630070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.892+0000 7fa64e4b2640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa63006e5f0 0x7fa630070ab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa63c000c00 tx=0x7fa63c005a20 comp rx=0 tx=0).stop 2024-09-13T22:18:19.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.892+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 msgr2=0x7fa64819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.892+0000 7fa64e4b2640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 0x7fa64819b910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa63800c8a0 tx=0x7fa63800cd60 comp rx=0 tx=0).stop 2024-09-13T22:18:19.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.893+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 shutdown_connections 2024-09-13T22:18:19.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.893+0000 7fa64e4b2640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa63006e5f0 0x7fa630070ab0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.893+0000 7fa64e4b2640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6481049f0 0x7fa64819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.893+0000 7fa64e4b2640 1 --2- 172.21.15.89:0/2902690492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6480fe9f0 0x7fa64819b910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.893+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 >> 172.21.15.89:0/2902690492 conn(0x7fa6480758a0 msgr2=0x7fa6480fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:19.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.893+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 shutdown_connections 2024-09-13T22:18:19.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.893+0000 7fa64e4b2640 1 -- 172.21.15.89:0/2902690492 wait complete. 2024-09-13T22:18:19.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.974+0000 7fb12a7df640 1 -- 172.21.15.89:0/1774965976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 msgr2=0x7fb124109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.974+0000 7fb12a7df640 1 --2- 172.21.15.89:0/1774965976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 0x7fb124109ac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009880 tx=0x7fb10c02a530 comp rx=0 tx=0).stop 2024-09-13T22:18:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.974+0000 7fb12a7df640 1 -- 172.21.15.89:0/1774965976 shutdown_connections 2024-09-13T22:18:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.974+0000 7fb12a7df640 1 --2- 172.21.15.89:0/1774965976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 0x7fb124109ac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.974+0000 7fb12a7df640 1 --2- 172.21.15.89:0/1774965976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb124100cb0 0x7fb124101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.974+0000 7fb12a7df640 1 -- 172.21.15.89:0/1774965976 >> 172.21.15.89:0/1774965976 conn(0x7fb1240758a0 msgr2=0x7fb1240fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.974+0000 7fb12a7df640 1 -- 172.21.15.89:0/1774965976 shutdown_connections 2024-09-13T22:18:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.974+0000 7fb12a7df640 1 -- 172.21.15.89:0/1774965976 wait complete. 2024-09-13T22:18:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.975+0000 7fb12a7df640 1 Processor -- start 2024-09-13T22:18:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.975+0000 7fb12a7df640 1 -- start start 2024-09-13T22:18:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.975+0000 7fb12a7df640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb124100cb0 0x7fb12419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.975+0000 7fb12a7df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 0x7fb12419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.975+0000 7fb12a7df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12419c4b0 con 0x7fb1241015d0 2024-09-13T22:18:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.975+0000 7fb12a7df640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb124195a40 con 0x7fb124100cb0 2024-09-13T22:18:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.975+0000 7fb1237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 0x7fb12419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.975+0000 7fb1237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 0x7fb12419be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59268/0 (socket says 172.21.15.89:59268) 2024-09-13T22:18:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.975+0000 7fb1237fe640 1 -- 172.21.15.89:0/4110038134 learned_addr learned my addr 172.21.15.89:0/4110038134 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb123fff640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb124100cb0 0x7fb12419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb1237fe640 1 -- 172.21.15.89:0/4110038134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb124100cb0 msgr2=0x7fb12419b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb1237fe640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb124100cb0 0x7fb12419b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb1237fe640 1 -- 172.21.15.89:0/4110038134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c009560 con 0x7fb1241015d0 2024-09-13T22:18:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb123fff640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb124100cb0 0x7fb12419b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:18:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb1237fe640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 0x7fb12419be90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb10c02aa50 tx=0x7fb10c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb1217fa640 1 -- 172.21.15.89:0/4110038134 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c004aa0 con 0x7fb1241015d0 2024-09-13T22:18:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb124195cc0 con 0x7fb1241015d0 2024-09-13T22:18:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb1217fa640 1 -- 172.21.15.89:0/4110038134 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb10c004c00 con 0x7fb1241015d0 2024-09-13T22:18:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb1217fa640 1 -- 172.21.15.89:0/4110038134 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c0039b0 con 0x7fb1241015d0 2024-09-13T22:18:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.976+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1241961b0 con 0x7fb1241015d0 2024-09-13T22:18:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.977+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb124068510 con 0x7fb1241015d0 2024-09-13T22:18:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.978+0000 7fb1217fa640 1 -- 172.21.15.89:0/4110038134 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb10c02ad50 con 0x7fb1241015d0 2024-09-13T22:18:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.978+0000 7fb1217fa640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb11006e5f0 0x7fb110070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.978+0000 7fb1217fa640 1 -- 172.21.15.89:0/4110038134 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fb10c0af6c0 con 0x7fb1241015d0 2024-09-13T22:18:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.979+0000 7fb123fff640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb11006e5f0 0x7fb110070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.979+0000 7fb123fff640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb11006e5f0 0x7fb110070ab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb114009930 tx=0x7fb114008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:19.983+0000 7fb1217fa640 1 -- 172.21.15.89:0/4110038134 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb10c078690 con 0x7fb1241015d0 2024-09-13T22:18:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.202+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb12410ce00 con 0x7fb11006e5f0 2024-09-13T22:18:20.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.214+0000 7fb1217fa640 1 -- 172.21.15.89:0/4110038134 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fb12410ce00 con 0x7fb11006e5f0 2024-09-13T22:18:20.216 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:18:20.216 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (7m) 57s ago 17m 25.3M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:18:20.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (17m) 57s ago 17m 9072k - 18.2.4-845-ge4e227b3 67ddd33fa72f 7f7cd3ee023b 2024-09-13T22:18:20.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (16m) 11s ago 16m 9277k - 18.2.4-845-ge4e227b3 67ddd33fa72f eb7b8eddac05 2024-09-13T22:18:20.216 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (4m) 57s ago 17m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:18:20.216 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (4m) 11s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:18:20.216 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (6m) 57s ago 17m 82.1M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:18:20.216 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (62s) 57s ago 11m 12.9M - 19.1.1-324-gecab7be5 0652ff2b5d78 8e7c4b78b682 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (79s) 57s ago 11m 13.8M - 19.1.1-324-gecab7be5 0652ff2b5d78 007f4687420d 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (36s) 11s ago 11m 16.2M - 19.1.1-324-gecab7be5 0652ff2b5d78 6795ed6657dc 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (15s) 11s ago 11m 13.2M - 19.1.1-324-gecab7be5 0652ff2b5d78 1301e4cf3709 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (8m) 57s ago 18m 505M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (7m) 11s ago 16m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (5m) 57s ago 18m 53.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (5m) 11s ago 16m 42.9M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 57s ago 17m 15.1M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (7m) 11s ago 16m 15.8M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (4m) 57s ago 15m 163M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (3m) 57s ago 15m 138M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 3d2a1d778a36 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (3m) 57s ago 14m 133M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 ffb294d5c14f 2024-09-13T22:18:20.217 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (2m) 11s ago 14m 141M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 6724e7895aeb 2024-09-13T22:18:20.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (2m) 11s ago 13m 98.5M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 18175379d0ae 2024-09-13T22:18:20.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (94s) 11s ago 13m 106M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 c11707471acc 2024-09-13T22:18:20.218 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (7m) 57s ago 17m 66.0M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:18:20.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.216+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb11006e5f0 msgr2=0x7fb110070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.216+0000 7fb12a7df640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb11006e5f0 0x7fb110070ab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb114009930 tx=0x7fb114008040 comp rx=0 tx=0).stop 2024-09-13T22:18:20.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.216+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 msgr2=0x7fb12419be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.216+0000 7fb12a7df640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 0x7fb12419be90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb10c02aa50 tx=0x7fb10c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.217+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 shutdown_connections 2024-09-13T22:18:20.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.217+0000 7fb12a7df640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb11006e5f0 0x7fb110070ab0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.217+0000 7fb12a7df640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1241015d0 0x7fb12419be90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.217+0000 7fb12a7df640 1 --2- 172.21.15.89:0/4110038134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb124100cb0 0x7fb12419b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.217+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 >> 172.21.15.89:0/4110038134 conn(0x7fb1240758a0 msgr2=0x7fb124101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:20.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.217+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 shutdown_connections 2024-09-13T22:18:20.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.217+0000 7fb12a7df640 1 -- 172.21.15.89:0/4110038134 wait complete. 2024-09-13T22:18:20.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.300+0000 7f1940bbd640 1 -- 172.21.15.89:0/4284763615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 msgr2=0x7f193c0fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.300+0000 7f1940bbd640 1 --2- 172.21.15.89:0/4284763615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 0x7f193c0fee70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1930009880 tx=0x7f193002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.300+0000 7f1940bbd640 1 -- 172.21.15.89:0/4284763615 shutdown_connections 2024-09-13T22:18:20.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.300+0000 7f1940bbd640 1 --2- 172.21.15.89:0/4284763615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 0x7f193c0fee70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.300+0000 7f1940bbd640 1 --2- 172.21.15.89:0/4284763615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c104a10 0x7f193c104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.300+0000 7f1940bbd640 1 -- 172.21.15.89:0/4284763615 >> 172.21.15.89:0/4284763615 conn(0x7f193c0fa730 msgr2=0x7f193c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:20.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.300+0000 7f1940bbd640 1 -- 172.21.15.89:0/4284763615 shutdown_connections 2024-09-13T22:18:20.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.300+0000 7f1940bbd640 1 -- 172.21.15.89:0/4284763615 wait complete. 2024-09-13T22:18:20.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.301+0000 7f1940bbd640 1 Processor -- start 2024-09-13T22:18:20.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.301+0000 7f1940bbd640 1 -- start start 2024-09-13T22:18:20.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.301+0000 7f1940bbd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 0x7f193c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:20.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.301+0000 7f1940bbd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c104a10 0x7f193c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:20.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.301+0000 7f1940bbd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c19c2f0 con 0x7f193c0fea10 2024-09-13T22:18:20.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.301+0000 7f1940bbd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c195910 con 0x7f193c104a10 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.301+0000 7f193a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 0x7f193c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.301+0000 7f193a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 0x7f193c19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59280/0 (socket says 172.21.15.89:59280) 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.301+0000 7f193a59c640 1 -- 172.21.15.89:0/4006327326 learned_addr learned my addr 172.21.15.89:0/4006327326 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.302+0000 7f193a59c640 1 -- 172.21.15.89:0/4006327326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c104a10 msgr2=0x7f193c19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.302+0000 7f193a59c640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c104a10 0x7f193c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.302+0000 7f193a59c640 1 -- 172.21.15.89:0/4006327326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930009560 con 0x7f193c0fea10 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.302+0000 7f193a59c640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 0x7f193c19b820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c8a0 tx=0x7f192c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.302+0000 7f192b7fe640 1 -- 172.21.15.89:0/4006327326 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f192c007b80 con 0x7f193c0fea10 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.302+0000 7f192b7fe640 1 -- 172.21.15.89:0/4006327326 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f192c007ce0 con 0x7f193c0fea10 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.302+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c195bf0 con 0x7f193c0fea10 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.302+0000 7f192b7fe640 1 -- 172.21.15.89:0/4006327326 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f192c018810 con 0x7f193c0fea10 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.302+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c196140 con 0x7f193c0fea10 2024-09-13T22:18:20.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.303+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c100150 con 0x7f193c0fea10 2024-09-13T22:18:20.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.304+0000 7f192b7fe640 1 -- 172.21.15.89:0/4006327326 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f192c018a80 con 0x7f193c0fea10 2024-09-13T22:18:20.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.304+0000 7f192b7fe640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f192406e5f0 0x7f1924070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:20.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.304+0000 7f192b7fe640 1 -- 172.21.15.89:0/4006327326 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f192c08ea50 con 0x7f193c0fea10 2024-09-13T22:18:20.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.304+0000 7f1939d9b640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f192406e5f0 0x7f1924070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:20.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.304+0000 7f1939d9b640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f192406e5f0 0x7f1924070ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f193c196d80 tx=0x7f1930000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:20.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.308+0000 7f192b7fe640 1 -- 172.21.15.89:0/4006327326 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f192c057a20 con 0x7f193c0fea10 2024-09-13T22:18:20.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:20 smithi089 ceph-mon[109939]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:20.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.547+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f193c107fb0 con 0x7f193c0fea10 2024-09-13T22:18:20.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.548+0000 7f192b7fe640 1 -- 172.21.15.89:0/4006327326 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f192c05b0e0 con 0x7f193c0fea10 2024-09-13T22:18:20.549 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:18:20.549 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:18:20.549 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:18:20.550 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:18:20.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f192406e5f0 msgr2=0x7f1924070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f192406e5f0 0x7f1924070ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f193c196d80 tx=0x7f1930000bc0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 msgr2=0x7f193c19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 0x7f193c19b820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c8a0 tx=0x7f192c00cd60 comp rx=0 tx=0).stop 2024-09-13T22:18:20.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 shutdown_connections 2024-09-13T22:18:20.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f192406e5f0 0x7f1924070ab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f193c104a10 0x7f193c19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 --2- 172.21.15.89:0/4006327326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193c0fea10 0x7f193c19b820 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 >> 172.21.15.89:0/4006327326 conn(0x7f193c0fa730 msgr2=0x7f193c068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:20.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 shutdown_connections 2024-09-13T22:18:20.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.550+0000 7f1940bbd640 1 -- 172.21.15.89:0/4006327326 wait complete. 2024-09-13T22:18:20.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.632+0000 7f803c85f640 1 -- 172.21.15.89:0/3427592989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80380ffb40 msgr2=0x7f80380fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.632+0000 7f803c85f640 1 --2- 172.21.15.89:0/3427592989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80380ffb40 0x7f80380fffa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f802c009880 tx=0x7f802c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.632+0000 7f803c85f640 1 -- 172.21.15.89:0/3427592989 shutdown_connections 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.632+0000 7f803c85f640 1 --2- 172.21.15.89:0/3427592989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80380ffb40 0x7f80380fffa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.632+0000 7f803c85f640 1 --2- 172.21.15.89:0/3427592989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8038105bf0 0x7f8038105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.632+0000 7f803c85f640 1 -- 172.21.15.89:0/3427592989 >> 172.21.15.89:0/3427592989 conn(0x7f80380fb7e0 msgr2=0x7f80380fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.632+0000 7f803c85f640 1 -- 172.21.15.89:0/3427592989 shutdown_connections 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.632+0000 7f803c85f640 1 -- 172.21.15.89:0/3427592989 wait complete. 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f803c85f640 1 Processor -- start 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f803c85f640 1 -- start start 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f803c85f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380ffb40 0x7f803819b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f803c85f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8038105bf0 0x7f803819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:20.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f803c85f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803819c300 con 0x7f8038105bf0 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f803c85f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8038195890 con 0x7f80380ffb40 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f8035d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8038105bf0 0x7f803819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f8035d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8038105bf0 0x7f803819bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59290/0 (socket says 172.21.15.89:59290) 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f8035d9b640 1 -- 172.21.15.89:0/3783736065 learned_addr learned my addr 172.21.15.89:0/3783736065 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.633+0000 7f803659c640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380ffb40 0x7f803819b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.634+0000 7f8035d9b640 1 -- 172.21.15.89:0/3783736065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380ffb40 msgr2=0x7f803819b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.634+0000 7f8035d9b640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380ffb40 0x7f803819b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.634+0000 7f8035d9b640 1 -- 172.21.15.89:0/3783736065 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c009560 con 0x7f8038105bf0 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.634+0000 7f8035d9b640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8038105bf0 0x7f803819bce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f802c02a9c0 tx=0x7f802c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.634+0000 7f80277fe640 1 -- 172.21.15.89:0/3783736065 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f802c004aa0 con 0x7f8038105bf0 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.634+0000 7f80277fe640 1 -- 172.21.15.89:0/3783736065 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f802c004c00 con 0x7f8038105bf0 2024-09-13T22:18:20.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.634+0000 7f80277fe640 1 -- 172.21.15.89:0/3783736065 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f802c003980 con 0x7f8038105bf0 2024-09-13T22:18:20.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.634+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8038195b10 con 0x7f8038105bf0 2024-09-13T22:18:20.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.634+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8038196080 con 0x7f8038105bf0 2024-09-13T22:18:20.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.635+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80381011f0 con 0x7f8038105bf0 2024-09-13T22:18:20.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.635+0000 7f80277fe640 1 -- 172.21.15.89:0/3783736065 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f802c003bf0 con 0x7f8038105bf0 2024-09-13T22:18:20.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.636+0000 7f80277fe640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f802006e5f0 0x7f8020070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:20.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.636+0000 7f80277fe640 1 -- 172.21.15.89:0/3783736065 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f802c0af8f0 con 0x7f8038105bf0 2024-09-13T22:18:20.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.636+0000 7f803659c640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f802006e5f0 0x7f8020070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:20.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.636+0000 7f803659c640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f802006e5f0 0x7f8020070ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8028005fd0 tx=0x7f8028005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:20.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.641+0000 7f80277fe640 1 -- 172.21.15.89:0/3783736065 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f802c0789a0 con 0x7f8038105bf0 2024-09-13T22:18:20.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:20 smithi159 ceph-mon[82000]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:20.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.872+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8038108010 con 0x7f8038105bf0 2024-09-13T22:18:20.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.872+0000 7f80277fe640 1 -- 172.21.15.89:0/3783736065 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1973 (secure 0 0 0) 0x7f802c07c060 con 0x7f8038105bf0 2024-09-13T22:18:20.873 INFO:teuthology.orchestra.run.smithi089.stdout:e32 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T22:18:13:096272+0000 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 32 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:18:12.099018+0000 2024-09-13T22:18:20.874 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 96 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=34374} 2024-09-13T22:18:20.875 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 34374 members: 34374 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{0:34374} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:18:20.876 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:18:20.877 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:18:20.877 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:18:20.877 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6828/246571303,v1:172.21.15.89:6829/246571303] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:18:20.877 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{-1:44291} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/1327575252,v1:172.21.15.159:6825/1327575252] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:18:20.877 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/916810058,v1:172.21.15.159:6827/916810058] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:18:20.877 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 32 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f802006e5f0 msgr2=0x7f8020070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f802006e5f0 0x7f8020070ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8028005fd0 tx=0x7f8028005850 comp rx=0 tx=0).stop 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8038105bf0 msgr2=0x7f803819bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8038105bf0 0x7f803819bce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f802c02a9c0 tx=0x7f802c0055a0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 shutdown_connections 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f802006e5f0 0x7f8020070ab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8038105bf0 0x7f803819bce0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 --2- 172.21.15.89:0/3783736065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80380ffb40 0x7f803819b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 >> 172.21.15.89:0/3783736065 conn(0x7f80380fb7e0 msgr2=0x7f80380fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.875+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 shutdown_connections 2024-09-13T22:18:20.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.876+0000 7f803c85f640 1 -- 172.21.15.89:0/3783736065 wait complete. 2024-09-13T22:18:20.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.958+0000 7fc5973ee640 1 -- 172.21.15.89:0/1947824480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5900ffda0 msgr2=0x7fc590100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.958+0000 7fc5973ee640 1 --2- 172.21.15.89:0/1947824480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5900ffda0 0x7fc590100180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc580009880 tx=0x7fc58002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.958+0000 7fc5973ee640 1 -- 172.21.15.89:0/1947824480 shutdown_connections 2024-09-13T22:18:20.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.958+0000 7fc5973ee640 1 --2- 172.21.15.89:0/1947824480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc590100750 0x7fc5901047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.958+0000 7fc5973ee640 1 --2- 172.21.15.89:0/1947824480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5900ffda0 0x7fc590100180 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.958+0000 7fc5973ee640 1 -- 172.21.15.89:0/1947824480 >> 172.21.15.89:0/1947824480 conn(0x7fc5900fb840 msgr2=0x7fc5900fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.958+0000 7fc5973ee640 1 -- 172.21.15.89:0/1947824480 shutdown_connections 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.958+0000 7fc5973ee640 1 -- 172.21.15.89:0/1947824480 wait complete. 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc5973ee640 1 Processor -- start 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc5973ee640 1 -- start start 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc5973ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5900ffda0 0x7fc59019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc5973ee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590100750 0x7fc59019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc5973ee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59019c360 con 0x7fc590100750 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc5973ee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5901958f0 con 0x7fc5900ffda0 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc594989640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590100750 0x7fc59019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc594989640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590100750 0x7fc59019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59298/0 (socket says 172.21.15.89:59298) 2024-09-13T22:18:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc594989640 1 -- 172.21.15.89:0/231628851 learned_addr learned my addr 172.21.15.89:0/231628851 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc59518a640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5900ffda0 0x7fc59019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc594989640 1 -- 172.21.15.89:0/231628851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5900ffda0 msgr2=0x7fc59019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc594989640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5900ffda0 0x7fc59019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc594989640 1 -- 172.21.15.89:0/231628851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580009560 con 0x7fc590100750 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.959+0000 7fc59518a640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5900ffda0 0x7fc59019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.960+0000 7fc594989640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590100750 0x7fc59019bd40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00c810 tx=0x7fc58c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.960+0000 7fc5867fc640 1 -- 172.21.15.89:0/231628851 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc58c0041f0 con 0x7fc590100750 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.960+0000 7fc5867fc640 1 -- 172.21.15.89:0/231628851 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc58c007e70 con 0x7fc590100750 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.960+0000 7fc5867fc640 1 -- 172.21.15.89:0/231628851 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc58c0049d0 con 0x7fc590100750 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.960+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc590195bd0 con 0x7fc590100750 2024-09-13T22:18:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.960+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc590196120 con 0x7fc590100750 2024-09-13T22:18:20.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.961+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc590101280 con 0x7fc590100750 2024-09-13T22:18:20.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.961+0000 7fc5867fc640 1 -- 172.21.15.89:0/231628851 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc58c0079b0 con 0x7fc590100750 2024-09-13T22:18:20.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.962+0000 7fc5867fc640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc57c06e5f0 0x7fc57c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:20.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.962+0000 7fc59518a640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc57c06e5f0 0x7fc57c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:20.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.962+0000 7fc5867fc640 1 -- 172.21.15.89:0/231628851 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fc58c08e5b0 con 0x7fc590100750 2024-09-13T22:18:20.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.962+0000 7fc59518a640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc57c06e5f0 0x7fc57c070ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc580000c00 tx=0x7fc580005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:20.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:20.966+0000 7fc5867fc640 1 -- 172.21.15.89:0/231628851 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc58c057600 con 0x7fc590100750 2024-09-13T22:18:21.173 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:18:21.173 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:18:21.173 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T22:18:21.173 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:18:21.173 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T22:18:21.173 INFO:teuthology.orchestra.run.smithi089.stdout: "osd", 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stdout: "mds" 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "16/23 daemons upgraded", 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.169+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc59010cdb0 con 0x7fc57c06e5f0 2024-09-13T22:18:21.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.171+0000 7fc5867fc640 1 -- 172.21.15.89:0/231628851 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fc59010cdb0 con 0x7fc57c06e5f0 2024-09-13T22:18:21.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc57c06e5f0 msgr2=0x7fc57c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:21.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc57c06e5f0 0x7fc57c070ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc580000c00 tx=0x7fc580005a20 comp rx=0 tx=0).stop 2024-09-13T22:18:21.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590100750 msgr2=0x7fc59019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:21.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590100750 0x7fc59019bd40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00c810 tx=0x7fc58c00ccd0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 shutdown_connections 2024-09-13T22:18:21.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc57c06e5f0 0x7fc57c070ab0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590100750 0x7fc59019bd40 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00c810 tx=0x7fc58c00ccd0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 --2- 172.21.15.89:0/231628851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5900ffda0 0x7fc59019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 >> 172.21.15.89:0/231628851 conn(0x7fc5900fb840 msgr2=0x7fc5900fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:21.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 shutdown_connections 2024-09-13T22:18:21.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.175+0000 7fc5973ee640 1 -- 172.21.15.89:0/231628851 wait complete. 2024-09-13T22:18:21.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.258+0000 7fb7525c4640 1 -- 172.21.15.89:0/2673096617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 msgr2=0x7fb74c10bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.258+0000 7fb7525c4640 1 --2- 172.21.15.89:0/2673096617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 0x7fb74c10bea0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb734009880 tx=0x7fb73402a530 comp rx=0 tx=0).stop 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.258+0000 7fb7525c4640 1 -- 172.21.15.89:0/2673096617 shutdown_connections 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.258+0000 7fb7525c4640 1 --2- 172.21.15.89:0/2673096617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 0x7fb74c10bea0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.258+0000 7fb7525c4640 1 --2- 172.21.15.89:0/2673096617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74c0727d0 0x7fb74c072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.258+0000 7fb7525c4640 1 -- 172.21.15.89:0/2673096617 >> 172.21.15.89:0/2673096617 conn(0x7fb74c0fb7e0 msgr2=0x7fb74c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.259+0000 7fb7525c4640 1 -- 172.21.15.89:0/2673096617 shutdown_connections 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.259+0000 7fb7525c4640 1 -- 172.21.15.89:0/2673096617 wait complete. 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.259+0000 7fb7525c4640 1 Processor -- start 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.259+0000 7fb7525c4640 1 -- start start 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb7525c4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74c0727d0 0x7fb74c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:21.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb7525c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 0x7fb74c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb7525c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c198960 con 0x7fb74c0730f0 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb7525c4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c19c6d0 con 0x7fb74c0727d0 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb74b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 0x7fb74c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb74b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 0x7fb74c1982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59314/0 (socket says 172.21.15.89:59314) 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb74b7fe640 1 -- 172.21.15.89:0/2175629439 learned_addr learned my addr 172.21.15.89:0/2175629439 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb74bfff640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74c0727d0 0x7fb74c197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb74b7fe640 1 -- 172.21.15.89:0/2175629439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74c0727d0 msgr2=0x7fb74c197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb74b7fe640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74c0727d0 0x7fb74c197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb74b7fe640 1 -- 172.21.15.89:0/2175629439 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734009560 con 0x7fb74c0730f0 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb74b7fe640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 0x7fb74c1982d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb73402aa50 tx=0x7fb7340055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb7497fa640 1 -- 172.21.15.89:0/2175629439 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb734004aa0 con 0x7fb74c0730f0 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb7497fa640 1 -- 172.21.15.89:0/2175629439 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb734004c00 con 0x7fb74c0730f0 2024-09-13T22:18:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c19c950 con 0x7fb74c0730f0 2024-09-13T22:18:21.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.260+0000 7fb7497fa640 1 -- 172.21.15.89:0/2175629439 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb734003980 con 0x7fb74c0730f0 2024-09-13T22:18:21.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.261+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c19ce40 con 0x7fb74c0730f0 2024-09-13T22:18:21.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.262+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c073f10 con 0x7fb74c0730f0 2024-09-13T22:18:21.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.262+0000 7fb7497fa640 1 -- 172.21.15.89:0/2175629439 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb73402ad50 con 0x7fb74c0730f0 2024-09-13T22:18:21.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.262+0000 7fb7497fa640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb73806e5f0 0x7fb738070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:21.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.262+0000 7fb7497fa640 1 -- 172.21.15.89:0/2175629439 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fb7340af4a0 con 0x7fb74c0730f0 2024-09-13T22:18:21.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.262+0000 7fb74bfff640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb73806e5f0 0x7fb738070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:21.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.263+0000 7fb74bfff640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb73806e5f0 0x7fb738070ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb73c005fd0 tx=0x7fb73c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:21.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.267+0000 7fb7497fa640 1 -- 172.21.15.89:0/2175629439 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb7340785a0 con 0x7fb74c0730f0 2024-09-13T22:18:21.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:21 smithi089 ceph-mon[109939]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:21.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:21 smithi089 ceph-mon[109939]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:21.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:21 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/4006327326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:21.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:21 smithi089 ceph-mon[109939]: pgmap v222: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-13T22:18:21.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:21 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3783736065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:18:21.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.516+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb74c072bb0 con 0x7fb74c0730f0 2024-09-13T22:18:21.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.516+0000 7fb7497fa640 1 -- 172.21.15.89:0/2175629439 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb73407bc60 con 0x7fb74c0730f0 2024-09-13T22:18:21.517 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:18:21.518 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:18:21.518 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:18:21.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb73806e5f0 msgr2=0x7fb738070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb73806e5f0 0x7fb738070ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb73c005fd0 tx=0x7fb73c00b390 comp rx=0 tx=0).stop 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 msgr2=0x7fb74c1982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 0x7fb74c1982d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb73402aa50 tx=0x7fb7340055a0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 shutdown_connections 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb73806e5f0 0x7fb738070ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb74c0730f0 0x7fb74c1982d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 --2- 172.21.15.89:0/2175629439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb74c0727d0 0x7fb74c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 >> 172.21.15.89:0/2175629439 conn(0x7fb74c0fb7e0 msgr2=0x7fb74c104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 shutdown_connections 2024-09-13T22:18:21.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:21.518+0000 7fb7525c4640 1 -- 172.21.15.89:0/2175629439 wait complete. 2024-09-13T22:18:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:21 smithi159 ceph-mon[82000]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:21 smithi159 ceph-mon[82000]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:21 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/4006327326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:21 smithi159 ceph-mon[82000]: pgmap v222: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-13T22:18:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:21 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3783736065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:18:22.664 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:22 smithi159 ceph-mon[82000]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:22.664 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:22 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2175629439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:18:22.665 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:22 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:18:22.665 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:22 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:22.665 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:22 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:22.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:22 smithi089 ceph-mon[109939]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:22 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2175629439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:18:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:22 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:18:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:22 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:22.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:22 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:23.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:23 smithi089 ceph-mon[109939]: pgmap v223: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:23.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:23 smithi159 ceph-mon[82000]: pgmap v223: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:24.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:24 smithi089 ceph-mon[109939]: Upgrade: Updating ceph-exporter.smithi159 (2/2) 2024-09-13T22:18:24.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:24 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:24.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:24 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:18:24.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:24 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:24.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:24 smithi089 ceph-mon[109939]: Deploying daemon ceph-exporter.smithi159 on smithi159 2024-09-13T22:18:24.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:24 smithi159 ceph-mon[82000]: Upgrade: Updating ceph-exporter.smithi159 (2/2) 2024-09-13T22:18:24.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:24 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:24.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:24 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:18:24.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:24 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:24.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:24 smithi159 ceph-mon[82000]: Deploying daemon ceph-exporter.smithi159 on smithi159 2024-09-13T22:18:25.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:25 smithi159 ceph-mon[82000]: pgmap v224: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:25.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:25 smithi089 ceph-mon[109939]: pgmap v224: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:27.922 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:27 smithi159 ceph-mon[82000]: pgmap v225: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:27.922 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:27.922 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:27.923 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:27 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:27.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:27 smithi089 ceph-mon[109939]: pgmap v225: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:27.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:27 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:29.959 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:29 smithi089 ceph-mon[109939]: pgmap v226: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:29.959 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:29 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:29.959 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:29 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:30.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:29 smithi159 ceph-mon[82000]: pgmap v226: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:30.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:29 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:30.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:29 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:30.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:30 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:30.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:30 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:31.166 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:30 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:31.166 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:30 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:32.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:31 smithi159 ceph-mon[82000]: pgmap v227: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:32.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:32.010 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:31 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:32.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:31 smithi089 ceph-mon[109939]: pgmap v227: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:32.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:32.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:31 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:33.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:32 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:33.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:32 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:33.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:32 smithi089 ceph-mon[109939]: pgmap v228: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:33.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:32 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:33.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:32 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:33.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:32 smithi159 ceph-mon[82000]: pgmap v228: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:34.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:34 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:34.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:34 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:34.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:34 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:34.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:34 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:35.348 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:35 smithi089 ceph-mon[109939]: pgmap v229: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:35.509 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:35 smithi159 ceph-mon[82000]: pgmap v229: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:36.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:36.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:36.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:36.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:36.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:36.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:36.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.747 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T22:18:36.748 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T22:18:36.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:36.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:36.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:36.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:36.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:36.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T22:18:36.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T22:18:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T22:18:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:18:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.497 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi089"}]: dispatch 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi089"}]': finished 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi159"}]: dispatch 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi159"}]': finished 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all iscsi 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.498 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all nfs 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: Upgrade: Setting container_image for all nvmeof 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: Upgrade: Finalizing container_image settings 2024-09-13T22:18:37.499 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T22:18:37.500 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T22:18:37.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T22:18:37.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T22:18:37.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T22:18:37.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T22:18:37.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T22:18:37.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T22:18:37.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T22:18:37.501 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: Upgrade: Complete! 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:37.502 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:37.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:37.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:37.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:18:37.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: pgmap v230: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:37.503 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T22:18:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: fsmap cephfs:1 {0=cephfs.smithi089.euhfjz=up:active} 3 up:standby 2024-09-13T22:18:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T22:18:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.760 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi089"}]: dispatch 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi089"}]': finished 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi159"}]: dispatch 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi159"}]': finished 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all iscsi 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all nfs 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: Upgrade: Setting container_image for all nvmeof 2024-09-13T22:18:37.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: Upgrade: Finalizing container_image settings 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T22:18:37.762 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T22:18:37.763 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: Upgrade: Complete! 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T22:18:37.764 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: pgmap v230: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:37.765 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:18:39.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:39 smithi089 ceph-mon[109939]: pgmap v231: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:40.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:39 smithi159 ceph-mon[82000]: pgmap v231: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:41.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:41 smithi089 ceph-mon[109939]: pgmap v232: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:42.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:41 smithi159 ceph-mon[82000]: pgmap v232: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:43.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:43 smithi089 ceph-mon[109939]: pgmap v233: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:44.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:43 smithi159 ceph-mon[82000]: pgmap v233: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:45.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:45 smithi089 ceph-mon[109939]: pgmap v234: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:46.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:45 smithi159 ceph-mon[82000]: pgmap v234: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:47.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:47 smithi089 ceph-mon[109939]: pgmap v235: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:48.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:47 smithi159 ceph-mon[82000]: pgmap v235: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:49.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:49 smithi089 ceph-mon[109939]: pgmap v236: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:50.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:49 smithi159 ceph-mon[82000]: pgmap v236: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 -- 172.21.15.89:0/2859989014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 msgr2=0x7f06980fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 --2- 172.21.15.89:0/2859989014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 0x7f06980fee90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f068c009880 tx=0x7f068c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:18:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 -- 172.21.15.89:0/2859989014 shutdown_connections 2024-09-13T22:18:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 --2- 172.21.15.89:0/2859989014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 0x7f06980fee90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 --2- 172.21.15.89:0/2859989014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0698104a30 0x7f0698104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 -- 172.21.15.89:0/2859989014 >> 172.21.15.89:0/2859989014 conn(0x7f06980fa730 msgr2=0x7f06980fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 -- 172.21.15.89:0/2859989014 shutdown_connections 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 -- 172.21.15.89:0/2859989014 wait complete. 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 Processor -- start 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.612+0000 7f069f900640 1 -- start start 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069f900640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 0x7f06981949f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069f900640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0698104a30 0x7f0698194f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069f900640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0698195610 con 0x7f06980fea30 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069f900640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0698199360 con 0x7f0698104a30 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069d69c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 0x7f06981949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069d69c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 0x7f06981949f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52922/0 (socket says 172.21.15.89:52922) 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069d69c640 1 -- 172.21.15.89:0/152107195 learned_addr learned my addr 172.21.15.89:0/152107195 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:51.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069ce9b640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0698104a30 0x7f0698194f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069d69c640 1 -- 172.21.15.89:0/152107195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0698104a30 msgr2=0x7f0698194f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069d69c640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0698104a30 0x7f0698194f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069d69c640 1 -- 172.21.15.89:0/152107195 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c009560 con 0x7f06980fea30 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069ce9b640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0698104a30 0x7f0698194f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f069d69c640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 0x7f06981949f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f069400d6f0 tx=0x7f069400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.613+0000 7f068a7fc640 1 -- 172.21.15.89:0/152107195 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0694009a30 con 0x7f06980fea30 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.614+0000 7f068a7fc640 1 -- 172.21.15.89:0/152107195 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06940054e0 con 0x7f06980fea30 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.614+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0698199560 con 0x7f06980fea30 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.614+0000 7f068a7fc640 1 -- 172.21.15.89:0/152107195 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0694010460 con 0x7f06980fea30 2024-09-13T22:18:51.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.614+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0698199ab0 con 0x7f06980fea30 2024-09-13T22:18:51.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.615+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0698100170 con 0x7f06980fea30 2024-09-13T22:18:51.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.615+0000 7f068a7fc640 1 -- 172.21.15.89:0/152107195 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0694009b90 con 0x7f06980fea30 2024-09-13T22:18:51.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.616+0000 7f068a7fc640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f068406e600 0x7f0684070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:51.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.616+0000 7f068a7fc640 1 -- 172.21.15.89:0/152107195 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f069408e3e0 con 0x7f06980fea30 2024-09-13T22:18:51.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.616+0000 7f069ce9b640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f068406e600 0x7f0684070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:51.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.616+0000 7f069ce9b640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f068406e600 0x7f0684070ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0698195fa0 tx=0x7f068c004180 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:51.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.620+0000 7f068a7fc640 1 -- 172.21.15.89:0/152107195 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f06940573b0 con 0x7f06980fea30 2024-09-13T22:18:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.807+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f069810bd90 con 0x7f068406e600 2024-09-13T22:18:51.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.808+0000 7f068a7fc640 1 -- 172.21.15.89:0/152107195 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f069810bd90 con 0x7f068406e600 2024-09-13T22:18:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f068406e600 msgr2=0x7f0684070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f068406e600 0x7f0684070ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0698195fa0 tx=0x7f068c004180 comp rx=0 tx=0).stop 2024-09-13T22:18:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 msgr2=0x7f06981949f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 0x7f06981949f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f069400d6f0 tx=0x7f069400dbb0 comp rx=0 tx=0).stop 2024-09-13T22:18:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 shutdown_connections 2024-09-13T22:18:51.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f068406e600 0x7f0684070ac0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:51.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0698104a30 0x7f0698194f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:51.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 --2- 172.21.15.89:0/152107195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06980fea30 0x7f06981949f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:51.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 >> 172.21.15.89:0/152107195 conn(0x7f06980fa730 msgr2=0x7f06980fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:51.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 shutdown_connections 2024-09-13T22:18:51.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:51.810+0000 7f069f900640 1 -- 172.21.15.89:0/152107195 wait complete. 2024-09-13T22:18:51.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:51 smithi089 ceph-mon[109939]: pgmap v237: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:51.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:18:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:51 smithi159 ceph-mon[82000]: pgmap v237: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:52.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:18:52.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T22:18:52.740 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:18:52.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:52 smithi089 ceph-mon[109939]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:53.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:52 smithi159 ceph-mon[82000]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:53.910 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:53 smithi089 ceph-mon[109939]: pgmap v238: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:54.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:53 smithi159 ceph-mon[82000]: pgmap v238: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:54.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 -- 172.21.15.89:0/1956758937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc0ffda0 msgr2=0x7f3ebc100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:54.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 --2- 172.21.15.89:0/1956758937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc0ffda0 0x7f3ebc100180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009880 tx=0x7f3eac02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:18:54.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 -- 172.21.15.89:0/1956758937 shutdown_connections 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 --2- 172.21.15.89:0/1956758937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ebc100750 0x7f3ebc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 --2- 172.21.15.89:0/1956758937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc0ffda0 0x7f3ebc100180 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 -- 172.21.15.89:0/1956758937 >> 172.21.15.89:0/1956758937 conn(0x7f3ebc0fb840 msgr2=0x7f3ebc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 -- 172.21.15.89:0/1956758937 shutdown_connections 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 -- 172.21.15.89:0/1956758937 wait complete. 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 Processor -- start 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.461+0000 7f3ec2765640 1 -- start start 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3ec2765640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ebc0ffda0 0x7f3ebc19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3ec2765640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc100750 0x7f3ebc19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3ec2765640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc19c360 con 0x7f3ebc100750 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3ec2765640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc1958f0 con 0x7f3ebc0ffda0 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc100750 0x7f3ebc19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:54.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc100750 0x7f3ebc19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54204/0 (socket says 172.21.15.89:54204) 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb3fff640 1 -- 172.21.15.89:0/3684686579 learned_addr learned my addr 172.21.15.89:0/3684686579 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3ebbfff640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ebc0ffda0 0x7f3ebc19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb3fff640 1 -- 172.21.15.89:0/3684686579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ebc0ffda0 msgr2=0x7f3ebc19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb3fff640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ebc0ffda0 0x7f3ebc19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb3fff640 1 -- 172.21.15.89:0/3684686579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac009560 con 0x7f3ebc100750 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb3fff640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc100750 0x7f3ebc19bd40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400d8d0 tx=0x7f3ea400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb9ffb640 1 -- 172.21.15.89:0/3684686579 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea400bea0 con 0x7f3ebc100750 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb9ffb640 1 -- 172.21.15.89:0/3684686579 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ea4009c00 con 0x7f3ebc100750 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc195bd0 con 0x7f3ebc100750 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.462+0000 7f3eb9ffb640 1 -- 172.21.15.89:0/3684686579 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea400f710 con 0x7f3ebc100750 2024-09-13T22:18:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.463+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc196120 con 0x7f3ebc100750 2024-09-13T22:18:54.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.464+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc101280 con 0x7f3ebc100750 2024-09-13T22:18:54.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.464+0000 7f3eb9ffb640 1 -- 172.21.15.89:0/3684686579 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3ea4010460 con 0x7f3ebc100750 2024-09-13T22:18:54.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.465+0000 7f3eb9ffb640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3ea806e5f0 0x7f3ea8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:54.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.465+0000 7f3eb9ffb640 1 -- 172.21.15.89:0/3684686579 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f3ea408e460 con 0x7f3ebc100750 2024-09-13T22:18:54.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.465+0000 7f3ebbfff640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3ea806e5f0 0x7f3ea8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:54.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.465+0000 7f3ebbfff640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3ea806e5f0 0x7f3ea8070ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009230 tx=0x7f3eac0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:54.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.469+0000 7f3eb9ffb640 1 -- 172.21.15.89:0/3684686579 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3ea4057560 con 0x7f3ebc100750 2024-09-13T22:18:54.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.645+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ebc10cdb0 con 0x7f3ea806e5f0 2024-09-13T22:18:54.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.654+0000 7f3eb9ffb640 1 -- 172.21.15.89:0/3684686579 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3ebc10cdb0 con 0x7f3ea806e5f0 2024-09-13T22:18:54.655 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:18:54.655 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (7m) 23s ago 17m 25.3M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (33s) 23s ago 18m 8044k - 19.1.1-324-gecab7be5 0652ff2b5d78 fd892c2da693 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (28s) 25s ago 17m 7314k - 19.1.1-324-gecab7be5 0652ff2b5d78 3f00da9335b5 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (5m) 23s ago 18m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (5m) 25s ago 17m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (7m) 23s ago 17m 79.8M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (97s) 23s ago 12m 14.2M - 19.1.1-324-gecab7be5 0652ff2b5d78 8e7c4b78b682 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (113s) 23s ago 12m 84.8M - 19.1.1-324-gecab7be5 0652ff2b5d78 007f4687420d 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (71s) 25s ago 12m 16.3M - 19.1.1-324-gecab7be5 0652ff2b5d78 6795ed6657dc 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (49s) 25s ago 12m 15.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 1301e4cf3709 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (9m) 23s ago 19m 508M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (8m) 25s ago 17m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (6m) 23s ago 19m 56.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:18:54.656 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (6m) 25s ago 17m 43.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:18:54.657 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (8m) 23s ago 18m 15.6M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:18:54.657 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (8m) 25s ago 17m 15.5M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:18:54.657 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (4m) 23s ago 16m 169M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:18:54.657 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (4m) 23s ago 15m 148M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 3d2a1d778a36 2024-09-13T22:18:54.657 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (3m) 23s ago 15m 143M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 ffb294d5c14f 2024-09-13T22:18:54.657 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (3m) 25s ago 14m 143M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 6724e7895aeb 2024-09-13T22:18:54.657 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (2m) 25s ago 14m 99.9M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 18175379d0ae 2024-09-13T22:18:54.657 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (2m) 25s ago 14m 108M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 c11707471acc 2024-09-13T22:18:54.657 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (7m) 23s ago 17m 66.1M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:18:54.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3ea806e5f0 msgr2=0x7f3ea8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:54.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3ea806e5f0 0x7f3ea8070ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009230 tx=0x7f3eac0058d0 comp rx=0 tx=0).stop 2024-09-13T22:18:54.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc100750 msgr2=0x7f3ebc19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:54.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc100750 0x7f3ebc19bd40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400d8d0 tx=0x7f3ea400dd90 comp rx=0 tx=0).stop 2024-09-13T22:18:54.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 shutdown_connections 2024-09-13T22:18:54.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3ea806e5f0 0x7f3ea8070ab0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:54.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ebc100750 0x7f3ebc19bd40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:54.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 --2- 172.21.15.89:0/3684686579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ebc0ffda0 0x7f3ebc19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:54.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 >> 172.21.15.89:0/3684686579 conn(0x7f3ebc0fb840 msgr2=0x7f3ebc0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:54.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 shutdown_connections 2024-09-13T22:18:54.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:54.656+0000 7f3ec2765640 1 -- 172.21.15.89:0/3684686579 wait complete. 2024-09-13T22:18:55.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade status' 2024-09-13T22:18:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:18:55.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:55 smithi089 ceph-mon[109939]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:55.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:55 smithi089 ceph-mon[109939]: pgmap v239: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:55 smithi159 ceph-mon[82000]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:56.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:55 smithi159 ceph-mon[82000]: pgmap v239: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:57.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.435+0000 7f3a6ad14640 1 -- 172.21.15.89:0/1807690582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a640fea30 msgr2=0x7f3a640fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:57.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.435+0000 7f3a6ad14640 1 --2- 172.21.15.89:0/1807690582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a640fea30 0x7f3a640fee90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009900 tx=0x7f3a5002c6e0 comp rx=0 tx=0).stop 2024-09-13T22:18:57.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.435+0000 7f3a6ad14640 1 -- 172.21.15.89:0/1807690582 shutdown_connections 2024-09-13T22:18:57.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.435+0000 7f3a6ad14640 1 --2- 172.21.15.89:0/1807690582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a640fea30 0x7f3a640fee90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:57.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 --2- 172.21.15.89:0/1807690582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a64104a30 0x7f3a64104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:57.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 -- 172.21.15.89:0/1807690582 >> 172.21.15.89:0/1807690582 conn(0x7f3a640fa730 msgr2=0x7f3a640fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 -- 172.21.15.89:0/1807690582 shutdown_connections 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 -- 172.21.15.89:0/1807690582 wait complete. 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 Processor -- start 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 -- start start 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a640fea30 0x7f3a64199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a64104a30 0x7f3a64199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a64193740 con 0x7f3a64104a30 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a6ad14640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a641938b0 con 0x7f3a640fea30 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a63fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a64104a30 0x7f3a64199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a63fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a64104a30 0x7f3a64199b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54222/0 (socket says 172.21.15.89:54222) 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.436+0000 7f3a63fff640 1 -- 172.21.15.89:0/2730596179 learned_addr learned my addr 172.21.15.89:0/2730596179 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:18:57.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a68ab0640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a640fea30 0x7f3a64199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a63fff640 1 -- 172.21.15.89:0/2730596179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a640fea30 msgr2=0x7f3a64199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a63fff640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a640fea30 0x7f3a64199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a63fff640 1 -- 172.21.15.89:0/2730596179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50009560 con 0x7f3a64104a30 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a68ab0640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a640fea30 0x7f3a64199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a63fff640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a64104a30 0x7f3a64199b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a5002cc00 tx=0x7f3a500055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a61ffb640 1 -- 172.21.15.89:0/2730596179 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a50004aa0 con 0x7f3a64104a30 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a61ffb640 1 -- 172.21.15.89:0/2730596179 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a50004c00 con 0x7f3a64104a30 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a64193b30 con 0x7f3a64104a30 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a61ffb640 1 -- 172.21.15.89:0/2730596179 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a50003980 con 0x7f3a64104a30 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.437+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a64194020 con 0x7f3a64104a30 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.438+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a64100170 con 0x7f3a64104a30 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.439+0000 7f3a61ffb640 1 -- 172.21.15.89:0/2730596179 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3a50033640 con 0x7f3a64104a30 2024-09-13T22:18:57.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.439+0000 7f3a61ffb640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3a5406e5f0 0x7f3a54070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:18:57.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.439+0000 7f3a61ffb640 1 -- 172.21.15.89:0/2730596179 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f3a500b1810 con 0x7f3a64104a30 2024-09-13T22:18:57.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.439+0000 7f3a68ab0640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3a5406e5f0 0x7f3a54070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:18:57.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.440+0000 7f3a68ab0640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3a5406e5f0 0x7f3a54070ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3a580058c0 tx=0x7f3a58005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:18:57.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.444+0000 7f3a61ffb640 1 -- 172.21.15.89:0/2730596179 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3a5007a860 con 0x7f3a64104a30 2024-09-13T22:18:57.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.638+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a64107010 con 0x7f3a5406e5f0 2024-09-13T22:18:57.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.639+0000 7f3a61ffb640 1 -- 172.21.15.89:0/2730596179 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3a64107010 con 0x7f3a5406e5f0 2024-09-13T22:18:57.640 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:18:57.640 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": null, 2024-09-13T22:18:57.640 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": false, 2024-09-13T22:18:57.640 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "", 2024-09-13T22:18:57.640 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T22:18:57.640 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": null, 2024-09-13T22:18:57.640 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-13T22:18:57.641 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T22:18:57.641 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:18:57.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3a5406e5f0 msgr2=0x7f3a54070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:57.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3a5406e5f0 0x7f3a54070ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3a580058c0 tx=0x7f3a58005850 comp rx=0 tx=0).stop 2024-09-13T22:18:57.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a64104a30 msgr2=0x7f3a64199b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:18:57.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a64104a30 0x7f3a64199b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a5002cc00 tx=0x7f3a500055a0 comp rx=0 tx=0).stop 2024-09-13T22:18:57.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 shutdown_connections 2024-09-13T22:18:57.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f3a5406e5f0 0x7f3a54070ab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:57.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a64104a30 0x7f3a64199b90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:57.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 --2- 172.21.15.89:0/2730596179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a640fea30 0x7f3a64199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:18:57.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 >> 172.21.15.89:0/2730596179 conn(0x7f3a640fa730 msgr2=0x7f3a640fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:18:57.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 shutdown_connections 2024-09-13T22:18:57.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:18:57.641+0000 7f3a6ad14640 1 -- 172.21.15.89:0/2730596179 wait complete. 2024-09-13T22:18:57.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:57 smithi089 ceph-mon[109939]: pgmap v240: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:58.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:57 smithi159 ceph-mon[82000]: pgmap v240: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:18:58.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph health detail' 2024-09-13T22:18:58.518 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:18:58.963 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:58 smithi089 ceph-mon[109939]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:59.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:58 smithi159 ceph-mon[82000]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:59.917 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:18:59 smithi089 ceph-mon[109939]: pgmap v241: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:00.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:18:59 smithi159 ceph-mon[82000]: pgmap v241: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.124+0000 7fca487a7640 1 -- 172.21.15.89:0/4044318737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca40104a30 msgr2=0x7fca40104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:19:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.124+0000 7fca487a7640 1 --2- 172.21.15.89:0/4044318737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca40104a30 0x7fca40104e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fca30009880 tx=0x7fca3002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:19:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.124+0000 7fca487a7640 1 -- 172.21.15.89:0/4044318737 shutdown_connections 2024-09-13T22:19:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.124+0000 7fca487a7640 1 --2- 172.21.15.89:0/4044318737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca400fea30 0x7fca400fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.124+0000 7fca487a7640 1 --2- 172.21.15.89:0/4044318737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca40104a30 0x7fca40104e10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.124+0000 7fca487a7640 1 -- 172.21.15.89:0/4044318737 >> 172.21.15.89:0/4044318737 conn(0x7fca400fa730 msgr2=0x7fca400fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.124+0000 7fca487a7640 1 -- 172.21.15.89:0/4044318737 shutdown_connections 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.124+0000 7fca487a7640 1 -- 172.21.15.89:0/4044318737 wait complete. 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca487a7640 1 Processor -- start 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca487a7640 1 -- start start 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca487a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca400fea30 0x7fca40196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca487a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40104a30 0x7fca40196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca487a7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40197410 con 0x7fca400fea30 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca487a7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40197580 con 0x7fca40104a30 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca46543640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca400fea30 0x7fca40196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca46543640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca400fea30 0x7fca40196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54230/0 (socket says 172.21.15.89:54230) 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca46543640 1 -- 172.21.15.89:0/976811548 learned_addr learned my addr 172.21.15.89:0/976811548 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:19:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca45d42640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40104a30 0x7fca40196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca46543640 1 -- 172.21.15.89:0/976811548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40104a30 msgr2=0x7fca40196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca46543640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40104a30 0x7fca40196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca46543640 1 -- 172.21.15.89:0/976811548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30009560 con 0x7fca400fea30 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.125+0000 7fca45d42640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40104a30 0x7fca40196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.126+0000 7fca46543640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca400fea30 0x7fca40196900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca30006010 tx=0x7fca300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.126+0000 7fca377fe640 1 -- 172.21.15.89:0/976811548 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca30004aa0 con 0x7fca400fea30 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.126+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4019f970 con 0x7fca400fea30 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.126+0000 7fca377fe640 1 -- 172.21.15.89:0/976811548 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca30004c00 con 0x7fca400fea30 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.126+0000 7fca377fe640 1 -- 172.21.15.89:0/976811548 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca30003a20 con 0x7fca400fea30 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.126+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4019fcd0 con 0x7fca400fea30 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.127+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca40100170 con 0x7fca400fea30 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.128+0000 7fca377fe640 1 -- 172.21.15.89:0/976811548 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fca30031c90 con 0x7fca400fea30 2024-09-13T22:19:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.128+0000 7fca377fe640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fca2c06e600 0x7fca2c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:19:00.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.128+0000 7fca377fe640 1 -- 172.21.15.89:0/976811548 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fca300afa10 con 0x7fca400fea30 2024-09-13T22:19:00.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.128+0000 7fca45d42640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fca2c06e600 0x7fca2c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:19:00.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.129+0000 7fca45d42640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fca2c06e600 0x7fca2c070ac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca40068c90 tx=0x7fca3c005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:19:00.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.132+0000 7fca377fe640 1 -- 172.21.15.89:0/976811548 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fca300789e0 con 0x7fca400fea30 2024-09-13T22:19:00.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.363+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fca400fee90 con 0x7fca400fea30 2024-09-13T22:19:00.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.363+0000 7fca377fe640 1 -- 172.21.15.89:0/976811548 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fca3007c0a0 con 0x7fca400fea30 2024-09-13T22:19:00.364 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:19:00.364 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:19:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:19:00.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fca2c06e600 msgr2=0x7fca2c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:19:00.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fca2c06e600 0x7fca2c070ac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca40068c90 tx=0x7fca3c005d30 comp rx=0 tx=0).stop 2024-09-13T22:19:00.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca400fea30 msgr2=0x7fca40196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:19:00.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca400fea30 0x7fca40196900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca30006010 tx=0x7fca300055a0 comp rx=0 tx=0).stop 2024-09-13T22:19:00.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 shutdown_connections 2024-09-13T22:19:00.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fca2c06e600 0x7fca2c070ac0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:00.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40104a30 0x7fca40196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:00.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 --2- 172.21.15.89:0/976811548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca400fea30 0x7fca40196900 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:00.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 >> 172.21.15.89:0/976811548 conn(0x7fca400fa730 msgr2=0x7fca400fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:19:00.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 shutdown_connections 2024-09-13T22:19:00.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:00.365+0000 7fca487a7640 1 -- 172.21.15.89:0/976811548 wait complete. 2024-09-13T22:19:00.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T22:19:01.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:00 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/976811548' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:19:01.177 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:19:01.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:00 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/976811548' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T22:19:01.989 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:01 smithi089 ceph-mon[109939]: pgmap v242: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:02.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:01 smithi159 ceph-mon[82000]: pgmap v242: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.097+0000 7f71736cd640 1 -- 172.21.15.89:0/2827058901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 msgr2=0x7f716c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.097+0000 7f71736cd640 1 --2- 172.21.15.89:0/2827058901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 0x7f716c104e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7160009880 tx=0x7f716002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.097+0000 7f71736cd640 1 -- 172.21.15.89:0/2827058901 shutdown_connections 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.097+0000 7f71736cd640 1 --2- 172.21.15.89:0/2827058901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c0fea30 0x7f716c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.097+0000 7f71736cd640 1 --2- 172.21.15.89:0/2827058901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 0x7f716c104e10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.097+0000 7f71736cd640 1 -- 172.21.15.89:0/2827058901 >> 172.21.15.89:0/2827058901 conn(0x7f716c0fa730 msgr2=0x7f716c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.097+0000 7f71736cd640 1 -- 172.21.15.89:0/2827058901 shutdown_connections 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f71736cd640 1 -- 172.21.15.89:0/2827058901 wait complete. 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f71736cd640 1 Processor -- start 2024-09-13T22:19:03.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f71736cd640 1 -- start start 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f71736cd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c0fea30 0x7f716c0fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f71736cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 0x7f716c0fb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f71736cd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0fbad0 con 0x7f716c104a30 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f71736cd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0fbc40 con 0x7f716c0fea30 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f7170c68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 0x7f716c0fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f7170c68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 0x7f716c0fb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54260/0 (socket says 172.21.15.89:54260) 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f7170c68640 1 -- 172.21.15.89:0/3098352906 learned_addr learned my addr 172.21.15.89:0/3098352906 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.098+0000 7f7171469640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c0fea30 0x7f716c0fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.099+0000 7f7170c68640 1 -- 172.21.15.89:0/3098352906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c0fea30 msgr2=0x7f716c0fb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.099+0000 7f7170c68640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c0fea30 0x7f716c0fb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.099+0000 7f7170c68640 1 -- 172.21.15.89:0/3098352906 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160009560 con 0x7f716c104a30 2024-09-13T22:19:03.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.099+0000 7f7170c68640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 0x7f716c0fb590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f715c00eb10 tx=0x7f715c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.099+0000 7f716a7fc640 1 -- 172.21.15.89:0/3098352906 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715c004b20 con 0x7f716c104a30 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.099+0000 7f716a7fc640 1 -- 172.21.15.89:0/3098352906 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f715c004c80 con 0x7f716c104a30 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.099+0000 7f716a7fc640 1 -- 172.21.15.89:0/3098352906 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715c010640 con 0x7f716c104a30 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.099+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c1a1cc0 con 0x7f716c104a30 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.099+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c1a2020 con 0x7f716c104a30 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.100+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c100170 con 0x7f716c104a30 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.100+0000 7f716a7fc640 1 -- 172.21.15.89:0/3098352906 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f715c0055e0 con 0x7f716c104a30 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.101+0000 7f716a7fc640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f715406e5f0 0x7f7154070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.101+0000 7f7171469640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f715406e5f0 0x7f7154070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:19:03.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.101+0000 7f716a7fc640 1 -- 172.21.15.89:0/3098352906 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f715c014070 con 0x7f716c104a30 2024-09-13T22:19:03.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.102+0000 7f7171469640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f715406e5f0 0x7f7154070ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7160009230 tx=0x7f71600058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:19:03.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.105+0000 7f716a7fc640 1 -- 172.21.15.89:0/3098352906 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f715c057f50 con 0x7f716c104a30 2024-09-13T22:19:03.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.339+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f716c108050 con 0x7f716c104a30 2024-09-13T22:19:03.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.340+0000 7f716a7fc640 1 -- 172.21.15.89:0/3098352906 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f715c05b610 con 0x7f716c104a30 2024-09-13T22:19:03.341 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:19:03.341 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:19:03.341 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:19:03.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:19:03.341 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:19:03.341 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:19:03.342 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:19:03.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f715406e5f0 msgr2=0x7f7154070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:19:03.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f715406e5f0 0x7f7154070ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7160009230 tx=0x7f71600058d0 comp rx=0 tx=0).stop 2024-09-13T22:19:03.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 msgr2=0x7f716c0fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:19:03.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 0x7f716c0fb590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f715c00eb10 tx=0x7f715c00c2d0 comp rx=0 tx=0).stop 2024-09-13T22:19:03.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 shutdown_connections 2024-09-13T22:19:03.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f715406e5f0 0x7f7154070ab0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:03.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c104a30 0x7f716c0fb590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:03.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 --2- 172.21.15.89:0/3098352906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c0fea30 0x7f716c0fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:19:03.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 >> 172.21.15.89:0/3098352906 conn(0x7f716c0fa730 msgr2=0x7f716c068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:19:03.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 shutdown_connections 2024-09-13T22:19:03.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:19:03.342+0000 7f71736cd640 1 -- 172.21.15.89:0/3098352906 wait complete. 2024-09-13T22:19:03.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:03 smithi089 ceph-mon[109939]: pgmap v243: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:03.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:03 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3098352906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:19:04.061 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T22:19:04.142 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:03 smithi159 ceph-mon[82000]: pgmap v243: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:04.142 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:03 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3098352906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:19:04.260 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:19:05.801 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:05 smithi089 ceph-mon[109939]: pgmap v244: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:05.901 INFO:teuthology.orchestra.run.smithi089.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T22:19:06.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:05 smithi159 ceph-mon[82000]: pgmap v244: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:06.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'sleep 60' 2024-09-13T22:19:06.811 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:19:06.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:19:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:19:07.924 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:07 smithi089 ceph-mon[109939]: pgmap v245: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:08.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:07 smithi159 ceph-mon[82000]: pgmap v245: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:10.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:09 smithi089 ceph-mon[109939]: pgmap v246: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:10.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:09 smithi159 ceph-mon[82000]: pgmap v246: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:12.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:11 smithi089 ceph-mon[109939]: pgmap v247: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:12.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:11 smithi159 ceph-mon[82000]: pgmap v247: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:14.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:13 smithi159 ceph-mon[82000]: pgmap v248: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:14.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:13 smithi089 ceph-mon[109939]: pgmap v248: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:16.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:15 smithi089 ceph-mon[109939]: pgmap v249: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:16.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:15 smithi159 ceph-mon[82000]: pgmap v249: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:17 smithi159 ceph-mon[82000]: pgmap v250: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:18.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:17 smithi089 ceph-mon[109939]: pgmap v250: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:20.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:19 smithi089 ceph-mon[109939]: pgmap v251: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:20.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:19 smithi159 ceph-mon[82000]: pgmap v251: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:22.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:21 smithi089 ceph-mon[109939]: pgmap v252: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:22.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:19:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:21 smithi159 ceph-mon[82000]: pgmap v252: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:19:24.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:23 smithi089 ceph-mon[109939]: pgmap v253: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:24.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:23 smithi159 ceph-mon[82000]: pgmap v253: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:26.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:25 smithi089 ceph-mon[109939]: pgmap v254: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:26.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:25 smithi159 ceph-mon[82000]: pgmap v254: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:28.092 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:27 smithi089 ceph-mon[109939]: pgmap v255: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:27 smithi159 ceph-mon[82000]: pgmap v255: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:29 smithi089 ceph-mon[109939]: pgmap v256: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:30.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:29 smithi159 ceph-mon[82000]: pgmap v256: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:32.061 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:31 smithi159 ceph-mon[82000]: pgmap v257: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:32.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:31 smithi089 ceph-mon[109939]: pgmap v257: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:34.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:33 smithi089 ceph-mon[109939]: pgmap v258: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:34.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:33 smithi159 ceph-mon[82000]: pgmap v258: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:36.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:35 smithi089 ceph-mon[109939]: pgmap v259: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:36.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:35 smithi159 ceph-mon[82000]: pgmap v259: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:37.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:19:37.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:37.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:19:37.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:38.067 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:37 smithi159 ceph-mon[82000]: pgmap v260: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:38.067 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:38.067 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:38.067 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:19:38.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:37 smithi089 ceph-mon[109939]: pgmap v260: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:38.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:38.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:38.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:19:40.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:39 smithi089 ceph-mon[109939]: pgmap v261: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:40.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:39 smithi159 ceph-mon[82000]: pgmap v261: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:42.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:41 smithi089 ceph-mon[109939]: pgmap v262: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:42.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:41 smithi159 ceph-mon[82000]: pgmap v262: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:44.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:43 smithi089 ceph-mon[109939]: pgmap v263: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:44.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:43 smithi159 ceph-mon[82000]: pgmap v263: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:46.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:45 smithi089 ceph-mon[109939]: pgmap v264: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:46.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:45 smithi159 ceph-mon[82000]: pgmap v264: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:48.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:47 smithi159 ceph-mon[82000]: pgmap v265: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:48.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:47 smithi089 ceph-mon[109939]: pgmap v265: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:50.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:49 smithi089 ceph-mon[109939]: pgmap v266: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:50.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:49 smithi159 ceph-mon[82000]: pgmap v266: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:52.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:51 smithi089 ceph-mon[109939]: pgmap v267: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:52.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:19:52.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:51 smithi159 ceph-mon[82000]: pgmap v267: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:52.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:19:54.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:53 smithi089 ceph-mon[109939]: pgmap v268: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:54.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:53 smithi159 ceph-mon[82000]: pgmap v268: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:56.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:55 smithi089 ceph-mon[109939]: pgmap v269: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:56.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:55 smithi159 ceph-mon[82000]: pgmap v269: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:58.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:57 smithi089 ceph-mon[109939]: pgmap v270: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:19:58.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:57 smithi159 ceph-mon[82000]: pgmap v270: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:00.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:19:59 smithi089 ceph-mon[109939]: pgmap v271: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:00.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:19:59 smithi159 ceph-mon[82000]: pgmap v271: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:01.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:00 smithi089 ceph-mon[109939]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:20:01.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:00 smithi159 ceph-mon[82000]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:20:02.160 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:01 smithi159 ceph-mon[82000]: pgmap v272: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:02.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:01 smithi089 ceph-mon[109939]: pgmap v272: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:03.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:03 smithi089 ceph-mon[109939]: pgmap v273: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:04.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:03 smithi159 ceph-mon[82000]: pgmap v273: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:06.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:05 smithi089 ceph-mon[109939]: pgmap v274: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:06.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:05 smithi159 ceph-mon[82000]: pgmap v274: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:07.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:20:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:20:08.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:07 smithi089 ceph-mon[109939]: pgmap v275: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:08.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:07 smithi159 ceph-mon[82000]: pgmap v275: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:09.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:08 smithi089 ceph-mon[109939]: pgmap v276: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:09.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T22:20:09.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:08 smithi159 ceph-mon[82000]: pgmap v276: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:09.364 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:10.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.953+0000 7ffac39e3640 1 -- 172.21.15.89:0/626091908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc0fea20 msgr2=0x7ffabc0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:10.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.953+0000 7ffac39e3640 1 --2- 172.21.15.89:0/626091908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc0fea20 0x7ffabc0fee80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009880 tx=0x7ffaac02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:10.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.953+0000 7ffac39e3640 1 -- 172.21.15.89:0/626091908 shutdown_connections 2024-09-13T22:20:10.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.953+0000 7ffac39e3640 1 --2- 172.21.15.89:0/626091908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc0fea20 0x7ffabc0fee80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.953+0000 7ffac39e3640 1 --2- 172.21.15.89:0/626091908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffabc104a20 0x7ffabc104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.953+0000 7ffac39e3640 1 -- 172.21.15.89:0/626091908 >> 172.21.15.89:0/626091908 conn(0x7ffabc0fa700 msgr2=0x7ffabc0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.953+0000 7ffac39e3640 1 -- 172.21.15.89:0/626091908 shutdown_connections 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.953+0000 7ffac39e3640 1 -- 172.21.15.89:0/626091908 wait complete. 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac39e3640 1 Processor -- start 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac39e3640 1 -- start start 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac39e3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffabc0fea20 0x7ffabc196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac39e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc104a20 0x7ffabc196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac39e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1974f0 con 0x7ffabc104a20 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac39e3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc197660 con 0x7ffabc0fea20 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac0f7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc104a20 0x7ffabc196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:10.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac0f7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc104a20 0x7ffabc196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40826/0 (socket says 172.21.15.89:40826) 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac0f7e640 1 -- 172.21.15.89:0/2292643251 learned_addr learned my addr 172.21.15.89:0/2292643251 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac177f640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffabc0fea20 0x7ffabc196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac0f7e640 1 -- 172.21.15.89:0/2292643251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffabc0fea20 msgr2=0x7ffabc196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac0f7e640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffabc0fea20 0x7ffabc196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.954+0000 7ffac0f7e640 1 -- 172.21.15.89:0/2292643251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009560 con 0x7ffabc104a20 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.955+0000 7ffac0f7e640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc104a20 0x7ffabc196fb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffaac02a9c0 tx=0x7ffaac0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.955+0000 7ffab27fc640 1 -- 172.21.15.89:0/2292643251 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaac004aa0 con 0x7ffabc104a20 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.955+0000 7ffab27fc640 1 -- 172.21.15.89:0/2292643251 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaac004c00 con 0x7ffabc104a20 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.955+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc1978e0 con 0x7ffabc104a20 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.955+0000 7ffab27fc640 1 -- 172.21.15.89:0/2292643251 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaac003ab0 con 0x7ffabc104a20 2024-09-13T22:20:10.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.955+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc19fe40 con 0x7ffabc104a20 2024-09-13T22:20:10.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.956+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc100160 con 0x7ffabc104a20 2024-09-13T22:20:10.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.956+0000 7ffab27fc640 1 -- 172.21.15.89:0/2292643251 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ffaac031d20 con 0x7ffabc104a20 2024-09-13T22:20:10.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.957+0000 7ffab27fc640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ffaa806e5f0 0x7ffaa8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:10.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.957+0000 7ffac177f640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ffaa806e5f0 0x7ffaa8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:10.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.957+0000 7ffab27fc640 1 -- 172.21.15.89:0/2292643251 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7ffaac0af7c0 con 0x7ffabc104a20 2024-09-13T22:20:10.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.957+0000 7ffac177f640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ffaa806e5f0 0x7ffaa8070ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009890 tx=0x7ffab8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:10.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:10.961+0000 7ffab27fc640 1 -- 172.21.15.89:0/2292643251 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ffaac078790 con 0x7ffabc104a20 2024-09-13T22:20:11.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.137+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 --> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffabc1978e0 con 0x7ffaa806e5f0 2024-09-13T22:20:11.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.147+0000 7ffab27fc640 1 -- 172.21.15.89:0/2292643251 <== mgr.34104 v2:172.21.15.89:6800/3113488493 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ffabc1978e0 con 0x7ffaa806e5f0 2024-09-13T22:20:11.148 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:20:11.148 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (8m) 99s ago 19m 25.3M - 0.25.0 c8568f914cd2 ddaa888355e0 2024-09-13T22:20:11.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi089 smithi089 running (109s) 99s ago 19m 8044k - 19.1.1-324-gecab7be5 0652ff2b5d78 fd892c2da693 2024-09-13T22:20:11.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-exporter.smithi159 smithi159 running (104s) 102s ago 18m 7314k - 19.1.1-324-gecab7be5 0652ff2b5d78 3f00da9335b5 2024-09-13T22:20:11.148 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (6m) 99s ago 19m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 1a11c1f3921f 2024-09-13T22:20:11.148 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi159 smithi159 running (6m) 102s ago 18m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 055877af7f89 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (8m) 99s ago 19m 79.8M - 9.4.12 2bacad6d85d8 a7839d0a334b 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.egpifu smithi089 running (2m) 99s ago 13m 14.2M - 19.1.1-324-gecab7be5 0652ff2b5d78 8e7c4b78b682 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.euhfjz smithi089 running (3m) 99s ago 13m 84.8M - 19.1.1-324-gecab7be5 0652ff2b5d78 007f4687420d 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.hqlvpx smithi159 running (2m) 102s ago 13m 16.3M - 19.1.1-324-gecab7be5 0652ff2b5d78 6795ed6657dc 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi159.rowsot smithi159 running (2m) 102s ago 13m 15.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 1301e4cf3709 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.naneiw smithi089 *:8443,9283,8765 running (10m) 99s ago 20m 508M - 19.1.1-324-gecab7be5 0652ff2b5d78 026b40cf495a 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi159.ghpomd smithi159 *:8443,9283,8765 running (9m) 102s ago 18m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 4875fb206e2c 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (7m) 99s ago 20m 56.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 6b2c5b0ea3e1 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi159 smithi159 running (7m) 102s ago 18m 43.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 7e0ece9671a7 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (9m) 99s ago 19m 15.6M - 1.5.0 0da6a335fe13 b74ed2ec9265 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi159 smithi159 *:9100 running (9m) 102s ago 18m 15.5M - 1.5.0 0da6a335fe13 a61b1d392993 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (6m) 99s ago 17m 169M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 6efec6931e20 2024-09-13T22:20:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (5m) 99s ago 17m 148M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 3d2a1d778a36 2024-09-13T22:20:11.150 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (5m) 99s ago 16m 143M 1215M 19.1.1-324-gecab7be5 0652ff2b5d78 ffb294d5c14f 2024-09-13T22:20:11.150 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi159 running (4m) 102s ago 16m 143M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 6724e7895aeb 2024-09-13T22:20:11.150 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi159 running (3m) 102s ago 15m 99.9M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 18175379d0ae 2024-09-13T22:20:11.150 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi159 running (3m) 102s ago 15m 108M 2240M 19.1.1-324-gecab7be5 0652ff2b5d78 c11707471acc 2024-09-13T22:20:11.150 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (9m) 99s ago 18m 66.1M - 2.43.0 a07b618ecd1d fb26655f5e16 2024-09-13T22:20:11.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ffaa806e5f0 msgr2=0x7ffaa8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ffaa806e5f0 0x7ffaa8070ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009890 tx=0x7ffab8008040 comp rx=0 tx=0).stop 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc104a20 msgr2=0x7ffabc196fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc104a20 0x7ffabc196fb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffaac02a9c0 tx=0x7ffaac0055a0 comp rx=0 tx=0).stop 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 shutdown_connections 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ffaa806e5f0 0x7ffaa8070ab0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffabc104a20 0x7ffabc196fb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 --2- 172.21.15.89:0/2292643251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffabc0fea20 0x7ffabc196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 >> 172.21.15.89:0/2292643251 conn(0x7ffabc0fa700 msgr2=0x7ffabc0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 shutdown_connections 2024-09-13T22:20:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:11.149+0000 7ffac39e3640 1 -- 172.21.15.89:0/2292643251 wait complete. 2024-09-13T22:20:11.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T22:20:11.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:11 smithi089 ceph-mon[109939]: pgmap v277: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:12.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:11 smithi159 ceph-mon[82000]: pgmap v277: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:12.048 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:12.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:12 smithi089 ceph-mon[109939]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:20:13.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:12 smithi159 ceph-mon[82000]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:20:13.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.753+0000 7fc2284b4640 1 -- 172.21.15.89:0/853066930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 msgr2=0x7fc220104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:13.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.753+0000 7fc2284b4640 1 --2- 172.21.15.89:0/853066930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 0x7fc220104dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009880 tx=0x7fc21c02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:13.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.753+0000 7fc2284b4640 1 -- 172.21.15.89:0/853066930 shutdown_connections 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.753+0000 7fc2284b4640 1 --2- 172.21.15.89:0/853066930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2200fe9f0 0x7fc2200fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.753+0000 7fc2284b4640 1 --2- 172.21.15.89:0/853066930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 0x7fc220104dd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.753+0000 7fc2284b4640 1 -- 172.21.15.89:0/853066930 >> 172.21.15.89:0/853066930 conn(0x7fc2200758a0 msgr2=0x7fc2200fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.753+0000 7fc2284b4640 1 -- 172.21.15.89:0/853066930 shutdown_connections 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.753+0000 7fc2284b4640 1 -- 172.21.15.89:0/853066930 wait complete. 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc2284b4640 1 Processor -- start 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc2284b4640 1 -- start start 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc2284b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2200fe9f0 0x7fc22019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc2284b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 0x7fc22019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc2284b4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22019c490 con 0x7fc2201049f0 2024-09-13T22:20:13.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc2284b4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc220195a70 con 0x7fc2200fe9f0 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc225a4f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 0x7fc22019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc225a4f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 0x7fc22019be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51472/0 (socket says 172.21.15.89:51472) 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc225a4f640 1 -- 172.21.15.89:0/3642411352 learned_addr learned my addr 172.21.15.89:0/3642411352 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.754+0000 7fc226250640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2200fe9f0 0x7fc22019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.755+0000 7fc225a4f640 1 -- 172.21.15.89:0/3642411352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2200fe9f0 msgr2=0x7fc22019b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.755+0000 7fc225a4f640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2200fe9f0 0x7fc22019b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.755+0000 7fc225a4f640 1 -- 172.21.15.89:0/3642411352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c009560 con 0x7fc2201049f0 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.755+0000 7fc225a4f640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 0x7fc22019be70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc21000b420 tx=0x7fc21000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.755+0000 7fc2177fe640 1 -- 172.21.15.89:0/3642411352 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc210011800 con 0x7fc2201049f0 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.755+0000 7fc2177fe640 1 -- 172.21.15.89:0/3642411352 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc210011e20 con 0x7fc2201049f0 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.755+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc220195d50 con 0x7fc2201049f0 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.755+0000 7fc2177fe640 1 -- 172.21.15.89:0/3642411352 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc21000f2e0 con 0x7fc2201049f0 2024-09-13T22:20:13.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.755+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2201962a0 con 0x7fc2201049f0 2024-09-13T22:20:13.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.756+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc220100130 con 0x7fc2201049f0 2024-09-13T22:20:13.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.757+0000 7fc2177fe640 1 -- 172.21.15.89:0/3642411352 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc210010380 con 0x7fc2201049f0 2024-09-13T22:20:13.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.757+0000 7fc2177fe640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc20c06e5f0 0x7fc20c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:13.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.757+0000 7fc2177fe640 1 -- 172.21.15.89:0/3642411352 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fc21008e110 con 0x7fc2201049f0 2024-09-13T22:20:13.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.757+0000 7fc226250640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc20c06e5f0 0x7fc20c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:13.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.757+0000 7fc226250640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc20c06e5f0 0x7fc20c070ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009230 tx=0x7fc21c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:13.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:13.761+0000 7fc2177fe640 1 -- 172.21.15.89:0/3642411352 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc2100570e0 con 0x7fc2201049f0 2024-09-13T22:20:13.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:13 smithi089 ceph-mon[109939]: pgmap v278: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:14.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.004+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc2200feed0 con 0x7fc2201049f0 2024-09-13T22:20:14.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.004+0000 7fc2177fe640 1 -- 172.21.15.89:0/3642411352 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fc21005a7a0 con 0x7fc2201049f0 2024-09-13T22:20:14.006 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T22:20:14.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T22:20:14.006 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:20:14.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:20:14.006 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T22:20:14.006 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:20:14.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:20:14.006 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T22:20:14.006 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T22:20:14.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:20:14.007 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T22:20:14.007 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T22:20:14.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T22:20:14.007 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T22:20:14.007 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T22:20:14.007 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T22:20:14.007 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T22:20:14.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.006+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc20c06e5f0 msgr2=0x7fc20c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:14.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.006+0000 7fc2284b4640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc20c06e5f0 0x7fc20c070ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009230 tx=0x7fc21c0058d0 comp rx=0 tx=0).stop 2024-09-13T22:20:14.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.007+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 msgr2=0x7fc22019be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:14.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.007+0000 7fc2284b4640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 0x7fc22019be70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc21000b420 tx=0x7fc21000b8e0 comp rx=0 tx=0).stop 2024-09-13T22:20:14.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.007+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 shutdown_connections 2024-09-13T22:20:14.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.007+0000 7fc2284b4640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fc20c06e5f0 0x7fc20c070ab0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:14.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.007+0000 7fc2284b4640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2201049f0 0x7fc22019be70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:14.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.007+0000 7fc2284b4640 1 --2- 172.21.15.89:0/3642411352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2200fe9f0 0x7fc22019b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:14.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.007+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 >> 172.21.15.89:0/3642411352 conn(0x7fc2200758a0 msgr2=0x7fc220067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:14.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.007+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 shutdown_connections 2024-09-13T22:20:14.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:14.007+0000 7fc2284b4640 1 -- 172.21.15.89:0/3642411352 wait complete. 2024-09-13T22:20:14.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:13 smithi159 ceph-mon[82000]: pgmap v278: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:14.776 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T22:20:14.978 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:15.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:14 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3642411352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:20:15.099 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:14 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3642411352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:20:16.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:15 smithi159 ceph-mon[82000]: pgmap v279: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:16.061 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:15 smithi089 ceph-mon[109939]: pgmap v279: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.569+0000 7f72c5b7d640 1 -- 172.21.15.89:0/3742023897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 msgr2=0x7f72c00fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.569+0000 7f72c5b7d640 1 --2- 172.21.15.89:0/3742023897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 0x7f72c00fee70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009880 tx=0x7f72a802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.569+0000 7f72c5b7d640 1 -- 172.21.15.89:0/3742023897 shutdown_connections 2024-09-13T22:20:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.569+0000 7f72c5b7d640 1 --2- 172.21.15.89:0/3742023897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 0x7f72c00fee70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.569+0000 7f72c5b7d640 1 --2- 172.21.15.89:0/3742023897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c0104a10 0x7f72c0104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:16.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.569+0000 7f72c5b7d640 1 -- 172.21.15.89:0/3742023897 >> 172.21.15.89:0/3742023897 conn(0x7f72c00fa6f0 msgr2=0x7f72c00fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.569+0000 7f72c5b7d640 1 -- 172.21.15.89:0/3742023897 shutdown_connections 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.569+0000 7f72c5b7d640 1 -- 172.21.15.89:0/3742023897 wait complete. 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72c5b7d640 1 Processor -- start 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72c5b7d640 1 -- start start 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72c5b7d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 0x7f72c01949f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72c5b7d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c0104a10 0x7f72c0194f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72c5b7d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0195610 con 0x7f72c00fea10 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72c5b7d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0199360 con 0x7f72c0104a10 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 0x7f72c01949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 0x7f72c01949f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51496/0 (socket says 172.21.15.89:51496) 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72bf7fe640 1 -- 172.21.15.89:0/2870558477 learned_addr learned my addr 172.21.15.89:0/2870558477 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72bf7fe640 1 -- 172.21.15.89:0/2870558477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c0104a10 msgr2=0x7f72c0194f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:16.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.570+0000 7f72bf7fe640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c0104a10 0x7f72c0194f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.571+0000 7f72bf7fe640 1 -- 172.21.15.89:0/2870558477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8009560 con 0x7f72c00fea10 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.571+0000 7f72bf7fe640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 0x7f72c01949f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72b000d6f0 tx=0x7f72b000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.571+0000 7f72bd7fa640 1 -- 172.21.15.89:0/2870558477 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b0009a30 con 0x7f72c00fea10 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.571+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c0199640 con 0x7f72c00fea10 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.571+0000 7f72bd7fa640 1 -- 172.21.15.89:0/2870558477 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72b00054e0 con 0x7f72c00fea10 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.571+0000 7f72bd7fa640 1 -- 172.21.15.89:0/2870558477 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b0010460 con 0x7f72c00fea10 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.571+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c0199b90 con 0x7f72c00fea10 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.572+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c0100150 con 0x7f72c00fea10 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.572+0000 7f72bd7fa640 1 -- 172.21.15.89:0/2870558477 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f72b0009b90 con 0x7f72c00fea10 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.573+0000 7f72bd7fa640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f72ac06e600 0x7f72ac070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.573+0000 7f72bd7fa640 1 -- 172.21.15.89:0/2870558477 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f72b008e3e0 con 0x7f72c00fea10 2024-09-13T22:20:16.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.573+0000 7f72b7fff640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f72ac06e600 0x7f72ac070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:16.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.573+0000 7f72b7fff640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f72ac06e600 0x7f72ac070ac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72a802a9c0 tx=0x7f72a8000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:16.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.577+0000 7f72bd7fa640 1 -- 172.21.15.89:0/2870558477 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f72b00573b0 con 0x7f72c00fea10 2024-09-13T22:20:16.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.811+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f72c0106f80 con 0x7f72c00fea10 2024-09-13T22:20:16.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.812+0000 7f72bd7fa640 1 -- 172.21.15.89:0/2870558477 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f72b005aa70 con 0x7f72c00fea10 2024-09-13T22:20:16.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f72ac06e600 msgr2=0x7f72ac070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:16.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f72ac06e600 0x7f72ac070ac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72a802a9c0 tx=0x7f72a8000bc0 comp rx=0 tx=0).stop 2024-09-13T22:20:16.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 msgr2=0x7f72c01949f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:16.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 0x7f72c01949f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72b000d6f0 tx=0x7f72b000dbb0 comp rx=0 tx=0).stop 2024-09-13T22:20:16.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 shutdown_connections 2024-09-13T22:20:16.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f72ac06e600 0x7f72ac070ac0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:16.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72c0104a10 0x7f72c0194f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:16.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 --2- 172.21.15.89:0/2870558477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72c00fea10 0x7f72c01949f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:16.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 >> 172.21.15.89:0/2870558477 conn(0x7f72c00fa6f0 msgr2=0x7f72c00fb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:16.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 shutdown_connections 2024-09-13T22:20:16.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:16.814+0000 7f72c5b7d640 1 -- 172.21.15.89:0/2870558477 wait complete. 2024-09-13T22:20:16.824 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T22:20:17.534 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T22:20:17.735 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:17 smithi159 ceph-mon[82000]: pgmap v280: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:18.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:17 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2870558477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:20:18.082 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:17 smithi089 ceph-mon[109939]: pgmap v280: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:18.082 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:17 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2870558477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.351+0000 7efd0ae2f640 1 -- 172.21.15.89:0/2320055809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 msgr2=0x7efd041047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.351+0000 7efd0ae2f640 1 --2- 172.21.15.89:0/2320055809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 0x7efd041047a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efcec009880 tx=0x7efcec02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.351+0000 7efd0ae2f640 1 -- 172.21.15.89:0/2320055809 shutdown_connections 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.351+0000 7efd0ae2f640 1 --2- 172.21.15.89:0/2320055809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 0x7efd041047a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.351+0000 7efd0ae2f640 1 --2- 172.21.15.89:0/2320055809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd040ffda0 0x7efd04100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.351+0000 7efd0ae2f640 1 -- 172.21.15.89:0/2320055809 >> 172.21.15.89:0/2320055809 conn(0x7efd040fb840 msgr2=0x7efd040fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.351+0000 7efd0ae2f640 1 -- 172.21.15.89:0/2320055809 shutdown_connections 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.351+0000 7efd0ae2f640 1 -- 172.21.15.89:0/2320055809 wait complete. 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd0ae2f640 1 Processor -- start 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd0ae2f640 1 -- start start 2024-09-13T22:20:19.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd0ae2f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd040ffda0 0x7efd0419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:19.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd0ae2f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 0x7efd0419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:19.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd0ae2f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0419c480 con 0x7efd04100750 2024-09-13T22:20:19.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd0ae2f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd04195a10 con 0x7efd040ffda0 2024-09-13T22:20:19.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd03fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 0x7efd0419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:19.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd03fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 0x7efd0419be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51514/0 (socket says 172.21.15.89:51514) 2024-09-13T22:20:19.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd03fff640 1 -- 172.21.15.89:0/1580169237 learned_addr learned my addr 172.21.15.89:0/1580169237 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:19.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd08bcb640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd040ffda0 0x7efd0419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:19.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd03fff640 1 -- 172.21.15.89:0/1580169237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd040ffda0 msgr2=0x7efd0419b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:19.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd03fff640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd040ffda0 0x7efd0419b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd03fff640 1 -- 172.21.15.89:0/1580169237 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec009560 con 0x7efd04100750 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd03fff640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 0x7efd0419be60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efcec02a9c0 tx=0x7efcec0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.352+0000 7efd01ffb640 1 -- 172.21.15.89:0/1580169237 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcec004aa0 con 0x7efd04100750 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.353+0000 7efd01ffb640 1 -- 172.21.15.89:0/1580169237 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcec004c00 con 0x7efd04100750 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.353+0000 7efd01ffb640 1 -- 172.21.15.89:0/1580169237 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcec003ab0 con 0x7efd04100750 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.353+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd04195c90 con 0x7efd04100750 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.353+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd04196180 con 0x7efd04100750 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.354+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd04101280 con 0x7efd04100750 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.354+0000 7efd01ffb640 1 -- 172.21.15.89:0/1580169237 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efcec031d20 con 0x7efd04100750 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.355+0000 7efd01ffb640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7efcf006e5f0 0x7efcf0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.355+0000 7efd08bcb640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7efcf006e5f0 0x7efcf0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.355+0000 7efd01ffb640 1 -- 172.21.15.89:0/1580169237 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7efcec0af920 con 0x7efd04100750 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.355+0000 7efd08bcb640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7efcf006e5f0 0x7efcf0070ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009890 tx=0x7efcf4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.359+0000 7efd01ffb640 1 -- 172.21.15.89:0/1580169237 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efcec0788f0 con 0x7efd04100750 2024-09-13T22:20:19.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.589+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd04100200 con 0x7efd04100750 2024-09-13T22:20:19.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.590+0000 7efd01ffb640 1 -- 172.21.15.89:0/1580169237 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7efcec07bfb0 con 0x7efd04100750 2024-09-13T22:20:19.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7efcf006e5f0 msgr2=0x7efcf0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:19.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7efcf006e5f0 0x7efcf0070ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009890 tx=0x7efcf4008040 comp rx=0 tx=0).stop 2024-09-13T22:20:19.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 msgr2=0x7efd0419be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:19.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 0x7efd0419be60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efcec02a9c0 tx=0x7efcec0055a0 comp rx=0 tx=0).stop 2024-09-13T22:20:19.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 shutdown_connections 2024-09-13T22:20:19.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7efcf006e5f0 0x7efcf0070ab0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:19.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd04100750 0x7efd0419be60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:19.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 --2- 172.21.15.89:0/1580169237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd040ffda0 0x7efd0419b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:19.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 >> 172.21.15.89:0/1580169237 conn(0x7efd040fb840 msgr2=0x7efd040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:19.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 shutdown_connections 2024-09-13T22:20:19.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:19.592+0000 7efd0ae2f640 1 -- 172.21.15.89:0/1580169237 wait complete. 2024-09-13T22:20:19.601 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)" 2024-09-13T22:20:19.910 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:19 smithi089 ceph-mon[109939]: pgmap v281: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:19.910 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:19 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1580169237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:20:20.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:19 smithi159 ceph-mon[82000]: pgmap v281: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:20.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:19 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1580169237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:20:20.232 DEBUG:teuthology.parallel:result is None 2024-09-13T22:20:20.232 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:20:20.243 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:20:20.244 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 39489060-721b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T22:20:20.444 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:21.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:21 smithi089 ceph-mon[109939]: pgmap v282: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:21.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:21 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:20:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:21 smithi159 ceph-mon[82000]: pgmap v282: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:22.009 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:21 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:20:22.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.183+0000 7ff26d9c8640 1 -- 172.21.15.89:0/3511965545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 msgr2=0x7ff268105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:22.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.183+0000 7ff26d9c8640 1 --2- 172.21.15.89:0/3511965545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 0x7ff268105fd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff258009c20 tx=0x7ff25802a970 comp rx=0 tx=0).stop 2024-09-13T22:20:22.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.183+0000 7ff26d9c8640 1 -- 172.21.15.89:0/3511965545 shutdown_connections 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.183+0000 7ff26d9c8640 1 --2- 172.21.15.89:0/3511965545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2680ffb40 0x7ff2680fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.183+0000 7ff26d9c8640 1 --2- 172.21.15.89:0/3511965545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 0x7ff268105fd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.183+0000 7ff26d9c8640 1 -- 172.21.15.89:0/3511965545 >> 172.21.15.89:0/3511965545 conn(0x7ff2680fb860 msgr2=0x7ff2680fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.183+0000 7ff26d9c8640 1 -- 172.21.15.89:0/3511965545 shutdown_connections 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.183+0000 7ff26d9c8640 1 -- 172.21.15.89:0/3511965545 wait complete. 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.184+0000 7ff26d9c8640 1 Processor -- start 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.184+0000 7ff26d9c8640 1 -- start start 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff26d9c8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2680ffb40 0x7ff26819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff26d9c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 0x7ff26819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff26d9c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26819c470 con 0x7ff268105bf0 2024-09-13T22:20:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff26d9c8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff268195a50 con 0x7ff2680ffb40 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff2667fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 0x7ff26819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff2667fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 0x7ff26819be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51526/0 (socket says 172.21.15.89:51526) 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff2667fc640 1 -- 172.21.15.89:0/2314762560 learned_addr learned my addr 172.21.15.89:0/2314762560 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff266ffd640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2680ffb40 0x7ff26819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff2667fc640 1 -- 172.21.15.89:0/2314762560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2680ffb40 msgr2=0x7ff26819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff2667fc640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2680ffb40 0x7ff26819b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff2667fc640 1 -- 172.21.15.89:0/2314762560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff258009900 con 0x7ff268105bf0 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff266ffd640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2680ffb40 0x7ff26819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff2667fc640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 0x7ff26819be50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff25000b420 tx=0x7ff25000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff26c9c6640 1 -- 172.21.15.89:0/2314762560 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff250011800 con 0x7ff268105bf0 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff26c9c6640 1 -- 172.21.15.89:0/2314762560 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff250011e20 con 0x7ff268105bf0 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff268195d30 con 0x7ff268105bf0 2024-09-13T22:20:22.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.185+0000 7ff26c9c6640 1 -- 172.21.15.89:0/2314762560 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25000f2e0 con 0x7ff268105bf0 2024-09-13T22:20:22.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.186+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff268196300 con 0x7ff268105bf0 2024-09-13T22:20:22.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.186+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2681011f0 con 0x7ff268105bf0 2024-09-13T22:20:22.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.187+0000 7ff26c9c6640 1 -- 172.21.15.89:0/2314762560 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff250010380 con 0x7ff268105bf0 2024-09-13T22:20:22.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.187+0000 7ff26c9c6640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff25406e5f0 0x7ff254070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:22.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.188+0000 7ff26c9c6640 1 -- 172.21.15.89:0/2314762560 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7ff25008e1a0 con 0x7ff268105bf0 2024-09-13T22:20:22.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.188+0000 7ff266ffd640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff25406e5f0 0x7ff254070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:22.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.188+0000 7ff266ffd640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff25406e5f0 0x7ff254070ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2580098d0 tx=0x7ff258009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:22.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.192+0000 7ff26c9c6640 1 -- 172.21.15.89:0/2314762560 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff250057170 con 0x7ff268105bf0 2024-09-13T22:20:22.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.391+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff268100020 con 0x7ff268105bf0 2024-09-13T22:20:22.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.391+0000 7ff26c9c6640 1 -- 172.21.15.89:0/2314762560 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1973 (secure 0 0 0) 0x7ff25005a830 con 0x7ff268105bf0 2024-09-13T22:20:22.392 INFO:teuthology.orchestra.run.smithi089.stdout:e33 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T22:18:36:392588+0000 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 33 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T22:06:14.394509+0000 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T22:18:35.514679+0000 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T22:20:22.393 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 96 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=34374} 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T22:20:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data enabled 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 34374 members: 34374 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.euhfjz{0:34374} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.89:6826/3405070026,v1:172.21.15.89:6827/3405070026] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.egpifu{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6828/246571303,v1:172.21.15.89:6829/246571303] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:20:22.395 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.hqlvpx{-1:44291} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6824/1327575252,v1:172.21.15.159:6825/1327575252] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:20:22.396 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi159.rowsot{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/916810058,v1:172.21.15.159:6827/916810058] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T22:20:22.396 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 33 2024-09-13T22:20:22.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff25406e5f0 msgr2=0x7ff254070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:22.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff25406e5f0 0x7ff254070ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2580098d0 tx=0x7ff258009360 comp rx=0 tx=0).stop 2024-09-13T22:20:22.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 msgr2=0x7ff26819be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:22.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 0x7ff26819be50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff25000b420 tx=0x7ff25000b8e0 comp rx=0 tx=0).stop 2024-09-13T22:20:22.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 shutdown_connections 2024-09-13T22:20:22.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7ff25406e5f0 0x7ff254070ab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:22.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff268105bf0 0x7ff26819be50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:22.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 --2- 172.21.15.89:0/2314762560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2680ffb40 0x7ff26819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:22.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 >> 172.21.15.89:0/2314762560 conn(0x7ff2680fb860 msgr2=0x7ff2680fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:22.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 shutdown_connections 2024-09-13T22:20:22.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:22.393+0000 7ff26d9c8640 1 -- 172.21.15.89:0/2314762560 wait complete. 2024-09-13T22:20:22.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:22 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2314762560' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:20:23.064 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T22:20:23.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T22:20:23.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:22 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2314762560' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:20:23.277 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:23.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:23 smithi089 ceph-mon[109939]: pgmap v283: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:24.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:23 smithi159 ceph-mon[82000]: pgmap v283: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:24.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.909+0000 7f8577fe5640 1 -- 172.21.15.89:0/895040475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570101600 msgr2=0x7f8570109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.909+0000 7f8577fe5640 1 --2- 172.21.15.89:0/895040475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570101600 0x7f8570109af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f85640098b0 tx=0x7f856402a4d0 comp rx=0 tx=0).stop 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.909+0000 7f8577fe5640 1 -- 172.21.15.89:0/895040475 shutdown_connections 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.909+0000 7f8577fe5640 1 --2- 172.21.15.89:0/895040475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570101600 0x7f8570109af0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.909+0000 7f8577fe5640 1 --2- 172.21.15.89:0/895040475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8570100c50 0x7f8570101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.909+0000 7f8577fe5640 1 -- 172.21.15.89:0/895040475 >> 172.21.15.89:0/895040475 conn(0x7f85700fa700 msgr2=0x7f85700fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.909+0000 7f8577fe5640 1 -- 172.21.15.89:0/895040475 shutdown_connections 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.909+0000 7f8577fe5640 1 -- 172.21.15.89:0/895040475 wait complete. 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.910+0000 7f8577fe5640 1 Processor -- start 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.910+0000 7f8577fe5640 1 -- start start 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.910+0000 7f8577fe5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570100c50 0x7f85700fe940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.910+0000 7f8577fe5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8570101600 0x7f85700fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:24.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.910+0000 7f8577fe5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700ff3c0 con 0x7f8570100c50 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.910+0000 7f8577fe5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700ff530 con 0x7f8570101600 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.910+0000 7f8575d81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570100c50 0x7f85700fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.910+0000 7f8575d81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570100c50 0x7f85700fe940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57264/0 (socket says 172.21.15.89:57264) 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.910+0000 7f8575d81640 1 -- 172.21.15.89:0/4201205261 learned_addr learned my addr 172.21.15.89:0/4201205261 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f8575580640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8570101600 0x7f85700fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f8575d81640 1 -- 172.21.15.89:0/4201205261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8570101600 msgr2=0x7f85700fee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f8575d81640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8570101600 0x7f85700fee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f8575d81640 1 -- 172.21.15.89:0/4201205261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564009560 con 0x7f8570100c50 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f8575580640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8570101600 0x7f85700fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f8575d81640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570100c50 0x7f85700fe940 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f856000d6f0 tx=0x7f856000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f856effd640 1 -- 172.21.15.89:0/4201205261 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8560009a30 con 0x7f8570100c50 2024-09-13T22:20:24.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85701a1d00 con 0x7f8570100c50 2024-09-13T22:20:24.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f856effd640 1 -- 172.21.15.89:0/4201205261 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85600054e0 con 0x7f8570100c50 2024-09-13T22:20:24.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f856effd640 1 -- 172.21.15.89:0/4201205261 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8560010460 con 0x7f8570100c50 2024-09-13T22:20:24.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.911+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85701a2060 con 0x7f8570100c50 2024-09-13T22:20:24.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.912+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8570068d30 con 0x7f8570100c50 2024-09-13T22:20:24.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.913+0000 7f856effd640 1 -- 172.21.15.89:0/4201205261 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8560009b90 con 0x7f8570100c50 2024-09-13T22:20:24.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.913+0000 7f856effd640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f855806e5f0 0x7f8558070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:24.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.913+0000 7f856effd640 1 -- 172.21.15.89:0/4201205261 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f856008e3e0 con 0x7f8570100c50 2024-09-13T22:20:24.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.913+0000 7f8575580640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f855806e5f0 0x7f8558070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:24.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.914+0000 7f8575580640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f855806e5f0 0x7f8558070ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8564009230 tx=0x7f8564005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:24.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:24.918+0000 7f856effd640 1 -- 172.21.15.89:0/4201205261 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f85600573b0 con 0x7f8570100c50 2024-09-13T22:20:25.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.120+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8570101030 con 0x7f8570100c50 2024-09-13T22:20:25.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.120+0000 7f856effd640 1 -- 172.21.15.89:0/4201205261 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+5249 (secure 0 0 0) 0x7f856005aa70 con 0x7f8570100c50 2024-09-13T22:20:25.122 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:25.122 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":33,"btime":"2024-09-13T22:18:36:392588+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44291,"name":"cephfs.smithi159.hqlvpx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6825/1327575252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1327575252},{"type":"v1","addr":"172.21.15.159:6825","nonce":1327575252}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44321,"name":"cephfs.smithi159.rowsot","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/916810058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":916810058},{"type":"v1","addr":"172.21.15.159:6827","nonce":916810058}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:18:35.514679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":0,"incarnation":27,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34374,"qdb_cluster":[34374]},"id":1}]} 2024-09-13T22:20:25.122 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 33 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.122+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f855806e5f0 msgr2=0x7f8558070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.122+0000 7f8577fe5640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f855806e5f0 0x7f8558070ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8564009230 tx=0x7f8564005a20 comp rx=0 tx=0).stop 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.122+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570100c50 msgr2=0x7f85700fe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.122+0000 7f8577fe5640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570100c50 0x7f85700fe940 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f856000d6f0 tx=0x7f856000dbb0 comp rx=0 tx=0).stop 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.122+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 shutdown_connections 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.122+0000 7f8577fe5640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f855806e5f0 0x7f8558070ab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.122+0000 7f8577fe5640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8570101600 0x7f85700fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.122+0000 7f8577fe5640 1 --2- 172.21.15.89:0/4201205261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8570100c50 0x7f85700fe940 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.122+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 >> 172.21.15.89:0/4201205261 conn(0x7f85700fa700 msgr2=0x7f8570101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.123+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 shutdown_connections 2024-09-13T22:20:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:25.123+0000 7f8577fe5640 1 -- 172.21.15.89:0/4201205261 wait complete. 2024-09-13T22:20:25.849 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-09-13T22:20:25.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-13T22:20:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:26.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:25 smithi089 ceph-mon[109939]: pgmap v284: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:26.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:25 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/4201205261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:20:26.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:25 smithi159 ceph-mon[82000]: pgmap v284: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:26.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:25 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/4201205261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:20:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 -- 172.21.15.89:0/3149546133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40fe8c0 msgr2=0x7f7fb40feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 --2- 172.21.15.89:0/3149546133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40fe8c0 0x7f7fb40feca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009880 tx=0x7f7fa402a490 comp rx=0 tx=0).stop 2024-09-13T22:20:27.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 -- 172.21.15.89:0/3149546133 shutdown_connections 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 --2- 172.21.15.89:0/3149546133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fb40ff270 0x7f7fb410bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 --2- 172.21.15.89:0/3149546133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40fe8c0 0x7f7fb40feca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 -- 172.21.15.89:0/3149546133 >> 172.21.15.89:0/3149546133 conn(0x7f7fb40758a0 msgr2=0x7f7fb40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 -- 172.21.15.89:0/3149546133 shutdown_connections 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 -- 172.21.15.89:0/3149546133 wait complete. 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 Processor -- start 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.667+0000 7f7fbc769640 1 -- start start 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fbc769640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fb40fe8c0 0x7f7fb4197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fbc769640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40ff270 0x7f7fb41982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fbc769640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4198940 con 0x7f7fb40ff270 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fbc769640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb419c6b0 con 0x7f7fb40fe8c0 2024-09-13T22:20:27.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb9d04640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40ff270 0x7f7fb41982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb9d04640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40ff270 0x7f7fb41982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57288/0 (socket says 172.21.15.89:57288) 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb9d04640 1 -- 172.21.15.89:0/2801067550 learned_addr learned my addr 172.21.15.89:0/2801067550 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fba505640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fb40fe8c0 0x7f7fb4197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb9d04640 1 -- 172.21.15.89:0/2801067550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fb40fe8c0 msgr2=0x7f7fb4197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb9d04640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fb40fe8c0 0x7f7fb4197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb9d04640 1 -- 172.21.15.89:0/2801067550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009560 con 0x7f7fb40ff270 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fba505640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fb40fe8c0 0x7f7fb4197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb9d04640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40ff270 0x7f7fb41982b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800b420 tx=0x7f7fa800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb37fe640 1 -- 172.21.15.89:0/2801067550 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fa8011800 con 0x7f7fb40ff270 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb419c990 con 0x7f7fb40ff270 2024-09-13T22:20:27.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb37fe640 1 -- 172.21.15.89:0/2801067550 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fa8011e20 con 0x7f7fb40ff270 2024-09-13T22:20:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.668+0000 7f7fb37fe640 1 -- 172.21.15.89:0/2801067550 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fa800f2e0 con 0x7f7fb40ff270 2024-09-13T22:20:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.669+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb419cee0 con 0x7f7fb40ff270 2024-09-13T22:20:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.669+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4068490 con 0x7f7fb40ff270 2024-09-13T22:20:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.670+0000 7f7fb37fe640 1 -- 172.21.15.89:0/2801067550 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7fa8010380 con 0x7f7fb40ff270 2024-09-13T22:20:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.670+0000 7f7fb37fe640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7f9c06e5f0 0x7f7f9c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.670+0000 7f7fb37fe640 1 -- 172.21.15.89:0/2801067550 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f7fa808e1a0 con 0x7f7fb40ff270 2024-09-13T22:20:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.670+0000 7f7fba505640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7f9c06e5f0 0x7f7f9c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.671+0000 7f7fba505640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7f9c06e5f0 0x7f7f9c070ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4000c00 tx=0x7f7fa4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:27.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.675+0000 7f7fb37fe640 1 -- 172.21.15.89:0/2801067550 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7fa8057170 con 0x7f7fb40ff270 2024-09-13T22:20:27.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.879+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f7fb40fed20 con 0x7f7fb40ff270 2024-09-13T22:20:27.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.880+0000 7f7fb37fe640 1 -- 172.21.15.89:0/2801067550 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v33) v1 ==== 107+0+4123 (secure 0 0 0) 0x7f7fa805a830 con 0x7f7fb40ff270 2024-09-13T22:20:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:27.881 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":16,"btime":"2024-09-13T22:16:58:069900+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14500,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6829/4253852693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":4253852693},{"type":"v1","addr":"172.21.15.89:6829","nonce":4253852693}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:06:34.551891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi159.hqlvpx","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6825/782752998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":782752998},{"type":"v1","addr":"172.21.15.159:6825","nonce":782752998}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:27.882 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 16 2024-09-13T22:20:27.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7f9c06e5f0 msgr2=0x7f7f9c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:27.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7f9c06e5f0 0x7f7f9c070ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4000c00 tx=0x7f7fa4005a20 comp rx=0 tx=0).stop 2024-09-13T22:20:27.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40ff270 msgr2=0x7f7fb41982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:27.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40ff270 0x7f7fb41982b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800b420 tx=0x7f7fa800b8e0 comp rx=0 tx=0).stop 2024-09-13T22:20:27.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 shutdown_connections 2024-09-13T22:20:27.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7f9c06e5f0 0x7f7f9c070ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:27.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb40ff270 0x7f7fb41982b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:27.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 --2- 172.21.15.89:0/2801067550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fb40fe8c0 0x7f7fb4197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:27.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 >> 172.21.15.89:0/2801067550 conn(0x7f7fb40758a0 msgr2=0x7f7fb40fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:27.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 shutdown_connections 2024-09-13T22:20:27.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:27.882+0000 7f7fbc769640 1 -- 172.21.15.89:0/2801067550 wait complete. 2024-09-13T22:20:27.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:27 smithi089 ceph-mon[109939]: pgmap v285: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:27 smithi159 ceph-mon[82000]: pgmap v285: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:28.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-13T22:20:28.715 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:29.095 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:28 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2801067550' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-13T22:20:29.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:28 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2801067550' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-13T22:20:30.026 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:29 smithi089 ceph-mon[109939]: pgmap v286: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:30.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:29 smithi159 ceph-mon[82000]: pgmap v286: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:30.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.365+0000 7f1edf124640 1 -- 172.21.15.89:0/2817486935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed8105c00 msgr2=0x7f1ed8105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:30.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.365+0000 7f1edf124640 1 --2- 172.21.15.89:0/2817486935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed8105c00 0x7f1ed8105fe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009880 tx=0x7f1ec802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:30.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.365+0000 7f1edf124640 1 -- 172.21.15.89:0/2817486935 shutdown_connections 2024-09-13T22:20:30.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.365+0000 7f1edf124640 1 --2- 172.21.15.89:0/2817486935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed80ffb50 0x7f1ed80fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:30.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.365+0000 7f1edf124640 1 --2- 172.21.15.89:0/2817486935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed8105c00 0x7f1ed8105fe0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:30.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.365+0000 7f1edf124640 1 -- 172.21.15.89:0/2817486935 >> 172.21.15.89:0/2817486935 conn(0x7f1ed80fb830 msgr2=0x7f1ed80fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:30.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.365+0000 7f1edf124640 1 -- 172.21.15.89:0/2817486935 shutdown_connections 2024-09-13T22:20:30.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.365+0000 7f1edf124640 1 -- 172.21.15.89:0/2817486935 wait complete. 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edf124640 1 Processor -- start 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edf124640 1 -- start start 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edf124640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed80ffb50 0x7f1ed80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edf124640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed8105c00 0x7f1ed8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edf124640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8073230 con 0x7f1ed80ffb50 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edf124640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80733a0 con 0x7f1ed8105c00 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edcec0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed80ffb50 0x7f1ed80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edcec0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed80ffb50 0x7f1ed80727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57310/0 (socket says 172.21.15.89:57310) 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edcec0640 1 -- 172.21.15.89:0/1599700130 learned_addr learned my addr 172.21.15.89:0/1599700130 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1ed7fff640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed8105c00 0x7f1ed8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edcec0640 1 -- 172.21.15.89:0/1599700130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed8105c00 msgr2=0x7f1ed8072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:30.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edcec0640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed8105c00 0x7f1ed8072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edcec0640 1 -- 172.21.15.89:0/1599700130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8009560 con 0x7f1ed80ffb50 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.366+0000 7f1edcec0640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed80ffb50 0x7f1ed80727b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1ec802a9c0 tx=0x7f1ec80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.367+0000 7f1ed5ffb640 1 -- 172.21.15.89:0/1599700130 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec8004aa0 con 0x7f1ed80ffb50 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.367+0000 7f1ed5ffb640 1 -- 172.21.15.89:0/1599700130 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ec8004c00 con 0x7f1ed80ffb50 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.367+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed8073620 con 0x7f1ed80ffb50 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.367+0000 7f1ed5ffb640 1 -- 172.21.15.89:0/1599700130 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec8003ab0 con 0x7f1ed80ffb50 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.367+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed81a2020 con 0x7f1ed80ffb50 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.368+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed8101200 con 0x7f1ed80ffb50 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.368+0000 7f1ed5ffb640 1 -- 172.21.15.89:0/1599700130 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1ec8031d20 con 0x7f1ed80ffb50 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.369+0000 7f1ed5ffb640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ec406e5f0 0x7f1ec4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.369+0000 7f1ed5ffb640 1 -- 172.21.15.89:0/1599700130 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f1ec80af7c0 con 0x7f1ed80ffb50 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.369+0000 7f1ed7fff640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ec406e5f0 0x7f1ec4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:30.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.369+0000 7f1ed7fff640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ec406e5f0 0x7f1ec4070ab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8073f30 tx=0x7f1ec0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.373+0000 7f1ed5ffb640 1 -- 172.21.15.89:0/1599700130 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1ec8078790 con 0x7f1ed80ffb50 2024-09-13T22:20:30.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.575+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f1ed8100030 con 0x7f1ed80ffb50 2024-09-13T22:20:30.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.575+0000 7f1ed5ffb640 1 -- 172.21.15.89:0/1599700130 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v33) v1 ==== 107+0+4970 (secure 0 0 0) 0x7f1ec807be50 con 0x7f1ed80ffb50 2024-09-13T22:20:30.577 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:30.577 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":17,"btime":"2024-09-13T22:17:01:785970+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14500,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.89:6829/4253852693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":4253852693},{"type":"v1","addr":"172.21.15.89:6829","nonce":4253852693}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:06:34.551891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi159.hqlvpx","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6825/782752998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":782752998},{"type":"v1","addr":"172.21.15.159:6825","nonce":782752998}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:30.577 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 17 2024-09-13T22:20:30.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.577+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ec406e5f0 msgr2=0x7f1ec4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:30.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.577+0000 7f1edf124640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ec406e5f0 0x7f1ec4070ab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8073f30 tx=0x7f1ec0008040 comp rx=0 tx=0).stop 2024-09-13T22:20:30.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.577+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed80ffb50 msgr2=0x7f1ed80727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:30.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.577+0000 7f1edf124640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed80ffb50 0x7f1ed80727b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1ec802a9c0 tx=0x7f1ec80055a0 comp rx=0 tx=0).stop 2024-09-13T22:20:30.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.578+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 shutdown_connections 2024-09-13T22:20:30.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.578+0000 7f1edf124640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1ec406e5f0 0x7f1ec4070ab0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:30.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.578+0000 7f1edf124640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ed8105c00 0x7f1ed8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:30.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.578+0000 7f1edf124640 1 --2- 172.21.15.89:0/1599700130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ed80ffb50 0x7f1ed80727b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:30.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.578+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 >> 172.21.15.89:0/1599700130 conn(0x7f1ed80fb830 msgr2=0x7f1ed80fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:30.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.578+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 shutdown_connections 2024-09-13T22:20:30.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:30.578+0000 7f1edf124640 1 -- 172.21.15.89:0/1599700130 wait complete. 2024-09-13T22:20:30.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:30 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1599700130' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T22:20:31.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:30 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1599700130' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T22:20:31.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-13T22:20:31.547 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:31.953 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:31 smithi089 ceph-mon[109939]: pgmap v287: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:32.160 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:31 smithi159 ceph-mon[82000]: pgmap v287: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:33.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.265+0000 7f1ded9a4640 1 -- 172.21.15.89:0/2406931436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de80ffda0 msgr2=0x7f1de8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:33.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.265+0000 7f1ded9a4640 1 --2- 172.21.15.89:0/2406931436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de80ffda0 0x7f1de8100180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009880 tx=0x7f1dd802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:33.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.265+0000 7f1ded9a4640 1 -- 172.21.15.89:0/2406931436 shutdown_connections 2024-09-13T22:20:33.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.265+0000 7f1ded9a4640 1 --2- 172.21.15.89:0/2406931436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de8100750 0x7f1de81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:33.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.265+0000 7f1ded9a4640 1 --2- 172.21.15.89:0/2406931436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de80ffda0 0x7f1de8100180 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.265+0000 7f1ded9a4640 1 -- 172.21.15.89:0/2406931436 >> 172.21.15.89:0/2406931436 conn(0x7f1de80fb840 msgr2=0x7f1de80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.265+0000 7f1ded9a4640 1 -- 172.21.15.89:0/2406931436 shutdown_connections 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.265+0000 7f1ded9a4640 1 -- 172.21.15.89:0/2406931436 wait complete. 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.266+0000 7f1ded9a4640 1 Processor -- start 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.266+0000 7f1ded9a4640 1 -- start start 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.266+0000 7f1ded9a4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80ffda0 0x7f1de8197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.266+0000 7f1ded9a4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8100750 0x7f1de8198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.266+0000 7f1ded9a4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81988f0 con 0x7f1de8100750 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.266+0000 7f1ded9a4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de819b560 con 0x7f1de80ffda0 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.266+0000 7f1de67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8100750 0x7f1de8198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.266+0000 7f1de67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8100750 0x7f1de8198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57342/0 (socket says 172.21.15.89:57342) 2024-09-13T22:20:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.266+0000 7f1de67fc640 1 -- 172.21.15.89:0/3626935285 learned_addr learned my addr 172.21.15.89:0/3626935285 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1de6ffd640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80ffda0 0x7f1de8197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1de67fc640 1 -- 172.21.15.89:0/3626935285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80ffda0 msgr2=0x7f1de8197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1de67fc640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80ffda0 0x7f1de8197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1de67fc640 1 -- 172.21.15.89:0/3626935285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8009560 con 0x7f1de8100750 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1de6ffd640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80ffda0 0x7f1de8197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1de67fc640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8100750 0x7f1de8198210 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c810 tx=0x7f1ddc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1dec9a2640 1 -- 172.21.15.89:0/3626935285 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc0041f0 con 0x7f1de8100750 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1dec9a2640 1 -- 172.21.15.89:0/3626935285 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ddc007e70 con 0x7f1de8100750 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de819b840 con 0x7f1de8100750 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1dec9a2640 1 -- 172.21.15.89:0/3626935285 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc0049d0 con 0x7f1de8100750 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.267+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de819bd90 con 0x7f1de8100750 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.268+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de8101280 con 0x7f1de8100750 2024-09-13T22:20:33.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.268+0000 7f1dec9a2640 1 -- 172.21.15.89:0/3626935285 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1ddc0079b0 con 0x7f1de8100750 2024-09-13T22:20:33.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.269+0000 7f1dec9a2640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1dd006e5f0 0x7f1dd0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:33.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.269+0000 7f1dec9a2640 1 -- 172.21.15.89:0/3626935285 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f1ddc08e6f0 con 0x7f1de8100750 2024-09-13T22:20:33.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.269+0000 7f1de6ffd640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1dd006e5f0 0x7f1dd0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:33.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.269+0000 7f1de6ffd640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1dd006e5f0 0x7f1dd0070ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8006010 tx=0x7f1dd8005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:33.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.273+0000 7f1dec9a2640 1 -- 172.21.15.89:0/3626935285 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1ddc057660 con 0x7f1de8100750 2024-09-13T22:20:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.473+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f1de8073f10 con 0x7f1de8100750 2024-09-13T22:20:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.474+0000 7f1dec9a2640 1 -- 172.21.15.89:0/3626935285 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v33) v1 ==== 107+0+4191 (secure 0 0 0) 0x7f1ddc05ad20 con 0x7f1de8100750 2024-09-13T22:20:33.475 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:33.475 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"btime":"2024-09-13T22:17:14:692510+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:06:34.551891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi159.hqlvpx","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6825/782752998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":782752998},{"type":"v1","addr":"172.21.15.159:6825","nonce":782752998}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 18 2024-09-13T22:20:33.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1dd006e5f0 msgr2=0x7f1dd0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:33.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1dd006e5f0 0x7f1dd0070ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8006010 tx=0x7f1dd8005e60 comp rx=0 tx=0).stop 2024-09-13T22:20:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8100750 msgr2=0x7f1de8198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8100750 0x7f1de8198210 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c810 tx=0x7f1ddc00ccd0 comp rx=0 tx=0).stop 2024-09-13T22:20:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 shutdown_connections 2024-09-13T22:20:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f1dd006e5f0 0x7f1dd0070ab0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8100750 0x7f1de8198210 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 --2- 172.21.15.89:0/3626935285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1de80ffda0 0x7f1de8197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 >> 172.21.15.89:0/3626935285 conn(0x7f1de80fb840 msgr2=0x7f1de80fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 shutdown_connections 2024-09-13T22:20:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:33.476+0000 7f1ded9a4640 1 -- 172.21.15.89:0/3626935285 wait complete. 2024-09-13T22:20:34.059 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:33 smithi089 ceph-mon[109939]: pgmap v288: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:34.059 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:33 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3626935285' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T22:20:34.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-13T22:20:34.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:33 smithi159 ceph-mon[82000]: pgmap v288: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:34.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:33 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3626935285' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T22:20:34.324 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:36.100 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:35 smithi089 ceph-mon[109939]: pgmap v289: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.098+0000 7f034bae8640 1 -- 172.21.15.89:0/2068304947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 msgr2=0x7f0344100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.098+0000 7f034bae8640 1 --2- 172.21.15.89:0/2068304947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 0x7f0344100180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0340009880 tx=0x7f034002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.098+0000 7f034bae8640 1 -- 172.21.15.89:0/2068304947 shutdown_connections 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.098+0000 7f034bae8640 1 --2- 172.21.15.89:0/2068304947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0344100750 0x7f03441047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.098+0000 7f034bae8640 1 --2- 172.21.15.89:0/2068304947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 0x7f0344100180 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.098+0000 7f034bae8640 1 -- 172.21.15.89:0/2068304947 >> 172.21.15.89:0/2068304947 conn(0x7f03440fb840 msgr2=0x7f03440fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.098+0000 7f034bae8640 1 -- 172.21.15.89:0/2068304947 shutdown_connections 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.098+0000 7f034bae8640 1 -- 172.21.15.89:0/2068304947 wait complete. 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.099+0000 7f034bae8640 1 Processor -- start 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.099+0000 7f034bae8640 1 -- start start 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.099+0000 7f034bae8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 0x7f034419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.099+0000 7f034bae8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0344100750 0x7f034419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.099+0000 7f034bae8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034419c480 con 0x7f03440ffda0 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.099+0000 7f034bae8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344195a10 con 0x7f0344100750 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.099+0000 7f0349884640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 0x7f034419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.099+0000 7f0349884640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 0x7f034419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33104/0 (socket says 172.21.15.89:33104) 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.099+0000 7f0349884640 1 -- 172.21.15.89:0/2881674355 learned_addr learned my addr 172.21.15.89:0/2881674355 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f0349083640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0344100750 0x7f034419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f0349884640 1 -- 172.21.15.89:0/2881674355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0344100750 msgr2=0x7f034419be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f0349884640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0344100750 0x7f034419be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f0349884640 1 -- 172.21.15.89:0/2881674355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0340009560 con 0x7f03440ffda0 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f0349884640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 0x7f034419b920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f034002a9c0 tx=0x7f03400055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f033affd640 1 -- 172.21.15.89:0/2881674355 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0340004aa0 con 0x7f03440ffda0 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0344195c90 con 0x7f03440ffda0 2024-09-13T22:20:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f033affd640 1 -- 172.21.15.89:0/2881674355 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0340004c00 con 0x7f03440ffda0 2024-09-13T22:20:36.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f033affd640 1 -- 172.21.15.89:0/2881674355 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0340003ab0 con 0x7f03440ffda0 2024-09-13T22:20:36.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.100+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0344196180 con 0x7f03440ffda0 2024-09-13T22:20:36.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.101+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0344101280 con 0x7f03440ffda0 2024-09-13T22:20:36.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.102+0000 7f033affd640 1 -- 172.21.15.89:0/2881674355 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0340003ce0 con 0x7f03440ffda0 2024-09-13T22:20:36.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.102+0000 7f033affd640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f033006e5f0 0x7f0330070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:36.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.102+0000 7f033affd640 1 -- 172.21.15.89:0/2881674355 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f03400af910 con 0x7f03440ffda0 2024-09-13T22:20:36.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.102+0000 7f0349083640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f033006e5f0 0x7f0330070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:36.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.102+0000 7f0349083640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f033006e5f0 0x7f0330070ab0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0344196e80 tx=0x7f0334008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:36.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.106+0000 7f033affd640 1 -- 172.21.15.89:0/2881674355 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f03400788e0 con 0x7f03440ffda0 2024-09-13T22:20:36.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:35 smithi159 ceph-mon[82000]: pgmap v289: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:36.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.307+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f03441080b0 con 0x7f03440ffda0 2024-09-13T22:20:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.308+0000 7f033affd640 1 -- 172.21.15.89:0/2881674355 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v33) v1 ==== 107+0+5035 (secure 0 0 0) 0x7f034007bfa0 con 0x7f03440ffda0 2024-09-13T22:20:36.309 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:36.309 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"btime":"2024-09-13T22:17:17:699529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:06:34.551891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi159.hqlvpx","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6825/782752998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":782752998},{"type":"v1","addr":"172.21.15.159:6825","nonce":782752998}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 19 2024-09-13T22:20:36.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f033006e5f0 msgr2=0x7f0330070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:36.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f033006e5f0 0x7f0330070ab0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0344196e80 tx=0x7f0334008040 comp rx=0 tx=0).stop 2024-09-13T22:20:36.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 msgr2=0x7f034419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:36.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 0x7f034419b920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f034002a9c0 tx=0x7f03400055a0 comp rx=0 tx=0).stop 2024-09-13T22:20:36.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 shutdown_connections 2024-09-13T22:20:36.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f033006e5f0 0x7f0330070ab0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:36.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0344100750 0x7f034419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:36.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 --2- 172.21.15.89:0/2881674355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03440ffda0 0x7f034419b920 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:36.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 >> 172.21.15.89:0/2881674355 conn(0x7f03440fb840 msgr2=0x7f03440fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:36.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 shutdown_connections 2024-09-13T22:20:36.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:36.310+0000 7f034bae8640 1 -- 172.21.15.89:0/2881674355 wait complete. 2024-09-13T22:20:36.982 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:36 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2881674355' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T22:20:36.982 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:36 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:20:37.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-13T22:20:37.205 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:37.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:36 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2881674355' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T22:20:37.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:36 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:20:37.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:37 smithi089 ceph-mon[109939]: pgmap v290: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:37.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:20:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:20:37.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:37 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:20:38.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:37 smithi159 ceph-mon[82000]: pgmap v290: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:38.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:20:38.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:20:38.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:37 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:20:38.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.889+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3628720879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4100d50 msgr2=0x7fb4e4101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:38.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.889+0000 7fb4e9aa7640 1 --2- 172.21.15.89:0/3628720879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4100d50 0x7fb4e4101130 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009880 tx=0x7fb4d402a530 comp rx=0 tx=0).stop 2024-09-13T22:20:38.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.889+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3628720879 shutdown_connections 2024-09-13T22:20:38.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.889+0000 7fb4e9aa7640 1 --2- 172.21.15.89:0/3628720879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e4101670 0x7fb4e4109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:38.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.889+0000 7fb4e9aa7640 1 --2- 172.21.15.89:0/3628720879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4100d50 0x7fb4e4101130 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:38.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.889+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3628720879 >> 172.21.15.89:0/3628720879 conn(0x7fb4e40758a0 msgr2=0x7fb4e40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:38.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.889+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3628720879 shutdown_connections 2024-09-13T22:20:38.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.889+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3628720879 wait complete. 2024-09-13T22:20:38.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4e9aa7640 1 Processor -- start 2024-09-13T22:20:38.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4e9aa7640 1 -- start start 2024-09-13T22:20:38.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4e9aa7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e4100d50 0x7fb4e419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:38.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4e9aa7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4101670 0x7fb4e419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:38.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4e9aa7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e419c3d0 con 0x7fb4e4101670 2024-09-13T22:20:38.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4e9aa7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4195960 con 0x7fb4e4100d50 2024-09-13T22:20:38.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4101670 0x7fb4e419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:38.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4101670 0x7fb4e419bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33112/0 (socket says 172.21.15.89:33112) 2024-09-13T22:20:38.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4dbfff640 1 -- 172.21.15.89:0/3577328128 learned_addr learned my addr 172.21.15.89:0/3577328128 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:38.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4e37fe640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e4100d50 0x7fb4e419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:38.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4dbfff640 1 -- 172.21.15.89:0/3577328128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e4100d50 msgr2=0x7fb4e419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:38.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4dbfff640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e4100d50 0x7fb4e419b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4dbfff640 1 -- 172.21.15.89:0/3577328128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4009560 con 0x7fb4e4101670 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.890+0000 7fb4e37fe640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e4100d50 0x7fb4e419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.891+0000 7fb4dbfff640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4101670 0x7fb4e419bdb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00c810 tx=0x7fb4cc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.891+0000 7fb4e17fa640 1 -- 172.21.15.89:0/3577328128 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4cc0041f0 con 0x7fb4e4101670 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.891+0000 7fb4e17fa640 1 -- 172.21.15.89:0/3577328128 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4cc007e70 con 0x7fb4e4101670 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.891+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e4195c40 con 0x7fb4e4101670 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.891+0000 7fb4e17fa640 1 -- 172.21.15.89:0/3577328128 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4cc0049d0 con 0x7fb4e4101670 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.891+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e4196190 con 0x7fb4e4101670 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.892+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e4068470 con 0x7fb4e4101670 2024-09-13T22:20:38.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.892+0000 7fb4e17fa640 1 -- 172.21.15.89:0/3577328128 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb4cc0079b0 con 0x7fb4e4101670 2024-09-13T22:20:38.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.893+0000 7fb4e17fa640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:38.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.893+0000 7fb4e17fa640 1 -- 172.21.15.89:0/3577328128 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fb4cc08e5c0 con 0x7fb4e4101670 2024-09-13T22:20:38.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.893+0000 7fb4e37fe640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:38.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.893+0000 7fb4e37fe640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4006010 tx=0x7fb4d4031400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:38.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:38.897+0000 7fb4e17fa640 1 -- 172.21.15.89:0/3577328128 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb4cc057610 con 0x7fb4e4101670 2024-09-13T22:20:38.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:38 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:20:38.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:38 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:20:38.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:38 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:20:39.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.098+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fb4e4101130 con 0x7fb4e4101670 2024-09-13T22:20:39.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.098+0000 7fb4e17fa640 1 -- 172.21.15.89:0/3577328128 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v33) v1 ==== 107+0+4245 (secure 0 0 0) 0x7fb4cc05acd0 con 0x7fb4e4101670 2024-09-13T22:20:39.100 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:39.100 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"btime":"2024-09-13T22:17:29:967228+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:17:29.966917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:39.100 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 20 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.100+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb4d006e5f0 msgr2=0x7fb4d0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.100+0000 7fb4e9aa7640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4006010 tx=0x7fb4d4031400 comp rx=0 tx=0).stop 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.100+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4101670 msgr2=0x7fb4e419bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.100+0000 7fb4e9aa7640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4101670 0x7fb4e419bdb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00c810 tx=0x7fb4cc00ccd0 comp rx=0 tx=0).stop 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.101+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 shutdown_connections 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.101+0000 7fb4e9aa7640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.101+0000 7fb4e9aa7640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4e4101670 0x7fb4e419bdb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.101+0000 7fb4e9aa7640 1 --2- 172.21.15.89:0/3577328128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e4100d50 0x7fb4e419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.101+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 >> 172.21.15.89:0/3577328128 conn(0x7fb4e40758a0 msgr2=0x7fb4e4101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:39.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.101+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 shutdown_connections 2024-09-13T22:20:39.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:39.101+0000 7fb4e9aa7640 1 -- 172.21.15.89:0/3577328128 wait complete. 2024-09-13T22:20:39.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:38 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:20:39.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:38 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:20:39.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:38 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' 2024-09-13T22:20:39.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-13T22:20:39.989 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:40.109 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:39 smithi089 ceph-mon[109939]: pgmap v291: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:40.110 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:39 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3577328128' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T22:20:40.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:39 smithi159 ceph-mon[82000]: pgmap v291: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:40.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:39 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3577328128' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T22:20:41.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.730+0000 7fa44d033640 1 -- 172.21.15.89:0/1039160996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 msgr2=0x7fa4480fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:41.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.730+0000 7fa44d033640 1 --2- 172.21.15.89:0/1039160996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 0x7fa4480fee50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa430009880 tx=0x7fa43002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:41.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.730+0000 7fa44d033640 1 -- 172.21.15.89:0/1039160996 shutdown_connections 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.730+0000 7fa44d033640 1 --2- 172.21.15.89:0/1039160996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 0x7fa4480fee50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.730+0000 7fa44d033640 1 --2- 172.21.15.89:0/1039160996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4481049f0 0x7fa448104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.730+0000 7fa44d033640 1 -- 172.21.15.89:0/1039160996 >> 172.21.15.89:0/1039160996 conn(0x7fa4480758a0 msgr2=0x7fa4480fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.730+0000 7fa44d033640 1 -- 172.21.15.89:0/1039160996 shutdown_connections 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.730+0000 7fa44d033640 1 -- 172.21.15.89:0/1039160996 wait complete. 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.731+0000 7fa44d033640 1 Processor -- start 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa44d033640 1 -- start start 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa44d033640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 0x7fa448194810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa44d033640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4481049f0 0x7fa448194d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa44d033640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa448195290 con 0x7fa4480fe9f0 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa44d033640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa448195400 con 0x7fa4481049f0 2024-09-13T22:20:41.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa446d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 0x7fa448194810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa446d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 0x7fa448194810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33116/0 (socket says 172.21.15.89:33116) 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa446d9d640 1 -- 172.21.15.89:0/1468623248 learned_addr learned my addr 172.21.15.89:0/1468623248 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa43e59c640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4481049f0 0x7fa448194d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa446d9d640 1 -- 172.21.15.89:0/1468623248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4481049f0 msgr2=0x7fa448194d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa446d9d640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4481049f0 0x7fa448194d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa446d9d640 1 -- 172.21.15.89:0/1468623248 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430009560 con 0x7fa4480fe9f0 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa43e59c640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4481049f0 0x7fa448194d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.732+0000 7fa446d9d640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 0x7fa448194810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa43800b420 tx=0x7fa43800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.733+0000 7fa444d99640 1 -- 172.21.15.89:0/1468623248 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa438011800 con 0x7fa4480fe9f0 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.733+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4481a1e80 con 0x7fa4480fe9f0 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.733+0000 7fa444d99640 1 -- 172.21.15.89:0/1468623248 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa438011e20 con 0x7fa4480fe9f0 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.733+0000 7fa444d99640 1 -- 172.21.15.89:0/1468623248 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa43800f2e0 con 0x7fa4480fe9f0 2024-09-13T22:20:41.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.733+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4481a21e0 con 0x7fa4480fe9f0 2024-09-13T22:20:41.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.734+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa448100130 con 0x7fa4480fe9f0 2024-09-13T22:20:41.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.734+0000 7fa444d99640 1 -- 172.21.15.89:0/1468623248 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa43800f5c0 con 0x7fa4480fe9f0 2024-09-13T22:20:41.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.735+0000 7fa444d99640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa43406e600 0x7fa434070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:41.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.735+0000 7fa444d99640 1 -- 172.21.15.89:0/1468623248 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fa43808e1f0 con 0x7fa4480fe9f0 2024-09-13T22:20:41.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.735+0000 7fa43e59c640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa43406e600 0x7fa434070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:41.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.735+0000 7fa43e59c640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa43406e600 0x7fa434070ac0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa430000c00 tx=0x7fa430005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:41.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.739+0000 7fa444d99640 1 -- 172.21.15.89:0/1468623248 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4380571c0 con 0x7fa4480fe9f0 2024-09-13T22:20:41.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.941+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fa448106fb0 con 0x7fa4480fe9f0 2024-09-13T22:20:41.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.942+0000 7fa444d99640 1 -- 172.21.15.89:0/1468623248 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v33) v1 ==== 107+0+4256 (secure 0 0 0) 0x7fa43805a880 con 0x7fa4480fe9f0 2024-09-13T22:20:41.944 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:41.945 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":21,"btime":"2024-09-13T22:17:29:972794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:17:29.972781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":0,"incarnation":21,"state":"up:replay","state_seq":2,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:41.945 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-09-13T22:20:41.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa43406e600 msgr2=0x7fa434070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:41.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa43406e600 0x7fa434070ac0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa430000c00 tx=0x7fa430005a20 comp rx=0 tx=0).stop 2024-09-13T22:20:41.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 msgr2=0x7fa448194810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:41.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 0x7fa448194810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa43800b420 tx=0x7fa43800b8e0 comp rx=0 tx=0).stop 2024-09-13T22:20:41.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 shutdown_connections 2024-09-13T22:20:41.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fa43406e600 0x7fa434070ac0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:41.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4481049f0 0x7fa448194d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:41.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 --2- 172.21.15.89:0/1468623248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4480fe9f0 0x7fa448194810 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:41.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 >> 172.21.15.89:0/1468623248 conn(0x7fa4480758a0 msgr2=0x7fa4480fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:41.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 shutdown_connections 2024-09-13T22:20:41.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:41.944+0000 7fa44d033640 1 -- 172.21.15.89:0/1468623248 wait complete. 2024-09-13T22:20:41.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:41 smithi089 ceph-mon[109939]: pgmap v292: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:42.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:41 smithi159 ceph-mon[82000]: pgmap v292: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:42.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-13T22:20:42.839 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:42.960 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:42 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1468623248' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T22:20:43.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:42 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1468623248' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T22:20:44.079 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:43 smithi159 ceph-mon[82000]: pgmap v293: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:44.132 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:43 smithi089 ceph-mon[109939]: pgmap v293: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:44.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.485+0000 7f6bd54c7640 1 -- 172.21.15.89:0/2361456539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 msgr2=0x7f6bd010bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:44.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.485+0000 7f6bd54c7640 1 --2- 172.21.15.89:0/2361456539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 0x7f6bd010bf40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009880 tx=0x7f6bb802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:44.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.485+0000 7f6bd54c7640 1 -- 172.21.15.89:0/2361456539 shutdown_connections 2024-09-13T22:20:44.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.485+0000 7f6bd54c7640 1 --2- 172.21.15.89:0/2361456539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 0x7f6bd010bf40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:44.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.485+0000 7f6bd54c7640 1 --2- 172.21.15.89:0/2361456539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd00fe8d0 0x7f6bd00fecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:44.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.485+0000 7f6bd54c7640 1 -- 172.21.15.89:0/2361456539 >> 172.21.15.89:0/2361456539 conn(0x7f6bd00fa700 msgr2=0x7f6bd00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:44.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.485+0000 7f6bd54c7640 1 -- 172.21.15.89:0/2361456539 shutdown_connections 2024-09-13T22:20:44.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.485+0000 7f6bd54c7640 1 -- 172.21.15.89:0/2361456539 wait complete. 2024-09-13T22:20:44.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.486+0000 7f6bd54c7640 1 Processor -- start 2024-09-13T22:20:44.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.486+0000 7f6bd54c7640 1 -- start start 2024-09-13T22:20:44.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bd54c7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd00fe8d0 0x7f6bd0197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:44.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bd54c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 0x7f6bd0198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:44.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bd54c7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd01988f0 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bd54c7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd019b560 con 0x7f6bd00fe8d0 2024-09-13T22:20:44.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bce7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 0x7f6bd0198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:44.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bce7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 0x7f6bd0198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39796/0 (socket says 172.21.15.89:39796) 2024-09-13T22:20:44.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bce7fc640 1 -- 172.21.15.89:0/3192015340 learned_addr learned my addr 172.21.15.89:0/3192015340 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:44.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bceffd640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd00fe8d0 0x7f6bd0197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:44.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bce7fc640 1 -- 172.21.15.89:0/3192015340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd00fe8d0 msgr2=0x7f6bd0197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:44.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bce7fc640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd00fe8d0 0x7f6bd0197cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:44.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bce7fc640 1 -- 172.21.15.89:0/3192015340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009560 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.487+0000 7f6bce7fc640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 0x7f6bd0198210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6bb802a9c0 tx=0x7f6bb8032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:44.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.488+0000 7f6bc7fff640 1 -- 172.21.15.89:0/3192015340 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb80037c0 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.488+0000 7f6bc7fff640 1 -- 172.21.15.89:0/3192015340 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bb8005d50 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.488+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd019b7e0 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.488+0000 7f6bc7fff640 1 -- 172.21.15.89:0/3192015340 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb803be30 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.488+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd019bcd0 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.489+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd0068cd0 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.489+0000 7f6bc7fff640 1 -- 172.21.15.89:0/3192015340 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6bb803b6d0 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.490+0000 7f6bc7fff640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f6bbc06e590 0x7f6bbc070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:44.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.490+0000 7f6bc7fff640 1 -- 172.21.15.89:0/3192015340 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f6bb80af680 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.490+0000 7f6bceffd640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f6bbc06e590 0x7f6bbc070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:44.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.490+0000 7f6bceffd640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f6bbc06e590 0x7f6bbc070a50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0005c40 tx=0x7f6bc0005bd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:44.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.494+0000 7f6bc7fff640 1 -- 172.21.15.89:0/3192015340 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6bb8078650 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.693+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f6bd0106670 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.693+0000 7f6bc7fff640 1 -- 172.21.15.89:0/3192015340 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v33) v1 ==== 107+0+4261 (secure 0 0 0) 0x7f6bb807bd10 con 0x7f6bd00ff1f0 2024-09-13T22:20:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:44.696 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"btime":"2024-09-13T22:17:37:627918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:17:37.192789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":168,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:44.696 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 22 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f6bbc06e590 msgr2=0x7f6bbc070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f6bbc06e590 0x7f6bbc070a50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0005c40 tx=0x7f6bc0005bd0 comp rx=0 tx=0).stop 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 msgr2=0x7f6bd0198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 0x7f6bd0198210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6bb802a9c0 tx=0x7f6bb8032bb0 comp rx=0 tx=0).stop 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 shutdown_connections 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f6bbc06e590 0x7f6bbc070a50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd00ff1f0 0x7f6bd0198210 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 --2- 172.21.15.89:0/3192015340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd00fe8d0 0x7f6bd0197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 >> 172.21.15.89:0/3192015340 conn(0x7f6bd00fa700 msgr2=0x7f6bd00fbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 shutdown_connections 2024-09-13T22:20:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:44.696+0000 7f6bd54c7640 1 -- 172.21.15.89:0/3192015340 wait complete. 2024-09-13T22:20:44.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:44 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/3192015340' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T22:20:45.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:44 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/3192015340' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T22:20:45.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-13T22:20:45.536 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:45.934 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:45 smithi089 ceph-mon[109939]: pgmap v294: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:46.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:45 smithi159 ceph-mon[82000]: pgmap v294: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:47.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.241+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/3190865587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 msgr2=0x7fd0d4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.241+0000 7fd0d9d6b640 1 --2- 172.21.15.89:0/3190865587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 0x7fd0d4100180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009880 tx=0x7fd0c402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.241+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/3190865587 shutdown_connections 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.241+0000 7fd0d9d6b640 1 --2- 172.21.15.89:0/3190865587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0d4100750 0x7fd0d41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.241+0000 7fd0d9d6b640 1 --2- 172.21.15.89:0/3190865587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 0x7fd0d4100180 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.241+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/3190865587 >> 172.21.15.89:0/3190865587 conn(0x7fd0d40fb840 msgr2=0x7fd0d40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.241+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/3190865587 shutdown_connections 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.241+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/3190865587 wait complete. 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d9d6b640 1 Processor -- start 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d9d6b640 1 -- start start 2024-09-13T22:20:47.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d9d6b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 0x7fd0d40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d9d6b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0d4100750 0x7fd0d4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d9d6b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d4073230 con 0x7fd0d40ffda0 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d9d6b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d40733a0 con 0x7fd0d4100750 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 0x7fd0d40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 0x7fd0d40727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39814/0 (socket says 172.21.15.89:39814) 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d37fe640 1 -- 172.21.15.89:0/1458920643 learned_addr learned my addr 172.21.15.89:0/1458920643 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.242+0000 7fd0d2ffd640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0d4100750 0x7fd0d4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.243+0000 7fd0d37fe640 1 -- 172.21.15.89:0/1458920643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0d4100750 msgr2=0x7fd0d4072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.243+0000 7fd0d37fe640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0d4100750 0x7fd0d4072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.243+0000 7fd0d37fe640 1 -- 172.21.15.89:0/1458920643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4009560 con 0x7fd0d40ffda0 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.243+0000 7fd0d37fe640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 0x7fd0d40727b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd0c402a9c0 tx=0x7fd0c40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.243+0000 7fd0d0ff9640 1 -- 172.21.15.89:0/1458920643 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c4004aa0 con 0x7fd0d40ffda0 2024-09-13T22:20:47.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.243+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d4073620 con 0x7fd0d40ffda0 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.243+0000 7fd0d0ff9640 1 -- 172.21.15.89:0/1458920643 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0c4004c00 con 0x7fd0d40ffda0 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.243+0000 7fd0d0ff9640 1 -- 172.21.15.89:0/1458920643 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c4003980 con 0x7fd0d40ffda0 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.243+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d41a1ef0 con 0x7fd0d40ffda0 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.244+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d4101280 con 0x7fd0d40ffda0 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.244+0000 7fd0d0ff9640 1 -- 172.21.15.89:0/1458920643 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd0c4003bf0 con 0x7fd0d40ffda0 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.245+0000 7fd0d0ff9640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd0bc06e5f0 0x7fd0bc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.245+0000 7fd0d0ff9640 1 -- 172.21.15.89:0/1458920643 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fd0c40af710 con 0x7fd0d40ffda0 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.245+0000 7fd0d2ffd640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd0bc06e5f0 0x7fd0bc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.245+0000 7fd0d2ffd640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd0bc06e5f0 0x7fd0bc070ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8005fd0 tx=0x7fd0c8005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:47.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.250+0000 7fd0d0ff9640 1 -- 172.21.15.89:0/1458920643 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd0c40786e0 con 0x7fd0d40ffda0 2024-09-13T22:20:47.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.451+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fd0d4073620 con 0x7fd0d40ffda0 2024-09-13T22:20:47.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.452+0000 7fd0d0ff9640 1 -- 172.21.15.89:0/1458920643 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v33) v1 ==== 107+0+4258 (secure 0 0 0) 0x7fd0d4073620 con 0x7fd0d40ffda0 2024-09-13T22:20:47.454 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:47.455 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"btime":"2024-09-13T22:17:38:632678+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:17:37.637337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":169,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:47.455 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 23 2024-09-13T22:20:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd0bc06e5f0 msgr2=0x7fd0bc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd0bc06e5f0 0x7fd0bc070ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8005fd0 tx=0x7fd0c8005850 comp rx=0 tx=0).stop 2024-09-13T22:20:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 msgr2=0x7fd0d40727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 0x7fd0d40727b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd0c402a9c0 tx=0x7fd0c40055a0 comp rx=0 tx=0).stop 2024-09-13T22:20:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 shutdown_connections 2024-09-13T22:20:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fd0bc06e5f0 0x7fd0bc070ab0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0d4100750 0x7fd0d4072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 --2- 172.21.15.89:0/1458920643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d40ffda0 0x7fd0d40727b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:47.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 >> 172.21.15.89:0/1458920643 conn(0x7fd0d40fb840 msgr2=0x7fd0d40fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:47.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 shutdown_connections 2024-09-13T22:20:47.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:47.454+0000 7fd0d9d6b640 1 -- 172.21.15.89:0/1458920643 wait complete. 2024-09-13T22:20:48.113 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:47 smithi089 ceph-mon[109939]: pgmap v295: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:48.113 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:47 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1458920643' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T22:20:48.134 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-13T22:20:48.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:47 smithi159 ceph-mon[82000]: pgmap v295: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:48.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:47 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1458920643' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T22:20:48.336 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:50.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.004+0000 7fde80f75640 1 -- 172.21.15.89:0/1806879639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c0fe9f0 msgr2=0x7fde7c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:50.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.004+0000 7fde80f75640 1 --2- 172.21.15.89:0/1806879639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c0fe9f0 0x7fde7c0fee50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fde70009880 tx=0x7fde7002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:50.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.004+0000 7fde80f75640 1 -- 172.21.15.89:0/1806879639 shutdown_connections 2024-09-13T22:20:50.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.004+0000 7fde80f75640 1 --2- 172.21.15.89:0/1806879639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c0fe9f0 0x7fde7c0fee50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:50.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.004+0000 7fde80f75640 1 --2- 172.21.15.89:0/1806879639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde7c1049f0 0x7fde7c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:50.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.004+0000 7fde80f75640 1 -- 172.21.15.89:0/1806879639 >> 172.21.15.89:0/1806879639 conn(0x7fde7c0758a0 msgr2=0x7fde7c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:50.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.004+0000 7fde80f75640 1 -- 172.21.15.89:0/1806879639 shutdown_connections 2024-09-13T22:20:50.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.004+0000 7fde80f75640 1 -- 172.21.15.89:0/1806879639 wait complete. 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde80f75640 1 Processor -- start 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde80f75640 1 -- start start 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde80f75640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde7c0fe9f0 0x7fde7c196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde80f75640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1049f0 0x7fde7c196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde80f75640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c197490 con 0x7fde7c1049f0 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde80f75640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c197600 con 0x7fde7c0fe9f0 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde79d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1049f0 0x7fde7c196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde79d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1049f0 0x7fde7c196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39840/0 (socket says 172.21.15.89:39840) 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde79d9b640 1 -- 172.21.15.89:0/2755285260 learned_addr learned my addr 172.21.15.89:0/2755285260 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:50.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde7a59c640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde7c0fe9f0 0x7fde7c196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde79d9b640 1 -- 172.21.15.89:0/2755285260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde7c0fe9f0 msgr2=0x7fde7c196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde79d9b640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde7c0fe9f0 0x7fde7c196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.005+0000 7fde79d9b640 1 -- 172.21.15.89:0/2755285260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009560 con 0x7fde7c1049f0 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.006+0000 7fde79d9b640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1049f0 0x7fde7c196ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde7002a9c0 tx=0x7fde700055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.006+0000 7fde6b7fe640 1 -- 172.21.15.89:0/2755285260 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde70004aa0 con 0x7fde7c1049f0 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.006+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c19f9f0 con 0x7fde7c1049f0 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.006+0000 7fde6b7fe640 1 -- 172.21.15.89:0/2755285260 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde70004c00 con 0x7fde7c1049f0 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.006+0000 7fde6b7fe640 1 -- 172.21.15.89:0/2755285260 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde70003980 con 0x7fde7c1049f0 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.006+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c19fd50 con 0x7fde7c1049f0 2024-09-13T22:20:50.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.007+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c100130 con 0x7fde7c1049f0 2024-09-13T22:20:50.010 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:49 smithi089 ceph-mon[109939]: pgmap v296: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:50.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.007+0000 7fde6b7fe640 1 -- 172.21.15.89:0/2755285260 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fde70003bf0 con 0x7fde7c1049f0 2024-09-13T22:20:50.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.008+0000 7fde6b7fe640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fde6406e5f0 0x7fde64070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:50.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.008+0000 7fde6b7fe640 1 -- 172.21.15.89:0/2755285260 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fde700af810 con 0x7fde7c1049f0 2024-09-13T22:20:50.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.008+0000 7fde7a59c640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fde6406e5f0 0x7fde64070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:50.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.008+0000 7fde7a59c640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fde6406e5f0 0x7fde64070ab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fde6c005fd0 tx=0x7fde6c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:50.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.012+0000 7fde6b7fe640 1 -- 172.21.15.89:0/2755285260 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fde70078890 con 0x7fde7c1049f0 2024-09-13T22:20:50.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.211+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fde7c0fee50 con 0x7fde7c1049f0 2024-09-13T22:20:50.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.211+0000 7fde6b7fe640 1 -- 172.21.15.89:0/2755285260 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v33) v1 ==== 107+0+4267 (secure 0 0 0) 0x7fde7c0fee50 con 0x7fde7c1049f0 2024-09-13T22:20:50.213 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:50.213 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":24,"btime":"2024-09-13T22:17:39:642389+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:17:39.642388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":0,"incarnation":21,"state":"up:active","state_seq":170,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24255,"qdb_cluster":[24255]},"id":1}]} 2024-09-13T22:20:50.213 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 24 2024-09-13T22:20:50.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.213+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fde6406e5f0 msgr2=0x7fde64070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:50.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.213+0000 7fde80f75640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fde6406e5f0 0x7fde64070ab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fde6c005fd0 tx=0x7fde6c00b390 comp rx=0 tx=0).stop 2024-09-13T22:20:50.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.214+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1049f0 msgr2=0x7fde7c196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:50.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.214+0000 7fde80f75640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1049f0 0x7fde7c196ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde7002a9c0 tx=0x7fde700055a0 comp rx=0 tx=0).stop 2024-09-13T22:20:50.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.214+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 shutdown_connections 2024-09-13T22:20:50.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.214+0000 7fde80f75640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fde6406e5f0 0x7fde64070ab0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:50.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.214+0000 7fde80f75640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde7c1049f0 0x7fde7c196ec0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:50.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.214+0000 7fde80f75640 1 --2- 172.21.15.89:0/2755285260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde7c0fe9f0 0x7fde7c196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:50.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.214+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 >> 172.21.15.89:0/2755285260 conn(0x7fde7c0758a0 msgr2=0x7fde7c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:50.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.214+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 shutdown_connections 2024-09-13T22:20:50.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:50.214+0000 7fde80f75640 1 -- 172.21.15.89:0/2755285260 wait complete. 2024-09-13T22:20:50.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:49 smithi159 ceph-mon[82000]: pgmap v296: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:50.921 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:50 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2755285260' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T22:20:50.948 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-13T22:20:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:51.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:50 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2755285260' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T22:20:51.979 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:51 smithi089 ceph-mon[109939]: pgmap v297: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:51.979 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:51 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:20:52.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:51 smithi159 ceph-mon[82000]: pgmap v297: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:52.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:51 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:20:52.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.897+0000 7f487c26b640 1 -- 172.21.15.89:0/2667417108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48740fea30 msgr2=0x7f48740fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:52.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.897+0000 7f487c26b640 1 --2- 172.21.15.89:0/2667417108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48740fea30 0x7f48740fee90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4864009880 tx=0x7f486402a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:52.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.897+0000 7f487c26b640 1 -- 172.21.15.89:0/2667417108 shutdown_connections 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.897+0000 7f487c26b640 1 --2- 172.21.15.89:0/2667417108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48740fea30 0x7f48740fee90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.897+0000 7f487c26b640 1 --2- 172.21.15.89:0/2667417108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4874104a30 0x7f4874104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.897+0000 7f487c26b640 1 -- 172.21.15.89:0/2667417108 >> 172.21.15.89:0/2667417108 conn(0x7f48740fa730 msgr2=0x7f48740fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f487c26b640 1 -- 172.21.15.89:0/2667417108 shutdown_connections 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f487c26b640 1 -- 172.21.15.89:0/2667417108 wait complete. 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f487c26b640 1 Processor -- start 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f487c26b640 1 -- start start 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f487c26b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48740fea30 0x7f48740fb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f487c26b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4874104a30 0x7f48740fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f487c26b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48740fbaa0 con 0x7f4874104a30 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f487c26b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48740fbc10 con 0x7f48740fea30 2024-09-13T22:20:52.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f4879806640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4874104a30 0x7f48740fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f4879806640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4874104a30 0x7f48740fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39860/0 (socket says 172.21.15.89:39860) 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.898+0000 7f4879806640 1 -- 172.21.15.89:0/984652186 learned_addr learned my addr 172.21.15.89:0/984652186 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f487a007640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48740fea30 0x7f48740fb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f4879806640 1 -- 172.21.15.89:0/984652186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48740fea30 msgr2=0x7f48740fb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f4879806640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48740fea30 0x7f48740fb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f4879806640 1 -- 172.21.15.89:0/984652186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864009560 con 0x7f4874104a30 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f487a007640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48740fea30 0x7f48740fb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f4879806640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4874104a30 0x7f48740fb560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f486402a9c0 tx=0x7f48640055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f486b7fe640 1 -- 172.21.15.89:0/984652186 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4864004aa0 con 0x7f4874104a30 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f486b7fe640 1 -- 172.21.15.89:0/984652186 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4864004c00 con 0x7f4874104a30 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48740fbe90 con 0x7f4874104a30 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f486b7fe640 1 -- 172.21.15.89:0/984652186 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4864003ab0 con 0x7f4874104a30 2024-09-13T22:20:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.899+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48741a1ef0 con 0x7f4874104a30 2024-09-13T22:20:52.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.900+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4874100170 con 0x7f4874104a30 2024-09-13T22:20:52.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.901+0000 7f486b7fe640 1 -- 172.21.15.89:0/984652186 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4864031d20 con 0x7f4874104a30 2024-09-13T22:20:52.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.901+0000 7f486b7fe640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f486006e5f0 0x7f4860070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:52.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.901+0000 7f487a007640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f486006e5f0 0x7f4860070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:52.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.901+0000 7f486b7fe640 1 -- 172.21.15.89:0/984652186 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f48640af7c0 con 0x7f4874104a30 2024-09-13T22:20:52.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.901+0000 7f487a007640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f486006e5f0 0x7f4860070ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48700058c0 tx=0x7f4870005ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:52.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:52.905+0000 7f486b7fe640 1 -- 172.21.15.89:0/984652186 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4864078790 con 0x7f4874104a30 2024-09-13T22:20:53.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.106+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f48740fbe60 con 0x7f4874104a30 2024-09-13T22:20:53.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.107+0000 7f486b7fe640 1 -- 172.21.15.89:0/984652186 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v33) v1 ==== 107+0+5117 (secure 0 0 0) 0x7f486407be50 con 0x7f4874104a30 2024-09-13T22:20:53.108 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:53.108 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":25,"btime":"2024-09-13T22:17:44:653771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44291,"name":"cephfs.smithi159.hqlvpx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6825/1327575252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1327575252},{"type":"v1","addr":"172.21.15.159:6825","nonce":1327575252}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:17:39.642388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi159.rowsot","rank":0,"incarnation":21,"state":"up:active","state_seq":170,"addr":"172.21.15.159:6827/2640700709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2640700709},{"type":"v1","addr":"172.21.15.159:6827","nonce":2640700709}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24255,"qdb_cluster":[24255]},"id":1}]} 2024-09-13T22:20:53.108 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 25 2024-09-13T22:20:53.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f486006e5f0 msgr2=0x7f4860070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:53.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f486006e5f0 0x7f4860070ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48700058c0 tx=0x7f4870005ec0 comp rx=0 tx=0).stop 2024-09-13T22:20:53.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4874104a30 msgr2=0x7f48740fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:53.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4874104a30 0x7f48740fb560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f486402a9c0 tx=0x7f48640055a0 comp rx=0 tx=0).stop 2024-09-13T22:20:53.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 shutdown_connections 2024-09-13T22:20:53.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f486006e5f0 0x7f4860070ab0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:53.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4874104a30 0x7f48740fb560 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:53.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 --2- 172.21.15.89:0/984652186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48740fea30 0x7f48740fb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:53.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 >> 172.21.15.89:0/984652186 conn(0x7f48740fa730 msgr2=0x7f4874068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:53.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 shutdown_connections 2024-09-13T22:20:53.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:53.109+0000 7f487c26b640 1 -- 172.21.15.89:0/984652186 wait complete. 2024-09-13T22:20:53.826 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-13T22:20:54.026 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:54.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:53 smithi089 ceph-mon[109939]: pgmap v298: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:54.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:53 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/984652186' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T22:20:54.236 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:53 smithi159 ceph-mon[82000]: pgmap v298: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:54.274 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:53 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/984652186' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T22:20:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.597+0000 7f8857719640 1 -- 172.21.15.89:0/876875784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88500fea20 msgr2=0x7f88500fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.597+0000 7f8857719640 1 --2- 172.21.15.89:0/876875784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88500fea20 0x7f88500fee80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8844009c20 tx=0x7f884402a970 comp rx=0 tx=0).stop 2024-09-13T22:20:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.597+0000 7f8857719640 1 -- 172.21.15.89:0/876875784 shutdown_connections 2024-09-13T22:20:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.597+0000 7f8857719640 1 --2- 172.21.15.89:0/876875784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88500fea20 0x7f88500fee80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.597+0000 7f8857719640 1 --2- 172.21.15.89:0/876875784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8850104a20 0x7f8850104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:55.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.597+0000 7f8857719640 1 -- 172.21.15.89:0/876875784 >> 172.21.15.89:0/876875784 conn(0x7f88500fa700 msgr2=0x7f88500fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.597+0000 7f8857719640 1 -- 172.21.15.89:0/876875784 shutdown_connections 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.597+0000 7f8857719640 1 -- 172.21.15.89:0/876875784 wait complete. 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8857719640 1 Processor -- start 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8857719640 1 -- start start 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8857719640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88500fea20 0x7f8850196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8857719640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8850104a20 0x7f8850196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8857719640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850197530 con 0x7f8850104a20 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8857719640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88501976a0 con 0x7f88500fea20 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8854cb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8850104a20 0x7f8850196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8854cb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8850104a20 0x7f8850196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58786/0 (socket says 172.21.15.89:58786) 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8854cb4640 1 -- 172.21.15.89:0/2677730415 learned_addr learned my addr 172.21.15.89:0/2677730415 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8854cb4640 1 -- 172.21.15.89:0/2677730415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88500fea20 msgr2=0x7f8850196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8854cb4640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88500fea20 0x7f8850196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:55.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.598+0000 7f8854cb4640 1 -- 172.21.15.89:0/2677730415 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009900 con 0x7f8850104a20 2024-09-13T22:20:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.599+0000 7f8854cb4640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8850104a20 0x7f8850196ff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f884402ae90 tx=0x7f88440308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.599+0000 7f884e7fc640 1 -- 172.21.15.89:0/2677730415 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f884402f590 con 0x7f8850104a20 2024-09-13T22:20:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.599+0000 7f884e7fc640 1 -- 172.21.15.89:0/2677730415 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8844030ca0 con 0x7f8850104a20 2024-09-13T22:20:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.599+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8850197920 con 0x7f8850104a20 2024-09-13T22:20:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.599+0000 7f884e7fc640 1 -- 172.21.15.89:0/2677730415 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8844039680 con 0x7f8850104a20 2024-09-13T22:20:55.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.599+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885019fe50 con 0x7f8850104a20 2024-09-13T22:20:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.600+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8850100160 con 0x7f8850104a20 2024-09-13T22:20:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.600+0000 7f884e7fc640 1 -- 172.21.15.89:0/2677730415 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f884400a040 con 0x7f8850104a20 2024-09-13T22:20:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.601+0000 7f884e7fc640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f883806e5f0 0x7f8838070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.601+0000 7f884e7fc640 1 -- 172.21.15.89:0/2677730415 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f884402c040 con 0x7f8850104a20 2024-09-13T22:20:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.601+0000 7f88554b5640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f883806e5f0 0x7f8838070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:55.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.601+0000 7f88554b5640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f883806e5f0 0x7f8838070ab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8848009710 tx=0x7f8848006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:55.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.605+0000 7f884e7fc640 1 -- 172.21.15.89:0/2677730415 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8844078cd0 con 0x7f8850104a20 2024-09-13T22:20:55.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.806+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f8850197920 con 0x7f8850104a20 2024-09-13T22:20:55.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.807+0000 7f884e7fc640 1 -- 172.21.15.89:0/2677730415 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v33) v1 ==== 107+0+4313 (secure 0 0 0) 0x7f8850197920 con 0x7f8850104a20 2024-09-13T22:20:55.809 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:55.809 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"btime":"2024-09-13T22:17:53:781671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44291,"name":"cephfs.smithi159.hqlvpx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6825/1327575252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1327575252},{"type":"v1","addr":"172.21.15.159:6825","nonce":1327575252}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:17:53.781669+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:55.809 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 26 2024-09-13T22:20:55.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.809+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f883806e5f0 msgr2=0x7f8838070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.809+0000 7f8857719640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f883806e5f0 0x7f8838070ab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8848009710 tx=0x7f8848006c90 comp rx=0 tx=0).stop 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.809+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8850104a20 msgr2=0x7f8850196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.809+0000 7f8857719640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8850104a20 0x7f8850196ff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f884402ae90 tx=0x7f88440308a0 comp rx=0 tx=0).stop 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.809+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 shutdown_connections 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.809+0000 7f8857719640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f883806e5f0 0x7f8838070ab0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.809+0000 7f8857719640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8850104a20 0x7f8850196ff0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.809+0000 7f8857719640 1 --2- 172.21.15.89:0/2677730415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88500fea20 0x7f8850196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.809+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 >> 172.21.15.89:0/2677730415 conn(0x7f88500fa700 msgr2=0x7f88500fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.810+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 shutdown_connections 2024-09-13T22:20:55.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:55.810+0000 7f8857719640 1 -- 172.21.15.89:0/2677730415 wait complete. 2024-09-13T22:20:56.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:55 smithi089 ceph-mon[109939]: pgmap v299: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:56.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:55 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2677730415' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T22:20:56.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:55 smithi159 ceph-mon[82000]: pgmap v299: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:56.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:55 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2677730415' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T22:20:56.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-13T22:20:56.650 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:58.180 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:57 smithi089 ceph-mon[109939]: pgmap v300: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:58.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:57 smithi159 ceph-mon[82000]: pgmap v300: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:20:58.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.406+0000 7f9ef8aba640 1 -- 172.21.15.89:0/2370847499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef40fea20 msgr2=0x7f9ef40fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.406+0000 7f9ef8aba640 1 --2- 172.21.15.89:0/2370847499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef40fea20 0x7f9ef40fee80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009880 tx=0x7f9edc02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.406+0000 7f9ef8aba640 1 -- 172.21.15.89:0/2370847499 shutdown_connections 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.406+0000 7f9ef8aba640 1 --2- 172.21.15.89:0/2370847499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef40fea20 0x7f9ef40fee80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.406+0000 7f9ef8aba640 1 --2- 172.21.15.89:0/2370847499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef4104a20 0x7f9ef4104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.406+0000 7f9ef8aba640 1 -- 172.21.15.89:0/2370847499 >> 172.21.15.89:0/2370847499 conn(0x7f9ef40fa700 msgr2=0x7f9ef40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.406+0000 7f9ef8aba640 1 -- 172.21.15.89:0/2370847499 shutdown_connections 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.406+0000 7f9ef8aba640 1 -- 172.21.15.89:0/2370847499 wait complete. 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.407+0000 7f9ef8aba640 1 Processor -- start 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.407+0000 7f9ef8aba640 1 -- start start 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.407+0000 7f9ef8aba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef40fea20 0x7f9ef419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.407+0000 7f9ef8aba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef4104a20 0x7f9ef419bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.407+0000 7f9ef8aba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef419c4c0 con 0x7f9ef4104a20 2024-09-13T22:20:58.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.407+0000 7f9ef8aba640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4195a50 con 0x7f9ef40fea20 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef4104a20 0x7f9ef419bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef4104a20 0x7f9ef419bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58814/0 (socket says 172.21.15.89:58814) 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eebfff640 1 -- 172.21.15.89:0/145913916 learned_addr learned my addr 172.21.15.89:0/145913916 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9ef259c640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef40fea20 0x7f9ef419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eebfff640 1 -- 172.21.15.89:0/145913916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef40fea20 msgr2=0x7f9ef419b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eebfff640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef40fea20 0x7f9ef419b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eebfff640 1 -- 172.21.15.89:0/145913916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009560 con 0x7f9ef4104a20 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eebfff640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef4104a20 0x7f9ef419bea0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9edc02a9c0 tx=0x7f9edc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eeb7fe640 1 -- 172.21.15.89:0/145913916 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9edc004aa0 con 0x7f9ef4104a20 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eeb7fe640 1 -- 172.21.15.89:0/145913916 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9edc004c00 con 0x7f9ef4104a20 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef4195cd0 con 0x7f9ef4104a20 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9eeb7fe640 1 -- 172.21.15.89:0/145913916 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9edc003ab0 con 0x7f9ef4104a20 2024-09-13T22:20:58.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.408+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef41961c0 con 0x7f9ef4104a20 2024-09-13T22:20:58.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.409+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef4100160 con 0x7f9ef4104a20 2024-09-13T22:20:58.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.410+0000 7f9eeb7fe640 1 -- 172.21.15.89:0/145913916 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9edc003ce0 con 0x7f9ef4104a20 2024-09-13T22:20:58.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.410+0000 7f9eeb7fe640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ee006e5f0 0x7f9ee0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:20:58.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.410+0000 7f9ef259c640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ee006e5f0 0x7f9ee0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:20:58.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.410+0000 7f9eeb7fe640 1 -- 172.21.15.89:0/145913916 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f9edc0af910 con 0x7f9ef4104a20 2024-09-13T22:20:58.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.411+0000 7f9ef259c640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ee006e5f0 0x7f9ee0070ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009890 tx=0x7f9ee4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:20:58.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.415+0000 7f9eeb7fe640 1 -- 172.21.15.89:0/145913916 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9edc0788e0 con 0x7f9ef4104a20 2024-09-13T22:20:58.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.612+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f9ef40fef00 con 0x7f9ef4104a20 2024-09-13T22:20:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.613+0000 7f9eeb7fe640 1 -- 172.21.15.89:0/145913916 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v33) v1 ==== 107+0+4392 (secure 0 0 0) 0x7f9edc07bfa0 con 0x7f9ef4104a20 2024-09-13T22:20:58.614 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:20:58.614 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":27,"btime":"2024-09-13T22:17:53:787017+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44291,"name":"cephfs.smithi159.hqlvpx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6825/1327575252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1327575252},{"type":"v1","addr":"172.21.15.159:6825","nonce":1327575252}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:17:53.787001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:20:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 27 2024-09-13T22:20:58.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ee006e5f0 msgr2=0x7f9ee0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:58.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ee006e5f0 0x7f9ee0070ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009890 tx=0x7f9ee4008040 comp rx=0 tx=0).stop 2024-09-13T22:20:58.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef4104a20 msgr2=0x7f9ef419bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:20:58.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef4104a20 0x7f9ef419bea0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9edc02a9c0 tx=0x7f9edc0055a0 comp rx=0 tx=0).stop 2024-09-13T22:20:58.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 shutdown_connections 2024-09-13T22:20:58.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9ee006e5f0 0x7f9ee0070ab0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:58.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef4104a20 0x7f9ef419bea0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:58.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 --2- 172.21.15.89:0/145913916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef40fea20 0x7f9ef419b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:20:58.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 >> 172.21.15.89:0/145913916 conn(0x7f9ef40fa700 msgr2=0x7f9ef4068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:20:58.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 shutdown_connections 2024-09-13T22:20:58.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:20:58.615+0000 7f9ef8aba640 1 -- 172.21.15.89:0/145913916 wait complete. 2024-09-13T22:20:59.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:58 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/145913916' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T22:20:59.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:58 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/145913916' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T22:20:59.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-13T22:20:59.500 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:20:59.967 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:20:59 smithi089 ceph-mon[109939]: pgmap v301: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:00.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:20:59 smithi159 ceph-mon[82000]: pgmap v301: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:01.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.102+0000 7fb6929de640 1 -- 172.21.15.89:0/173518818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 msgr2=0x7fb68c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:01.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.102+0000 7fb6929de640 1 --2- 172.21.15.89:0/173518818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 0x7fb68c1047a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb680009880 tx=0x7fb68002a4a0 comp rx=0 tx=0).stop 2024-09-13T22:21:01.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.102+0000 7fb6929de640 1 -- 172.21.15.89:0/173518818 shutdown_connections 2024-09-13T22:21:01.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.102+0000 7fb6929de640 1 --2- 172.21.15.89:0/173518818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 0x7fb68c1047a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:01.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.102+0000 7fb6929de640 1 --2- 172.21.15.89:0/173518818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c0ffda0 0x7fb68c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:01.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.102+0000 7fb6929de640 1 -- 172.21.15.89:0/173518818 >> 172.21.15.89:0/173518818 conn(0x7fb68c0fb840 msgr2=0x7fb68c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.102+0000 7fb6929de640 1 -- 172.21.15.89:0/173518818 shutdown_connections 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.102+0000 7fb6929de640 1 -- 172.21.15.89:0/173518818 wait complete. 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.103+0000 7fb6929de640 1 Processor -- start 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.103+0000 7fb6929de640 1 -- start start 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.103+0000 7fb6929de640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c0ffda0 0x7fb68c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.103+0000 7fb6929de640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 0x7fb68c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.103+0000 7fb6929de640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c073230 con 0x7fb68c100750 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.103+0000 7fb6929de640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c073370 con 0x7fb68c0ffda0 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.103+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 0x7fb68c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 0x7fb68c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58830/0 (socket says 172.21.15.89:58830) 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb68b7fe640 1 -- 172.21.15.89:0/1658110235 learned_addr learned my addr 172.21.15.89:0/1658110235 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb68bfff640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c0ffda0 0x7fb68c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb68b7fe640 1 -- 172.21.15.89:0/1658110235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c0ffda0 msgr2=0x7fb68c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb68b7fe640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c0ffda0 0x7fb68c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb68b7fe640 1 -- 172.21.15.89:0/1658110235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680009560 con 0x7fb68c100750 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb68bfff640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c0ffda0 0x7fb68c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb68b7fe640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 0x7fb68c072cf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb68002a9c0 tx=0x7fb6800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb6897fa640 1 -- 172.21.15.89:0/1658110235 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb680004aa0 con 0x7fb68c100750 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c0735f0 con 0x7fb68c100750 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb6897fa640 1 -- 172.21.15.89:0/1658110235 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb680004c00 con 0x7fb68c100750 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb6897fa640 1 -- 172.21.15.89:0/1658110235 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb680003980 con 0x7fb68c100750 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.104+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c1a2000 con 0x7fb68c100750 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.105+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c101280 con 0x7fb68c100750 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.106+0000 7fb6897fa640 1 -- 172.21.15.89:0/1658110235 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb680003bf0 con 0x7fb68c100750 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.106+0000 7fb6897fa640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb67406e5f0 0x7fb674070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.106+0000 7fb68bfff640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb67406e5f0 0x7fb674070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:01.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.106+0000 7fb6897fa640 1 -- 172.21.15.89:0/1658110235 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fb6800af8a0 con 0x7fb68c100750 2024-09-13T22:21:01.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.107+0000 7fb68bfff640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb67406e5f0 0x7fb674070ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0058c0 tx=0x7fb67c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:01.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.110+0000 7fb6897fa640 1 -- 172.21.15.89:0/1658110235 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb680078870 con 0x7fb68c100750 2024-09-13T22:21:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.310+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fb68c100180 con 0x7fb68c100750 2024-09-13T22:21:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.310+0000 7fb6897fa640 1 -- 172.21.15.89:0/1658110235 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v33) v1 ==== 107+0+4396 (secure 0 0 0) 0x7fb68007bf30 con 0x7fb68c100750 2024-09-13T22:21:01.311 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:21:01.312 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":28,"btime":"2024-09-13T22:18:01:379092+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44291,"name":"cephfs.smithi159.hqlvpx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6825/1327575252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1327575252},{"type":"v1","addr":"172.21.15.159:6825","nonce":1327575252}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:18:00.915101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":16,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:21:01.312 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 28 2024-09-13T22:21:01.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb67406e5f0 msgr2=0x7fb674070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:01.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb67406e5f0 0x7fb674070ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0058c0 tx=0x7fb67c005850 comp rx=0 tx=0).stop 2024-09-13T22:21:01.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 msgr2=0x7fb68c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:01.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 0x7fb68c072cf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb68002a9c0 tx=0x7fb6800055a0 comp rx=0 tx=0).stop 2024-09-13T22:21:01.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 shutdown_connections 2024-09-13T22:21:01.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7fb67406e5f0 0x7fb674070ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:01.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb68c100750 0x7fb68c072cf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:01.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 --2- 172.21.15.89:0/1658110235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c0ffda0 0x7fb68c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:01.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 >> 172.21.15.89:0/1658110235 conn(0x7fb68c0fb840 msgr2=0x7fb68c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:01.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 shutdown_connections 2024-09-13T22:21:01.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:01.312+0000 7fb6929de640 1 -- 172.21.15.89:0/1658110235 wait complete. 2024-09-13T22:21:02.010 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-13T22:21:02.208 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:21:02.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:01 smithi089 ceph-mon[109939]: pgmap v302: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:02.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:01 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1658110235' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T22:21:02.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:01 smithi159 ceph-mon[82000]: pgmap v302: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:02.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:01 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1658110235' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T22:21:04.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.036+0000 7f9776ab7640 1 -- 172.21.15.89:0/3117214344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 msgr2=0x7f97700fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:04.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.036+0000 7f9776ab7640 1 --2- 172.21.15.89:0/3117214344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 0x7f97700fee80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9760009c20 tx=0x7f976002a970 comp rx=0 tx=0).stop 2024-09-13T22:21:04.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.036+0000 7f9776ab7640 1 -- 172.21.15.89:0/3117214344 shutdown_connections 2024-09-13T22:21:04.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.036+0000 7f9776ab7640 1 --2- 172.21.15.89:0/3117214344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 0x7f97700fee80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:04.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.036+0000 7f9776ab7640 1 --2- 172.21.15.89:0/3117214344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9770104a20 0x7f9770104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:04.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.036+0000 7f9776ab7640 1 -- 172.21.15.89:0/3117214344 >> 172.21.15.89:0/3117214344 conn(0x7f97700fa700 msgr2=0x7f97700fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.037+0000 7f9776ab7640 1 -- 172.21.15.89:0/3117214344 shutdown_connections 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.037+0000 7f9776ab7640 1 -- 172.21.15.89:0/3117214344 wait complete. 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.037+0000 7f9776ab7640 1 Processor -- start 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.037+0000 7f9776ab7640 1 -- start start 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.037+0000 7f9776ab7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 0x7f97700fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.037+0000 7f9776ab7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9770104a20 0x7f97700fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.037+0000 7f9776ab7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700fba30 con 0x7f97700fea20 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.037+0000 7f9776ab7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700fbba0 con 0x7f9770104a20 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.037+0000 7f9774853640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 0x7f97700fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f9774853640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 0x7f97700fafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41772/0 (socket says 172.21.15.89:41772) 2024-09-13T22:21:04.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f9774853640 1 -- 172.21.15.89:0/2610195956 learned_addr learned my addr 172.21.15.89:0/2610195956 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f976ffff640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9770104a20 0x7f97700fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f9774853640 1 -- 172.21.15.89:0/2610195956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9770104a20 msgr2=0x7f97700fb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f9774853640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9770104a20 0x7f97700fb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f9774853640 1 -- 172.21.15.89:0/2610195956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009900 con 0x7f97700fea20 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f976ffff640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9770104a20 0x7f97700fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f9774853640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 0x7f97700fafb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f976800c810 tx=0x7f976800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f976dffb640 1 -- 172.21.15.89:0/2610195956 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97680041f0 con 0x7f97700fea20 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97701a1c60 con 0x7f97700fea20 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f976dffb640 1 -- 172.21.15.89:0/2610195956 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9768007e70 con 0x7f97700fea20 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f976dffb640 1 -- 172.21.15.89:0/2610195956 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97680049d0 con 0x7f97700fea20 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.038+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97701a1fc0 con 0x7f97700fea20 2024-09-13T22:21:04.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.040+0000 7f976dffb640 1 -- 172.21.15.89:0/2610195956 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f97680079b0 con 0x7f97700fea20 2024-09-13T22:21:04.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.040+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9770100160 con 0x7f97700fea20 2024-09-13T22:21:04.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.041+0000 7f976dffb640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f975c06e600 0x7f975c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:04.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.041+0000 7f976dffb640 1 -- 172.21.15.89:0/2610195956 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f976808e670 con 0x7f97700fea20 2024-09-13T22:21:04.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.041+0000 7f976ffff640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f975c06e600 0x7f975c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:04.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.041+0000 7f976ffff640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f975c06e600 0x7f975c070ac0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f97700fc730 tx=0x7f9760009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:04.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.045+0000 7f976dffb640 1 -- 172.21.15.89:0/2610195956 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9768057640 con 0x7f97700fea20 2024-09-13T22:21:04.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:03 smithi089 ceph-mon[109939]: pgmap v303: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:04.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.245+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f97700fc4e0 con 0x7f97700fea20 2024-09-13T22:21:04.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.246+0000 7f976dffb640 1 -- 172.21.15.89:0/2610195956 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v33) v1 ==== 107+0+4393 (secure 0 0 0) 0x7f976805ad00 con 0x7f97700fea20 2024-09-13T22:21:04.247 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:21:04.247 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":29,"btime":"2024-09-13T22:18:02:384200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44291,"name":"cephfs.smithi159.hqlvpx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6825/1327575252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1327575252},{"type":"v1","addr":"172.21.15.159:6825","nonce":1327575252}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:18:01.387085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T22:21:04.248 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 29 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.248+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f975c06e600 msgr2=0x7f975c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.248+0000 7f9776ab7640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f975c06e600 0x7f975c070ac0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f97700fc730 tx=0x7f9760009360 comp rx=0 tx=0).stop 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.248+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 msgr2=0x7f97700fafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.248+0000 7f9776ab7640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 0x7f97700fafb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f976800c810 tx=0x7f976800ccd0 comp rx=0 tx=0).stop 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.249+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 shutdown_connections 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.249+0000 7f9776ab7640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f975c06e600 0x7f975c070ac0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.249+0000 7f9776ab7640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9770104a20 0x7f97700fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.249+0000 7f9776ab7640 1 --2- 172.21.15.89:0/2610195956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97700fea20 0x7f97700fafb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.249+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 >> 172.21.15.89:0/2610195956 conn(0x7f97700fa700 msgr2=0x7f9770068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.249+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 shutdown_connections 2024-09-13T22:21:04.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:04.249+0000 7f9776ab7640 1 -- 172.21.15.89:0/2610195956 wait complete. 2024-09-13T22:21:04.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:03 smithi159 ceph-mon[82000]: pgmap v303: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:04.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-13T22:21:05.100 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:21:05.220 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:04 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2610195956' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T22:21:05.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:04 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2610195956' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T22:21:06.211 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:05 smithi089 ceph-mon[109939]: pgmap v304: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:06.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:05 smithi159 ceph-mon[82000]: pgmap v304: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.728+0000 7f9f97017640 1 -- 172.21.15.89:0/2402704567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 msgr2=0x7f9f90104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.728+0000 7f9f97017640 1 --2- 172.21.15.89:0/2402704567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 0x7f9f90104dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009880 tx=0x7f9f7802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.728+0000 7f9f97017640 1 -- 172.21.15.89:0/2402704567 shutdown_connections 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.728+0000 7f9f97017640 1 --2- 172.21.15.89:0/2402704567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900fe9f0 0x7f9f900fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.728+0000 7f9f97017640 1 --2- 172.21.15.89:0/2402704567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 0x7f9f90104dd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.728+0000 7f9f97017640 1 -- 172.21.15.89:0/2402704567 >> 172.21.15.89:0/2402704567 conn(0x7f9f900758a0 msgr2=0x7f9f900fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.728+0000 7f9f97017640 1 -- 172.21.15.89:0/2402704567 shutdown_connections 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.728+0000 7f9f97017640 1 -- 172.21.15.89:0/2402704567 wait complete. 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f97017640 1 Processor -- start 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f97017640 1 -- start start 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f97017640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900fe9f0 0x7f9f900fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f97017640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 0x7f9f900fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f97017640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900fb800 con 0x7f9f901049f0 2024-09-13T22:21:06.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f97017640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900fb940 con 0x7f9f900fe9f0 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f8ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 0x7f9f900fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f8ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 0x7f9f900fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41784/0 (socket says 172.21.15.89:41784) 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f8ffff640 1 -- 172.21.15.89:0/4147777873 learned_addr learned my addr 172.21.15.89:0/4147777873 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f94db3640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900fe9f0 0x7f9f900fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f8ffff640 1 -- 172.21.15.89:0/4147777873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900fe9f0 msgr2=0x7f9f900fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f8ffff640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900fe9f0 0x7f9f900fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f8ffff640 1 -- 172.21.15.89:0/4147777873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f78009560 con 0x7f9f901049f0 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.729+0000 7f9f94db3640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900fe9f0 0x7f9f900fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.730+0000 7f9f8ffff640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 0x7f9f900fb2c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000d6f0 tx=0x7f9f8000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.730+0000 7f9f8dffb640 1 -- 172.21.15.89:0/4147777873 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f80009a30 con 0x7f9f901049f0 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.730+0000 7f9f8dffb640 1 -- 172.21.15.89:0/4147777873 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f800054e0 con 0x7f9f901049f0 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.730+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f901a1ca0 con 0x7f9f901049f0 2024-09-13T22:21:06.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.730+0000 7f9f8dffb640 1 -- 172.21.15.89:0/4147777873 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f80010460 con 0x7f9f901049f0 2024-09-13T22:21:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.730+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f901a20b0 con 0x7f9f901049f0 2024-09-13T22:21:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.731+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f90100130 con 0x7f9f901049f0 2024-09-13T22:21:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.731+0000 7f9f8dffb640 1 -- 172.21.15.89:0/4147777873 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9f80009b90 con 0x7f9f901049f0 2024-09-13T22:21:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.732+0000 7f9f8dffb640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9f7c06e600 0x7f9f7c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.732+0000 7f9f8dffb640 1 -- 172.21.15.89:0/4147777873 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f9f8008e3e0 con 0x7f9f901049f0 2024-09-13T22:21:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.732+0000 7f9f94db3640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9f7c06e600 0x7f9f7c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.732+0000 7f9f94db3640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9f7c06e600 0x7f9f7c070ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f78000c00 tx=0x7f9f780041a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.736+0000 7f9f8dffb640 1 -- 172.21.15.89:0/4147777873 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9f800573b0 con 0x7f9f901049f0 2024-09-13T22:21:06.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.939+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f9f900fee50 con 0x7f9f901049f0 2024-09-13T22:21:06.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.939+0000 7f9f8dffb640 1 -- 172.21.15.89:0/4147777873 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v33) v1 ==== 107+0+4402 (secure 0 0 0) 0x7f9f8005aa70 con 0x7f9f901049f0 2024-09-13T22:21:06.941 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:21:06.941 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":30,"btime":"2024-09-13T22:18:03:389763+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44291,"name":"cephfs.smithi159.hqlvpx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6825/1327575252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1327575252},{"type":"v1","addr":"172.21.15.159:6825","nonce":1327575252}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:18:03.389760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":0,"incarnation":27,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34374,"qdb_cluster":[34374]},"id":1}]} 2024-09-13T22:21:06.941 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 30 2024-09-13T22:21:06.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.941+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9f7c06e600 msgr2=0x7f9f7c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:06.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.941+0000 7f9f97017640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9f7c06e600 0x7f9f7c070ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f78000c00 tx=0x7f9f780041a0 comp rx=0 tx=0).stop 2024-09-13T22:21:06.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.941+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 msgr2=0x7f9f900fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:06.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.941+0000 7f9f97017640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 0x7f9f900fb2c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000d6f0 tx=0x7f9f8000dbb0 comp rx=0 tx=0).stop 2024-09-13T22:21:06.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.942+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 shutdown_connections 2024-09-13T22:21:06.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.942+0000 7f9f97017640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f9f7c06e600 0x7f9f7c070ac0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:06.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.942+0000 7f9f97017640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f901049f0 0x7f9f900fb2c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:06.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.942+0000 7f9f97017640 1 --2- 172.21.15.89:0/4147777873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f900fe9f0 0x7f9f900fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:06.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.942+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 >> 172.21.15.89:0/4147777873 conn(0x7f9f900758a0 msgr2=0x7f9f900fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:06.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.942+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 shutdown_connections 2024-09-13T22:21:06.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:06.942+0000 7f9f97017640 1 -- 172.21.15.89:0/4147777873 wait complete. 2024-09-13T22:21:07.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:06 smithi089 ceph-mon[109939]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:21:07.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:06 smithi159 ceph-mon[82000]: from='mgr.34104 172.21.15.89:0/931924525' entity='mgr.smithi089.naneiw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:21:07.541 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-13T22:21:07.743 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:21:08.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:07 smithi089 ceph-mon[109939]: pgmap v305: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:08.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:07 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/4147777873' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T22:21:08.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:07 smithi159 ceph-mon[82000]: pgmap v305: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:08.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:07 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/4147777873' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T22:21:09.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 -- 172.21.15.89:0/486435227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 msgr2=0x7f99f40feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 --2- 172.21.15.89:0/486435227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 0x7f99f40feea0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009880 tx=0x7f99dc02a4a0 comp rx=0 tx=0).stop 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 -- 172.21.15.89:0/486435227 shutdown_connections 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 --2- 172.21.15.89:0/486435227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 0x7f99f40feea0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 --2- 172.21.15.89:0/486435227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f4104a40 0x7f99f4104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 -- 172.21.15.89:0/486435227 >> 172.21.15.89:0/486435227 conn(0x7f99f40fa700 msgr2=0x7f99f40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 -- 172.21.15.89:0/486435227 shutdown_connections 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 -- 172.21.15.89:0/486435227 wait complete. 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 Processor -- start 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.517+0000 7f99f8dcd640 1 -- start start 2024-09-13T22:21:09.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f8dcd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 0x7f99f419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f8dcd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f4104a40 0x7f99f419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f8dcd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f419c310 con 0x7f99f40fea40 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f8dcd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4195930 con 0x7f99f4104a40 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 0x7f99f419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 0x7f99f419b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41808/0 (socket says 172.21.15.89:41808) 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f259c640 1 -- 172.21.15.89:0/1387967046 learned_addr learned my addr 172.21.15.89:0/1387967046 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99ebfff640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f4104a40 0x7f99f419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f259c640 1 -- 172.21.15.89:0/1387967046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f4104a40 msgr2=0x7f99f419bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f259c640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f4104a40 0x7f99f419bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f259c640 1 -- 172.21.15.89:0/1387967046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc009560 con 0x7f99f40fea40 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f259c640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 0x7f99f419b840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99e400c8a0 tx=0x7f99e400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99eb7fe640 1 -- 172.21.15.89:0/1387967046 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e4007b80 con 0x7f99f40fea40 2024-09-13T22:21:09.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99eb7fe640 1 -- 172.21.15.89:0/1387967046 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99e4007ce0 con 0x7f99f40fea40 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f4195c10 con 0x7f99f40fea40 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99eb7fe640 1 -- 172.21.15.89:0/1387967046 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e4018810 con 0x7f99f40fea40 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.518+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f4196130 con 0x7f99f40fea40 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.520+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f4100180 con 0x7f99f40fea40 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.520+0000 7f99eb7fe640 1 -- 172.21.15.89:0/1387967046 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f99e4018970 con 0x7f99f40fea40 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.520+0000 7f99eb7fe640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99e006e5f0 0x7f99e0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.520+0000 7f99eb7fe640 1 -- 172.21.15.89:0/1387967046 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f99e408e8b0 con 0x7f99f40fea40 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.521+0000 7f99ebfff640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99e006e5f0 0x7f99e0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.521+0000 7f99ebfff640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99e006e5f0 0x7f99e0070ab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009230 tx=0x7f99dc0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:09.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.525+0000 7f99eb7fe640 1 -- 172.21.15.89:0/1387967046 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f99e4057900 con 0x7f99f40fea40 2024-09-13T22:21:09.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.725+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f99f40feea0 con 0x7f99f40fea40 2024-09-13T22:21:09.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.726+0000 7f99eb7fe640 1 -- 172.21.15.89:0/1387967046 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v33) v1 ==== 107+0+5249 (secure 0 0 0) 0x7f99e405afc0 con 0x7f99f40fea40 2024-09-13T22:21:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:21:09.728 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":31,"btime":"2024-09-13T22:18:06:404570+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44291,"name":"cephfs.smithi159.hqlvpx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6825/1327575252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1327575252},{"type":"v1","addr":"172.21.15.159:6825","nonce":1327575252}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44321,"name":"cephfs.smithi159.rowsot","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/916810058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":916810058},{"type":"v1","addr":"172.21.15.159:6827","nonce":916810058}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:18:03.389760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":0,"incarnation":27,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34374,"qdb_cluster":[34374]},"id":1}]} 2024-09-13T22:21:09.728 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 31 2024-09-13T22:21:09.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99e006e5f0 msgr2=0x7f99e0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:09.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99e006e5f0 0x7f99e0070ab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009230 tx=0x7f99dc0058d0 comp rx=0 tx=0).stop 2024-09-13T22:21:09.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 msgr2=0x7f99f419b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:09.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 0x7f99f419b840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99e400c8a0 tx=0x7f99e400cd60 comp rx=0 tx=0).stop 2024-09-13T22:21:09.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 shutdown_connections 2024-09-13T22:21:09.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f99e006e5f0 0x7f99e0070ab0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:09.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99f4104a40 0x7f99f419bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:09.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 --2- 172.21.15.89:0/1387967046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f40fea40 0x7f99f419b840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:09.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 >> 172.21.15.89:0/1387967046 conn(0x7f99f40fa700 msgr2=0x7f99f4068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:09.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 shutdown_connections 2024-09-13T22:21:09.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:09.728+0000 7f99f8dcd640 1 -- 172.21.15.89:0/1387967046 wait complete. 2024-09-13T22:21:09.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:09 smithi089 ceph-mon[109939]: pgmap v306: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:09.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:09 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/1387967046' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T22:21:10.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:09 smithi159 ceph-mon[82000]: pgmap v306: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:10.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:09 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/1387967046' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T22:21:10.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-13T22:21:10.630 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:21:12.089 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:11 smithi089 ceph-mon[109939]: pgmap v307: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:12.261 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:11 smithi159 ceph-mon[82000]: pgmap v307: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:12.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.317+0000 7f7459b12640 1 -- 172.21.15.89:0/3318197573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454101610 msgr2=0x7f7454109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.317+0000 7f7459b12640 1 --2- 172.21.15.89:0/3318197573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454101610 0x7f7454109b00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f74480098b0 tx=0x7f744802a4d0 comp rx=0 tx=0).stop 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.317+0000 7f7459b12640 1 -- 172.21.15.89:0/3318197573 shutdown_connections 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.317+0000 7f7459b12640 1 --2- 172.21.15.89:0/3318197573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454101610 0x7f7454109b00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.317+0000 7f7459b12640 1 --2- 172.21.15.89:0/3318197573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7454100c60 0x7f7454101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.317+0000 7f7459b12640 1 -- 172.21.15.89:0/3318197573 >> 172.21.15.89:0/3318197573 conn(0x7f74540fa730 msgr2=0x7f74540fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.317+0000 7f7459b12640 1 -- 172.21.15.89:0/3318197573 shutdown_connections 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.317+0000 7f7459b12640 1 -- 172.21.15.89:0/3318197573 wait complete. 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.318+0000 7f7459b12640 1 Processor -- start 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.318+0000 7f7459b12640 1 -- start start 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.318+0000 7f7459b12640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454100c60 0x7f745419b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:12.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.318+0000 7f7459b12640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7454101610 0x7f745419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.318+0000 7f7459b12640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745419c3e0 con 0x7f7454100c60 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.318+0000 7f7459b12640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7454195970 con 0x7f7454101610 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f74537fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454100c60 0x7f745419b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f74537fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454100c60 0x7f745419b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41826/0 (socket says 172.21.15.89:41826) 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f74537fe640 1 -- 172.21.15.89:0/4218098192 learned_addr learned my addr 172.21.15.89:0/4218098192 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f7452ffd640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7454101610 0x7f745419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f74537fe640 1 -- 172.21.15.89:0/4218098192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7454101610 msgr2=0x7f745419bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f74537fe640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7454101610 0x7f745419bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f74537fe640 1 -- 172.21.15.89:0/4218098192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7448009560 con 0x7f7454100c60 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f7452ffd640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7454101610 0x7f745419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f74537fe640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454100c60 0x7f745419b880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f744400ea00 tx=0x7f744400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f7450ff9640 1 -- 172.21.15.89:0/4218098192 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f744400cd50 con 0x7f7454100c60 2024-09-13T22:21:12.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7454195c50 con 0x7f7454100c60 2024-09-13T22:21:12.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f7450ff9640 1 -- 172.21.15.89:0/4218098192 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7444005020 con 0x7f7454100c60 2024-09-13T22:21:12.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f7450ff9640 1 -- 172.21.15.89:0/4218098192 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74440116a0 con 0x7f7454100c60 2024-09-13T22:21:12.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.319+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7454196170 con 0x7f7454100c60 2024-09-13T22:21:12.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.320+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7454068d30 con 0x7f7454100c60 2024-09-13T22:21:12.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.321+0000 7f7450ff9640 1 -- 172.21.15.89:0/4218098192 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7444005190 con 0x7f7454100c60 2024-09-13T22:21:12.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.322+0000 7f7450ff9640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f743c06e5f0 0x7f743c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:12.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.322+0000 7f7450ff9640 1 -- 172.21.15.89:0/4218098192 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f744408ec00 con 0x7f7454100c60 2024-09-13T22:21:12.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.322+0000 7f7452ffd640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f743c06e5f0 0x7f743c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:12.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.322+0000 7f7452ffd640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f743c06e5f0 0x7f743c070ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7448009230 tx=0x7f7448005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:12.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.326+0000 7f7450ff9640 1 -- 172.21.15.89:0/4218098192 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7444094020 con 0x7f7454100c60 2024-09-13T22:21:12.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.528+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f7454104340 con 0x7f7454100c60 2024-09-13T22:21:12.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.528+0000 7f7450ff9640 1 -- 172.21.15.89:0/4218098192 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v33) v1 ==== 107+0+5249 (secure 0 0 0) 0x7f7444057bd0 con 0x7f7454100c60 2024-09-13T22:21:12.530 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T22:21:12.530 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":32,"btime":"2024-09-13T22:18:13:096272+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi089.egpifu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/246571303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":246571303},{"type":"v1","addr":"172.21.15.89:6829","nonce":246571303}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44291,"name":"cephfs.smithi159.hqlvpx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6825/1327575252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1327575252},{"type":"v1","addr":"172.21.15.159:6825","nonce":1327575252}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44321,"name":"cephfs.smithi159.rowsot","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/916810058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":916810058},{"type":"v1","addr":"172.21.15.159:6827","nonce":916810058}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T22:06:14.394509+0000","modified":"2024-09-13T22:18:12.099018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi089.euhfjz","rank":0,"incarnation":27,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6827/3405070026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3405070026},{"type":"v1","addr":"172.21.15.89:6827","nonce":3405070026}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34374,"qdb_cluster":[34374]},"id":1}]} 2024-09-13T22:21:12.530 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 32 2024-09-13T22:21:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f743c06e5f0 msgr2=0x7f743c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f743c06e5f0 0x7f743c070ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7448009230 tx=0x7f7448005a20 comp rx=0 tx=0).stop 2024-09-13T22:21:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454100c60 msgr2=0x7f745419b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454100c60 0x7f745419b880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f744400ea00 tx=0x7f744400eec0 comp rx=0 tx=0).stop 2024-09-13T22:21:12.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 shutdown_connections 2024-09-13T22:21:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f743c06e5f0 0x7f743c070ab0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7454101610 0x7f745419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 --2- 172.21.15.89:0/4218098192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454100c60 0x7f745419b880 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 >> 172.21.15.89:0/4218098192 conn(0x7f74540fa730 msgr2=0x7f7454101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 shutdown_connections 2024-09-13T22:21:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:12.531+0000 7f7459b12640 1 -- 172.21.15.89:0/4218098192 wait complete. 2024-09-13T22:21:13.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:12 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/4218098192' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T22:21:13.164 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T22:21:13.175 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T22:21:13.175 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:21:13.175 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T22:21:13.194 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T22:21:13.194 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T22:21:13.251 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T22:21:13.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:12 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/4218098192' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T22:21:13.505 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:21:14.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:13 smithi089 ceph-mon[109939]: pgmap v308: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:14.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:13 smithi159 ceph-mon[82000]: pgmap v308: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:15.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 -- 172.21.15.89:0/719299048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 msgr2=0x7f2e500fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:15.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 --2- 172.21.15.89:0/719299048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 0x7f2e500fee50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009880 tx=0x7f2e3802a4a0 comp rx=0 tx=0).stop 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 -- 172.21.15.89:0/719299048 shutdown_connections 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 --2- 172.21.15.89:0/719299048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 0x7f2e500fee50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 --2- 172.21.15.89:0/719299048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e501049f0 0x7f2e50104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 -- 172.21.15.89:0/719299048 >> 172.21.15.89:0/719299048 conn(0x7f2e500758a0 msgr2=0x7f2e500fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 -- 172.21.15.89:0/719299048 shutdown_connections 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 -- 172.21.15.89:0/719299048 wait complete. 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 Processor -- start 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 -- start start 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 0x7f2e5019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e501049f0 0x7f2e5019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50195900 con 0x7f2e500fe9f0 2024-09-13T22:21:15.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e56bb7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50195a70 con 0x7f2e501049f0 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.251+0000 7f2e54953640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 0x7f2e5019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e54953640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 0x7f2e5019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40232/0 (socket says 172.21.15.89:40232) 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e54953640 1 -- 172.21.15.89:0/2895862224 learned_addr learned my addr 172.21.15.89:0/2895862224 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e4ffff640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e501049f0 0x7f2e5019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e54953640 1 -- 172.21.15.89:0/2895862224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e501049f0 msgr2=0x7f2e5019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e54953640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e501049f0 0x7f2e5019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e54953640 1 -- 172.21.15.89:0/2895862224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e38009560 con 0x7f2e500fe9f0 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e4ffff640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e501049f0 0x7f2e5019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e54953640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 0x7f2e5019b810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000c8f0 tx=0x7f2e4000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e4dffb640 1 -- 172.21.15.89:0/2895862224 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e40007b80 con 0x7f2e500fe9f0 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e4dffb640 1 -- 172.21.15.89:0/2895862224 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e400054e0 con 0x7f2e500fe9f0 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e4dffb640 1 -- 172.21.15.89:0/2895862224 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e4000f450 con 0x7f2e500fe9f0 2024-09-13T22:21:15.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e50195d50 con 0x7f2e500fe9f0 2024-09-13T22:21:15.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.252+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e50196250 con 0x7f2e500fe9f0 2024-09-13T22:21:15.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.253+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e50100130 con 0x7f2e500fe9f0 2024-09-13T22:21:15.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.254+0000 7f2e4dffb640 1 -- 172.21.15.89:0/2895862224 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2e40004f60 con 0x7f2e500fe9f0 2024-09-13T22:21:15.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.254+0000 7f2e4dffb640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2e3c06e5f0 0x7f2e3c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:15.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.254+0000 7f2e4dffb640 1 -- 172.21.15.89:0/2895862224 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f2e4008e6a0 con 0x7f2e500fe9f0 2024-09-13T22:21:15.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.254+0000 7f2e4ffff640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2e3c06e5f0 0x7f2e3c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:15.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.255+0000 7f2e4ffff640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2e3c06e5f0 0x7f2e3c070ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e38000c00 tx=0x7f2e38005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:15.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.259+0000 7f2e4dffb640 1 -- 172.21.15.89:0/2895862224 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2e40057670 con 0x7f2e500fe9f0 2024-09-13T22:21:15.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.436+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e50196520 con 0x7f2e500fe9f0 2024-09-13T22:21:15.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.436+0000 7f2e4dffb640 1 -- 172.21.15.89:0/2895862224 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v96) v1 ==== 81+0+2434 (secure 0 0 0) 0x7f2e4005ad30 con 0x7f2e500fe9f0 2024-09-13T22:21:15.438 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6825/782752998 2024-09-14T22:17:29.966904+0000 2024-09-13T22:21:15.438 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/4031420145 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:15.438 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/4031420145 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:15.438 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3285075130 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:15.438 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/1295505650 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:15.438 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6824/782752998 2024-09-14T22:17:29.966904+0000 2024-09-13T22:21:15.438 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6826/216662831 2024-09-14T22:06:31.529685+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/2422912912 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/2476248652 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6829/1500548398 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/2476248652 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/801083302 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/2892493712 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/748057153 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1244250966 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/2352924949 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/1295505650 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6828/1500548398 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/3305276684 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1863857877 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:15.439 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1858361029 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6827/216662831 2024-09-14T22:06:31.529685+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/3305276684 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1753927941 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3017475793 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/523992665 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/512897293 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6826/2640700709 2024-09-14T22:17:53.780003+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/268036096 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/958685779 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3806822510 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/1940163960 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6827/2640700709 2024-09-14T22:17:53.780003+0000 2024-09-13T22:21:15.440 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/3920137844 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:15.441 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/1940163960 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:15.441 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/1587602815 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:15.441 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3358437000 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:15.441 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1019473844 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:15.441 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/2060117181 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:15.441 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/1417427949 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:15.441 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3559780592 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:listed 41 entries 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.438+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2e3c06e5f0 msgr2=0x7f2e3c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.438+0000 7f2e56bb7640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2e3c06e5f0 0x7f2e3c070ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e38000c00 tx=0x7f2e38005e60 comp rx=0 tx=0).stop 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.438+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 msgr2=0x7f2e5019b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.438+0000 7f2e56bb7640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 0x7f2e5019b810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000c8f0 tx=0x7f2e4000cdb0 comp rx=0 tx=0).stop 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.439+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 shutdown_connections 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.439+0000 7f2e56bb7640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f2e3c06e5f0 0x7f2e3c070ab0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.439+0000 7f2e56bb7640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e501049f0 0x7f2e5019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.439+0000 7f2e56bb7640 1 --2- 172.21.15.89:0/2895862224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e500fe9f0 0x7f2e5019b810 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.439+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 >> 172.21.15.89:0/2895862224 conn(0x7f2e500758a0 msgr2=0x7f2e50102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:15.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.439+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 shutdown_connections 2024-09-13T22:21:15.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:15.439+0000 7f2e56bb7640 1 -- 172.21.15.89:0/2895862224 wait complete. 2024-09-13T22:21:15.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:15 smithi089 ceph-mon[109939]: pgmap v309: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:15.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:15 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/2895862224' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T22:21:16.047 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T22:21:16.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:16.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T22:21:16.076 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:21:16.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:16.077 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T22:21:16.144 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:21:16.144 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T22:21:16.165 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-13T22:21:16.165 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T22:21:16.225 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 39489060-721b-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T22:21:16.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:15 smithi159 ceph-mon[82000]: pgmap v309: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:16.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:15 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/2895862224' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T22:21:16.425 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T22:21:18.129 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:17 smithi089 ceph-mon[109939]: pgmap v310: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.132+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/1782011768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 msgr2=0x7f7ae00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.132+0000 7f7ae6b8e640 1 --2- 172.21.15.89:0/1782011768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 0x7f7ae00fee50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009c20 tx=0x7f7ad402a970 comp rx=0 tx=0).stop 2024-09-13T22:21:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.132+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/1782011768 shutdown_connections 2024-09-13T22:21:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.132+0000 7f7ae6b8e640 1 --2- 172.21.15.89:0/1782011768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 0x7f7ae00fee50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 --2- 172.21.15.89:0/1782011768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae01049f0 0x7f7ae0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/1782011768 >> 172.21.15.89:0/1782011768 conn(0x7f7ae00758a0 msgr2=0x7f7ae00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/1782011768 shutdown_connections 2024-09-13T22:21:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/1782011768 wait complete. 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 Processor -- start 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 -- start start 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 0x7f7ae019b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae01049f0 0x7f7ae019be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae019c4b0 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae6b8e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae0195a40 con 0x7f7ae01049f0 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae492a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 0x7f7ae019b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.133+0000 7f7ae492a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 0x7f7ae019b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40252/0 (socket says 172.21.15.89:40252) 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7ae492a640 1 -- 172.21.15.89:0/161133656 learned_addr learned my addr 172.21.15.89:0/161133656 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7adffff640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae01049f0 0x7f7ae019be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7ae492a640 1 -- 172.21.15.89:0/161133656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae01049f0 msgr2=0x7f7ae019be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7ae492a640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae01049f0 0x7f7ae019be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7ae492a640 1 -- 172.21.15.89:0/161133656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad4009900 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7ae492a640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 0x7f7ae019b950 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000b420 tx=0x7f7ad000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7addffb640 1 -- 172.21.15.89:0/161133656 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad0011800 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7addffb640 1 -- 172.21.15.89:0/161133656 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ad0011e20 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae0195d20 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7addffb640 1 -- 172.21.15.89:0/161133656 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad000f2e0 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.134+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae0196270 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.135+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae0100130 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.136+0000 7f7addffb640 1 -- 172.21.15.89:0/161133656 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7ad0010380 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.136+0000 7f7addffb640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7ac806e5f0 0x7f7ac8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:21:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.136+0000 7f7addffb640 1 -- 172.21.15.89:0/161133656 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f7ad008e1a0 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.136+0000 7f7adffff640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7ac806e5f0 0x7f7ac8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:21:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.137+0000 7f7adffff640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7ac806e5f0 0x7f7ac8070ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0196eb0 tx=0x7f7ad4009820 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:21:18.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.141+0000 7f7addffb640 1 -- 172.21.15.89:0/161133656 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7ad0057170 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:17 smithi159 ceph-mon[82000]: pgmap v310: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:21:18.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.318+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ae00feed0 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.319+0000 7f7addffb640 1 -- 172.21.15.89:0/161133656 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v96) v1 ==== 81+0+2434 (secure 0 0 0) 0x7f7ad005a830 con 0x7f7ae00fe9f0 2024-09-13T22:21:18.320 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6825/782752998 2024-09-14T22:17:29.966904+0000 2024-09-13T22:21:18.320 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/4031420145 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:18.320 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/4031420145 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:18.320 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3285075130 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:18.320 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/1295505650 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:18.320 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6824/782752998 2024-09-14T22:17:29.966904+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6826/216662831 2024-09-14T22:06:31.529685+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/2422912912 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/2476248652 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6829/1500548398 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/2476248652 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/801083302 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/2892493712 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/748057153 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1244250966 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/2352924949 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/1295505650 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:18.321 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6828/1500548398 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/3305276684 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1863857877 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1858361029 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6827/216662831 2024-09-14T22:06:31.529685+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/3305276684 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1753927941 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3017475793 2024-09-14T22:12:36.564117+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/523992665 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/512897293 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6826/2640700709 2024-09-14T22:17:53.780003+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/268036096 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/958685779 2024-09-14T22:01:24.135771+0000 2024-09-13T22:21:18.322 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3806822510 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/1940163960 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:6827/2640700709 2024-09-14T22:17:53.780003+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/3920137844 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/1940163960 2024-09-14T21:59:52.175828+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/1587602815 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3358437000 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1019473844 2024-09-14T22:00:22.356658+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/2060117181 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.159:0/1417427949 2024-09-14T22:09:51.885165+0000 2024-09-13T22:21:18.323 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3559780592 2024-09-14T22:09:11.173226+0000 2024-09-13T22:21:18.324 INFO:teuthology.orchestra.run.smithi089.stderr:listed 41 entries 2024-09-13T22:21:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7ac806e5f0 msgr2=0x7f7ac8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7ac806e5f0 0x7f7ac8070ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0196eb0 tx=0x7f7ad4009820 comp rx=0 tx=0).stop 2024-09-13T22:21:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 msgr2=0x7f7ae019b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:21:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 0x7f7ae019b950 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000b420 tx=0x7f7ad000b8e0 comp rx=0 tx=0).stop 2024-09-13T22:21:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 shutdown_connections 2024-09-13T22:21:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:6800/3113488493,v1:172.21.15.89:6801/3113488493] conn(0x7f7ac806e5f0 0x7f7ac8070ab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:18.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae01049f0 0x7f7ae019be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:18.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 --2- 172.21.15.89:0/161133656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ae00fe9f0 0x7f7ae019b950 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:21:18.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 >> 172.21.15.89:0/161133656 conn(0x7f7ae00758a0 msgr2=0x7f7ae00682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:21:18.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 shutdown_connections 2024-09-13T22:21:18.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T22:21:18.321+0000 7f7ae6b8e640 1 -- 172.21.15.89:0/161133656 wait complete. 2024-09-13T22:21:18.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:18 smithi089 ceph-mon[109939]: from='client.? 172.21.15.89:0/161133656' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T22:21:19.123 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T22:21:19.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:19.123 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T22:21:19.151 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:18 smithi159 ceph-mon[82000]: from='client.? 172.21.15.89:0/161133656' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T22:21:19.159 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2024-09-13T22:21:19.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:19.159 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T22:21:19.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:19.230 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-13T22:21:19.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T22:21:19.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:19.248 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T22:21:19.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:19.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-09-13T22:21:19.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:19.417 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-09-13T22:21:19.436 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T22:21:19.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:19.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T22:21:19.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:21:19.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2024-09-13T22:21:19.603 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T22:21:19.613 INFO:tasks.cephadm:Teardown begin 2024-09-13T22:21:19.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:19.642 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:19.669 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T22:21:19.669 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T22:21:19.697 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T22:21:19.724 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T22:21:19.725 INFO:tasks.cephadm.mon.smithi089:Stopping mon.smithi089... 2024-09-13T22:21:19.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089 2024-09-13T22:21:19.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:19 smithi089 systemd[1]: Stopping Ceph mon.smithi089 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:21:19.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:19 smithi089 ceph-mon[109939]: pgmap v311: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:21:20.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:19 smithi159 ceph-mon[82000]: pgmap v311: 65 pgs: 65 active+clean; 201 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T22:21:20.277 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:20 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089[109935]: 2024-09-13T22:21:20.062+0000 7f7bf03b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi089 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:21:20.278 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:20 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089[109935]: 2024-09-13T22:21:20.062+0000 7f7bf03b8640 -1 mon.smithi089@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T22:21:20.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:20 smithi089 podman[155534]: 2024-09-13 22:21:20.277567144 +0000 UTC m=+0.344025874 container died 6b2c5b0ea3e13e05e9a1eee024fa26a66e5c2d7d800a463cf42a04b0181603f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:21:20.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:20 smithi089 podman[155534]: 2024-09-13 22:21:20.654460323 +0000 UTC m=+0.720919060 container cleanup 6b2c5b0ea3e13e05e9a1eee024fa26a66e5c2d7d800a463cf42a04b0181603f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:21:20.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 22:21:20 smithi089 bash[155534]: ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi089 2024-09-13T22:21:21.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi089.service' 2024-09-13T22:21:21.148 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:21:21.148 INFO:tasks.cephadm.mon.smithi089:Stopped mon.smithi089 2024-09-13T22:21:21.148 INFO:tasks.cephadm.mon.smithi159:Stopping mon.smithi159... 2024-09-13T22:21:21.148 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi159 2024-09-13T22:21:21.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:21 smithi159 systemd[1]: Stopping Ceph mon.smithi159 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:21:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:21 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159[81996]: 2024-09-13T22:21:21.446+0000 7f7ad555c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi159 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:21:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:21 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159[81996]: 2024-09-13T22:21:21.446+0000 7f7ad555c640 -1 mon.smithi159@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T22:21:21.759 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:21 smithi159 podman[118502]: 2024-09-13 22:21:21.660467791 +0000 UTC m=+0.316362955 container died 7e0ece9671a705ca4051bfb8d054e6a1440464017ebea1547b2e2084606eed9c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T22:21:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:22 smithi159 podman[118502]: 2024-09-13 22:21:22.172121738 +0000 UTC m=+0.828016900 container cleanup 7e0ece9671a705ca4051bfb8d054e6a1440464017ebea1547b2e2084606eed9c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T22:21:22.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:22 smithi159 bash[118502]: ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159 2024-09-13T22:21:22.657 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Sep 13 22:21:22 smithi159 podman[118514]: 2024-09-13 22:21:22.406872471 +0000 UTC m=+0.749449470 container remove 7e0ece9671a705ca4051bfb8d054e6a1440464017ebea1547b2e2084606eed9c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-mon-smithi159, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T22:21:22.661 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@mon.smithi159.service' 2024-09-13T22:21:22.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:21:22.713 INFO:tasks.cephadm.mon.smithi159:Stopped mon.smithi159 2024-09-13T22:21:22.713 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T22:21:22.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-39489060-721b-11ef-bceb-c7b262605968@osd.0 2024-09-13T22:21:22.996 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:22 smithi089 systemd[1]: Stopping Ceph osd.0 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:21:23.496 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:23 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[121174]: 2024-09-13T22:21:23.008+0000 7f6caba4e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:21:23.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:23 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[121174]: 2024-09-13T22:21:23.008+0000 7f6caba4e640 -1 osd.0 96 *** Got signal Terminated *** 2024-09-13T22:21:23.497 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:23 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0[121174]: 2024-09-13T22:21:23.008+0000 7f6caba4e640 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:21:28.796 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:28 smithi089 podman[155667]: 2024-09-13 22:21:28.509944289 +0000 UTC m=+5.601860414 container died 6efec6931e208a8a537c3e3e1b0a64f813b3cf0a575221b0572fb459072ba5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-13T22:21:29.170 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:28 smithi089 podman[155667]: 2024-09-13 22:21:28.885004712 +0000 UTC m=+5.976920828 container cleanup 6efec6931e208a8a537c3e3e1b0a64f813b3cf0a575221b0572fb459072ba5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T22:21:29.170 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:28 smithi089 bash[155667]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0 2024-09-13T22:21:29.457 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:29 smithi089 podman[155684]: 2024-09-13 22:21:29.169909326 +0000 UTC m=+0.649273478 container remove 6efec6931e208a8a537c3e3e1b0a64f813b3cf0a575221b0572fb459072ba5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T22:21:29.746 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:29 smithi089 podman[155770]: 2024-09-13 22:21:29.411676551 +0000 UTC m=+0.016017189 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:21:29.746 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:29 smithi089 podman[155770]: 2024-09-13 22:21:29.537602728 +0000 UTC m=+0.141943352 container create 8d58f057e2257d9c435730c7709a90b6d7049241a7bdb82b82b0b70a9fba100a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:21:30.193 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:29 smithi089 podman[155770]: 2024-09-13 22:21:29.824178938 +0000 UTC m=+0.428519575 container init 8d58f057e2257d9c435730c7709a90b6d7049241a7bdb82b82b0b70a9fba100a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:21:30.193 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:29 smithi089 podman[155770]: 2024-09-13 22:21:29.827451744 +0000 UTC m=+0.431792378 container start 8d58f057e2257d9c435730c7709a90b6d7049241a7bdb82b82b0b70a9fba100a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T22:21:30.193 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:29 smithi089 podman[155770]: 2024-09-13 22:21:29.924227155 +0000 UTC m=+0.528567789 container attach 8d58f057e2257d9c435730c7709a90b6d7049241a7bdb82b82b0b70a9fba100a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T22:21:30.193 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 22:21:30 smithi089 podman[155770]: 2024-09-13 22:21:30.017314143 +0000 UTC m=+0.621654781 container died 8d58f057e2257d9c435730c7709a90b6d7049241a7bdb82b82b0b70a9fba100a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T22:21:30.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T22:21:30.695 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:21:30.695 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T22:21:30.695 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T22:21:30.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-39489060-721b-11ef-bceb-c7b262605968@osd.1 2024-09-13T22:21:30.996 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:30 smithi089 systemd[1]: Stopping Ceph osd.1 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:21:31.496 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:31 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[126578]: 2024-09-13T22:21:31.018+0000 7fbd83e85640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:21:31.497 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:31 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[126578]: 2024-09-13T22:21:31.018+0000 7fbd83e85640 -1 osd.1 96 *** Got signal Terminated *** 2024-09-13T22:21:31.497 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:31 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1[126578]: 2024-09-13T22:21:31.018+0000 7fbd83e85640 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:21:36.599 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:36 smithi089 podman[155871]: 2024-09-13 22:21:36.333730845 +0000 UTC m=+5.413447874 container died 3d2a1d778a362e0a524f45b127afc24d58d7f2ec7579b4bea67c8dc7f38ccec8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:21:36.996 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:36 smithi089 podman[155871]: 2024-09-13 22:21:36.698058495 +0000 UTC m=+5.777775521 container cleanup 3d2a1d778a362e0a524f45b127afc24d58d7f2ec7579b4bea67c8dc7f38ccec8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-ecab7be) 2024-09-13T22:21:36.996 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:36 smithi089 bash[155871]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1 2024-09-13T22:21:37.364 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:36 smithi089 podman[155890]: 2024-09-13 22:21:36.999572349 +0000 UTC m=+0.660057765 container remove 3d2a1d778a362e0a524f45b127afc24d58d7f2ec7579b4bea67c8dc7f38ccec8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T22:21:37.637 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:37 smithi089 podman[155978]: 2024-09-13 22:21:37.267149202 +0000 UTC m=+0.016089683 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:21:37.637 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:37 smithi089 podman[155978]: 2024-09-13 22:21:37.384195943 +0000 UTC m=+0.133136411 container create 852d6bb712d9930606789d415cee0c769fc266286e927e6a8a1670db82c61018 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T22:21:37.637 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:37 smithi089 podman[155978]: 2024-09-13 22:21:37.636908914 +0000 UTC m=+0.385849397 container init 852d6bb712d9930606789d415cee0c769fc266286e927e6a8a1670db82c61018 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T22:21:37.996 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:37 smithi089 podman[155978]: 2024-09-13 22:21:37.640220939 +0000 UTC m=+0.389161423 container start 852d6bb712d9930606789d415cee0c769fc266286e927e6a8a1670db82c61018 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-13T22:21:37.997 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:37 smithi089 podman[155978]: 2024-09-13 22:21:37.711779378 +0000 UTC m=+0.460719859 container attach 852d6bb712d9930606789d415cee0c769fc266286e927e6a8a1670db82c61018 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:21:37.997 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 22:21:37 smithi089 podman[155978]: 2024-09-13 22:21:37.839019435 +0000 UTC m=+0.587959917 container died 852d6bb712d9930606789d415cee0c769fc266286e927e6a8a1670db82c61018 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T22:21:38.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T22:21:38.507 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:21:38.507 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T22:21:38.507 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T22:21:38.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-39489060-721b-11ef-bceb-c7b262605968@osd.2 2024-09-13T22:21:38.747 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:38 smithi089 systemd[1]: Stopping Ceph osd.2 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:21:39.246 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:38 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[131965]: 2024-09-13T22:21:38.852+0000 7f4a02154640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:21:39.246 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:38 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[131965]: 2024-09-13T22:21:38.852+0000 7f4a02154640 -1 osd.2 96 *** Got signal Terminated *** 2024-09-13T22:21:39.246 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:38 smithi089 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2[131965]: 2024-09-13T22:21:38.852+0000 7f4a02154640 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:21:44.579 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:44 smithi089 podman[156080]: 2024-09-13 22:21:44.286690996 +0000 UTC m=+5.560500853 container died ffb294d5c14fc50ea0c373d55564ab19ab463b194698bbe652749a891ae9a7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T22:21:44.929 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:44 smithi089 podman[156080]: 2024-09-13 22:21:44.677768006 +0000 UTC m=+5.951577851 container cleanup ffb294d5c14fc50ea0c373d55564ab19ab463b194698bbe652749a891ae9a7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T22:21:44.930 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:44 smithi089 bash[156080]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2 2024-09-13T22:21:45.246 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:44 smithi089 podman[156095]: 2024-09-13 22:21:44.929340517 +0000 UTC m=+0.639713714 container remove ffb294d5c14fc50ea0c373d55564ab19ab463b194698bbe652749a891ae9a7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T22:21:45.507 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:45 smithi089 podman[156193]: 2024-09-13 22:21:45.239086293 +0000 UTC m=+0.018275859 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:21:45.507 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:45 smithi089 podman[156193]: 2024-09-13 22:21:45.364011445 +0000 UTC m=+0.143201002 container create 29632f996ccea7c59a3be5458c808196ab5eb0b87ab1d770209811f570142c07 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:21:45.792 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:45 smithi089 podman[156193]: 2024-09-13 22:21:45.60027968 +0000 UTC m=+0.379469246 container init 29632f996ccea7c59a3be5458c808196ab5eb0b87ab1d770209811f570142c07 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-13T22:21:45.792 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:45 smithi089 podman[156193]: 2024-09-13 22:21:45.603946626 +0000 UTC m=+0.383136185 container start 29632f996ccea7c59a3be5458c808196ab5eb0b87ab1d770209811f570142c07 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2) 2024-09-13T22:21:45.792 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:45 smithi089 podman[156193]: 2024-09-13 22:21:45.683420971 +0000 UTC m=+0.462610535 container attach 29632f996ccea7c59a3be5458c808196ab5eb0b87ab1d770209811f570142c07 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=) 2024-09-13T22:21:46.096 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 22:21:45 smithi089 podman[156193]: 2024-09-13 22:21:45.803067913 +0000 UTC m=+0.582257478 container died 29632f996ccea7c59a3be5458c808196ab5eb0b87ab1d770209811f570142c07 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:21:46.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T22:21:46.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:21:46.417 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T22:21:46.418 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T22:21:46.418 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-39489060-721b-11ef-bceb-c7b262605968@osd.3 2024-09-13T22:21:46.726 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:46 smithi159 systemd[1]: Stopping Ceph osd.3 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:21:47.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:46 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[91463]: 2024-09-13T22:21:46.724+0000 7f097f37f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:21:47.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:46 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[91463]: 2024-09-13T22:21:46.724+0000 7f097f37f640 -1 osd.3 96 *** Got signal Terminated *** 2024-09-13T22:21:47.009 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:46 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3[91463]: 2024-09-13T22:21:46.724+0000 7f097f37f640 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:21:51.759 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:51 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:51.532+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:26.736967+0000 front 2024-09-13T22:21:26.736978+0000 (oldest deadline 2024-09-13T22:21:50.836784+0000) 2024-09-13T22:21:51.760 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:21:51 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:21:51.334+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:21:52.368 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:52 smithi159 podman[118623]: 2024-09-13 22:21:52.096553532 +0000 UTC m=+5.479150309 container died 6724e7895aeb9e5d1e45ac08afbe35aa6c02b52bd5f37ab62bef439dced6b2f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.build-date=20240731) 2024-09-13T22:21:52.759 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:52 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:52.516+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:26.736967+0000 front 2024-09-13T22:21:26.736978+0000 (oldest deadline 2024-09-13T22:21:50.836784+0000) 2024-09-13T22:21:52.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:21:52 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:21:52.375+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:21:52.760 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:52 smithi159 podman[118623]: 2024-09-13 22:21:52.54177299 +0000 UTC m=+5.924369766 container cleanup 6724e7895aeb9e5d1e45ac08afbe35aa6c02b52bd5f37ab62bef439dced6b2f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T22:21:52.760 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:52 smithi159 bash[118623]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3 2024-09-13T22:21:53.177 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:52 smithi159 podman[118639]: 2024-09-13 22:21:52.826602193 +0000 UTC m=+0.731093390 container remove 6724e7895aeb9e5d1e45ac08afbe35aa6c02b52bd5f37ab62bef439dced6b2f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T22:21:53.506 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:21:53 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:21:53.397+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:21:53.506 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:53 smithi159 podman[118726]: 2024-09-13 22:21:53.079777489 +0000 UTC m=+0.016045718 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:21:53.506 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:53 smithi159 podman[118726]: 2024-09-13 22:21:53.194326515 +0000 UTC m=+0.130594730 container create 3612af77442041c27373198d5a7be8387049a2edf5cd73230bf61499cee108dc (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:21:53.506 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:53 smithi159 podman[118726]: 2024-09-13 22:21:53.421685684 +0000 UTC m=+0.357953899 container init 3612af77442041c27373198d5a7be8387049a2edf5cd73230bf61499cee108dc (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be) 2024-09-13T22:21:53.506 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:53 smithi159 podman[118726]: 2024-09-13 22:21:53.424963202 +0000 UTC m=+0.361231421 container start 3612af77442041c27373198d5a7be8387049a2edf5cd73230bf61499cee108dc (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-09-13T22:21:53.506 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:53 smithi159 podman[118726]: 2024-09-13 22:21:53.505303034 +0000 UTC m=+0.441571258 container attach 3612af77442041c27373198d5a7be8387049a2edf5cd73230bf61499cee108dc (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T22:21:53.759 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:53 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:53.558+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:26.736967+0000 front 2024-09-13T22:21:26.736978+0000 (oldest deadline 2024-09-13T22:21:50.836784+0000) 2024-09-13T22:21:53.759 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 13 22:21:53 smithi159 podman[118726]: 2024-09-13 22:21:53.62142071 +0000 UTC m=+0.557688936 container died 3612af77442041c27373198d5a7be8387049a2edf5cd73230bf61499cee108dc (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-ecab7be) 2024-09-13T22:21:54.259 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T22:21:54.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:21:54.302 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T22:21:54.303 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T22:21:54.303 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-39489060-721b-11ef-bceb-c7b262605968@osd.4 2024-09-13T22:21:54.509 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:54 smithi159 systemd[1]: Stopping Ceph osd.4 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:21:54.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:21:54 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:21:54.376+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:21:55.009 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:54 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:54.533+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:26.736967+0000 front 2024-09-13T22:21:26.736978+0000 (oldest deadline 2024-09-13T22:21:50.836784+0000) 2024-09-13T22:21:55.009 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:54 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:54.687+0000 7fd7460b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:21:55.009 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:54 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:54.687+0000 7fd7460b8640 -1 osd.4 96 *** Got signal Terminated *** 2024-09-13T22:21:55.010 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:54 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:54.687+0000 7fd7460b8640 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:21:55.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:21:55 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:21:55.363+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:21:56.009 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:55 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:55.522+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:26.736967+0000 front 2024-09-13T22:21:26.736978+0000 (oldest deadline 2024-09-13T22:21:50.836784+0000) 2024-09-13T22:21:56.759 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:56 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:56.539+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:26.736967+0000 front 2024-09-13T22:21:26.736978+0000 (oldest deadline 2024-09-13T22:21:50.836784+0000) 2024-09-13T22:21:56.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:21:56 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:21:56.341+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:21:57.759 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:57 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:57.544+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:26.736967+0000 front 2024-09-13T22:21:26.736978+0000 (oldest deadline 2024-09-13T22:21:50.836784+0000) 2024-09-13T22:21:57.759 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:57 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:57.544+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:30.837276+0000 front 2024-09-13T22:21:30.837310+0000 (oldest deadline 2024-09-13T22:21:56.737171+0000) 2024-09-13T22:21:57.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:21:57 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:21:57.309+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:21:58.595 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:21:58 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:21:58.260+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:21:59.009 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:58 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:58.593+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:26.736967+0000 front 2024-09-13T22:21:26.736978+0000 (oldest deadline 2024-09-13T22:21:50.836784+0000) 2024-09-13T22:21:59.009 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:58 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:58.593+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:30.837276+0000 front 2024-09-13T22:21:30.837310+0000 (oldest deadline 2024-09-13T22:21:56.737171+0000) 2024-09-13T22:21:59.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:21:59 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:21:59.255+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:22:00.009 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:59 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:59.560+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:26.736967+0000 front 2024-09-13T22:21:26.736978+0000 (oldest deadline 2024-09-13T22:21:50.836784+0000) 2024-09-13T22:22:00.009 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:21:59 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4[96800]: 2024-09-13T22:21:59.560+0000 7fd73e6b5640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:30.837276+0000 front 2024-09-13T22:21:30.837310+0000 (oldest deadline 2024-09-13T22:21:56.737171+0000) 2024-09-13T22:22:00.357 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:00 smithi159 podman[118831]: 2024-09-13 22:22:00.051386437 +0000 UTC m=+5.488301669 container died 18175379d0ae3318546dda03ff5adf706e8a81fa5f9179894f67ab60fe6af9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T22:22:00.357 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:00 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:00.263+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:22:00.707 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:00 smithi159 podman[118831]: 2024-09-13 22:22:00.454888967 +0000 UTC m=+5.891804186 container cleanup 18175379d0ae3318546dda03ff5adf706e8a81fa5f9179894f67ab60fe6af9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T22:22:00.707 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:00 smithi159 bash[118831]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4 2024-09-13T22:22:01.009 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:00 smithi159 podman[118857]: 2024-09-13 22:22:00.706396378 +0000 UTC m=+0.651966762 container remove 18175379d0ae3318546dda03ff5adf706e8a81fa5f9179894f67ab60fe6af9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T22:22:01.285 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:01 smithi159 podman[118946]: 2024-09-13 22:22:00.92374137 +0000 UTC m=+0.016076791 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:22:01.285 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:01 smithi159 podman[118946]: 2024-09-13 22:22:01.049043063 +0000 UTC m=+0.141378526 container create 89c6fa1160837c74b9d6542f4730db91e19bd2b41ce4951a412ce1ea52400886 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be) 2024-09-13T22:22:01.285 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:01 smithi159 podman[118946]: 2024-09-13 22:22:01.259715612 +0000 UTC m=+0.352051038 container init 89c6fa1160837c74b9d6542f4730db91e19bd2b41ce4951a412ce1ea52400886 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be) 2024-09-13T22:22:01.285 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:01 smithi159 podman[118946]: 2024-09-13 22:22:01.262940991 +0000 UTC m=+0.355276414 container start 89c6fa1160837c74b9d6542f4730db91e19bd2b41ce4951a412ce1ea52400886 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2) 2024-09-13T22:22:01.739 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:01 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:01.283+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:22:01.739 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:01 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:01.283+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:35.719301+0000 front 2024-09-13T22:21:35.719287+0000 (oldest deadline 2024-09-13T22:22:01.019133+0000) 2024-09-13T22:22:01.739 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:01 smithi159 podman[118946]: 2024-09-13 22:22:01.368411827 +0000 UTC m=+0.460747250 container attach 89c6fa1160837c74b9d6542f4730db91e19bd2b41ce4951a412ce1ea52400886 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-13T22:22:01.739 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 13 22:22:01 smithi159 podman[118946]: 2024-09-13 22:22:01.444985261 +0000 UTC m=+0.537320686 container died 89c6fa1160837c74b9d6542f4730db91e19bd2b41ce4951a412ce1ea52400886 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T22:22:02.039 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T22:22:02.080 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:22:02.081 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T22:22:02.081 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T22:22:02.081 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-39489060-721b-11ef-bceb-c7b262605968@osd.5 2024-09-13T22:22:02.270 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:02 smithi159 systemd[1]: Stopping Ceph osd.5 for 39489060-721b-11ef-bceb-c7b262605968... 2024-09-13T22:22:02.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:02 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:02.268+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:22:02.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:02 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:02.268+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:35.719301+0000 front 2024-09-13T22:21:35.719287+0000 (oldest deadline 2024-09-13T22:22:01.019133+0000) 2024-09-13T22:22:02.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:02 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:02.400+0000 7f4f72e3b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:22:02.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:02 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:02.400+0000 7f4f72e3b640 -1 osd.5 96 *** Got signal Terminated *** 2024-09-13T22:22:02.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:02 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:02.400+0000 7f4f72e3b640 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:22:03.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:03 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:03.280+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:22:03.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:03 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:03.280+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:35.719301+0000 front 2024-09-13T22:21:35.719287+0000 (oldest deadline 2024-09-13T22:22:01.019133+0000) 2024-09-13T22:22:04.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:04 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:04.319+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:22:04.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:04 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:04.319+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:35.719301+0000 front 2024-09-13T22:21:35.719287+0000 (oldest deadline 2024-09-13T22:22:01.019133+0000) 2024-09-13T22:22:05.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:05 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:05.285+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:22:05.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:05 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:05.285+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:35.719301+0000 front 2024-09-13T22:21:35.719287+0000 (oldest deadline 2024-09-13T22:22:01.019133+0000) 2024-09-13T22:22:05.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:05 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:05.285+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-13T22:21:41.019614+0000 front 2024-09-13T22:21:41.019566+0000 (oldest deadline 2024-09-13T22:22:04.419868+0000) 2024-09-13T22:22:06.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:06 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:06.319+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:22:06.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:06 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:06.319+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:35.719301+0000 front 2024-09-13T22:21:35.719287+0000 (oldest deadline 2024-09-13T22:22:01.019133+0000) 2024-09-13T22:22:06.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:06 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:06.319+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-13T22:21:41.019614+0000 front 2024-09-13T22:21:41.019566+0000 (oldest deadline 2024-09-13T22:22:04.419868+0000) 2024-09-13T22:22:07.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:07 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:07.344+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T22:21:25.417625+0000 front 2024-09-13T22:21:25.417712+0000 (oldest deadline 2024-09-13T22:21:50.717624+0000) 2024-09-13T22:22:07.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:07 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:07.344+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T22:21:35.719301+0000 front 2024-09-13T22:21:35.719287+0000 (oldest deadline 2024-09-13T22:22:01.019133+0000) 2024-09-13T22:22:07.759 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:07 smithi159 ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5[101977]: 2024-09-13T22:22:07.344+0000 7f4f6b438640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-13T22:21:41.019614+0000 front 2024-09-13T22:21:41.019566+0000 (oldest deadline 2024-09-13T22:22:04.419868+0000) 2024-09-13T22:22:08.193 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:07 smithi159 podman[119052]: 2024-09-13 22:22:07.910406643 +0000 UTC m=+5.611991641 container died c11707471acc02dc3356b91bb7bc71845e8c5f9b0d88e5747e9f2513f3948873 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:22:08.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:08 smithi159 podman[119052]: 2024-09-13 22:22:08.283501019 +0000 UTC m=+5.985086003 container cleanup c11707471acc02dc3356b91bb7bc71845e8c5f9b0d88e5747e9f2513f3948873 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T22:22:08.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:08 smithi159 bash[119052]: ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5 2024-09-13T22:22:08.861 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:08 smithi159 podman[119071]: 2024-09-13 22:22:08.534542374 +0000 UTC m=+0.624318076 container remove c11707471acc02dc3356b91bb7bc71845e8c5f9b0d88e5747e9f2513f3948873 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2) 2024-09-13T22:22:09.180 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:08 smithi159 podman[119159]: 2024-09-13 22:22:08.7634786 +0000 UTC m=+0.015799485 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:22:09.180 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:08 smithi159 podman[119159]: 2024-09-13 22:22:08.868904797 +0000 UTC m=+0.121225678 container create ad65735b944e56d2770c24c4282d7c67d5b989ce23d946f1d601d456c4cc2a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T22:22:09.180 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:09 smithi159 podman[119159]: 2024-09-13 22:22:09.096704173 +0000 UTC m=+0.349025053 container init ad65735b944e56d2770c24c4282d7c67d5b989ce23d946f1d601d456c4cc2a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T22:22:09.180 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:09 smithi159 podman[119159]: 2024-09-13 22:22:09.099897787 +0000 UTC m=+0.352218676 container start ad65735b944e56d2770c24c4282d7c67d5b989ce23d946f1d601d456c4cc2a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=) 2024-09-13T22:22:09.181 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:09 smithi159 podman[119159]: 2024-09-13 22:22:09.179930415 +0000 UTC m=+0.432251306 container attach ad65735b944e56d2770c24c4282d7c67d5b989ce23d946f1d601d456c4cc2a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:22:09.509 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 13 22:22:09 smithi159 podman[119159]: 2024-09-13 22:22:09.291255687 +0000 UTC m=+0.543576576 container died ad65735b944e56d2770c24c4282d7c67d5b989ce23d946f1d601d456c4cc2a28 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-39489060-721b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.license=GPLv2) 2024-09-13T22:22:09.876 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-39489060-721b-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T22:22:09.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:22:09.915 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T22:22:09.915 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 39489060-721b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T22:22:10.068 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:22:35.152 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 39489060-721b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T22:22:35.311 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:22:50.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:22:50.485 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:22:50.513 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T22:22:50.515 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904246/remote/smithi089/crash 2024-09-13T22:22:50.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/crash -- . 2024-09-13T22:22:50.553 INFO:teuthology.orchestra.run.smithi089.stderr:tar: /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T22:22:50.553 INFO:teuthology.orchestra.run.smithi089.stderr:tar: Error is not recoverable: exiting now 2024-09-13T22:22:50.555 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904246/remote/smithi159/crash 2024-09-13T22:22:50.556 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/crash -- . 2024-09-13T22:22:50.580 INFO:teuthology.orchestra.run.smithi159.stderr:tar: /var/lib/ceph/39489060-721b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T22:22:50.580 INFO:teuthology.orchestra.run.smithi159.stderr:tar: Error is not recoverable: exiting now 2024-09-13T22:22:50.581 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T22:22:50.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T22:22:50.645 INFO:tasks.cephadm:Compressing logs... 2024-09-13T22:22:50.645 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T22:22:50.648 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T22:22:50.671 INFO:teuthology.orchestra.run.smithi089.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-13T22:22:50.672 INFO:teuthology.orchestra.run.smithi089.stderr:: No such file or directory 2024-09-13T22:22:50.672 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-13T22:22:50.672 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi089.log 2024-09-13T22:22:50.672 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T22:22:50.672 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi089.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mgr.smithi089.naneiw.log 2024-09-13T22:22:50.672 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.egpifu.log 2024-09-13T22:22:50.677 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mgr.smithi089.naneiw.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T22:22:50.677 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.egpifu.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mon.smithi089.log 2024-09-13T22:22:50.677 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.audit.log: gzip 94.0% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi089.log.gz 2024-09-13T22:22:50.677 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.euhfjz.log 2024-09-13T22:22:50.677 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mon.smithi089.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T22:22:50.677 INFO:teuthology.orchestra.run.smithi159.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi159.rowsot.log 2024-09-13T22:22:50.677 INFO:teuthology.orchestra.run.smithi159.stderr:: No such file or directory 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mon.smithi159.log 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi159.rowsot.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mgr.smithi159.ghpomd.log 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mon.smithi159.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mgr.smithi159.ghpomd.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi159.hqlvpx.log 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi159.hqlvpx.log: 86.1% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T22:22:50.678 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.log 2024-09-13T22:22:50.679 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.5.log: 91.8% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T22:22:50.679 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.euhfjz.log: 94.1% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.egpifu.log.gz 2024-09-13T22:22:50.679 INFO:teuthology.orchestra.run.smithi089.stderr: 91.6% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T22:22:50.680 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi159.log 2024-09-13T22:22:50.683 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.log: 88.1% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T22:22:50.686 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-13T22:22:50.687 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.log 2024-09-13T22:22:50.687 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.cephadm.log: /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.2.log: 87.0% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T22:22:50.691 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T22:22:50.693 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-13T22:22:50.695 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi159.log: 94.0% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi159.log.gz 2024-09-13T22:22:50.695 INFO:teuthology.orchestra.run.smithi159.stderr: 91.1% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T22:22:50.696 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T22:22:50.697 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T22:22:50.699 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T22:22:50.700 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.log: /var/log/ceph/cephadm.log: 88.0% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T22:22:50.708 INFO:teuthology.orchestra.run.smithi159.stderr: 89.1% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mgr.smithi159.ghpomd.log.gz 2024-09-13T22:22:50.717 INFO:teuthology.orchestra.run.smithi089.stderr: 90.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T22:22:50.943 INFO:teuthology.orchestra.run.smithi159.stderr: 92.5% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mon.smithi159.log.gz 2024-09-13T22:22:50.974 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mgr.smithi089.naneiw.log.gz 2024-09-13T22:22:51.509 INFO:teuthology.orchestra.run.smithi089.stderr: 90.6% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mon.smithi089.log.gz 2024-09-13T22:22:54.924 INFO:teuthology.orchestra.run.smithi159.stderr: 93.6% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-13T22:22:56.026 INFO:teuthology.orchestra.run.smithi089.stderr: 93.5% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-13T22:22:56.138 INFO:teuthology.orchestra.run.smithi089.stderr: 94.8% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.euhfjz.log.gz 2024-09-13T22:22:56.202 INFO:teuthology.orchestra.run.smithi159.stderr: 93.6% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-13T22:22:56.506 INFO:teuthology.orchestra.run.smithi089.stderr: 93.1% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-13T22:22:57.010 INFO:teuthology.orchestra.run.smithi089.stderr: 93.4% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-13T22:22:57.012 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-13T22:22:57.012 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m6.352s 2024-09-13T22:22:57.012 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m23.297s 2024-09-13T22:22:57.012 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.855s 2024-09-13T22:22:57.047 INFO:teuthology.orchestra.run.smithi159.stderr: 93.6% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-13T22:22:57.340 INFO:teuthology.orchestra.run.smithi159.stderr: 94.9% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi159.rowsot.log.gz 2024-09-13T22:24:20.102 INFO:teuthology.orchestra.run.smithi159.stderr: 92.5% -- replaced with /var/log/ceph/39489060-721b-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi159.hqlvpx.log.gz 2024-09-13T22:24:20.104 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-09-13T22:24:20.104 INFO:teuthology.orchestra.run.smithi159.stderr:real 1m29.441s 2024-09-13T22:24:20.104 INFO:teuthology.orchestra.run.smithi159.stderr:user 1m48.859s 2024-09-13T22:24:20.104 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m3.463s 2024-09-13T22:24:20.105 INFO:tasks.cephadm:Archiving logs... 2024-09-13T22:24:20.105 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904246/remote/smithi089/log 2024-09-13T22:24:20.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T22:24:23.523 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904246/remote/smithi159/log 2024-09-13T22:24:23.524 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T22:24:40.836 INFO:tasks.cephadm:Removing cluster... 2024-09-13T22:24:40.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 39489060-721b-11ef-bceb-c7b262605968 --force 2024-09-13T22:24:40.991 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:24:41.370 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 39489060-721b-11ef-bceb-c7b262605968 --force 2024-09-13T22:24:41.515 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 39489060-721b-11ef-bceb-c7b262605968 2024-09-13T22:24:41.918 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T22:24:41.918 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T22:24:41.935 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T22:24:41.950 INFO:tasks.cephadm:Teardown complete 2024-09-13T22:24:41.951 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T22:24:41.966 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T22:24:41.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T22:24:41.978 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T22:24:42.087 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T22:24:42.105 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T22:24:42.106 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:24:42.109 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:24:42.121 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-13T22:24:42.124 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-13T22:24:42.126 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T22:24:42.127 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-13T22:24:42.127 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 -110us[ -98us] +/- 39ms 2024-09-13T22:24:42.127 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 +367us[ +367us] +/- 85ms 2024-09-13T22:24:42.127 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -52us[ -40us] +/- 69ms 2024-09-13T22:24:42.128 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:24:42.129 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T22:24:42.130 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-13T22:24:42.130 INFO:teuthology.orchestra.run.smithi159.stdout:^* hv01.front.sepia.ceph.com 3 7 377 107 -127us[ -123us] +/- 38ms 2024-09-13T22:24:42.130 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 +365us[ +365us] +/- 85ms 2024-09-13T22:24:42.130 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 107 -52us[ -52us] +/- 68ms 2024-09-13T22:24:42.130 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:24:42.131 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T22:24:42.150 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T22:24:42.151 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T22:24:42.162 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T22:24:42.249 DEBUG:teuthology.orchestra.run.smithi159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T22:24:42.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:24:42.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:24:42.353 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:24:42.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:24:42.382 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T22:24:42.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T22:24:42.405 INFO:teuthology.task.internal:Duration was 1953.325396 seconds 2024-09-13T22:24:42.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T22:24:42.416 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T22:24:42.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T22:24:42.420 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T22:24:42.455 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:24:42.462 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:24:42.796 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T22:24:42.796 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T22:24:42.796 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T22:24:42.853 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2024-09-13T22:24:42.854 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T22:24:42.882 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T22:24:42.882 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T22:24:42.896 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T22:24:42.949 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T22:24:42.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T22:24:42.963 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T22:24:43.621 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T22:24:43.633 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T22:24:43.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T22:24:43.658 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T22:24:43.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T22:24:43.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T22:24:43.701 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T22:24:43.722 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-13T22:24:43.750 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2024-09-13T22:24:43.763 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T22:24:43.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:24:43.794 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T22:24:43.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:24:43.823 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T22:24:43.836 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T22:24:43.837 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904246/remote/smithi089 2024-09-13T22:24:43.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T22:24:43.886 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904246/remote/smithi159 2024-09-13T22:24:43.886 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T22:24:43.924 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T22:24:43.925 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T22:24:43.927 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T22:24:43.974 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T22:24:43.989 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T22:24:43.989 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T22:24:44.001 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T22:24:44.001 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T22:24:44.003 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T22:24:44.016 INFO:teuthology.orchestra.run.smithi089.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 22:24 /home/ubuntu/cephtest 2024-09-13T22:24:44.029 INFO:teuthology.orchestra.run.smithi159.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 22:24 /home/ubuntu/cephtest 2024-09-13T22:24:44.030 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T22:24:44.042 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T22:24:44.069 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1953.3253955841064 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-13T22:24:44.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T22:24:44.157 INFO:teuthology.run:pass